JP2015208602A - Image display device and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device and an image display method which facilitate an operation for laying out a medical image and changing the number of dividing a layout frame and the size of the layout frame by visualizing a change in a layout while performing an operation for arranging the medical image in a display area.SOLUTION: An instruction position (region division) by a mouse, a layout frame 31b to be used, and the arrangement position of a medical image are associated with one another and are previously stored as layout information in a storage device. When a thumbnail image selected by the mouse is subjected to a drag operation into a medical image display region 52, a CPU displays a layout frame 31b corresponding to the position of a mouse cursor 4 on the basis of the layout information. When a drop operation is successively performed, a selected medical image is arranged in a frame corresponding to the instruction position of the mouse cursor 4 in size corresponding to the layout frame 31b.

Description

  The present invention relates to an image display device and an image display method, and more particularly, to a change in the layout of a medical image.

  Conventionally, PACS (Picture Archiving and Communication System), etc. for storing, browsing, and managing image data generated by various imaging devices such as CR (Computed Radiography), CT (Computed Tomography), and MRI (Magnetic Resonance Imaging) Medical image management systems are used. In such an apparatus for displaying medical images, a technique for laying out a plurality of medical images in a display format that is easy for an operator to browse has been developed. For example, a technique is known in which the entire monitor is divided into layout frames of 1 × 1, 2 × 2, 3 × 3, and the like, and a medical image selected by the operator is laid out with respect to the divided frames (frames). However, in the conventional method, when the medical image is laid out, the operator needs to set the number of divisions and size of the layout frame (frame) in advance, or the operation to call the set layout frame (frame) is necessary. Therefore, the operation is complicated.

  In Patent Document 1, the region segment to which the coordinate value of the display position designated by the drag operation and the drop operation of the target image belongs is determined, and the number of divisions of the display region is changed according to the display layout information corresponding to the region segment, Techniques such as determining an arrangement position of a target image are disclosed.

WO2007 / 141995

  However, in the method of Patent Document 1, it is not possible to confirm during the operation what the display layout information corresponding to the region classification is, and the operator does not change the layout until the drag operation and the drop operation are completed. I can't confirm. Whether it is possible to obtain a desired layout by drop where the target image therefore, it is difficult to recognize while operating.

  The present invention has been made in view of the above-described problems, and makes it possible to visualize a change in layout while performing an operation of placing a medical image in a display area, thereby laying out a medical image and a layout frame ( An object of the present invention is to provide an image display apparatus and an image display method capable of facilitating an operation of changing the division number and size of the frame and reducing the burden on the operator.

  In order to achieve the above-described object, a first invention includes a medical image acquisition unit that acquires a plurality of medical images, a thumbnail image display area that displays selectable thumbnail images of the plurality of medical images, and the medical images. A display unit that forms a medical image display area to be displayed on a display screen; an operation input unit that inputs a selection operation of the thumbnail image and an arrangement position instruction operation that instructs an arrangement position of the medical image; and the operation Selecting a thumbnail image by operating the operation input unit; a storage unit that preliminarily stores layout information that defines a layout frame corresponding to a designated position in the medical image display area by the input unit and an arrangement position of the medical image; In the image selection unit for selecting an image to be displayed in the medical image display area, and during the arrangement position instruction operation after the image selection operation by the operation input unit, A layout frame display unit that displays the layout frame in the medical image display region according to the layout information stored in the storage unit, and a designated position in the medical image display region according to an arrangement position instruction operation by the operation input unit An image display device comprising: an image placement unit that places the medical image in a size corresponding to the layout frame.

  According to a second aspect of the invention, the computer includes a step of acquiring a plurality of medical images, a thumbnail image display area for selectively displaying thumbnail images of the plurality of medical images, and a medical image display area for displaying the medical images. A step of forming on a display screen; a step of inputting an arrangement position instruction operation which is an operation of instructing an arrangement position of the thumbnail image and a medical image; and a display in the medical image display area by the selection operation of the thumbnail image A step of selecting an image to be displayed, a step of displaying the layout frame in the medical image display area according to layout information stored in a storage unit during an arrangement position instruction operation after the image selection operation, and a response to the arrangement position instruction operation The medical image is arranged in a size corresponding to the layout frame at the designated position in the medical image display area. An image display method characterized by performing Tsu and up, the process comprising.

  According to the present invention, a layout change can be visualized during an operation of arranging a medical image in a display area, thereby facilitating an operation of laying out a medical image or changing the number of divisions and size of a layout frame (frame). An image display device and an image display method capable of reducing the burden of the image can be provided.

The figure which shows the structure of the image display apparatus 100 which concerns on this invention. The figure which shows the function structure of the image display apparatus 100 The figure explaining layout frame 31 (31a, 31b) An example of the area division 32 of the medical image display area 52 An example of layout information 30 corresponding to the area section 32 of FIG. Operation flow and screen transition example (Drop operation in area (a)) Operation flow and screen transition example (when drop operation is performed in area (b)) Operation flow and screen transition example (when drop operation is performed in area (f)) Flow chart explaining the flow of image display processing An example of the image search screen 55 Example of initial display screen An example of the area section 32b used in the second embodiment Example of a plurality of layout information 30A and 30B corresponding to the area section 32b of FIG. Flowchart for explaining the flow of image display processing (second embodiment) Example of arranging the layout frame 31d in the upper left frame of the layout frame 31b The figure which shows the state by which the image has been arrange | positioned to the layout frame 31d of FIG. An example of the area section 32c used in the example of arranging the layout frame in the layout frame Screen transition example during pinch-out operation Example of layout information 30C for pinch-out processing Example of layout frame combination when touching the intersection of layout frames Example of layout frame combination when touching the border of the layout frame Flowchart for explaining the flow of layout frame division / combination processing (third embodiment)

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
First, the configuration of a medical image display system 1 to which the image display device 100 of the present invention is applied will be described with reference to FIG.

  As shown in FIG. 1, the image display system 1 includes an image display device 100 having a display device 107 and an input device 109, an image database 111 connected to the image display device 100 via a network 110, and an image photographing device 112. With.

  The image display device 100 is a computer that performs image display processing according to the present invention. As shown in FIG. 1, the image display device 100 includes a CPU (Central Processing Unit) 101, a main memory 102, a storage device 103, a communication interface (communication I / F) 104, a display memory 105, a mouse 108, and other external devices. Interface (I / F) 106, and each unit is connected via a bus 113.

  The CPU 101 calls a program stored in the main memory 102 or the storage device 103 to the work memory area on the RAM of the main memory 102 and executes the program, drives and controls each unit connected via the bus 113, and the image display device Various processes performed by 100 are realized.

  In addition, the CPU 101 executes image display processing (see FIG. 9) for displaying medical images in a predetermined layout. Details of the image display processing will be described later.

  The main memory 102 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The ROM permanently holds a computer boot program, a program such as BIOS, data, and the like. The RAM temporarily stores programs, data, and the like loaded from the ROM, the storage device 103, and the like, and includes a work area used by the CPU 101 for performing various processes.

  The storage device 103 is a storage device that reads and writes data to and from an HDD (hard disk drive) and other recording media, and stores a program executed by the CPU 101, data necessary for program execution, an OS (operating system), and the like. . As for the program, a control program corresponding to the OS and an application program are stored. Each of these program codes is read by the CPU 101 as necessary, transferred to the RAM of the main memory 102, and executed as various means.

The communication I / F 104 includes a communication control device, a communication port, and the like, and mediates communication between the image display device 100 and the network 110. The communication I / F 104 performs communication control with the image database 111, another computer, or an image capturing apparatus 112 such as an X-ray CT apparatus or an MRI apparatus via the network 110.
The I / F 106 is a port for connecting a peripheral device, and transmits / receives data to / from the peripheral device. For example, a pointing device such as a mouse 108 or a stylus pen may be connected via the I / F 106.

  The display memory 105 is a buffer that temporarily accumulates display data input from the CPU 101. The accumulated display data is output to the display device 107 at a predetermined timing.

  The display device 107 includes a display device such as a liquid crystal panel and a CRT monitor, and a logic circuit for executing display processing in cooperation with the display device, and is connected to the CPU 101 via the display memory 105. The display device 107 displays display data stored in the display memory 105 under the control of the CPU 101.

  The input device 109 is an input device such as a keyboard, for example, and outputs various instructions and information input by the operator to the CPU 101. The operator interactively operates the image display device 100 using external devices such as the display device 107, the input device 109, and the mouse 108.

  The network 110 includes various communication networks such as a LAN (Local Area Network), a WAN (Wide Area Network), an intranet, the Internet, and the like, and connects the image database 111, a server, other information devices, and the like to the image display apparatus 100. Mediate.

  The image database 111 stores and stores image data captured by the image capturing device 112. In the image display system 1 shown in FIG. 1, the image database 111 is connected to the image display device 100 via the network 110, but the image database 111 is provided in, for example, the storage device 103 in the image display device 100. May be.

Next, functions provided in the image display apparatus 100 according to the present invention will be described.
FIG. 2 is a diagram illustrating a functional configuration of the image display apparatus 100.
As shown in FIG. 2, the CPU 101 of the image display device 100 reads out and executes a program stored in the storage device 103 to the main memory 102, thereby executing a medical image acquisition unit 21, an image selection unit 22, and a layout frame display unit. 23, the image arrangement unit 24, and the like. In addition, layout information 30 is stored in the storage device 103 (or main memory 102).

  An input signal corresponding to an operation from the operation input unit such as the mouse 108 is input to the image selection unit 22, the layout frame display unit 23, and the image arrangement unit 24 of the CPU 101 via the I / F 106. The CPU 101 calculates position information, a movement amount, a movement direction, and the like of the mouse cursor according to the movement operation of the mouse 108. Various operation signals such as a click operation, a drag operation, and a drop operation are input from the mouse 108. The click operation is an operation for instructing an object by briefly pressing a mouse button. The drag operation is an operation of moving with the mouse button pressed. The drop operation is an operation for stopping the pressing of the mouse button during the drag operation and determining the position of the movement destination. When a touch panel is used instead of the mouse 108 as an operation input unit, operations corresponding to the touch panel such as a pinch out operation and a flick operation can be performed in addition to a touch operation, a drag operation, and a drop operation. An operation signal corresponding to is input to the CPU 101.

  The medical image acquisition unit 21 acquires medical images from the storage device 103, the image database 111, and the like, and stores them in the main memory 102. Medical images are generated by various medical imaging apparatuses such as an X-ray diagnostic apparatus, an X-ray CT apparatus, an MRI apparatus, and an ultrasonic apparatus. In the case of a CT image or the like, since a plurality of tomographic image groups (series images) are associated with one tomographic image, those related images are also acquired together. The medical image acquisition unit 21 desirably displays an image search screen 55 (see FIG. 10) described later on the display device 107 so that the operator can search for a desired medical image.

  The image selection unit 22 selects an image to be displayed in the medical image display area 52 formed on the display screen 5 of the display device 107. The operation for selecting an image is, for example, an instruction operation (click operation or drag operation) using the mouse 108.

  The image placement unit 24 selects the image selected by the image selection unit 22 in accordance with a placement position instruction operation (for example, drag and drop operation) performed following the instruction operation, and displays a medical image display area on the display screen 5. 52 at the indicated position.

  During this arrangement position instruction operation, the layout frame display unit 23 displays the layout frame 31 corresponding to the instruction position in the medical image display area 52.

First, the display screen 5 of the display device 107 will be described.
The CPU 101 forms a thumbnail image display area 51 for selectively displaying thumbnail images of medical images on the display screen 5 of the display device 107 and a medical image display area 52 for displaying medical images (FIGS. 6 to 8, FIG. 11 etc.).

  In the thumbnail image display area 51 of the display screen 5, thumbnail images of a plurality of medical images acquired by the medical image acquisition unit 21 are displayed. In the medical image display area 52, a medical image corresponding to the thumbnail image selected by the image selection unit 22 (thumbnail image selected in the thumbnail image display area 51) is displayed so as to be viewable. The medical image displayed in the medical image display area 52 includes the selected medical image and its related image. When there are a plurality of related images, the related images are displayed on the same display position as the selected medical image, or are displayed side by side continuously. It is assumed that how the related image is displayed is set in advance according to the type of image, the purpose of inspection, and the like.

  The layout frame display unit 23 displays the layout frame 31 in the medical image display area 52 according to the layout information 30 during the image placement position instruction operation (drag operation) after the image selection operation by the image selection unit 22.

  As shown in FIG. 3, the layout frame 31 is a frame line for dividing the medical image display area 52 of the display screen 5 into a predetermined number of frames. For example, as shown in FIG. 3A, a layout frame 31a (no division) having a frame number of “1 × 1”, or a layout divided into “2 × 2” vertically and horizontally as shown in FIG. 3B. There is a frame 31b and the like. The number of divisions of the medical image display area 52 and which layout frame to use are defined in the layout information 30 and are determined according to the position of the mouse cursor 4 (area section 32) during the drag operation and drop operation. . The area division 32 is information obtained by dividing the medical image display area 52 into a plurality of areas. FIG. 4 shows an example of the area section 32.

  The area division 32 shown in FIG. 4 is an example in which the medical image display area 52 is divided into 11 areas (a) to (k). The area division 32 in FIG. 4 is an example, and is not limited to this example, and may be divided at another position.

  As shown in FIG. 5, the layout information 30 corresponds to the information on the area classification 32 in the medical image display area 52, the layout frame 31 to be used, the number of divisions 33 in the medical image display area 52, and the image arrangement position 34. Defined.

  For example, in the layout information 30 illustrated in FIG. 5, the area section (a), the layout frame “1 × 1”, the division number “1 × 1”, and the arrangement position “−” are stored in association with each other. When the thumbnail image 61S being selected is dragged and dropped to the position of the area section (a) shown in FIG. 4 (the central part of the medical image display area 52), as shown in FIG. The layout frame 31a of “× 1” is used (FIG. 6B), and the medical image 61 corresponding to the currently selected thumbnail image 61S and its related image are enlarged or reduced in accordance with the size of the frame (one section of the layout frame). This means that the images are arranged in a reduced size (FIG. 6C).

  In the layout information 30 shown in FIG. 5, the area section (b), the layout frame “1 × 2”, the division number “1 × 2”, and the arrangement position “upper side” are associated with each other. As shown in FIG. 7, when the selected thumbnail image 61S is dragged and dropped to the position (b) of the area section shown in FIG. 4, the “1 × 2” layout frame 31c is used. (FIG. 7B) shows that the medical image 61 corresponding to the currently selected thumbnail image 61S and the related image are arranged in the upper frame (FIG. 7C).

  In the layout information 30 shown in FIG. 5, the area section (f), the layout frame “2 × 2”, the division number “2 × 2”, and the arrangement position “upper left” are associated with each other. As shown in FIG. 8, when the currently selected thumbnail image 61S is dragged and dropped to the position (f) of the area section shown in FIG. 4, the “2 × 2” layout frame 31b is used. This shows that the medical image 61 corresponding to the currently selected thumbnail image 61S or its related image is arranged in the upper left frame (FIG. 8C).

  It is desirable that a plurality of layout information 30 is prepared according to the type of image, inspection purpose, etc., and held in the storage device 103. For example, even with the same CT image, it is desirable to prepare different layout information depending on the examination site and purpose, such as the chest and head. In this case, the layout frame display unit 23 and the image arrangement unit 24 select appropriate layout information 30 according to the type of image or the inspection purpose from a plurality of layout information groups stored in the storage device 103.

  As shown in FIG. 6B, FIG. 7B, and FIG. 8B, the layout frame display unit 23 is performing an image arrangement position instruction operation after the image selection operation by the image selection unit 22 (during a drag operation). In addition, the layout frame 31 is displayed in the medical image display area 52 according to the layout information 30 based on the position information of the mouse cursor. Each time the position of the mouse cursor is changed by the drag operation, the layout frame display unit 23 updates the display of the layout frame 31.

  During the drag operation, the layout frame display unit 23 may display the already displayed medical image 60 in a translucent manner with the original image size and layout. By displaying translucently, it is possible to simultaneously confirm an image already arranged and an image to be newly arranged.

  Further, during the drag operation, the layout frame display unit 23 may perform various highlights at the arrangement position when the drop operation is performed according to the layout information based on the position information of the mouse cursor 4. Examples of the highlight display include blinking the arrangement position and displaying an animation for moving the drag icon to the arrangement position.

  The image placement unit 24 places a medical image in a size corresponding to the above-described layout frame at the designated position in the medical image display area 52 in accordance with an image placement position instruction operation (for example, a drag and drop operation). After the image is arranged in the medical image display area 52, the original image 60 displayed in advance may be hidden, or may be displayed on a frame different from the frame where the selected image 61 is arranged. Good.

Next, the procedure of image display processing executed by the image display device 100 will be described.
The CPU 101 of the image display apparatus 100 reads a program and data related to the image display process shown in FIG. 9 from the main memory 102, and executes a process based on the program and data.

  At the start of execution of the image display processing, medical image data to be processed is acquired from the image database 111 or the like via the network 110 and the communication I / F 104 and stored in the storage device 103 of the image display device 100. And

  First, the CPU 101 of the image display apparatus 100 performs an operator login process (step S101). The CPU 101 accepts input of login information such as an operator's user number, user name, password, or biometric information. The CPU 101 acquires user information such as the user name and user level of the operator from the storage device 103 based on the input login information.

  Next, the CPU 101 reads out image information including subject information and examination information related to the medical image from the storage device 103 (step S102), and displays a list on the display device 107 as in the image search screen 55 shown in FIG. (Step S103). The subject information includes information such as a subject number, subject name, sex, age, weight, height, movement method, entrance / exit classification, and special notes. The examination information includes doctor-related information (requested doctor number, requested doctor name, requested department, etc.) and information on a plurality of medical images desired by the doctor (image number, examination part, examination date, examination apparatus, examination part, examination) Method).

10 includes a search condition input field 201, a search button 202, a display button 203, an image information list display field 204, and the like.
When a search condition regarding a desired medical image is input to each search item or free text search item in the search condition input field 201 by the operator and the search button 202 is pressed, the CPU 101 displays an image corresponding to the input search condition. Information is read from the storage device 103 and displayed in a list in the image information list display field 204. When image information is selected from the displayed image information and the display button 203 is pressed (step S104), the CPU 101 reads the image information selected by the operator and the related medical image from the storage device 103, and It displays on the display screen 5 of the display apparatus 103 according to the initial display conditions according to a medical image (step S105).

  FIG. 11 shows an example of a display screen 5a configured by two display devices (the left monitor 107a and the right monitor 107b). For example, it is assumed that medical image display areas 52a and 52b are provided on the left monitor 107a and the right monitor 107b, respectively, and a thumbnail image display area 51 is provided above the left monitor 107a. In the image selection process in step S104, when an image having a plurality of related images such as a CT image is selected, the CPU 101 displays a representative image of the selected image (for example, the first slice) as an initial display of the CT image. CT images) are arranged in the medical image display area 52a of the left monitor 107a, and related images (such as images having different slice positions obtained by the same examination) are arranged in the medical image display area 52b of the right monitor 107b. The initial display layout in FIG. 11 is merely an example, and other layouts may be used.

  When any thumbnail image 61S in the thumbnail image display area 51 is dragged on the display screen 5a (step S106; Yes), the CPU 101 follows the layout information 30 based on the position information of the mouse cursor 4 during the drag operation. The layout frame 31 (31a, 31b, 31c, etc.) is displayed in one of the medical image display areas 52a, 52b (step S107). In the processing of step S107, the CPU 101 discriminates the current area section 32 from the position information of the mouse cursor 4 and refers to the layout information 30 to determine the layout frame 31 and the arrangement position 34 corresponding to the area section 32 currently instructed. Get information. The CPU 101 displays the layout frame 31 (31a, 31b, 31c, etc.) in the medical image display area 52b (or 52a) where the mouse cursor 4 is located during the drag operation according to the acquired information.

  Each time the mouse cursor 4 is moved during the drag operation, the CPU 101 discriminates the area section 32 from the position information of the mouse cursor 4 after the movement, and refers to the layout information 30 to determine the layout frame 31 corresponding to the current area section 32. And the information of the arrangement position 34 is acquired, and the display of the layout frame 31 is updated (Step S108; No → Step S106; Yes → Step S107).

  During the drag operation, the CPU 101 may display the layout frame 31 and display the already displayed medical image 60 in a translucent manner with the original image size and layout. Further, the CPU 101 causes the background of the arrangement position 34 (frame) when the drop operation is performed to blink according to the layout information 30 based on the position information of the mouse cursor 4 or enlarges the drag icon to the arrangement position 34. An animation may be displayed or other various highlights may be displayed.

  When the drop operation is performed (step S108; Yes), the CPU 101 arranges the selected medical image 61 at the arrangement position 34 in the layout frame 31 according to the layout information 30 based on the position information of the mouse cursor 4 at the time of the drop (step S108; Yes). Step S109). At this time, the CPU 101 arranges the medical image 61 in an enlarged or reduced size according to the frame of the layout frame 31 (step S109).

  When the selected medical image 61 has a plurality of related images such as a CT image, the representative image (for example, the image of the first slice) is replaced with a predetermined arrangement position (frame) of the layout frame 31 in the image arrangement processing in step S109. 34. Then, the related images may be sequentially switched and displayed in the same frame in accordance with a predetermined operation such as rotating the mouse wheel.

  When the selected medical image 61 is arranged in the frame of the layout frame 31 of the medical image display area 52 (52a or 52b), the originally arranged medical image 60 may be hidden or the selected medical image 60 may be hidden. You may display on the flame | frame different from the flame | frame in which the image 61 is arrange | positioned.

  Thereafter, when another thumbnail image is dragged (step S106; Yes), the CPU 101 repeatedly executes the processes of steps S107 to S109. That is, the CPU 101 displays the layout frame 31 in the medical image display area 52 according to the layout information 30 based on the position information of the mouse cursor 4 being dragged. When a drop operation is performed, the layout frame 31 is displayed according to the layout information 30 based on the position information of the mouse cursor 4 at the time of dropping, and the selected medical image is arranged at a predetermined arrangement position 34 of the layout frame 31.

  When the drag operation is not performed on the thumbnail image (step S106; No), the series of image display processing shown in FIG. 9 is ended.

  As described above, the image display apparatus 100 according to the present invention acquires a plurality of medical images from the storage device 103 or the like, and displays the thumbnail images side by side in the thumbnail image display area 51 formed on the display screen 5. On the display screen 5, in addition to the thumbnail image display area 51, a medical image display area 52 for displaying a medical image so as to be viewable is formed. When the selected thumbnail image is dragged into the medical image display area 52 by the operation input unit such as the mouse 108, the CPU 101 performs a layout corresponding to the designated position (position of the mouse cursor 4) in the medical image display area 52. A frame 31 is displayed based on the layout information 30. Further, when an image arrangement position instruction operation (drop operation) is performed by the operation input unit, a frame (arrangement position 34) corresponding to the instruction position (instruction position of the mouse cursor) in the medical image display area 52 is set in accordance with the layout frame 31. The selected medical image is arranged in the selected size.

  Since the position indicated by the mouse 108 (region section 32), the layout frame 31 to be used, and the arrangement position 34 of the medical image are associated with each other and defined in advance as layout information 30, and stored in the storage device 103, the operator There is no need to set the number of divisions of the layout frame 31 or the image size. Further, even if an operation for calling the layout frame 31 corresponding to the set division number or the like is not performed, the layout frame can be changed and the image can be arranged by a mouse drag and drop operation. Furthermore, according to the present invention, since the layout frame corresponding to the position of the mouse cursor 4 is displayed during the drag operation, it is easy to recall the layout after the drop operation before performing the drop operation. Therefore, the operator can smoothly arrange and browse medical images in various layout frames with a simple operation.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS.
In the second embodiment, the CPU 101 performs image display processing according to the procedure shown in FIG. 14 by using the area section 32b shown in FIG. 12 and the plurality of layout information 30A and 30B shown in FIG. Note that the area section 32b in FIG. 12 and the layout information in FIG. 13 are examples, and other area sections and layout information may be used.

  In the second embodiment, the storage device 103 of the image display device 100 holds a plurality of layout information 30A and 30B. The layout frame display unit 23 switches the layout information 30 to be applied according to the operation amount of the operation input unit 25 (the movement speed, movement direction, movement amount, or locus of mouse gestures of the mouse cursor 4). For example, different layout information is used when the drag operation is performed slowly and when the drag operation is performed quickly.

  The area section 32b shown in FIG. 12 has areas (a), (j), (k), (l), (m), (n) compared to the area section 32 of the first embodiment shown in FIG. ) Position is different. In addition, the layout information 30A and 30B using the area section 32b in FIG. 12 can be operated in the above-described areas (a), (j), (k), (l), (m), and (n). Different processing (layout information) is applied accordingly. For example, in the layout information 30A and 30B in FIG. 13, different division numbers, layout frames, and arrangement positions are defined in the regions (a), (j), (k), (l), (m), and (n). Has been.

  For example, in a normal drag operation, the CPU 101 performs processing such as layout frame display and image arrangement using the layout information 30A. When the movement amount of the mouse cursor stops for a predetermined time or moves slowly during the drag operation (when the movement amount of the mouse cursor becomes less than a preset threshold value), the process proceeds to process B. In the process B, the CPU 101 uses the layout information 30B to perform processes such as layout frame display and image arrangement.

With reference to FIG. 14, the flow of processing of the second embodiment will be described.
In the flowchart of FIG. 14, the processing from step S201 to step S205 is the same as the processing from step S101 to step S105 of the first embodiment, and thus description thereof is omitted. The display screen 5 (5a) is also provided with a thumbnail image display area 51 and a medical image display area 52 (52a, 52b), as in the first embodiment.

  For example, when the thumbnail image in the thumbnail image display area 51 is dragged into the medical image display area 52 (52a, 52b) on the display screen 5a shown in FIG. 11 (step S206; Yes), the CPU 101 displays the mouse cursor 4 Select the process according to the moving speed.

  That is, if the moving speed of the mouse cursor 4 during the drag operation is equal to or higher than the preset threshold value H (step S207; No), the CPU 101 selects the process A (step S208). The process A is a layout frame display process and an image arrangement process based on the layout information 30A (steps S209 to S211).

  On the other hand, if the mouse cursor 4 is stopped or moved at a speed close to stopping during the drag operation (the movement speed is lower than the preset threshold value H) (step S207; Yes), the CPU 101 performs the process B. Select (step S212). The process B is a layout frame display process and an image arrangement process based on the layout information 30B (steps S213 to S215).

  In the process A, the CPU 101 determines the current area section 32 from the position information of the mouse cursor 4, and acquires information on the layout frame 31 and the arrangement position 34 corresponding to the current area section 32 with reference to the layout information 30A. The CPU 101 displays the acquired layout frame 31 in the medical image display area 52a (or 52b) during the drag operation. In the layout information 30A, for example, layout frames 31 of “1 × 1”, “1 × 2”, “2 × 1”, “2 × 2”, “3 × 1”, and “1 × 3” are medical image display areas. 52b.

  In the process B, the CPU 101 determines the current area section 32 from the position information of the mouse cursor 4, and acquires information on the layout frame 31 and the arrangement position 34 corresponding to the current area section 32 with reference to the layout information 30B. The CPU 101 displays the acquired layout frame 31 in the medical image display area 52a (or 52b) during the drag operation. In the layout information 30B, for example, layout frames 31 of “1 × 1”, “1 × 2”, “2 × 1”, “2 × 2”, and “3 × 3” are displayed in the medical image display area 52b.

  In the process A or the process B, during a drag operation, the CPU 101 returns to the process of step S207 at every elapse of a predetermined time (step S210; No, step S214; No), and determines the moving speed of the mouse cursor 4. Then, either process A or process B is selected according to the determination result, and the display of the layout frame 3 is updated according to the position information of the mouse cursor 4 after the movement.

  During the drag operation, the CPU 101 may display the already displayed medical image 60 in a translucent manner with the original image size and layout. Further, the CPU 101 blinks and displays the background of the arrangement position when a drop operation is performed according to the layout information based on the position information of the mouse cursor 4, or displays an animation for enlarging and moving the drag icon to the arrangement position. Various other highlighting may be performed.

  When the drop operation is performed (step S210; Yes, step S214; Yes), the CPU 101 places the selected medical image in the layout frame according to the layout information 30A or 30B based on the position information of the mouse cursor 4 at the time of dropping. (Step S211, Step S215). At this time, the CPU 101 arranges the selected medical image in an enlarged or reduced size according to the layout frame.

  When the selected medical image is associated with a plurality of images, such as a CT image, the image arrangement processing in step S211 and step S215 is a representative image (for example, the first image) according to the layout information 30A or 30B. (Slice) is displayed in the corresponding layout frame. Furthermore, it is desirable to sequentially switch and display images related to the representative image in the same layout frame in accordance with a predetermined operation such as rotating the mouse wheel.

  Note that after the selected medical image is placed in the layout frame 31 of the medical image display area 52, the originally placed medical image 60 may be hidden, or different from the frame on which the selected medical image is placed. It may be displayed by moving to a frame where nothing is displayed.

  When another thumbnail image is dragged (step S206; Yes), the CPU 101 repeats the processing from step S207 to step S215. That is, the CPU 101 selects either process A or process B according to the moving speed of the mouse cursor during the drag operation, and displays the layout frame 31 corresponding to the position information of the mouse cursor 4 according to the selected process (layout information). To do. When the drop operation is performed, the layout frame 31 is displayed based on the position information of the mouse cursor 4 at the time of dropping, and the selected medical image is arranged in the layout frame 31.

  When the drag operation is not performed on the thumbnail image (step S206; No), the series of processes illustrated in FIG.

  For example, when the mouse cursor 4 is moved to the position (a) of the area section 32b shown in FIG. 12 during the drag operation of the thumbnail image, the drag operation is performed at the normal speed and the drop operation is performed at the position (a). For example, the process A (layout information 30A) is selected, and a “1 × 1” layout frame can be used. Further, when the movement is stopped in a state where the drag operation is performed to the position (a) of the same area section 32b, the process B (layout information 30B) is selected and the “3 × 3” layout frame may be used. it can.

  As described above, the image display apparatus 100 according to the second embodiment can select different layout information according to the operation amount of the drag operation and can arrange medical images based on the selected layout information. Become. As a result, even if the position indicated by the mouse cursor 4 is the same, the layout can be changed to a different layout frame simply by changing the operation method (operation amount).

  In the above-described processing, in the determination processing in step S207, the determination is made based on the moving speed of the mouse. However, the determination is not limited to the moving speed, and the moving direction of the mouse or a special operation (for example, a locus such as a circle during dragging) Different processing may be selected based on a mouse gesture). Further, by providing three or more thresholds for the operation amount (including moving speed, moving direction, operation method, etc.) and holding different layout information, in addition to the above processing A and processing B, processing C and processing More processing can be added like D,.

  In the first and second embodiments, the area division is set for the entire medical image display area 52 and the layout frame corresponding to the area division is arranged. A layout frame may be further arranged inside. For example, as shown in FIG. 15, in the state where the “2 × 2” layout frame 31b has already been arranged in the medical image display area 52b of the right monitor 107b, the operator drags a new thumbnail image to right monitor 107b. When the mouse cursor 4 is moved to the upper left area of the upper left frame of the medical image display area 52b, the CPU 101 further divides the upper left frame by the “2 × 2” layout frame 31d based on the position information of the mouse cursor 4. When the drop operation is performed, the CPU 101 may arrange one or a plurality of medical images 61a and 61b related to the thumbnail image 61S with a size corresponding to the layout frame 31d, as shown in FIG. FIG. 17 shows a region section 32c used in the examples of FIGS. It is assumed that the layout frame corresponding to the area section 32c is held in the storage device 103 as layout information.

[Third Embodiment]
Next, a third embodiment of the present invention will be described with reference to FIGS.
In recent years, electronic devices such as tablets equipped with a touch panel in which a display device and an input device are integrated are widely used. In the touch panel, an operation equivalent to a mouse click operation or a drag and drop operation can be performed by a touch operation with a finger or a touch pen. Therefore, the same image display processing as in the first and second embodiments can be applied to this type of electronic apparatus. Furthermore, it is possible to add processing different from the first or second embodiment by using an operation method unique to the touch panel. For example, an image display process corresponding to an operation specific to the touch panel such as a “pinch-out operation” can be added to the process of the first or second embodiment. The pinch-out operation is an operation in which two fingers are placed on the same area and then released to widen the area.

  In the third embodiment, the CPU 101 of the image display device 100 executes processing according to a pinch-out operation on the touch panel. A process corresponding to the pinch-out operation (hereinafter referred to as a pinch-out process) is, for example, a layout frame extension process. Specifically, as shown in FIG. 18, when a layout frame is displayed in the medical image display area 52 of the display screen, a pinch-out operation is performed at an intersection position of adjacent layout frames by the operation input unit (touch panel). (FIGS. 18A and 18B), the CPU 101 of the image display device 100 changes the layout frame and increases the number of divisions (layout frame addition processing unit; FIG. 18C).

  FIG. 19 shows an example of layout information 30C used in the pinch-out process. The storage device 103 stores layout information 30C used in the pinch out process as shown in FIG. When a pinch-out operation is started on the touch panel (operation input unit), the CPU 101 reads the layout information 30C from the storage device 103, and adds a layout frame according to the layout information 30C.

  The layout information 30C shown in FIG. 19 corresponds to the area section 32b shown in FIG. When the pinch out process is performed in the area (a) corresponding to the intersection of the layout frames of the initial image display area, the CPU 101 changes the layout frame to “3 × 3” and displays each of the images displayed in the medical image display area 52. The medical image is reduced to the size of each frame in the “3 × 3” layout frame and rearranged (example in FIG. 18). Further, for example, when the pinch out process is performed in the area (l) corresponding to the boundary of the layout frame of the initial image display area, the CPU 101 changes the layout frame to “1 × 3” and is displayed in the medical image display area. Each medical image is reduced to the size of each frame in the “1 × 3” layout frame and rearranged.

  20 and 21, the CPU 101 of the image display device 100 allows the operation input unit (touch panel) to display the intersection of the layout frames 31 while the layout frame 31 is displayed in the medical image display area 52 of the display screen. When the boundary is instructed (touch operation), layout frames adjacent to the instructed intersection or boundary may be combined (layout frame combination processing unit). The CPU 101 arranges the medical image in the layout frame with a size corresponding to the combined layout frame.

FIG. 22 is a flowchart showing the procedure of layout frame addition / combination processing.
Note that at the start of the processing shown in FIG. 22, for example, a “2 × 2” layout frame is arranged as an initial display in the medical image display area 52 of the display screen, and a medical image is displayed in each layout frame. (Display state in FIG. 18A).

  When a signal for touching (instructing) an intersection of the layout frames is input from the touch panel (step S301; Yes), the CPU 101 determines whether the operation is a pinch-out operation (step S302). When the pinch-out operation is performed (step S302; Yes), the CPU 101 divides (adds) the layout frame according to the layout information 30C corresponding to the pinch-out process (step S303). The CPU 101 rearranges the currently displayed image in accordance with the size of the layout frame after expansion (step S304). For example, as shown in FIG. 18C, the currently displayed image is rearranged on each outer frame.

  If the pinch operation is not performed in the determination in step S302 and the operation is a touch operation (step S302; No-> step S305; Yes), the CPU 101 combines frames adjacent to the instructed position (step S306). The CPU 101 rearranges the currently displayed image in accordance with the size of the combined layout frame (step S307).

  For example, as shown in FIG. 20, when a touch operation is performed at the intersection of four layout frames (frames), four frames adjacent to the intersection are combined into one frame. Also, the image displayed in the original layout frame is enlarged according to the size of the new frame and rearranged. For example, as shown in FIG. 21, when a touch operation is performed at the boundary between two layout frames (frames), two frames adjacent to the boundary are combined into one frame. Also, the image displayed in the original layout frame is enlarged according to the size of the new frame and rearranged.

  In the above example, a pinch-out operation or a touch operation is used as a preferred example of an operation for an intersection or a boundary. However, the above-described layout frame addition processing or layout frame combination processing may be applied to other operations. . Further, it is possible to add a process to another operation (flick operation or the like) different from the pinch out operation or the touch operation.

  As described above, according to the third embodiment, when a predetermined operation is performed on the intersection or boundary of adjacent layout frames by the operation input unit while the layout frame is displayed on the display screen 5. The CPU 101 adds a layout frame near the intersection or boundary. Alternatively, when a predetermined operation is performed on the intersection or boundary of the layout frame by the operation input unit with the layout frame displayed, the CPU 101 combines the layout frames adjacent to the intersection or boundary. Then, the CPU 101 arranges medical images in the layout frame with a size corresponding to each added or combined layout frame.

  As a result, layout frames can be added or combined with an intuitive and simple operation, so that an image browsing operation can be performed smoothly.

  The preferred embodiments of the image display apparatus according to the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to such examples. It will be apparent to those skilled in the art that various changes or modifications can be conceived within the scope of the technical idea disclosed in the present application, and these naturally belong to the technical scope of the present invention. Understood.

1... Image display system 100... Image display device 101.
102... Main memory 103... Storage device 104... Communication I / F
105... Display memory 106... I / F
107... Display device 108... Mouse 109... Input device 110... Network 111. ... Image capturing device 21... Medical image acquisition unit 22... Image selection unit 23. Image layout units 30, 30A, 30B, 30C ... Layout information 31, 31a, 31b, 31c ... Layout frames 32, 32b, 32c ... Area division 33 ... ... Number of divisions 34 ... Arrangement position 4 ... Mouse cursor 5, 5a ... Display screen 51 ... Thumbnail image display area 52, 52a, 52b ... Medical image display area 55 ...・ ・ Image search screen 61 </ b> S... Selected thumbnail image 60....

Claims (6)

A medical image acquisition unit for acquiring a plurality of medical images;
A display unit for forming a thumbnail image display area for selectively displaying thumbnail images of the plurality of medical images and a medical image display area for displaying the medical images on a display screen;
An operation input unit for inputting an arrangement position instruction operation which is an operation for instructing an arrangement position of the thumbnail image and a medical image;
A storage unit that holds in advance layout information that defines a layout frame corresponding to an instruction position in the medical image display area by the operation input unit and an arrangement position of the medical image;
An image selection unit for selecting an image to be displayed in the medical image display region by selecting a thumbnail image by operation of the operation input unit;
A layout frame display unit that displays the layout frame in the medical image display area according to layout information stored in the storage unit during an arrangement position instruction operation after an image selection operation by the operation input unit;
An image placement unit for placing the medical image in a size corresponding to the layout frame at a designated position in the medical image display area in response to a placement position instruction operation by the operation input unit;
An image display device comprising:   The image display apparatus according to claim 1, wherein the operation input unit instructs the selection of the thumbnail image and the arrangement position of the medical image by a drag operation, and determines the arrangement position of the medical image by a drop operation. The storage unit holds a plurality of layout information,
The layout frame display unit switches layout information to be applied according to the operation amount of the operation input unit and displays the layout frame in the medical image display region,
The image arrangement unit arranges the medical image in a size corresponding to the layout frame at an instruction position in the medical image display area in response to an operation of instructing an arrangement position of the medical image by the operation input unit. The image display device according to claim 1.   When a predetermined operation is performed on an intersection or boundary of adjacent layout frames by the operation input unit in a state where the layout frame is displayed, a layout frame addition processing unit that adds a layout frame near the intersection or boundary is provided. The image display apparatus according to claim 1, further comprising: When a predetermined operation is performed on the intersection or boundary of the layout frame by the operation input unit in a state where the layout frame is displayed, a layout frame combination processing unit that combines the layout frames adjacent to the intersection or boundary In addition,
The image display device according to claim 1, wherein the image arrangement unit arranges medical images in the layout frame with a size corresponding to the combined layout frame. Computer
Acquiring a plurality of medical images;
Forming a thumbnail image display area for selectively displaying thumbnail images of the plurality of medical images and a medical image display area for displaying the medical images on a display screen;
A step of inputting an arrangement position instruction operation which is an operation for instructing a thumbnail image selection operation and an arrangement position of a medical image;
Selecting an image to be displayed in the medical image display area by a thumbnail image selection operation;
Displaying the layout frame in the medical image display area according to layout information stored in a storage unit during an arrangement position instruction operation after the image selection operation;
Arranging the medical image in a size corresponding to the layout frame at an indicated position in the medical image display area in accordance with an arrangement position instruction operation;
An image display method comprising performing processing including:

Images