JP6501525B2 - INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM - Google Patents

Description

  The disclosed technology relates to an information processing device, an information processing method, and a program.

  In order to display a plurality of images to be compared side by side, it is known to divide an image display area into a plurality of areas and display the images in each of the plurality of areas. Furthermore, in order to display images in a plurality of areas, dragging and dropping a thumbnail, an icon or the like displayed on the display unit into each area is performed. As a method of displaying an image in a desired area by a simple operation, a window for designating a display position of the image is displayed in the vicinity of the dragged thumbnail, and the display position of the image is determined by the drop position on this window. Is known (Patent Document 1). According to this technique, it is possible to easily display an image associated with a thumbnail without having to drag the thumbnail to an area for actually displaying the image.

Patent 5362307 gazette

  However, since the display position of the image is determined at the position where the thumbnail is dropped, there is a problem that the user is required to perform a detailed operation. Also, designation of how to divide the display area is complicated because it must be performed separately from the drag and drop operation.

  The technology disclosed herein has been made in view of such a situation, and has an object of dividing a display area and displaying an image at a desired position of the divided area with a simple operation.

  It is to be noted that the operation and effect are not limited to the above object but are derived from the respective configurations shown in the embodiments for carrying out the invention described later, and it is another object of the present invention to exert the operation and effect not obtained by the prior art. It can be positioned as one.

As a means for achieving the above object, the information processing apparatus disclosed herein includes a detection unit that detects an operation direction of a flick operation or a drag operation on an object displayed on the display unit, and an operation direction detected by the detection unit. Based on the division means for dividing the display area of the display unit into a plurality of areas, and based on the operation direction detected by the detection means, displaying an image associated with the object among the plurality of areas Determining means for determining an area to be selected, and display control means for displaying an image associated with the object in the area determined by the determining means, wherein the object is selected by the user by the detection means When the display control means detects the flick operation or the drag operation. An indication of division results in areas of the display unit by the dividing means in the case of performing click operation or drag operation Ru is displayed for each of the operation direction.

  According to the disclosed technology, it is possible to divide the display area and display an image at a desired position of the divided area with a simple operation.

(A) is a figure which shows an example of the whole structure of a data display apparatus. (B) is a figure for demonstrating an example of the function of a data display apparatus. It is a figure showing an example of the screen composition of a data display device. It is a figure showing an example of display area selection UI. It is a figure which shows an example (left and right 2 division) of a data display area. It is a figure which shows an example (upper and lower 2 division) of a material display area. It is a figure which shows an example (upper and lower left 4 divisions) of a material display area. It is a figure which shows an example of the flow (left and right 2 division | segmentation) which selects a data display area. It is a figure which shows an example of the flow (upper and lower left 4 divisions) which selects a data display area. It is a flowchart for demonstrating an example of a data display process. It is a flowchart for demonstrating an example of operation direction detection processing. It is a figure which shows the example of a display of a display area selection UI (material display is possible only by 2 division | segmentation on either side). It is a figure which shows the example of a display of a display area selection UI (material display is possible only by upper and lower 2 division | segmentation). It is a figure which shows the example of a display of display area selection UI (it can display data only on the right side). It is a figure which shows the example of a display of the display area selection UI (material display is possible only at the lower side). It is a figure showing an example of display area selection UI.

  Hereinafter, the present invention will be described in detail based on preferred embodiments thereof with reference to the attached drawings. In addition, the structure shown in the following embodiment is only an example, and this invention is not limited to a following example.

  In the following embodiments, a medical material display apparatus for medical treatment that treats medical images and medical documents as materials is taken as an example, but the present invention is also applicable to images and documents in fields other than medical treatment.

First Embodiment
FIG. 1A shows an entire configuration of a material display apparatus (information processing apparatus) according to the present embodiment. The data display device 1 includes a UI (User Interface) device 101, a CPU (Central Processing Unit) 102, a RAM (Random Access Memory) 103, a communication IF (Inter Face) 104, a UI display unit 105, a program storage area 106, and data. A storage area 107 is provided.

  The UI device 101 is a device that receives an input from a user such as a doctor operating the material display device 1 and outputs a signal according to the user's operation on the UI device 101. For example, the UI device 101 is configured by a mouse and / or a keyboard. Further, the UI device 101 may be configured by a touch sensor or the like that detects a position where an object such as a finger touches on the display screen of the UI display unit 105. That is, the UI device 101 is used to input a user's instruction to the material display device 1.

  The CPU 102 interprets and executes the program read from the program storage area 106 to the RAM 103 by the CPU 102, and can display various controls, calculations, and a UI in the material display device 1. That is, when the CPU 102 executes the program, the material display device 1 functions as various means for executing each process shown in the flowchart to be described later. The functions realized by the program execution of the CPU 102 will be described later with reference to FIG.

  The RAM 103 is used as a working memory required for the operation of the CPU 102.

  The communication IF 104 is connected to an in-hospital network, and is a communication interface used when acquiring materials from a PACS (Picture Archiving and Communication System) server or file server in a hospital. That is, when the CPU 102 acquires a medical image such as an X-ray image from a PACS server or the like, the medical image is acquired via the communication IF 104.

  The UI display unit 105 is a light emitting diode (LED), a liquid crystal panel, or the like that displays the state of the apparatus and the processing content.

  Furthermore, the material display device 1 includes a program storage area 106 and a data storage area 107. Specifically, the program storage area 106 and the data storage area 107 are realized using a hard disk or a flash memory. For example, the program storage area is realized by a ROM (Read Only Memory), and the data storage area 107 is realized by a HDD (Hard Disk Drive). However, the program storage area 106 and the data storage area 107 are not limited to a specific storage medium.

  In the material display device 1, for example, materials to be displayed on the UI display unit 105, such as images and documents, are stored in the data storage area 107. The data to be displayed may be stored in a PACS server, a file server, or the like in a hospital, and the CPU 102 may acquire the data from various servers via the communication IF 104.

  Next, an example of the function of the CPU 102 will be described with reference to FIG.

  The CPU 102 functions as each unit shown in FIG. 1B by executing the program stored in the program storage area 106. Specifically, the CPU 103 functions as a detection unit 112, a division unit 122, a determination unit 132, and a display control unit 142.

  The CPU 102 and the program storage area 106 included in the material display device 1 may be one or plural. That is, at least one or more processing units (CPU) and at least one storage unit (ROM) are connected, and at least one or more processing units execute a program stored in at least one or more storage units. The material display device 1 functions as each means described above.

  The detection unit 112 detects an operation on the material display device 1 by the user. More specifically, the detection unit 112 detects the operation direction of the flick operation and the drag operation performed using the UI device 101 on an object such as a thumbnail or an icon displayed on the UI display unit 105. Here, when the UI device 101 is configured by a touch sensor, the flick operation is a finger or the like after the finger or the like is moved quickly by a predetermined distance or more in a state where the touch of the finger is detected by the touch sensor. Is an operation of releasing the touch sensor from the touch sensor. That is, the flick operation is an operation of tracing quickly so as to flip the touch panel (touch sensor) with a finger or the like. The detection means 112 detects that a finger or the like has moved at a predetermined distance or more and a predetermined speed or more after touch-down detection, and if it detects touch-up as it is, determines that flicking has been performed. That is, the detection unit 112 detects a flick operation based on a signal output from the UI device 101 based on the presence or absence of a touch on the UI device 101 such as a finger. The detection unit 112 can detect the direction of the flick operation based on the change of the output from the UI device 101 accompanying the movement of the finger or the like. In addition, when a signal indicating that a finger or the like is in contact with the UI device 101 is output from the UI device 101 for a predetermined time or more, the detection unit 112 can detect that a long press has occurred. Note that touch-down indicates contact of a finger or the like on the touch panel, and touch-up indicates releasing the finger or the like from the touch panel.

  When the UI device 101 is configured by a mouse, the detection unit detects a drag based on a signal output from the UI device 101 by depression of a button of the mouse and a signal output from the UI device 101 by movement of the mouse Do. The detection unit 112 can detect a drop based on a signal output from the UI device 101 (or the stop of the signal due to the button depression) when the button provided on the mouse is released after the drag detection. Further, based on the signal output from the UI device 101 by the movement of the mouse, the detection unit 112 can detect the direction of the drag operation. That is, the detection unit 112 corresponds to an example of a detection unit that detects the operation direction of the flick operation or the drag operation on the object displayed on the display unit. In addition, the detection method of the operation direction of flick operation or a drag operation is later mentioned using FIG.

  The dividing unit 122 divides an area (image display area) in which an image is displayed on the UI display unit 105 based on the detection result of the detection unit 112. Here, the image is an image associated with an object such as a thumbnail or an icon. Examples of the image include an X-ray image, a CT image and the like. Specifically, the dividing unit 122 divides the image display area in the UI display unit 105 based on the operation direction of the flick operation or the drag operation detected by the detection unit 112. For example, depending on the operation direction detected by the detection unit 112, the method of dividing the image display area is different. As an example, when the operation direction is up and down, the dividing unit 122 divides the image display area into upper and lower parts. Also, for example, when the operation direction is the left and right direction, the dividing unit 122 divides the image display area into two in the left and right. That is, the dividing unit 122 corresponds to an example of the dividing unit that divides the display area of the display unit into a plurality of areas based on the operation direction detected by the detecting unit. The relationship between the operation direction and the manner of division is not limited to the above-described example, and may be another relationship.

  The determination unit 132 determines which area of the display area of the divided image in the UI display unit 105 is to be displayed based on the detection result of the detection unit 112. Specifically, the determination unit 132 determines the display area of the image on the UI display unit 105 based on the operation direction of the flick operation or the drag operation detected by the detection unit 112. That is, the determination unit 132 determines the display position of the image in the image display area based on the operation direction detected by the detection unit 112. That is, the determination unit 132 corresponds to an example of a determination unit that determines an area to display an image associated with an object among a plurality of areas based on the operation direction detected by the detection unit. For example, in accordance with the operation direction detected by the detection unit 112, the display position of the image in the image display area is different. As an example, when the operation direction is upward, the upper one of the image display areas divided into two vertically by the division means 122 is determined as the display position of the image. Further, for example, when the operation direction is the left direction, the left area among the image display areas divided into two by the division means 122 is determined as the display position of the image. The relationship between the operation direction and the display position of the image is not limited to the above-described example, and may be another relationship.

  Note that, for example, when an image is already displayed in the image display area, when the detection unit 112 detects that the operation direction is the left direction, the display position of the image that is already displayed is two on the left and right. The right side of the divided image display area. Then, the determination unit 132 determines the display position of the image corresponding to the object subjected to the flick operation or the like to the left side of the image display area divided into two.

  The display control means 142 causes the image to be displayed at the position determined by the determination means 132. Specifically, the display control unit 142 controls the UI display unit 105 to display an image at the position determined by the determination unit 132. That is, the display control means 142 corresponds to an example of the display control means for displaying the image associated with the object in the area determined by the determination means.

  Further, the display control unit 142 may cause the UI display unit 105 to display a line indicating a boundary of the area divided by the dividing unit 122 or a dotted line. The display control unit 142 reads an image associated with the object to be operated from the data storage area 107 and causes the UI display unit 105 to display the image. That is, a table indicating the correspondence between the object and the image is stored in the data storage area 107, and based on the table, the display control means 142 can obtain an image corresponding to the object being manipulated. It has become. Although an image has been described as an example associated with an object, document data such as an electronic medical chart or a medical questionnaire may be associated. Hereinafter, images and document data may be simply referred to as materials.

  Next, the configuration of the screen displayed on the UI display unit 105 of the material display device 1 will be described with reference to FIG. The UI displayed on the UI display unit 105 includes a material display space 11 including an object display area 10 and a material display area 12. In the object display area 10, objects (symbol images) such as thumbnails or icons are displayed in a matrix. Here, the symbol image includes a thumbnail representing a material, an image or an icon indicating a material name. Further, in the object display area 10, the vertical axis indicates the type of material, and the horizontal axis indicates the examination date and time. Specifically, the vertical axis indicates the type of modality that acquired the image or the type of document data. Furthermore, the horizontal axis indicates the date when the image was taken or the date when the document data was created. In addition, the information which a vertical axis | shaft and a horizontal axis show is not limited to the form of FIG. 2, For example, you may be reverse. Although the symbol images are displayed in a matrix in this embodiment, the display format may be such that each material is displayed in a list.

  A material display area 12 exists inside the material display space 11 of FIG. In the material display area 11, an image, document data or the like associated with the symbol image is displayed. Specifically, the display control means 142 causes the material display area 12 to display an image, document data or the like associated with the symbol image selected by the user using the UI device 101.

  Next, an example of a UI used when displaying material in the material display area 12 by flick operation or the like will be described using FIG. A display area selection UI 14 is shown in FIG. The display area selection UI 14 is displayed by the display control means 142 in response to, for example, selecting (long-pressing) any symbol image 15 on the material list 10 with a user instruction 13 such as a finger or a mouse cursor for a predetermined time or more. Ru. Details of the display area selection UI 14 are shown in FIG. As shown in FIG. 15, the display area selection UI 14 shows the division pattern of the material display space 11 and where the material is displayed when the division pattern is selected. That is, the display area selection UI 14 is displayed for each operation direction by the display control unit when the detection unit detects that the object is selected by the user, and the flick operation or the drag operation is performed before the flick operation or the drag operation is performed. It corresponds to an example of a display showing the division result of the area of the display unit by the division means when the operation is performed. In the example shown in FIG. 15, it is shown that the data display space 11 is divided into two in the vertical direction when the flick operation is performed in the vertical direction. Further, when the flick operation is performed in the left and right direction, it is shown that the data display space 11 is divided into two in the left and right direction. Furthermore, when the flick operation is performed in the oblique direction, the data display space 11 is shown to be divided into four vertically and horizontally. Black circles in FIG. 15 indicate the display position of the material in the divided area. That is, this black circle corresponds to an example of a display showing an area for displaying an image determined by the determination means when a flick operation or a drag operation is performed. For example, when the flick operation is performed in the upward direction, the material associated with the symbol image 15 that is the target of the flick operation is displayed in the upper area among the upper and lower divided areas.

  In the example shown in FIG. 15, the area is divided corresponding to the flick operation in eight directions, but the present invention is not limited to this. For example, the specification may not correspond to the flick in the oblique direction, but may correspond to the flick operation in the up, down, left, and right directions. Further, in FIG. 15, the black circles indicate the display position of the material in the divided area, but this may not be displayed.

  FIG. 4 shows a display screen of the UI display unit 105 after the flick operation is performed in the right direction from the state of FIG. Since the flick operation is performed in the right direction, the data display space 11 is divided into left and right into the data display areas 12 (A) and 12 (B). Further, since the flick operation is performed in the right direction, the material associated with the symbol image 15 that is the flick target is displayed in the right area among the areas divided into right and left. The material already displayed in the material display space 11 at the stage of FIG. 3 is displayed in an area other than the display position determined based on the flicking direction in the divided area. In the example shown in FIG. 4, since new material is displayed in the right area among the areas divided into right and left by the flick operation, before the flick operation in the area other than the right area (ie, the left area) The displayed material will be displayed.

  FIG. 5 shows a display screen of the UI display unit 105 after the flick operation is performed downward from the state of FIG. Since the flick operation is performed downward, the data display space 11 is divided into the data display area 12 (C) and the data display area 12 (D) at the top and bottom. In addition, since the flick operation is performed downward, the material associated with the symbol image 15 that is the flick target is displayed in the lower area among the areas divided up and down. The material already displayed in the material display space 11 at the stage of FIG. 3 is displayed in an area other than the display position determined based on the flicking direction in the divided area. In the example shown in FIG. 5, since new material is displayed in the lower area of the areas divided up and down by the flick operation, the area other than the lower area (ie, the upper area) is displayed before the flick operation. The displayed material will be displayed.

  FIG. 6 shows a display screen of the UI display unit 105 after the flick operation is performed in the lower left direction from the state of FIG. Since the flick operation is performed in the lower left direction, the data display space 11 is divided into the data display area 12 (E) to 12 (H) in the upper, lower, left, and right directions. In addition, since the flick operation is performed in the lower left direction, the material associated with the symbol image 15 as the flick target is displayed in the lower left area among the areas divided vertically and horizontally. The material already displayed in the material display space 11 at the stage of FIG. 3 is displayed in an area other than the display position determined based on the flicking direction in the divided area. In the example shown in FIG. 5, a new material is displayed in the lower left area among the areas divided up, down, left and right by the flick operation, so an area other than the lower left area (for example, the upper left area) The material displayed on will be displayed.

  Next, the operation of the material display device 1 will be described with reference to the flowchart shown in FIG. In the description of the flowchart shown in FIG. 9, reference is made to FIG. 7 and FIG. 8 showing an example of the display screen of the UI display unit 105.

  First, in S100, the display control unit 142 causes the UI display unit 105 to display symbol images of a predetermined patient in a matrix. That is, in S100, symbol images 15 are displayed in a matrix in the object area 10 of FIG. The designation of a predetermined patient is performed by inputting a patient ID or the like via the UI device 101. The display control unit 142 searches the data storage area 107 for a material having the patient ID based on the input patient ID, for example, and causes the object area 10 to display the material as the symbol image 15.

  Next, in S101, the detection unit 112 determines whether an operation has been performed on the symbol image 15 via the UI device 101. If no operation is performed on the symbol image 15, the determination of S101 is performed again. On the other hand, when the detection unit 112 detects an operation on the symbol image 15, the detection unit 112 determines whether the detected operation is a click operation or a tap operation. If the detection unit 112 determines that the operation is a tap operation or a click operation, the display control unit 142 acquires the material associated with the symbol image from the data storage area 107 and displays the material in the material display space 11 (S103). On the other hand, when the operation on the symbol image 15 detected by the detection unit 112 is other than a tap operation and a click operation, the detection unit 112 determines that a long press or flick operation has been performed. Then, in S104, the display control unit 142 causes the UI display unit 105 to display the display area selection UI 14 as shown in FIG. Specifically, the display control means 142 displays the display area selection UI 14 centering on the symbol image 15 which has been the object of the long press or flick operation. The display position of the display area selection UI 14 is not limited to the above, and may be displayed at another position. FIGS. 7A and 7B show an example of screen transition in S104. When the user long-press on the symbol image 15 as shown in FIG. 7A or 8A, the display control unit 142 displays the display area selection UI 14 as shown in FIG. 7B or 8B. Be done. Here, when the flick operation or the drag operation is performed before the detection unit 112 determines that the touch operation is long, the display control unit 114 may display the display area selection UI 14 immediately after detection of the flick operation or the like. Further, the display area selection UI 14 may not be displayed.

  Next, in step S105, the detection unit 112 determines the operation direction of the flick operation or the like by the user. The determination of the operation direction, that is, the detection of the operation direction will be described in detail with reference to the flowchart of FIG.

  When the process of detecting the operation direction starts (S200), the detection unit 112 detects the coordinates B touched down and the coordinates E touched up on the display area of the UI display unit 105 in S201 based on the output of the UI device 101. get. When a pointing device such as a mouse is used as the UI device, the coordinates of the mouse cursor position when the mouse button is pressed corresponds to the touched-down coordinates. Further, the coordinates of the position of the mouse cursor when the mouse button is released correspond to the touched-up coordinates.

  The detection means 112 uses the coordinates B and the coordinates E to calculate the operation direction vector D as D ← E · B.

  In S202, the detection unit 112 determines whether the operation direction vector D calculated in S201 is 0 or less than a predetermined threshold (is sufficiently small). If it is determined that the operation direction vector D is 0 or less than the predetermined threshold value, the process proceeds to S203, the detection means 112 determines that the detection means is a click or a tap, and ends the process (S204). Here, for example, the process of S102 is performed based on the determination result of S203.

  If it is determined that the operation direction vector D is not 0 or less than a predetermined threshold, the process proceeds to S205. In S205, the detection means 112 calculates an angle θ [rad] between the operation direction vector D and the x axis of the display area. Note that θ can be expressed as θ = a tan 2 (y, x) [wherein, −π <θ ≦ π]. Here, the a tan 2 (y, x) function is an arc tangent function that calculates an angle θ between the vector D (x, y) and the x axis.

  Next, in S206, the detection means 112 determines the operation direction of the user's flick operation or the like according to the range of θ, and ends the processing (S207). Specifically, in S206, the detection unit 112 determines that the operation direction is the lower left direction if − (7/8) π <θ ≦ − (5/8) π, and − (5/8) π <θ ≦ If it is-(3/8) pi, it will be judged as the lower direction, and if it is-(3/8) pi <θ −-(1/8) pi it will be judged as the lower right direction. If-(1/8) π <θ ≦ (1/8) π, the detection unit 112 determines that the operation direction is the right direction, and (1/8) π <θ ≦ (3/8) π. If it is, it is determined that the upper right direction is present, and if (3/8) π <θ ≦ (5/8) π, it is determined that the upper direction is present. Furthermore, if (5/8) π <θ ≦ (7/8) π, the detection means 112 determines that the operation direction is the upper left direction, and (7/8) π <θ ≦ π or −π <θ ≦ If it is-(7/8) pi, it will judge with the left direction.

  Returning to the description of the flowchart in FIG. 9, the processing after S105 will be described.

  If the operation direction is determined to be left or right in S105, the process proceeds to S106. If the operation is determined to be upward or downward, the process proceeds to S107. The operation is either upper right, lower right, or lower left. If it is determined that it is the case, the process proceeds to S108. In S106, the dividing means 122 divides the data display space 11 into two left and right, and in S107, the dividing means 122 divides the data display space 11 into upper and lower parts. Further, in S108, the dividing means 122 divides the data display space 11 into upper, lower, left and right.

  If the operation direction is the left direction, the process proceeds to S109 after S106. In S109, the determination unit 132 determines the display position of the material associated with the symbol image based on the operation direction with the material display area 12 (A) shown in FIG. decide. Then, the display control means 142 focuses the material display area 12 (A). As an example of the focus, the frame of the area determined by the determination unit 132 may be highlighted by displaying it in a color different from the frame of the other area. If the operation direction is the right direction, the process proceeds to step S110 after step S106. In step S110, the determination unit 132 displays the display position of the material associated with the symbol image based on the operation direction in FIG. Decide as). Then, the display control means 142 focuses the material display area 12 (B).

  If the operation direction is upward, the process proceeds to step S111 after step S107. In step S111, the determination unit 132 determines the display position of the material associated with the symbol image based on the operation direction with the material display area 12 (C) shown in FIG. decide. Then, the display control means 142 focuses the material display area 12 (C). If the operation direction is downward, the process proceeds to step S112 after step S107. In step S112, the determination unit 132 displays the display position of the material associated with the symbol image based on the operation direction in FIG. Decide as). Then, the display control means 142 focuses the material display area 12 (D).

  Furthermore, when the operation direction is the upper left direction, the process proceeds to S113 after S108, and in S113, the determination unit 132 displays the display position of the material associated with the symbol image based on the operation direction in FIG. Decide as). Then, the display control means 142 focuses the material display area 12 (E). When the operation direction is the lower left direction, the process proceeds to S114 after S108. In S114, the determination unit 132 displays the display position of the material associated with the symbol image based on the operation direction in the document display area 12 (F Decide as). Then, the display control means 142 focuses the material display area 12 (F). Further, if the operation direction is the upper right direction, the process proceeds to S115 after S108, and in S115, the determination unit 132 displays the display position of the material associated with the symbol image based on the operation direction in FIG. Decide as). Then, the display control means 142 focuses the material display area 12 (G). When the operation direction is the lower right direction, the process proceeds to S116 after S108, and in S116, the determination unit 132 displays the display position of the material associated with the symbol image based on the operation direction in FIG. H) Decide. Then, the display control means 142 focuses the material display area 12 (H).

  In S117, the display control means 142 acquires the material associated with the symbol image in the area (the focused area) determined in S109-116 from the data storage area 107 and displays it. For example, when S110 is performed, the display screen illustrated in FIG. 7C is displayed on the UI display unit 105. Further, when the process goes through S114, the display screen shown in FIG. 8C is displayed on the UI display unit 105. That is, the dividing unit divides the area of the display unit in different ways with respect to a plurality of different operation directions, and the determining unit sets the areas for displaying the image as different areas with respect to a plurality of different operation directions There is.

  In order to make it easy for the user to recognize the flick direction when flicking, a portion corresponding to the flicking direction on the display area selection UI 14 may be highlighted.

  In the present embodiment, the display area selection UI 14 presents the user with the correspondence between the display area of the material and each operation direction. However, the display area selection UI 14 may not be displayed. Also, instead of a visual UI, an auditory UI such as changing the tone of the operation sound according to the operation direction of the user, or a tactile UI such as changing the vibration pattern according to the operation direction of the user You may use it. Moreover, although the case of flick operation was mainly demonstrated in said embodiment, it is not limited to this, It is good also as applying to other operation methods, such as drag operation.

  According to the above embodiment, the division of the display area and the display of the image can be performed by one flick operation. That is, the display area can be divided and the image can be displayed at a desired position of the divided area by a simple operation. Therefore, the user's operation burden can be reduced. In addition, since the display area selection UI 14 indicates the layout of the display area after flicking, it becomes possible to perform the flick operation after grasping the display form after flicking. Therefore, it is possible to prevent the display form different from the user's intention.

Second Embodiment
In the second embodiment, the display area selection UI 14 is changed to the display area selection UI 14 (a) or 14 (b) according to the screen size as shown in FIG. It is also possible to display only in two divisions.

  As an example of restricting display to only the left and right two divisions as shown in FIG. 11, there are cases where it becomes difficult to see if the screen size is arranged horizontally in two rows and vertically as shown in FIG. For example, the display control unit 142 displays the display area selection UI 14 based on the aspect ratio of the display area including the object display area 10 displayed on the UI display unit 105 and the material display space 11 as shown in the display area selection UI 14 (a). Change to For example, the display control means 142 changes the display area selection UI 14 to a display area selection UI 14 (a) when the horizontal length is larger than the predetermined value with respect to the vertical length of the display area. That is, the display control unit 142 displays the display result indicating the division result of the area of the display unit by the division unit when the flick operation or the drag operation is performed before the flick operation or the drag operation is performed to the size of the display area of the display unit. Change based on. In the case of FIG. 11, even if the flick operation is performed other than in the left-right direction, the division of the area by the dividing unit 122 is not performed.

  Further, as an example in which the display can be limited to only the upper and lower two divisions as shown in FIG. 12, the case where the screen size is vertically long and arranged horizontally in two rows as shown in FIG. For example, the display control unit 142 displays the display area selection UI 14 as the display area selection UI 14 (b) based on the aspect ratio of the display area including the object display area 10 and the material display space 11 displayed on the UI display unit 105. Change to For example, the display control means 142 changes the display area selection UI 14 to a display area selection UI 14 (a) when the vertical length is larger than the predetermined value with respect to the horizontal length of the display area. In the case of FIG. 11, even if the flick operation is performed other than in the vertical direction, the division of the area by the dividing unit 122 is not performed.

  According to the present embodiment, in addition to the effects of the first embodiment, it is possible to divide the area in accordance with the characteristics of the size of the display area. Therefore, when the area is divided and the image is displayed, it is possible to prevent the display from being difficult for the user to see.

Embodiment 3
In the third embodiment, as shown in FIGS. 13 and 14, the display area selection UI 14 is changed to display area selection UIs 14 (c) and 14 (d) according to the attribute of the display target material. Then, it is possible to display flick operation only on the right side or only on the lower side.

  As an example of restricting display to only the right side as shown in FIG. 13, for the purpose of preventing confusion of the data, the data of the patient currently displayed and the data of another patient are displayed only on the right An example is given. Specifically, the display control unit 142 acquires, from the data storage area 107, the patient identification information associated with the image currently displayed in the material display space 11. The display control means 142 also acquires patient identification information of the material corresponding to the symbol image which is the target of the flick operation. Then, the display control means 142 compares the patient identification information of the material corresponding to the symbol image subjected to the flick operation with the patient identification information associated with the image currently displayed in the material display space 11. . As a result of comparison, if different, the display control means 142 changes the display area selection UI 14 to a display area selection UI 14 (c) shown in FIG. Usually, the information of the focused patient is displayed on the left, and the information of other patients for reference is often displayed on the right. Therefore, it is possible to prevent the user from feeling discomfort by doing as described above. Become.

  As another example, there is an example in which the material with the latest examination date and time is displayed only on the right side. Specifically, the display control means 142 acquires from the data storage area 107 the shooting date and time associated with the image currently displayed in the material display space 11. The display control means 142 also acquires the photographing date and the like of the material corresponding to the symbol image which is the target of the flick operation. Then, the display control means 142 compares the shooting date and time of the material corresponding to the symbol image subjected to the flick operation with the shooting date and time associated with the image currently displayed in the material display space 11. If the shooting date and time of the material corresponding to the symbol image subjected to the flick operation is newer as a result of comparison, the display control means 142 displays the display area selection UI 14 of the display area selection UI 14 (c) shown in FIG. To change. Usually, new materials are displayed on the right side, so that it is possible to prevent the user from feeling uncomfortable when doing as described above.

  In the above example, the document corresponding to the symbol image subjected to the flick operation is displayed on the right side of the divided area. However, the present invention is not limited to this, and it is divided by the user It may be displayed on the left side of the area.

  Next, as an example of restricting the display to only the lower side as shown in FIG. 14, the actual positional relationship of the parts of the image is reflected, and the image of the abdomen is displayed only on the lower side of the image of the chest There is an example of making it impossible. At this time, in the case of a DICOM image, the site can be acquired from a Body Part Examined tag. Further, as for the positional relationship between the parts, for example, information on a table defined like head, chest, upper limbs, spine, abdomen, pelvis, lower limbs in order from the top is stored in the data storage area 107 and referred to To do. Specifically, the display control unit 142 acquires, from the data storage area 107, part information associated with the image currently displayed in the material display space 11. The display control means 142 also acquires part information of the material corresponding to the symbol image which is the target of the flick operation. Then, the display control means 142 uses the above table for the part of the material corresponding to the symbol image which is the object of the flick operation and the part corresponding to the image currently displayed in the material display space 11. Compare. As a result of comparison, the portion of the material corresponding to the symbol image subjected to the flick operation is located below the portion corresponding to the image currently displayed in the data display space 11 in the human body structure. In the case of the site, the following processing is performed. For example, the display control means 142 changes the display area selection UI 14 to a display area selection UI 14 (d) shown in FIG. Further, the portion of the material corresponding to the symbol image subjected to the flick operation is located above the portion associated with the image currently displayed in the data display space 11 in the human body structure. The following process is performed. For example, the display control unit 142 may change the display area selection UI 14 to a UI for displaying on the upper side of the divided area.

  As described above, in the third embodiment, the display control unit 142 displays on the object a display indicating the division result of the area of the display unit by the division unit when the flick operation or the drag operation is performed before the flick operation or the drag operation is performed. It changes based on either the imaging | photography date of the matched image, the imaging | photography site | part or the identification information which identifies the test subject of an image.

  As another example, a general display order of image modality may be reflected so that CT images can be displayed only below simple X-rays.

  According to the present embodiment, it is possible to provide a more intuitive display to the user in addition to the effects in the first embodiment.

<Other Embodiments>
Although the embodiment has been described above in detail, the present invention can be embodied as, for example, a system, an apparatus, a method, a program, or a recording medium (storage medium). Specifically, the present invention may be applied to a system configured of a plurality of devices (for example, a host computer, interface device, imaging device, web application, etc.), or may be applied to a device including one device. good.

  Further, it goes without saying that the object of the present invention can be achieved by the following. That is, a recording medium (or storage medium) storing a program code (computer program) of software for realizing the functions of the above-described embodiments is supplied to a system or apparatus. Such storage media are, of course, computer readable storage media. Then, the computer (or CPU or MPU) of the system or apparatus reads out and executes the program code stored in the recording medium. In this case, the program code itself read from the recording medium implements the functions of the above-described embodiments, and the recording medium recording the program code constitutes the present invention.

DESCRIPTION OF SYMBOLS 1 Material display apparatus 112 Detection means 122 Division means 132 Determination means 142 Display control means

Claims (9)

A detection unit that detects an operation direction of a flick operation or a drag operation on an object displayed on the display unit;
A division unit configured to divide a display area of the display unit into a plurality of areas based on the operation direction detected by the detection unit;
A determination unit configured to determine an area to display an image associated with the object among the plurality of areas based on the operation direction detected by the detection unit;
Display control means for displaying an image associated with the object in the area determined by the determination means;
Equipped with
When the detection unit detects that the object is selected by the user, the display control unit performs the flick operation or the drag operation before the flick operation or the drag operation is performed. An information processing apparatus, wherein a display indicating a division result of an area of the display unit is displayed for each of the operation directions. The dividing unit divides the area of the display unit in different ways with respect to a plurality of different operation directions,
The information processing apparatus according to claim 1, wherein the determination unit sets an area in which the image is displayed to be different areas with respect to a plurality of different operation directions.   When the detection unit detects that the object is selected by the user for a predetermined time or more, the display control unit performs the flick operation or the drag operation before the flick operation or the drag operation is performed. 3. The information processing apparatus according to claim 1, wherein a display indicating the division result of the area of the display unit by the division unit is displayed for each of the operation directions.   The display control unit is configured to perform the flick operation or the drag operation in addition to the display indicating the division result of the area of the display unit by the division unit when the flick operation or the drag operation is performed. The information processing apparatus according to any one of claims 1 to 3, wherein a display indicating an area for displaying the image to be determined is displayed for each of the operation directions.   The display control means is a display area of the display unit for displaying a display indicating the division result of the area of the display unit by the dividing means when the flick operation or the drag operation is performed before the flick operation or the drag operation is performed. The information processing apparatus according to any one of claims 1 to 4, wherein the information processing apparatus changes according to the size of the information.   The display control means associates, with the object, a display indicating the division result of the area of the display unit by the division means when the flick operation or the drag operation is performed before the flick operation or the drag operation is performed. The information processing apparatus according to any one of claims 1 to 4, wherein the change is made based on any one of the imaging date and time of the image, the imaging region, and identification information for identifying the subject of the image.   The information processing apparatus according to any one of claims 1 to 6, wherein the object is a thumbnail or an icon. A detection step of detecting an operation direction of a flick operation or a drag operation on an object displayed on the display unit;
A division step of dividing the display area of the display unit into a plurality of areas based on the operation direction detected in the detection step;
A determining step of determining an area to display an image associated with the object among the plurality of areas based on the operation direction detected in the detecting step;
A display control step of displaying an image associated with the object in the area determined in the determination step;
When it is detected in the detection step that the object is selected by the user, in the display control step, the division step is performed when the flick operation or the drag operation is performed before the flick operation or the drag operation is performed An information processing method comprising displaying a display indicating the division result of the area of the display unit for each of the operation directions.   A program causing a computer to execute the information processing method according to claim 8.

Images