JP2018171441A - Computer program, display device, display system, and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a computer program, display device, display system, and display method, for preventing an erroneous operation when a risk of designating an unintended area exists in designating a desired position on a screen.SOLUTION: A computer program for making a computer display medical information on a display screen, makes the computer execute: processing of allocating different pieces of first predetermined processing to respective ones of a plurality of first specific operations; and processing of displaying a selection menu for selecting second predetermined processing different correspondingly to a type of the medical information when one specific operation of the plurality of first specific operations is performed with respect to the medical information displayed on the display screen.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to a computer program, a display device, a display system, and a display method.

  In recent years, in medical institutions such as hospitals and clinics, digitization and systematization of medical information is progressing. Documents such as image data or inspection data in each department such as radiology departments of medical institutions, reports showing inspection results, etc. A medical information integrated management system in which a large amount of medical information such as data and electronic medical records is made into a database has been put into practical use.

  Such a medical information integrated management system includes a server that centrally manages a large amount of medical information, an information processing device that transmits medical data obtained in each department to the server, and medical personnel such as doctors, engineers, and nurses. A display device for browsing medical information or performing a required operation is provided.

  When interpreting a medical image or the like, a past image is compared with a current image. Therefore, in order to reduce the burden on the operator at the time of image interpretation, a predetermined process is associated with each partial area of the displayed image, and a desired position is designated on the screen. A system for executing processing corresponding to a specific position is disclosed (see Patent Document 1).

Japanese Patent No. 5416890

  However, in a system such as that disclosed in Patent Document 1, a single process is assigned to an area, and when a plurality of processes are assigned, it is necessary to divide the area into smaller areas. For this reason, there is a possibility that an unintended region may be specified when specifying a desired position on the screen, and an unintended process may be performed, which may increase erroneous operations.

  The present disclosure has been made in view of such circumstances, and clarifies a computer program, a display device, a display system, and a display method that can facilitate a desired process.

  The present application includes a plurality of means for solving the above problems. To give an example, a computer program is a computer program for causing a computer to display medical information on a display screen. A process of assigning a different first predetermined process to each of the first specific operations and one specific operation of the plurality of first specific operations is performed on the medical information displayed on the display screen. If so, a process for displaying a selection menu for selecting a different second predetermined process corresponding to the type of medical information is executed.

  According to the present disclosure, a desired process can be facilitated. Further features related to the present disclosure will become apparent from the description of the present specification and the accompanying drawings. Problems, configurations, and descriptions other than those described above will be clarified by the following description of embodiments.

It is a block diagram which shows an example of a structure of the display system of this Embodiment. It is a block diagram which shows an example of a structure of the display process part of this Embodiment. It is a schematic diagram which shows the 1st display example which the display process part of this Embodiment displays on a display screen. It is explanatory drawing which shows an example of specific operation processed with the display process part of this Embodiment. It is explanatory drawing which shows the 1st example of the predetermined process allocated to specific operation by the display process part of this Embodiment. It is a schematic diagram which shows an example of the gesture on the multiwindow display which the display process part of this Embodiment displays on a display screen. It is explanatory drawing which shows the 2nd example of the predetermined process allocated to specific operation by the display process part of this Embodiment. It is explanatory drawing which shows the 3rd example of the predetermined process allocated to specific operation by the display process part of this Embodiment. It is a schematic diagram which shows the 1st example of the selection menu which the display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 1st example of the operation | movement at the time of selection of the selection menu by the display process part of this Embodiment. It is a schematic diagram which shows the 2nd example of operation | movement at the time of selection of the selection menu by the display process part of this Embodiment. It is a schematic diagram which shows the 2nd example of the selection menu which the display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 3rd example of the selection menu which the display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 4th example of the selection menu which the display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 2nd display example which the display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 1st example of the icon which the menu display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 1st example of the adjustment operation icon which the menu display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 2nd example of the icon which the menu display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows an example of operation with respect to the icon which the menu display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the 3rd example of the icon which the menu display process part of this Embodiment displays on a display screen. It is a schematic diagram which shows the other example of the icon which the menu display process part of this Embodiment displays on a display screen. It is a block diagram which shows the other example of a structure of the display process part of this Embodiment. It is a flowchart which shows the 1st example of the display process by the display apparatus of this Embodiment. It is a flowchart which shows the 2nd example of the display process by the display apparatus of this Embodiment. It is a flowchart which shows the 2nd example of the display process by the display apparatus of this Embodiment.

  Hereinafter, a display device according to an embodiment of the present disclosure, a computer program for realizing the display device, a display system, and a display method will be described. FIG. 1 is a block diagram illustrating an example of a configuration of a display system 100 according to the present embodiment. The display system 100 according to the present embodiment is, for example, a medical information integrated management system, and medical information related to diagnosis, diagnosis, examination, and the like performed in a medical institution such as a hospital or a clinic can be referred to for each patient. Integrated management.

  The display system 100 includes a server 20 that integrally manages medical information, a plurality of information processing apparatuses 10 connected to the server 20 via a predetermined communication network, a display apparatus 50, and the like. In FIG. 1, only one display device 50 is shown for convenience, but a plurality of display devices 50 may be connected to the server 20.

  The information processing apparatus 10 is installed in a plurality of treatment departments, medical departments, examination departments, or the like in a medical institution, and can perform predetermined electronic data input processing, recording processing, editing processing, output processing, and the like. The information processing apparatus 10 can be configured by a computer system including peripheral devices. For example, a radiation system, an electronic medical record system, an endoscope system, a physiological examination system, an electrocardiogram system, a sample laboratory system, a drug prescription system, etc. Can be configured. The information processing apparatus 10 can transmit medical information such as image data, document data, and examination data to the server 20.

  The server 20 includes a control unit 21, a storage unit 22, a communication unit 23, and the like that control the entire server 20.

  The communication unit 23 has a communication function between the information processing device 10 and the display device 50, and can transmit and receive required information.

  The storage unit 22 stores medical information transmitted by each information processing apparatus 10. The storage unit 22 can store medical information in association with each patient for each piece of specific information that specifies a patient.

  The control unit 21 can be configured by a CPU, a memory (ROM, RAM, etc.), a program stored in the memory, and the like, and extracts medical information stored in the storage unit 22 based on specific information that identifies a patient. Then, display data in a list display format is generated in which the extracted medical information is arranged in a matrix by two specific elements that can specify the medical information.

  The display device 50 includes a display screen 51 such as a liquid crystal panel, a display processing unit 52, an operation input unit 53, a communication unit 54, a storage unit 55, and the like. The display device 50 is used by medical personnel such as doctors, engineers, and nurses of medical institutions to perform operations and browsing related to medical information, and is used for medical treatment and diagnosis. The display device 50 can be configured by a computer device including a peripheral device, but may be a tablet device that can perform a touch operation on the screen.

  Note that the display device 50 may incorporate the function of the server 20. For example, the display device 50 can also accumulate and display necessary information via the network directly with the information processing device 10 without going through the server 20.

  The display device 50 may incorporate the function of the information processing device 10. For example, the function of the information processing apparatus 10 can be incorporated into the display device 50 by extending the function of the electronic medical record system.

  Moreover, the display screen 51 with which the display apparatus 50 is provided is not limited to one, It can also be provided with several display screens (multiple display devices).

  The operation input unit 53 includes a keyboard, a mouse, a track pad (touch pad), a stylus pen, and the like, and a medical worker needs icons (graphics, characters, numbers, symbols, etc.) on the display screen 51 or the display screen 51. Is operated (for example, in the case of a mouse, left click, right click, double click, etc.), the input operation is converted into a command corresponding to the operation and output to the display processing unit 52.

  The communication unit 54 receives display data in a list display format transmitted by the server 20. Display data received by the communication unit 54 is stored in the storage unit 55.

  FIG. 2 is a block diagram showing an example of the configuration of the display processing unit 52 of the present embodiment. The display processing unit 52 includes an allocation processing unit 521, a predetermined processing unit 522, a menu display processing unit 523, and the like. The display processing unit 52 can be configured by a CPU, a memory (ROM, RAM, etc.), a program stored in the memory, and the like.

  The display processing unit 52 receives medical information that is integrated and managed by the server 20 via the communication unit 54, so that medical information necessary for diagnosis, diagnosis, examination, and the like is matched to the use of each medical worker. For each patient, a process of displaying the past medical information to the latest medical information in time series is performed.

  For convenience, the medical information can be divided for each type of image, document, examination, medication, and the like. The image includes data such as CT (Computed Tomography), CR (Computed Radiology), US (Ultrasonography), and MRI (Magnetic Resonance Imaging). The images also include moving images. The document includes, for example, a letter of introduction, a medical certificate, a report, a questionnaire, a consent form, a plan, and the like. The examination includes examination data such as electrocardiogram, electroencephalogram, ultrasound, fundus, arteriosclerosis, blood pressure, body temperature, endoscope, etc. as physiological data, and sample data includes, for example, CEA (tumor marker), blood Laboratory data such as pathology, urine, and ALT (alanine aminotransferase) are included. Dosing includes dosing information.

  Note that one or a plurality of images acquired in one examination are managed as one piece of image information. When a plurality of images are included in one image information, the plurality of images are referred to as series images. The series image is composed of, for example, a plurality of images with different imaging parts.

  Next, details of the display processing unit 52 will be described.

  The allocation processing unit 521 allocates a plurality of specific operations corresponding to the movement trajectories with different pointers displayed on the display screen 51. The pointer includes, for example, a mouse cursor. Also, the assignment processing unit 521 assigns a different first predetermined process to each of a plurality of specific operations. Further, the assignment processing unit 521 assigns a different second predetermined process to each of a plurality of second specific operations for each of a plurality of pieces of medical information having different types. The first predetermined process is a process that is not related to the type of medical information among the predetermined processes, and the second predetermined process is a process that corresponds to the type of medical information among the predetermined processes. The specific operation includes, for example, a mouse gesture (specific movement operation of the cursor) or a mouse button click operation. In this specification, for the sake of convenience, a plurality of specific operations are classified into a first specific operation and a second specific operation. The first specific operation is an operation for displaying a selection menu for selecting a different second predetermined process corresponding to the type of medical information according to the specific operation without depending on the type of medical information. That is, if the type of medical information is different, a different selection menu is displayed even if the operation is the same. This eliminates the need to remember the operation for each piece of medical information, improving convenience. On the other hand, the second specific operation corresponds to the type of medical information, and if the type of medical information is different even for the same operation, a different second predetermined process (including display of a selection menu) can be assigned. It is an operation. Note that the operation contents of the first specific operation and the second specific operation may be the same or different. Details of the specific operation will be described later.

  When one specific operation among a plurality of specific operations is performed on the medical information displayed on the display screen 51, the predetermined processing unit 522 performs a predetermined process (first process) assigned to the one specific operation. Predetermined process or second predetermined process).

  Since different predetermined processes are assigned to each of the plurality of specific operations, the desired process can be facilitated only by performing the specific operation corresponding to the desired process.

  This will be specifically described below.

  FIG. 3 is a schematic diagram illustrating a first display example displayed on the display screen 51 by the display processing unit 52 of the present embodiment. The display example shown in FIG. 3 is also referred to as multi-window display, and simultaneously displays a plurality of pieces of medical information at a certain point in time or period of a certain patient (for example, patient ID: xxxxxxxx). In the example of FIG. 3, each of the CR image, CT image, MRI image, US image, document, and inspection data is displayed in a predetermined display area 61 on the display screen 51. Note that the types of medical information and the number of medical information to be displayed are examples, and are not limited to the example in FIG.

  FIG. 4 is an explanatory diagram illustrating an example of a specific operation processed by the display processing unit 52 according to the present embodiment. The specific operation illustrated in FIG. 4 shows an example of a gesture operation. The gesture operation can be started by pressing a specific key, clicking the mouse, or locating the mouse cursor (pointer) in a predetermined area of the display screen 51.

  As shown in FIG. 4, the operation C1 is a gesture for moving the cursor in the horizontal direction (from left to right or from right to left). The operation C2 is a gesture for moving the cursor in the vertical direction (from top to bottom or from bottom to top). The operation C3 is a gesture for moving the cursor diagonally upward (lower left to upper right, or lower right to upper left). Operation C4 is a gesture for moving the cursor diagonally downward (upper left to lower right or upper right to lower left). Operation C5 is a gesture that moves in a circle (draws a circle) with the cursor. Operation C6 is a gesture for moving the cursor in a V shape. The operation C7 is a gesture for moving the cursor in an L shape in the lower right direction. Operation C8 is a gesture for moving the cursor in an L shape in the lower left direction. Operation C9 is a gesture for moving the cursor to the left in an L shape. Operation C10 is a gesture for moving the cursor to the right in an L shape. As a result, the operation time of the operator can be shortened and the convenience can be improved. A predetermined process performed by the display processing unit 52 (predetermined processing unit 522) can be assigned to each gesture operation. The set gesture operation can be changed according to the preference of the operator. The gesture operation illustrated in FIG. 4 can be assigned to one or both of the first specific operation and the second specific operation.

  When one specific operation among the plurality of specific operations (first specific operations) is performed on the medical information displayed on the display screen 51, the menu display processing unit 523 sets the type of the medical information. Correspondingly, a selection menu for selecting a different second predetermined process is displayed. The selection menu will be described later.

  As a result, a selection menu for selecting a different second predetermined process corresponding to the type of medical information is displayed only by performing one specific operation among a plurality of specific operations (first specific operations). This makes it easy to select a desired process.

Note that the gesture operation is not limited to the operation illustrated in FIG. Although not illustrated in FIG. 4, a mouse click operation can also be included as an example of a gesture operation. Mouse click operations include, for example, mouse-over (operation to move the mouse cursor to the required position and hold it), left 1 click, left 2 click (double click), left 3 click (triple click), right 1 click , Right 2 clicks, right 3 clicks, dragging and other operations. Further, the first specific operation and the second specific operation include a combination of pressing of a key including a specific key (for example, a shift key, a CTL key, an ALT key, a Windows key, etc.) and a simultaneous operation of a gesture operation, or the key. A combination of simultaneous pressing of the button and mouse button operation can also be included.

  FIG. 5 is an explanatory diagram showing a first example of a predetermined process assigned to a specific operation by the display processing unit 52 of the present embodiment. In the example of FIG. 5, series images, documents, and moving images are listed as medical information. In addition, as the second specific operation, among the operations illustrated in FIG. 4, operations C1, C2, and C3 are cited. As shown in FIG. 5, when the operation C1 is performed on the series image (that is, when the cursor is moved in the horizontal direction on the series image displayed on the display screen 51), the animation reproduction of the series image starts. Is done. Further, when the same operation C1 is performed on a document, a keyword search process different from that for a series image is performed. Further, when the same operation C1 is performed on the moving image, the moving image is reproduced. The operations C2 and C3 are also as shown in FIG.

  As described above, when the specific processing unit 522 performs one specific operation of the plurality of specific operations (second specific operations) on the medical information displayed on the display screen 51, the medical processing is performed. A second predetermined process assigned to the information and one specific operation is performed. Note that the second predetermined process includes a process of displaying a selection menu for selecting a different second predetermined process corresponding to the type of medical information.

  In the example of FIG. 5, the predetermined process assigned to the series image and the operation C1 is the start of animation reproduction, and the predetermined process assigned to the document and the operation C1 is a keyword search and is assigned to the moving image and the operation C1. The predetermined process is reproduction of a moving image. In the case of a document, it is possible to include a keyword display process, a process for switching between the entire document display and an enlarged display of a point of interest (important part). In the case of a moving image, display switching processing such as start, frame, and time can be included.

  As described above, when the same specific operation is performed, different predetermined processes can be assigned for each type of medical information. Therefore, when performing different processes for each medical information, it is necessary to assign different operations for each medical information. Rather, it is possible to execute a desired process for each piece of medical information in one specific operation. Thereby, it can prevent that the number of different specific operation increases.

  FIG. 6 is a schematic diagram showing an example of a gesture on the multi-window display displayed on the display screen 51 by the display processing unit 52 of the present embodiment. The example of FIG. 6 shows a state in which the gesture of operation C7 is performed on the multi-window display CT image illustrated in FIG. In this way, a specific gesture operation (specific operation) can be performed on desired medical information among different medical information displayed in multiple windows.

  FIG. 7 is an explanatory diagram illustrating a second example of the predetermined process assigned to the specific operation by the display processing unit 52 according to the present embodiment. FIG. 7 shows the correspondence between the specific operation for the CT image and the assigned predetermined process. As shown in FIG. 7, a selection menu display process for selecting a gradation operation is assigned as a predetermined process to the operation C7, and brightness, brightness, WL (window value), WW (window width) are assigned. ), Gradation inversion, gradation initial state, etc. (processing) can be performed.

  In addition, a selection menu display process for selecting a file operation is assigned to the operation C8 as a predetermined process, and operations (processes) such as opening, closing, displaying the next file, and displaying the previous file are processed. )It can be performed.

  Also, for the operation C9, a display process of a selection menu for selecting an enlargement / reduction / rotation / inversion operation is assigned as a predetermined process, and operations (processes) such as enlargement / reduction, magnification change, rotation, left / right inversion )It can be performed.

  Also, for the operation C10, a display process of a selection menu for selecting a display layout change operation is assigned as a predetermined process, and operations (processes) such as changing the number of display windows, enlarging only one image, displaying a list, and the like are performed. It can be carried out.

  As described above, in the predetermined process assigned to the specific operation, when one specific operation is performed on the medical information displayed on the display screen 51, a selection menu for selecting the predetermined process for the medical information is displayed. The process to perform is also included. Note that the gestures, selection menus, and operation details (processing) illustrated in FIG. 7 are examples, and are not limited to the examples in FIG.

  FIG. 8 is an explanatory diagram illustrating a third example of the predetermined process assigned to the specific operation by the display processing unit 52 according to the present embodiment. FIG. 8 shows the correspondence between the specific operation for the inspection data and the assigned predetermined process. As shown in FIG. 8, a selection menu display process for selecting a print operation is assigned to the operation C7 as a predetermined process, and an operation (process) such as a print setting can be performed.

  In addition, for the operation C8, a display process of a selection menu for selecting a graph display operation is assigned as a predetermined process, and an operation (process) such as a display setting when graphing examination data is performed. Can do.

  In addition, for the operation C9, a display process of a selection menu for selecting a search operation is assigned as a predetermined process, and an operation (process) such as a search condition setting for characters in the inspection data can be performed.

  Further, for the operation C10, a display process of a selection menu for selecting an enlargement / reduction operation is assigned as a predetermined process, and an operation (process) such as a magnification setting can be performed.

  As described above, a plurality of specialized medical information can be obtained simply by selecting the required medical information from the plurality of medical information displayed on the display screen 51 and performing a specific operation (for example, a specific gesture operation). Since a selection menu for selecting the process (operation content) is displayed, it becomes easy to select a desired process.

  Further, the operations C7 to C10 illustrated in FIG. 7 and FIG. 8 are assigned different predetermined processes for different types of medical information (CT images in FIG. 7 and examination data in FIG. 8). Operations C7 to C10 can be referred to as second specific operations.

  FIG. 9 is a schematic diagram showing a first example of a selection menu 62 displayed on the display screen 51 by the display processing unit 52 of the present embodiment. A selection menu 62 shown in FIG. 9 shows an example of a gradation operation menu for the CT image exemplified in FIG. The selection menu 62 has a shape in which one of the circles divided into four equal parts in the radial direction is missing, and is arranged adjacent to the display area at the lower right corner of the display area of the CT image. The selection menu 62 is classified into three areas classified according to operation contents (processing). In each area, an icon for recalling the operation content is displayed. The shape of the selection menu 62, the number of operation content classifications, icons representing the operation content, and the like are examples, and are not limited to the example of FIG.

  As described above, when the menu display processing unit 523 performs the second specific operation on the medical information displayed on the display screen 51, the menu display processing unit 523 performs a second predetermined process that differs depending on the type of the medical information. A selection menu 62 to select can be displayed.

  That is, by performing a common operation (first specific operation) regardless of the type of medical information or a second specific operation corresponding to the type of medical information, the menu display processing unit 523 is related to the medical information. An operation group can be displayed as an operation menu. The operation (process) displayed as the operation menu may be the operation illustrated in FIG. 7 (referred to as “predetermined process A”), or the operation most frequently used for the medical information (predetermined process B). May be used). Thereby, even if it does not remember operation, such as gesture operation for every medical information, operation related to the said medical information can be implemented in the state which reduced the workload.

  The menu display processing unit 523 displays a selection menu 62 having transparency. Thereby, even if the selection menu 62 is displayed over a part of medical information such as an MRI image, the part of the medical information can be visually recognized.

  The menu display processing unit 523 displays the selection menu 62 in or near the display area where the medical information (CT image in the example of FIG. 9) on which the specific operation has been performed is displayed. By displaying the selection menu 62 in the display area, the movement distance of the mouse cursor (pointer) can be reduced, the work load can be reduced without misidentifying which medical information is to be processed. Efficiency can be improved. Further, by displaying the selection menu 62 in the vicinity of the display area, in addition to the above-described effects, the processing result of the target medical information can be clearly grasped.

  Further, the display position of the operation menu 62 (FIG. 9, FIG. 12, FIG. 13, which will be described later, etc.) may be designated depending on the specific operation mode. For example, the display position of the operation menu 62 may be designated by the position where the specific operation is started. By doing in this way, the transition from the specific operation to the operation in the operation menu can be performed smoothly. Further, the number of operation menus may be specified depending on the specific operation mode. For example, the time when the specific operation is performed or the length of the movement locus of the cursor may be associated with the number of operation menus such as 3, 5, or 7. By doing this, it is possible to intuitively specify the number of menus for a specific operation without having to remember the operation for specifying the number of menus separately.

  FIG. 10 is a schematic diagram illustrating a first example of an operation when the selection menu 62 is selected by the display processing unit 52 of the present embodiment. In the example of FIG. 10, the lower left in the selection menu 62 (three icons of “change gradation”, “invert gradation”, “return gradation operation result to initial state”) are displayed. By moving the mouse cursor M to the gradation change symbol (icon), the slider bar for changing the gradation is displayed. The slider bar has a bar for changing WL (window value) in the vertical direction and WW (window width) in the horizontal direction. The medical staff can change the gradation on the slider bar by, for example, moving the mouse up, down, left and right while left-clicking. The gradation can be changed by moving the mouse up and down and left and right while left-clicking the mouse in a place other than the slider bar, for example, in the display area of the CT image.

  FIG. 11 is a schematic diagram showing a second example of the operation when the selection menu 62 is selected by the display processing unit 52 of the present embodiment. In the example of FIG. 11, it is assumed that the CT image is a series image. In the selection menu 62 (three icons "Image Operation", "Play Animation", and "Stop Animation Play" are displayed), the mouse cursor is placed on the image operation symbol (icon) in the series image at the lower left. By moving M, a slider bar for selecting an image (image) to be displayed from the series images is displayed. The slider bar has a bar for selecting Im (image position) in the vertical direction. The medical staff can change the image (image) to be displayed on the slider bar, for example, by moving the mouse up and down while left-clicking. Further, a displayed image (image) can be changed by moving the mouse up and down while left-clicking in a place other than the slider bar, for example, the display area of the CT image.

  As described above, a selection menu for selecting a predetermined process assigned to a specific gesture operation is displayed in the vicinity of required medical information, and a desired operation can be performed by selecting a process (operation) in the displayed selection menu. Can be easily performed.

  FIG. 12 is a schematic diagram showing a second example of the selection menu 62 displayed on the display screen 51 by the display processing unit 52 of the present embodiment. A selection menu 62 shown in FIG. 12 shows an example of a gradation operation menu for the CT image exemplified in FIG. The selection menu 62 has a fan-like shape in which two opposing long rectangular sides are curved in the same direction, and is arranged at the lower right corner in the CT image display area. Each icon in the selection menu 62 is the same as that in the example of FIG. 9, but may be different.

  The selection menu 62 has transparency. Thereby, even if the selection menu 62 is displayed overlaid on a part of medical information such as a CT image, the part of the medical information can be visually recognized.

  FIG. 13 is a schematic diagram showing a third example of the selection menu 62 displayed on the display screen 51 by the display processing unit 52 of the present embodiment. In the example of FIG. 13, a predetermined specific operation (for example, a gesture operation, a mouse click operation, etc.) is performed on the CT image displayed on the display screen 51 (may be on the display area of the CT image). For example, a selection menu 62 is displayed around the tip position S of the cursor M.

  In the example of FIG. 13, the distance between the position of the cursor M (for example, the tip position S) and each area where the icons in the selection menu 62 are displayed are approximately the same, and the distance is relatively small. I try to shorten it.

  That is, when one specific operation is performed on the medical information displayed on the display screen 51, the menu display processing unit 523 displays a region around the position on the display screen 51 where the one specific operation is performed. Displays a selection menu. Thereby, when a desired process is selected, the moving distance of the mouse cursor (pointer) can be reduced, the work load can be reduced, and the work efficiency can be improved.

  In addition, the menu display processing unit 523 can display a fan-shaped selection menu 62 composed of a part of concentric circles centered on the position of the cursor M of the mouse. Thereby, when a desired process is selected, the moving distance of the mouse cursor (pointer) can be reduced, the work load can be reduced, and the work efficiency can be improved.

  FIG. 14 is a schematic diagram showing a fourth example of the selection menu 62 displayed on the display screen 51 by the display processing unit 52 of the present embodiment. The example of FIG. 14 shows a case where a submenu (subselection menu) 63 obtained by further subdividing operations in the selection menu 62 is displayed. That is, the submenu 63 of the process selected in the selection menu 62 is displayed, and a desired process can be selected from the submenu 63.

  As shown in FIG. 14, when the mouse cursor M is moved to the “rotation” menu 62a in the selection menu 62 and the “rotation” menu 62a is selected, a submenu 63 is displayed. Each processing of “rotation”, “left rotation”, “inverted vertically”, and “inverted horizontally” can be selected. By displaying the submenu 63, it is possible to easily select detailed processing for the processing displayed in the selection menu 62. Note that the example of the submenu 63 is not limited to the example of FIG.

  As described above, when an operation item in the selection menu 62 is selected, the menu display processing unit 523 displays the submenu 63 for selecting a predetermined process related to the selected operation item. As a result, even when a plurality of predetermined processes are hierarchized into a wide variety, a desired process can be easily selected.

  Further, when a selection operation is performed in the selection menu 62, the menu display processing unit 523 displays a submenu 63 in an area around the position on the display screen 51 where the selection operation is performed. Thereby, when a desired process is selected, the moving distance of the mouse cursor (pointer) can be reduced, the work load can be reduced, and the work efficiency can be improved.

  In addition, the menu display processing unit 523 can display a fan-shaped submenu 63 including a part of concentric circles centered on the position of the cursor M of the mouse. Thereby, when a desired process is selected, the moving distance of the mouse cursor (pointer) can be reduced, the work load can be reduced, and the work efficiency can be improved.

  Moreover, since the submenu 63 has transparency, even if the submenu 63 is displayed so as to overlap with a part of medical information such as a CT image, the part of the medical information can be visually recognized.

  Next, a VR (volume rendering) image will be described as an example of an image that is one type of medical information.

  FIG. 15 is a schematic diagram illustrating a second display example displayed on the display screen 51 by the display processing unit 52 of the present embodiment. The difference from the first display example shown in FIG. 3 is that a VR image of a certain patient (for example, patient ID: xxxxxxxx) at a required time or period is displayed in a predetermined display area 61 on the display screen 51. It is. By performing the specific operation illustrated in FIG. 4 on the display screen 51 (for example, on the VR image or at a place away from the VR image), the menu display processing unit 523 performs a predetermined process as shown in FIG. An icon for performing can be displayed. An icon refers to a single image formed by the selection menu as a specific pixel area on the screen, and a predetermined operation is assigned according to the entire area to be formed or the position of the area to be formed. Refers to things.

  That is, the menu display processing unit 523 can display an icon for performing a predetermined process on an image when either the first specific operation or the second specific operation is performed. Here, the predetermined process may be a first predetermined process or a second predetermined process.

  FIG. 16 is a schematic diagram illustrating a first example of icons displayed on the display screen 51 by the menu display processing unit 523 according to the present embodiment. The predetermined processing can be, for example, processing related to conversion to a VR image, and includes rotation processing (free rotation on 3D or rotation on a plane), enlargement / reduction processing, translation processing, clipping by ROI (Region of Interest). Processing etc. can be included. The predetermined process can be a process related to a VR image. For example, a process related to color map adjustment (for example, RGB value adjustment, opacity adjustment, signal value for setting a control point) Or a process of adjusting the specular reflectance or the ambient light. A color map is a conversion table in which the relationship between signal values, RGB values, and opacity is defined by the user. By applying it to volume rendering, a specific organ can be colored with an arbitrary color. The transparent organ can be rendered transparent.

  In the example of FIG. 16, the icon 71 is assigned a rotation process (also referred to as rotation) in 3D, the icon 72 is assigned a rotation process (also referred to as spin) on a plane, and the icon 73 is Enlargement / reduction processing (also referred to as dolly) is assigned, and the icon 74 is assigned parallel movement processing (also referred to as panning). In the example of FIG. 16, a state in which an operation on the icon 74 is accepted is illustrated. The operation for the icon that performs the predetermined process can be, for example, an operation such as click, flick, or mouse-over, but is not limited to these operations. The icon for performing the predetermined process is not limited to the example of FIG.

  When the predetermined processing unit 522 receives an operation for an icon for performing a predetermined process, the predetermined processing unit 522 receives an operation for adjusting the processing amount of the predetermined process at the position of the icon. More specifically, when receiving an operation on an icon for performing a predetermined process, the predetermined processing unit 522 receives an operation for adjusting a processing amount of the predetermined process that is different depending on a position where the operation in the icon is received. When the predetermined process is, for example, a process related to conversion of a VR image, the processing amount can be, for example, a rotation angle, an enlargement / reduction ratio, a parallel movement amount (offset), an ROI coordinate, or the like. “At the position of the icon” includes, for example, the boundary between the icon and a region other than the icon, the vicinity of the icon, and the like on the icon.

  In the present embodiment, with the above-described configuration, a predetermined process is assigned according to the position of the displayed icon, and the processing amount of the predetermined process can be adjusted by an operation at the icon position. The desired operation can be realized in the vicinity of, so that the operation can be simplified and the operation display area can be reduced. The vicinity of the medical information may be a position overlapping with a part of the medical information, a position in contact with the medical information, or a position away from the medical information by a short distance.

  In the present embodiment, as shown in FIG. 16, the processing content can be changed according to the positions of the icons 71 to 74. In other words, in the present embodiment, different processing can be assigned according to the position information of the icons 71 to 74, and the processing amount of processing according to the position of the icon can be immediately adjusted.

  Moreover, the menu display process part 523 can display the adjustment operation icon which receives adjustment operation, when operation with respect to an icon is received. This is the same as the operation for displaying the submenu 63 of the process selected in the selection menu 62 described above.

  FIG. 17 is a schematic diagram illustrating a first example of the adjustment operation icon displayed on the display screen 51 by the menu display processing unit 523 according to the present embodiment. In the example of FIG. 17, icons 71a, 71b, and 71c are displayed around the icon 71, and the icons 71a, 71b, and 71c can each adjust the rotation angle around the xyz axis on 3D. Icons 72a and 72b are displayed around the icon 72, and the icons 72a and 72b can respectively adjust the rotation angles around two axes on the plane. Icons 73a and 73b are displayed around the icon 73, and the icons 73a and 73b can adjust the magnification of the enlargement process and the reduction process. In addition, icons 74a, 74b, 74c, and 74d are displayed around the icon 74, and the icons 74a, 74b, 74c, and 74d can adjust the movement distance in the vertical and horizontal directions.

  In the example of FIG. 17, for convenience, adjustment operation icons are displayed around the icons 71, 72, 73, and 74. However, as shown in FIG. 17, adjustments for all the icons 71, 72, 73, and 74 are performed. There is no need to display an operation icon. For example, as illustrated in FIG. 16, when an operation on the icon 74 is received, the adjustment operation icon may be displayed around the icon 74, and the adjustment operation icon may not be displayed around the icons 71 to 73.

  That is, the menu display processing unit 523 displays a plurality of icons for performing predetermined processing on an image, and when an operation for one icon is received among the plurality of icons, an adjustment operation icon is displayed in the vicinity of the one icon. Then, no adjustment operation icon is displayed in the vicinity of other icons except the one icon. For example, when the user selects one of a plurality of icons, an adjustment operation icon is displayed in the vicinity of the selected icon, but an adjustment operation icon is displayed in the vicinity of another icon that is not selected. Is not displayed. Thereby, the adjustment operation icons can be selectively displayed, and it is not necessary to display the adjustment operation icons for each of the plurality of icons, so that the operation display area can be reduced. The vicinity of the icon may be a position overlapping with a part of the icon, a position in contact with the icon, or a position away from the icon by a short distance.

  As described above, since the adjustment operation icon is displayed simply by performing an operation on the icons 71 to 74, the adjustment operation can be immediately performed at the positions of the icons 71 to 74, and the operation becomes simple and the operability is improved. .

  Further, the transparency of the icons 71 to 74 is made relatively large, and the icons 71 to 74 are displayed in a state where the VR image in the background of the icons 71 to 74 can be seen transparently, and an operation on any of the icons 71 to 74 is performed. When this is done, the transparency of the icon on which the operation has been performed can be reduced and the icon can be displayed prominently. Thereby, when the operation with respect to the icons 71 to 74 is not performed, the visibility of the background VR image is improved, and when the operation with respect to the icon is performed, the visibility of the icon is improved. it can.

  The menu display processing unit 523 can display an adjustment operation icon in the vicinity of the icon. In the example of FIG. 17, the adjustment operation icons are displayed around (near) the icons 71 to 74. Thereby, for example, the movement of the position of the mouse cursor becomes unnecessary, or the movement distance can be shortened, and the operability is improved. Note that the adjustment operation icon may be displayed so that the adjustment operation icon overlaps a part of the icons 71 to 74 that perform the predetermined processing. Thereby, the area of the display area for displaying the icon can be further reduced, and the area where the VR image is blocked by the icon can be reduced.

  FIG. 18 is a schematic diagram illustrating a second example of icons displayed on the display screen 51 by the menu display processing unit 523 according to the present embodiment. In the example of FIG. 18, the predetermined process for the VR image is a process related to the adjustment of the color map, the icon 81 is an icon for adjusting the R value, and the icon 82 is for adjusting the G value. The icon 83 is an icon that performs B value adjustment processing, the icon 84 is an icon that performs opacity adjustment processing, and the icon 85 is a signal value adjustment processing for setting control points. It is an icon to do. Numerical values displayed below the icons 81 to 85 represent RGB values, opacity, and signal values.

  The menu display processing unit 523 performs a predetermined process as shown in FIG. 18 by performing the specific operation illustrated in FIG. 4 on the display screen 51 (for example, it may be on the VR image or may be a part away from the VR image). Icons 81-85 can be displayed.

  When the menu display processing unit 523 receives an operation of selecting a desired location (indicated by reference numeral 80 in FIG. 18) in the VR image displayed on the display screen 51, the predetermined processing as shown in FIG. The icons 81 to 85 for performing can be displayed.

  When the menu display processing unit 523 receives an operation of selecting a desired location (indicated by reference numeral 80 in FIG. 18) in the VR image displayed on the display screen 51, the menu display processing unit 523 corresponds to the pixel at the location of the image. The pixel value assigned to the signal value to be acquired can be acquired, and the acquired pixel value can be displayed. The pixels at the location of the image are not limited to only one pixel when a single image is selected, but a plurality of pixels having the same pixel value within a predetermined area around the one pixel are selected together. It may be. The pixel value can be, for example, the RGB value or opacity assigned to the original signal value represented by the target pixel, the original signal value, or the like. In the example of FIG. 18, the RGB value, opacity, and signal value are 128, 65, 32, 0.8, and 1520, respectively, but are not limited thereto. In the normal color map setting, a desired RGB value or opacity is set to a signal value serving as one or a plurality of control points, thereby defining the correspondence between all signal values, RGB values, and opacity. For the signal values other than the control points, RGB values and opacity complemented by a predetermined procedure are set.

  Further, the transparency of the icons 81 to 85 is made relatively large, the icons 81 to 85 are displayed in a state where the VR image in the background of the icons 81 to 85 can be seen through, and an operation on any of the icons 81 to 85 is performed. When this is done, the transparency of the icon on which the operation has been performed can be reduced and the icon can be displayed prominently. Thereby, when the operation with respect to the icons 81-85 is not performed, the visibility of the background VR image is improved, and when the operation with respect to the icon is performed, the visibility of the icon is improved. it can.

  FIG. 19 is a schematic diagram illustrating an example of an operation on an icon displayed on the display screen 51 by the menu display processing unit 523 according to the present embodiment. FIG. 19 shows the result of the operation on the icon 81 shown in FIG. As shown in FIG. 19, by performing an upward operation on the icon 81 that performs the predetermined processing, the R value corresponding to the pixel at the selected desired location can be increased, and the operation can be performed downward. By doing so, the R value can be reduced. When the operation for the icon is a color map operation, the same operation is performed to change not only the pixel value of the pixel at the selected desired location, but also to the signal value corresponding to the desired pixel. The entire VR image may be redrawn by changing the definition of the color map so as to change the pixel value to be assigned (for example, the R value). In the example of FIG. 19, the R value is adjusted to increase from 128 to 138. Similarly, for the other icons 82 to 85, the numerical value can be increased by the upward operation, and the numerical value can be decreased by the downward operation.

  The operation is not limited to the vertical direction, and the numerical value may be increased when the icons 81 to 85 are pressed strongly, and the numerical value may be decreased when the icons 81 to 85 are pressed weakly. Further, the display speed when the numerical value increases or decreases (for example, the time for displaying one numerical value) may be set as appropriate.

  When the menu display processing unit 523 displays the icons 81 to 85 for performing the predetermined processing and receives an operation on the icons 81 to 85, the predetermined processing unit 522 is set to a pixel value corresponding to a desired portion of the VR image. The pixel value adjustment operation can be accepted so that the current value is changed. More specifically, the predetermined processing unit 522 performs predetermined processing at a position where an operation in the icons 81 to 85 is received so that a value set to a pixel value corresponding to a desired portion of the VR image is changed. Adjustment operations with different processing amounts can be accepted. The predetermined process can be, for example, a process related to the adjustment of the color map (for example, adjustment of RGB values, adjustment of opacity, adjustment of signal values for setting control points, etc.).

  With the above-described configuration, it is possible to intuitively select a location where the pixel value is to be adjusted on medical information (for example, a VR image). Further, since the pixel value can be adjusted at the position of the displayed icon simply by selecting a desired location on the medical information, the operation time can be shortened and the operability can be improved.

  In addition, as described above, the pixel value of the selected location can be displayed simply by selecting a desired location on the medical information, so how to adjust the displayed pixel value. This makes it possible to make an intuitive determination while looking at the screen, improving operability.

  In addition, as illustrated in FIG. 19, when a pixel value adjustment operation is accepted, the pixel value corresponding to the adjustment operation is displayed, so that the pixel value adjustment result can be intuitively determined while viewing medical information. Operability is improved.

  FIG. 20 is a schematic diagram illustrating a third example of icons displayed on the display screen 51 by the menu display processing unit 523 according to the present embodiment. In the example of FIG. 20, the icons 81 to 83 are displayed like a pie chart. For example, the R value can be increased by operating the circle 81 at the position of the icon 81, and the R value can be decreased by operating the circle toward the center. The same applies to the other icons 82 to 83.

  21A to 21G are schematic diagrams illustrating other examples of icons displayed on the display screen 51 by the menu display processing unit 523 according to the present embodiment. The example of FIG. 21A represents the adjustment value of the pixel value according to the size of the area occupied in the icon. For example, when the B value is 0 to 255, the example in FIG. 21A indicates that the B value is adjusted to 192. The shape of the icon can be rectangular or circular as shown in FIG. 21A, but is not limited to this, and may be a polygon such as a triangle, pentagon, or hexagon. Further, the region indicating the adjustment value can be a rectangle, a pie chart, a concentric circle, or the like. As a result, it is possible to intuitively determine how much (%) the adjustment value is the maximum value. Alternatively, the pixel value may be adjusted by dragging a boundary line between an area indicating the adjustment value in the icon and an area other than the area. The same applies to other pixel values (R value, G value, opacity, signal value).

  In the example of FIG. 21B, the adjustment value of the pixel value is represented by the size of the icon shape (icon area). As shown in FIG. 21B, the adjustment values of other pixel values can be displayed in comparison with each other by displaying rectangular icons of RGB. In the example of FIG. 21C, each of the RGB icons is displayed in three regions obtained by dividing the circle into three equal parts. The adjustment value of the pixel value can be expressed by the size (diameter length) of the icon shape, and the adjustment value of other pixel values can be compared and expressed.

  In the example of FIG. 21D, RGB icons are displayed in, for example, a rectangle or a circle, and icons are displayed in colors obtained from RGB values. For example, when the R value is 255, the G value is 255, and the B value is 128, the icon is displayed in yellow. Thereby, since the color of the icon changes by adjusting the RGB value, the RGB value can be adjusted intuitively.

  In the example of FIG. 21E, the shape of the icon is an arrow. For example, the tip of the arrow is directed upward and downward. The pixel value (B value in the example of FIG. 21E) can be increased by operating somewhere in the upper half area of the icon, and the pixel value can be decreased by operating somewhere in the lower half area of the icon. be able to. Since the adjustment method of increase / decrease of the pixel value can be easily determined from the shape of the icon, the pixel value can be adjusted intuitively.

  The example of FIG. 21F represents the adjustment value of the pixel value according to the size of the area occupied in the icon. As a result, it is possible to intuitively determine how much (%) the adjustment value is the maximum value. Alternatively, the pixel value may be adjusted by dragging a boundary line between an area indicating the adjustment value in the icon and an area other than the area. The same applies to other pixel values (R value, G value, opacity, signal value).

  The example of FIG. 21G has an aspect in which icons of RGB values are collected into one shape (in the example of the figure, a triangle). It can be easily determined that the direction in which each vertex of the triangle faces is the direction in which the pixel value is increased. The pixel value can be increased by operating in the direction of the vertex (outward direction) at the icon position of each RGB value, and the pixel value can be decreased by operating in the opposite direction (inward direction). Since the adjustment method of increase / decrease of the pixel value can be easily determined from the shape of the icon, the pixel value can be adjusted intuitively.

  As described above, the menu display processing unit 523 can change the icon display mode according to the adjustment operation when the pixel value adjustment operation is received. The icon display mode includes, for example, the shape, size, and color of the icon as illustrated in FIGS. 21A to 21G. Thereby, the adjustment result can be visually determined, and the pixel value can be easily adjusted. Further, the pixel value can be adjusted in one icon, and the pixel value can be intuitively increased or decreased, thereby improving the operability.

  The display mode of the icon is not limited to the example of FIG. For example, a pixel value may be displayed on the surface of a rotating unit such as a dial or a drum, and the required pixel value may be selected by increasing or decreasing the pixel value by rotating the rotating unit.

  FIG. 22 is a block diagram showing another example of the configuration of the display processing unit 52 of the present embodiment. As shown in FIG. 22, the display processing unit 52 can be composed of a CPU 526, a ROM 527, a RAM 528, a recording medium reading unit 529, and the like. The computer program recorded on the recording medium 1 can be read by the recording medium reading unit 529 and stored in the RAM 528. By causing the CPU 526 to execute the computer program stored in the RAM 528, processing performed by the allocation processing unit 521, the predetermined processing unit 522, and the menu display processing unit 523 can be executed. Note that the CPU 526 is a generic term for a processor, a processor device, a processing unit, and the like, and can be configured by one or more. The computer program can also be downloaded via a network such as the Internet, instead of being read by the recording medium reading unit 529.

  Next, the operation of the display device 50 according to the present embodiment will be described.

  FIG. 23 is a flowchart showing a first example of display processing by the display device 50 of the present embodiment. In the following, the processing subject will be described as the display processing unit 52 for convenience. The display processing unit 52 acquires patient specific information (S11). The acquisition of the specific information can be performed, for example, by the medical worker inputting the specific information of the patient from the operation input unit 53 or selecting the required patient from the list of patients displayed on the display screen 51.

  The display processing unit 52 acquires medical information of the identified patient from the server 20 (S12). The acquired medical information can be stored in the storage unit 55. The display processing unit 52 displays the patient's medical information (S13). The display of medical information is, for example, illustrated in FIG. 3, but is not limited thereto.

  The display processing unit 52 determines whether or not a specific operation has been performed (S14). The specific operation may include, for example, a mouse cursor gesture operation, a mouse click operation, a key press operation, or a combination thereof. When there is no specific operation (NO in S14), the display processing unit 52 continues the process of step S14.

  When there is a specific operation (YES in S14), the display processing unit 52 depends on the type of medical information (for example, CR image, CT image, MRI image, US image, document, and examination data). It is determined whether or not the operation is to be performed (S15).

  If the operation depends on the type (YES in S15), the display processing unit 52 determines whether the operation is for displaying a selection menu for selecting an operation for the medical information (S16). When the operation is for displaying the selection menu (YES in S16), the display processing unit 52 displays the selection menu (S17), executes a predetermined process selected in the selection menu (S18), and will be described later. The process of step S21 is performed.

  If the operation is not an operation for displaying the selection menu (NO in S16), the display processing unit 52 executes the specific operation performed in step S14 and the predetermined process assigned to the medical information (S19). The process of step S21 is performed. If the operation does not depend on the type of medical information (NO in S15), the display processing unit 52 displays a selection menu for selecting a common operation regardless of the type of medical information (S20), and performs the process of step S18. .

  The display processing unit 52 determines whether or not to end the process (S21). If the process is not ended (NO in S21), the process after step S14 is continued and the process is ended (YES in S21). The process ends.

  As described above, according to the present embodiment, the operation to the required medical information to be focused on is the gesture operation or the mouse click operation in the medical information or the display area of the medical information, and the vicinity of the medical information. By the selection operation on the menu displayed on the screen, it is possible to reduce the movement distance of the mouse cursor (pointer), reduce the work load, and improve the work efficiency. In addition, since information other than medical information is not displayed on the display screen (work screen) except when necessary, the screen space can be used effectively, and more medical information can be displayed. .

  24 and 25 are flowcharts showing a second example of display processing by the display device 50 of the present embodiment. The display processing unit 52 acquires patient specific information (S31). The acquisition of the specific information can be performed, for example, by the medical worker inputting the specific information of the patient from the operation input unit 53 or selecting the required patient from the list of patients displayed on the display screen 51.

  The display processing unit 52 acquires medical information of the identified patient from the server 20 (S32). The acquired medical information can be stored in the storage unit 55. The display processing unit 52 displays the patient's medical information (S33). For example, the display of medical information is illustrated in FIG. 15, but is not limited thereto.

  The display processing unit 52 determines whether or not a specific operation has been performed (S34). The specific operation may be the first specific operation or the second specific operation. If there is no specific operation (NO in S34), the display processing unit 52 continues the process of step S34.

  When there is a specific operation (YES in S34), the display processing unit 52 applies a desired color map (S35) and displays a VR image according to the operation of the medical staff (S36). Here, it is assumed that a specific operation is performed on the VR image in the medical information illustrated in FIG.

  The display processing unit 52 displays an icon for VR image conversion processing (performs predetermined processing) (S37), and determines whether or not a processing amount adjustment operation has been received at the position of the conversion processing icon (S38). ). When a processing amount adjustment operation is received (YES in S38), the display processing unit 52 displays an icon (S39) and determines whether or not there is an adjustment operation (S40).

  When there is an adjustment operation (YES in S40), the display processing unit 52 converts and displays the VR image according to the adjusted processing amount (S41), and determines whether or not to end the processing (S42). ). When the processing amount adjustment operation is not received (NO in S38), or when there is no adjustment operation (NO in S40), the display processing unit 52 performs the process of step S42.

  If the process is not terminated (NO in S42), the display processing unit 52 determines whether or not there is an operation for selecting a location in the VR image (S43). If there is an operation for selecting (YES in S43), an icon is displayed. Display (S44), and obtain the pixel value of the selected location (S45). Here, the pixel value acquired together with the icon may be displayed.

  The display processing unit 52 determines whether or not a pixel value adjustment operation has been performed (S46), and when an adjustment operation has been performed (YES in S46), displays a VR image with the adjusted pixel value (S47).

  The display processing unit 52 changes the display mode of the adjustment operation icon according to the adjusted pixel value (S48), and performs the process of step S42. When there is no adjustment operation (NO in S46), the display processing unit 52 performs the process of step S42.

  If there is no operation for selecting a location in the VR image (NO in S43), the display processing unit 52 continues the processing from step 37 onward. The display process part 52 complete | finishes a process, when complete | finishing a process (it is YES at S42).

  In the above-described embodiment, the display device 50 includes the display processing unit 52. However, the present invention is not limited to this. For example, the server 20 can have the same configuration as the display processing unit 52. In this case, the display device 50 outputs the operation performed by the operation input unit 53 to the server 20, the server 20 performs a required display process according to the operation, and transmits the processing result to the display device 50. You can do it.

  The computer program according to the present embodiment is a computer program for causing a computer to display medical information on a display screen. The computer performs a first predetermined process different for each of a plurality of first specific operations. When a specific operation of the plurality of first specific operations is performed on the medical information displayed on the display screen and the assigning process, the second information that differs depending on the type of the medical information And a process for displaying a selection menu for selecting a predetermined process.

  The display device according to the present embodiment is a display device that displays medical information on a display screen, and an allocation processing unit that assigns a different first predetermined process to each of a plurality of first specific operations, and the display Selection for selecting a different second predetermined process corresponding to the type of medical information when one specific operation of the plurality of first specific operations is performed on the medical information displayed on the screen A menu display processing unit for displaying a menu.

  The display method according to the present embodiment is a display method for displaying medical information on a display screen, wherein an assignment processing unit assigns a different first predetermined process to each of a plurality of first specific operations, and the display Selection for selecting a different second predetermined process corresponding to the type of medical information when one specific operation of the plurality of first specific operations is performed on the medical information displayed on the screen The display processing unit displays the menu.

  The computer program, the display device, and the display method according to the present embodiment assign different first predetermined processes to each of the plurality of first specific operations, and apply the medical information displayed on the display screen to When one specific operation of the plurality of first specific operations is performed, a selection menu for selecting a different second predetermined process corresponding to the type of the medical information is displayed. The first predetermined process is a process not related to the type of medical information, and the second predetermined process is a process corresponding to the type of medical information.

  The first specific operation includes, for example, a mouse gesture (specific movement operation of the cursor) or a mouse button click operation. The medical information includes, for example, images (series images such as CT, CR, US, and MRI or moving images), documents, inspection results (inspection data), and the like.

  A selection menu for selecting a different second predetermined process corresponding to the type of medical information is displayed only by performing one specific operation of the plurality of first specific operations. It becomes easy.

  The computer program according to the present embodiment includes a process for allocating a second predetermined process different for each of a plurality of second specific operations for each of a plurality of different types of medical information to the computer, and a display on the display screen When one specific operation of the plurality of second specific operations is performed on the medical information, the medical information and a second predetermined process assigned to the one specific operation are executed.

  The computer program according to the present embodiment assigns a different second predetermined process to each of a plurality of second specific operations for each of a plurality of different types of medical information, and applies the medical information displayed on the display screen. When one specific operation among the plurality of second specific operations is performed, the second predetermined processing assigned to the medical information and the one specific operation is performed.

  The second specific operation corresponds to the type of medical information and includes, for example, a mouse gesture (specific movement operation of the cursor) or a mouse button click operation. Note that the first specific operation and the second specific operation may be the same operation or different operations.

  Since a different second predetermined process is assigned to each of the plurality of second specific operations, the desired process can be facilitated only by performing a specific operation corresponding to the desired process. For example, when the same specific operation is performed, a different second predetermined process can be assigned for each type of medical information. Therefore, when performing a different process for each medical information, a different operation is performed for each medical information. There is no need to assign, and it is possible to execute a desired process for each piece of medical information in one specific operation. Thereby, it can prevent that the number of different specific operation increases.

  In the computer program according to the present embodiment, when the second predetermined process performs one specific operation of the plurality of second specific operations on the medical information displayed on the display screen, A process of displaying a selection menu for selecting a different second predetermined process corresponding to the type of the medical information.

  The second predetermined process differs depending on the type of the medical information when one specific operation of the plurality of second specific operations is performed on the medical information displayed on the display screen. Including a process for displaying a selection menu for selecting the predetermined process. Since the selection menu is displayed, it becomes easy to select a desired process.

  When the computer program according to the present embodiment performs one specific operation of the plurality of first specific operations or the plurality of second specific operations on the computer, the display area in which the medical information is displayed A process of displaying the selection menu in or near is executed.

  When the computer program according to the present embodiment performs one specific operation of a plurality of first specific operations or a plurality of second specific operations on the medical information displayed on the display screen, the medical program A selection menu is displayed in or near the display area where the information is displayed. Thereby, when a desired process is selected, the moving distance of the mouse cursor (pointer) can be reduced, the work load can be reduced, and the work efficiency can be improved.

  In the computer program according to the present embodiment, when one specific operation of the plurality of first specific operations or the plurality of second specific operations is performed on the computer, the one specific operation is performed. A process of displaying the selection menu in an area around the position on the display screen is executed.

  When the computer program according to the present embodiment performs one specific operation among a plurality of first specific operations or a plurality of second specific operations on the medical information displayed on the display screen, the computer program The selection menu is displayed in the area around the position on the display screen where the specific operation is performed. Thereby, when a desired process is selected, the moving distance of the mouse cursor (pointer) can be reduced, the work load can be reduced, and the work efficiency can be improved.

  When the computer program according to the present embodiment selects an operation item in the selection menu, the computer program causes the computer to execute a process of displaying a sub-selection menu for selecting a predetermined process related to the operation item.

  When an operation item in the selection menu is selected, the computer program according to the present embodiment displays a sub-selection menu for selecting a predetermined process related to the selected operation item. As a result, even when a plurality of predetermined processes are hierarchized into a wide variety, a desired process can be easily selected.

  In the computer program according to the present embodiment, the selection menu or the sub-selection menu has transparency.

  The selection menu or the sub-selection menu has transparency. Thereby, even if the selection menu or the sub-selection menu is displayed so as to overlap with a part of medical information such as an image, the part of the medical information can be visually recognized.

  The computer program according to the present embodiment causes a computer to execute a process of assigning each of the specific operations in correspondence with different movement trajectories of pointers displayed on the display screen.

  The computer program according to the present embodiment assigns a plurality of first specific operations or second specific operations in correspondence with different movement paths of pointers displayed on the display screen. The pointer includes, for example, a mouse cursor. Thereby, a desired predetermined process can be executed only by performing an operation (a gesture operation) for moving the pointer.

  The display system according to the present embodiment includes the display device according to the present embodiment, and a server that is connected to the display device and includes a storage unit that stores medical information.

  Thereby, patient medical information can be managed in an integrated manner.

  The computer program according to the present embodiment is a computer program for causing a computer to display medical information on a display screen. The computer program displays an icon for performing predetermined processing on the medical information on the computer, and an operation for the icon. Is received, the process of accepting an adjustment operation with a different processing amount of the predetermined process is executed depending on the position where the operation in the icon is accepted.

  The display device according to the present embodiment is a display device that displays medical information on a display screen. When a display processing unit that displays an icon that performs predetermined processing on medical information and an operation on the icon are received, An adjustment operation receiving unit that receives an adjustment operation of a different processing amount of the predetermined process depending on a position where the operation in the icon is received.

  The display method according to the present embodiment is a display method for displaying medical information on a display screen. When an icon for performing predetermined processing on medical information is displayed and an operation for the icon is accepted, an operation in the icon is performed. An adjustment operation with a different processing amount of the predetermined processing is received depending on the position where the processing is received.

  The computer program, the display device, and the display method according to the present embodiment display icons for performing predetermined processing on medical information. The predetermined processing can be, for example, processing related to conversion to a VR (volume rendering) image, and includes rotation processing (free rotation on 3D or rotation on a plane), enlargement / reduction processing, translation processing, ROI (Region of Includes clipping processing by Interest). The predetermined process can be a process related to a VR image. For example, a process related to color map adjustment (for example, RGB value adjustment, opacity adjustment, signal value for setting a control point) Or adjustment of specular reflectance or ambient light.

  In the present embodiment, when an operation for an icon for performing a predetermined process is received, an adjustment operation with a different processing amount for the predetermined process is received depending on the position where the operation in the icon is received. When the predetermined process is a process related to conversion, the processing amount can be, for example, a rotation angle, an enlargement / reduction ratio, a parallel movement amount (offset), an ROI coordinate, or the like.

  In the present embodiment, with the above-described configuration, a predetermined process is assigned according to the position of the displayed icon, and the processing amount of the predetermined process can be adjusted by an operation at the icon position. The desired operation can be realized in the vicinity of, so that the operation can be simplified and the operation display area can be reduced.

  When the computer program according to the present embodiment receives an operation on the icon, the computer program causes the computer to execute a process of displaying the adjustment operation icon that receives the adjustment operation.

  In this embodiment, when an operation for an icon is received, an adjustment operation icon for receiving an adjustment operation is displayed. Since the adjustment operation icon is displayed simply by performing an operation on the icon, the adjustment operation can be immediately performed at the position of the icon, and the operation is simplified and the operability is improved.

  The computer program according to the present embodiment causes a computer to execute processing for displaying the adjustment operation icon in the vicinity of the icon.

  In the present embodiment, since the adjustment operation icon is displayed near the icon, for example, it is not necessary to move the position of the mouse cursor, or the movement distance can be shortened and the operability is improved. The vicinity of the icon may be a position partially overlapping with the icon, a position in contact with the icon, or a position near the icon.

  When the computer program according to the present embodiment receives a process for displaying a plurality of icons for performing predetermined processing on medical information on the computer and an operation for one of the plurality of icons, the one icon The adjustment operation icon is displayed in the vicinity of the icon, and the adjustment operation icon is not displayed in the vicinity of the other icons except the one icon.

  In the present embodiment, a plurality of icons for performing predetermined processing on medical information is displayed, and when an operation for one icon is received among the plurality of icons, an adjustment operation icon is displayed in the vicinity of the one icon, The adjustment operation icon is not displayed near other icons except the one icon. For example, when the user selects one of a plurality of icons, an adjustment operation icon is displayed in the vicinity of the selected icon, but an adjustment operation icon is displayed in the vicinity of another icon that is not selected. Is not displayed. Thereby, the adjustment operation icons can be selectively displayed, and it is not necessary to display the adjustment operation icons for each of the plurality of icons, so that the operation display area can be reduced.

  The computer program according to the present embodiment is a computer program for causing a computer to display medical information on a display screen. The computer program displays on the display screen an icon for performing a predetermined process on the medical information. Processing for accepting an operation for selecting a desired location in the displayed medical information, processing for obtaining a pixel value at the location of the medical information when the operation for selection is accepted, and operation for the icon If so, a process for receiving the predetermined process is executed so that a value set for the pixel value is changed.

  The display device according to the present embodiment is a display device that displays medical information on a display screen, a display processing unit that displays an icon for performing a predetermined process on the medical information, and a medical information displayed on the display screen. A selection operation accepting unit that accepts an operation for selecting a desired location, an acquisition unit that obtains a pixel value at the location of the medical information when an operation to select is accepted, and an operation for the icon And an adjustment operation receiving unit that receives the predetermined process so that a value set for the pixel value is changed.

  The display method according to the present embodiment is a display method for displaying medical information on a display screen, displays an icon for performing a predetermined process on the medical information, and a desired location in the medical information displayed on the display screen When the selection operation is received, the pixel value at the location of the medical information is acquired, and when the operation for the icon is received, the value set for the pixel value is changed. As described above, the predetermined process is accepted.

  In the present embodiment, when an operation for selecting a desired location in the medical information displayed on the display screen is received, the pixel value assigned to the signal value corresponding to the pixel corresponding to the location of the medical information is acquired. . The medical information can be, for example, a VR (volume rendering) image, and the pixel value can be an RGB value assigned to the original signal value represented by the target pixel, It can be opacity, original signal value, etc. Normally, RGB values and opacity are defined as correspondences between all signal values, RGB values, and opacity by setting desired RGB values and opacity to signal values serving as one or a plurality of control points. For the signal values other than the control points, RGB values and opacity complemented by a predetermined procedure are set.

  In the present embodiment, an icon for performing a predetermined process on a location of medical information is displayed, and when an operation on the icon is received, the predetermined process is received so that the value set for the pixel value is changed. For example, when an icon for performing a predetermined process on a location of medical information is displayed and an operation for the icon is received, the predetermined process is performed at the position where the operation in the icon is received so that the value set in the pixel value is changed. An adjustment operation with a different processing amount is accepted. The predetermined processing can be, for example, processing related to color map adjustment (for example, adjustment of RGB value, opacity, signal value, etc.).

  In the present embodiment, with the above-described configuration, it is possible to intuitively select a location where the pixel value is to be adjusted on medical information. In addition, by simply selecting a desired location on the medical information, for example, the pixel value can be adjusted at the position of the displayed icon, so that the operation time can be shortened and the operability can be improved.

  The computer program according to the present embodiment causes the computer to execute processing for displaying the acquired pixel value.

  In the present embodiment, the acquired pixel value is displayed. By simply selecting the desired location on the image, the pixel value at the selected location can be displayed, so you can intuitively determine how to adjust the displayed pixel value while viewing the image. Operability is improved.

  The computer program according to the present embodiment causes a computer to execute a process of displaying a pixel value corresponding to the adjustment operation when the adjustment operation of the pixel value is received.

  In the present embodiment, when a pixel value adjustment operation is received, the pixel value corresponding to the adjustment operation is displayed. Therefore, the adjustment result of the pixel value can be intuitively determined while viewing the image, and the operability is improved. Will improve.

  When the computer program according to the present embodiment accepts the pixel value adjustment operation, the computer program causes the computer to execute a process of changing the display mode of the icon according to the adjustment operation.

  In the present embodiment, when a pixel value adjustment operation is received, the icon display mode is changed according to the adjustment operation. The icon display mode includes, for example, the shape, size, and color of the icon. Thereby, the adjustment result can be visually determined, and the pixel value can be easily adjusted.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 20 Server 21 Control part 22 Storage part 23 Communication part 50 Display apparatus 51 Display screen 52 Display processing part 53 Operation input part 54 Communication part 55 Storage part 521 Allocation process part 522 Predetermined process part 523 Menu display process part 526 CPU
527 ROM
528 RAM
529 Recording medium reading unit

Claims (23)

A computer program for causing a computer to display medical information on a display screen,
On the computer,
A process of assigning a different first predetermined process to each of the plurality of first specific operations;
When one specific operation of the plurality of first specific operations is performed on the medical information displayed on the display screen, a different second predetermined process corresponding to the type of the medical information is selected. A computer program that executes a process for displaying a selection menu. On the computer,
A process of assigning a different second predetermined process to each of a plurality of second specific operations for each of a plurality of pieces of medical information of different types;
When one specific operation of the plurality of second specific operations is performed on the medical information displayed on the display screen, a second predetermined process assigned to the medical information and the one specific operation The computer program according to claim 1, wherein: The second predetermined process is:
When one of the plurality of second specific operations is performed on the medical information displayed on the display screen, a different second predetermined process corresponding to the type of the medical information is selected. The computer program according to claim 2, comprising a process for displaying a selection menu. On the computer,
When one specific operation of the plurality of first specific operations or the plurality of second specific operations is performed, a process of displaying the selection menu in or near the display area where the medical information is displayed is executed The computer program according to claim 1 or 3 to be executed. On the computer,
When one specific operation of the plurality of first specific operations or the plurality of second specific operations is performed, the selection is performed in an area around the position on the display screen where the one specific operation is performed. The computer program according to any one of claims 1, 3, and 4, wherein a process for displaying a menu is executed. On the computer,
6. The process according to claim 1, wherein when an operation item in the selection menu is selected, a process of displaying a sub-selection menu for selecting a predetermined process related to the operation item is executed. The computer program described. The selection menu or the sub-selection menu is:
The computer program according to claim 1, which has transparency. On the computer,
The computer program according to any one of claims 1 to 7, wherein a process of assigning each of the specific operations corresponding to different movement trajectories of pointers displayed on the display screen is executed. A computer program for causing a computer to display medical information on a display screen,
On the computer,
Processing to display an icon for performing predetermined processing on medical information;
A computer program that, when receiving an operation on the icon, executes a process of accepting an adjustment operation with a different processing amount of the predetermined process depending on a position where the operation in the icon is received. On the computer,
The computer program according to claim 9, wherein when an operation on the icon is received, a process of displaying an adjustment operation icon that receives the adjustment operation is executed. On the computer,
The computer program according to claim 10, wherein a process for displaying the adjustment operation icon in the vicinity of the icon is executed. On the computer,
Processing for displaying a plurality of icons for performing predetermined processing on medical information;
When an operation on one of the plurality of icons is accepted, the adjustment operation icon is displayed in the vicinity of the one icon, and the adjustment operation icon is displayed in the vicinity of other icons other than the one icon. The computer program according to claim 10 or 11, which causes a process not to be executed to be executed. A computer program for causing a computer to display medical information on a display screen,
On the computer,
Processing to display an icon for performing predetermined processing on medical information;
A process of accepting an operation of selecting a desired location in the medical information displayed on the display screen;
When receiving the operation to select, a process of obtaining a pixel value at the location of the medical information;
A computer program that executes a process of receiving the predetermined process so that a value set to the pixel value is changed when an operation on the icon is received. On the computer,
The computer program according to claim 13, wherein processing for displaying the acquired pixel value is executed. On the computer,
The computer program according to claim 13 or 14, wherein when a pixel value adjustment operation is received, a process of displaying a pixel value according to the adjustment operation is executed. On the computer,
The computer program according to any one of claims 13 to 15, which executes a process of changing a display mode of the icon according to the adjustment operation when the adjustment operation of the pixel value is received. A display device for displaying medical information on a display screen,
An allocation processing unit that allocates a different first predetermined process to each of the plurality of first specific operations;
When one specific operation of the plurality of first specific operations is performed on the medical information displayed on the display screen, a different second predetermined process corresponding to the type of the medical information is selected. And a menu display processing unit for displaying a selection menu to be displayed. A display device for displaying medical information on a display screen,
A display processing unit for displaying an icon for performing predetermined processing on medical information;
A display device comprising: an adjustment operation receiving unit that receives an adjustment operation of a different processing amount of the predetermined process depending on a position at which an operation in the icon is received when an operation on the icon is received. A display device for displaying medical information on a display screen,
A display processing unit for displaying an icon for performing predetermined processing on medical information;
A selection operation receiving unit that receives an operation of selecting a desired location in the medical information displayed on the display screen;
When the operation to select is received, an acquisition unit that acquires a pixel value at the location of the medical information;
A display device comprising: an adjustment operation receiving unit that receives the predetermined process so that a value set to the pixel value is changed when an operation on the icon is received.   A display system comprising: the display device according to any one of claims 17 to 19; and a server connected to the display device and having a storage unit that stores medical information. A display method for displaying medical information on a display screen,
The assignment processing unit assigns a different first predetermined process to each of the plurality of first specific operations,
When one specific operation of the plurality of first specific operations is performed on the medical information displayed on the display screen, a different second predetermined process corresponding to the type of the medical information is selected. A display method in which the display processing unit displays a selection menu to be displayed. A display method for displaying medical information on a display screen,
Displays an icon that performs predetermined processing on medical information,
A display method for accepting an adjustment operation with a different processing amount of the predetermined process depending on a position where an operation in the icon is accepted when an operation on the icon is accepted. A display method for displaying medical information on a display screen,
Displays an icon that performs predetermined processing on medical information,
Accepting an operation to select a desired location in the medical information displayed on the display screen,
If the operation to select is received, obtain the pixel value at the location of the medical information,
A display method for receiving the predetermined process so that a value set for the pixel value is changed when an operation on the icon is received.