JP7172093B2 - Computer program, display device, display system and display method - Google Patents

Description

The present disclosure relates to computer programs, display devices, display systems, and display methods.

In recent years, in medical institutions such as hospitals and clinics, the computerization and systemization of medical information is progressing, and documents such as image data, examination data, and reports showing examination results in each department such as the radiology department of medical institutions. A medical information integrated management system in which a huge amount of medical information such as data and electronic medical charts is put into a database has been put into practical use.

Such a medical information integrated management system consists of a server that centrally manages a huge amount of medical information, an information processing device that transmits medical data obtained in each department to the server, and medical staff such as doctors, technicians, and nurses. A display device or the like is provided for viewing medical information or performing required operations.

2. Description of the Related Art When interpreting a medical image or the like, a past image and a current image are compared. Therefore, in order to reduce the burden on the operator during interpretation, predetermined processing is associated with each partial region of the displayed image, and when a desired position is designated on the screen, the designated processing is performed. A system for executing processing corresponding to a position is disclosed (see Patent Document 1).

Japanese Patent No. 5416890

However, in a system such as Patent Document 1, only a single process is assigned to an area, and when a plurality of processes are assigned, it is necessary to divide the area into smaller areas. Therefore, when specifying a desired position on the screen, an unintended area may be specified, and unintended processing may be performed, which may increase the number of erroneous operations.

The present disclosure has been made in view of such circumstances, and clarifies a computer program, a display device, a display system, and a display method that can facilitate desired processing.

The present application includes a plurality of means for solving the above problems, and to give an example, the computer program is a computer program for causing the computer to display medical information on a display screen, and the computer is provided with a plurality of a process of assigning a different first predetermined process to each of the first specific operations; and performing one of the plurality of first specific operations on the medical information displayed on the display screen. If so, a process of displaying a selection menu for selecting a different second predetermined process corresponding to the type of the medical information is executed.

According to the present disclosure, desired processing can be facilitated. Further features related to the present disclosure will become apparent from the description of the specification and the accompanying drawings. Problems, configurations, and descriptions other than those described above will be clarified by the following description of the embodiments.

1 is a block diagram showing an example of the configuration of a display system according to an embodiment; FIG. It is a block diagram which shows an example of a structure of the display process part of this Embodiment. FIG. 4 is a schematic diagram showing a first display example displayed on the display screen by the display processing unit of the embodiment; FIG. 11 is an explanatory diagram showing an example of a specific operation processed by the display processing unit according to the embodiment; FIG. 10 is an explanatory diagram showing a first example of predetermined processing assigned to a specific operation by the display processing unit according to the embodiment; FIG. 5 is a schematic diagram showing an example of gestures on a multi-window display displayed on the display screen by the display processing unit of the present embodiment; FIG. 11 is an explanatory diagram showing a second example of predetermined processing assigned to a specific operation by the display processing unit according to the embodiment; FIG. 11 is an explanatory diagram showing a third example of predetermined processing assigned to a specific operation by the display processing unit of the embodiment; FIG. 4 is a schematic diagram showing a first example of a selection menu displayed on the display screen by the display processing unit according to the embodiment; FIG. 10 is a schematic diagram showing a first example of the operation when the selection menu is selected by the display processing unit of the embodiment; FIG. 10 is a schematic diagram showing a second example of the operation when the selection menu is selected by the display processing unit of the embodiment; FIG. 9 is a schematic diagram showing a second example of a selection menu displayed on the display screen by the display processing unit of the embodiment; FIG. 11 is a schematic diagram showing a third example of a selection menu displayed on the display screen by the display processing unit of the embodiment; FIG. 12 is a schematic diagram showing a fourth example of a selection menu displayed on the display screen by the display processing unit of the embodiment; FIG. 9 is a schematic diagram showing a second display example displayed on the display screen by the display processing unit of the embodiment; FIG. 4 is a schematic diagram showing a first example of icons displayed on the display screen by the menu display processing unit according to the embodiment; FIG. 4 is a schematic diagram showing a first example of adjustment operation icons displayed on the display screen by the menu display processing unit according to the embodiment; FIG. 9 is a schematic diagram showing a second example of icons displayed on the display screen by the menu display processing unit of the embodiment; FIG. 10 is a schematic diagram showing an example of an operation on icons displayed on the display screen by the menu display processing unit according to the embodiment; FIG. 12 is a schematic diagram showing a third example of icons displayed on the display screen by the menu display processing unit according to the embodiment; FIG. 7 is a schematic diagram showing another example of icons displayed on the display screen by the menu display processing unit according to the embodiment; FIG. 11 is a block diagram showing another example of the configuration of the display processing section of the embodiment; 4 is a flow chart showing a first example of display processing by the display device of the present embodiment; 9 is a flow chart showing a second example of display processing by the display device of the present embodiment; 9 is a flow chart showing a second example of display processing by the display device of the present embodiment;

A display device, a computer program for realizing the display device, a display system, and a display method according to embodiments of the present disclosure will be described below. FIG. 1 is a block diagram showing an example of the configuration of a display system 100 according to this embodiment. The display system 100 of the present embodiment is, for example, a medical information integrated management system, and can refer to medical information related to medical examinations, diagnoses, examinations, etc. performed in medical institutions such as hospitals and clinics for each patient. integrated management.

The display system 100 includes a server 20 that integrally manages medical information, a plurality of information processing devices 10 and a display device 50 that are connected to the server 20 via a predetermined communication network. Although only one display device 50 is shown in FIG. 1 for convenience, a plurality of display devices 50 may be connected to the server 20 .

The information processing apparatus 10 is installed in a plurality of treatment departments, diagnosis departments, examination departments, or the like in a medical institution, and can perform predetermined electronic data input processing, recording processing, editing processing, output processing, and the like. The information processing apparatus 10 can be configured by a computer system including peripheral devices, for example, a radiation system, an electronic chart system, an endoscope system, a physiological examination system, an electrocardiogram system, a specimen laboratory system, a drug administration prescription system, and the like. Can be configured. The information processing device 10 can transmit medical information such as image data, document data, and examination data to the server 20 .

The server 20 includes a control unit 21 that controls the entire server 20, a storage unit 22, a communication unit 23, and the like.

The communication unit 23 has a communication function between the information processing device 10 and the display device 50, and can transmit and receive required information.

The storage unit 22 stores medical information transmitted by each information processing device 10 . The storage unit 22 can store medical information in association with each patient for each specific information that specifies the patient.

The control unit 21 can be configured by a CPU, memory (ROM, RAM, etc.), programs stored in the memory, etc., and extracts medical information stored in the storage unit 22 based on specific information that identifies a patient. , the extracted medical information is arranged in a matrix with two specific elements that can specify the medical information to generate display data in a list display format.

The display device 50 includes a display screen 51 such as a liquid crystal panel, a display processing section 52, an operation input section 53, a communication section 54, a storage section 55, and the like. The display device 50 is used by medical personnel such as doctors, technicians, and nurses of medical institutions to operate and view medical information, and is used for medical treatment and diagnosis. The display device 50 can be configured by a computer device including peripheral devices, but may be a tablet device that allows touch operations on the screen.

Note that the display device 50 may incorporate the functions of the server 20 . For example, the display device 50 can store and display necessary information directly through the network with the information processing device 10 without going through the server 20 .

Moreover, the display device 50 may incorporate the functions of the information processing device 10 . For example, the functions of the information processing apparatus 10 can be incorporated into the display device 50 by expanding the function of the electronic medical record system.

Moreover, the display screen 51 provided in the display device 50 is not limited to one, and may be provided with a plurality of display screens (a plurality of display devices).

The operation input unit 53 includes a keyboard, a mouse, a trackpad (touchpad), a stylus pen, and the like. (For example, in the case of a mouse, left click, right click, double click, etc.), the input operation is converted into a command corresponding to the operation and output to the display processing unit 52 .

The communication unit 54 receives the display data in the list display format transmitted by the server 20 . The display data received by the communication unit 54 is stored in the storage unit 55 .

FIG. 2 is a block diagram showing an example of the configuration of the display processing section 52 of this embodiment. The display processing unit 52 includes an allocation processing unit 521, a predetermined processing unit 522, a menu display processing unit 523, and the like. The display processing unit 52 can be configured by a CPU, memory (ROM, RAM, etc.), programs stored in the memory, and the like.

The display processing unit 52 receives the medical information integrated and managed by the server 20 via the communication unit 54, and displays the medical information required for examination, diagnosis, examination, etc. according to the usage of each medical worker. , to display past medical information to the latest medical information in chronological order for each patient.

Medical information can be conveniently separated by type, for example, images, documents, tests, medications, and the like. Images include data such as CT (Computed Tomography), CR (Computed Radiology), US (Ultrasonography), and MRI (Magnetic Resonance Imaging). The images also include moving images. Documents include, for example, a letter of introduction, a medical certificate, a report, a medical questionnaire, a consent form, a plan, and the like. The examination includes physiological data such as electrocardiogram, electroencephalogram, ultrasound, fundus, arteriosclerosis, blood pressure, body temperature, endoscope, etc. Specimen data such as CEA (tumor marker), blood , pathology, urine, ALT (alanine aminotransferase) and other laboratory data. Medication includes medication information.

One or more images acquired in one examination are managed as one piece of image information. When multiple images are included in one piece of image information, the multiple images are referred to as series images. A series image is composed of, for example, a plurality of images of different imaging regions.

Next, details of the display processing unit 52 will be described.

The allocation processing unit 521 allocates a plurality of specific operations corresponding to different movement trajectories of the pointer displayed on the display screen 51 . A pointer includes, for example, a mouse cursor. Also, the allocation processing unit 521 allocates different first predetermined processes to each of the plurality of specific operations. Also, the allocation processing unit 521 allocates different second predetermined processes to each of the plurality of second specific operations for each of the plurality of pieces of medical information of different types. The first predetermined process is a process that is not related to the type of medical information among the predetermined processes, and the second predetermined process is a process that corresponds to the type of medical information among the predetermined processes. Specific operations include, for example, mouse gestures (specific cursor movement operations), mouse button click operations, and the like. In this specification, for convenience, a plurality of specific operations are distinguished into a first specific operation and a second specific operation. The first specific operation is an operation for displaying a selection menu for selecting a different second predetermined process corresponding to the type of medical information according to a specific operation without depending on the type of medical information. That is, if the type of medical information is different, different selection menus are displayed even if the operation is the same. This eliminates the need to memorize operations for each piece of medical information, improving convenience. On the other hand, the second specific operation corresponds to the type of medical information, and if the same operation is for different types of medical information, a different second predetermined process (including display of a selection menu) can be assigned. Operation. Note that the operation contents of the first specific operation and the second specific operation may be the same or different. Details of the specific operation will be described later.

When one of a plurality of specific operations is performed on the medical information displayed on the display screen 51, the predetermined processing unit 522 performs a predetermined process (first process) assigned to the one specific operation. predetermined processing or second predetermined processing).

Since a different predetermined process is assigned to each of the plurality of specific operations, the desired process can be easily performed simply by performing the specific operation corresponding to the desired process.

A specific description will be given below.

FIG. 3 is a schematic diagram showing a first display example displayed on the display screen 51 by the display processing unit 52 of the present embodiment. The display example shown in FIG. 3 is also called a multi-window display, and simultaneously displays a plurality of pieces of medical information for a certain patient (for example, patient ID: xxxxxx) at a required time point or period. In the example of FIG. 3, CR images, CT images, MRI images, US images, documents, and examination data are displayed in predetermined display areas 61 on the display screen 51, respectively. Note that the types of medical information displayed and the number of medical information displayed are examples, and are not limited to the examples in FIG. 3 .

FIG. 4 is an explanatory diagram showing an example of a specific operation processed by the display processing unit 52 of this embodiment. The specific operation illustrated in FIG. 4 is an example of a gesture operation. A gesture operation can be started by pressing a specific key, clicking a mouse, or locating a mouse cursor (pointer) in a predetermined area of the display screen 51 .

As shown in FIG. 4, operation C1 is a gesture of moving the cursor horizontally (left to right or right to left). Operation C2 is a gesture of moving the cursor vertically (from top to bottom or from bottom to top). The operation C3 is a gesture of moving the cursor diagonally upward (from the lower left to the upper right, or from the lower right to the upper left). The operation C4 is a gesture of moving the cursor obliquely downward (from upper left to lower right, or from upper right to lower left). The operation C5 is a gesture of moving the cursor in a circular shape (drawing a circle). Operation C6 is a gesture of moving the cursor in a V shape. The operation C7 is a gesture of moving the cursor in the lower right direction in an L shape. The operation C8 is a gesture of moving the cursor in the lower left direction in an L shape. Operation C9 is a gesture of moving the cursor leftward in an L shape. The operation C10 is a gesture of moving the cursor rightward in an L shape. As a result, it is possible to shorten the operation time of the operator and improve the convenience. Note that predetermined processing performed by the display processing unit 52 (predetermined processing unit 522) can be assigned to each gesture operation. Also, the set gesture operation can be changed according to the preference of the operator. Also, the gesture operations illustrated in FIG. 4 can be assigned to one or both of the first specific operation and the second specific operation.

When one of the plurality of specific operations (first specific operation) is performed on the medical information displayed on the display screen 51, the menu display processing unit 523 selects the type of the medical information. A selection menu is displayed for selecting a correspondingly different second predetermined process. The selection menu will be described later.

As a result, a selection menu for selecting a different second predetermined process corresponding to the type of medical information is displayed by performing only one specific operation out of a plurality of specific operations (first specific operation). , facilitating the selection of the desired treatment.

Gesture operations are not limited to the operations illustrated in FIG. 4 . Although not illustrated in FIG. 4, a mouse click operation can also be included as an example of a gesture operation. Mouse click operations include, for example, mouse-over (an operation of moving the mouse cursor to a desired location and holding it), left one click, left two clicks (double click), left three clicks (triple click), right one click. , right 2-click, right 3-click, and drag. In addition, the first specific operation and the second specific operation include a combination of simultaneous operation of pressing a key including a specific key (for example, shift key, CTL key, ALT key, Windows key, etc.) and gesture operation, or Simultaneous combinations of pressing and mouse button operations can also be included.

FIG. 5 is an explanatory diagram showing a first example of predetermined processing assigned to a specific operation by the display processing unit 52 of this embodiment. In the example of FIG. 5, series images, documents, and moving images are listed as medical information. Further, among the operations illustrated in FIG. 4, the operations C1, C2, and C3 are listed as the second specific operation. As shown in FIG. 5, when the operation C1 is performed on the series image (that is, when the cursor is moved horizontally on the series image displayed on the display screen 51), animation reproduction of the series image starts. be done. Also, when the same operation C1 is performed on a document, a keyword search process different from that for series images is performed. Also, when the same operation C1 is performed on a moving image, the moving image is reproduced. Operation C2 and operation C3 are also as shown in FIG.

As described above, when one of the plurality of specific operations (second specific operation) is performed on the medical information displayed on the display screen 51, the predetermined processing unit 522 performs the medical information displayed on the display screen 51. A second predetermined process assigned to the information and one specific operation is performed. The second predetermined processing includes processing for displaying a selection menu for selecting different second predetermined processing corresponding to the type of medical information.

In the example of FIG. 5, the predetermined process assigned to the series image and operation C1 is the start of animation playback, and the predetermined process assigned to the document and operation C1 is keyword search, which is assigned to the moving image and operation C1. The specified processing is reproduction of moving images. In the case of a document, it is possible to include keyword display processing, switching processing between display of the entire document and enlarged display of a portion of interest (important portion), and the like. In addition, in the case of moving images, display switching processing such as start, frame, and time can be included.

In this way, when the same specific operation is performed, different predetermined processing can be assigned to each type of medical information. Therefore, when performing different processing for each medical information, it is not necessary to assign different operations to each medical information. desired processing can be executed for each piece of medical information by one specific operation. This can prevent an increase in the number of different specific operations.

FIG. 6 is a schematic diagram showing an example of gestures on the multi-window display displayed on the display screen 51 by the display processing unit 52 of the present embodiment. The example of FIG. 6 shows how the gesture of the operation C7 is performed on the CT image in the multi-window display illustrated in FIG. In this manner, a specific gesture operation (specific operation) can be performed on desired medical information among different medical information displayed in a multi-window.

FIG. 7 is an explanatory diagram showing a second example of predetermined processing assigned to a specific operation by the display processing unit 52 of this embodiment. FIG. 7 shows correspondence between specific operations on CT images and assigned predetermined processes. As shown in FIG. 7, a selection menu display process for selecting a gradation operation is assigned to the operation C7 as a predetermined process. ), gradation inversion, gradation initial state, and other operations (processing) can be performed.

A selection menu display process for selecting a file operation is assigned to the operation C8 as a predetermined process. )It can be performed.

A selection menu display process for selecting enlargement/reduction, rotation, and reversal operations is assigned to the operation C9 as predetermined processing. )It can be performed.

A selection menu display process for selecting a display layout change operation is assigned to the operation C10 as a predetermined process. It can be carried out.

As described above, in the predetermined processing assigned to the specific operation, when one specific operation is performed on the medical information displayed on the display screen 51, a selection menu for selecting the predetermined processing for the medical information is displayed. It also includes processing to Note that the gestures, selection menus, and operation details (processes) illustrated in FIG. 7 are merely examples, and are not limited to the examples in FIG. 7 .

FIG. 8 is an explanatory diagram showing a third example of predetermined processing assigned to a specific operation by the display processing unit 52 of this embodiment. FIG. 8 shows the correspondence between specific operations on inspection data and assigned predetermined processes. As shown in FIG. 8, a selection menu display process for selecting a print operation is assigned to the operation C7 as a predetermined process, and an operation (process) such as print setting can be performed.

In addition, a selection menu display process for selecting a graph display operation is assigned to the operation C8 as a predetermined process. can be done.

A selection menu display process for selecting a search operation is assigned to the operation C9 as a predetermined process, and an operation (process) such as setting search conditions such as characters in the inspection data can be performed.

A selection menu display process for selecting an enlargement/reduction operation is assigned to the operation C10 as a predetermined process, and an operation (process) such as magnification setting can be performed.

As described above, by simply selecting desired medical information from a plurality of pieces of medical information displayed on the display screen 51 and performing a specific operation (for example, a specific gesture operation), a plurality of pieces of medical information specialized for that medical information can be displayed. Since a selection menu for selecting the processing (operation content) is displayed, the desired processing can be easily selected.

Further, the operations C7 to C10 illustrated in FIGS. 7 and 8 are assigned different predetermined processes for different types of medical information (CT images in FIG. 7 and examination data in FIG. 8). , the operations C7 to C10 can be referred to as second specific operations.

FIG. 9 is a schematic diagram showing a first example of the selection menu 62 displayed on the display screen 51 by the display processing unit 52 of this embodiment. A selection menu 62 shown in FIG. 9 shows an example of a gradation operation menu for the CT image illustrated in FIG. The selection menu 62 has a shape in which one of the four halves of a circle in the radial direction is missing, and is arranged in the lower right corner of the CT image display area so as to be adjacent to the display area. The selection menu 62 is classified into three areas according to operation contents (processes). Each area displays an icon that reminds one of the operation content. Note that the shape of the selection menu 62, the number of types of operation content, the icons representing the operation content, and the like are examples, and are not limited to the example in FIG.

As described above, when the second specific operation is performed on the medical information displayed on the display screen 51, the menu display processing unit 523 performs different second predetermined processing corresponding to the type of the medical information. A selection menu 62 can be displayed for selection.

That is, by performing a common operation (first specifying operation) irrespective of the type of medical information or a second specifying operation corresponding to the type of medical information, the menu display processing unit 523 displays information associated with the medical information. The operation group can be displayed as an operation menu. The operation (process) displayed as the operation menu may be an operation (referred to as predetermined process A) illustrated in FIG. may be called). As a result, even if the user does not remember operations such as gesture operations for each piece of medical information, operations related to the medical information can be performed with a reduced workload.

The menu display processing unit 523 displays the transparent selection menu 62 . As a result, even if the selection menu 62 is displayed superimposed on part of the medical information such as an MRI image, the part of the medical information can be visually recognized.

Further, the menu display processing unit 523 displays the selection menu 62 in or near the display area where the medical information (the CT image in the example of FIG. 9) for which the specific operation was performed is displayed. By displaying the selection menu 62 within the display area, it is possible to reduce the moving distance of the mouse cursor (pointer) without misunderstanding which medical information is to be processed, thereby reducing the workload. Efficiency can be improved. Further, by displaying the selection menu 62 near the display area, in addition to the above effects, it becomes possible to clearly grasp the processing result of the target medical information.

Also, the display position of the operation menu 62 (FIG. 9, FIGS. 12 and 13 described later, etc.) may be specified depending on the mode of the specific operation. For example, the display position of the operation menu 62 may be specified according to the position where the specific operation is started. By doing so, it is possible to smoothly transition from the specific operation to the operation within the operation menu. Also, the number of operation menus may be specified depending on the mode of the specific operation. For example, the time at which the specific operation is performed or the length of the movement trajectory of the cursor may be associated with the number of operation menus, such as three, five, or seven. By doing so, the user can intuitively specify the number of menus for a specific operation without having to separately learn the operation for specifying the number of menus.

FIG. 10 is a schematic diagram showing a first example of the operation when the selection menu 62 is selected by the display processing unit 52 of the present embodiment. In the example of FIG. 10, in the selection menu 62 (three icons of "change gradation", "invert gradation", and "reset gradation operation result to initial state" are displayed), the lower left It shows that a slider bar for changing the gradation is displayed by moving the mouse cursor M to the gradation change symbol (icon). The slider bar has a bar for changing WL (window value) in the vertical direction and WW (window width) in the horizontal direction. The medical staff can change the gradation by, for example, left-clicking and moving the mouse up, down, left, or right on the slider bar. In addition, the gradation can be changed by moving the mouse up, down, left, or right while left-clicking the mouse in a place other than the slider bar, for example, within the display area of the CT image.

FIG. 11 is a schematic diagram showing a second example of the operation when the selection menu 62 is selected by the display processing unit 52 of the present embodiment. In the example of FIG. 11, it is assumed that the CT images are series images. Move the mouse cursor to the image manipulation symbol (icon) of the lower left series image in the selection menu 62 (three icons of "image manipulation", "play animation", and "stop animation play" are displayed). By moving M, it is shown that a slider bar for selecting an image to be displayed from among the series images is displayed. The slider bar has a vertical Im (image position) selection bar. The medical staff can change the image to be displayed by, for example, moving the mouse up and down while left-clicking on the slider bar. In addition, the image to be displayed can be changed by moving the mouse up and down while left-clicking the mouse in a place other than the slider bar, for example, within the display area of the CT image.

As described above, a selection menu for selecting a predetermined process assigned to a specific gesture operation is displayed near the desired medical information, and the desired process (operation) is selected from the displayed selection menu. can be easily processed.

FIG. 12 is a schematic diagram showing a second example of the selection menu 62 displayed on the display screen 51 by the display processing unit 52 of this embodiment. A selection menu 62 shown in FIG. 12 shows an example of a gradation operation menu for the CT image illustrated in FIG. The selection menu 62 has a sector-like shape in which two opposing sides of an elongated rectangle are curved in the same direction, and is arranged at the lower right corner of the CT image display area. Each icon in the selection menu 62 is similar to the example in FIG. 9, but may be different.

The selection menu 62 has transparency. As a result, even if the selection menu 62 is displayed superimposed on part of the medical information such as a CT image, the part of the medical information can be visually recognized.

FIG. 13 is a schematic diagram showing a third example of the selection menu 62 displayed on the display screen 51 by the display processing unit 52 of this embodiment. In the example of FIG. 13, the mouse is operated by performing a predetermined specific operation (eg, gesture operation, mouse click operation, etc.) on the CT image displayed on the display screen 51 (or on the display area of the CT image). A selection menu 62 is displayed around, for example, the tip position S of the cursor M of .

Further, in the example of FIG. 13, the distance between the position of the cursor M (for example, the tip position S) and each area where each icon in the selection menu 62 is displayed is approximately the same, and the distance is relatively large. I'm trying to keep it short.

That is, when one specific operation is performed on the medical information displayed on the display screen 51, the menu display processing unit 523 displays a Display a selection menu. As a result, it is possible to reduce the moving distance of the cursor (pointer) of the mouse when selecting a desired process, reduce the workload, and improve the work efficiency.

Moreover, the menu display processing unit 523 can display a fan-shaped selection menu 62 formed of a part of a concentric circle centered on the position of the cursor M of the mouse. As a result, it is possible to reduce the moving distance of the cursor (pointer) of the mouse when selecting a desired process, reduce the workload, and improve the work efficiency.

FIG. 14 is a schematic diagram showing a fourth example of the selection menu 62 displayed on the display screen 51 by the display processing unit 52 of this embodiment. The example of FIG. 14 shows a case of displaying a submenu (secondary selection menu) 63 in which the operations in the selection menu 62 are further subdivided. That is, the submenu 63 of the process selected in the selection menu 62 is displayed, and the desired process can be selected from the submenu 63 .

As shown in FIG. 14, when the mouse cursor M is moved to the "rotation" menu 62a in the selection menu 62 and the "rotation" menu 62a is selected, a submenu 63 is displayed. Each processing of "rotation", "left rotation", "vertical inversion", and "horizontal inversion" can be selected. By displaying the submenu 63, it is possible to easily select detailed processing for the processing displayed on the selection menu 62. FIG. Note that the example of the submenu 63 is not limited to the example of FIG. 14 .

As described above, when an operation item in the selection menu 62 is selected, the menu display processing unit 523 displays the submenu 63 for selecting a predetermined process related to the selected operation item. This makes it possible to easily select a desired process even when a plurality of predetermined processes are hierarchized and diversified.

Further, when a selection operation is performed within the selection menu 62, the menu display processing unit 523 displays the submenu 63 in an area around the position on the display screen 51 where the selection operation is performed. As a result, it is possible to reduce the moving distance of the cursor (pointer) of the mouse when selecting a desired process, reduce the workload, and improve the work efficiency.

Further, the menu display processing unit 523 can display a fan-shaped submenu 63 formed of a part of a concentric circle centered on the position of the cursor M of the mouse. As a result, it is possible to reduce the moving distance of the cursor (pointer) of the mouse when selecting a desired process, reduce the workload, and improve the work efficiency.

Further, since the submenu 63 has transparency, even if the submenu 63 is displayed overlapping part of the medical information such as a CT image, the part of the medical information can be visually recognized.

Next, a VR (volume rendering) image will be described as an example of an image that is one type of medical information.

FIG. 15 is a schematic diagram showing a second display example displayed on the display screen 51 by the display processing unit 52 of the present embodiment. The difference from the first display example shown in FIG. 3 is that a VR image of a certain patient (for example, patient ID: xxxxxx) at a required time point or period is displayed in a predetermined display area 61 on the display screen 51. is. By performing the specific operation illustrated in FIG. 4 on the display screen 51 (for example, on the VR image or at a location away from the VR image), the menu display processing unit 523 performs predetermined processing as shown in FIG. icon can be displayed. Note that an icon refers to a group of images in which the aforementioned selection menu is formed as a specific pixel area on the screen, and a predetermined operation is assigned according to the entire formed area or the position of the formed area. point to something

That is, the menu display processing unit 523 can display an icon for performing predetermined processing on an image when either the first specific operation or the second specific operation is performed. Here, the predetermined process may be the first predetermined process or the second predetermined process.

FIG. 16 is a schematic diagram showing a first example of icons displayed on the display screen 51 by the menu display processing unit 523 of this embodiment. The predetermined processing can be, for example, processing related to conversion of a VR image, such as rotation processing (free rotation in 3D or rotation on a plane), enlargement/reduction processing, parallel movement processing, clipping by ROI (Region of Interest). processing can be included. Further, the predetermined processing can be processing related to the VR image, for example, processing related to adjustment of the color map (eg, adjustment of RGB values, adjustment of opacity, signal value for setting control points). processing such as adjustment of the specular reflectance or ambient light, or the like. A color map is a user-defined conversion table that defines the relationship between signal values, RGB values, and opacity. can be made transparent to reveal hidden organs.

In the example of FIG. 16, the icon 71 is assigned 3D rotation processing (also referred to as rotation), the icon 72 is assigned planar rotation processing (also referred to as spin), and the icon 73 is An enlargement/reduction process (also called dolly) is assigned, and the icon 74 is assigned a translation process (also called pan). Also, the example of FIG. 16 illustrates a state in which an operation on the icon 74 is accepted. An operation on an icon that performs a predetermined process can be, for example, an operation such as clicking, flicking, or mouseover, but is not limited to these operations. Note that the icon for performing the predetermined process is not limited to the example in FIG. 16 .

When receiving an operation for an icon that performs a predetermined process, the predetermined processing unit 522 receives an operation for adjusting the processing amount of the predetermined process at the position of the icon. More specifically, when receiving an operation on an icon that performs a predetermined process, the predetermined processing unit 522 receives an operation for adjusting the processing amount of the predetermined process that differs depending on the position within the icon at which the operation is received. For example, if the predetermined process is a process related to conversion of a VR image, the amount of processing can be, for example, a rotation angle, enlargement/reduction magnification, translation amount (offset), ROI coordinates, and the like. "At the position of the icon" includes, for example, on the icon, the boundary between the icon and an area other than the icon, and the vicinity of the icon.

In the present embodiment, with the configuration described above, predetermined processing is assigned according to the position of the displayed icon, and the processing amount of the predetermined processing can be adjusted by operating the icon position. A desired operation can be realized in the vicinity of . The vicinity of the medical information may be a position overlapping with a part of the medical information, a position in contact with the medical information, or a position a short distance away from the medical information.

In addition, in this embodiment, as shown in FIG. 16, the processing contents can be changed according to the positions of the icons 71-74. In other words, in the present embodiment, different processing can be assigned according to the position information of the icons 71 to 74, and the processing amount of the processing can be immediately adjusted according to the positions of the icons.

Further, when receiving an operation for an icon, the menu display processing unit 523 can display an adjustment operation icon for receiving an adjustment operation. This is the same as the operation for displaying the submenu 63 of the process selected in the selection menu 62 described above.

FIG. 17 is a schematic diagram showing a first example of adjustment operation icons displayed on the display screen 51 by the menu display processing unit 523 of the present embodiment. In the example of FIG. 17, icons 71a, 71b, and 71c are displayed around the icon 71, and the icons 71a, 71b, and 71c can adjust the rotation angles around the 3D xyz axes, respectively. Icons 72a and 72b are displayed around the icon 72, and the icons 72a and 72b can adjust rotation angles around two axes on the plane, respectively. Icons 73a and 73b are displayed around the icon 73, and the icons 73a and 73b can adjust the magnification of enlargement processing and reduction processing. Icons 74a, 74b, 74c, and 74d are displayed around the icon 74, and the icons 74a, 74b, 74c, and 74d can adjust the movement distance in the vertical and horizontal directions.

In the example of FIG. 17, adjustment operation icons are displayed around the icons 71, 72, 73 and 74 for convenience. It is not necessary to display the operation icon. For example, as shown in FIG. 16, when an operation on icon 74 is accepted, adjustment operation icons may be displayed around icon 74, and adjustment operation icons may not be displayed around icons 71-73.

That is, the menu display processing unit 523 displays a plurality of icons for performing predetermined processing on an image, and when an operation for one of the plurality of icons is received, displays an adjustment operation icon near the one icon. However, the adjustment operation icon is not displayed in the vicinity of the icons other than the one icon. For example, when the user selects one of a plurality of icons, the adjustment operation icon is displayed near the selected icon, but the adjustment operation icon is displayed near the other unselected icons. is not displayed. As a result, it is possible to selectively display the adjustment operation icon, and it is not necessary to display the adjustment operation icon for each of the plurality of icons, so that the operation display area can be reduced. Note that the vicinity of the icon may be a position overlapping with a part of the icon, a position in contact with the icon, or a position a short distance away from the icon.

As described above, the adjustment operation icon is displayed simply by performing an operation on the icons 71 to 74. Therefore, the adjustment operation can be performed immediately at the positions of the icons 71 to 74, which simplifies the operation and improves the operability. .

Also, the icons 71 to 74 are displayed in such a manner that the transparency of the icons 71 to 74 is made relatively large so that the VR image in the background of the icons 71 to 74 can be seen through. When the operation is performed, the transparency of the icon on which the operation is performed can be reduced to make the icon stand out. As a result, the visibility of the background VR image is improved when the icons 71 to 74 are not operated, and the visibility of the icon is enhanced when the icon is operated. can.

Also, the menu display processing unit 523 can display adjustment operation icons near the icons. In the example of FIG. 17, the adjustment operation icons are displayed around (near) the icons 71-74. As a result, for example, it is not necessary to move the position of the cursor of the mouse, or the moving distance can be shortened, thereby improving the operability. Note that the adjustment operation icon may be displayed so as to overlap a part of the icons 71 to 74 that perform the predetermined processing. As a result, the area of the display area for displaying the icon can be further reduced, and the area where the VR image is blocked by the icon can be reduced.

FIG. 18 is a schematic diagram showing a second example of icons displayed on the display screen 51 by the menu display processing unit 523 of this embodiment. In the example of FIG. 18, the predetermined process for the VR image is a process related to color map adjustment, the icon 81 is an icon for adjusting the R value, and the icon 82 is for adjusting the G value. An icon 83 is an icon for adjusting the B value, an icon 84 is an icon for adjusting the opacity, and an icon 85 is for adjusting the signal value for setting the control point. It is an icon that performs Numerical values displayed below the icons 81 to 85 represent RGB values, opacity, and signal values.

By performing the specific operation illustrated in FIG. 4 on the display screen 51 (for example, on the VR image or at a location away from the VR image), the menu display processing unit 523 performs predetermined processing as shown in FIG. Icons 81-85 can be displayed.

Further, when the menu display processing unit 523 receives an operation to select a desired portion (indicated by reference numeral 80 in FIG. 18) in the VR image displayed on the display screen 51, the predetermined processing shown in FIG. icons 81 to 85 can be displayed.

Further, when the menu display processing unit 523 receives an operation to select a desired portion (indicated by reference numeral 80 in FIG. 18) in the VR image displayed on the display screen 51, the menu display processing unit 523 selects a pixel corresponding to the portion of the image. A pixel value assigned to the signal value to be obtained can be obtained and the obtained pixel value can be displayed. The pixels in the image are selected so that when one image is selected, not only the one pixel but also a plurality of pixels having the same pixel value within a predetermined region around the one pixel are selected together. can be The pixel value can be, for example, the RGB value assigned to the original signal value represented by the pixel of interest, the opacity, the original signal value, or the like. In the example of FIG. 18, the RGB value, opacity, and signal value are 128, 65, 32, 0.8, and 1520, respectively, but are not limited to these. In normal color map setting, by setting desired RGB values and opacity for signal values that are one or more control points, the correspondence between all signal values, RGB values, and opacity is defined. For signal values other than control points, RGB values and opacity values interpolated by a predetermined procedure are set.

Also, the icons 81 to 85 are displayed in such a manner that the transparency of the icons 81 to 85 is made relatively large so that the VR image in the background of the icons 81 to 85 can be seen through. When the operation is performed, the transparency of the icon on which the operation is performed can be reduced to make the icon stand out. As a result, the visibility of the background VR image can be improved when the icons 81 to 85 are not operated, and the visibility of the icon can be improved when the icon is operated. can.

FIG. 19 is a schematic diagram showing an example of operation for icons displayed on the display screen 51 by the menu display processing unit 523 of the present embodiment. FIG. 19 shows the result of operating the icon 81 shown in FIG. As shown in FIG. 19, by performing an upward operation on an icon 81 for performing predetermined processing, it is possible to increase the R value corresponding to a pixel at a selected desired location, and by performing a downward operation. By doing so, the R value can be reduced. When the operation on the icon is a color map operation, by performing a similar operation, not only the pixel value of the pixel at the selected desired location is changed, but also the signal value corresponding to the desired pixel is changed. The entire VR image may be redrawn by changing the definition of the color map so as to change the assigned pixel value (eg, R value, etc.). In the example of FIG. 19, the R value is adjusted to increase from 128 to 138. Similarly, for the other icons 82 to 85, the numerical value can be increased by the upward operation, and the numerical value can be decreased by the downward operation.

Note that the operation is not limited to the vertical direction, and the numerical value may be increased when the icons 81 to 85 are strongly pressed, and decreased when the icon is pressed lightly. Also, the display speed when the numerical value increases or decreases (for example, the time for displaying one numerical value) may be appropriately set.

When the menu display processing unit 523 displays icons 81 to 85 for performing predetermined processing and accepts an operation on the icons 81 to 85, the predetermined processing unit 522 sets the pixel value corresponding to the desired portion of the VR image. A pixel value adjustment operation can be accepted such that the value of the pixel value is changed. More specifically, the predetermined processing unit 522 performs the predetermined processing at the position within the icons 81 to 85 where the operation is received so that the value set for the pixel value corresponding to the desired portion of the VR image is changed. can accept adjustment operations for different processing amounts. The predetermined processing can be, for example, processing related to color map adjustment (eg, RGB value adjustment, opacity adjustment, signal value adjustment for setting control points, etc.).

With the above-described configuration, it is possible to intuitively select a portion whose pixel value is to be adjusted on the medical information (for example, VR image). In addition, since the pixel value can be adjusted at the position of the displayed icon simply by selecting a desired portion on the medical information, the operation time can be shortened and the operability can be improved.

In addition, as described above, by simply selecting a desired location on the medical information, the pixel values of the selected location can be displayed. It is possible to intuitively judge while watching, and the operability is improved.

Further, as illustrated in FIG. 19, when a pixel value adjustment operation is accepted, the pixel value corresponding to the adjustment operation is displayed, so that the user can intuitively judge the pixel value adjustment result while viewing the medical information. and improve operability.

FIG. 20 is a schematic diagram showing a third example of icons displayed on the display screen 51 by the menu display processing unit 523 of this embodiment. In the example of FIG. 20, icons 81 to 83 are displayed like a pie chart. For example, at the position of the icon 81, the R value can be increased by operating the circle outward, and the R value can be decreased by operating the circle toward the center. Other icons 82-83 are similar.

21A to 21G are schematic diagrams showing other examples of icons displayed on the display screen 51 by the menu display processing unit 523 of this embodiment. The example of FIG. 21A represents adjustment values for pixel values according to the size of the area occupied within the icon. For example, when the B value is 0 to 255, the example in FIG. 21A indicates that the B value is adjusted to 192. The shape of the icon can be rectangular or circular, as shown in FIG. 21A, but is not limited thereto, and may be polygonal such as triangular, pentagonal, or hexagonal. Also, the area indicating the adjustment value can be rectangular, pie chart-shaped, concentric circle-shaped, or the like. This makes it possible to intuitively determine to what extent (percentage) the adjustment value is of the maximum value. Further, the pixel value may be adjusted by dragging the boundary line between the area indicating the adjustment value in the icon and the area other than the area. The same applies to other pixel values (R value, G value, opacity, signal value).

In the example of FIG. 21B, the pixel value adjustment value is represented by the size of the icon shape (icon area). As shown in FIG. 21B, by displaying rectangular icons for each of RGB, the adjustment values of other pixel values can be displayed in comparison. In the example of FIG. 21C, each of the RGB icons is displayed in three areas obtained by dividing a circle into three equal parts. The adjustment value of the pixel value can be represented by the size (length of the diameter) of the shape of the icon, and the adjustment value of other pixel values can be represented in comparison.

In the example of FIG. 21D, each of the RGB icons is displayed in, for example, a rectangle or a circle, and the icons are displayed in colors obtained from the RGB values. For example, if the R value is 255, the G value is 255, and the B value is 128, the icon is displayed in yellow. Since the color of the icon changes by adjusting the RGB values, the RGB values can be adjusted intuitively.

In the example of FIG. 21E, the icon has an arrow shape, and for example, the tip of the arrow points upward and downward. By manipulating anywhere in the upper half of the icon, the pixel value (B value in the example of FIG. 21E) can be increased, and by manipulating anywhere in the lower half of the icon, the pixel value is decreased. be able to. Since the adjustment method for increasing or decreasing the pixel value can be easily determined from the shape of the icon, the pixel value can be adjusted intuitively.

The example of FIG. 21F represents adjustment values for pixel values depending on the size of the area occupied within the icon. This makes it possible to intuitively determine to what extent (percentage) the adjustment value is of the maximum value. Further, the pixel value may be adjusted by dragging the boundary line between the area indicating the adjustment value in the icon and the area other than the area. The same applies to other pixel values (R value, G value, opacity, signal value).

In the example of FIG. 21G, each icon of RGB values is grouped into one shape (a triangle in the example of the figure). It can be easily determined that the direction in which each vertex of the triangle faces is the direction in which the pixel value increases. The pixel value can be increased by operating in the direction of the vertex (outward direction) at the icon position of each RGB value, and the pixel value can be decreased by operating in the opposite direction (inward direction). Since the adjustment method for increasing or decreasing the pixel value can be easily determined from the shape of the icon, the pixel value can be adjusted intuitively.

As described above, when receiving a pixel value adjustment operation, the menu display processing unit 523 can change the icon display mode according to the adjustment operation. The icon display mode includes, for example, the shape, size, and color of the icon, as illustrated in FIGS. 21A to 21G. As a result, the adjustment result can be visually determined, and the pixel value can be easily adjusted. In addition, the pixel value can be adjusted within one icon, and the pixel value can be increased or decreased intuitively, thereby improving operability.

The display mode of icons is not limited to the example in FIG. For example, pixel values may be displayed on the surface of a rotating part such as a dial or a drum, and the pixel values may be increased or decreased by rotating the rotating part to select a desired pixel value.

FIG. 22 is a block diagram showing another example of the configuration of the display processing section 52 of this embodiment. As shown in FIG. 22, the display processing unit 52 can be composed of a CPU 526, a ROM 527, a RAM 528, a recording medium reading unit 529, and the like. A computer program recorded on the recording medium 1 can be read by the recording medium reading unit 529 and stored in the RAM 528 . By causing the CPU 526 to execute the computer program stored in the RAM 528, the processing performed by the allocation processing unit 521, the predetermined processing unit 522, and the menu display processing unit 523 can be executed. Note that the CPU 526 is a general term for processors, processor devices, processing units, and the like, and can be composed of one or more. Also, the computer program can be downloaded via a network such as the Internet instead of being read by the recording medium reading unit 529 .

Next, the operation of the display device 50 of this embodiment will be described.

FIG. 23 is a flow chart showing a first example of display processing by the display device 50 of this embodiment. In the following, for the sake of convenience, the display processing unit 52 will be described as the subject of processing. The display processing unit 52 acquires patient specific information (S11). The specific information can be acquired, for example, by the medical staff inputting patient specific information from the operation input unit 53 or selecting a desired patient from a list of patients displayed on the display screen 51 .

The display processing unit 52 acquires the specified patient's medical information from the server 20 (S12). The acquired medical information can be stored in the storage unit 55 . The display processing unit 52 displays the patient's medical information (S13). The display of medical information is, for example, that illustrated in FIG. 3, but is not limited to this.

The display processing unit 52 determines whether or not a specific operation has been performed (S14). The specific operation can include, for example, a mouse cursor gesture operation, a mouse click operation, a key press operation, or a combination thereof. If there is no specific operation (NO in S14), the display processing unit 52 continues the processing of step S14.

If there is a specific operation (YES in S14), the display processing unit 52 determines that the specific operation depends on the type of medical information (for example, CR image, CT image, MRI image, US image, document, examination data, etc.). It is determined whether or not it is an operation to do (S15).

If the operation depends on the type (YES in S15), the display processing unit 52 determines whether the operation is for displaying a selection menu for selecting an operation for the medical information (S16). If the operation is for displaying a selection menu (YES in S16), the display processing unit 52 displays the selection menu (S17), executes a predetermined process selected in the selection menu (S18), The process of step S21 is performed.

If the operation is not for displaying a selection menu (NO in S16), the display processing unit 52 executes the specific operation performed in step S14 and the predetermined processing assigned to the medical information (S19), and The process of step S21 is performed. If the operation does not depend on the type of medical information (NO in S15), the display processing unit 52 displays a selection menu for selecting common operations regardless of the type of medical information (S20), and performs the process of step S18. .

The display processing unit 52 determines whether or not to end the process (S21). End the process.

As described above, according to the present embodiment, operations on required medical information to be focused on are gesture operations or mouse click operations in the medical information or in the display area of the medical information, or in the vicinity of the medical information. By selecting the menu displayed in , the moving distance of the mouse cursor (pointer) can be reduced, the workload can be reduced, and the work efficiency can be improved. In addition, since information other than medical information is not displayed on the display screen (work screen) unless necessary, it is possible to effectively utilize the screen space and display more medical information. .

24 and 25 are flowcharts showing a second example of display processing by the display device 50 of this embodiment. The display processing unit 52 acquires patient specific information (S31). The specific information can be acquired, for example, by the medical staff inputting patient specific information from the operation input unit 53 or selecting a desired patient from a list of patients displayed on the display screen 51 .

The display processing unit 52 acquires the specified patient's medical information from the server 20 (S32). The acquired medical information can be stored in the storage unit 55 . The display processing unit 52 displays the patient's medical information (S33). The display of medical information is, for example, the one shown in FIG. 15, but is not limited to this.

The display processing unit 52 determines whether or not there is a specific operation (S34). The specific operation may be the first specific operation or the second specific operation. If there is no specific operation (NO in S34), the display processing unit 52 continues the processing of step S34.

If there is a specific operation (YES in S34), the display processing unit 52 applies a desired color map according to the operation of the medical staff (S35), and displays the VR image (S36). Here, it is assumed that a specific operation has been performed on the VR image in the medical information illustrated in FIG. 15 .

The display processing unit 52 displays an icon for conversion processing (performs predetermined processing) of the VR image (S37), and determines whether or not an operation for adjusting the processing amount has been received at the position of the icon for conversion processing (S38). ). When the processing amount adjusting operation is received (YES in S38), the display processing unit 52 displays an icon (S39) and determines whether or not there is an adjusting operation (S40).

If there is an adjustment operation (YES in S40), the display processing unit 52 converts and displays the VR image according to the adjusted processing amount (S41), and determines whether or not to end the processing (S42). ). If the adjustment operation for the processing amount is not received (NO in S38) or if there is no adjustment operation (NO in S40), the display processing unit 52 performs the process of step S42.

If the process is not to end (NO in S42), the display processing unit 52 determines whether or not there is an operation to select a location in the VR image (S43). is displayed (S44), and the pixel value of the selected portion is acquired (S45). Here, the acquired pixel value may be displayed together with the icon.

The display processing unit 52 determines whether or not there is a pixel value adjustment operation (S46), and if there is an adjustment operation (YES in S46), the VR image is displayed with the adjusted pixel values (S47).

The display processing unit 52 changes the display mode of the adjustment operation icon according to the adjusted pixel value (S48), and performs the process of step S42. If there is no adjustment operation (NO in S46), the display processing unit 52 performs the processing of step S42.

If there is no operation to select a location within the VR image (NO in S43), the display processing unit 52 continues the processing from step 37 onward. When the display processing unit 52 ends the processing (YES in S42), it ends the processing.

In the above embodiment, the display device 50 is configured to include the display processing section 52, but the present invention is not limited to this. For example, the server 20 can have a configuration similar to that of the display processing unit 52 . In this case, the display device 50 outputs the operation performed by the operation input unit 53 to the server 20 , the server 20 performs required display processing according to the operation, and transmits the processing result to the display device 50 . should be

A computer program according to the present embodiment is a computer program for causing a computer to display medical information on a display screen, wherein the computer performs different first predetermined processes for each of a plurality of first specific operations. and when one of the plurality of first specific operations is performed on the medical information displayed on the display screen, a different second specific operation corresponding to the type of the medical information is performed. and a process of displaying a selection menu for selecting a predetermined process.

A display device according to the present embodiment is a display device that displays medical information on a display screen, and includes an allocation processing unit that allocates a different first predetermined process to each of a plurality of first specific operations; Selection of selecting a different second predetermined process corresponding to the type of the medical information when one of the plurality of first specific operations is performed on the medical information displayed on the screen. and a menu display processing unit for displaying a menu.

A display method according to the present embodiment is a display method for displaying medical information on a display screen, wherein an allocation processing unit allocates a different first predetermined process to each of a plurality of first specific operations, and the display is performed. Selection of selecting a different second predetermined process corresponding to the type of the medical information when one of the plurality of first specific operations is performed on the medical information displayed on the screen. The display processing unit displays the menu.

A computer program, a display device, and a display method according to the present embodiment assign different first predetermined processes to each of a plurality of first specific operations, and display the medical information displayed on the display screen. When one specific operation among the plurality of first specific operations is performed, a selection menu is displayed for selecting a different second predetermined process corresponding to the type of the medical information. The first predetermined process is a process irrelevant to the type of medical information, and the second predetermined process is a process corresponding to the type of medical information.

The first specific operation includes, for example, a mouse gesture (a specific cursor movement operation) or a mouse button click operation. The medical information includes, for example, images (series images such as CT, CR, US, MRI, or moving images), documents, test results (test data), and the like.

Since a selection menu for selecting a different second predetermined process corresponding to the type of medical information is displayed only by performing one specific operation out of the plurality of first specific operations, the desired process can be selected. become easier.

A computer program according to the present embodiment provides a computer with a process of assigning a different second predetermined process to each of a plurality of second specific operations for each of a plurality of pieces of medical information of different types, and displaying on the display screen. When one of the plurality of second specific operations is performed on the received medical information, a second predetermined process assigned to the medical information and the one specific operation is executed.

A computer program according to the present embodiment assigns a different second predetermined process to each of a plurality of second specific operations for each of a plurality of pieces of medical information of different types, and performs processing on the medical information displayed on the display screen. Then, when one of the plurality of second specific operations is performed, a second predetermined process assigned to the medical information and the one specific operation is performed.

The second specific operation corresponds to the type of medical information, and includes, for example, a mouse gesture (a specific cursor movement operation) or a mouse button click operation. Note that the first specific operation and the second specific operation may be the same operation or different operations.

Since a different second predetermined process is assigned to each of the plurality of second specific operations, the desired process can be facilitated simply by performing the specific operation corresponding to the desired process. Further, for example, when the same specific operation is performed, different second predetermined processes can be assigned for each type of medical information. A desired process can be executed for each piece of medical information with one specific operation without the need for allocation. This can prevent an increase in the number of different specific operations.

In the computer program according to the present embodiment, the second predetermined process includes performing one specific operation among the plurality of second specific operations on the medical information displayed on the display screen, A process of displaying a selection menu for selecting a different second predetermined process corresponding to the type of the medical information is included.

The second predetermined process is, when one of a plurality of second specific operations is performed on the medical information displayed on the display screen, a different second specific operation corresponding to the type of the medical information. including a process of displaying a selection menu for selecting a predetermined process of Since the selection menu is displayed, it becomes easy to select the desired process.

The computer program according to the present embodiment provides a display area in which the medical information is displayed when one of the plurality of first specific operations or the plurality of second specific operations is performed on the computer. A process for displaying the selection menu in or near the display is executed.

A computer program according to the present embodiment, when performing one specific operation out of a plurality of first specific operations or a plurality of second specific operations on medical information displayed on a display screen, A selection menu is displayed within or near the display area where the information is displayed. As a result, it is possible to reduce the moving distance of the cursor (pointer) of the mouse when selecting a desired process, reduce the workload, and improve the work efficiency.

The computer program according to the present embodiment is a computer program that, when one of the plurality of first specific operations or the plurality of second specific operations is performed on the computer, that the one specific operation is performed A process for displaying the selection menu in a region surrounding the position on the display screen is executed.

A computer program according to the present embodiment, when performing one specific operation out of a plurality of first specific operations or a plurality of second specific operations on medical information displayed on a display screen, A selection menu is displayed in the area around the position on the display screen where the specific operation of is performed. As a result, it is possible to reduce the moving distance of the cursor (pointer) of the mouse when selecting a desired process, reduce the workload, and improve the work efficiency.

A computer program according to the present embodiment causes a computer, when an operation item in the selection menu is selected, to display a secondary selection menu for selecting a predetermined process related to the operation item.

A computer program according to the present embodiment displays a sub-selection menu for selecting a predetermined process related to the selected operation item when an operation item in the selection menu is selected. This makes it possible to easily select a desired process even when a plurality of predetermined processes are hierarchized and diversified.

In the computer program according to this embodiment, the selection menu or the sub-selection menu has transparency.

A selection menu or sub-selection menu has transparency. Thereby, even if the selection menu or the sub-selection menu is displayed overlapping part of the medical information such as an image, the part of the medical information can be visually recognized.

A computer program according to the present embodiment causes a computer to execute processing for allocating each of the specific operations in correspondence with different movement trajectories of a pointer displayed on the display screen.

A computer program according to the present embodiment assigns a plurality of first specific operations or second specific operations to correspond to different movement trajectories of a pointer displayed on a display screen. A pointer includes, for example, a mouse cursor. Accordingly, desired predetermined processing can be executed simply by performing an operation (gesture operation) to move the pointer.

A display system according to this embodiment includes the display device according to this embodiment, and a server connected to the display device and having a storage unit for storing medical information.

This makes it possible to centrally manage patient's medical information.

A computer program according to the present embodiment is a computer program for causing a computer to display medical information on a display screen. is received, a process of receiving an adjustment operation of a different processing amount of the predetermined process depending on the position in the icon where the operation is received is executed.

A display device according to the present embodiment is a display device that displays medical information on a display screen, and includes a display processing unit that displays an icon for performing predetermined processing on medical information, and when an operation on the icon is received, the an adjustment operation receiving unit that receives an adjustment operation for adjusting the amount of processing of the predetermined processing that differs depending on the position within the icon at which the operation is received;

A display method according to the present embodiment is a display method for displaying medical information on a display screen. An icon for performing a predetermined process on medical information is displayed. The adjustment operation of the processing amount of the predetermined processing that differs depending on the position at which the is received is received.

A computer program, a display device, and a display method according to the present embodiment display icons for performing predetermined processing on medical information. The predetermined processing can be, for example, processing related to conversion of a VR (volume rendering) image, such as rotation processing (free rotation in 3D or rotation on a plane), enlargement/reduction processing, translation processing, ROI (Region of Interest) including clipping processing. Further, the predetermined processing can be processing related to the VR image, for example, processing related to adjustment of the color map (eg, adjustment of RGB values, adjustment of opacity, signal value for setting control points). ), or may include specular reflectance or ambient light adjustments.

In the present embodiment, when an operation for an icon that performs a predetermined process is received, an operation for adjusting the processing amount of the predetermined process that differs depending on the position within the icon at which the operation is received is received. If the predetermined process is a process related to conversion, the amount of processing can be, for example, a rotation angle, an enlargement/reduction magnification, a translation amount (offset), ROI coordinates, or the like.

In the present embodiment, with the configuration described above, predetermined processing is assigned according to the position of the displayed icon, and the processing amount of the predetermined processing can be adjusted by operating the icon position. A desired operation can be realized in the vicinity of .

A computer program according to the present embodiment causes a computer to execute a process of displaying an adjustment operation icon that accepts the adjustment operation when an operation on the icon is accepted.

In this embodiment, when an operation on an icon is accepted, an adjustment operation icon for accepting an adjustment operation is displayed. Since the adjustment operation icon is displayed only by performing an operation on the icon, the adjustment operation can be performed immediately at the position of the icon, the operation is simplified, and the operability is improved.

A computer program according to the present embodiment causes a computer to execute processing for displaying the adjustment operation icon near the icon.

In this embodiment, since the adjustment operation icon is displayed near the icon, for example, it is not necessary to move the position of the mouse cursor, or the moving distance can be shortened, thereby improving operability. The vicinity of the icon may be a position partially overlapping with the icon, a position in contact with the icon, or a position distant from the icon.

A computer program according to the present embodiment provides a computer with a process of displaying a plurality of icons for performing a predetermined process on medical information; and a process of displaying the adjustment operation icon in the vicinity of the icon and not displaying the adjustment operation icon in the vicinity of the icons other than the one icon.

In the present embodiment, a plurality of icons for performing predetermined processing on medical information are displayed, and when an operation for one of the plurality of icons is accepted, an adjustment operation icon is displayed near the one icon, The adjustment operation icon is not displayed in the vicinity of the icons other than the one icon. For example, when the user selects one of a plurality of icons, the adjustment operation icon is displayed near the selected icon, but the adjustment operation icon is displayed near the other unselected icons. is not displayed. As a result, it is possible to selectively display the adjustment operation icon, and it is not necessary to display the adjustment operation icon for each of the plurality of icons, so that the operation display area can be reduced.

A computer program according to the present embodiment is a computer program for causing a computer to display medical information on a display screen. A process of accepting an operation to select a desired location in the displayed medical information, a process of acquiring a pixel value at the location of the medical information when the selection operation is accepted, and an acceptance of an operation on the icon. If so, a process for accepting the predetermined process is executed so that the value set as the pixel value is changed.

A display device according to the present embodiment is a display device that displays medical information on a display screen, and includes a display processing unit that displays an icon for performing predetermined processing on the medical information, and a selection operation reception unit that receives an operation to select a desired portion of the medical information, an acquisition unit that acquires a pixel value at the location of the medical information when the selection operation is received, and an operation on the icon and an adjustment operation reception unit that receives the predetermined processing so that the value set as the pixel value is changed.

A display method according to the present embodiment is a display method for displaying medical information on a display screen, in which an icon for performing predetermined processing on medical information is displayed, and a desired portion in the medical information displayed on the display screen is displayed. is received, and when the operation to select is received, the pixel value at the location of the medical information is acquired, and when the operation on the icon is received, the value set as the pixel value is changed. , the predetermined process is accepted.

In the present embodiment, when an operation to select a desired portion in the medical information displayed on the display screen is accepted, the pixel value assigned to the signal value corresponding to the pixel corresponding to the portion of the medical information is obtained. . The medical information may be, for example, a VR (volume rendering) image, and the pixel values may be, for example, RGB values assigned to the original signal values represented by the pixels of interest when adjusting the color map, or It can be opacity, original signal value, etc. Generally, RGB values and opacity define the correspondence between all signal values, RGB values and opacity by setting desired RGB values and opacity to signal values that are one or more control points. For signal values other than control points, RGB values and opacity values interpolated by a predetermined procedure are set.

In this embodiment, an icon for performing a predetermined process on a portion of medical information is displayed, and when an operation on the icon is received, the predetermined process is received so that the value set as the pixel value is changed. For example, an icon for performing a predetermined process on a portion of medical information is displayed, and when an operation on the icon is received, the value set as the pixel value is changed. Accepts adjustment operations for different throughput. The predetermined processing can be, for example, processing related to color map adjustment (eg, adjustment of RGB values, opacity, signal values, etc.).

In the present embodiment, the configuration described above enables intuitive selection of a portion whose pixel value is to be adjusted on the medical information. In addition, by simply selecting a desired location on the medical information, for example, the pixel value can be adjusted at the position of the displayed icon, so the operation time can be shortened and the operability can be improved.

A computer program according to the present embodiment causes a computer to execute processing for displaying the acquired pixel values.

In this embodiment, the acquired pixel values are displayed. By simply selecting a desired portion on the image, the pixel value of the selected portion can be displayed, so that it is possible to intuitively judge how the displayed pixel value should be adjusted while looking at the image. and improve operability.

A computer program according to the present embodiment causes a computer to execute a process of displaying a pixel value corresponding to the adjustment operation when the adjustment operation of the pixel value is received.

In the present embodiment, when a pixel value adjustment operation is received, the pixel value corresponding to the adjustment operation is displayed. Therefore, the user can intuitively determine the pixel value adjustment result while viewing the image, thereby improving operability. improves.

A computer program according to the present embodiment causes a computer to change the display mode of the icon according to the adjustment operation when the adjustment operation of the pixel value is received.

In the present embodiment, when a pixel value adjustment operation is received, the icon display mode is changed according to the adjustment operation. The icon display mode includes, for example, icon shape, size, color, and the like. As a result, the adjustment result can be visually determined, and the pixel value can be easily adjusted.

10 information processing device 20 server 21 control unit 22 storage unit 23 communication unit 50 display device 51 display screen 52 display processing unit 53 operation input unit 54 communication unit 55 storage unit 521 allocation processing unit 522 predetermined processing unit 523 menu display processing unit 526 CPU
527 ROMs
528 RAM
529 recording medium reader

Claims (21)

A computer program for causing a computer to display medical information on a display screen,
to the computer,
a process of assigning a different first predetermined process to each of the plurality of first specific operations;
a process of assigning a different second predetermined process to each of the plurality of second specific operations for each of a plurality of pieces of medical information of different types;
When one specific operation among the plurality of first specific operations is performed on the medical information displayed on the display screen, the second predetermined processing different corresponding to the type of the medical information is performed. a process of displaying a selection menu to select ;
a second predetermined process assigned to the medical information and one specific operation when one of the plurality of second specific operations is performed on the medical information displayed on the display screen; When
and
The second predetermined process includes
selecting a different second predetermined process corresponding to the type of the medical information when one of the plurality of second specific operations is performed on the medical information displayed on the display screen; A computer program that includes a process for displaying a selection menu . to the computer,
executing a process of displaying the selection menu in or near the display area where the medical information is displayed when one of the plurality of first specific operations or the plurality of second specific operations is performed; 2. The computer program of claim 1, wherein the computer program causes to the computer,
When one specific operation among the plurality of first specific operations or the plurality of second specific operations is performed, the selection is performed in a region around a position on the display screen where the one specific operation is performed. 3. The computer program according to claim 1 , which causes execution of processing for displaying a menu. to the computer,
4. The computer according to any one of claims 1 to 3 , wherein when an operation item in the selection menu is selected, a process of displaying a sub-selection menu for selecting a predetermined process related to the operation item is executed. program. Said selection menu or said sub-selection menu comprises:
5. A computer program as claimed in claim 4 , which is transparent. to the computer,
6. The computer program according to any one of claims 1 to 5 , causing a process of allocating each of the specific operations to correspond to different movement trajectories of the pointer displayed on the display screen. to the computer,
a process of displaying an icon for performing a predetermined process on the medical information displayed on the display screen;
7. The method according to any one of claims 1 to 6 , wherein when an operation on the icon is accepted, a process of accepting an adjustment operation of a different processing amount of the predetermined process depending on a position in the icon where the operation is accepted is executed. computer program. to the computer,
8. The computer program according to claim 7 , wherein when an operation on the icon is accepted, a process of displaying an adjustment operation icon for accepting the adjustment operation is executed. to the computer,
9. The computer program according to claim 8 , causing execution of processing for displaying the adjustment operation icon in the vicinity of the icon. to the computer,
a process of displaying a plurality of icons for performing predetermined processing on medical information;
When an operation on one of the plurality of icons is accepted, the adjustment operation icon is displayed near the one icon, and the adjustment operation icon is displayed near the icons other than the one icon. 10. The computer program according to claim 8 or 9 , causing the processing not to be performed and the processing to be performed. to the computer,
a process of displaying an icon for performing a predetermined process on the medical information displayed on the display screen;
a process of accepting an operation to select a desired portion in the medical information displayed on the display screen;
a process of acquiring a pixel value at the location of the medical information when the selection operation is received;
11. The computer according to any one of claims 1 to 10 , wherein when an operation on the icon is accepted, a process of accepting the predetermined process is executed such that the value set as the pixel value is changed. program. to the computer,
12. The computer program according to claim 11 , causing a process of displaying the acquired pixel values to be executed. to the computer,
13. The computer program according to claim 11 or 12 , wherein when the pixel value adjustment operation is accepted, a process of displaying the pixel value corresponding to the adjustment operation is executed. to the computer,
14. The computer program according to any one of claims 11 to 13 , wherein, when the pixel value adjustment operation is accepted, a process of changing the display mode of the icon according to the adjustment operation is executed. A display device for displaying medical information on a display screen,
A different first predetermined process is assigned to each of a plurality of first specific operations, and a different second predetermined process is assigned to each of a plurality of second specific operations for each of a plurality of medical information of different types. an allocation processing unit;
When one specific operation among the plurality of first specific operations is performed on the medical information displayed on the display screen, the second predetermined processing different corresponding to the type of the medical information is performed. a menu display processing unit that displays a selection menu to be selected ;
a second predetermined process assigned to the medical information and one specific operation when one of the plurality of second specific operations is performed on the medical information displayed on the display screen; A predetermined processing unit that performs
with
The second predetermined process includes
selecting a different second predetermined process corresponding to the type of the medical information when one of the plurality of second specific operations is performed on the medical information displayed on the display screen; A display device that includes processing to display a selection menu . a display processing unit that displays an icon for performing predetermined processing on the medical information displayed on the display screen;
16. The display device according to claim 15 , further comprising: an adjustment operation receiving unit that receives an adjustment operation of a different processing amount of the predetermined process depending on a position within the icon at which the operation is received when the operation on the icon is received. a display processing unit that displays an icon for performing predetermined processing on the medical information displayed on the display screen;
a selection operation reception unit that receives an operation of selecting a desired portion in the medical information displayed on the display screen;
an acquisition unit that acquires a pixel value at the location of the medical information when the selection operation is received;
17. The display device according to claim 15 , further comprising an adjustment operation reception unit that receives the predetermined processing so that, when an operation on the icon is received, the value set as the pixel value is changed. A display system comprising: the display device according to any one of claims 15 to 17 ; and a server connected to the display device and having a storage unit for storing medical information. A display method for displaying medical information on a display screen, comprising:
an assignment processing unit assigning a different first predetermined process to each of the plurality of first specific operations;
the assignment processing unit assigning a different second predetermined process to each of a plurality of second specific operations for each of a plurality of pieces of medical information of different types;
When one specific operation among the plurality of first specific operations is performed on the medical information displayed on the display screen, the second predetermined processing different corresponding to the type of the medical information is performed. The menu display processing unit displays the selection menu to be selected ,
a second predetermined process assigned to the medical information and one specific operation when one of the plurality of second specific operations is performed on the medical information displayed on the display screen; is performed by the predetermined processing unit,
The second predetermined process includes
selecting a different second predetermined process corresponding to the type of the medical information when one of the plurality of second specific operations is performed on the medical information displayed on the display screen; A display method that includes processing to display the selection menu . a display processing unit displaying an icon for performing predetermined processing on the medical information displayed on the display screen;
20. The display method according to claim 19 , wherein when an operation on the icon is accepted, an adjustment operation accepting unit accepts an adjustment operation of a different processing amount of the predetermined process depending on a position within the icon where the operation is accepted. a display processing unit displaying an icon for performing predetermined processing on the medical information displayed on the display screen;
a selection operation receiving unit receiving an operation for selecting a desired portion in the medical information displayed on the display screen;
when the operation to select is accepted, an acquisition unit acquires a pixel value at the location of the medical information;
21. The display method according to claim 19 or 20 , wherein when an operation on said icon is accepted, an adjustment operation accepting unit accepts said predetermined processing such that the value set as said pixel value is changed.

Images