JP2020177482A - Medical information processing apparatus, and medical information processing method - Google Patents

Abstract

To allow an operator to easily carry out multilateral review from multilateral standpoints by using various kinds of medical care data.SOLUTION: A medical information processing apparatus according to an embodiment of the present invention has a display control unit, and a changing unit. The display control unit arranges various kinds of medical care data in a virtual space having plural dimensions and displays the plurality of medical care data within a visual range on the virtual space on a display screen. The changing unit displays at least one medical care data of the plurality of medical care data so as to keep it within the screen, and changes the visual range in the virtual space so as to change display of other medical care data on the screen. Thus, the display of the medical care data on the screen is changed.SELECTED DRAWING: Figure 3

Description

Embodiments of the present invention relate to a medical information processing device and a medical information processing method.

In recent years, with the advancement of medical technology, the types and numbers of medical data collected in daily medical care have increased, and the method for doctors to refer to medical data to determine diagnosis and treatment policy has become complicated. .. For this reason, in the medical field, a system that displays various medical data necessary for a doctor to examine a diagnosis and a treatment policy is desired on one screen.

Special Table 2017-537368 JP-A-2017-042592 Special Table 2018-509689

An object to be solved by the present invention is to enable an operator to easily perform a multifaceted study using various medical data.

The medical information processing device according to the embodiment includes a display control unit and a change unit. The display control unit arranges various medical care data in a virtual space having a plurality of dimensions, and displays a plurality of medical care data within the visual field range on the virtual space on a display screen. The changing unit in the virtual space so as to change the display of other medical data on the screen while displaying at least one medical data of the plurality of medical data so as not to deviate from the screen. By changing the visual field range with, the display of medical data on the screen is changed.

FIG. 1 is a diagram showing a configuration example of a medical information processing device according to the first embodiment. FIG. 2 is a diagram showing an example of display of medical data performed by the display control function according to the first embodiment. FIG. 3 is a diagram showing an example of changing the display of medical data performed by the changing function according to the first embodiment. FIG. 4 is a diagram showing another example of changing the display of medical data performed by the changing function according to the first embodiment. FIG. 5 is a diagram showing another example of changing the display of medical data performed by the changing function according to the first embodiment. FIG. 6 is a diagram showing another example of changing the display of medical data performed by the changing function according to the first embodiment. FIG. 7 is a diagram showing another example of changing the display of medical data performed by the changing function according to the first embodiment. FIG. 8 is a flowchart showing a processing procedure of processing realized by each processing function of the processing circuit according to the first embodiment. FIG. 9 is a diagram showing an outline of display of medical data performed by the medical information processing apparatus according to the second embodiment. FIG. 10 is a diagram showing an example of classification of a panel of medical care data according to the second embodiment. FIG. 11 is a diagram showing an example of coordinates assigned to each medical data panel by the display control function according to the second embodiment. FIG. 12 is a diagram showing an example of the expansion conversion performed by the change function according to the second embodiment. FIG. 13 is a diagram showing another example of the expansion conversion performed by the change function according to the second embodiment. FIG. 14 is a diagram showing an example of reduction conversion performed by the change function according to the second embodiment. FIG. 15 is a diagram showing another example of reduction conversion performed by the change function according to the second embodiment. FIG. 16 is a diagram showing an example of rotation conversion performed by the change function according to the second embodiment. FIG. 17 is a diagram showing another example of the rotation conversion performed by the change function according to the second embodiment. FIG. 18 is a diagram showing an example of a translation transformation performed by the change function according to the second embodiment. FIG. 19 is a diagram showing another example of the translation transformation performed by the change function according to the second embodiment.

Hereinafter, embodiments of the medical information processing apparatus and the medical information processing method will be described in detail with reference to the drawings.

(First Embodiment)
FIG. 1 is a diagram showing a configuration example of a medical information processing device according to the first embodiment.

For example, as shown in FIG. 1, the medical information processing apparatus 100 according to the present embodiment is communicably connected to an electronic medical record system 300, a radiation department system 400, a sample testing system 500, etc. via a network 200. .. For example, the medical information processing apparatus 100 and each system are installed in a hospital or the like and are connected to each other by a network 200 such as an in-hospital LAN (Local Area Network).

The electronic medical record system 300 generates medical data related to prescriptions and nursing records performed on the subject and stores them in a storage circuit in the system. Then, the electronic medical record system 300 transmits the medical data stored in the storage circuit to the medical information processing device 100 in response to the request from the medical information processing device 100.

The radiation department system 400 generates medical data related to vitals and imaging tests performed on a subject and stores them in a storage circuit in the system. The image inspection referred to here includes an inspection using a CT image taken by an X-ray CT (Computed Tomography) device, an inspection using an MR image taken by an MRI (Magnetic Resonance Imaging) device, and an ultrasonic diagnostic apparatus. This includes an inspection using an ultrasonic image taken by an X-ray diagnostic apparatus, an inspection using an X-ray image taken by an X-ray diagnostic apparatus, and the like. For example, the radiation department system 400 includes a PACS (Picture Archiving and Communication System) and the like, and is in a format compliant with DICOM (Digital Imaging and Communications in Medicine), and is a CT image, MR image, ultrasonic image, X-ray image. Store medical images such as in the database. Then, the radiation department system 400 transmits the medical data stored in the storage circuit to the medical information processing device 100 in response to the request from the medical information processing device 100.

The sample test system 500 generates medical data related to the sample test performed on the subject and stores it in a storage circuit in the system. Then, the sample test system 500 transmits the medical data stored in the storage circuit to the medical information processing device 100 in response to the request from the medical information processing device 100.

The medical information processing apparatus 100 acquires various medical data from the electronic medical record system 300, the radiation department system 400, and the sample testing system 500 via the network 200, and performs various information processing using the acquired medical data. For example, the medical information processing apparatus 100 is realized by a computer device such as a workstation, a personal computer, or a tablet terminal.

Specifically, the medical information processing apparatus 100 has a NW (network) interface 110, a storage circuit 120, an input interface 130, a display 140, and a processing circuit 150.

The NW interface 110 is connected to the processing circuit 150 and controls the transmission and communication of various data performed between the medical information processing apparatus 100 and each system. Specifically, the NW interface 110 receives medical care data from each system and outputs the received medical care data to the processing circuit 150. For example, the NW interface 110 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

The storage circuit 120 is connected to the processing circuit 150 and stores various data. Specifically, the storage circuit 120 stores medical care data received from each system. For example, the storage circuit 120 is realized by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, a hard disk, an optical disk, or the like. The storage circuit 120 is an example of a storage unit.

The input interface 130 is connected to the processing circuit 150 and receives various instructions and various information input operations from the operator. Specifically, the input interface 130 converts the input operation received from the operator into an electric signal and outputs it to the processing circuit 150. For example, the input interface 130 includes a trackball, a switch button, a mouse, a keyboard, a touch pad for performing input operations by touching an operation surface, a touch screen in which a display screen and a touch pad are integrated, and a non-optical sensor. It is realized by a contact input circuit, a voice input circuit, and the like. In the present specification, the input interface 130 is not limited to the one provided with physical operating parts such as a mouse and a keyboard. For example, an example of the input interface 130 includes an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the device and outputs the electric signal to a control circuit.

The display 140 is connected to the processing circuit 150 and displays various information and various images. Specifically, the display 140 converts various information and various image data sent from the processing circuit 150 into electrical signals for display and outputs the data. For example, the display 140 is realized by a liquid crystal monitor, a CRT (Cathode Ray Tube) monitor, a touch panel, or the like.

The processing circuit 150 controls the components of the medical information processing apparatus 100 in response to an input operation received from the operator via the input interface 130. Specifically, the processing circuit 150 stores the medical care data output from the NW interface 110 in the storage circuit 120. Further, the processing circuit 150 reads out medical data from the storage circuit 120 and displays it on the display 140.

The overall configuration of the medical information processing apparatus 100 according to the present embodiment has been described above. Under such a configuration, the medical information processing apparatus 100 according to the present embodiment displays various medical data generated by the electronic medical record system 300, the radiation department system 400, and the sample examination system 500 on one screen. It has a function. The medical information processing device 100 according to the present embodiment is configured so that the operator can easily perform a multifaceted examination using various medical data.

Specifically, in the present embodiment, a display device for VR (Virtual Reality), MR (Mixed Reality) or AR (Augmented Reality) is used as the display 140. For example, the display 140 is realized by a head mounted display (HMD), goggles for VR, MR or AR, a high resolution display such as an 8K monitor, and the like.

Further, in the present embodiment, an input device for VR, MR or AR is used as the input interface 130. For example, the input interface 130 is realized by an operation sensor that detects the operation of the operator, a line-of-sight sensor that detects the line of sight of the operator, a controller for VR, MR, or AR that accepts the operation of the operator.

Then, in the present embodiment, the processing circuit 150 has an acquisition function 151, a display control function 152, and a change function 153.

The acquisition function 151 acquires various medical data from the electronic medical record system 300, the radiation department system 400, and the sample testing system 500 via the network 200.

Specifically, the acquisition function 151 acquires various medical data regarding the subject to be diagnosed designated by the operator from each system, and stores the acquired medical data in the storage circuit 120. Here, the acquisition function 151 may store the medical care data acquired from each system in the storage circuit 120 as it is, or may store it in an appropriately normalized format.

The display control function 152 arranges various medical care data in a virtual space having a plurality of dimensions, and displays a plurality of medical care data within the visual field range on the virtual space on the screen of the display 140.

Specifically, the display control function 152 reads various medical care data acquired from each system by the acquisition function 151 from the storage circuit 120, and arranges the read medical care data in a predetermined virtual space. Then, the display control function 152 displays medical data that falls within a predetermined visual field range on the virtual space on the screen of the display 140.

In the present embodiment, the display control function 152 has a plurality of panels displaying the contents of medical data in a virtual space having two dimensions of up and down and left and right, or a virtual space having three dimensions of up and down, left and right, and front and back. Is arranged, and medical data that falls within the visual field range in the virtual space is displayed on the screen of the display 140.

FIG. 2 is a diagram showing an example of display of medical data performed by the display control function 152 according to the first embodiment.

For example, as shown in FIG. 2, the display control function 152 arranges a timeline panel 2 in the virtual space 1 that shows the occurrence timing of each medical event for a plurality of medical data in chronological order. Further, the display control function 152 has a panel 4 of image data corresponding to the attention range 3 designated on the timeline by the operator, a panel 5 of medication data, and nursing record data under the panel 2 of the timeline. Panels 6 are arranged side by side in order from left to right. Here, the timeline, image data, medication data, and nursing record data are examples of medical data. Then, the display control function 152 displays the panel within the visual field range 7 on the screen of the display 140 among the plurality of panels arranged in the virtual space 1.

The change function 153 changes the display of other medical data on the screen while displaying at least one of the medical data displayed on the screen of the display 140 so as not to deviate from the screen. In addition, the display of medical data on the screen is changed by changing the visual field range in the virtual space.

Specifically, the change function 153 receives a change instruction by the operator's action, line of sight, or operation, and changes the display of medical data on the screen according to the received change instruction. At this time, for example, the change function 153 has an operation in which the operator turns the neck in a predetermined direction (horizontal direction, vertical direction, etc.) and an operation in which the operator moves in a predetermined direction (front-back direction, horizontal direction, etc.) as a change instruction. , The operator has moved to a certain position or angle of medical care data that he / she wants to see in the virtual space, and the operator has been keeping an eye on a predetermined position on the screen (icon, panel position, etc. on the screen) for a certain period of time. Accepts that the operator flicks the line of sight in a predetermined direction (vertical direction, horizontal direction, etc.).

For example, the change function 153 is a change instruction by the operation of the operator detected by the motion sensor used as the input interface 130, the line of sight of the operator detected by the line-of-sight sensor, or the operation of the operator received by the controller. Is accepted, and the display of medical data on the screen is changed according to the received change instruction.

FIG. 3 is a diagram showing an example of a display change of medical data performed by the change function 153 according to the first embodiment.

Here, as shown in FIG. 2, a timeline panel is arranged in the virtual space, and below that, as medical data corresponding to the attention range specified on the timeline, an image data panel and medication data Etc. and the nursing record data panel are arranged in order from left to right. Further, here, it is assumed that the HMD is used as the display 140.

Then, for example, as shown in FIG. 3A, a part of the medical data arranged in the virtual space including the attention range of the timeline panel and the image data panel as the panel within the visual field range. And the panel of the medication data and the like are displayed on the screen 8 of the display 140.

In this case, for example, the change function 153 accepts the operation of the operator O turning his / her neck left and right as a change instruction. Then, the change function 153 moves left and right in a state where the image data panel, the medication data panel, and the nursing record data panel are arranged side by side in the left-right direction on the screen 8 in response to the received change instruction. As such, change the viewing range in the virtual space. Then, at this time, the change function 153 keeps the panel of the timeline within the field of view so that the attention range 3 designated on the timeline does not deviate from the screen 8.

For example, as shown in FIG. 3B, the change function 153 displays an image data panel, medication data, etc. on the screen 8 when the operator O performs an operation of turning the neck from left to right. And the panel of nursing record data are moved to the left. At this time, the change function 153 keeps the position of the timeline panel fixed on the screen 8 so that the attention range 3 designated on the timeline does not deviate from the screen 8.

Then, for example, as shown in FIG. 3C, when the operator O continues the operation of turning the neck from left to right, the change function 153 displays the image data panel on the screen 8. The panel of the medication data and the like and the panel of the nursing record data are further moved to the left so that the panel of the medication data and the panel of the nursing record data are displayed on the screen 8. Also at this time, the change function 153 keeps the position of the timeline panel fixed on the screen 8 so that the attention range 3 designated on the timeline does not deviate from the screen 8.

FIG. 4 is a diagram showing another example of changing the display of medical data performed by the change function 153 according to the first embodiment.

Here, it is assumed that a panel of the timeline is arranged in the virtual space, and a panel showing the change over time of the sample test data in the period indicated on the timeline is arranged below the panel.

Then, for example, as shown in (a) of FIG. 4, among the medical care data arranged in the virtual space, a part including the left end of the timeline panel and the sample test data panel are used as panels that enter the visual field range. It is assumed that a part including the left end of the display 140 is displayed on the screen 8 of the display 140.

In this case, for example, the change function 153 keeps the operator O gazing at either of the icons 9 and 10 arranged on the left side and the right side of the screen 8 for a certain period of time based on the line of sight of the operator O. Accept that as a change instruction. Then, the change function 153 changes the visual field range in the virtual space so that the panel of the sample test data moves left and right on the screen 8 in response to the received change instruction. Then, at this time, the change function 153 keeps the timeline panel within the field of view so as not to deviate from the screen 8.

For example, as shown in FIG. 4B, the change function 153 moves the sample test data panel to the left on the screen 8 when the operator O gazes at the icon 10 on the right side for a certain period of time. .. At this time, the change function 153 keeps the position of the timeline panel fixed on the screen 8 so as not to deviate from the screen 8.

Then, for example, as shown in FIG. 4 (c), when the operator O continues to pay attention to the icon 10 on the right side, the change function 153 further displays the sample test data panel on the screen 8. Move it to the left so that the part including the right end of the sample test data panel is displayed. Also at this time, the change function 153 keeps the position of the timeline panel fixed on the screen 8 so as not to deviate from the screen 8.

FIG. 5 is a diagram showing another example of changing the display of medical data performed by the change function 153 according to the first embodiment.

Here, as in the example shown in FIG. 4, a timeline panel is arranged in the virtual space, and a sample test data panel whose size in the left-right direction is larger than the timeline panel is arranged below the timeline panel. Suppose.

Then, for example, as shown in FIG. 5 (a), among the medical care data arranged in the virtual space, a part including the left end of the timeline panel and the sample test data panel are used as panels that enter the visual field range. It is assumed that a part including the left end of the display 140 is displayed on the screen 8 of the display 140.

In this case, for example, the change function 153 receives a change instruction by the line of sight and operation of the operator O. For example, when the change function 153 detects that the operator O has been gazing at one of the panels displayed on the screen 8 for a certain period of time, the display of the panel that has been continuously watched is changed. Identify as. Further, the change function 153 changes the field of view in the virtual space so that the panel specified as the target of the display change moves left and right on the screen 8 in response to the operation of the operator O. Then, at this time, the change function 153 keeps the panel not specified as the target of the display change within the field of view so as not to deviate from the screen 8.

For example, as shown in FIG. 5A, when the operator O keeps watching the sample test data panel displayed on the screen 8 for a certain period of time, the change function 153 changes the sample test data. Specify the panel as the target of the display change.

After that, for example, as shown in FIG. 5B, the change function 153 is specified as a display change target on the screen 8 when the operator performs an operation of instructing the left side with the controller 11. Move the sample test data panel to the left. At this time, the change function 153 keeps the position of the timeline panel fixed on the screen 8 so as not to deviate from the screen 8.

Then, for example, as shown in FIG. 5C, when the operator O continues the operation of instructing the left with the controller 11, the change function 153 displays the sample test data panel on the screen 8. Move it further to the left so that the part including the right end of the sample test data panel is displayed. Also at this time, the change function 153 keeps the position of the timeline panel fixed on the screen 8 so as not to deviate from the screen 8.

In the above-mentioned example, as an example of changing the display of medical data, an example of moving the panel of medical data specified as the target of the display change to the left or right has been described, but this is the method of changing the display of medical data. Not limited to. For example, the contents of the panel of medical data specified as the target of display change may be switched.

FIG. 6 is a diagram showing another example of changing the display of medical data performed by the change function 153 according to the first embodiment.

For example, as shown in FIG. 6A, among the medical data arranged in the virtual space, the panel of the timeline and the sample test data in the period shown on the timeline are used as the panel within the visual field range. It is assumed that a panel showing a change over time is arranged. Here, the panel of sample test data shows the contents related to the sample test data of three types A, B, and C, and further, three icons showing the types of sample test data shown on the panel. It is assumed that 12 is displayed.

In this case, for example, the change function 153 accepts the operation of the operator O flicking the line of sight in the vertical direction as a change instruction. Then, the change function 153 switches the content shown on the sample test data panel on the screen 8 in response to the received change instruction.

For example, as shown in FIG. 6B, the change function 153 changes the contents of the sample test data panel from the contents showing all three types when the operator O flicks the line of sight upward once. Switch to the content showing only type A. Then, for example, as shown in FIG. 6 (c), the change function 153 changes the contents of the sample test data panel to only the type A when the operator O flicks the line of sight upward once more. Switch from the content shown to the content showing only type B.

Similarly, for example, as shown in FIG. 6D, the change function 153 changes the contents of the sample test data panel only for type B when the operator O flicks the line of sight upward once more. The content indicating only type C is switched from the content indicating. Then, for example, as shown in FIG. 6A, the change function 153 changes the contents of the sample test data panel only to the type C when the operator O flicks the line of sight upward once more. Switch from the content shown to the content showing all three types.

In this example, the change instruction received by the change function 153 from the operator is not limited to the flick of the line of sight. For example, the change function 153 switches the contents shown on the sample test data panel according to the action of the operator O flicking the neck up and down, the action of making a strong blink, the action of winking, and the like. You may.

Alternatively, for example, the change function 153 gazes at any one of the three icons 12 indicating the type of sample test data displayed on the panel by the operator O based on the line of sight of the operator O for a certain period of time. When it is detected that the data has been continuously monitored, the sample test data of the type indicated by the icon that has been continuously watched may be displayed on the panel.

Further, as another example of changing the display of medical data, for example, the change function 153 provides medical data when the medical data to be changed is represented in time series like a timeline. The time scale of may be expanded or contracted.

FIG. 7 is a diagram showing another example of changing the display of medical data performed by the change function 153 according to the first embodiment.

Here, as an example, an example in which the timeline panel is the target of the display change will be described. For example, as shown in FIG. 7A, it is assumed that a timeline panel showing the period from April 2016 to August 2016 is displayed on the screen of the display 140. Further, here, it is assumed that the HMD is used as the display 140.

In this case, for example, the change function 153 accepts the operation of the operator O moving in the front-rear direction as a change instruction. Then, the change function 153 changes the time scale of the panel of the timeline according to the received change instruction.

For example, as shown in FIG. 7B, the change function 153 changes the time scale of the timeline panel from the period from April 2016 to August 2016 when the operator O moves forward. The period will be changed from April 1, 2016 to April 30, 2016. That is, the change function 153 reduces the time scale of the timeline panel when the operator O moves forward.

On the other hand, the change function 153 changes the time scale of the timeline panel from April 1, 2016 to April 30, 2016 to April 2016 when the operator O moves backward. ~ Change to the period of August 2016. That is, the change function 153 expands the time scale of the panel of the timeline when the operator O moves backward.

The processing functions of the processing circuit 150 have been described above. Here, for example, the processing circuit 150 is realized by a processor. In this case, the processing function of the processing circuit 150 is stored in the storage circuit 120 in the form of a program that can be executed by a computer. Then, the processing circuit 150 realizes a function corresponding to each program by reading each program from the storage circuit 120 and executing the program. In other words, the processing circuit 150 in the state where each program is read has each function shown in the processing circuit 150 of FIG.

FIG. 8 is a flowchart showing a processing procedure of processing realized by each processing function of the processing circuit 150 according to the first embodiment.

For example, as shown in FIG. 8, when the acquisition function 151 receives a medical data display instruction from the operator (step S101, Yes), various types from the electronic medical record system 300, the radiation department system 400, and the sample inspection system 500. (Step S102). This processing is realized, for example, by the processing circuit 150 reading a predetermined program corresponding to the acquisition function 151 from the storage circuit 120 and executing it.

Subsequently, the display control function 152 arranges each medical care data acquired by the acquisition function 151 in the virtual space (step S103), and displays a plurality of medical care data within the visual field range on the virtual space on the screen of the display 140. (Step S104). This processing is realized, for example, by the processing circuit 150 reading a predetermined program corresponding to the display control function 152 from the storage circuit 120 and executing it.

After that, when the change function 153 receives a change instruction by the operator's action, line of sight, or operation (steps S105, Yes), a plurality of medical data displayed on the screen of the display 140 in response to the received change instruction. By changing the visual field range in the virtual space so as to change the display of other medical data on the screen while displaying at least one of the medical data so as not to deviate from the screen, medical treatment on the screen The data display is changed (step S106). This processing is realized, for example, by the processing circuit 150 reading a predetermined program corresponding to the change function 153 from the storage circuit 120 and executing it.

Although each processing function has been described here as being realized by a single processor, the function is realized by combining a plurality of independent processors to form a processing circuit and executing a program by each processor. It doesn't matter if it is a thing. Further, each processing function included in the processing circuit 150 may be appropriately distributed or integrated into a single or a plurality of processing circuits. Further, in the example shown in FIG. 1, a single storage circuit 120 has been described as storing a program corresponding to each processing function, but a plurality of storage circuits are distributed and arranged, and the processing circuits are individually stored. The configuration may be such that the corresponding program is read from the circuit.

As described above, in the first embodiment, the display control function 152 arranges various medical care data in a virtual space having a plurality of dimensions, and displays a plurality of medical care data within the visual field range on the virtual space 140. Display on the screen of. Then, the change function 153 displays at least one of the plurality of medical care data displayed on the screen of the display 140 so as not to deviate from the screen, and displays other medical care data on the screen. By changing the visual field range in the virtual space so as to change, the display of medical data on the screen is changed. According to such a configuration, it is possible to switch and display various other types of medical care data while displaying the medical care data that the operator is paying attention to on the screen.

Further, in the first embodiment, the change function 153 receives a change instruction by the operation, line of sight, or operation of the operator, and changes the display of medical data on the screen according to the received change instruction. With such a configuration, the operator can display the medical data more intuitively.

Therefore, according to the present embodiment, the operator can easily perform a multifaceted study using various medical data.

In the first embodiment described above, an example of preventing the timeline panel from coming off the screen has been described, but the embodiment is not limited to this. For example, the change function 153 may prevent the panel of other medical data such as image data from being removed from the screen, and may change the other panel in response to a change instruction from the operator.

Further, in the above-described first embodiment, as an example of changing the display of the medical care data, an example of moving the medical care data panel to the left or right has been described, but the embodiment is not limited to this. For example, the change function 153 may move the medical data panel up and down when a plurality of medical data panels are arranged side by side in the vertical direction in the virtual space.

Further, in the first embodiment described above, when the display control function 152 arranges a plurality of medical data in the virtual space, for example, the most important medical data is arranged at the center in the horizontal direction or the vertical direction. It may be. Alternatively, the display control function 152 may arrange the medical care data having the highest importance under the attention range set on the timeline. Alternatively, the display control function 152 may display medical data indicating a summary of each medical data on the plurality of medical data.

Further, in the above-described first embodiment, an example in which the medical care data is moved in the direction instructed by the operator has been described, but the embodiment is not limited to this. For example, the change function 153 may automatically flow and display a plurality of medical care data to be displayed in the direction in which the medical care data are arranged.

Further, in the first embodiment described above, when the display control function 152 displays the medical care data on the display 140, the medical care data may be displayed on the actual image. In that case, for example, the display control function 152 detects the position of the target site or the subject by a camera, a sensor, or the like, and displays the medical data near the detected image of the target site or the subject. As a result, the operator can examine the diagnosis and treatment policy based on the medical data while observing the target site and the subject.

Further, in the first embodiment described above, an example of switching the contents of the sample test data panel according to the action of flicking the line of sight has been described, but the embodiment is not limited to this. For example, the change function 153 may switch the image data panel to turn pages according to the action of flicking the line of sight. Further, in such a case, the change instruction received from the operator is not limited to the flick of the line of sight, and may be, for example, an operation in which the operator scrolls with a mouse or the like.

Further, in the above-described first embodiment, an example in which the time scale of the medical data represented in time series is enlarged or reduced according to the operation of the operator O moving in the front-rear direction has been described. The form is not limited to this. For example, the change function 153 may switch and display the image data captured in time series and the report data created in time series in chronological order according to the operation of the operator O moving in the front-back direction. Good.

(Second Embodiment)
Further, in the above-described first embodiment, an example of arranging medical data in a virtual space having two dimensions of up / down and left / right, or a virtual space having three dimensions of up / down, left / right, and front / back has been described. However, the embodiment is not limited to this.

For example, the classification of medical care data may be assigned to the dimension of the virtual space, and various medical care data may be arranged in the virtual space according to each classification. Hereinafter, an example of such a case will be described as a second embodiment. In the second embodiment, the points different from the first embodiment described above will be mainly described, and detailed description of the points common to the first embodiment will be omitted.

FIG. 9 is a diagram showing an outline of display of medical data performed by the medical information processing apparatus 100 according to the second embodiment.

For example, as shown in FIG. 2, in the present embodiment, the display control function 152 arranges various medical care data according to each classification in a virtual space having a plurality of dimensions indicating the classification of medical care data. Here, the classification of medical care data is the width, time, and depth of medical care data. In this embodiment, such a virtual space is referred to as a “medical data space”.

Then, in the present embodiment, the change function 153 performs spatial conversion on the medical data space with reference to the designated conversion reference point, so that at least one medical data out of the plurality of medical data is displayed on the screen. The display of medical data on the screen is changed by changing the visual field range so as to change the display of other medical data on the screen while displaying so as not to deviate from.

Hereinafter, the processing performed by the acquisition function 151, the display control function 152, and the change function 153 according to the present embodiment will be described in detail. Further, in the present embodiment, an example in which the subject is a patient will be described.

First, the acquisition function 151 acquires various medical data from the electronic medical record system 300, the radiation department system 400, and the sample testing system 500 via the network 200. For example, the acquisition function 151 acquires medical information such as patient information, order information, order execution information, image examination information, and various measurement information as medical data.

Then, the acquisition function 151 stores the medical care data acquired from each system in the integrated medical care DB (Data Base) constructed by the storage circuit 120. Here, the acquisition function 151 may store the medical care data acquired from each system in the integrated medical care DB in the same format as it is, or may store it in an appropriately normalized format.

For example, the integrated medical care DB stores medication data and medication summary data as data based on order information or order execution information. The medication data is medical data regarding the medication given to the patient. The medication summary data is medical data relating to a medication summary that summarizes the medications given to the patient at multiple time points. In addition to the medication data and the medication summary data, the medical data based on the order information or the order implementation information includes, for example, medical data related to various orders such as images, meals, rehabilitation, surgery, intravascular treatment, and radiotherapy. Medical data relating to the implementation of the various orders may be used.

Further, for example, the integrated medical care DB stores image data, image measurement value data, and image interpretation report data as medical care data based on image inspection information. The image data is medical data related to an image of a patient. The image measurement value data is medical data related to the measurement value measured based on the image of the patient. The interpretation report data is medical data related to the interpretation report created based on the image of the patient. The images referred to here are medical image diagnostic devices 600 (for example, various medical image diagnostic devices such as an X-ray diagnostic device, an X-ray CT device, an MRI device, an ultrasonic diagnostic device, a SPECT device, and a PET device, and a SPECT device. It is a medical image taken by a SPECT-CT device in which an X-ray CT device is integrated, a PET-CT device in which a PET device and an X-ray CT device are integrated, or a group of these devices, etc.).

Further, for example, the integrated medical care DB has, as medical care data based on various measurement information, electrocardiogram data, electrocardiogram measurement value data, electrocardiogram data, vital data, vital summary data, nursing record data, sample test data, sample test summary data, and Store sample test report data. The electrocardiogram data is medical data related to the patient's electrocardiogram measured by the examination. The electrocardiogram measurement value data is medical data related to the measurement value measured based on the patient's electrocardiogram. The electrocardiogram report data is medical data related to an electrocardiogram report created based on the patient's electrocardiogram. Vital data is medical data related to a patient's vitals (for example, blood pressure, pulse, body temperature, etc.) measured by a test. Vital summary data is medical data related to vital summaries that summarizes vitals measured from patients at multiple time points. Nursing record data is medical data related to nursing records created based on the patient's vitals. The sample test data is medical data related to a patient's sample test (for example, a test for uric acid (UA), total protein (TP), etc.). The sample test summary data is medical data related to a sample test summary that summarizes sample tests performed on a patient at a plurality of time points. The sample test report data is medical data related to the sample test report created based on the sample test of the patient.

Here, in the present embodiment, for each of the above-mentioned medical care data, a panel showing the medical care data in a data display format suitable for viewing is defined. Here, the data display format is, for example, a table format, a time series format, an image display format, an electrocardiogram display format, a report display format, or the like. Then, in the present embodiment, the panel defined for each medical data is classified from various viewpoints according to the clinical study purpose.

FIG. 10 is a diagram showing an example of classification of a panel of medical care data according to the second embodiment.

For example, as shown in the vertical direction in FIG. 10, the panel of medical data is classified into a panel related to intervention and a panel related to response. Intervention panels are further subdivided into dosing panels, and dosing panels are further subdivided by drug type. Further, the panel related to the response is further classified into a panel related to the image, a panel related to the electrocardiogram, a panel related to vitals, and a panel related to the sample test.

From another point of view, for example, as shown in the left-right direction in FIG. 10, the panel of medical care data is classified into a panel related to objective data and a panel related to subjective data. Further, the panel related to objective data is further classified into a panel related to raw data and a panel related to processed data, and a panel related to subjective data is further classified into a panel related to character data.

From yet another point of view, for example, as shown in the diagonally upward-sloping direction in FIG. 10, the panel of medical data is divided and classified for each time point in the time series.

Here, for example, the above-mentioned dosing data panel is classified as a dosing and raw data panel, as shown in the first row from the top and the first column from the left in FIG. 10, and further, at each time series time point. It is divided and classified. In addition, as shown in the first row from the top and the second column from the left in FIG. 10, the above-mentioned panel of medication summary data is classified as a panel related to medication and processing data, and is a panel summarizing medications at a plurality of time points. being classified.

Further, the above-mentioned image data panel is classified as a panel related to images and raw data as shown in the second row from the top and the first column from the left in FIG. 10, and is further divided into time-series time points. being classified. Further, the above-mentioned image measurement value data panel is classified as a panel related to image and processed data as shown in the second row from the top and the second column from the left in FIG. 10, and is divided for each time point in the time series. being classified. Further, the above-mentioned image interpretation report data panel is classified as a panel related to image and character data as shown in the second row from the top and the third column from the left in FIG. 10, and is classified according to the time series. Will be done.

Further, the above-mentioned electrocardiogram data panel is classified as a panel related to electrocardiogram and raw data as shown in the third row from the top and the first column from the left in FIG. 10, and is further divided into time-series time points. being classified. Further, the above-mentioned panel of electrocardiogram measurement value data is classified as a panel related to electrocardiogram and processed data as shown in the third row from the top and the second column from the left in FIG. 10, and is divided for each time point in the time series. being classified. Further, the above-mentioned ECG report data panel is classified as a panel related to electrocardiogram and character data as shown in the third row from the top and the third column from the left in FIG. 10, and is classified according to the time series. Will be done.

Further, the above-mentioned vital data panel is classified as a panel related to vital data and raw data as shown in the fourth row from the top and the first column from the left in FIG. 10, and further divided by time series time point. being classified. In addition, the above-mentioned vital summary data panel is classified as a panel related to vitals and processing data as shown in the fourth row from the top and the second column from the left in FIG. 10, and the measured values of vitals at a plurality of time points are summarized. It is classified as a panel. In addition, the above-mentioned nursing record data panel is classified as a panel related to vital and character data as shown in the fourth row from the top and the third column from the left in FIG. 10, and is classified according to the time series. Will be done.

Further, the above-mentioned panel of sample test data is classified as a panel related to sample test and raw data as shown in the fifth row from the top and the first column from the left in FIG. 10, and further divided by time series time point. Is classified. Further, the above-mentioned panel of sample test summary data is classified as a panel related to sample test and processed data as shown in the fifth row from the top and the second column from the left in FIG. 10, and the measurement of the sample test at a plurality of time points is performed. It is classified as a panel that summarizes the values. In addition, the above-mentioned sample test report data panel is classified as a panel related to sample test and character data as shown in the fifth row from the top and the third column from the left in FIG. 10, and is divided by time series. Is classified as.

Next, the display control function 152 has a medical care data space having three dimensions, that is, a dimension indicating the width of the medical care data, a dimension indicating the time of the medical care data, and a dimension indicating the depth of the medical care data, according to the above-mentioned classification. A panel of each medical data is placed in.

Specifically, the display control function 152 arranges each medical data panel in the medical data space by assigning coordinates on the medical data space to each medical data panel.

FIG. 11 is a diagram showing an example of coordinates assigned to each medical data panel by the display control function 152 according to the second embodiment.

For example, as shown in FIG. 11, the display control function 152 displays the coordinates (W (width), T (time)) on the medical care data space in each medical care data panel shown in FIG. 10 according to the respective classifications. , D (depth)).

For example, in the width (W) direction, coordinates are assigned to each medical data panel so that the coordinate values increase in the order of medication, image, electrocardiogram, vital, and sample test. Further, in the depth (D) direction, coordinates are assigned to each medical data panel so that the coordinate values increase in the order of raw data, processed data, and character data. Further, in the time (T) direction, the coordinates are associated with the panel of each medical treatment data so that the coordinate values increase in the order of the time series.

In this way, after arranging the panels of each medical care data stored in the integrated medical care DB in the medical care data space, the display control function 152 displays a plurality of medical care data panels within the visual field range on the medical care data space on the screen of the display 140. indicate. Specifically, the display control function 152 generates a display screen for displaying each medical care data panel based on the medical care data space, and displays the generated display screen on the display 140.

Next, the change function 153 displays at least one of the plurality of medical care data displayed on the screen of the display 140 so as not to deviate from the screen, and displays other medical care data on the screen. By changing the visual field range in the medical care data space so as to change, the display of medical care data on the screen is changed.

Specifically, the change function 153 changes the visual field range so as to change the display of other medical care data on the screen by performing spatial conversion on the medical care data space with reference to the designated conversion reference point. change. Here, the change function 153 accepts a change instruction by the operator's action, line of sight, or operation, and changes the display of medical data on the screen according to the received change instruction.

First, the change function 153 acquires the display state before spatial conversion for each medical data panel displayed on the screen of the display 140 by the display control function 152. Specifically, the change function 153 is based on the information displayed on the screen and the instruction received from the operator, and the display state before spatial conversion (which coordinates are displayed, which dimension (point, line). , Surface, etc.) is displayed). Here, the display state before the spatial conversion is indicated by a point, a line, or a plane on the medical data space. In the following, the display state before spatial conversion is referred to as "pre-conversion state".

After that, the change function 153 acquires a reference point for spatial conversion. Specifically, the change function 153 acquires a reference point for spatial conversion based on an instruction received from the operator. Here, the reference point for spatial conversion is indicated by a point, line, or plane in the medical data space. In the following, the reference point for spatial conversion will be referred to as the "conversion reference point".

Further, the change function 153 acquires the direction of the spatial conversion. Specifically, the change function 153 acquires the direction of spatial conversion based on the instruction received from the operator. In the following, the direction of spatial conversion is referred to as "conversion direction".

Then, the change function 153 performs spatial conversion. Specifically, the change function 153 displays the display state after spatial conversion (which coordinates are displayed) based on the acquired pre-conversion state, conversion reference point and conversion direction, and the coordinates assigned to each medical data. Or which dimension (point, line, surface, etc.) to display) is acquired. Here, the display state after the spatial conversion is indicated by a point, a line, or a plane on the medical data space. In the following, the display state after spatial conversion is referred to as "post-conversion state".

After that, the change function 153 displays the display screen after the spatial conversion. Specifically, the change function 153 is based on the converted state acquired by the spatial conversion by the change function 153, the panel defined for each medical data, and each medical data stored in the integrated medical DB. A display screen after spatial conversion is generated, and the generated display screen is displayed on the display 140.

As described above, as a spatial conversion, the change function 153 uses the pre-conversion state represented by a point, a line, or a plane on the medical data space as a reference with the conversion reference point specified in the pre-conversion state. Convert to the converted state indicated by a point, line or plane. Here, the conversion reference point is also indicated by a point, a line, or a plane in the medical data space.

Then, the change function 153 keeps the position on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen when the above-mentioned spatial conversion is performed.

Hereinafter, the spatial conversion and the display change of the medical data performed by the change function 153 according to the second embodiment will be described with reference to specific examples. In the following, an example will be described in which the change function 153 performs expansion, reduction, rotation, or translation in the medical data space as a spatial conversion.

FIG. 12 is a diagram showing an example of the expansion conversion performed by the change function 153 according to the second embodiment.

Here, an example of converting a point into a line display by enlarging will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 12, in a state where a plurality of medical data panels are displayed on the screen, the operator sets the pre-conversion state and the conversion reference point as (W, T, D) = (W). _a, T _a, D _a) are panels designated clinical data assigned, as the conversion direction, the expansion of the depth direction (D = *) is specified.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is in the pre-conversion state and the conversion reference. Judge that it was specified as a point. Further, for example, when the change function 153 detects an operation in which the operator O moves backward, it determines that expansion in the depth direction is specified as the conversion direction. Here, the change function 153 specifies the conversion amount of the expansion conversion according to the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 12, changing function 153, coordinates indicating the pre-conversion state _{(W A, T A, D} A) , and coordinates representing the converted state (W _A, T Convert to _A , *). This spatial conversion converts the pre-conversion state indicated by a point into the post-conversion state indicated by a line extending in the depth direction by expanding in the depth direction with reference to the conversion reference point indicated by the point. Corresponds to that.

As a result, for example, as shown in FIG. 12, before the conversion, the image data was displayed at one time point, but after the conversion, the image data, the measured value of the image, and the image interpretation were displayed at the same time point. You can switch to the state where the report is displayed. Then, when performing this spatial conversion, the change function 153 keeps the position on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

FIG. 13 is a diagram showing another example of the expansion conversion performed by the change function 153 according to the second embodiment.

Here, an example of converting a line into a surface display by enlarging will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 13, in a state where a plurality of medical data panels are displayed on the screen, the operator sets the pre-conversion state and the conversion reference point as (W, T, D) = (W). _B, *, D _B) are panels designated clinical data assigned, enlarged in the width direction (W = *) is assumed to be designated as the transducing direction.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is in the pre-conversion state and the conversion reference. Judge that it was specified as a point. Further, for example, when the change function 153 detects an operation in which the operator O moves backward, it determines that expansion in the width direction is specified as the conversion direction. Here, the change function 153 specifies the conversion amount of the expansion conversion according to the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 13, changing function 153, coordinates indicating the pre-conversion state _{(W B, *, D B} ) , and coordinates representing the converted state (*, *, D Convert to _B ). In this spatial conversion, the pre-conversion state indicated by the line extending in the time direction is expanded in the width direction with reference to the conversion reference point indicated by the line, and the conversion is indicated by the plane extending in the width direction and the time direction. Corresponds to converting to a later state.

As a result, for example, as shown in FIG. 13, before the conversion, the sample test summary data was displayed at a plurality of time points, but after the conversion, the medication summary data and the sample test were displayed at the plurality of time points. You can switch between the summary data and the vital summary data displayed. Then, when performing this spatial conversion, the change function 153 keeps the position on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

FIG. 14 is a diagram showing an example of reduction conversion performed by the change function 153 according to the second embodiment.

Here, an example of converting a line into a point display by reduction will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 14, with the panel of the plurality of medical information data is displayed on the screen, by the operator, as the state before conversion, (W, T, D) = (W C, *, D _C) is the panel specification of medical data assigned, as the conversion reference point, (W, T, D) = (W C, T C, the position is D _C) is specified, as the conversion direction, time Suppose that reduction in the direction (T = *) is specified.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is designated as the pre-conversion state. Further, it is determined that the position on the panel that has been continuously watched is designated as the conversion reference point. Further, for example, when the change function 153 detects an operation in which the operator O moves forward, it determines that reduction in the time direction is specified as the conversion direction. Here, the change function 153 specifies the conversion amount of the reduction conversion according to the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 14, changing function 153, coordinates indicating the pre-conversion state _{(W C, *, D C} ) , and coordinates representing the converted state (W _C, T _C It is converted into D _C). In this spatial conversion, the pre-conversion state indicated by a line extending in the time direction is reduced in the time direction with reference to the conversion reference point indicated by one point included in the line, and the post-conversion indicated by a point is performed. It is equivalent to converting to a state.

As a result, for example, as shown in FIG. 14, the state in which the sample test summary data was displayed at a plurality of time points before the conversion, and after the conversion, the sample at one of the plurality of time points. The measurement value of the inspection is switched to the displayed state. Then, when performing this spatial conversion, the change function 153 keeps the positions on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

FIG. 15 is a diagram showing another example of the reduction conversion performed by the change function 153 according to the second embodiment.

Here, an example of converting a surface into a line display by reduction will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 15, in a state where a plurality of medical data panels are displayed on the screen, the operator sets the pre-conversion state as (W, T, D) = (*, *, D). The panel of medical data to which _D ) is assigned is specified, the position where (W, T, D) = (*, T _D , _DD ) is specified as the conversion reference point, and the time direction (T) is specified as the conversion direction. = *) Is specified, and further, it is specified to reduce in that direction.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is designated as the pre-conversion state. Further, it is determined that the position on the panel that has been continuously watched is designated as the conversion reference point. Further, for example, when the change function 153 detects an operation in which the operator O moves forward, it determines that reduction in the time direction is specified as the conversion direction. Here, the change function 153 specifies the conversion amount of the reduction conversion according to the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 15, changing function 153, coordinates indicating the pre-conversion state (*, *, _D D) a, coordinates indicating the converted state (*, T _D, D Convert to _D ). This spatial conversion is performed by reducing the pre-conversion state indicated by a surface extending in the width direction and the time direction in the time direction with reference to a conversion reference point indicated by one line extending in the width direction included in the surface. , Corresponds to conversion to the converted state indicated by a line extending in the width direction.

As a result, for example, as shown in FIG. 15, before the conversion, the medication summary data, the sample test summary data, and the vital summary data were displayed at a plurality of time points, but after the conversion, the plurality of states are displayed. For one time point included in the time point, it is switched to a state in which the information indicating the drug, the measurement value of the sample test, and the measurement value of vitals are displayed. Then, when performing this spatial conversion, the change function 153 keeps the position on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

FIG. 16 is a diagram showing an example of rotation conversion performed by the change function 153 according to the second embodiment.

Here, an example in the case of rotationally transforming a line will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 16, in a state where a plurality of medical data panels are displayed on the screen, the operator sets the pre-conversion state as (W, T, D) = ( _WE1 , *, The panel of medical data to which _DE1 ) is assigned is specified, the position where (W, T, D) = ( _WE1 , _TE1 , _DE1 ) is specified as the conversion reference point, and the depth as the conversion direction. It is assumed that rotation in the direction (D = *) is specified.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is designated as the pre-conversion state. Further, it is determined that the position on the panel that has been continuously watched is designated as the conversion reference point. Further, for example, the change function 153 specifies rotation in the depth direction as the conversion direction when the operator O accepts the operation of rotating the object 13 in the medical data space displayed on the screen of the display 140. Judge that it was done. Alternatively, for example, when the change function 153 detects that the medical care data to be viewed in the medical care data space 14 has moved to a certain angle, the change function 153 determines that rotation in the depth direction is specified as the conversion direction. To do. Here, the change function 153 specifies the conversion amount of the rotation conversion according to the operation amount or the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 16, changing function 153, coordinates indicating the pre-conversion state _{(W E1, *, D E1} ) the coordinates indicating the converted state (W _E1, T _E1 , *). This spatial conversion extends in the depth direction by rotating the pre-conversion state indicated by a line extending in the time direction in the depth direction with reference to the conversion reference point indicated by one point included in the line. Corresponds to conversion to the converted state indicated by a line.

As a result, for example, as shown in FIG. 16, before the conversion, the image data was displayed at a plurality of time points, but after the conversion, the image data is displayed at one time point included in the plurality of time points. , The measured value of the image and the interpretation report can be switched to the displayed state. Then, when performing this spatial conversion, the change function 153 keeps the position on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

FIG. 17 is a diagram showing another example of the rotation conversion performed by the change function 153 according to the second embodiment.

Here, an example in the case of rotationally transforming a surface will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 17, in a state where a plurality of medical data panels are displayed on the screen, the operator sets the pre-conversion state as (W, T, D) = (*, *, D). The panel of medical data to which _F1 ) is assigned is specified, the position where (W, T, D) = ( _WF1 , *, D _F1 ) is specified as the conversion reference point, and the depth direction (D _F1 ) is specified as the conversion direction. It is assumed that the rotation to D = *) is specified.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is designated as the pre-conversion state. Further, it is determined that the position on the panel that has been continuously watched is designated as the conversion reference point. Further, for example, the change function 153 specifies rotation in the depth direction as the conversion direction when the operator O accepts the operation of rotating the object 13 in the medical data space displayed on the screen of the display 140. Judge that it was done. Alternatively, for example, when the change function 153 detects that the medical care data to be viewed in the medical care data space 14 has moved to a certain angle, the change function 153 determines that rotation in the depth direction is specified as the conversion direction. To do. Here, the change function 153 specifies the conversion amount of the rotation conversion according to the operation amount or the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 17, changing function 153, coordinates indicating the pre-conversion state (*, *, D _F1) and coordinates indicating the converted state (W _F1, *, * ). In this spatial conversion, the pre-conversion state indicated by a surface extending in the width direction and the time direction is rotated in the depth direction with reference to a conversion reference point indicated by one line extending in the time direction included in the surface. Corresponds to conversion to the converted state indicated by the plane extending in the time direction and the depth direction.

As a result, for example, as shown in FIG. 17, before the conversion, the measured values of the images, the sample test summary data, and the vital summary data were displayed at a plurality of time points, but after the conversion, the corresponding state is displayed. At multiple time points, the measured values of the image, the image data, and the interpretation report can be switched to the displayed state. Then, when performing this spatial conversion, the change function 153 keeps the position on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

FIG. 18 is a diagram showing an example of a translation transformation performed by the change function 153 according to the second embodiment.

Here, an example in the case of translating a line into parallel movement will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 18, in a state where a plurality of medical data panels are displayed on the screen, the operator sets the pre-conversion state and the conversion reference point as (W, T, D) = (*. , _TG , _DG ) is assigned to the panel of medical data, and the forward direction (-T) in the time direction is specified as the conversion direction.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is in the pre-conversion state and the conversion reference. Judge that it was specified as a point. Further, for example, when the change function 153 detects that the operator O has moved to the position of the medical care data to be viewed in the medical care data space 14, it determines that the forward direction in the time direction is designated as the conversion direction. Here, the change function 153 specifies the conversion amount of the translation conversion according to the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 18, the change function 153 changes the coordinates (*, _TG , _DG ) indicating the pre-conversion state to the coordinates (*, _TG −) indicating the post-conversion state. Convert to T, _DG ). In this spatial transformation, the pre-conversion state indicated by the line extending in the width direction is translated in the time direction with respect to the conversion reference point indicated by the line, and the transformation indicated by another line extending in the width direction. Corresponds to converting to a later state.

As a result, for example, as shown in FIG. 18, before the conversion, the state in which the information indicating the drug, the measured value of the sample test, and the measured value of the vital signs were displayed at one time point is displayed after the conversion. , The information indicating the drug, the measured value of the sample test, and the measured value of vitals are displayed at the other one time point. Then, when performing this spatial conversion, the change function 153 keeps the positions on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

FIG. 19 is a diagram showing another example of the translation transformation performed by the change function 153 according to the second embodiment.

Here, an example in the case of translating a surface will be described. Further, here, it is assumed that the HMD is used as the display 140.

For example, as shown on the left side of FIG. 19, a panel of medical data to which (W, T, D) = (*, *, _DH ) is assigned as a pre-conversion state and a conversion reference point is designated by the operator. And it is assumed that the rear direction (+ D) in the depth direction is specified as the conversion direction.

For example, when the change function 153 detects that the operator O has been gazing at any one of the panels displayed on the screen for a certain period of time, the panel that has been continuously watched is in the pre-conversion state and the conversion reference. Judge that it was specified as a point. Further, for example, when the change function 153 detects that the operator O has moved to the position of the medical care data to be viewed in the medical care data space 14, it determines that the rear direction in the depth direction is designated as the conversion direction. .. Here, the change function 153 specifies the conversion amount of the translation conversion according to the movement amount of the operator O.

In this case, for example, as shown on the right side of FIG. 19, changing function 153, coordinates indicating the pre-conversion state (*, *, D _H) of the coordinates indicating the converted state (*, *, D _H Convert to + D). This spatial conversion extends in the width direction and the time direction by translating the pre-conversion state indicated by the plane extending in the width direction and the time direction in the depth direction with reference to the conversion reference point indicated by the plane. It corresponds to the conversion to the converted state shown in the other surface.

As a result, for example, as shown in FIG. 19, before the conversion, the measured values of the image and the measured values of the electrocardiogram were displayed at the plurality of time points, but after the conversion, the measured values of the electrocardiogram were displayed. The image data and the image data of the electrocardiogram can be switched to the displayed state. Then, when performing this spatial conversion, the change function 153 keeps the position on the screen fixed so that the panels other than the panel designated as the conversion reference point do not deviate from the screen.

The spatial conversion performed by the change function 153 is not limited to the two-dimensional spatial conversion as described above. For example, the change function 153 may perform three-dimensional or higher spatial conversion such as expansion from a surface to a space, rotation or translation of a space, reduction from a space to a surface, and the like.

As described above, in the second embodiment, the display control function 152 arranges various medical data according to each classification in a virtual space having a plurality of dimensions indicating the classification of the medical data. According to such a configuration, for example, the display of the medical care data can be switched and displayed for each classification such as the width, time, and depth of the medical care data, and the operator can use various medical care data in various ways. You will be able to conduct examinations efficiently.

In the second embodiment described above, an example in which the width, time, and depth of the medical care data are used dimensionally in the medical care data space has been described, but the classification of the medical care data assigned to the medical care data space is classified into these. Other classifications may be used without limitation. For example, patients who are the target of medical data may be used as a classification.

Further, in the second embodiment described above, there is an operation in which the operator rotates an object in the medical care data space displayed on the screen of the display 140, and medical care data in which the operator wants to see in the medical care data space 14. Although an example of changing the display of medical data according to the operation of moving to an angle has been described, the embodiment is not limited to this.

For example, the display control function 152 arranges the medical care data semi-transparently in the virtual space displayed on the screen of the display 140, and the change function 153 reaches out for the medical care data displayed semi-transparently. When the action to be taken is performed, the medical data picked up by the operator may be clearly displayed according to the action.

Alternatively, for example, the display control function 152 may arrange a transparent board in the virtual space displayed on the screen of the display 140 and display the medical care data on the board. In that case, for example, when the operator moves forward, the change function 153 causes the next medical data to be displayed on the transparent board accordingly. Alternatively, the change function 153 zooms the medical care data displayed on the transparent board accordingly when the operator moves forward, and when the operator crosses the transparent board, the next data. May be displayed. Alternatively, the change function 153 may change the display of the medical care data according to the operation of pushing the transparent plate or the operation of pulling it out.

In the above-described embodiment, an example in which the display control unit, the reception unit, and the change unit in the present specification are realized by the display control function 152 and the change function 153 of the processing circuit 150, respectively, has been described. Is not limited to this. For example, the display control unit, the reception unit, and the change unit in the present specification are realized by the display control function 152 and the change function 153 described in the embodiment, or are only hardware or a mixture of hardware and software. It may be the one that realizes the same function.

Further, the word "processor" used in the above description means, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an integrated circuit for a specific application (Application Specific Integrated Circuit: ASIC), or a programmable logic device. (For example, it means a circuit such as a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). The processor realizes the function by reading and executing the program stored in the storage circuit 120. Instead of storing the program in the storage circuit 120, the program may be directly incorporated in the circuit of the processor. In this case, the processor realizes the function by reading and executing the program embedded in the circuit. Further, the processor of the present embodiment is not limited to the case where it is configured as a single circuit, and a plurality of independent circuits may be combined to be configured as one processor to realize its function.

Here, the program executed by the processor is provided by being incorporated in a ROM (Read Only Memory), a storage circuit, or the like in advance. This program is a file in a format that can be installed or executed on these devices, such as CD (Compact Disk) -ROM, FD (Flexible Disk), CD-R (Recordable), DVD (Digital Versatile Disk), etc. It may be recorded and provided on a computer-readable storage medium. Further, this program may be provided or distributed by being stored on a computer connected to a network such as the Internet and downloaded via the network. For example, this program is composed of modules including the above-mentioned functional parts. In actual hardware, the CPU reads a program from a storage medium such as a ROM and executes it, so that each module is loaded on the main storage device and generated on the main storage device.

According to at least one embodiment described above, the operator can easily perform a multifaceted study using various medical data.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

100 Medical information processing device 150 Processing circuit 152 Display control function 153 Change function

Claims (9)

A display control unit that arranges various medical care data in a virtual space having multiple dimensions and displays a plurality of medical care data within the visual field range on the virtual space on the screen of the display.
While displaying at least one of the plurality of medical data so as not to deviate from the screen, the visual field range is changed in the virtual space so as to change the display of other medical data on the screen. A medical information processing device including a changing unit that changes the display of medical data on the screen. The changing unit receives a change instruction by the operator's action, line of sight, or operation, and changes the display of medical data on the screen according to the received change instruction.
The medical information processing device according to claim 1. In the change unit, as the change instruction, the operation of the operator turning the neck in a predetermined direction, the operation of the operator moving in a predetermined direction, the position where the operator has medical data that he / she wants to see in the virtual space, or It accepts that it has moved to an angle, that the operator has been gazing at a predetermined position on the screen for a certain period of time, and that the operator has flicked the line of sight in a predetermined direction.
The medical information processing device according to claim 2. The virtual space has a dimension indicating the classification of the medical data.
The display control unit arranges the various medical data in the virtual space according to each classification.
The medical information processing device according to any one of claims 1 to 3. The dimension of the medical data indicates the width, time or depth of the medical data.
The medical information processing device according to claim 4. The changing unit changes the visual field range so as to change the display of the other medical data on the screen by performing spatial conversion on the virtual space with reference to a designated conversion reference point. ,
The medical information processing device according to any one of claims 1 to 5. The change unit performs enlargement, reduction, rotation, or translation in the virtual space as the space conversion.
The medical information processing device according to claim 6. As the display, a display device for VR (Virtual Reality), MR (Mixed Reality) or AR (Augmented Reality) is used.
The medical information processing device according to any one of claims 1 to 7. Various medical data are arranged in a virtual space having multiple dimensions, and a plurality of medical data within the visual field range on the virtual space are displayed on the display screen.
In the virtual space, at least one of the plurality of medical data displayed on the screen is displayed so as not to deviate from the screen, and the display of other medical data is changed on the screen. A medical information processing method including changing the display of medical data on the screen by changing the visual field range with.