JP7384231B2 - Information processing device, information processing system, medical support method and program - Google Patents

Description

The present invention relates to an information processing device, an information processing system, a medical support method, and a program.

Various medical instruments are used in surgeries in medical settings. Since it is difficult for doctors and nurses who perform surgeries (hereinafter also referred to as "medical personnel") to be familiar with all medical equipment, for example, personnel from medical equipment manufacturers (hereinafter also referred to as "support personnel") Medical personnel (called medical personnel) attend surgeries and assist medical personnel by instructing appropriate medical equipment at the necessary timing or explaining its uses. Additionally, consideration is being given to providing such support remotely.

For example, Patent Document 1 discloses a technique for sharing the details of a surgery with a remote location using images obtained from a camera installed in an operating room or worn by a doctor.

However, the conventional technology has a problem in that it places a heavy burden on medical personnel and supporters on the spot when supporting medical personnel from a distance. For example, in order for a supporter to remotely grasp the medical equipment present in an operating room, it is possible for the supporter to check while sharing an image of the medical equipment using a camera in the operating room. However, since there is a wide variety of medical equipment required for surgery, it is necessary to check and collate the medical equipment between the medical staff and the support person each time until the medical equipment is known. Performing such confirmation work while performing surgery is a heavy burden.

In view of the above-mentioned technical problems, an embodiment of the present invention aims to reduce the burden on medical personnel and supporters in the field when supporting medical personnel remotely.

In order to solve the above problems, an information processing apparatus according to an embodiment of the present invention includes a surgical information management section that stores surgical information that associates a surgical operation with a medical instrument used in the surgical operation in a storage section, and a communication control section that receives instrument information that is acquired by an acquisition device that is present in the operating room and that can identify medical instruments that are present in the operating room; The medical device identified by the procedure is compared with the medical device included in the surgical information.

According to one embodiment of the present invention, it is possible to reduce the burden on on-site medical personnel and supporters when supporting medical personnel remotely.

1 is a diagram showing an example of the overall configuration of a medical support system in a first embodiment. 1 is a diagram illustrating an example of a hardware configuration of a celestial sphere imaging device in an embodiment. FIG. It is a diagram showing an example of the hardware configuration of a smartphone in one embodiment. 1 is a diagram illustrating an example of a hardware configuration of a computer in an embodiment. FIG. 1 is a diagram illustrating an example of a functional configuration of a medical support system in a first embodiment. FIG. It is a figure showing an example of room management information. It is a figure showing an example of user management information. FIG. 3 is a diagram showing an example of device management information. FIG. 3 is a diagram showing an example of content management information. It is a figure showing an example of instrument image information. It is a figure showing an example of surgical information. It is a figure which shows an example of usage information. It is a figure showing an example of a processing procedure of a medical support method in a 1st embodiment. It is a figure which shows an example of a collation result screen. It is a figure which shows an example of a usage information screen. It is a figure showing an example of the whole composition of a medical support system in a 2nd embodiment. It is a figure showing an example of functional composition of a medical support system in a 2nd embodiment. It is a figure which shows an example of the processing procedure of the medical support method in 2nd Embodiment. It is a figure showing an example of the whole composition of a medical support system in a 3rd embodiment. It is a figure showing an example of functional composition of a medical support system in a 3rd embodiment. It is a figure which shows an example of the processing procedure of the medical support method in 3rd Embodiment. It is a figure which shows an example of a usage information screen. It is a figure showing an example of the whole composition of a medical support system in a 4th embodiment. It is a figure showing an example of functional composition of a medical support system in a 4th embodiment. It is a figure which shows an example of the processing procedure of the medical support method in 4th Embodiment. 7 is a diagram illustrating an example of a functional configuration of a medical support system in Modification 1. FIG. 7 is a diagram illustrating an example of a processing procedure of a medical support method in Modification 1. FIG. 7 is a diagram illustrating an example of a functional configuration of a medical support system in Modification 2. FIG. 7 is a diagram illustrating an example of a processing procedure of a medical support method in Modification 2. FIG. FIG. 3 is a diagram showing an example of device identification information. 7 is a diagram illustrating an example of a functional configuration of a medical support system in Modification 3. FIG. 12 is a diagram illustrating an example of a processing procedure of a medical support method in Modification 3. FIG.

Embodiments of the present invention will be described in detail below with reference to the drawings. Note that in the drawings, components having the same functions are designated by the same numbers, and redundant explanation will be omitted.

[background]
BACKGROUND OF THE INVENTION Surgery in medical settings is performed by a team including medical personnel with various roles, such as doctors and nurses. For example, nurses have a role called "instrument dispenser" who hands various medical instruments to doctors as the surgery progresses. When it comes to dispensing equipment, it is necessary to hand over the necessary medical equipment as soon as the doctor starts using it, depending on the flow of the surgery. Therefore, the nurse in charge of dispensing equipment must always have the next required medical equipment on hand.

When removing the instruments, a support person, such as a person in charge of the medical instrument manufacturer, may be present during the surgery to ensure that the medical instruments are not used incorrectly. The supporter supports the nurse in charge of dispensing equipment by instructing which equipment is needed at what timing.

In medical settings, surgeries are performed every day at various locations and times, so it is a burden for supporters to be present at the site and provide support. Therefore, in recent years, consideration has been given to making it possible to provide such support remotely.

However, in order to provide support from a distance, a new burden will be placed on medical professionals and supporters. For example, nurses are required to photograph medical equipment each time using a camera installed in the operating room or carried by the nurse. At this time, nurses have to focus on checking whether the medical equipment is being photographed correctly by the camera. In this process, you should check, for example, whether the medical device is within the camera's shooting range, whether you are in the appropriate shooting position, whether the direction of shooting the medical device is appropriate in that position, and whether the length of shooting time is appropriate. A variety of viewpoints are required.

Furthermore, even if the medical equipment required for surgery is one type, its types and uses are wide-ranging. Therefore, as more and more cameras are used to photograph medical equipment, the burden on supporters in remote locations to check the equipment each time increases.

As described above, when remotely supporting the handling of medical equipment in an operating room, the challenge is to reduce the burden on nurses who are in charge of taking out the equipment and support personnel in remote locations. However, with conventional techniques, it has been difficult to realize this.

A medical support system according to an embodiment of the present invention acquires information that allows identification of medical instruments existing in an operating room, and transmits the comparison results between the medical instruments existing in the operating room and the medical instruments used in the surgery to a remote location. Displayed on a terminal used by a support person in the room or a terminal used by a medical worker in the operating room. At this time, information for explaining its use may be displayed in association with the medical instrument used in the surgery. This allows the supporter to remotely grasp the medical equipment present in the operating room and provide medical personnel with information regarding its use without much burden. In other words, it is possible to reduce the burden on the supporter when supporting the medical worker remotely.

[First embodiment]
The first embodiment of the present invention provides information regarding medical instruments present in the operating room to support personnel in remote locations and medical personnel in the operating room, based on images taken of the medical instruments present in the operating room. It is a medical support system that provides The medical support system in this embodiment displays a screen (hereinafter also referred to as a "verification result screen") showing the comparison results between medical instruments existing in the operating room and medical instruments used in surgery to the support person. . In addition, the medical support system in this embodiment provides medical personnel with a screen (hereinafter referred to as "usage information") that shows information (hereinafter also referred to as "usage information") for explaining the usage of medical equipment used in surgery. (also called "screen").

<Overall configuration of medical support system>
First, the overall configuration of a medical support system 1 in this embodiment will be described with reference to FIG. 1. FIG. 1 is a diagram showing an example of the overall configuration of a medical support system 1 in this embodiment.

As shown in FIG. 1, the medical support system 1 in this embodiment includes an acquisition device 10, a display device 11, a supporter terminal 20, and a service providing server 30. The acquisition device 10, the display device 11, the supporter terminal 20, and the service providing server 30 are each connected to the communication network N1. The communication network N1 is configured so that connected devices can communicate with each other.

The communication network N1 is constructed, for example, by a wired communication network such as the Internet, a LAN (Local Area Network), or a WAN (Wide Area Network). The communication network N1 includes not only wired communication but also wireless communication such as wireless LAN or short-range wireless communication, WiMAX (Worldwide Interoperability for Microwave Access), LTE (Long Term Evolution), 5G (5th Generation), etc. This may include a mobile communication network.

The acquisition device 10 and the display device 11 exist in the usage environment E1. The supporter terminal 20 is installed in the support environment E2. The service providing server 30 is installed in the service providing environment E3. The usage environment E1, the support environment E2, and the service provision environment E3 are constructed in different remote locations. The usage environment E1, the support environment E2, and the service provision environment E3 can communicate with each other via the communication network N1.

The usage environment E1 is an environment where medical equipment is used, such as an operating room where medical personnel are present. The support environment E2 is an environment where a supporter performs support work, such as an office of a medical device manufacturer, for example. The service providing environment E3 is, for example, an environment such as a data center that provides services to the usage environment E1 and the support environment E2 via the communication network N1.

The acquisition device 10 is an electronic device that acquires information (hereinafter also referred to as "instrument information") that allows identification of medical instruments existing in the usage environment E1. The device information in this embodiment is an image of a medical device (hereinafter also referred to as an "instrument image"). An example of the acquisition device 10 is a spherical photographing device. Another example of the acquisition device 10 is a mobile terminal such as a smartphone or a tablet terminal, or a wearable device such as smart glasses or an action camera.

The display device 11 is an electronic device that displays information regarding medical equipment to medical personnel in the usage environment E1. The information displayed by the display device 11 in this embodiment is usage information of medical instruments used in surgery. An example of the display device 11 is a computer. Another example of the display device 11 is a mobile terminal such as a smartphone or a tablet terminal.

The supporter terminal 20 is an information processing terminal used by a supporter in the support environment E2. The supporter terminal 20 displays the comparison result between the medical instruments existing in the operating room and the medical instruments used in the surgery. Further, the supporter terminal 20 requests the display device 11 to transmit the usage information of the medical equipment used in the surgery in response to the supporter's operation. An example of the supporter terminal 20 is a computer.

The service providing server 30 is an information processing device that provides services used by supporters to support medical personnel. The service providing server 30 outputs, to the supporter terminal 20, the comparison result between the medical instruments present in the operating room and the medical instruments used in the surgery. Further, the service providing server 30 outputs usage information of medical instruments used in surgery to the display device 11. An example of the service providing server 30 is a computer.

The acquisition device 10 and the display device 11 may be configured as one information processing terminal that has the functions that each of them should have. For example, by using a computer equipped with a camera, a display, and a communication function, such as a laptop-type personal computer, a smartphone, or a tablet terminal, it is possible to realize an information processing terminal that has the functions of the acquisition device 10 and the display device 11. can.

The acquisition device 10 may be connected to the display device 11 through a wired or wireless communication path without being connected to the communication network N1. In this case, the acquisition device 10 connects to the communication network N1 via the display device 11 and communicates with other devices, terminals, or servers.

Note that the acquisition device 10, display device 11, supporter terminal 20, and service providing server 30 are not limited to a spherical photographing device, a smartphone, or a computer, as long as they are devices equipped with a communication function. The acquisition device 10, the display device 11, the supporter terminal 20, and the service providing server 30 are, for example, a PJ (Projector), an IWB (Interactive White Board: a whiteboard with an electronic blackboard function capable of mutual communication), a digital Output devices such as signage, HUD (Head Up Display) devices, industrial machinery, imaging devices, sound collection devices, medical equipment, network appliances, connected cars, personal computers, mobile phones, smartphones, tablet terminals , a game machine, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, a desktop PC, or the like.

<Hardware configuration of medical support system>
Next, the hardware configuration of each device included in the medical support system 1 in this embodiment will be explained with reference to FIGS. 2 to 4.

≪Hardware configuration of spherical imaging device≫
FIG. 2 is a diagram illustrating an example of a hardware configuration when the acquisition device 10 is implemented as a spherical photographing device. In the following, the spherical photographing device is assumed to be a spherical (omnidirectional) photographing device using two image sensors, but any number of image sensors may be used as long as it is two or more. Also, it does not necessarily have to be a device dedicated to omnidirectional photography; by attaching an aftermarket omnidirectional imaging unit to a regular digital camera or smartphone, it can essentially have the same functionality as a omnidirectional photography device. You can.

As shown in FIG. 2, the omnidirectional imaging device in one embodiment includes an imaging unit 601, an image processing unit 604, an imaging control unit 605, a microphone 608, a sound processing unit 609, and a CPU (Central Processing Unit) 611. , ROM (Read Only Memory) 612, SRAM (Static Random Access Memory) 613, DRAM (Dynamic Random Access Memory) 614, operation unit 615, external device connection I/F 616, communication unit 617, antenna 617a, acceleration/direction sensor 618 , a gyro sensor 619, an acceleration sensor 620, and a concave terminal 621 for Micro USB.

Among these, the imaging unit 601 includes wide-angle lenses (so-called fisheye lenses) 602a and 602b each having an angle of view of 180° or more for forming a hemispherical image, and two imaging units provided corresponding to each wide-angle lens. It includes elements 603a and 603b. The image sensors 603a and 603b are image sensors such as CMOS (Complementary Metal Oxide Semiconductor) sensors and CCD (Charge Coupled Device) sensors that convert optical images formed by fisheye lenses 602a and 602b into electrical signal image data and output the image data. It has a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks, and a group of registers in which various commands and parameters necessary for the operation of this image sensor are set.

The imaging elements 603a and 603b of the imaging unit 601 are each connected to the image processing unit 604 via a parallel I/F bus. On the other hand, the imaging elements 603a and 603b of the imaging unit 601 are connected to the imaging control unit 605 via a serial I/F bus (such as an I2C bus). The image processing unit 604, the imaging control unit 605, and the sound processing unit 609 are connected to the CPU 611 via a bus 610. Further, the bus 610 is also connected to a ROM 612, an SRAM 613, a DRAM 614, an operation unit 615, an external device connection I/F (Interface) 616, a communication unit 617, an acceleration/direction sensor 618, and the like.

The image processing unit 604 takes in image data output from the image sensors 603a and 603b through the parallel I/F bus, performs predetermined processing on each image data, and then synthesizes these image data. , create equirectangular projection image data.

Generally, the imaging control unit 605 uses the I2C bus to set commands and the like in register groups of the imaging devices 603a and 603b, with the imaging control unit 605 as a master device and the imaging devices 603a and 603b as slave devices. Necessary commands and the like are received from the CPU 611. Further, the imaging control unit 605 also uses the I2C bus to take in status data and the like of the register groups of the imaging elements 603a and 603b, and sends it to the CPU 611.

Furthermore, the imaging control unit 605 instructs the imaging elements 603a and 603b to output image data at the timing when the shutter button of the operation unit 615 is pressed. Some omnidirectional photography devices may have a preview display function or a function that supports video display on a display (for example, a smartphone display). In this case, image data is output continuously from the image sensors 603a and 603b at a predetermined frame rate (frames/minute).

The imaging control unit 605 also functions as a synchronization control unit that synchronizes the output timing of image data of the imaging elements 603a and 603b in cooperation with the CPU 611, as will be described later. Note that in this embodiment, the omnidirectional photographing device is not provided with a display, but may be provided with a display section.

Microphone 608 converts sound into sound (signal) data. The sound processing unit 609 takes in sound data output from the microphone 608 through the I/F bus, and performs predetermined processing on the sound data.

The CPU 611 controls the overall operation of the omnidirectional photographing apparatus and executes necessary processing. ROM612 stores various programs for CPU611. The SRAM 613 and DRAM 614 are work memories that store programs executed by the CPU 611, data being processed, and the like. In particular, the DRAM 614 stores image data that is currently being processed by the image processing unit 604 and data of processed equirectangular projection images.

The operation unit 615 is a general term for operation buttons such as the shutter button 615a. By operating the operation unit 615, the user inputs various shooting modes, shooting conditions, and the like.

The external device connection I/F 616 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a PC (Personal Computer), or the like. The data of the equirectangular projection image stored in the DRAM 614 can be recorded on an external media via this external device connection I/F 616, or transferred to an external device such as a smartphone via the external device connection I/F 616 as necessary. It may be sent to a terminal (device).

The communication unit 617 communicates with an external terminal such as a smartphone using short-range wireless communication technology such as Wi-Fi, NFC (Near Field Communication), or Bluetooth (registered trademark) via an antenna 617a provided on the spherical photographing device. Communicate with (device). This communication unit 617 can also transmit data of an equirectangular projection image to an external terminal (device) such as a smartphone.

The acceleration/azimuth sensor 618 calculates the azimuth of the omnidirectional imaging device from the earth's magnetism and outputs azimuth information. This orientation information is an example of related information (metadata) in accordance with Exif, and is used for image processing such as image correction of captured images. Note that the related information also includes data such as the date and time when the image was taken and the data capacity of the image data. Further, the acceleration/azimuth sensor 618 is a sensor that detects changes in angle (roll angle, pitch angle, yaw angle) accompanying movement of the omnidirectional photographing device 6. A change in angle is an example of related information (metadata) according to Exif, and is used for image processing such as image correction of a captured image.

Furthermore, the acceleration/direction sensor 618 is a sensor that detects acceleration in three axial directions. The omnidirectional imaging device calculates the attitude (angle with respect to the direction of gravity) of its own device (the omnidirectional imaging device) based on the acceleration detected by the acceleration/azimuth sensor 618. By providing the acceleration/azimuth sensor 618 in the omnidirectional photographing device, the accuracy of image correction is improved.

≪Hardware configuration of smartphone≫
FIG. 3 is a diagram illustrating an example of a hardware configuration when the acquisition device 10 and the display device 11 are implemented by a smartphone.

As shown in FIG. 3, the smartphone in one embodiment includes a CPU 401, ROM 402, RAM 403, EEPROM 404, CMOS sensor 405, image sensor I/F 406, acceleration/direction sensor 407, media I/F 409, and GPS receiving unit 411. It is equipped with

Among these, the CPU 401 controls the entire operation of the smartphone. The ROM 402 stores the CPU 401 and programs used to drive the CPU 401 such as IPL. RAM 403 is used as a work area for CPU 401. The EEPROM 404 reads or writes various data such as smartphone programs under the control of the CPU 401. A CMOS (Complementary Metal Oxide Semiconductor) sensor 405 is a type of built-in imaging means that images a subject (mainly a self-portrait) and obtains image data under the control of the CPU 401. Note that instead of a CMOS sensor, an imaging means such as a CCD (Charge Coupled Device) sensor may be used.

The image sensor I/F 406 is a circuit that controls driving of the CMOS sensor 405. The acceleration/direction sensor 407 is a variety of sensors such as an electronic magnetic compass, a gyro compass, and an acceleration sensor that detect geomagnetism. A media I/F 409 controls reading or writing (storage) of data to a recording medium 408 such as a flash memory. GPS receiving section 411 receives GPS signals from GPS satellites.

The smartphone also includes a long-distance communication circuit 412, a CMOS sensor 413, an image sensor I/F 414, a microphone 415, a speaker 416, a sound input/output I/F 417, a display 418, an external device connection I/F (Interface) 419, and a short distance It includes a communication circuit 420, an antenna 420a of the short-range communication circuit 420, and a touch panel 421.

Among these, the long distance communication circuit 412 is a circuit that communicates with other devices via the communication network N1. The CMOS sensor 413 is a type of built-in imaging means that images a subject and obtains image data under the control of the CPU 401. The image sensor I/F 414 is a circuit that controls driving of the CMOS sensor 413. Microphone 415 is a built-in circuit that converts sound into electrical signals. The speaker 416 is a built-in circuit that converts electrical signals into physical vibrations to produce sounds such as music and voice. The sound input/output I/F 417 is a circuit that processes input/output of sound signals between the microphone 415 and the speaker 416 under the control of the CPU 401 .

The display 418 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays images of the subject, various icons, and the like. The external device connection I/F 419 is an interface for connecting various external devices. The near field communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 421 is a type of input means by which the user operates the smartphone by pressing the display 418.

The smartphone also includes a bus line 410. The bus line 410 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 401 shown in FIG. 3.

≪Computer hardware configuration≫
FIG. 4 is a diagram showing an example of a hardware configuration when the supporter terminal 20 and the service providing server 30 are realized by a computer.

As shown in FIG. 4, the computer in one embodiment includes a CPU 501, ROM 502, RAM 503, HD 504, HDD (Hard Disk Drive) controller 505, display 506, external device connection I/F (Interface) 508, network I /F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I/F 516.

Among these, the CPU 501 controls the operation of the entire computer. The ROM 502 stores programs used to drive the CPU 501 such as IPL. RAM 503 is used as a work area for CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls reading and writing of various data to the HD 504 under the control of the CPU 501.

The display 506 displays various information such as a cursor, menu, window, characters, or images. External device connection I/F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I/F 509 is an interface for data communication using the communication network N1. The bus line 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 4.

Further, the keyboard 511 is a type of input means that includes a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The DVD-RW drive 514 controls reading and writing of various data on a DVD-RW 513, which is an example of a removable recording medium. Note that it is not limited to DVD-RW, but may be DVD-R or the like. The media I/F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

<Functional configuration of medical support system>
Next, an example of the functional configuration of the medical support system 1 in this embodiment will be described with reference to FIG. 5. FIG. 5 is a block diagram illustrating the functional configuration of each device included in the medical support system 1 in this embodiment.

≪Functional configuration of acquisition device≫
As shown in FIG. 5, the acquisition device 10 in this embodiment includes a communication control section 101 and an information acquisition section 102.

The communication control unit 101 transmits and receives various data to and from the service providing server 30 via the communication network N1. The communication control unit 101 is realized, for example, by a process in which a program expanded from the ROM 612 to the SRAM 613 shown in FIG. 2 is executed by the CPU 611 and the external device connection I/F 616.

The information acquisition unit 102 photographs medical equipment present in the operating room and generates an image including the medical equipment. The information acquisition unit 102 may generate a moving image (that is, a time series of images). The information acquisition unit 102 is realized, for example, by a process in which a program expanded from the ROM 612 to the SRAM 613 shown in FIG. 2 is executed by the CPU 611 and the imaging control unit 605.

≪Functional configuration of display device≫
As shown in FIG. 5, the display device 11 in this embodiment includes a communication control section 111 and a screen display section 112.

The communication control unit 111 transmits and receives various data to and from the service providing server 30 via the communication network N1. The communication control unit 111 is realized, for example, by a process in which a program loaded from the EEPROM 404 shown in FIG.

The screen display unit 112 displays each screen based on the screen information received from the service providing server 30. The screen display unit 112 is realized, for example, by a process in which a program loaded from the EEPROM 404 onto the RAM 403 shown in FIG. 3 is executed by the CPU 401 and the display 418. An example of the screen display unit 112 is a browser.

≪Functional configuration of supporter terminal≫
As shown in FIG. 5, the supporter terminal 20 in this embodiment includes a communication control section 201 and a screen display section 202.

The communication control unit 201 transmits and receives various data to and from the service providing server 30 via the communication network N1. The communication control unit 201 is realized, for example, by processing that causes the CPU 501 and the network I/F 509 to execute a program expanded from the HD 504 onto the RAM 503 as shown in FIG.

The screen display unit 202 displays each screen based on the screen information received from the service providing server 30. The screen display unit 202 is realized, for example, by the process of causing the CPU 501 and the display 506 to execute a program loaded from the HD 504 onto the RAM 503 as shown in FIG. An example of the screen display unit 202 is a browser.

≪Functional configuration of service providing server≫
As shown in FIG. 5, the service providing server 30 in this embodiment includes a communication control section 301, a screen information generation section 302, a screen information storage section 303, a room management section 304, a room information storage section 305, and a content distribution section. section 306, content storage section 307, message processing section 308, image recognition section 311, image information storage section 312, surgical information management section 313, surgical information storage section 314, usage information management section 315, and usage information storage section 316.

The communication control unit 301 transmits and receives various data to and from the acquisition device 10, display device 11, and supporter terminal 20 via the communication network N1. The communication control unit 301 is realized, for example, by processing that causes the CPU 501 and the network I/F 509 to execute a program expanded from the HD 504 onto the RAM 503 as shown in FIG.

The screen information generation unit 302, room management unit 304, content distribution unit 306, message processing unit 308, image recognition unit 311, surgical information management unit 313, and usage information management unit 315, for example, This is realized by a process in which a program developed on the RAM 503 is executed by the CPU 501 and the HDD controller 505.

The screen information storage unit 303, room information storage unit 305, content storage unit 307, image information storage unit 312, surgery information storage unit 314, and usage information storage unit 316 are realized using, for example, the HD 504 shown in FIG. be done. Reading or writing of data stored in the HD 504 is performed, for example, via the HDD controller 505.

Note that the screen information storage section 303, the room information storage section 305, the content storage section 307, the image information storage section 312, the surgical information storage section 314, and the usage information storage section 316 are not provided in the service providing server 30, but are provided in an external storage device. may also be used. An example of an external storage device is a NAS (Network Attached Storage) or an online storage service.

The screen information generation unit 302 generates screen information to be provided to the display device 11 and the supporter terminal 20 based on the screen information stored in the screen information storage unit 303. Each piece of screen information generated by the screen information generation unit 302 is, for example, screen information written in HTML (HyperText Markup Language) or the like, and may include an application written in JavaScript (registered trademark) or the like.

The screen information storage unit 303 stores screen information that the screen information generation unit 302 provides to the display device 11 and the supporter terminal 20.

Room management section 304 manages room information stored in room information storage section 305. A room is a unit for managing a distribution destination (connection destination) of an image or video captured by the acquisition device 10 (hereinafter also referred to as a “device”). The room may be created in advance, or may be created temporarily in response to a request from the supporter terminal 20 or the like.

Specifically, the room management unit 304 executes the following processing. First, settings are registered to associate the device with the room. Second, information about users entering and leaving the room is updated. That is, the users currently entering each room are managed.

Room information storage section 305 stores room information managed by room management section 304. Room information includes room management information, user management information, and device management information. The room information may include destination management information for managing a destination list including multiple users and/or devices.

Room management information is information that associates a room with a user and a device that have entered the room. Room management information in this embodiment is stored in a room management table that will be described later.

The user management information is information for managing attribute information and status information of users registered in the service providing server 30. User management information in this embodiment is stored in a user management table that will be described later.

The device management information is information for managing attribute information and status information of devices registered in the service providing server 30. Device management information in this embodiment is stored in a device management table that will be described later.

Here, room information in this embodiment will be explained with reference to FIGS. 6 to 8. FIG. 6 is a conceptual diagram showing an example of a room management table in this embodiment.

As shown in FIG. 6, the room management table 1000 in this embodiment includes, as data items, a room ID for identifying a room, an entering user ID for identifying a user who has entered the room, and a user ID for entering the room. It has an entry device ID that identifies the device that has entered the room.

FIG. 7 is a conceptual diagram showing an example of the user management table in this embodiment. As shown in FIG. 7, the user management table 1100 in this embodiment includes data items such as a user ID that identifies a user, a display name of the user, a communication status of the user, and a connection source of the user. It has an IP address, etc.

FIG. 8 is a conceptual diagram showing an example of a device management table in this embodiment. As shown in FIG. 8, the device management table 1200 in this embodiment has data items such as a device ID for identifying a device, a display name of the device, and an IP address of the device.

The explanation will be returned to FIG. 5. The content distribution unit 306 distributes content (for example, a still image or a video) captured by a device that is in the room to a terminal used by a user who is in the room. Specifically, the content distribution unit 306 executes the following processing. First, still image or video data received from a device is streamed to users who are in the same room. Second, the still image or video data stored in the content storage unit 307 is distributed in response to a user's request.

The content storage unit 307 stores the content distributed by the content distribution unit 306. Further, the content storage unit 307 stores content management information that associates content with attribute information of the content. Content management information in this embodiment is stored in a content management table that will be described later.

The content stored in the content storage unit 307 is raw data of still images or moving images captured by the device. When the content is photographed by a spherical photographing device, viewpoint information is also stored as the content. Specifically, still image or video data captured by a device during live distribution is stored as content. Further, when the content is a panoramic image or a video, viewpoint information of a viewing base (for example, coordinates of the viewpoint, viewing time, identification information of the base, etc.) is stored in association with the content.

Here, content management information in this embodiment will be explained with reference to FIG. 9. FIG. 9 is a conceptual diagram showing an example of a content management table in this embodiment.

As shown in FIG. 9, the content management table 1300 according to the present embodiment includes, as data items, a data ID for identifying content, a name of the content, a shooting date and time, a room ID, a photographer, an entering user ID, a panoramic Contains image viewpoint information, actual data storage location, etc.

The explanation will be returned to FIG. 5. The message processing unit 308 processes messages sent to devices connected to the room. Examples of messages include instructing the device to take pictures, receiving images taken by the device, receiving the presence of the device (e.g., video distribution status, camera and microphone status, presence or absence of screen sharing, etc.), and 360-degree views of each location. This includes receiving viewpoint information of a video or image.

The image recognition unit 311 recognizes a medical device included in the device image received from the acquisition device 10 . The image recognition unit 311 performs recognition using images of medical instruments stored in the image information storage unit 312.

The image information storage unit 312 stores device image information that associates an image of a medical device with the type of the medical device. Instrument image information in this embodiment is stored in an instrument image management table, which will be described later.

Here, the device image information in this embodiment will be explained with reference to FIG. 10. FIG. 10 is a conceptual diagram showing an example of the instrument image management table in this embodiment.

As shown in FIG. 10, the device image management table 1400 in this embodiment includes images of medical devices, types of medical devices, etc. as data items. The image may be the image data itself, or may be information indicating the storage location of the image data (eg, URL (Uniform Resource Locator), etc.).

The explanation will be returned to FIG. 5. The surgical information management section 313 manages surgical information stored in the surgical information storage section 314. The surgical information is information that associates information representing the operating room, information representing the surgery scheduled in the relevant operating room, information representing the time zone in which the relevant surgery will be performed, and information representing the medical equipment used in the relevant surgery. It is.

The surgical information storage unit 314 stores surgical information managed by the surgical information management unit 313. Surgery information in this embodiment is stored in a surgery management table that will be described later.

Here, surgical information in this embodiment will be explained with reference to FIG. 11. FIG. 11 is a conceptual diagram showing an example of the surgery management table in this embodiment.

As shown in FIG. 11, the surgery management table 1500 in this embodiment includes, as data items, the location where the surgery is performed, the sending device ID that identifies the device that transmits images from the location, and the medical equipment used in the surgery. It includes the time period in which the surgery will be used (scheduled time of use), and the medical equipment (instruments used) that will be used in the surgery.

The explanation will be returned to FIG. 5. The usage information management unit 315 manages usage management information stored in the usage information storage unit 316. The usage management information is information that associates information representing a medical device with usage information for explaining the usage of the medical device.

The usage information storage unit 316 stores usage management information managed by the usage information management unit 315. The usage management information in this embodiment is stored in a usage management table that will be described later.

Here, the usage management information in this embodiment will be explained with reference to FIG. 12. FIG. 12 is a conceptual diagram showing an example of the usage management table in this embodiment.

As shown in FIG. 12, the usage management table 1600 in this embodiment has the type of medical device, usage information, etc. as data items. The usage information may be textual information, a link to audio data (eg, URL, etc.), or a link to video data (eg, URL, etc.).

<Processing procedure of medical support method>
Next, details of the medical support method executed by the medical support system 1 in this embodiment will be described with reference to FIG. 13. FIG. 13 is a sequence diagram showing an example of the medical support method in this embodiment.

In step S101, the communication control unit 101 included in the acquisition device 10 transmits a request to connect to the room to the service providing server 30 in response to an operation by a medical professional. The connection request includes the room ID. Specifically, the medical professional performs a predetermined connection operation on the operation unit 615 of the omnidirectional imaging device. The room ID of the connection destination is set in the acquisition device 10 in advance.

In step S201, the communication control unit 201 included in the supporter terminal 20 transmits a connection request to the room to the service providing server 30 in response to the supporter's operation. The connection request includes the room ID. Specifically, the supporter accesses a predetermined URL from a browser installed on the supporter terminal 20. The room ID of the connection destination is specified by the URL of the connection destination.

In step S301, the communication control unit 301 included in the service providing server 30 receives a connection request from the acquisition device 10 and the supporter terminal 20. Next, the communication control unit 301 sends the received connection request to the room management unit 304.

The room management unit 304 acquires the room ID from the received connection request. Next, the room management unit 304 adds information regarding the acquisition device 10 and the supporter terminal 20 to the room management information identified by the acquired room ID.

In step S102, the information acquisition unit 102 included in the acquisition device 10 photographs medical instruments present in the operating room and generates an instrument image. Next, the information acquisition unit 102 sends the generated device image to the communication control unit 301. The communication control unit 301 transmits the received device image to the service providing server 30.

For example, medical instruments are arranged on an instrument stand installed in an operating room. When the acquisition device 10 is a spherical photographing device, the acquisition device 10 may be installed so that the entire instrument installation stand is included in the angle of view. When the acquisition device 10 is a mobile terminal such as a smartphone, a nurse or the like in charge of taking out the instruments may take a picture with the camera of the smartphone so that the entire instrument installation table is included in the angle of view. When the acquisition device 10 is a wearable device such as smart glasses, a nurse or the like wearing the wearable device may direct their line of sight in the direction of the instrument installation table.

In step S302, the communication control unit 301 included in the service providing server 30 receives the instrument image from the acquisition device 10. Next, the communication control unit 301 sends the received device image to the room management unit 304 and the image recognition unit 311.

The room management unit 304 identifies the room ID to which the device image is to be delivered, based on the room information stored in the room information storage unit 305. Next, the room management section 304 sends the room ID and the device image to the content distribution section 306.

Specifically, the room management unit 304 uses the device management information to identify the device ID from the IP address of the acquisition device 10 that transmitted the instrument image. Next, the room management unit 304 uses the room management information to identify the room ID that the device ID has entered. Subsequently, the room management section 304 sends the specified device ID to the surgical information management section 313.

The content distribution unit 306 stores the device image received from the room management unit 304 in the content storage unit 307. Next, the content distribution unit 306 stores, in the content storage unit 307, the content management information including the room ID and attribute information regarding the device image received from the room management unit 304. Subsequently, the content distribution unit 306 transmits the device image to the supporter terminal 20 identified by the user ID who has entered the room.

In step S303, the image recognition unit 311 included in the service providing server 30 recognizes medical instruments present in the operating room based on the instrument image received from the acquisition device 10. Next, the image recognition unit 311 sends the recognition result of the medical instrument to the surgical information management unit 313.

Instrument image information stored in the image information storage section 312 is used to recognize medical instruments. Specifically, the image recognition unit 311 extracts an image of a medical device from the device image. Next, the image recognition unit 311 compares each of the extracted medical device images with each of the medical device images included in the device image information. Subsequently, the image recognition unit 311 identifies device image information that includes an image of the most similar medical device, and acquires the type of medical device included in the device image information.

The image recognition unit 311 may use the image recognition model to estimate the type of medical device for each image of the medical device extracted from the device image. The image recognition model is, for example, a machine learning model that has learned the relationship between an image of a medical device and its type using the device image information stored in the image information storage unit 312 as learning data.

In step S304, the surgical information management unit 313 included in the service providing server 30 acquires the surgical information identified by the device ID received from the room management unit 304 from the surgical information storage unit 314.

In step S305, the surgical information management unit 313 included in the service providing server 30 receives the medical device recognition result from the image recognition unit 311. Next, the surgical information management unit 313 compares the medical instruments included in the received recognition result with the used instruments included in the acquired surgical information. That is, the surgical information management unit 313 determines whether each of the used instruments included in the surgical information exists among the medical instruments included in the recognition results. Next, the surgical information management section 313 sends the comparison result between the medical instrument and the instrument to be used to the screen information generation section 302.

In step S306, the screen information generation unit 302 included in the service providing server 30 receives the comparison result between the medical equipment and the used equipment from the surgical information management unit 313. Next, the screen information generation unit 302 generates screen information of a verification result screen based on the received verification results. The verification result screen is a screen for displaying verification results.

Specifically, the screen information generation unit 302 acquires the screen information of the verification result screen stored in the screen information storage unit 303. Next, the screen information generation unit 302 embeds the verification result received from the surgical information management unit 313 into the acquired screen information.

Subsequently, the screen information generation unit 302 sends the screen information of the generated verification result screen to the communication control unit 301. The communication control unit 301 transmits the screen information received from the screen information generation unit 302 to the supporter terminal 20.

In step S202, the communication control unit 201 included in the supporter terminal 20 receives screen information of the verification result screen from the service providing server 30. Next, the communication control unit 201 sends the received screen information to the screen display unit 202. The screen display unit 202 displays a verification result screen on the display 506 based on the screen information received from the communication control unit 201.

Here, the verification result screen in this embodiment will be explained with reference to FIG. 14. FIG. 14 is a conceptual diagram showing an example of a matching result screen in this embodiment.

As shown in FIG. 14, the verification result screen 2000 in this embodiment includes a device display field 2001, a verification result display field 2002, a contact button 2003, and a send button 2004.

The device display field 2001 displays information regarding the acquisition device 10 that transmitted the instrument image. The verification result display field 2002 displays identification information of the medical device, an image of the medical device, and the verification result. In the verification result, among the used instruments included in the surgical information, medical instruments that are recognized from the instrument image are displayed as "OK", and medical instruments that are not recognized from the instrument image are displayed as "NG". .

The method of displaying the verification results is not limited to text information, and any method may be used as long as the missing medical equipment is displayed in a recognizable manner. For example, the font color or background color of the missing medical equipment may be changed, or a message indicating that there is a missing medical equipment may be displayed, for example, in a pop-up or a marquee.

When the supporter presses the contact button 2003 on the verification result screen 2000, the supporter can contact the medical professional. Contact may be made by sending a message from the supporter terminal 20 to the display device 11 using the message processing unit 308 included in the service providing server 30, or by calling a preset telephone number and making a voice call. You can. The notification can be used, for example, by the support person to confirm or notify the medical staff when there is a medical device for which the verification result is NG.

When the supporter presses the send button 2004 on the verification result screen 2000, a request to send usage information is sent to the service providing server 30. The transmission request includes information for identifying the medical device displayed in the verification result display field 2002.

The explanation will be returned to FIG. 13. In step S203, the communication control unit 201 included in the supporter terminal 20 transmits a request to send usage information to the service providing server 30 in response to the supporter's operation. Specifically, the supporter presses the send button 2004 on the verification result screen.

In step S307, the communication control unit 301 included in the service providing server 30 receives a request to send usage information from the supporter terminal 20. Next, the communication control unit 301 sends the received transmission request to the usage information management unit 315.

The usage information management unit 315 acquires usage information based on the transmission request received from the supporter terminal 20. Specifically, the usage information management unit 315 acquires information that identifies the medical device from the transmission request. Next, the usage information management unit 315 acquires usage information associated with the acquired medical device from the usage information storage unit 316. Subsequently, the usage information management unit 315 sends the acquired usage information to the screen information generation unit 302.

The screen information generation unit 302 receives usage information from the usage information management unit 315. Next, the screen information generation unit 302 generates screen information of the usage information screen based on the received usage information. The usage information screen is a screen for displaying usage information.

Specifically, the screen information generation unit 302 acquires the screen information of the usage information screen stored in the screen information storage unit 303. Next, the screen information generation unit 302 embeds the usage information received from the usage information management unit 315 into the acquired screen information.

Subsequently, the screen information generation unit 302 sends the screen information of the generated usage information screen to the communication control unit 301. The communication control unit 301 transmits the screen information received from the screen information generation unit 302 to the display device 11.

In step S<b>111 , the communication control unit 111 included in the display device 11 receives screen information of the usage information screen from the service providing server 30 . Next, the communication control unit 111 sends the received screen information to the screen display unit 112. The screen display unit 112 displays a usage information screen on the display 506 based on the screen information received from the communication control unit 111.

Here, the usage information screen in this embodiment will be explained with reference to FIG. 15. FIG. 15 is a conceptual diagram showing an example of the usage information screen in this embodiment.

As shown in FIG. 15, the usage information screen 2100 in this embodiment has a usage information display column 2101.

In the usage information display field 2101, images and usage information of the medical device are displayed. The usage information is text information, a link to audio data, a link to video data, and a combination thereof. If the usage information is a link, the linked audio data or video data can be played from the link.

<Effects of the first embodiment>
The service providing server in this embodiment recognizes the medical instruments present in the operating room from the image of the medical instruments received from the acquisition device, and sends the results of matching between the medical instruments included in the recognition results and the medical instruments used in the surgery to the supporter. Display on terminal. Therefore, according to the medical support system of this embodiment, the supporter can remotely grasp the medical equipment present in the operating room.

Further, the service providing server in this embodiment associates usage information with medical instruments used in surgery and displays them on the display device. Therefore, according to the medical support system of this embodiment, a supporter can remotely provide usage information of medical equipment used in surgery to a medical professional.

[Second embodiment]
The medical support system 1 in the first embodiment is configured such that the service providing server 30 that distributes content also provides information regarding medical instruments present in the operating room. In the medical support system 1 according to the second embodiment, an application server installed in a support environment E2 uses an API (Application Programming Interface) provided by a service providing server 30 to generate information regarding medical equipment existing in an operating room. Configure it to do this.

The medical support system 1 in this embodiment will be described below, focusing on the differences from the medical support system 1 in the first embodiment.

<Overall configuration of medical support system>
First, the overall configuration of the medical support system 1 in this embodiment will be described with reference to FIG. 16. FIG. 16 is a diagram showing an example of the overall configuration of the medical support system 1 in this embodiment.

As shown in FIG. 16, the medical support system 1 according to this embodiment differs from the medical support system 1 according to the first embodiment (see FIG. 1) in that an application server 21 is included. The application server 21 is installed in the support environment E2 and is connected to the communication network N1.

The application server 21 is an information processing device that uses the service provided by the service providing server 30 to execute an application for a supporter in the support environment E2 to support a medical worker in the usage environment E1. The application server 21 outputs to the support person terminal 20 the results of matching the medical instruments present in the operating room and the medical instruments used in the surgery. Further, the application server 21 outputs usage information of medical instruments used in surgery to the display device 11. An example of the application server 21 is a computer.

<Functional configuration of medical support system>
Next, an example of the functional configuration of the medical support system 1 in this embodiment will be described with reference to FIG. 17. FIG. 17 is a block diagram illustrating the functional configuration of each device included in the medical support system 1 in this embodiment.

≪Functional configuration of service providing server≫
As shown in FIG. 17, the service providing server 30 in this embodiment includes a communication control section 301, a room management section 304, a room information storage section 305, a content distribution section 306, a content storage section 307, and a message processing section 308. and a validity confirmation unit 309.

That is, the service providing server 30 in this embodiment has a screen information generation section 302, a screen information storage section 303, an image recognition section 311, and an image information generation section 302, a screen information storage section 303, an image recognition section 311, and a The difference is that the storage section 312, the surgical information management section 313, the surgical information storage section 314, the usage information management section 315, and the usage information storage section 316 are not provided, but a validity confirmation section 309 is provided.

The validity checking unit 309 checks whether the application installed on the application server 21 is a genuine application. For example, when an application installed on the application server 21 calls various functions provided by the service providing server 30, it is determined whether the application is a legitimate application based on pre-registered contract information.

≪Functional configuration of application server≫
As shown in FIG. 17, the application server 21 in this embodiment includes a communication control section 211, a screen information generation section 302, a screen information storage section 303, an image recognition section 311, an image information storage section 312, and a surgical information management section. section 313 , a surgical information storage section 314 , a usage information management section 315 , and a usage information storage section 316 .

The communication control unit 211 transmits and receives various data to and from the display device 11, the supporter terminal 20, and the service providing server 30 via the communication network N1. The communication control unit 211 is realized, for example, by a process that causes the CPU 501 and the network I/F 509 to execute a program loaded from the HD 504 onto the RAM 503 as shown in FIG.

The screen information generation section 302, the screen information storage section 303, the image recognition section 311, the image information storage section 312, the surgical information management section 313, the surgical information storage section 314, the usage information management section 315, and the usage information storage section 316 are the first The components are the same as those included in the service providing server 30 in the embodiment.

<Processing procedure of medical support method>
Next, details of the medical support method executed by the medical support system 1 in this embodiment will be described with reference to FIG. 18. FIG. 18 is a sequence diagram showing an example of the medical support method in this embodiment.

In step S211, the communication control unit 211 included in the application server 21 uses the API provided by the service providing server 30 to transmit a request to connect to the room to the service providing server 30. The connection request includes the room ID. The room ID of the connection destination is set in advance in the API.

In step S311, the communication control unit 301 included in the service providing server 30 receives a connection request from the application server 21. Next, the communication control unit 301 sends the connection request received from the application server 21 to the validity confirmation unit 309.

The validity checking unit 309 checks whether the application is genuine based on the connection request received from the application server 21 . If the authenticity confirmation unit 309 cannot confirm that the application is genuine, it rejects the connection. If the validity confirmation unit 309 is able to confirm that the application is genuine, it sends the connection request received from the application server 21 to the room management unit 304 . Here, we will continue the explanation assuming that we have confirmed that it is a genuine application.

In step S301, the communication control unit 301 included in the service providing server 30 receives a connection request from the acquisition device 10. Next, the communication control unit 301 sends the connection request received from the acquisition device 10 to the room management unit 304.

The room management unit 304 acquires the room ID from the received connection request. Next, the room management unit 304 adds information regarding the acquisition device 10 and the application server 21 to the room management information identified by the acquired room ID.

In step S<b>102 , the information acquisition unit 102 included in the acquisition device 10 transmits an instrument image of a medical instrument existing in the operating room to the service providing server 30 via the communication control unit 301 .

In the service providing server 30 , the communication control unit 301 sends the instrument image received from the acquisition device 10 to the room management unit 304 . The room management unit 304 sends the room ID and device image specified based on the room information to the content distribution unit 306. The content distribution unit 306 stores the device image in the content storage unit 307 and transmits the device ID and the device image to the application server 21.

In step S212, the communication control unit 211 included in the application server 21 receives the device ID and the device image from the service providing server 30. Next, the communication control unit 211 sends the received device image to the image recognition unit 311. Subsequently, the communication control unit 211 sends the received device ID to the surgical information management unit 313.

In step S213, the image recognition unit 311 included in the application server 21 recognizes medical instruments present in the operating room based on the instrument image received from the service providing server 30. Next, the image recognition unit 311 sends the recognition result of the medical instrument to the surgical information management unit 313.

In step S214, the surgical information management unit 313 included in the application server 21 acquires surgical information identified by the device ID received from the service providing server 30 from the surgical information storage unit 314.

In step S215, the surgical information management unit 313 included in the application server 21 receives the medical instrument recognition result from the image recognition unit 311. Next, the surgical information management unit 313 compares the medical instruments included in the received recognition result with the used instruments included in the acquired surgical information. Subsequently, the surgical information management unit 313 sends the results of the comparison between the medical equipment and the used equipment to the screen information generation unit 302.

In step S216, the screen information generation unit 302 included in the application server 21 receives the comparison result between the medical equipment and the used equipment from the surgical information management unit 313. Next, the screen information generation unit 302 generates screen information of a verification result screen based on the received verification results. Next, the screen information generation unit 302 transmits the screen information of the generated verification result screen to the supporter terminal 20 via the communication control unit 301.

In step S202, the screen display unit 202 included in the supporter terminal 20 displays the matching result screen on the display 506 based on the screen information of the matching result screen received from the application server 21.

In step S203, the communication control unit 201 included in the supporter terminal 20 transmits a request to send usage information to the application server 21 in response to the supporter's operation.

In step S217, based on the usage information transmission request received from the supporter terminal 20, the usage information management unit 315 included in the application server 21 transmits the usage information associated with the medical device acquired from the transmission request. Obtained from storage unit 316. Next, the usage information management unit 315 sends the acquired usage information to the screen information generation unit 302.

The screen information generation unit 302 generates screen information of the usage information screen based on the usage information received from the usage information management unit 315. Next, the screen information generation unit 302 transmits the screen information of the generated usage information screen to the display device 11 via the communication control unit 301.

In step S<b>111 , the screen display unit 112 included in the display device 11 displays the usage information screen on the display 506 based on the screen information of the usage information screen received from the application server 21 .

<Effects of the second embodiment>
In the medical support system according to the present embodiment, an application server installed in a support environment provides information regarding medical instruments existing in an operating room to supporters and medical personnel. The application server in this embodiment uses a service provided by a service providing server via an API.

Therefore, the medical support system in this embodiment can be implemented without changing the service providing server. Furthermore, since the processing is shared between the application server and the service providing server, the load on the service providing server can be reduced even when the number of content distribution destinations increases.

[Third embodiment]
The medical support system 1 in the first embodiment displays the verification results of medical devices on the supporter terminal 20 installed in the support environment E2, and installs usage information of the medical devices in the usage environment E1 according to the supporter's operation. The screen is configured to be displayed on the display device 11 that is configured to display the screen. The medical support system 1 in the third embodiment does not construct the support environment E2, but is configured to display the verification results of medical instruments on the display device 11 installed in the usage environment E1.

The medical support system 1 in this embodiment will be described below, focusing on the differences from the medical support system 1 in the first embodiment.

<Overall configuration of medical support system>
First, the overall configuration of the medical support system 1 in this embodiment will be described with reference to FIG. 19. FIG. 19 is a diagram showing an example of the overall configuration of the medical support system 1 in this embodiment.

As shown in FIG. 19, the medical support system 1 in this embodiment includes an acquisition device 10, a display device 11, and a service providing server 30. That is, the medical support system 1 in this embodiment differs from the medical support system 1 in the first embodiment (see FIG. 1) in that it does not include the supporter terminal 20.

<Functional configuration of medical support system>
Next, an example of the functional configuration of the medical support system 1 in this embodiment will be described with reference to FIG. 20. FIG. 20 is a block diagram illustrating the functional configuration of each device included in the medical support system 1 in this embodiment.

As shown in FIG. 20, the acquisition device 10, display device 11, and service providing server 30 in this embodiment have the same functional configuration as the acquisition device 10, display device 11, and service providing server 30 in the first embodiment. has.

<Processing procedure of medical support method>
Next, details of the medical support method executed by the medical support system 1 in this embodiment will be explained with reference to FIG. 21. FIG. 21 is a sequence diagram showing an example of the medical support method in this embodiment.

As shown in FIG. 21, the medical support method according to the present embodiment is different from the medical support method according to the first embodiment (see FIG. 13) in that step S306 executed by the service providing server 30 and the supporter The difference is that steps S201 to S203 executed by the terminal 20 are not performed.

Furthermore, the medical support method in this embodiment differs in the configuration of the screen information generated by the screen information generation unit 302 in step S307.

In step S307, the screen information generation unit 302 in this embodiment receives the comparison result between the medical instrument and the used instrument from the surgical information management unit 313. Next, the screen information generation unit 302 receives usage information from the usage information management unit 315.

Subsequently, the screen information generation unit 302 acquires the screen information of the usage information screen stored in the screen information storage unit 303. Next, the screen information generation unit 302 embeds the verification result and usage information in the acquired screen information.

Here, the usage information screen in this embodiment will be explained with reference to FIG. 22. FIG. 22 is a conceptual diagram showing an example of the usage information screen in this embodiment.

As shown in FIG. 22, the usage information screen 2200 in this embodiment has a usage information display column 2201. The usage information display field 2201 displays images of medical devices, usage information, and matching results. The image of the medical device, the usage information, and the verification result displayed on the usage information screen 2200 are the same as the verification result screen 2000 and the usage information screen 2100 in the first embodiment.

<Effects of the third embodiment>
The service providing server in this embodiment associates a comparison result with the medical device used in the surgery and usage information with the medical device used in the surgery, and displays the associated information on the display device. Therefore, according to the medical support system of this embodiment, information regarding medical equipment can be automatically provided to medical personnel without requiring any operation by a supporter.

[Fourth embodiment]
The medical support system 1 in the second embodiment displays the verification results of the medical equipment on the supporter terminal 20 installed in the support environment E2, and installs usage information of the medical equipment in the usage environment E1 according to the supporter's operation. The screen is configured to be displayed on a display device 11 that is The medical support system 1 in the fourth embodiment does not construct the support environment E2, but is configured to display the verification results of medical instruments on the display device 11 installed in the usage environment E1.

The medical support system 1 in this embodiment will be described below, focusing on the differences from the medical support system 1 in the second embodiment.

<Overall configuration of medical support system>
First, the overall configuration of the medical support system 1 in this embodiment will be described with reference to FIG. 23. FIG. 23 is a diagram showing an example of the overall configuration of the medical support system 1 in this embodiment.

As shown in FIG. 23, the medical support system 1 in this embodiment includes an acquisition device 10, a display device 11, an application server 21, and a service provision server 30. That is, the medical support system 1 in this embodiment differs from the medical support system 1 in the second embodiment (see FIG. 16) in that it does not include the supporter terminal 20.

<Functional configuration of medical support system>
Next, an example of the functional configuration of the medical support system 1 in this embodiment will be described with reference to FIG. 24. FIG. 24 is a block diagram illustrating the functional configuration of each device included in the medical support system 1 in this embodiment.

As shown in FIG. 24, the acquisition device 10, display device 11, application server 21, and service providing server 30 in this embodiment are the same as the acquisition device 10, display device 11, application server 21, and service provision server 30 in the second embodiment. It has the same functional configuration as the provision server 30.

<Processing procedure of medical support method>
Next, details of the medical support method executed by the medical support system 1 in this embodiment will be described with reference to FIG. 25. FIG. 25 is a sequence diagram showing an example of the medical support method in this embodiment.

As shown in FIG. 25, the medical support method according to the present embodiment is different from the medical support method according to the second embodiment (see FIG. 18) in that step S216 executed by the application server 21 and the supporter terminal The difference is that steps S202 and S203 that are executed by No. 20 are not performed.

Furthermore, the medical support method in this embodiment differs in the configuration of the screen information generated by the screen information generation unit 302 in step S217. Note that the usage information screen in this embodiment is similar to the usage information screen 2200 (see FIG. 22) in the third embodiment.

<Effects of the fourth embodiment>
In the medical support system in this embodiment, an application server installed in a support environment provides medical personnel with information regarding medical instruments present in an operating room. Therefore, the medical support system in this embodiment can be implemented without changing the service providing server. Further, even when the number of content distribution destinations increases, the load on the service providing server can be reduced.

Further, the application server in this embodiment associates a comparison result with the medical device used in the surgery and usage information with the medical device used in the surgery, and displays the associated information on the display device. Therefore, according to the medical support system of this embodiment, information regarding medical equipment can be automatically provided to medical personnel without requiring any operation by a supporter.

[Modification 1]
The medical support system 1 in the first embodiment is configured such that the service providing server 30 that distributes content also provides information regarding medical instruments present in the operating room. The medical support system 1 in Modification 1 is configured such that the supporter terminal 20 generates information regarding medical instruments present in the operating room and displays the verification results of the medical instruments used in the surgery.

The medical support system 1 in this modification will be described below, focusing on the differences from the medical support system 1 in the first embodiment.

<Functional configuration of medical support system>
First, an example of the functional configuration of the medical support system 1 in this modification will be described with reference to FIG. 26. FIG. 26 is a block diagram illustrating the functional configuration of each device included in the medical support system 1 in this modification.

≪Functional configuration of service providing server≫
As shown in FIG. 26, the service providing server 30 in this modification includes a communication control section 301, a room management section 304, a room information storage section 305, a content distribution section 306, a content storage section 307, and a message processing section 308. Equipped with

That is, the service providing server 30 in this modified example has a screen information generation unit 302, a screen information storage unit 303, an image recognition unit 311, and an image information generation unit 302, a screen information storage unit 303, an image recognition unit 311, and a The difference is that a storage section 312, a surgical information management section 313, a surgical information storage section 314, a usage information management section 315, and a usage information storage section 316 are not provided.

≪Functional configuration of supporter terminal≫
As shown in FIG. 26, the supporter terminal 20 in this modification includes a communication control unit 201, a screen display unit 202, a screen information generation unit 302, a screen information storage unit 303, an image recognition unit 311, an image information storage section 312 , a surgical information management section 313 , a surgical information storage section 314 , a usage information management section 315 , and a usage information storage section 316 .

The screen information storage unit 303, the image recognition unit 311, the image information storage unit 312, the surgical information management unit 313, the surgical information storage unit 314, the usage information management unit 315, and the usage information storage unit 316 are the service providing server in the first embodiment. It is similar to each part provided in 30.

<Processing procedure of medical support method>
Next, details of the medical support method executed by the medical support system 1 in this modification will be described with reference to FIG. 27. FIG. 27 is a sequence diagram showing an example of the medical support method in this modification.

In step S204, the communication control unit 201 included in the supporter terminal 20 receives the device ID and the device image from the service providing server 30. Next, the communication control unit 201 sends the received device image to the image recognition unit 311. Subsequently, the communication control unit 201 sends the received device ID to the surgical information management unit 313.

In step S205, the image recognition unit 311 included in the supporter terminal 20 recognizes medical instruments present in the operating room based on the instrument image received from the service providing server 30. Next, the image recognition unit 311 sends the recognition result of the medical instrument to the surgical information management unit 313.

In step S206, the surgical information management unit 313 included in the supporter terminal 20 acquires surgical information identified by the device ID received from the service providing server 30 from the surgical information storage unit 314.

In step S207, the surgical information management unit 313 included in the supporter terminal 20 receives the medical instrument recognition result from the image recognition unit 311. Next, the surgical information management unit 313 compares the medical instruments included in the received recognition result with the used instruments included in the acquired surgical information. Subsequently, the surgical information management section 313 sends the comparison result between the medical instrument and the instrument to be used to the screen display section 202.

In step S202, the screen information generation unit 302 included in the supporter terminal 20 receives the comparison result between the medical equipment and the used equipment from the surgical information management unit 313. Next, the screen information generation unit 302 generates screen information of a verification result screen based on the received verification results. Subsequently, the screen display unit 202 displays the matching result screen on the display 506 based on the screen information of the matching result screen generated by the screen information generating unit 302.

<Modification 1 applied to the second embodiment>
Although the above modification 1 has been explained using an example applied to the first embodiment, it can be similarly applied to the second embodiment.

In the first modification applied to the second embodiment, the supporter terminal 20 includes a communication control section 201, a screen display section 202, an image recognition section 311, an image information storage section 312, a surgical information management section 313, and a surgical information storage section 314. , a usage information management section 315 and a usage information storage section 316.

In the first modification applied to the second embodiment, the application server 21 includes a communication control section 211, a screen information generation section 302, and a screen information storage section 303. The service providing server 30 is similar to the service providing server 30 in the second embodiment.

<Effects of modification 1>
In the medical support system in this modified example, a supporter terminal generates information regarding medical equipment present in an operating room and provides it to the supporter and medical personnel. Therefore, the medical support system in this modification can be implemented without changing the service providing server. Furthermore, since the supporter terminal and the service providing server share the processing, it is possible to reduce the load on the service providing server even when the number of content distribution destinations increases.

[Modification 2]
The acquisition device 10 in the first embodiment is configured to transmit an image of a medical instrument existing in an operating room to the service providing server 30 as instrument information. The acquisition device 10 in Modification 2 is configured to transmit an image of identification information displayed on a medical device to the service providing server 30.

The medical support system 1 in this modification will be described below, focusing on the differences from the medical support system 1 in the first embodiment.

<Functional configuration of medical support system>
First, an example of the functional configuration of the medical support system 1 in this modification will be described with reference to FIG. 28. FIG. 28 is a block diagram illustrating the functional configuration of each device included in the medical support system 1 in this modification.

≪Functional configuration of service providing server≫
As shown in FIG. 28, the service providing server 30 in this modification includes a communication control section 301, a screen information generation section 302, a screen information storage section 303, a room management section 304, a room information storage section 305, and a content distribution section. section 306, content storage section 307, message processing section 308, image recognition section 311, image information storage section 312, surgical information management section 313, surgical information storage section 314, usage information management section 315, usage information storage section 316, identification information It includes a recognition section 317 and an identification information storage section 318.

That is, the service providing server 30 in this modification differs from the service providing server 30 in the first embodiment (see FIG. 5) in that it includes an identification information recognition section 317 and an identification information storage section 318.

The identification information recognition unit 317 recognizes identification information included in the device image received from the acquisition device 10. The identification information recognition unit 317 performs recognition using the identification information of the medical device stored in the identification information storage unit 318.

The identification information storage unit 318 stores device identification information that associates the identification information of a medical device with the type of the medical device. The device identification information in this modification is stored in an identification information management table that will be described later.

Here, the device identification information in this modification will be explained with reference to FIG. 29. FIG. 29 is a conceptual diagram showing an example of the identification information management table in this modification.

As shown in FIG. 29, the identification information management table 1700 in this modification has identification information of a medical device, type of medical device, etc. as data items.

<Processing procedure of medical support method>
Next, details of the medical support method executed by the medical support system 1 in this modification will be described with reference to FIG. 30. FIG. 30 is a sequence diagram showing an example of the medical support method in this modification.

In step S102, the information acquisition unit 102 included in the acquisition device 10 photographs medical instruments present in the operating room and generates an instrument image. At this time, the information acquisition unit 102 photographs the medical device so that the identification information displayed on it is reflected.

For example, a serial number, a bar code, a two-dimensional code, or the like can be used as the identification information. As a method for displaying identification information on a medical device, for example, pasting of a sticker on which identification information is printed or direct marking in which identification information is engraved with a laser or the like can be used. These identification information display methods are merely examples, and any method may be used as long as the identification information is displayed in an optically distinguishable manner.

In step S311, the identification information recognition unit 317 included in the service providing server 30 recognizes medical instruments present in the operating room based on the instrument image received from the acquisition device 10. Next, the identification information recognition unit 317 sends the recognition result of the medical device to the surgical information management unit 313.

Specifically, the identification information recognition unit 317 extracts the identification information of the medical device from the device image. Next, the identification information recognition unit 317 compares each extracted medical device identification information with each medical device identification information included in the device identification information. Subsequently, the identification information recognition unit 317 identifies the device identification information using the identification number extracted from the device image, and acquires the type of medical device included in the device identification information.

In step S305, the surgical information management unit 313 included in the service providing server 30 integrates the recognition result received from the identification information recognition unit 317 and the recognition result received from the image recognition unit 311. Next, the surgical information management unit 313 compares the medical instruments included in the integrated recognition results with the used instruments included in the acquired surgical information. Next, the surgical information management section 313 sends the comparison result between the medical instrument and the instrument to be used to the screen information generation section 302.

The subsequent processing is similar to the medical support method in the first embodiment.

<Effects of modification 2>
In the medical support system in this modification, an acquisition device photographs an instrument image so as to include identification information displayed on the medical instrument, and a service providing server recognizes the identification information included in the instrument image. Recognition of identification information can be performed with high precision compared to image recognition and the like. Therefore, according to the medical support system in this modification, medical instruments present in the operating room can be identified with high precision.

[Modification 3]
The acquisition device 10 in the first embodiment is configured to transmit an image of a medical instrument existing in an operating room to the service providing server 30 as instrument information. The acquisition device 10 in Modification 3 is configured to acquire identification information embedded in a medical device and transmit it to the service providing server 30.

The medical support system 1 in this modification will be described below, focusing on the differences from the medical support system 1 in the first embodiment.

<Functional configuration of medical support system>
First, an example of the functional configuration of the medical support system 1 in this modification will be described with reference to FIG. 31. FIG. 31 is a block diagram illustrating the functional configuration of each device included in the medical support system 1 in this modification.

≪Functional configuration of service providing server≫
As shown in FIG. 31, the service providing server 30 in this modification includes a communication control section 301, a screen information generation section 302, a screen information storage section 303, a room management section 304, a room information storage section 305, and a content distribution section. section 306, content storage section 307, message processing section 308, surgical information management section 313, surgical information storage section 314, usage information management section 315, usage information storage section 316, and identification information storage section 318.

That is, compared to the service providing server 30 in the first embodiment (see FIG. 5), the service providing server 30 in this modification example does not include the image recognition unit 311 and the image information storage unit 312, and does not include the identification information storage unit 318. It differs in that it is equipped with

<Processing procedure of medical support method>
Next, details of the medical support method executed by the medical support system 1 in this modification will be described with reference to FIG. 32. FIG. 32 is a sequence diagram showing an example of the medical support method in this modification.

In step S121, the information acquisition unit 102 included in the acquisition device 10 acquires identification information set on medical instruments present in the operating room. Next, the information acquisition unit 102 transmits the acquired identification information to the service providing server 30 via the communication control unit 301.

The identification information can be obtained using, for example, RFID. Identification information can be set in a medical device by, for example, embedding an RDIF tag with identification information written inside the medical device during manufacturing, or by placing an RDIF tag with identification information written on the surface of the medical device when it is used. It may also be pasted. These identification information setting methods are just examples, and any method may be used as long as the acquisition device 10 is embedded in a method that allows the acquisition device 10 to acquire identification information through wireless communication.

In step S321, the communication control unit 301 included in the service providing server 30 receives identification information from the acquisition device 10. Next, the communication control unit 301 sends the received identification information to the room management unit 304 and the surgical information management unit 313.

In step S304, the surgical information management unit 313 included in the service providing server 30 acquires the surgical information identified by the device ID received from the room management unit 304 from the surgical information storage unit 314.

In step S305, the surgical information management unit 313 included in the service providing server 30 compares the identification information received from the communication control unit 301 with each piece of identification information of a medical device included in the device identification information. Next, the surgical information management unit 313 identifies the device identification information using the identification number extracted from the device image, and acquires the type of medical device included in the device identification information.

Subsequently, the surgical information management unit 313 checks the identified medical equipment and the used equipment included in the acquired surgical information. Next, the surgical information management section 313 sends the comparison result between the medical instrument and the instrument to be used to the screen information generation section 302.

The subsequent processing is similar to the medical support method in the first embodiment.

<Effects of modification 3>
In the medical support system in this modification, an acquisition device acquires identification information set on a medical device and transmits it to a service providing server. The medical support system in this modification obtains identification information directly from the medical device without using image recognition or the like, and therefore can obtain identification information with high accuracy. Therefore, according to the medical support system in this modification, medical instruments present in the operating room can be identified with high precision.

[supplement]
In each of the above embodiments, the medical support system 1 is an example of an information processing system. The supporter terminal 20, the application server 21, and the service providing server 30 are examples of information processing devices. The acquisition device 10 is an example of an information processing terminal. The screen display section 202 and the screen information generation section 302 are examples of a result output section.

Each modification described above has been described using an example applied to the first embodiment, but can be similarly applied to the second to fourth embodiments.

Each function of the embodiments described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules.

The devices described in the embodiments are merely indicative of one of several computing environments for implementing the embodiments disclosed herein.

In some embodiments, a serving server includes multiple computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, an application server may include multiple computing devices configured to communicate with each other.

Further, the service provision server and the application server can be configured to share the disclosed processing steps in various combinations. For example, a process executed by a given unit may be executed by a service providing server. Similarly, the functionality of a given unit may be performed by an application server. Further, each element of the service providing server and the application server may be combined into one server device, or may be divided into multiple devices.

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to these embodiments, and various modifications or variations can be made within the scope of the gist of the present invention as described in the claims. Changes are possible.

1 Medical support system 10 Acquisition device 11 Display device 20 Supporter terminal 21 Application server 30 Service providing server 101 Communication control unit 102 Information acquisition unit 111 Communication control unit 112 Screen display unit 201 Communication control unit 202 Screen display unit 211 Communication control unit 301 Communication control unit 302 Screen information generation unit 303 Screen information storage unit 304 Room management unit 305 Room information storage unit 306 Content distribution unit 307 Content storage unit 308 Message processing unit 311 Image recognition unit 312 Image information storage unit 313 Surgery information management unit 314 Surgery Information storage unit 315 Usage information management unit 316 Usage information storage unit 317 Identification information recognition unit 318 Identification information storage unit

Patent No. 6693507

Claims (9)

An information processing device capable of communicating via a network with a first information processing terminal located in an operating room and a second information processing terminal used by a supporter located in a space different from the operating room,
a communication control unit that receives instrument information that is acquired by an acquisition device that is present in the operating room and that allows identification of medical instruments that are present in the operating room;
a content distribution unit that distributes images photographed by the acquisition device to the second information processing terminal;
Storing surgical information that associates a surgery performed in the operating room with a medical device used in the surgery in a storage unit, and comparing the medical device identified by the device information with the medical device included in the surgical information. A surgical information management department that conducts
a usage information management unit that stores usage information representing usage of the medical device in a storage unit and acquires the usage information in response to a request from the supporter;
a result output unit that transmits the collation result of the collation to the second information processing terminal and transmits the usage information to the first information processing terminal;
An information processing device comprising : The information processing device according to claim 1 ,
The device information includes an image taken of the medical device existing in the operating room,
further comprising an image recognition unit that recognizes the medical device included in the image;
Information processing device. The information processing device according to claim 2 ,
The image is a photograph of identification information displayed on the medical equipment present in the operating room,
further comprising an identification information recognition unit that recognizes the identification information included in the image;
Information processing device. The information processing device according to claim 1 ,
The device information is identification information set for the medical device existing in the operating room.
Information processing device. Information processing in which a first information processing terminal existing in an operating room, a second information processing terminal used by a support person existing in a space different from the operating room, and an information processing device can communicate via a network. A system,
The first information processing terminal includes:
a first communication control unit that transmits instrument information that can identify medical instruments present in the operating room and images taken in the operating room to the information processing device ;
a first screen display unit that displays usage information representing the usage of the medical device received from the information processing device;
Equipped with
The information processing device includes:
a second communication control unit that receives the device information and the image from the first information processing terminal;
a content distribution unit that distributes the image to the second information processing terminal;
Storing surgical information that associates a surgery performed in the operating room with a medical device used in the surgery in a storage unit, and comparing the medical device identified by the device information with the medical device included in the surgical information. A surgical information management department that conducts
a usage information management unit that stores the usage information in a storage unit and acquires the usage information in response to a request from the supporter;
a result output unit that transmits the collation result of the collation to the second information processing terminal and transmits the usage information to the first information processing terminal;
Equipped with
The second information processing terminal is
a second screen display unit that displays the matching result and the image received from the information processing device ;
a third communication control unit that transmits a request to transmit the usage information to the information processing device in response to an operation of the supporter;
Equipped with
Information processing system. An information processing system in which an information processing terminal located in an operating room and an information processing device used by a supporter located in a space different from the operating room can communicate via a network,
The information processing terminal is
a first communication control unit that transmits instrument information that can identify medical instruments present in the operating room and images taken in the operating room to the information processing device ;
a first screen display unit that displays usage information representing the usage of the medical device received from the information processing device;
Equipped with
The information processing device includes:
a second communication control unit that receives the device information and the image and transmits the usage information to the information processing terminal ;
Storing surgical information that associates a surgery performed in the operating room with a medical device used in the surgery in a storage unit, and comparing the medical device identified by the device information with the medical device included in the surgical information. A surgical information management department that conducts
a usage information management unit that stores the usage information in a storage unit and acquires the usage information in response to a request from the supporter;
a second screen display unit that displays the image and the results of the verification performed by the surgical information management unit;
Equipped with
Information processing system. A first information processing terminal existing in an operating room, a second information processing terminal used by a support person existing in a space different from the operating room , a first information processing device, and a second information processing device. An information processing system that can communicate via a network,
The first information processing terminal includes:
a first communication control unit that transmits, to the first information processing device, instrument information that allows identification of medical instruments present in the operating room and images taken in the operating room ;
a first screen display unit that displays usage information indicating the usage of the medical device received from the second information processing device;
Equipped with
The first information processing device includes:
comprising a second communication control unit that transmits the device information and the image received from the first information processing terminal to the second information processing device,
The second information processing device includes:
a third communication control unit that receives the device information and the image from the first information processing device;
a content distribution unit that distributes the image to the second information processing terminal;
Storing surgical information that associates a surgery performed in the operating room with a medical device used in the surgery in a storage unit, and comparing the medical device identified by the device information with the medical device included in the surgical information. A surgical information management department that conducts
a usage information management unit that stores the usage information in a storage unit and acquires the usage information in response to a request from the supporter;
a result output unit that transmits the collation result of the collation to the second information processing terminal and transmits the usage information to the first information processing terminal;
Equipped with
The second information processing terminal is
a second screen display unit that displays the matching result and the image received from the information processing device;
a fourth communication control unit that transmits a request to transmit the usage information to the second information processing device in response to an operation by the supporter;
Equipped with
Information processing system. A computer capable of communicating via a network with a first information processing terminal existing in the operating room and a second information processing terminal used by a supporter existing in a space different from the operating room,
storing in a storage unit surgical information that associates a surgery performed in the operating room with medical equipment used in the surgery;
a step of storing usage information representing usage of the medical device in a storage unit;
a step of receiving instrument information that is acquired by an acquisition device that is present in the operating room and that can identify the medical equipment that is present in the operating room;
a step of delivering an image photographed by the acquisition device to the second information processing terminal;
a step of comparing the medical device identified by the device information with the medical device included in the surgical information ;
a step of transmitting the matching result of the matching to the second information processing terminal;
a step of acquiring the usage information in response to a request from the supporter;
a step of transmitting the usage information to the first information processing terminal;
Medical assistance methods to perform . A computer capable of communicating via a network with a first information processing terminal existing in the operating room and a second information processing terminal used by a supporter existing in a space different from the operating room;
storing in a storage unit surgical information that associates a surgery performed in the operating room with medical equipment used in the surgery;
a step of storing usage information representing usage of the medical device in a storage unit;
a step of receiving instrument information that is acquired by an acquisition device that is present in the operating room and that can identify the medical equipment that is present in the operating room;
a step of delivering an image photographed by the acquisition device to the second information processing terminal;
a step of comparing the medical device identified by the device information with the medical device included in the surgical information ;
a step of transmitting the matching result of the matching to the second information processing terminal;
a step of acquiring the usage information in response to a request from the supporter;
a step of transmitting the usage information to the first information processing terminal;
A program to run .

Images