WO2019244896A1

WO2019244896A1 - Information processing system, information processing device, and information processing method

Info

Publication number: WO2019244896A1
Application number: PCT/JP2019/024149
Authority: WO
Inventors: 林　俊輔; 英人四方; 大生三浦; 昭彦中谷; 功史小幡
Original assignee: ソニー株式会社
Priority date: 2018-06-18
Filing date: 2019-06-18
Publication date: 2019-12-26
Also published as: US20210249109A1; CN112262437A; JPWO2019244896A1; JP7380557B2

Abstract

This information processing system is provided with: an acquiring unit for acquiring a first surgical record, which is a record of information relating to operation of a medical appliance used for surgery; a converting unit (101) for converting the first surgical record into a second surgical record by subjecting personal information of a patient, included in the first surgical record, to a protection process; an identification information generating unit (102) for generating first identification information associated with the first surgical record and second identification information associated with the second surgical record; and a determining unit (103) for determining, on the basis of rights information relating to the rights of a user, which of the first surgical record associated with the first identification information and the second surgical record associated with the second identification information to send to a node (30) used by the user.

Description

Information processing system, information processing apparatus and information processing method

The present disclosure relates to an information processing system, an information processing apparatus, and an information processing method.

In recent years, at a medical site, in order to analyze the operation situation after the operation, images obtained by an endoscope during the operation and images obtained by an operation field camera, the operation status of an electric scalpel and the like are recorded. I have. In addition, these surgical records are sometimes used for disclosure to academic societies and training purposes, and for accumulation for use in statistical analysis.

手術 However, since surgery records may include personal information such as the patient's face and name, it is necessary to protect personal information in order to share surgery records among many people. For example, Patent Literature 1 below discloses a technique for deleting personal information from a moving image file including a medical image and personal information without manual operation.

JP 2012-217631 A

However, according to the technology disclosed in Patent Document 1, if the use restriction is not imposed on the moving image file from which the personal information has not been deleted, the user can use the moving image file. As a result, a moving image file from which personal information has not been deleted may be obtained by an unspecified person, and the personal information of the patient may be leaked. As described above, from the viewpoint of sharing operation records, protection of personal information is required. On the other hand, from the viewpoint of recording operation status, it is required to preserve unmodified operation records.

Therefore, the present disclosure proposes an information processing system, an information processing apparatus, and an information processing method that can simultaneously store operation records and protect personal information.

According to the present disclosure, an acquisition unit that acquires a first operation record, which is a record of information on the operation of a medical device used for an operation in a hospital, and protects personal information of a patient included in the first operation record A conversion unit that performs processing and converts the first operation record into a second operation record, first identification information associated with the first operation record, and second identification information associated with the second operation record And a first operation record linked to the first identification information based on an attribute in the hospital or authority information on a user's authority determined based on the operation information. Alternatively, there is provided an information processing system including: a determination unit configured to determine whether the user can access any of the second operation records linked to the second identification information.

Further, according to the present disclosure, based on the authority information on the authority of the user, the user can determine which of the first operation record linked to the first identification information or the second operation record linked to the second identification information is the user's The first operation record is a record of information on operation of a medical device used for the operation, and the second operation record is the first operation record. An information processing apparatus is provided, which is a record converted from the first operation record by performing a protection process on the personal information of the patient included in the information.

Further, according to the present disclosure, the processor acquires the first operation record, which is a record of information on the operation of the medical device used for the operation, and protects the personal information of the patient included in the first operation record. To convert the second operation record into a second operation record that is an operation record in which the patient cannot be identified, the first identification information associated with the first operation record, and the second operation record associated with the second operation record. Generating the second identification information and the first operation record associated with the first identification information or the second operation associated with the second identification information based on the authority information on the authority of the user. Determining which of the records to send to the node used by the user.

According to the present disclosure, it is determined whether or not to transmit a moving image on which personal information protection processing has been performed to a node used by a user according to the authority of the user.

According to the present disclosure, as described above, it is possible to save the operation record and protect the personal information at the same time.

Note that the above effects are not necessarily limited, and any of the effects described in the present specification or other effects that can be grasped from the present specification are used together with or in place of the above effects. May be played.

FIG. 1 is an explanatory diagram illustrating a configuration of an information processing system according to a first embodiment of the present disclosure. FIG. 2 is a block diagram illustrating a configuration of the information processing apparatus according to the embodiment. It is a figure showing an example of the right information list used for the judgment by the judgment part concerning the embodiment. It is explanatory drawing which shows the structure of the surgery system concerning the embodiment. It is a flowchart which shows the flow of operation | movement from acquisition of the 1st operation | movement moving image by the information processing apparatus which concerns on the embodiment to storage. 4 is a flowchart illustrating a flow of a determination operation by a determination unit according to the embodiment. FIG. 11 is an explanatory diagram illustrating a configuration of an information processing device according to a second embodiment of the present disclosure. FIG. 3 is a diagram illustrating an example of an authority information list according to the embodiment. It is a flowchart which shows the flow of operation | movement from acquisition of the 1st operation | movement moving image by the information processing apparatus which concerns on the embodiment to storage. 4 is a flowchart illustrating a flow of a determination operation by a determination unit according to the embodiment. FIG. 14 is an explanatory diagram showing a display output to the node according to the embodiment; FIG. 17 is an explanatory diagram showing another display output to the node according to the embodiment; FIG. 13 is a block diagram illustrating a configuration of an information processing system according to a third embodiment of the present disclosure. It is a sequence diagram showing the flow of the operation by the information processing system according to the same embodiment. It is a sequence diagram by the information processing system which concerns on the same embodiment which shows the flow of the operation | movement from acquisition of 2nd operation | movement moving image to storage when a 1st operation | movement moving image and a 2nd operation | movement moving image are each stored in a different storage server. 1 is a block diagram illustrating a hardware configuration of an information processing system according to the present disclosure. FIG. 21 is a block diagram illustrating a modification of the configuration of the information processing system according to the present disclosure.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

The description will be made in the following order.
<1. First Embodiment>
<2. Second Embodiment>
<3. Third Embodiment>
<4. Hardware Configuration>
<5. Conclusion>

<1. First Embodiment>
[1.1. Constitution]
First, an information processing system 1 according to a first embodiment of the present disclosure will be described with reference to FIGS. FIG. 1 is an explanatory diagram illustrating an information processing system 1 according to the present embodiment. FIG. 2 is a block diagram illustrating a configuration of the information processing apparatus 10 according to the embodiment. FIG. 3 is a diagram illustrating an example of an authority information list used for determination by the determination unit 103 according to the embodiment.

The information processing system 1 according to the present embodiment includes an information processing device 10, a storage server 20, a node 30, a surgery system 40, and a network 50.

The information processing system 1 acquires a first operation record, which is a record of information relating to the operation of a medical device used for an operation, performs protection processing on patient personal information included in the first operation record, and performs a first operation. It has a function of converting a record into a second operation record. The information processing system 1 generates first identification information associated with the first operation record and second identification information associated with the second operation record. The information processing system 1 uses whichever of the first surgery record linked to the first identification information or the second surgery record linked to the second identification information based on the authority information related to the user's authority. It is determined whether or not to transmit to the node. In the present specification, the first operation record is a first operation image that is a record of information on the operation of a medical device used for the operation using a moving image, and the second operation record is a patient individual included in the first operation image. The present technology will be described by taking as an example a case where a first operation moving image is converted into a second operation moving image by performing a protection process on information.

Note that the first operation moving image includes any moving image that can be acquired during the operation. Examples of the first operation moving image include a moving image obtained by an endoscope, a moving image obtained by an operation field camera installed in an operating room, a moving image obtained by photographing a display screen of a peripheral measuring instrument, and a device used for the operation. And the moving image from which the status of the operation has been acquired. In addition, the first operation moving image may include a moving image acquired by a camera that captures a gaze direction of a person involved in the operation, for example, a surgeon, a nurse, a clinical engineer, or the like. A camera that captures a human gaze direction involved in the operation is attached to, for example, a glasses-type wearable device or an HMD (Head @ Mounted * Display). In addition, the first surgery moving image may include a moving image acquired by a surgery robot. It should be noted that the first operation moving image can include a plurality of moving images that can be acquired during the operation.

個人 In addition, the personal information referred to here is information that can identify a specific individual. The personal information includes information that can identify a specific individual by collating with other information. The personal information includes, for example, the face and name of the patient recorded in the moving image, the name of the patient included in the sound in the moving image, the voice of the patient, and the like. In addition, personal information includes not only the entire face but also the appearance determined by the color of the skeleton and skin of the face, the position and shape of the eyes, nose, mouth and other parts of the face, and the linear shape formed by the undulation of the iris surface May be included. In addition, the personal information may include, for example, a voiceprint of the patient as a characteristic of the patient's voice. Further, the personal information may include the shape, fingerprint or palm print of the vein, which is determined by the bifurcation and the end points of the vein under the skin of the patient's palm or the back of the hand or finger. Further, the personal information may be information that can identify a specific individual by combining a plurality of pieces of information. For example, information such as the age of a patient, the number of days of discharge, and medical history cannot be used to identify individual information alone, but information that can identify an individual using multiple pieces of information may be treated as personal information.

(4) In the personal information protection process, it is preferable that the personal information is processed by a method that can prevent the patient from being irreversibly specified. For example, it is preferable that the personal information be processed by mosaic processing or blackening processing. The protection of personal information may be performed by an encryption process that is an advanced encryption process and cannot be decrypted without a substantial encryption key. In the personal information protection processing, for example, it is determined whether or not a surgical operation moving image includes a patient's face or an operating room member's face by face recognition using machine learning. Then, mosaic processing or blackening processing is performed on the area recognized as a face. In the face recognition using machine learning, for example, an image with a label indicating a region including a human face is input as learning data to a machine learning model of a multilayer neural network, and parameters are generated. A predetermined one frame of a surgical moving image is input to an inference model of a multilayer neural network set based on these parameters. Thereby, it is possible to estimate a region including the face. Further, protection of personal information may be performed by image processing for replacing a patient's face or voice with another face or voice. As a result, the facial expression of the patient could not be observed in the mosaic process or the blackening process, but the facial expression of the patient during the operation can be observed by the replacement process while protecting personal information. For example, the face area of the patient is determined by face recognition using machine learning. Next, a replacement process is performed to replace the patient's face with another human face. By performing the face replacement process for each frame of the surgical moving image, personal information is protected. In addition, the facial expression of the patient (change that has occurred on the patient's face during the operation) can also be recorded in the second operation moving image. Note that the face and voice replacement processing is preferably performed by reinforcement learning using a multilayer neural network (for example, Generative @ Adversarial @ Networks). Also, a mark indicating whether or not face replacement has been performed may be superimposed on the second surgical moving image. This makes it easy to determine whether or not personal information is protected when a face considered to be a patient appears in the second operation moving image.

The information processing apparatus 10 includes an information processing unit 100, a communication unit 110, and a storage unit 120, as illustrated in FIG. The information processing unit 100 has a function of controlling processing of a surgical moving image acquired by the information processing device 10. The information processing unit 100 includes a conversion unit 101, an identification information generation unit 102, a determination unit 103, and an accompanying information generation unit 104.

The conversion unit 101 serves as an acquisition unit that acquires the first operation movie, and a conversion unit that performs protection processing on the patient's personal information included in the first operation image and converts the first operation image into the second operation image. It has the function of The conversion unit 101 obtains a first operation movie from the operation system 40 via the communication unit 110, and when the obtained first operation image includes personal information of a patient, performs a process of protecting the personal information and Has a function of converting to a second operation moving image in which the identification of the second operation is impossible. Specifically, the conversion unit 101 detects personal information in the first operation moving image. When the personal information is detected from the first operation moving image, the conversion unit 101 determines a personal information area in the first operation moving image and performs protection processing on the personal information area. The detection of the personal information and the determination of the personal information area can be performed by using the existing image recognition technology and image processing technology. As described above, the protection processing of the personal information in which the area is defined can be performed by a method capable of preventing the patient from being irreversibly specified. The first operation moving image before being converted into the second operation moving image is stored in the storage server 20 or the storage unit 120. Hereinafter, when there is no need to distinguish between the first operation moving image and the second operation moving image, the first operation moving image and the second operation moving image may be simply referred to as an operation moving image.

When personal information is included as audio data in the first operation video, the conversion unit 101 converts the audio data including information corresponding to the personal information into audio data that does not correspond to personal information by the existing audio processing technology. can do. For example, the conversion unit 101 may perform conversion of voice data of a portion corresponding to personal information into voice data not corresponding to personal information, deletion of voice data of a portion corresponding to personal information, and the like.

Regarding the presence / absence of personal information in the first operation moving image, the personal information in the operation is often included in the moving image acquired by the operation field camera. For this reason, when it is clear that the personal information is not included in the other moving images included in the first operation moving image, for example, the conversion unit 101 determines whether the video of the operation field camera is included in the first operation moving image. Thus, it is possible to determine the presence or absence of personal information in the first operation moving image. For example, when it is determined that the first surgery moving image is an endoscope moving image based on the accompanying information (for example, metadata) of the moving image, the possibility that the personal information is reflected is very low. It may be determined that personal information is not included in the video.

In addition, the 2nd operation | movement moving image is the operation | movement moving image converted into the moving image in which the personal information protection processing was performed among the 1st operation | movement moving images, and the operation | movement moving image in which the personal information protection processing was not performed among the 1st operation moving images. May be included. In addition, the second operation moving image may include only the operation moving image converted from the first operation moving image into a moving image in which personal information protection processing is performed.

The identification information generation unit 102 has a function of generating identification information for identifying the first operation moving image and the second operation moving image. Specifically, the identification information generation unit 102 sets a corresponding flag for each of the first operation moving image and the second operation moving image, and uses the flag as the identification information. The identification information includes first identification information associated with the first operation animation and second identification information associated with the second operation animation. Hereinafter, when it is not necessary to particularly distinguish the first identification information and the second identification information, the first identification information and the second identification information are simply referred to as identification information, and are linked to the first operation video as needed. The assigned identification information is referred to as first identification information, and the identification information associated with the second operation moving image is referred to as second identification information. The first identification information is identification information indicating that personal information is included in the first operation moving image, and is, for example, metadata indicating that personal information is included. The second identification information is identification information indicating that personal information is not included in the second operation moving image, and is, for example, metadata indicating that personal information is not included. The first identification information and the second identification information only need to be able to determine whether or not personal information is included. The data may directly include the presence or absence of personal information, or may indirectly include the presence or absence of personal information. May be included in the data. For example, the presence / absence of personal information may be directly included in the data by a flag indicating the presence / absence of personal information. Further, the presence or absence of personal information may be indirectly included in the data by, for example, information indicating a user who can access the first identification information or the second identification information.

The determination unit 103 determines whether the first surgery record linked to the first identification information or the second surgery record linked to the second identification information is determined by the user based on the authority information that is information regarding the authority of the user. It has a function of determining whether to transmit to the used node 30. The authority information includes information on the user, information on the access authority to the operation video, and the like. For example, as shown in FIG. 3, the attribute, the first operation video, and the second operation video linked to the user ID And the like of transmission permission / non-transmission. For example, the user ID “1” has information that the attribute is “administrator” and information indicating that both the first surgery moving image and the second surgery moving image can be transmitted to the node 30 that transmitted the user ID “1”. It is linked. Similarly, for example, the attribute is a doctor for the user ID “2”, and both the first operation moving image and the second operation moving image can be transmitted to the node 30 that has transmitted the user ID “2”. Information is linked. In addition, for example, the attribute of the user ID “100” is “Resident”, and the transmission of the first surgery moving image is not possible, and the transmission of the second surgery moving image to the node 30 that has transmitted the user ID “100”. Is associated with the information that is possible. Also, for example, information indicating that the user ID “8000” has the attribute “guest” and that neither the first surgery moving image nor the second surgery moving image can be transmitted to the node 30 that has transmitted the user ID “8000”. Is tied. Note that the authority information is preferably information based on attributes in the hospital. For example, authority information may be determined based on attributes (for example, doctors, residents, nurses, and the like) related to occupations included in a personnel information database in a hospital. In addition, the authority information is determined based on information on members related to the operation included in the operation information database that records information on the operation and information indicating the profession in the operation (eg, surgeon, assistant, nurse, etc.). May be.

The accompanying information generation unit 104 has a function of generating accompanying information relating to personal information, attached to the second surgical moving image. The accompanying information includes, for example, information on personal information included in the second operation moving image, and specifically, information such as timing and time when the moving image includes personal information. The incidental information generation unit 104 can generate incidental information using an existing image processing technique. The incidental information generation unit 104 may generate incidental information that accompanies the first surgery moving image. Hereinafter, if necessary, the accompanying information accompanying the first surgical moving image may be referred to as first accompanying information, and the accompanying information accompanying the second operating moving image may be referred to as second accompanying information.

The storage unit 120 appropriately records various programs and databases used when the information processing apparatus 10 executes the various processes described above. Further, the storage unit 120 may record various types of information generated by the information processing unit 100 as history information. For example, the storage unit 120 may store a first surgery moving image, a second surgery moving image, identification information, authority information, and accompanying information. Furthermore, in the storage unit 120, for example, when the conversion unit 101, the identification information generation unit 102, the determination unit 103, and the accompanying information generation unit 104 perform the above-described processing, various parameters that need to be saved, The progress of the processing may be recorded as appropriate. The processing is not limited to the processing performed by the conversion unit 101, the identification information generation unit 102, the determination unit 103, and the accompanying information generation unit 104, and various types of processing that need to be saved when the information processing apparatus 10 according to the present embodiment performs some processing. The parameters and the progress of the processing may be recorded in the storage unit 120 as appropriate. The information processing unit 100 and the communication unit 110 can freely perform read / write processing on the storage unit 120.

The communication unit 110 has a function of transmitting and receiving various types of information to and from the surgery system 40, the storage server 20, and the node 30 via the network 50. Specifically, the communication unit 110 receives the first operation moving image from the operation system 40 and outputs the first operation image to the information processing unit 100. The communication unit 110 also includes a first surgery moving image, a second surgery moving image obtained by converting the first surgery moving image, various information generated by the information processing unit 100, for example, identification information, accompanying information, and authority received from the node 30. Information and the like are transmitted to the storage server 20.

The storage server 20 stores the first operation moving image, the second operation moving image, the identification information, the authority information, and the accompanying information. The storage server 20 is connected to the information processing device 10, the node 30, and the surgery system 40 via a network 50. The storage server 20 stores the first surgery moving image, the second surgery moving image, the identification information, the authority information, and the accompanying information received from the information processing device 10, but may store the authority information received from the node 30. The first operation moving image received from the operation system 40 may be stored.

In addition, the first operation moving image, the second operation moving image, the identification information, and the accompanying information are stored in a folder to which a unique operation ID is assigned for each operation, and the folder is stored in the storage server 20 or the storage unit 120. Is also good. For the operation ID assigned at this time, for example, a number or a symbol is assigned to each operation-related information such as the type of operation, an operation site, a surgeon, and a date, and the operation ID is assigned by a combination of these numbers or symbols. May be done. Based on the operation ID, an operation moving image, identification information, and accompanying information relating to a predetermined operation can be transmitted to the node 30.

The node 30 is used when accessing an operation moving image, and is connected to the information processing apparatus 10, the storage server 20, and the operation system 40 via a network 50. The node 30 has a display for displaying at least one of the first operation moving image and the second operation moving image. A user using the node 30 is assigned a unique user ID owned by each user. When the user uses the node 30, for example, when the user logs in to the node 30, the user ID is transmitted from the node 30 to the information processing apparatus 10. The transmitted user ID is used for the determination by the determination unit 103. Note that the plurality of nodes 30 may be connected to the information processing device 10 and the storage server 20 via the network 50.

The operation system 40 has a function of acquiring a first operation moving image. Here, an example of the surgery system 40 will be described with reference to FIG. FIG. 4 is an explanatory diagram illustrating a configuration of the surgery system 40 according to the present embodiment.

において In an operating room to which the operating system 40 is applied, for example, a ceiling camera 411 and an operating room camera 413 are provided on the ceiling of the operating room. With the ceiling camera 411 and the operation site camera 413, it is possible to photograph an operator (doctor) 425 who performs a treatment on the affected part of the patient 423 on the patient bed 421 and the state of the entire operation room. The ceiling camera 411 and the operation site camera 413 may be provided with a magnification adjustment function, a focal length adjustment function, an imaging direction adjustment function, and the like. The lighting 415 is provided on the ceiling of the operating room and illuminates at least the operator 425. The illumination 415 may be capable of appropriately adjusting the irradiation light amount, the wavelength (color) of the irradiation light, the irradiation direction of the light, and the like.

The endoscopic surgery system 431, the patient bed 421, the ceiling camera 411, the operation site camera 413, and the lighting 415 are connected to be able to cooperate with each other. A centralized operation panel 433 is provided in the operating room. As described above, the user can appropriately operate these devices existing in the operating room via the centralized operation panel 433.

Hereinafter, a configuration that can be adopted by the surgery system 40 will be described by taking an example of endoscopic surgery. As shown in the figure, the surgical system 40 includes an endoscope 441, a surgical tool 443, a support arm device 451 supporting the endoscope 441, and a cart 461 on which various devices for endoscopic surgery are mounted. May be provided.

では In endoscopic surgery, instead of cutting the abdominal wall to open the abdomen, a plurality of tubular opening instruments are punctured into the abdominal wall. The endoscope 441 and the surgical tool 443 are inserted into the body cavity of the patient 423 from the opening formed by the opening device. In the illustrated example, an insufflation tube 445, an energy treatment tool 447, and forceps 449 are inserted into the body cavity of the patient 423 as the surgical tool 443. The energy treatment device 447 is a treatment device that performs incision and exfoliation of tissue, sealing of blood vessels, and the like by using high-frequency current and ultrasonic vibration.

画像 The image of the operative site in the body cavity of the patient 423 taken by the endoscope 441 is displayed on the display device 435. The operator 425 performs a procedure such as excision of the affected part using the energy treatment tool 447 and the forceps 449 while viewing the image of the operated part displayed on the display device 435 in real time.

The support arm device 451 supports the endoscope 441, and controls the position and the posture of the endoscope 441. Thereby, stable fixing of the position of the endoscope 441 can be realized.

The endoscope 441 has a region of a predetermined length from the distal end inserted into the body cavity of the patient 423. The light source device 463 is connected to the endoscope 441, and the light generated by the light source device 463 is emitted toward an observation target in the body cavity of the patient 423.

A $ CCU (Camera Control Unit) 462 includes a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and the like, and controls the operations of the endoscope 441 and the display device 435 in a centralized manner. Specifically, the CCU 462 provides an image signal to the display device 435. Further, the CCU 462 transmits a control signal to the endoscope 441 and controls the driving thereof. The control signal may include information on imaging conditions such as a magnification and a focal length. The information regarding the imaging condition may be input via the input device 465 or may be input via the centralized operation panel 433 described above.

The display device 435 displays an image based on the image signal under the control of the CCU 462. In addition, a plurality of display devices 435 having different resolutions and sizes may be provided according to applications.

The light source device 463 is configured by a light source such as an LED (light emitting diode), for example, and supplies the endoscope 441 with irradiation light at the time of imaging the operation site.

The arm control device 464 is constituted by a processor such as a CPU, for example, and operates according to a predetermined program to control the driving of the arm of the support arm device 451 according to a predetermined control method.

The input device 465 is an input interface to the endoscopic surgery system 431. The user can input various information and input instructions to the endoscopic surgery system 431 via the input device 465. For example, the user inputs, via the input device 465, various types of information related to surgery, such as patient's physical information and information about a surgical procedure. Further, for example, the user inputs an instruction to drive the arm unit via the input device 465, an instruction to change imaging conditions (such as the type of irradiation light, magnification, and focal length) of the endoscope 441, An instruction or the like for driving the energy treatment tool 447 is input.

The type of the input device 465 is not limited, and the input device 465 may be various known input devices. As the input device 465, for example, a mouse, a keyboard, a touch panel, a switch, a foot switch 471, and / or a lever can be applied. When a touch panel is used as the input device 465, the touch panel may be provided on a display surface of the display device 435.

Alternatively, the input device 465 is a device worn by the user, such as a glasses-type wearable device or an HMD (Head Mounted Display), and various inputs are performed in accordance with the user's gestures and eyes detected by these devices. Is performed. Further, the input device 465 includes a camera capable of detecting the movement of the user, and performs various inputs in accordance with the user's gesture and the line of sight detected from the video imaged by the camera. Further, the input device 465 includes a microphone capable of collecting a user's voice, and various inputs are performed by voice via the microphone. As described above, since the input device 465 is configured to be capable of inputting various kinds of information in a non-contact manner, a user (for example, the surgeon 425) particularly belonging to a clean area can operate a device belonging to a dirty area without contact. Becomes possible.

The treatment instrument control device 466 controls the drive of the energy treatment instrument 447 for cauterizing, incising, sealing blood vessels, and the like. The insufflation device 467 sends gas into the body cavity through the insufflation tube 445 to inflate the body cavity of the patient 423 for the purpose of securing the visual field by the endoscope 441 and securing the working space of the operator. . The recorder 468 is a device that can record various types of information related to surgery. The printer 469 is a device capable of printing various types of information on surgery in various formats such as text, images, and graphs.

The operation system 40 described above is merely an example, and other devices and devices may be applied as necessary, or the devices and devices described above may be omitted.

The surgery system 40 may have a camera that can acquire a display screen of the peripheral measuring instrument and a moving image of the operation status of the device. The first operation moving image is acquired by various cameras provided in the operation system 40 described above.

[1.2. motion]
So far, the configuration of the information processing system 1 according to the present embodiment has been described. Subsequently, an operation of the information processing apparatus 10 will be described with reference to FIGS. FIG. 5 is a flowchart showing a flow of operation from acquisition to storage of the first surgery moving image by the information processing apparatus 10 according to the present embodiment. FIG. 6 is a flowchart showing the flow of the determination operation by the determination unit 103 according to the present embodiment.

With reference to FIG. 5, a description will be given of an operation flow from the acquisition of the first operation movie to the information processing device 10 to the storage of the first operation movie, the second operation movie, and the accompanying information.

First, the information processing apparatus 10 acquires a first operation moving image from the operation system 40 provided in the operation room (S101). Specifically, the communication unit 110 receives the first surgery moving image from the surgery system 40 via the network 50 and outputs the first surgery moving image to the information processing unit 100. At this time, the first operation moving image may be stored in the storage server 20 or the storage unit 120.

Next, the conversion unit 101 included in the information processing unit 100 determines whether the first surgery moving image includes personal information (S103). When personal information is included in the first operation movie (S103 / YES), the first operation movie is converted into a second operation movie (S105). Subsequently, the identification information generation unit 102 generates identification information corresponding to the first operation moving image and the second operation moving image (S107). Specifically, the identification information generation unit 102 sets a flag corresponding to each of the first operation moving image and the second operation moving image, and sets the identification information associated with the first operation moving image and the second operation moving image. Generate.

Next, the incidental information generation unit 104 generates incidental information associated with the second operation moving image (S109). More specifically, the accompanying information generation unit 104 can generate information such as timing and time when personal information is included in a moving image by using an existing image processing technique.

The first operation moving image, the second operation moving image, the identification information, and the accompanying information are transmitted to the storage server 20 via the network 50 and stored (S111). Note that the first operation moving image, the second operation moving image, the identification information, and the accompanying information may be stored in the storage unit 120.

On the other hand, in step S103, when the first operation moving image does not include personal information (S103 / NO), the above-described conversion processing into the second operation moving image in S105 is not performed, and the identification information generation unit 102 performs Identification information corresponding to one operation moving image is generated (S107).

The generation of the identification information corresponding to the first operation moving image may be performed before the conversion into the second operation moving image (S105), or may be performed simultaneously with the conversion into the second operation moving image. Further, the order of the operations of the generation of the identification information (S107) and the generation of the accompanying information (S109) is not limited to the above, and the identification information may be generated after the generation of the accompanying information.

So far, the flow of operation from the acquisition of the first operation movie to the storage thereof by the information processing apparatus 10 has been described. Next, the flow of the determination operation by the determination unit 103 will be described with reference to FIG.

First, the determination unit 103 acquires a user ID from the node 30 (S201). At this time, the determination unit 103 receives the surgery ID input by the user from the node 30, and thereby the first surgery moving image, the second surgery moving image, the first accompanying information, and the Obtain second accompanying information.

Next, the determination unit 103 determines whether to transmit the second operation moving image to the node 30 based on the authority information (S203). The determination unit 103 searches for the user ID transmitted from the node 30 from the authority information list illustrated in FIG. 3, and transmits the second operation moving image to the node 30 based on the authority information associated with the user ID. Determine whether or not it is possible. For example, as illustrated in FIG. 3, when the node 30 is used by the user having the user ID “1”, the determination unit 103 determines that the second operation moving image can be transmitted to the node 30.

Next, when the determination unit 103 determines that the transmission of the second operation video to the node 30 is possible (S203 / YES), the determination unit 103 transmits the first operation video to the node 30 based on the authority information. It is determined whether or not to transmit (S205). For example, as illustrated in FIG. 3, when the determination unit 103 receives any of the user IDs “1” to “3”, “300”, “301”, and “9999”, the determination unit 103 It is determined that the first operation moving image can be transmitted (S205 / YES). As a result, the determination unit 103 determines that the first surgery moving image linked to the surgery ID and the second surgery moving image linked to the surgery ID can be transmitted to the node 30 (S207).

In S205, for example, as illustrated in FIG. 3, when the determination unit 103 receives any of the user IDs “100”, “101”, “200”, and “201”, the determination unit 103 It is determined that transmission of the first operation moving image is impossible (S205 / NO). As a result, the determination unit 103 determines that the second surgery moving image linked to the surgery ID can be transmitted to the node 30 (S208).

In S203, for example, as illustrated in FIG. 3, when the determination unit 103 receives the user ID “9999”, the determination unit 103 determines that transmission of the second surgery moving image to the node 30 is not possible ( S205 / NO). In this case, the determination unit 103 determines that neither the first surgery moving image nor the second surgery moving image can be transmitted to the node 30 (S206).

According to the present embodiment, the unaltered surgical moving image is stored, and it is determined whether to transmit the surgical moving image to the node used by the user. Therefore, an unaltered surgical moving image including personal information can be used only by an authorized user. As a result, leakage of personal information is prevented. Therefore, the information processing system according to the present embodiment makes it possible to simultaneously store the operation record and protect the personal information.

[1.3. Modification]
In the above embodiment, the case where one storage server 20 is provided has been described, but the information processing system according to this embodiment may include a plurality of storage servers. For example, if two storage servers are provided, one storage server may store the first operation movie and the other storage server may store the second operation movie. Since the first operation moving image and the second operation moving image are stored in different storage servers, security is enhanced, and leakage of personal information can be prevented.

<2. Second Embodiment>
[2.1. Constitution]
Subsequently, an information processing system 2 according to the second embodiment of the present disclosure will be described with reference to FIG. FIG. 7 is a block diagram illustrating a configuration of the information processing system 2 according to the present embodiment. The information processing system 2 according to the present embodiment includes an information processing device 11, a storage server 20, a node 30, a surgery system 41, and a network 50. In the present embodiment, the storage server 20 and the nodes 30 that can be applied to the information processing system 2 are the same as those described in the first embodiment, and thus detailed description thereof will be omitted.

The information processing apparatus 11 according to the present embodiment includes an information processing unit 100, a communication unit 110, a storage unit 120, and an output control unit 130. The information processing unit 100 includes a conversion unit 101, an identification information generation unit 102, a determination unit 103, a search unit 105, and an accompanying information generation unit 106. In the present embodiment, the conversion unit 101, the identification information generation unit 102, and the determination unit 103 are the same as those described in the first embodiment, and a detailed description thereof will be omitted.

The additional information generation unit 106 has a function of generating additional information associated with any information related to surgery, in addition to information associated with personal information. For example, the incidental information generation unit 106 generates, as incidental information, information on the type of operation, the operation flow, the progress of the operation, the amount of bleeding, the bleeding point, the timing of occurrence of bleeding, and the timing of using medical equipment. Can be. The incidental information generation unit 106 generates chapter information indicating the timing at which a predetermined operation has been performed as incidental information by applying, for example, an information adding technique to a moving image file disclosed in Japanese Patent Application Laid-Open No. 2016-42982. can do. Also, the incidental information generation unit 106 can generate the timing of bleeding occurrence and the timing at which a medical device is used as incidental information by applying, for example, the image recording technology disclosed in Japanese Patent Application Laid-Open No. 2011-36372. Can be. The additional information generation unit 106 can generate information on a bleeding point and a bleeding amount in a surgical moving image as additional information by applying, for example, an image processing technique disclosed in Japanese Patent Application Laid-Open No. 2011-36371. . The accompanying information generated by the accompanying information generating unit 106 can be attached to any of the first operation moving image and the second operation moving image.

(4) The accompanying information generating unit 106 may tag the generated accompanying information. The tagged attached information is displayed in a tag information display column 305 of the node 30 described later. Further, the accompanying information generation unit 106 applies the existing image analysis technology to analyze the movement of a person involved in the operation, for example, the movement of a nurse, from the moving image of the operation field camera, and tags the movement of the nurse. May be generated.

The search unit 105 has a function of searching for a surgical moving image stored in the storage server 20 or the storage unit 120. Specifically, based on the information input using the node 30, a corresponding operation video is searched. The search unit 105 may search for a corresponding operation video based on the operation ID. A search result by the search unit 105 is output to the node 30 by the output control unit 130.

The output control unit 130 has a function of controlling information output to the node 30 based on the authority information. For example, the output control unit 130 refers to the authority information associated with the user ID transmitted from the node 30 to control a surgical operation video to be output to the node 30 and a process executable by the node 30. Further, the output control unit 130 may have a function of outputting a search result by the search unit 105 to the node 30.

Here, the control executed by the output control unit 130 will be described in detail with reference to FIG. FIG. 8 is a diagram illustrating an example of the authority information list according to the present embodiment. For example, as shown in FIG. 8, the authority information list includes an attribute, an access level, whether or not transmission of an operation video is possible, and whether or not the operation video and accompanying information are stored, which are linked to the user ID. The output control unit 130 can control the output to the node 30 according to the access level associated with the user ID. More specifically, the output control unit 130 can control, for example, an operation video that can be output, types of accompanying information that can be output, types of an operation video that can be stored in the node 30, and types of auxiliary information, according to the access level. .

For example, the output control unit 130 can control the transmission of the first surgery moving image and the second surgery moving image to the node 30 having the user ID whose access level is “1”. The output control unit 130 can perform control so that the node 30 having the user ID whose access level is “1” can store the first surgery moving image, the second surgery moving image, the first accompanying information, and the second accompanying information. In addition, the output control unit 130 can control, for example, to transmit the first surgery moving image and the second surgery moving image to the node 30 of the user ID whose access level is “2” or “5”. . The output control unit 130 controls the node 30 whose access level is “2” or “5” so that the node 30 cannot store the first surgery moving image and the first accompanying information but can store the second surgery moving image and the second accompanying information. can do. In addition, the output control unit 130 controls, for example, to transmit the second surgery moving image without transmitting the first surgery moving image to the node 30 of the user ID whose access level is “3” or “4”. can do. The output control unit 130 controls the node 30 whose access level is “3” or “4” so that the node 30 cannot store the first surgery moving image and the first accompanying information but can store the second surgery moving image and the second accompanying information. can do. Further, the output control unit 130 can control, for example, not to transmit any of the first surgery moving image and the second surgery moving image to the node 30 of the user ID whose access level is “9”. The output control unit 130 can perform control so that the node 30 whose access level is “9” cannot store the first surgery moving image, the second surgery moving image, the first incidental information, and the second incidental information.

The access level may be set according to the user ID, the attribute, the access location, the access method, the type of the node 30, and the like. For example, for a user whose attribute is a surgeon, the access level is set to be high, and both the first operation video and the second operation video can be used, and many types of accompanying information can be used. Good. The access level may be set low for a user whose attribute is a resident, so that the user can use only the second surgery moving image and can use limited accompanying information. Further, for example, the access level is set high for the node 30 accessing the information processing apparatus 11 from the network in the hospital, and for the node 30 accessing the information processing system 2 via another network. Alternatively, the access level may be set low. Further, for example, when the node 30 is, for example, a PC, the access level is set high for the node 30, and when the node 30 is a mobile terminal, the access level is set low for the node 30. Is also good.

(4) The output control unit 130 may change the display screen output by the node 30 according to a user attribute or an access level. For example, the output control unit 130 may display a first display screen 300A in which a first operation video and a second operation video are displayed in a switchable manner, and a second display screen in which only the second operation video is displayed without displaying the first operation video. The second display screen 300B may be output. The first display screen 300A is output to the node 30 that has been determined by the determination unit 103 to be able to transmit the first surgery moving image. The second display screen 300B is output to the node 30 in which the determination unit 103 determines that transmission of the first surgery moving image is not possible and transmission of the second surgery moving image is possible. Here, the display screen output by the output control unit 130 to the node 30 will be described in detail with reference to FIGS. 9 and 10. FIG. 9 is an explanatory diagram of a first display screen 300A that displays the first surgery moving image and the first accompanying information output to the node 30 according to the present embodiment. FIG. 10 is an explanatory diagram of the second display screen 300B that displays the second surgery moving image and the second accompanying information output to the node 30 according to the present embodiment.

First, with reference to FIG. 9, a first display screen 300A that is a display screen of the node 30 to which the first operation moving image and the accompanying information are output will be described. On the first display screen 300A, an attribute display column 301, an information column 302, a main display area 303, a tag selection column 304, a tag information display column 305, a timeline column 306, a related moving image display column 307, a search column 308, a selection button 309, an operation video conversion button 310 and a setting field 311 are displayed.

The attribute display column 301 displays the attribute associated with the user ID. In FIG. 9, “doctor”, which is the attribute of the user, is displayed as an example. The attribute display column 301 is not limited to the attribute, and may display a user ID and the name of the user associated with the user ID.

In the information column 302, information on the operation moving image displayed in the main display area 303 is displayed. For example, the information column 302 displays information such as a patient name, an operation date, an operation place, a surgeon, and operation conditions. The operating conditions include, for example, open surgery, endoscopic surgery, and the presence or absence of complications.

In the main display area 303, a first surgery moving image is displayed. In the main display area 303, one moving image of the first surgery moving image may be displayed, or a plurality of moving images may be displayed. The moving image displayed in the main display area 303 can be selected by the user with the select button 309 for the moving image to be displayed. Further, the main display area 303 may display a patient's electronic medical record.

In the tag selection field 304, a plurality of tags attached by the accompanying information generation unit 106 are displayed, and one of the plurality of tags is selected by the user. In the tag information display column, accompanying information corresponding to the selected tag is displayed. For example, when the user selects an electrosurgical scalpel in the tag selection field 304, the tag information display field 305 displays the electrosurgical scalpel used in the surgery in which the operation video displayed in the main display area 303 was acquired. Information about changes is displayed in chronological order. For example, as shown in FIG. 9, the electric knife is changed from the stop mode to the standby mode at time t1, the electric knife is changed from the standby mode to the cutting mode at time t2, and the electric knife is changed from the cutting mode to the stop mode at time t3. May be displayed. Further, for example, the accompanying information displayed in the tag information display column 305 may be linked to an icon displayed in a timeline column 306 described later. The information that can be displayed in the tag information display column 305 can be associated information that changes during the operation, such as information on each step of the operation, the timing of the change in the display of the patient's personal information, Changes in anesthesia status, bleeding occurrence timing, bleeding amount change, alarm generation timing by a medical device, change in the state of a patient, and the like. Further, when the information of each time displayed in the tag information display field 305 is selected by the user, the moving image of the selected time may be displayed in the main display area 303.

In the timeline column 306, a timeline of the first operation moving image displayed in the main display area 303 is displayed. On the timeline, a display indicating the playback position of the moving image displayed in the main display area 303 may be displayed, or an icon indicating the time at which a predetermined event has occurred may be displayed. The event may be, for example, one displayed in the tag information display field 305. For example, when the user selects an electric scalpel in the tag selection field 304 and the information about the change of the electro scalpel is displayed in a time series in the tag information display field 305, the timeline displays the position corresponding to each time. An icon may be displayed. For example, in FIG. 9, icons are displayed on the time line at positions corresponding to times t1, t2, and t3. When the icon displayed on the timeline is selected by the user, the moving image at the selected time may be displayed in the main display area 303.

In the related moving image display column 307, for example, an operation moving image related to the operation moving image displayed in the main display area 303 may be displayed. In the related moving image display column 307, for example, in the same operation as the operation moving image displayed in the main display area 303, a first operation moving image, which is different from the operation moving image displayed in the main display area 303, is displayed. It may be displayed. Specifically, in the case of one endoscopic operation, and the first operation moving image displayed in the main display area 303 is a moving image acquired by an operation field camera, a “moving image” displayed in the related moving image display column 307 is displayed. The moving image acquired by the endoscope may be displayed on “A”. Similarly, for example, in “B” shown in the related moving image display column 307, a moving image of the same endoscopic operation, in which the display screen of the peripheral measuring instrument is captured, may be displayed. In “C” shown in the display field 307, a moving image acquired by a camera that captures the state of the nurse's line of sight may be displayed.

In addition, in the related moving image display column 307, for example, a moving image related to the information displayed in the information column 302 may be displayed. In the “T” shown in the related moving image display column 307, for example, a first operation moving image of a different operation performed at the same position as the operation position displayed in the information column 302 may be displayed. Similarly, for example, “S” shown in the related moving image display column 307 may display a first operation moving image of another operation performed by the surgeon displayed in the information column 302, or may be a related moving image. In the “U” shown in the display column 307, a first operation moving image of the operation close to the operation condition displayed in the information column 302 may be displayed.

関連 Further, in the related moving image display column 307, for example, a first surgery moving image searched by the user may be displayed. In “W” shown in the related moving image display field 307, for example, a first surgery moving image having the highest degree of relevance to the search term input in the search field 308 may be displayed. In “V” and “X” shown in the related moving image display column 307, a first operation moving image having a relatively high degree of relevance to the search term may be displayed.

In the search field 308, the user may input a surgery ID or a search phrase in order to search for a first surgery moving image desired by the user from among the first surgery moving images stored in the storage server 20. By inputting at least a part of the operation ID, the patient name, the operation date, the operation place, the surgeon, the operation condition, and the like in the search column 308, the corresponding first operation moving image is searched from the search term. The searched first operation moving image may be displayed in the related moving image display column 307.

The selection button 309 is used by the user to select a surgery moving image and a display format displayed in the main display area 303. In accordance with the display format displayed on the selection button 309, a moving image is displayed in the main display area 303. For example, in FIG. 9, four types of buttons are displayed, and when the button “A” is selected by the user, “A” displayed in the related moving image display column 307 is displayed in the main display area 303. Further, for example, when the button “AB” is selected by the user, “A” and “B” displayed in the related moving image display column 307 are displayed side by side in the main display area 303. As described above, when the operation moving image or the display format is selected by the selection button 309, another operation moving image displayed in the related moving image display column 307 is displayed in the main display area 303. Further, with the selection of the predetermined operation video selected by the selection button 309, the accompanying information displayed in the tag information display column 305 and the timeline displayed in the timeline column 306 correspond to the selected operation video. It is changed to accompanying information.

The operation video conversion button 310 converts the operation video displayed on the display screen of the node 30 from the first operation video to the second operation video. The operation video conversion button 310 is displayed on the node 30 having a user ID capable of receiving the first operation video.

In the setting field 311, various settings of the display screen of the node 30 are performed by the user. In the setting column 311, for example, the order of the operation videos displayed in the related video display column 307 can be changed by a user's instruction, and the operation videos with good surgical results are displayed above the operation videos with poor operation results. It may be changed as follows. In the setting column 311, for example, the user sets fonts to be used, character sizes, search items, and the like.

Next, a second display screen 300B, which is a display screen of the node 30 to which the second operation moving image and the second accompanying information have been output, will be described with reference to FIG. The second display screen 300B is displayed on the node 30 that has been determined by the determination unit 103 to be unable to transmit the first operation moving image and to be able to transmit the second operation moving image. Therefore, on the second display screen 300B, a second surgery moving image on which personal information protection processing has been performed is displayed. On the second display screen 300B, an attribute display column 301, an information column 302, a main display area 303, a tag selection column 304, a tag information display column 305, a timeline column 306, a related moving image display column 307, a search column 308, a selection button 309, a setting field 311, a voting button 312, and a reference level display field 313 are displayed. The attribute display column 301, the information column 302, the timeline column 306, the search column 308, the selection button 309, and the setting column 311 on the second display screen are the same as those displayed on the first display screen. Is omitted.

In the main display area 303, an electronic medical record of a patient may be displayed similarly to the first display screen 300A, but the electronic medical record displayed on the second display screen 300B is different from the personal information included in the electronic medical record. The ones that have been protected are displayed.

The tag information display column 305 of the second display screen 300B may display accompanying information according to the user attribute or access level. For example, if the user's attribute is trainee, the tag information may display only the progress of the operation and the change in the electric scalpel.If the user's attribute is a clinical engineer, Changes of all medical devices used for the operation may be displayed. If the attribute of the user is an anesthesiologist, the tag information display column 305 may display an anesthesia status. When the attribute of the user is an anesthesiologist, the facial expression of the patient is important. Therefore, information indicating the facial expression of the patient (for example, information on the facial expression subjected to the replacement process) may be displayed. In the tag information display column 305, for example, the tag generated for the movement of the nurse, which is obtained by analyzing the movement of a person involved in the operation, for example, a nurse from the moving image of the operation field camera by the accompanying information generation unit 106, is displayed. It may be displayed. The tag information display column 305 may display, for example, surgical instrument information used for the operation, specifically, the type of forceps and the type of thread used for suturing. Further, accompanying information based on the billing information may be displayed in the tag information display column 305 of the second display screen 300B. For example, charging information associated with the accessed user is read from a charging information database including charging information indicating a charging amount or a charging plan of the user. The associated information is displayed in the tag information display column 305 of the second display screen 300B based on the table information in which the accounting information and the associated information that can be displayed are recorded in advance. As a result, the amount of display information can be controlled based on the billing information. Alternatively, a tag may be provided that generates information on the position of a blood vessel by analyzing a moving image, and superimposes and displays information indicating the position of the blood vessel on the moving image.

(4) In the tag selection field 304, a tag of "comment" may be registered in advance as a selection candidate. For example, when the tag “comment” is selected, the comments input by the user may be displayed in the tag information display column 305 in the order of the playback time of the moving image. As a result, information can be exchanged between users who use one surgical moving image at different timings. As a result, information not included in the accompanying information can be complemented by the user's comment. For example, information on medical devices used for surgery, specifically, information on medical device manufacturers, models, etc., and information on criteria for selecting a surgical tool used for surgery are exchanged between users. It becomes possible.

In the related moving image display column 307, a search result according to a user attribute or an access level may be displayed. For example, if the user is a resident, the resident may be able to search for a surgical video by the type of illness, the affected part, the treatment, the sex of the patient, the age or the patient's smoking habit, a surgeon, etc. Good.

The reference degree display column 313 is arranged corresponding to the second operation moving image displayed in the related moving image display column 307, and displays the reference degree of the operation moving image. For example, the voting button 312 is a button used by the user when it is determined that the second operation moving image displayed in the main display area 303 is useful for the user, and the voting button 312 is pressed by the user. In this case, the reference degree of the second operation moving image is increased. In the related moving image display column 307, the second operation moving image with a high reference level may be displayed above the second operation moving image with a low reference level. In addition, supplementary information regarding the corresponding operation moving image may be displayed in the reference degree display column 313. For example, in the reference degree display column 313, information such as the publication status of the surgical operation moving image, specifically, whether or not the operation moving image has been published, the purpose of publication, and the date and time may be displayed.

The output control unit 130 may control the second display screen 300B to display differently according to the attribute or the access level. When the user is a resident, the second display screen 300B may display a surgical operation video recommended by a doctor.

Since the first operation video is not displayed on the second display screen, the operation video conversion button 310 displayed on the first display screen is not displayed.

The output control unit 130 may change the image quality of the surgical operation video displayed on the node 30 according to the access level.

The operation system 41 transmits, to the information processing apparatus 11, information on the operation status of the medical device used for the operation, in addition to the first operation moving image. The transmitted information on the operation status of the medical device may be used as accompanying information and may be displayed in the tag information display field 305 described earlier.

[2.2. motion]
So far, the configuration of the information processing system 2 according to the present embodiment has been described. Subsequently, an operation of the information processing apparatus 11 will be described with reference to FIGS. FIG. 11 is a flowchart showing a flow of an operation from acquisition to storage of the first surgery moving image by the information processing apparatus 11 according to the present embodiment. FIG. 12 is a flowchart showing the flow of operation from the acquisition of authority information by the information processing apparatus 11 according to the present embodiment to the output to the node 30.

With reference to FIG. 11, a description will be given of the operation flow from the acquisition of the first surgery moving image by the information processing apparatus 10 to the storage of the first surgery moving image, the second surgery moving image and the accompanying information. Steps S303, S305, S307, and S311 shown in FIG. 11 are the same as steps S103, S105, S107, and S111 described in the first embodiment, respectively, and thus detailed description thereof will be omitted.

First, the information processing apparatus 11 acquires a first operation moving image from the operation system 41 provided in the operation room (S301). Specifically, the communication unit 110 receives the first surgery moving image from the surgery system 40 via the network 50 and transmits the first surgery moving image to the information processing unit 100. At this time, the communication unit 110 may receive, from the operation system 41, information on the operation status of the medical device used for the operation. The first operation video and the information on the operation status of the medical device may be stored in the storage server 20 or the storage unit 120.

In S309, accompanying information accompanying the second operation moving image associated with the first operation moving image is generated. Specifically, the accompanying information generation unit 106 generates accompanying information that accompanies all information related to the timing and time at which personal information is included in the moving image and surgery. For example, the accompanying information generation unit 106 attaches information on the type of surgery, the flow of surgery, the progress of surgery, the amount of bleeding, the bleeding location, the timing of bleeding occurrence, the timing of using medical equipment, the movement of nurses, and the like. Generate as information. The incidental information generation unit 106 generates the incidental information based on the first operation moving image, the second operation moving image, the information on the operation status of the medical device transmitted from the operation system 41, and the like.

Next, with reference to FIG. 12, an operation flow from the acquisition of the authority information by the information processing apparatus 11 to the output to the node 30 will be described. Each of S401, S403, S405, S406, S407, and S408 shown in FIG. 12 is the same as S201, S203, S205, S206, S207, and S208 described in the first embodiment, respectively. Detailed description is omitted.

If the determining unit 103 determines that both the first operation video and the second operation video can be transmitted (S407), the node 30 can display the first display screen (S409). ). The user can use the first surgery video, the second surgery video, the accompanying information, the surgery video related to the first surgery video or the second surgery video displayed on the first display screen 300A of the node 30, and the like.

(4) When the determination unit 103 determines that the second operation moving image can be transmitted (S408), the node 30 can display the second display screen (S410). The user can use the second operation movie displayed on the second display screen of the node 30, the accompanying information, and the operation movie related to the second operation movie.

According to the present embodiment, the node 30 can display a type of operation moving image and accompanying information according to the access level of a user who uses the operation moving image. Thereby, while protecting the patient's personal information displayed in the operation video, the operation video can be used from a different viewpoint for one operation depending on the attribute and purpose of the user. As a result, it is possible to provide a user with a highly convenient operation moving image while protecting personal information. For example, according to the information processing system according to the present embodiment, it is possible to store an unaltered operation movie recorded during an operation and to use a patient as a learning material for medical staff or learning data for machine learning. It is possible to use an operation video in which personal information of the user is protected.

手術 In addition, by storing the operation video recorded during the operation without any modification, it is possible to easily identify a patient by confirming the personal information included in the operation video, if necessary.

<3. Third Embodiment>
[3.1. Constitution]
Subsequently, an information processing system 3 according to the third embodiment of the present disclosure will be described with reference to FIG. FIG. 13 is a block diagram illustrating a configuration of the information processing system 3 according to the present embodiment. The information processing system 3 according to the present embodiment includes an information processing device 12, a storage server 20, a node 30, a surgery system 41 (not shown), a network 50 (not shown), and an access server 60. In this embodiment, the storage server 20 and the node 30 that can be applied to the information processing system 3 are the same as those described in the first embodiment, and the operation system 41 is the same as that described in the second embodiment. Since it is the same, detailed description is omitted here.

The information processing device 12 according to the present embodiment includes an information processing unit 100, a communication unit 110, a storage unit 120, and an output control unit 131. The information processing unit 100 includes a conversion unit 101, an identification information generation unit 102, a determination unit 103, an accompanying information generation unit 106, and a search unit 105. In the present embodiment, the conversion unit 101, the identification information generation unit 102, the determination unit 103, the accompanying information generation unit 106, the search unit 105, the communication unit 110, and the storage unit 120 are the same as those described in the second embodiment. Therefore, detailed description is omitted here.

The output control unit 131 controls the operation moving image and the accompanying information output to the node 30. For example, the output control unit 131 controls the operation moving image and the accompanying information corresponding to the determination result of the determination unit 620 included in the access server 60 described below.

The node 30 accesses the information processing device 12 or the storage server 20 via the access server 60. The access server 60 has a communication unit 610 and a determination unit 620.

The communication unit 610 has a function of transmitting and receiving various information to and from the information processing device 10, the storage server 20, and the node 30 via the network 50. Specifically, the communication unit 610 receives the first surgery moving image, the second surgery moving image, the accompanying information, and the identification information from the surgery system 41 or the storage server 20. Further, the communication unit 610 receives an instruction from the node 30, a user ID, and the like, and transmits an operation moving image, accompanying information, and the like to the node 30 according to the instruction content from the node 30 or the determination performed by the determination unit 620. Further, the communication unit 610 transmits to the storage server 20 the first surgery moving image, the second surgery moving image, and various information generated by the information processing unit 100, for example, identification information, accompanying information, authority information received from the node 30, and the like. I do.

The determination unit 620 has a function of determining whether to transmit the first operation moving image to the node 30 and whether to transmit the second operation moving image to the node 30 based on the authority information transmitted from the node 30. Specifically, the determination unit 620 determines whether or not to transmit a surgery moving image based on the user ID transmitted from the node 30 and, for example, the authority information list illustrated in FIG.

[3.2. motion]
Subsequently, the operation of the information processing system 3 will be described with reference to FIG. FIG. 14 is a sequence diagram showing a flow of an operation from acquisition to storage of the first surgery moving image by the information processing system 3 according to the present embodiment.

The operation system 41 transmits, to the information processing apparatus 12, the first operation moving image and information on the operation status of the medical device used for the operation to the information processing apparatus 10 (S501). When personal information is included in the first surgery moving image, the information processing device 12 converts the first surgery moving image into the second surgery moving image by the conversion unit 101 (S503). The first operation moving image and the second operation moving image are transmitted to the storage server 20 (S505). Further, the information processing device 12 causes the accompanying information generation unit 104 to generate accompanying information associated with the first surgery moving image and the second surgery moving image (S507). The node 30 transmits the authority information to the information processing device 12 and the access server 60 (S509). The information processing device 12 selects, based on the transmitted authority information, incidental information that can be transmitted to the node 30 of the authorized user, and transmits the incidental information to the storage server 20 (S511). The access server 60 causes the determination unit 620 to determine whether to transmit the first surgery moving image to the node 30 and whether to transmit the second surgery moving image to the node 30 based on the authority information transmitted from the node 30 (S513). The access server 60 transmits a transmission instruction of the operation moving image and the accompanying information to the storage server 20 based on the determination result (S515). The storage server 20 transmits the corresponding operation moving image and accompanying information to the access server 60 based on the transmission instruction transmitted from the access server 60 (S517). Next, the access server 60 transmits the received operation moving image and the accompanying information to the node 30 (S519). Then, the node 30 displays the received operation moving image and the accompanying information (S521). For example, the node 30 displays the first display screen when receiving the first operation video, and displays the second display screen when receiving the second operation video without receiving the first operation video. .

According to the information processing system according to the present embodiment, since the information processing apparatus 12 transmits the accompanying information corresponding to the predetermined authority information to the storage server 20, the unauthorized accompanying information may be transmitted to the node 30. Is prevented. In addition, the determination unit 620 provided in the access server 60 that is physically separated from the information processing apparatus 12 that generates the accompanying information determines whether or not to transmit the surgery moving image to the node 30, so that the possibility of information leakage is further reduced. It becomes possible to reduce.

[3.3. Modification]
In the above embodiment, the case where one storage server 20 is provided has been described, but the information processing system 3 according to the present embodiment may include a plurality of storage servers. For example, if two storage servers are provided, one storage server 21 may store the first surgery moving image, and the other storage server 22 may store the second surgery moving image. With reference to FIG. 15, a description will be given of an operation flow from acquisition to storage of the second operation moving image when the first operation moving image and the second operation moving image are stored in different storage servers. FIG. 15 is a sequence diagram illustrating a flow of an operation from acquisition to storage of the second operation moving image when the first operation moving image and the second operation moving image are stored in different storage servers. Note that S601, S603, and S613 shown in FIG. 15 are the same as S501, S503, and S513 described earlier, respectively, and thus description thereof will be omitted. The storage server 21 corresponds to a first storage server according to the present disclosure, and the storage server 22 corresponds to a second storage server according to the present disclosure.

The first operation moving image transmitted to the information processing device 12 is transmitted to the storage server 21 (S602). After the information processing device 12 converts the first operation moving image into the second operation moving image (S603), the information processing device 12 transmits the second operation moving image to the storage server 22 (S605). Next, the first additional information and the second additional information are generated by the additional information generator 106 provided in the information processing device 12 (S607). Subsequently, the information processing device 12 transmits the first accompanying information to the storage server 21 and transmits the second accompanying information to the storage server 22 (S609).

The node 30 transmits the authority information to the access server 60 (S611). In S613, when the determination unit 620 determines that the first surgery moving image cannot be transmitted to the node 30 and the second surgery moving image can be transmitted, the storage server 22 stores the second surgery moving image and the second accompanying information in the storage server 22. A transmission instruction is transmitted (S615). The storage server 22 transmits the second operation moving image and the second accompanying information to the access server 60 based on the transmission instruction transmitted from the access server 60 (S617). Next, the access server 60 transmits the received second surgery moving image and the second accompanying information to the node 30 (S619). Then, the node 30 displays the received second surgery moving image and the second accompanying information (S621).

In the above, the case where the access server 60 receives the second surgery moving image and the second accompanying information stored in the storage server 22 and transmits the second surgery moving image and the second accompanying information to the node 30 has been described. The present invention is not limited to the above, and a transmission instruction of the operation moving image and the accompanying information may be transmitted to at least one of the storage server 21 and the storage server 22 based on the determination result by the access server 60. For example, when the determination unit 620 determines that the first surgery moving image and the second surgery moving image can be transmitted, a transmission instruction of the surgery moving image and the accompanying information may be transmitted to the storage server 21 and the storage server 22. Thereafter, the storage server 21 may transmit the first surgery moving image and the first accompanying information to the access server 60, and the storage server 22 may transmit the second surgery moving image and the second accompanying information to the access server 60.

Since a plurality of storage servers are provided, the first operation video and the second operation video can be stored in different storage servers. As a result, security is further enhanced, and leakage of personal information can be prevented. Become. In addition, it is preferable that only a node whose access level is equal to or higher than a specified value can be connected to the storage server in which the first operation moving image is stored. For example, the determination unit 620 determines the access location based on the access level, and if the access is from an external network other than the in-hospital network, blocks the access to the storage server that stores the first surgical moving image. This makes it possible to further enhance security.

Note that a server in the hospital is a storage server 21 for recording a first surgery moving image including personal information, and a cloud server (an out-of-hospital server set on a network by cloud computing) is a third server that does not include personal information. The storage server 22 for recording the second operation moving image may be used. At this time, the storage server 21 can be accessed in the case of access via the access server provided in the hospital, and only the storage server 22 can be accessed in the case of access via the access server provided in the cloud. preferable. Thereby, security can be strengthened by blocking access to the storage server in which the first surgery moving image is stored, and convenience can be improved by enabling access by cloud computing. At this time, some functions of the information processing apparatus 12 described in the above embodiment may be provided in the cloud server. For example, the information processing device in the hospital records the operation video as the first operation video linked to the first identification information in the storage server 21 in the hospital, and transmits the operation video to the cloud server. The cloud server performs a protection process for protecting the personal information on the operation moving image, generates a second operation moving image associated with the second identification information, and records the second operation moving image on the cloud server. Thereby, the protection processing of the personal information can be performed by the computing resources of the cloud server, so that the adjustment of the computing resources is facilitated. At this time, the first operation moving image may be recorded on the cloud server and a secret key and a public key may be generated so that only the user having the private key can access the first operation moving image. In addition, the information processing device 12 links the patient's pre-surgery consent information (for example, information indicating consent to record the surgery video and release the surgery video after protecting personal information) with the surgery video. It may also be recorded. Further, the information processing apparatus may include a determination unit that determines whether or not the personal information protection processing or the recording of the storage server 22 is possible based on whether or not the consent information is linked to the operation moving image.

<4. Hardware Configuration>
The embodiment according to the present disclosure has been described above. The above-described image processing is realized by cooperation between software and hardware of an information processing system described below.

Next, a hardware configuration example of the information processing system 1 according to an embodiment of the present disclosure will be described. FIG. 16 is a block diagram illustrating a hardware configuration example of the information processing system 1 according to an embodiment of the present disclosure. Referring to FIG. 16, the information processing system 1 includes, for example, a CPU 1270, a ROM 1271, a RAM 1272, a host bus 1273, a bridge 1274, an external bus 1275, an interface 1276, an input device 1277, a display device 1278, , An audio output device 1279, a storage device 1280, a drive 1281, a connection port 1282, and a removable storage medium 1283. Note that the hardware configuration shown here is an example, and some of the components may be omitted. Further, components other than the components shown here may be further included.

The CPU 1270 functions as, for example, an arithmetic processing device or a control device, and controls the entire operation of each component or a part thereof based on various programs recorded in the ROM 1271, the RAM 1272, the storage device 1280, or the removable storage medium 1283. . The CPU 1270 realizes functions as, for example, the information processing unit 100, the output control unit 130, the output control unit 131, the determination unit 230, and the determination unit 620 in cooperation with software.

The ROM 1271 is a means for storing programs read by the CPU 1270, data used for calculations, and the like. The RAM 1272 temporarily or permanently stores, for example, a program read by the CPU 1270 and various parameters that appropriately change when the program is executed.

The CPU 1270, the ROM 1271, and the RAM 1272 are mutually connected, for example, via a host bus 1273 capable of high-speed data transmission. On the other hand, the host bus 1273 is connected to, for example, an external bus 876 having a relatively low data transmission speed via a bridge 1274. The external bus 1275 is connected to various components via an interface 1276.

For the input device 1277, for example, a mouse, a keyboard, a touch panel, a button, a switch, a lever, and the like can be used. Further, as the input device 1277, a remote controller capable of transmitting a control signal using infrared rays or other radio waves may be used. The input device 1277 includes a voice input device such as a microphone. The input device 1277 is applied to, for example, the node 30. In a surgical system to which the technology of the present disclosure can be applied, it is preferable that the foot switch 250 be used as the input device 1277.

The display device 1278 is, for example, a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL, a printer, or the like, and the audio output device 1279 is an audio output device such as a speaker or headphones. Each of the display device 1278 and the audio output device 1279 is a device capable of visually or audibly notifying the user of the acquired information, and is used for the node 30, for example. When a display device is used as the display device 1278, for example, the display device 1278 displays at least one of the first display screen 300A and the second display screen 300B described above.

The storage device 1280 is a device for storing various data. As the storage device 1280, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like is used. The storage device 1280 realizes, for example, a function as the storage unit 120 in cooperation with software, and realizes one function of the storage server 20, the storage server 21, the storage server 22, and the storage server 23.

The drive 1281 is a device that reads information recorded on a removable storage medium 1283 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory or writes information to the removable storage medium 1283.

The 記憶 removable storage medium 1283 is, for example, a DVD medium, a Blu-ray (registered trademark) medium, an HD DVD medium, various semiconductor storage media, or the like. Of course, the removable storage medium 1283 may be, for example, an IC card on which a non-contact type IC chip is mounted, or an electronic device.

The connection port 1282 is a port for connecting an external connection device 902 such as a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface), an RS-232C port, or an optical audio terminal. is there.

<5. Conclusion>
Although the preferred embodiments of the present disclosure have been described above in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can reach various changes or modifications within the scope of the technical idea described in the claims. It is naturally understood that the above also belongs to the technical scope of the present disclosure.

For example, in the above embodiment, the determination unit is provided in the information processing device or the access server, but the present technology is not limited to such an example. For example, as shown in FIG. 17, the storage server 23 may include a determination unit 230 corresponding to the determination unit 103 or the determination unit 620.

効果 In addition, the effects described in this specification are merely illustrative or exemplary, and are not restrictive. That is, the technology according to the present disclosure can exhibit other effects that are obvious to those skilled in the art from the description in the present specification, in addition to or instead of the above effects.

The following configuration also belongs to the technical scope of the present disclosure.
(1)
An acquisition unit configured to acquire a first operation record, which is a record of information on operation of a medical device used for an operation in a hospital,
A conversion unit that performs protection processing on the patient's personal information included in the first operation record and converts the first operation record into a second operation record;
An identification information generating unit that generates first identification information associated with the first operation record and second identification information associated with the second operation record;
The first operation record or the second identification information associated with the first identification information based on the authority information on the authority of the user determined based on the hospital attribute or the information on the operation. A determination unit that determines whether the user can access any of the obtained second surgery records;
An information processing system comprising:
(2)
The information processing system according to (1), wherein the first operation record and the second operation record include a moving image record.
(3)
The determination unit can transmit the first operation record linked to the first identification information to a node used by the user when the authority information includes an access right to the first operation record. The information processing system according to (1) or (2), wherein
(4)
The information processing system according to any one of (1) to (3), further comprising: an output control unit configured to output the first operation record or the second operation record to the node.
(5)
The information processing system according to any one of (1) to (4), further including an accompanying information generation unit that generates accompanying information regarding the personal information accompanying the first operation record or the second operation record.
(6)
The information processing system according to (5), wherein the accompanying information includes information on the operation.
(7)
An output control unit that outputs the first operation record or the second operation record to a node used by the user,
The information processing system according to (6), wherein the output control unit can output the accompanying information to the node based on the authority information of the user.
(8)
An output control unit that outputs the first operation record or the second operation record to a node used by the user,
The output control unit, when the determination unit determines that the first surgery record associated with the first identification information should be transmitted to the node, the accompanying information together with the first surgery record The information processing system according to (6), wherein the information is output to the node.
(9)
The first operation record includes audio information,
The conversion unit according to any one of (1) to (8), wherein the conversion unit performs protection processing on the personal information of the patient included in the audio information to convert the first operation record into the second operation record. The information processing system as described.
(10)
(1) The apparatus according to any one of (1) to (9), further including a storage unit configured to store the first operation record, the second operation record, the first identification information, and the second identification information. The information processing system as described.
(11)
The storage unit includes a first storage server that stores the first surgery record and the first identification information, and a second storage server that stores the second surgery record and the second identification information. The information processing system according to (10).
(12)
The authority information includes information on whether a node used by the user is connected to a network in a hospital,
The information processing system according to (11), wherein the determination unit blocks access to the first storage server when the node is not connected to a network in a hospital.
(13)
The information processing system according to any one of (1) to (12), wherein the conversion unit performs a replacement process for replacing the face of the patient with another human face.
(14)
The information processing system according to (7), wherein the output control unit selects the accompanying information to be output based on the authority information of the user.
(15)
The information processing system according to (7), wherein the output control unit selects the additional information to be output based on the authority information of the user and charging information of the user.
(16)
Based on the authority information on the authority of the user, the first operation record associated with the first identification information or the second operation record associated with the second identification information is transmitted to a node used by the user. A determination unit for determining whether
The first operation record is a record of information on the operation of a medical device used for the operation,
The information processing apparatus, wherein the second operation record is a record converted from the first operation record by performing a protection process on personal information of a patient included in the first operation record.
(17)
The processor
Acquiring a first surgery record, which is a record of information on the operation of medical equipment used for surgery,
Performing a process of protecting the personal information of the patient included in the first operation record and converting it to a second operation record that is an operation record in which the patient cannot be identified;
Generating first identification information associated with the first operation record and second identification information associated with the second operation record;
Which of the first operation record linked to the first identification information or the second operation record linked to the second identification information is used by the user based on authority information related to the authority of the user. Determining whether to send to the node;
An information processing method, including:

1, 2, 3

Information processing system

10, 11, 12, 13

Information processing device

20, 21, 22, 23 Storage server 30 Node 40, 41 Surgery system 50 Network 60

Access server

100, 140 Information processing unit 101 Conversion unit 102 Identification

Information generation unit

103, 230, 620

Judgment unit

104, 106 Associated information generation unit 105

Search unit

110, 610 Communication unit 120

Storage unit

130, 131 Output control unit 300A First display screen 300B Second display screen

Claims

An acquisition unit configured to acquire a first operation record, which is a record of information on operation of a medical device used for an operation in a hospital,
A conversion unit that performs protection processing on the patient's personal information included in the first operation record and converts the first operation record into a second operation record;
An identification information generating unit that generates first identification information associated with the first operation record and second identification information associated with the second operation record;
The first operation record or the second identification information associated with the first identification information based on the authority information on the authority of the user determined based on the hospital attribute or the information on the operation. A determination unit that determines whether the user can access any of the obtained second surgery records;
An information processing system comprising:
The information processing system according to claim 1, wherein the first operation record and the second operation record include a moving image record.
The determination unit can transmit the first operation record linked to the first identification information to a node used by the user when the authority information includes an access right to the first operation record. The information processing system according to claim 1, wherein the information processing system determines that is.
4. The information processing system according to claim 3, further comprising an output control unit configured to output the first operation record or the second operation record to the node.
2. The information processing system according to claim 1, further comprising an incidental information generation unit that generates incidental information regarding the personal information associated with the first operation record or the second operation record.
6. The information processing system according to claim 5, wherein the accompanying information includes information on the operation.
An output control unit that outputs the first operation record or the second operation record to a node used by the user,
The information processing system according to claim 6, wherein the output control unit can output the accompanying information to the node based on the authority information of the user.
An output control unit that outputs the first operation record or the second operation record to a node used by the user,
The output control unit, when the determination unit determines that the first surgery record associated with the first identification information should be transmitted to the node, the accompanying information together with the first surgery record The information processing system according to claim 6, wherein the information is output to the node.
The first operation record includes audio information,
The information processing system according to claim 1, wherein the conversion unit performs a protection process on the personal information of the patient included in the audio information to convert the first operation record into the second operation record.
2. The information processing system according to claim 1, further comprising a storage unit configured to store the first operation record, the second operation record, the first identification information, and the second identification information. 3.
The storage unit includes a first storage server that stores the first surgery record and the first identification information, and a second storage server that stores the second surgery record and the second identification information. The information processing system according to claim 10, wherein
The authority information includes information on whether a node used by the user is connected to a network in a hospital,
The information processing system according to claim 11, wherein the determination unit blocks access to the first storage server when the node is not connected to a network in a hospital.
The conversion unit performs a replacement process to replace the patient's face with another human face,
The information processing system according to claim 1.
The information processing system according to claim 7, wherein the output control unit selects the accompanying information to be output based on the authority information of the user.
The information processing system according to claim 7, wherein the output control unit selects the additional information to be output based on the authority information of the user and the charging information of the user.
Based on the authority information related to the authority of the user, the first operation record associated with the first identification information or the second operation record associated with the second identification information is transmitted to a node used by the user. A determination unit for determining whether
The first operation record is a record of information on the operation of a medical device used for the operation,
The information processing apparatus, wherein the second operation record is a record converted from the first operation record by performing a protection process on personal information of a patient included in the first operation record.
The processor
Acquiring a first surgery record, which is a record of information on the operation of medical equipment used for surgery,
Performing a process of protecting the personal information of the patient included in the first operation record and converting it to a second operation record that is an operation record in which the patient cannot be identified;
Generating first identification information associated with the first operation record and second identification information associated with the second operation record;
Which of the first operation record linked to the first identification information or the second operation record linked to the second identification information is used by the user based on the authority information related to the authority of the user. Determining whether to send to the node;
An information processing method, including: