JP7024450B2 - Computer programs, support devices and support methods - Google Patents

Description

The present invention relates to a computer program, a support device, and a support method.

Taking medication alone is not enough to cure lifestyle-related diseases, but it is important to improve lifestyle-related habits such as eating, exercising, or sleeping. On the other hand, with the recent development of information and communication technology, a telemedicine support system in which the attending physician treats a patient remotely has been proposed (see Patent Document 1).

Japanese Patent No. 6019296

Depending on the degree of the patient's medical condition, not only daily health management such as lifestyle-related diseases but also more specialized and various treatments may be required. For this reason, the role of a counselor who supports the attending physician as needed is required even in telemedicine.

The present invention has been made in view of such circumstances, and an object of the present invention is to provide a computer program, a support device, and a support method capable of supporting a doctor's telemedicine.

The computer program according to the embodiment of the present invention is a computer program that operates on a doctor's terminal device for causing a computer to perform support for remote medical care, and the computer has an image of a remote medical care subject on a display screen. The process of displaying the image of the doctor and the process of displaying the image of the medical worker different from the doctor in the area different from the area where the image of the remote medical care subject and the image of the doctor are displayed are executed.

The support device according to the embodiment of the present invention is a support device that supports remote medical care, and is an image that receives an image of a doctor acquired by a doctor terminal device and an image of a remote medical care subject acquired by a target person terminal device. A receiving unit, an image transmitting unit that transmits an image of a doctor received by the image receiving unit to the subject terminal device, and an image transmitting unit that transmits an image of a remote medical care subject received by the image receiving unit to the doctor terminal device. An output unit that outputs a list of candidates for medical professionals different from the doctor to the doctor terminal device, a reception unit that accepts selection of medical professionals from the list of candidates, and a reception unit that accepts selections. A provider that provides a video communication function between the doctor terminal device, the subject terminal device, and the worker terminal device of the selected medical worker.

The support method according to the embodiment of the present invention is a support method for supporting remote medical care, and receives an image of a doctor acquired by a doctor terminal device and an image of a remote medical care subject acquired by a target person terminal device. The received image of the doctor is transmitted to the subject terminal device, the received image of the remote medical care subject is transmitted to the doctor terminal device, and a list of candidates for medical staff different from the doctor is displayed in the doctor terminal device. When the selection of the medical worker from the candidate list is accepted and the selection is accepted, the doctor terminal device, the target person terminal device, and the selected medical worker's worker terminal device are three parties. Provides the ability to make video calls between.

According to the present invention, it is possible to support the telemedicine of a doctor.

It is a schematic diagram which shows an example of the outline of the telemedicine support service of this embodiment. It is explanatory drawing which shows an example of the process of the telemedicine support service of this embodiment. It is a schematic diagram which shows an example of the structure of the telemedicine support system of this embodiment. It is a block diagram which shows an example of the configuration of the server of this embodiment. It is a block diagram which shows an example of the structure of the attending physician terminal apparatus of this embodiment. It is a block diagram which shows an example of the structure of the telemedicine terminal apparatus of this embodiment. It is a block diagram which shows an example of the structure of the specialist terminal apparatus of this embodiment. It is a schematic diagram which shows the 1st example of the guidance of the telemedicine displayed by the telemedicine terminal apparatus of this embodiment. It is a schematic diagram which shows the 2nd example of the guidance of the telemedicine displayed by the telemedicine terminal apparatus of this embodiment. It is a schematic diagram which shows an example of the reservation notification screen of the telemedicine displayed by the telemedicine terminal apparatus of this embodiment. It is a schematic diagram which shows an example of the remote medical care start screen displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device and the telemedicine terminal device when the telemedicine is started. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device and the telemedicine terminal device during telemedicine. It is a schematic diagram which shows the 1st example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows the 2nd example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows the 3rd example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows the 4th example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows the 5th example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows the sixth example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows the 7th example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows the 8th example of the telemedicine assistance information displayed by the attending physician terminal apparatus of this embodiment. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device and the telemedicine terminal device when the patient permits the disclosure of medical information. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device and the telemedicine terminal apparatus when the video call between the attending physician, the patient and the specialist is started. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device, the telemedicine terminal apparatus and the specialist doctor terminal apparatus when the attending physician consults with a specialist in a video call between three parties. It is a schematic diagram which shows the 1st example of the display screen of the attending physician terminal device when the attending physician permits the disclosure of medical information of a patient. It is a schematic diagram which shows the 2nd example of the display screen of the attending physician terminal device when the attending physician permits the disclosure of medical information of a patient. It is a schematic diagram which shows the 3rd example of the display screen of the attending physician terminal device when the attending physician permits the disclosure of medical information of a patient. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device, the remote medical care terminal apparatus, and the specialist doctor terminal apparatus when a specialist is talking with a patient in a video call between three parties. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device, the telemedicine terminal apparatus and the specialist doctor terminal apparatus when a specialist advises the attending physician in a video call between three parties. It is a schematic diagram which shows an example of the display screen of the attending physician terminal device and the telemedicine terminal apparatus when the attending physician diagnoses and prescribes. It is a schematic diagram which shows an example of the display screen of the telemedicine terminal apparatus when the telemedicine is completed. It is a schematic diagram which shows an example of the case where the content displayed by a telemedicine terminal device is displayed on another display device. It is a flowchart which shows an example of the procedure of the generation processing of the guidance information of telemedicine by the server of this embodiment. It is a flowchart which shows an example of the procedure of the processing of telemedicine by the server of this embodiment. It is a flowchart which shows an example of the procedure of the processing of telemedicine by the server of this embodiment. It is a flowchart which shows an example of the processing procedure of the attending physician terminal apparatus of this embodiment. It is a flowchart which shows an example of the processing procedure of the telemedicine terminal apparatus of this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram showing an example of an outline of the telemedicine support service of the present embodiment. The entities involved in the telemedicine support service are, for example, a doctor who performs telemedicine (also referred to as the chief doctor in this specification), a telemedicine target person who receives telemedicine (also referred to as a patient in this specification), and a medical worker who is different from the doctor. (In FIG. 1, a specialist) and a telemedicine support provider (not shown) that provides a telemedicine support service are included. The organization to which the patient belongs may include, for example, a company (for example, a health insurance association), a public employee (for example, a mutual aid association), a self-employed person (national health insurance), and the like.

Doctors include, for example, doctors in in-house clinics located in the vicinity of business establishments of companies, doctors in university hospitals (working doctors), doctors in nearby clinics (practitioners), and the like. Health care workers include specialists (eg, diabetic specialists and well-known doctors in large hospitals), health nurses, nurses, pharmacists, medical instructors, psychological counselors, registered dietitians, health exercise instructors or care managers.

The attending physician usually provides telemedicine by making a video call between the two with the patient. If the attending physician needs the advice of a specialist who specializes in the patient's medical condition, depending on the degree of the patient's medical condition, the attending physician will consult with the specialist by making a video call with the specialist. The specialist who received the consultation conducts a more specialized consultation hearing about the patient's medical condition, etc. by making a video call with the patient. In this case, a three-way video call is made between the patient, the attending physician and the specialist. The specialist who conducted the consultation hearing with the patient gives advice (advice) to the attending physician. The attending physician will finally make a diagnosis, prescription, etc., referring to the advice of a specialist, and end the telemedicine. This makes it possible to improve the accuracy of diagnosis and support the telemedicine of doctors.

FIG. 2 is an explanatory diagram showing an example of the process of the telemedicine support service of the present embodiment. Hereinafter, processes P1 to P7 will be described.

In process P1, the patient makes an appointment for telemedicine with the attending physician using the telemedicine terminal device described below.

In process P2, telemedicine is performed by the attending physician. In this case, telemedicine can use a two-way video call between the patient and the attending physician. In addition, instead of the video call, or together with the video call, a text chat may be used, or a voice-only call may be used.

In process P3, the attending physician determines that the advice of a specialist is needed and calls a specialist suitable for the patient's medical condition. When the specialist initiates a video call, a video call between the patient, the attending physician, and the specialist is initiated.

In process P4, the attending physician consults with a specialist.

In process P5, the consulted specialist conducts a consultation hearing with the patient and makes a more specialized diagnosis of the patient's medical condition.

In process P6, the specialist gives medical advice to the attending physician based on the consultation hearing with the patient. Then, when the specialist's advice is finished, the specialist ends the video call. This ends the three-way video call.

In process P7, the attending physician makes a diagnosis and prescription with reference to the advice of a specialist, and ends the telemedicine.

FIG. 3 is a schematic diagram showing an example of the configuration of the telemedicine support system of the present embodiment. The telemedicine support system includes an attending physician terminal device 10 as a doctor terminal device used by an attending physician who performs telemedicine, a remote medical care terminal device 20 used by a patient, and a specialist terminal device 30 used by a specialist as a medical worker different from a doctor. , And a server 50 as a support device held or managed by a telemedicine support company. The attending physician terminal device 10, the remote medical care terminal device 20, the specialist doctor terminal device 30, and the server 50 are connected to each other via the communication network 1. The server 50 has a function of controlling and managing information exchange between the attending physician terminal device 10, the remote medical care terminal device 20, and the specialist doctor terminal device 30, the attending physician terminal device 10, the remote medical care terminal device 20, the specialist doctor terminal device 30, and the like. And the number of servers 50 is not limited to the example of FIG.

The attending physician terminal device 10, the telemedicine terminal apparatus 20, and the specialist physician terminal apparatus 30 are provided with display screens 11, 21, and 31, respectively. Further, the telemedicine terminal device 20 can be connected to the measuring instrument 40 by short-range communication. The measuring instrument 40 can measure data (vital data, etc.) such as blood pressure, heart rate, body weight, number of steps, and sleep time, for example.

A video call can be made between the attending physician terminal device 10, the telemedicine terminal apparatus 20, and the specialist physician terminal apparatus 30. In addition to the video call or in addition to the video call, it is also possible to make a text chat or a voice-only call.

FIG. 4 is a block diagram showing an example of the configuration of the server 50 according to the present embodiment. The server (support device) 50 includes a control unit 51, a first communication unit 52, a second communication unit 53, a third communication unit 54, a video call function providing unit 55, a timer 56, and a charge calculation unit 57 that control the entire server 50. , Patient DB 58, AI engine unit 59, auxiliary information generation unit 60, consultation staff DB 61, support permission determination unit 62, and the like.

The first communication unit 52 provides a communication function with the attending physician terminal device 10 via the communication network 1.

The second communication unit 53 provides a communication function with the telemedicine terminal device 20 via the communication network 1.

The third communication unit 54 provides a communication function with the specialist terminal device 30 via the communication network 1.

The video call function providing unit 55 provides a two-way and three-way video call function between the attending physician terminal device 10, the telemedicine terminal device 20, and the specialist terminal device 30. In addition, the video call function providing unit 55 can collect and record images and conversation contents of each of the patient, the attending physician, and the specialist.

Under the control of the control unit 51, the timer 56 measures the start time and end time of a predetermined event (for example, a video call). Specifically, the timer 56 specifies the time or the number of times related to the video call between any two of the attending physician terminal device 10, the telemedicine terminal device 20, and the specialist terminal device 30. That is, the time related to the video call between the attending physician terminal device 10 and the telemedicine terminal device 20, between the attending physician terminal device 10 and the specialist terminal device 30, or between the specialist doctor terminal device 30 and the telemedicine terminal device 20. Specify the number of times. This makes it possible to obtain information for calculating the cost of telemedicine.

The charge calculation unit 57 calculates the charge related to telemedicine based on the time measured by the timer 56 (for example, the video talk time) and the predetermined charge calculation table. For example, fees for telemedicine between the patient and the attending physician, fees for advice based on the video talk time between the attending physician and the specialist, and consultation hearings based on the video talk time between the patient and the specialist. Charges can be calculated.

The patient DB 58 is a database that records medical information about patients separately for each patient. Medical information includes, for example, information related to medical examinations, diagnoses, examinations, and the like. Specifically, medical records (electronic medical records), doctor's findings (treatment policy), referral letters, questionnaires, vital data (eg, blood pressure, heartbeat, steps, sleep time, dietary intake, etc.), health data (eg, gender). , Age, height, weight, etc.), and includes test data such as blood tests.

The AI (artificial intelligence) engine unit 59 is composed of an algorithm or a trained model that realizes a voice recognition function, a language analysis function, a machine learning function, and the like. Specifically, it combines hardware such as CPU (for example, a multi-processor with multiple processor cores), GPU (Graphics Processing Units), DSP (Digital Signal Processors), and FPGA (Field-Programmable Gate Arrays). Can be configured by It can also be combined with a quantum processor. The machine learning model (machine learning method) includes, for example, a neural network including deep learning or reinforcement learning. The AI (artificial intelligence) engine unit 59 may be separated from the server 50 and configured by another server or a plurality of servers.

The auxiliary information generation unit 60 generates remote medical care auxiliary information. Specifically, the AI engine unit 59 analyzes the conversation content between the patient and the attending physician collected by the video call function providing unit 55. Based on the analysis result, the auxiliary information generation unit 60 generates the telemedicine auxiliary information. In addition, the AI engine unit 59 analyzes the medical information of the patient. Based on the analysis result, the auxiliary information generation unit 60 can also generate the telemedicine auxiliary information. The telemedicine assistance information includes, for example, information for supporting the telemedicine of the attending physician.

The consultation staff DB 61 is a database that records information on medical staff who are different from the attending physician. Specifically, the consultation staff DB 61 includes information such as the name, title, specialty field, work style, work place, work schedule, and contact information of the medical staff.

The support permission determination unit 62 determines whether or not to permit the support of the specialist based on the position information of the specialist terminal device 30. For example, the location of a medical place where medical practice is permitted is registered in advance, and based on the acquired position information, it is determined whether or not the specialist terminal device 30 exists in the predetermined medical place, and the medical place is set to the predetermined medical place. If present, the assistance of a specialist can be granted.

FIG. 5 is a block diagram showing an example of the configuration of the attending physician terminal device 10 of the present embodiment. In addition to the display screen 11, the attending physician terminal device 10 includes a control unit 12, a communication unit 13, an input unit 14, a storage unit 15, a display control unit 16, a video call processing unit 17, and the like that control the entire device. The attending physician terminal device 10 can be configured by, for example, a smartphone, a tablet, a notebook personal computer, or the like.

The communication unit 13 provides a communication function with the server 50 via the communication network 1.

The input unit 14 is composed of, for example, a keyboard, a mouse, a touch pad, a touch panel, and the like, and can input characters and perform operations on icons, buttons, menu bars, windows, cursors, and the like on the display screen 11.

The storage unit 15 can store information acquired from the server 50, information input from the input unit 14, and the like.

The display control unit 16 performs a process for displaying predetermined information on the display screen 11.

The video call processing unit 17 includes a camera, a microphone, a speaker, and the like, and executes a process for making a video call between the remote medical care terminal device 20 and the specialist terminal device 30.

The processing performed by the display control unit 16 and the video call processing unit 17 can be realized by an application program (computer program). That is, the processing of the display control unit 16 and the video call processing unit 17 is realized by loading the computer program into the RAM (not shown) provided in the attending physician terminal device 10 and causing the CPU to execute each processing of the loaded computer program. can do.

FIG. 6 is a block diagram showing an example of the configuration of the telemedicine terminal device 20 of the present embodiment. In addition to the display screen 21, the remote medical terminal device 20 includes a control unit 22, a communication unit 23, a camera 24, a microphone 25, a speaker 26, a motion sensor 27, a storage unit 28, an operation unit 29, and a display that control the entire device. It includes a control unit 201, a video call processing unit 202, an interface unit 203, and the like.

The telemedicine terminal device 20 can be placed at a desired location such as a desk, table, or shelf, and a family member in a house including a patient can enjoy video calls and message exchanges. .. That is, the telemedicine terminal device 20 is a communication device that can enjoy conversation not only by voice but also by facial expressions by using the function of the server 50. Further, the telemedicine terminal device 20 is also an information providing device that provides various information about telemedicine in a timely manner by using the function of the server 50. The telemedicine terminal device 20 may be configured by a smartphone, a tablet, a notebook personal computer, or the like.

The communication unit 23 provides a communication function with the server 50 via the communication network 1.

The motion sensor 27 detects the presence / absence or position of the patient. That is, the motion sensor 27 determines whether or not there is a patient near the telemedicine terminal device 20, and if there is a patient in the detection range, detects the position of the patient.

When the camera 24 detects the patient with the motion sensor 27, the camera 24 takes an image of the patient. The camera 24 may move the optical axis of the lens in the direction in which the patient is present, or a wide-angle camera may be used.

As a result, the patient can be imaged in conjunction with the patient's location or movement, and the patient does not have to look into the screen of a smartphone or personal computer. Since the camera 24 captures the patient only by being close to the telemedicine terminal device 20, the patient can receive the telemedicine with a natural feeling similar to that of face-to-face medical care.

The storage unit 28 can store information acquired from the server 50, information obtained by processing inside the telemedicine terminal device 20, and the like.

The operation unit 29 is composed of a touch panel or the like, and can perform operations on icons, buttons, menu bars, windows, cursors, and the like on the display screen 11.

The display control unit 201 performs a process for displaying predetermined information on the display screen 21.

The video call processing unit 202 executes processing for making a video call between the attending physician terminal device 10 and the specialist terminal device 30.

The interface unit 203 provides an interface function for short-range communication with the measuring instrument 40. The interface unit 203 can acquire the biological data stored in the measuring instrument 40 that measures the data related to the living body. For example, simply by placing the measuring instrument 40 near the telemedicine terminal device 20, short-range communication between the telemedicine terminal device 20 and the measuring instrument 40 is established, and the patient's biometric data held by the measuring instrument 40 is established. Etc. can be automatically transmitted to the telemedicine terminal device 20.

The communication unit 23 outputs the acquired biometric data to the server 50. As a result, the biometric data measured by the patient can be automatically sent to the server 50 without the patient performing any special operation, and the biometric data of the patient can be easily collected.

The processing performed by the display control unit 201 and the video call processing unit 202 can be realized by an application program (computer program). That is, the processing of the display control unit 201 and the video call processing unit 202 is performed by loading the computer program into the RAM (not shown) provided in the remote medical care terminal device 20 and causing the CPU to execute each processing of the loaded computer program. It can be realized.

FIG. 7 is a block diagram showing an example of the configuration of the specialist terminal device 30 of the present embodiment. In addition to the display screen 31, the specialist terminal device 30 includes a control unit 32, a communication unit 33, an input unit 34, a storage unit 35, a display control unit 36, a video call processing unit 37, and the like that control the entire device. The specialist terminal device 30 can be configured by, for example, a smartphone, a tablet, a notebook personal computer, or the like.

The communication unit 33 provides a communication function with the server 50 via the communication network 1.

The input unit 34 is composed of, for example, a keyboard, a mouse, a touch pad, a touch panel, and the like, and can input characters and operate icons, buttons, menu bars, windows, cursors, and the like on the display screen 31.

The storage unit 35 can store information acquired from the server 50, information input from the input unit 34, and the like.

The display control unit 36 performs a process for displaying predetermined information on the display screen 31.

The video call processing unit 37 includes a camera, a microphone, a speaker, and the like, and executes a process for making a video call between the remote medical care terminal device 20 and the attending physician terminal device 10.

The processing performed by the display control unit 36 and the video call processing unit 37 can be realized by an application program (computer program). That is, the processing of the display control unit 36 and the video call processing unit 37 is realized by loading the computer program into the RAM (not shown) provided in the specialist terminal device 30 and causing the CPU to execute each process of the loaded computer program. can do.

Next, the operation of the telemedicine system of the present embodiment will be described.

FIG. 8 is a schematic diagram showing a first example of the telemedicine guidance displayed by the telemedicine terminal device 20 of the present embodiment. The microphone 25 of the telemedicine terminal device 20 acquires the conversation content of the surroundings. The communication unit 23 transmits the acquired conversation content to the server 50. The conversations are, for example, "I think I've gained weight recently.", "I'm not feeling well recently.", "I don't have much appetite.", "I should go to the hospital once." , "It's a hassle because it takes time to go to the hospital."

The second communication unit 53 of the server 50 receives the conversation content transmitted by the telemedicine terminal device 20 and outputs it to the AI engine unit 59. The AI engine unit 59 performs voice recognition processing and language analysis processing on the conversation content, and generates a message related to telemedicine using the learned model. The second communication unit 53 transmits the generated message to the telemedicine terminal device 20. The message relating to telemedicine can include, for example, information regarding guidance for recommending the use of telemedicine, and includes, for example, information as illustrated in FIG.

The communication unit 23 of the telemedicine terminal device 20 receives a message related to the telemedicine from the server 50, and the display control unit 201 displays the received message on the display screen 21. Instead of displaying the message on the display screen 21, the message may be output by voice, or may be output by voice together with the display of the message.

In the example of FIG. 8, the message is like "You can see a doctor by video call. Why don't you see a telemedicine?", And if you need more detailed information, "Information desk" You can get detailed information about telemedicine by operating the icon. If you want to participate in telemedicine immediately, you can proceed to the registration process for receiving telemedicine by operating the "initial registration" icon.

With the above configuration, the telemedicine terminal device 20 can play a role as if it were a family watching over the health of the whole family.

FIG. 9 is a schematic diagram showing a second example of the telemedicine guidance displayed by the telemedicine terminal device 20 of the present embodiment. In the example of Figure 9, the message might be something like "You may have'hyperlipidemia'. Why don't you see a telemedicine by your doctor?" And if you need more information, Detailed information on telemedicine can be obtained by operating the "information desk" icon. If you want to participate in telemedicine immediately, you can proceed to the registration process for receiving telemedicine by operating the "initial registration" icon.

FIG. 10 is a schematic diagram showing an example of a reservation notification screen for telemedicine displayed by the telemedicine terminal device 20 of the present embodiment. The display control unit 201 of the telemedicine terminal device 20 can notify a preset reservation time for telemedicine. As a result, the patient can be made to wait before the start of telemedicine, and the telemedicine can be started smoothly.

Further, the display control unit 201 displays on the display screen 21 that the reservation time for the telemedicine will be reached at a predetermined time (for example, 10 minutes) before the reservation time for the telemedicine set in advance. In the example of FIG. 10, information is displayed such as "Currently XX hours XX minutes. It is the start time of XX teacher's telemedicine in 10 minutes." The information can also be output by voice.

Further, the control unit 22 informs the attending physician terminal device 10 that the patient is in a standby state when the patient operates the "confirmation" icon at a time before a predetermined time before the appointment time of the telemedicine set in advance. Notice. As a result, it is possible to inform the attending physician that the patient is waiting, and telemedicine can be started smoothly.

Further, the control unit 22 indicates that the patient is in a standby state when the motion sensor 27 detects the presence or position of the patient at a time before a predetermined time before the appointment time of the telemedicine set in advance. The device 10 can be notified. As a result, the patient can inform the attending physician that the patient is waiting only by being near the telemedicine terminal device 20, and the telemedicine can be started smoothly.

FIG. 11 is a schematic diagram showing an example of a telemedicine start screen displayed by the attending physician terminal device 10 of the present embodiment. As described in the above-mentioned example of FIG. 10, when the telemedicine terminal device 20 notifies that the patient is in the standby state, the display control unit 16 of the attending physician terminal device 10 has information as illustrated in FIG. Is displayed. The display control unit 16 displays list information of the target patients who are waiting for consultation within the reservation time frame corresponding to the reservation date and time of the telemedicine.

In the example of FIG. 11, it can be seen that two patients are waiting for a medical examination within the appointment time frame of 2017 ○ month × day 15:00 to 15:30. In addition, a display button 101 for displaying medical information of the patient corresponding to each patient waiting for consultation is displayed. By operating the display button 101, the attending physician can display the medical information 103 of the patient. The attending physician can check the patient's medical information before performing telemedicine. As a result, the attending physician can refer to the medical information of the patient when making a video call with the patient and the medical staff, and thus can support the telemedicine of the attending physician.

In addition, a call button 102 for starting a video call corresponding to each patient waiting for consultation is displayed. By operating the call button 102, the attending physician can make a video call with the patient's telemedicine terminal device 20.

With the above configuration, the attending physician can keep track of the patient waiting for consultation within the appointment time frame, for example, to prevent the patient from not answering the video call when making a video call. It can prevent busy doctors from wasting time.

FIG. 12 is a schematic diagram showing an example of the display screens of the attending physician terminal device 10 and the telemedicine terminal device 20 when the telemedicine is started. The display control unit 16 of the attending physician terminal device 10 displays an image D of the attending physician, an image P of the patient, and medical information 103 of the patient. In this case, the image P of the patient is displayed larger than the image D of the attending physician. It is not necessary to display the image D of the attending physician.

The display control unit 201 of the telemedicine terminal device 20 displays the image D of the attending physician and the image P of the patient. As a result, the patient can easily make a video call with the attending physician, so that the patient can easily receive telemedicine. In this case, the image D of the attending physician can be displayed larger than the image P of the patient. It is not necessary to display the patient image P.

The telemedicine terminal device 20 is a terminal device specialized for telemedicine, and can display an image D of an attending physician and an image P of a patient captured by a camera 24 on a display screen 21 to make a video call. As a result, the patient can easily make a video call with the doctor, and the patient can easily receive telemedicine.

FIG. 13 is a schematic diagram showing an example of a display screen of the attending physician terminal device 10 and the telemedicine terminal device 20 during telemedicine. The display control unit 16 of the attending physician terminal device 10 displays a window 11a for telemedicine assistance information in an area different from the area where the image P of the patient and the image D of the attending physician are displayed. The telemedicine assistance information is displayed in the window 11a for the telemedicine assistance information. The telemedicine assistance information may be any information to support the telemedicine of the attending physician, and includes an image of a specialist. As a result, the attending physician can utilize the telemedicine assistance information, and thus can support the telemedicine of the attending physician. Hereinafter, specific examples of telemedicine assistance information will be described.

FIG. 14 is a schematic diagram showing a first example of remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. The display control unit 16 can display patient vital data (for example, blood pressure data, heart rate data, sleep time, step count data, etc.) in the window 11a. As a result, the attending physician can make an accurate diagnosis by referring to the vital data of the patient.

FIG. 15 is a schematic diagram showing a second example of the remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. The AI engine unit 59 of the server 50 analyzes the conversation content (may be at least one of the patient's voice, image, and utterance content) between the patient and the attending physician collected by the video call function providing unit 55. Based on the analysis result, the auxiliary information generation unit 60 generates an index related to the patient's emotion. The first communication unit 52 transmits the telemedicine auxiliary information (index related to the patient's emotion) generated by the auxiliary information generation unit 60 to the attending physician terminal device 10. As a result, the attending physician can utilize the telemedicine assistance information, and thus can support the telemedicine of the doctor.

The display control unit 16 displays an index related to the patient's emotions generated by the server 50 based on at least one of the patient's voice, image, and utterance content. The emotional index may be, for example, the emotion of the patient and may indicate the patient's situation that the attending physician can sense if it is a face-to-face medical treatment. Specifically, the facial expression and the degree of energy. Etc. can be included. The index can be represented by a chart, an image including an icon, a numerical value, or the like.

In the example of FIG. 15, the facial expression of the patient is displayed by the smiling character 104. The character 104 is an example and is not limited to the one illustrated in FIG. Further, the character 104 may be animated in conjunction with the movement of the patient's face. In addition, the energy level of the patient is represented by a bar graph 105 classified into "bad", "normal", and "good". In the example of FIG. 15, the energy level is "good".

FIG. 16 is a schematic diagram showing a third example of remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. In the example of FIG. 16, the facial expression of the patient is displayed by the character 106 having a normal facial expression. The patient's vitality is represented by a bar graph 107 indicating "normal".

FIG. 17 is a schematic diagram showing a fourth example of remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. In the example of FIG. 17, the facial expression of the patient is displayed by the character 108 with a crying facial expression. The patient's energy level is represented by a bar graph 109 indicating "bad".

With the above configuration, it is possible to convey the complexion and facial expression of the patient, which is difficult to understand by video call, to the attending physician, which makes it possible to approach face-to-face medical care.

FIG. 18 is a schematic diagram showing a fifth example of remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. The display control unit 16 compares the index related to the patient's emotions generated during the current telemedicine with the index related to the patient's emotions generated during the previous telemedicine, and information indicating the change in the patient's emotions. Can be displayed. In the example of FIG. 18, the chart 110 showing the changes in the energy levels of the previous time, the previous time, and the current time is displayed.

This makes it possible to inform the attending physician of changes in the patient's complexion and facial expression (changes during this telemedicine compared to the previous telemedicine) that are difficult to understand with video calls, making it possible to approach face-to-face medical care. ..

FIG. 19 is a schematic diagram showing a sixth example of remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. For example, when the patient is diabetic, the display control unit 16 can display the specialized information 111 regarding diabetes obtained by the AI engine unit 59 of the server 50 analyzing the medical information of the patient. As a result, the attending physician can obtain more specialized information by using artificial intelligence and can make an accurate diagnosis.

FIG. 20 is a schematic diagram showing a seventh example of remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. The AI engine unit 59 of the server 50 analyzes the conversation content (may be at least one of the patient's voice, image, and utterance content) between the patient and the attending physician collected by the video call function providing unit 55. Based on the analysis result, the auxiliary information generation unit 60 generates a list of candidates for medical staff. The first communication unit 52 transmits the list of candidates for medical staff generated by the auxiliary information generation unit 60 to the attending physician terminal device 10. This makes it possible to provide doctors with candidates for the appropriate or optimal medical staff for the attending physician and the patient.

The display control unit 16 preferentially and selectably displays a list of candidates for medical staff in the window 11a for telemedicine assistance information, which is an area different from the area where the image P of the patient and the image D of the attending physician are displayed. do. In the example of FIG. 20, priority 112, the title of the healthcare professional such as a diabetic specialist 113, the name of the healthcare professional, whether each healthcare worker is connected to the system, or whether the video call is ready. A code (ONLINE, OFFLINE in the figure) indicating whether or not it is displayed, a reservation button 114 for receiving a consultation from a medical worker, and the like are displayed. The priority is determined by the AI engine unit 59 to specify the order of the most appropriate medical staff as the medical staff to be consulted by the attending physician based on the content of the conversation between the patient and the attending physician. When the attending physician determines the medical staff to be consulted from the list of candidates displayed in the window 11a, the attending physician reserves the date and time for making a video call with the patient, the attending physician, and the specialist by operating the reservation button 114. be able to. In the following, a case where a video call with a patient, an attending physician and a specialist is immediately started will be described.

FIG. 21 is a schematic diagram showing an eighth example of remote medical care assistance information displayed by the attending physician terminal device 10 of the present embodiment. The difference from the seventh example illustrated in FIG. 20 is that the call button 115 is displayed instead of the reservation button 114. The display control unit 16 preferentially and selectably displays a list of candidates for medical staff in the window 11a for telemedicine assistance information, which is an area different from the area where the image P of the patient and the image D of the attending physician are displayed. do. When the attending physician decides a medical worker to consult from the list of candidates displayed in the window 11a, he / she can make a video call with the patient, the attending physician, and a specialist by operating the call button 115. This allows the attending physician to select the appropriate or optimal healthcare professional for the attending physician and the patient. It should be noted that, among the displayed candidates for the medical staff, only the candidates who are ready to participate in the video call may be selectable.

In each of the above examples, the AI engine unit 59 may analyze the medical information of the patient, and the auxiliary information generation unit 60 may generate the telemedicine auxiliary information based on the analysis result. This makes it possible to provide doctors with candidates for the appropriate or optimal medical staff for doctors and patients.

FIG. 22 is a schematic diagram showing an example of display screens of the attending physician terminal device 10 and the telemedicine terminal device 20 when the patient permits the disclosure of medical information. When the attending physician performs an operation such as requesting permission / disapproval of disclosure of medical information in the attending physician terminal device 10, the display control unit 201 of the remote medical care terminal device 20 can view the medical information of the patient on the specialist doctor terminal device 30 of the specialist. The icon 210 that accepts the setting of whether or not to allow the medical treatment is displayed. In the example of FIG. 22, the icon 210 is described as "medical information disclosure permission". Although not shown, two icons, permission and disapproval, may be displayed. In addition, it may be possible to select all or part of medical information. When the patient operates the icon 210, the window 11a of the attending physician terminal device 10 displays, for example, "The patient has been permitted to disclose medical information to a specialist." This allows the attending physician to confirm that the patient's permission has been obtained for the disclosure of medical information. It is also possible to record that the patient's permission has been obtained for the disclosure of medical information.

With the above configuration, it is possible to prevent the medical information of the patient from being unconditionally viewed by a third party other than the doctor.

FIG. 23 is a schematic diagram showing an example of a display screen of the attending physician terminal device 10 and the telemedicine terminal apparatus 20 when starting a video call between the attending physician, the patient, and the specialist. In the example of FIG. 23, only the “specialist △△ teacher” selected from the list of candidates for medical professionals is described for convenience. In the window 11c of the attending physician terminal device 10, the characters "Do you want to allow display on the patient screen?", The "Yes" icon 118, and the "No" icon 119 are displayed. When the attending physician operates the call button 115 to call a specialist and selects the “yes” icon 118, the patient's telemedicine terminal device 20 displays an image of the specialist described later.

Specifically, the first communication unit 52 of the server 50 acquires the image D of the attending physician from the attending physician terminal device 10. The second communication unit 53 acquires the patient image P from the telemedicine terminal device 20. The first communication unit 52 transmits the image P of the patient to the attending physician terminal device 10. The second communication unit 53 transmits the image D of the attending physician to the telemedicine terminal device 20.

The first communication unit 52 transmits (outputs) a list of candidates for medical staff to the attending physician terminal device 10. In addition, the first communication unit 52 accepts the selection of the medical worker from the list of candidates for the medical worker. Specifically, in the attending physician terminal device 10, when the attending physician performs an operation of selecting a required medical worker from a list of candidates, the attending physician terminal device 10 outputs the result of the operation to the server 50. , The first communication unit 52 accepts the result of the operation, that is, the selection.

When the first communication unit 52 accepts the selection of a specialist, the video call function providing unit 55 makes a video call between the chief doctor terminal device 10, the remote medical care terminal device 20, and the selected specialist doctor terminal device 30. Provide functionality. The attending physician can make a video call between three parties including a specialist in addition to the patient, and can obtain, for example, the advice of a specialist in real time when performing telemedicine. This makes it possible to improve the accuracy of diagnosis and support the telemedicine of doctors.

When starting a video call with the specialist terminal device 30, the third communication unit 54 acquires the position information of the specialist terminal device 30. As for the position information, for example, the specialist terminal device 30 may be provided with a GPS receiver, and the position information acquired by the specialist terminal device 30 may be transmitted to the server 50.

The support permission determination unit 62 determines whether or not to permit the support of the specialist related to the specialist terminal device 30 based on the acquired position information. For example, the location of a medical place where medical practice is permitted is registered in advance, and based on the acquired position information, it is determined whether or not the specialist terminal device 30 exists in the predetermined medical place, and the medical place is set to the predetermined medical place. If present, the assistance of a specialist can be granted.

The video call function providing unit 55 provides the video call function to the specialist terminal device 30 of the specialist who is determined to be permitted by the support permission determination unit 62. As a result, it is possible to ensure that consultation advice by a specialist is given at a predetermined medical place, and to record the fact, so that legal telemedicine can be performed.

FIG. 24 is a schematic diagram showing an example of display screens of the attending physician terminal device 10, the telemedicine terminal apparatus 20, and the specialist physician terminal apparatus 30 when the attending physician consults with a specialist in a video call between three parties. The display control unit 16 of the attending physician terminal device 10 displays the image S of the specialist in an area different from the area in which the image P of the patient and the image D of the attending physician are displayed.

With the above configuration, the attending physician can make a video call between the two parties with the patient, as well as a video call between the three parties including the specialist, and when performing telemedicine, for example, the specialist's Get advice in real time. This makes it possible to improve the accuracy of diagnosis and support the telemedicine of doctors.

Further, the image S of the specialist can be an area different from the area where the telemedicine assistance information is displayed. As a result, the image S of the specialist and the telemedicine assistance information can be displayed at the same time. Further, the image S of the specialist may be displayed in the window 11a in which the telemedicine assistance information is displayed. In this case, only one of the image S of the specialist and the telemedicine assistance information may be displayed in the window 11a and the other may be erased.

The display control unit 16 of the attending physician terminal device 10 displays the image of the other party with whom the attending physician is talking in a video call larger than the other images among the image P of the patient, the image D of the attending physician, and the image S of the specialist. In the example of FIG. 24, since the attending physician is talking to the specialist, the image S of the specialist is displayed larger than the other images.

The display control unit 36 of the specialist terminal device 30 displays the image of the other party the specialist is talking about in the video call larger than the other images among the image P of the patient, the image D of the attending physician, and the image S of the specialist. In the example of FIG. 24, since the specialist is talking to the attending physician, the image D of the attending physician is displayed larger than the other images.

The display control unit 201 of the telemedicine terminal device 20 displays the image S of the specialist obtained from the specialist terminal device 30 on the display screen 21 in addition to the image D of the attending physician and the image P of the patient. As a result, in addition to a two-way video call with a patient, a three-way video call including a specialist can be made, and consultation with a specialist or advice from a specialist can be obtained in real time. can.

Further, when the image D of the attending physician and the image S of the specialist are displayed on the display screen 21, the display control unit 201 displays an image of the attending physician or a specialist who is speaking and an image of a person who is not speaking. Display in different display modes. For example, the image of the person who is speaking is displayed large, and the image of the person who is not speaking is displayed small. In the example of FIG. 24, since the image D of the attending physician is displayed larger than the image S of the specialist, it can be seen that the attending physician is speaking and the specialist is listening. Note that the different display modes are not limited to the size of the image to be displayed, and the surroundings of the image of the speaker may be highlighted, or the color or brightness may be changed to make them stand out. good. This allows the patient to easily determine whether the attending physician or the specialist is speaking.

FIG. 25 is a schematic diagram showing a first example of a display screen of the attending physician terminal device 10 when the attending physician permits disclosure of medical information of the patient. The display control unit 16 displays the icon 116 of “medical information batch disclosure permission” on the display screen 11. By operating the icon 116, the attending physician permits all of the patient's medical information 103 to be viewed on the specialist terminal device 30. This makes it possible to prevent the medical information of the patient from being unconditionally viewed by a third party other than the attending physician.

FIG. 26 is a schematic diagram showing a second example of the display screen of the attending physician terminal device 10 when the attending physician permits the disclosure of medical information of the patient. The display control unit 16 displays the medical information of the patient on the display screen 11 by dividing it into a plurality of parts. In the example of FIG. 26, medical information M1, medical information M2, medical information M3, ... Are displayed. The display control unit 16 displays the “permission” icon 117 corresponding to each medical information. By selecting and operating any one of the icons 117, the attending physician permits the selected medical information (a part of the medical information 103) to be viewed on the specialist terminal device 30. This makes it possible to prevent the medical information of the patient from being unconditionally viewed by a third party other than the attending physician.

FIG. 27 is a schematic diagram showing a third example of the display screen of the attending physician terminal device 10 when the attending physician permits the disclosure of medical information of the patient. The display control unit 16 displays the medical information of the patient on the display screen 11 by dividing it into a plurality of parts. In the example of FIG. 26, medical information M1, medical information M2, medical information M3, ... Are displayed. The attending physician selects one of the medical information, and for example, by dragging and dropping the selected medical information to the area where the image S of the specialist is displayed, the selected medical information (one of the medical information 103). Department) is allowed to be viewed by the specialist terminal device 30. This makes it possible to prevent the medical information of the patient from being unconditionally viewed by a third party other than the attending physician.

FIG. 28 is a schematic diagram showing an example of display screens of the attending physician terminal device 10, the remote medical care terminal device 20, and the specialist doctor terminal device 30 when a specialist is talking with a patient in a video call between three parties. The display control unit 16 of the attending physician terminal device 10 displays the image S of the specialist in an area different from the area in which the image P of the patient and the image D of the attending physician are displayed.

The display control unit 201 of the remote medical care terminal device 20 displays the image of the other party with whom the patient is talking in the video call larger than the other images among the image P of the patient, the image D of the attending physician, and the image S of the specialist. In the example of FIG. 28, since the patient is talking to a specialist, the specialist image S is displayed larger than the other images.

The display control unit 36 of the specialist terminal device 30 displays the image of the other party the specialist is talking about in the video call larger than the other images among the image P of the patient, the image D of the attending physician, and the image S of the specialist. In the example of FIG. 28, since the specialist is talking to the patient, the patient's image P is displayed larger than the other images. When the specialist is conducting a consultation hearing with the patient, the attending physician does not necessarily have to be in front of the attending physician terminal device 10, and may be away from his / her seat.

Although not shown, the "close" icon is displayed on the display screens of the attending physician terminal device 10, the telemedicine terminal apparatus 20, and the specialist physician terminal apparatus 30. When either the attending physician, the patient, or the specialist operates the "close" icon, the display control unit 201 of the telemedicine terminal device 20 can erase the image S of the specialist from the display screen 21, and the consultation hearing by the specialist is completed. do.

FIG. 29 is a schematic diagram showing an example of display screens of the attending physician terminal device 10, the telemedicine terminal apparatus 20, and the specialist physician terminal apparatus 30 when the specialist advises the attending physician in a video call between the three parties. When the specialist inputs advice (advice) from the specialist terminal device 30, the server 50 transfers the advice from the specialist terminal device 30 to the attending physician terminal device 10. The display control unit 16 of the attending physician terminal device 10 can display the advice (advice) of a specialist in the window 11a. In the example of FIG. 29, the AI engine unit 59 of the server 50 can analyze the content of the advice input by the specialist, convert the content of the advice into medical terms, and automatically transfer it to the electronic medical record.

The advice may be input by text using a keyboard or the like, or by voice input using a microphone. If the attending physician is away from the attending physician terminal device 10, the specialist does not have to wait for the attending physician to return. Further, when the attending physician is in front of the display screen 11 of the attending physician terminal device 10, the specialist may directly orally convey advice to the attending physician.

FIG. 30 is a schematic diagram showing an example of display screens of the attending physician terminal device 10 and the telemedicine terminal apparatus 20 when the attending physician diagnoses and prescribes. The display control unit 16 of the attending physician terminal device 10 displays an image D of the attending physician and an image P of the patient. In this case, the image P of the patient is displayed larger than the image D of the attending physician. It is not necessary to display the image D of the attending physician.

The display control unit 201 of the telemedicine terminal device 20 displays the image D of the attending physician and the image P of the patient. In this case, the image D of the attending physician can be displayed larger than the image P of the patient. It is not necessary to display the patient image P. As a result, the patient can be diagnosed and prescribed by the attending physician.

FIG. 31 is a schematic diagram showing an example of a display screen of the telemedicine terminal device 20 when the telemedicine is completed. The display control unit 201 of the telemedicine terminal device 20 displays at least one of the time from the start to the end of the telemedicine, the number of times of the telemedicine, and the charge related to the telemedicine. In the example of FIG. 31, the telemedicine (medical treatment time) and the medical treatment fee between the patient and the attending physician are displayed, and the consultation time and the consultation fee between the patient and the specialist are displayed. For the patient, only the medical treatment time and the medical treatment fee with the attending physician may be displayed.

In addition to displaying the medical treatment hours and medical expenses on the display screen 21, it is also possible to notify the medical treatment hours and medical expenses by voice.

As a result, the patient can grasp the time and fee required for the telemedicine when the telemedicine is completed.

FIG. 32 is a schematic diagram showing an example of a case where the content displayed by the telemedicine terminal device 20 is displayed on another display device 80. The interface unit 203 outputs the content displayed on the display screen 21 by the display control unit 201 to the display device 80. The display device 80 (for example, a TV receiver having a large display screen) can display the display contents acquired from the telemedicine terminal device 20 on the display screen 81. In this case, the same display content may be displayed simultaneously on the display screen 21 of the telemedicine terminal device 20 and the display screen 81 of the display device 80, and when displaying on the display screen 81 of the display device 80, the telemedicine terminal device 20 The display screen 21 of the above may be turned off. Further, a video call is made by displaying the image of the patient himself, the image D of the attending physician, and the image S of the specialist on the display screen 81 of the display device 80 installed near the remote medical care terminal device 20. Can be done. By using a display device with a large display screen, for example, the image D of the attending physician can be displayed and viewed on the large display screen, and the patient can be given the feeling that the attending physician is actually nearby, and telemedicine can be performed. You can increase the familiarity with.

Next, the processing of the server 50, the attending physician terminal device 10, and the telemedicine terminal device 20 of the present embodiment will be described.

FIG. 33 is a flowchart showing an example of a procedure for generating guidance information for telemedicine by the server 50 of the present embodiment. The server 50 determines whether or not the remote medical care terminal device 20 has permission to collect conversation content (S11), and if there is permission (YES in S11), the server 50 identifies the ID (identification information) of the remote medical care terminal device 20 (identification information). S12). If there is no permission (NO in S11), the server 50 ends the process.

The server 50 collects the conversation content (S13) and analyzes the conversation content (S14). Based on the analysis result of the conversation content, the server 50 determines whether or not the information regarding the telemedicine is useful to the person who was having a conversation (S15). When it is determined to be useful (YES in S15), the server 50 generates the telemedicine guidance information based on the analysis result of the conversation content (S16), and outputs the generated guidance information to the telemedicine terminal device 20. (S17).

If the information about telemedicine is not useful (NO in S15), the server 50 performs the process of step S18 described later. The server 50 determines whether or not to end the process (S18), and if the process is not terminated (NO in S18), the server 50 continues the process after step S13. When the process is terminated (YES in S18), the server 50 terminates the process.

34 and 35 are flowcharts showing an example of a procedure for processing telemedicine by the server 50 of the present embodiment. The server 50 determines whether or not to start the telemedicine (S31), and if the telemedicine is not started (NO in S31), the process of step S31 is continued. When starting telemedicine (YES in S31), the server 50 performs video call processing (S32) and operates the timer 56 (S33).

The server 50 collects the content of the conversation between the patient and the attending physician (S34), and acquires the medical information of the patient (S35). The server 50 analyzes at least one of the conversation content and the patient's medical information (S36). The server 50 generates a list of candidates for the consultation staff (medical staff) based on the analysis result (S37).

The server 50 outputs (transmits) the generated list of candidates to the attending physician terminal device 10 (S38), and determines whether or not the consultation staff is selected from the attending physician terminal device 10 (S39). If there is no selection (NO in S39), the server 50 continues the process of step S39. When there is a selection (YES in S39), the server 50 acquires the position information from the specialist terminal device 30 of the selected consultation staff (S40).

The server 50 determines whether or not the consultation staff is in a predetermined medical place (S41), and if the consultation staff is in a predetermined medical place (YES in S41), the patient, the attending physician, and the consultation staff (for example, a specialist) Perform video call processing between the three parties (S42).

When the consultation staff is not in the designated medical place (NO in S41), the server 50 outputs (transmits) information to the attending physician terminal device 10 that medical treatment (consultation hearing) by the consultation staff is not possible (S43). , The process of step S44 described later is performed.

The server 50 determines whether or not the video call has ended (S44), and if the video call has not ended (NO in S44), the process of step S34 and subsequent steps is continued. When the video call ends (YES in S44), the server 50 specifies the time for telemedicine (S45) and calculates the charge for telemedicine (S46). The server 50 outputs (transmits) the time and fee of the telemedicine to the telemedicine terminal device 20 (S47), and ends the process.

FIG. 36 is a flowchart showing an example of the processing procedure of the attending physician terminal device 10 of the present embodiment. The attending physician terminal device 10 displays the patient list of the appointment time frame (S61), and displays the medical information of the patient in response to the request of the attending physician (S62). The attending physician terminal device 10 determines whether or not to start telemedicine (S63), and if the telemedicine is not started (NO in S63), the process of step S63 is continued.

When starting telemedicine (YES in S63), the attending physician terminal device 10 performs video call processing with the patient (S64). The attending physician terminal device 10 displays telemedicine assistance information (S65) and displays a list of candidates for consultation staff (S66), if necessary.

The attending physician terminal device 10 selects a counseling staff member, calls the selected counseling staff member according to the operation of the attending physician (S67), and performs video call processing between the three parties (S68). The attending physician terminal device 10 determines whether or not to terminate the video call processing (S69), and if the video call processing is not terminated (NO in S69), the process of step S69 is continued. When terminating the video call processing (YES in S69), the attending physician terminal device 10 ends the processing.

FIG. 37 is a flowchart showing an example of the processing procedure of the telemedicine terminal device 20 of the present embodiment. The telemedicine terminal device 20 determines whether or not it is before the predetermined time of the reservation time for telemedicine (S81), and if it is not before the predetermined time (NO in S81), the process of step S81 is continued. If it is before a predetermined time (YES in S81), the telemedicine terminal device 20 notifies the reservation of the telemedicine (S82) and determines whether or not the reservation confirmation operation is performed (S83).

If there is no reservation confirmation operation (NO in S83), the telemedicine terminal device 20 continues the process of step S82. When there is a reservation confirmation operation (YES in S83), the telemedicine terminal device 20 determines whether or not to start the telemedicine (S84), and when the telemedicine is not started (NO in S84), in step S84. Continue processing.

When starting telemedicine (YES in S84), the telemedicine terminal device 20 performs video call processing with the attending physician (S85). The telemedicine terminal device 20 determines whether or not to start the hearing with the consultation staff (for example, a specialist) (S86), and if the hearing is not started (NO in S86), the process of step S85 is continued.

When starting the hearing with the consultation staff (YES in S86), the telemedicine terminal device 20 performs video call processing between the three parties (S87). The telemedicine terminal device 20 determines whether or not to end the video call processing (S88), and if the video call processing is not ended (NO in S88), the processing in step S88 is continued. When the video call processing is terminated (YES in S88), the telemedicine terminal device 20 displays the time and charge of the telemedicine (S89), and terminates the processing.

The computer program according to the present embodiment is a computer program that operates on a doctor's terminal device for causing a computer to perform support for remote medical care, and the computer displays an image of a remote medical care subject and a doctor's image on a display screen. The process of displaying an image and the process of displaying an image of a medical worker different from the doctor in an area different from the area where the image of the remote medical care subject and the image of the doctor are displayed are executed.

The computer program runs on a physician terminal device that performs telemedicine support. For example, the doctor terminal device includes a video call function for telemedicine. The computer program displays an image of a telemedicine subject (patient) and an image of a doctor (physician) on the display screen of the doctor terminal device. The computer program displays an image of a medical worker different from the doctor in an area different from the area where the image of the telemedicine subject and the image of the doctor are displayed. A medical worker different from a doctor is, for example, a medical worker who gives professional advice to a doctor who performs remote medical care, and is a specialist (consultant doctor), a dietitian, a nurse, a pharmacist, a medical treatment instructor, etc. Includes psychological counselors, registered dietitians, health exercise instructors, care managers, etc.

With the above configuration, the doctor can make a video call between the three parties including the medical staff in addition to the video call between the two parties with the patient, and when performing telemedicine, for example, Get real-time advice from a specialist. This makes it possible to improve the accuracy of diagnosis and support the telemedicine of doctors.

In the computer program according to the present embodiment, the content of the conversation between the telemedicine subject and the doctor or the remote in an area different from the area where the image of the telemedicine subject and the image of the doctor are displayed on the computer. The process of displaying the telemedicine assistance information generated based on the medical information of the medical treatment target person is executed.

The computer program is a telemedicine generated based on the content of the conversation between the telemedicine subject and the doctor or the medical information of the telemedicine subject in an area different from the area where the image of the telemedicine subject and the image of the doctor are displayed. Display auxiliary information. Another area for displaying the telemedicine assistance information may be a different area from the area where the image of the medical worker is displayed, or may be the same area. That is, the image of the medical worker and the telemedicine assistance information may be displayed simultaneously in different areas, or only one of the image of the medical worker and the telemedicine assistance information may be displayed in the same area and the other may be erased. You may.

The telemedicine assistance information is information for supporting the telemedicine of a doctor, for example, information generated by AI (artificial intelligence) judging from the content of a conversation between a doctor and a patient, or medical information of a patient (for example, medical information of a patient). Includes information generated by AI's judgment from (information related to medical examinations, diagnoses, examinations, etc.). The telemedicine assistance information can also include images of health care workers.

With the above configuration, the doctor can utilize the telemedicine assistance information, and thus can support the doctor's telemedicine.

The computer program according to the present embodiment causes a computer to execute a process of displaying medical information of the telemedicine subject on the display screen.

The computer program displays medical information (for example, information related to medical examination, diagnosis, examination, etc.) of a telemedicine subject on a display screen. As a result, the doctor can refer to the medical information of the patient when making a video call with the patient and the medical staff, and thus can support the doctor's telemedicine.

The computer program according to the present embodiment is a process of displaying a list of candidates for the medical staff in a computer in a region different from the region in which the image of the remote medical care subject and the image of the doctor are displayed. And the process of displaying the image of the medical worker selected from the candidate list.

The computer program displays a selectable list of candidates for medical staff in an area different from the area where the image of the telemedicine subject and the image of the doctor are displayed, and the image of the medical worker selected from the candidate list. Is displayed. For example, by performing an operation of selecting a required medical worker from a list of candidates, a video call is started with the worker device of the selected medical worker, and an image of the medical worker is displayed. Can be done. It should be noted that, among the displayed candidates for the medical staff, only the candidates who are ready to participate in the video call may be selectable.

With the above configuration, the physician can easily initiate a three-way video call with the patient and the healthcare professional.

The computer program according to the present embodiment is a candidate for the medical worker in the other area based on the content of the conversation between the telemedicine subject and the doctor or the medical information of the telemedicine subject on the computer. Execute the process to display the list in a selectable manner.

The computer program selectively displays a list of candidates for health care workers in another area based on the content of the conversation between the telemedicine subject and the doctor or the medical information of the telemedicine subject. For example, the list of candidates for medical staff may be generated by AI (artificial intelligence) judging from the content of conversation between a doctor and a patient, or for medical information of a patient (for example, medical examination, diagnosis, examination, etc.). The AI may determine and generate it from the relevant information). This makes it possible to list candidates for the appropriate or optimal medical staff for doctors and patients.

The computer program according to the present embodiment causes the computer to execute a process of prioritizing the candidates of the medical staff and displaying the candidate list.

The computer program prioritizes and displays a list of candidates for health care workers. This allows physicians to select appropriate or optimal healthcare professionals for physicians and patients.

The computer program according to the present embodiment sets whether or not to allow the computer to view all or part of the medical information of the telemedicine subject on the worker terminal device of the medical worker. Execute the accepting process.

The computer program accepts the setting of whether to allow all or part of the medical information of the telemedicine subject to be viewed on the worker terminal device of the medical worker. This makes it possible to prevent the medical information of the patient from being unconditionally viewed by a third party other than the doctor.

The computer program according to the present embodiment displays on the computer an index related to the emotion of the telemedicine subject generated based on at least one of the voice, the image, and the utterance content of the telemedicine subject. Let it run.

The computer program displays an index relating to the emotion of the telemedicine subject generated based on at least one of the voice, the image, and the utterance content of the telemedicine subject. The emotional index may be, for example, the emotion of the patient and may indicate the patient's situation that the doctor can sense if it is a face-to-face medical treatment. Specifically, the facial expression and the degree of energy. Etc. can be included. The index can be represented by a chart, an image including an icon, a numerical value, or the like.

With the above configuration, it is possible to convey to the doctor the complexion and facial expression of the patient, which is difficult to understand by video call, and it is possible to approach face-to-face medical care.

The computer program according to the present embodiment uses a computer to display the index related to the emotion of the telemedicine subject generated at the time of this telemedicine and the emotion of the telemedicine subject generated at the time of the telemedicine prior to this time. A process of displaying information indicating a change in emotions of the telemedicine subject by comparing with the index is executed.

The computer program compares the index related to the emotions of the telemedicine subject generated at the time of this telemedicine with the index related to the emotion of the telemedicine subject generated at the time of the telemedicine prior to this time. Display information that indicates changes in emotions. This makes it possible to inform doctors of changes in the patient's complexion and facial expressions (changes during this telemedicine compared to the previous telemedicine) that are difficult to understand with video calls, making it possible to approach face-to-face medical care. ..

The support device according to the present embodiment is a support device that supports remote medical care, and is an image receiving unit that receives an image of a doctor acquired by a doctor terminal device and an image of a remote medical care target person acquired by the target person terminal device. An image transmission unit that transmits an image of a doctor received by the image receiving unit to the subject terminal device, and an image of a remote medical care subject received by the image receiving unit to the doctor terminal device, and the doctor. An output unit that outputs a list of candidates for medical staff different from the above to the doctor terminal device, a reception unit that accepts selection of medical staff from the list of candidates, and a reception unit that accepts selection from the reception unit. It is provided with a providing unit that provides a video communication function between a doctor terminal device, the subject terminal device, and a worker terminal device of a selected medical worker.

The support method according to the present embodiment is a support method for supporting remote medical care, and receives and receives an image of a doctor acquired by a doctor terminal device and an image of a remote medical care target person acquired by a target person terminal device. The image of the doctor is transmitted to the subject terminal device, the received image of the remote medical care subject is transmitted to the doctor terminal device, and a list of candidates for medical staff different from the doctor is output to the doctor terminal device. Then, when the selection of the medical worker is accepted from the candidate list and the selection is accepted, the doctor terminal device, the target person terminal device, and the worker terminal device of the selected medical worker are among the three parties. Provides video calling capabilities.

The image receiving unit receives the image of the doctor (the attending physician) acquired by the doctor terminal device and the image of the telemedicine subject (patient) acquired by the subject terminal device. The image transmission unit transmits the image of the doctor received from the doctor terminal device to the subject terminal device, and transmits the image of the remote medical care subject received from the subject terminal device to the doctor terminal device.

The output unit outputs a list of candidates for medical staff different from the doctor to the doctor terminal device. The reception department accepts the selection of medical staff from the list of candidates. Specifically, when a doctor performs an operation of selecting a required medical worker from a list of candidates in the doctor terminal device, the doctor terminal device outputs the result of the operation to the support device and accepts the operation. The unit accepts the result of the operation, that is, the selection.

When the reception unit accepts the selection, the providing unit provides a video communication function between the doctor terminal device, the target person terminal device, and the worker terminal device of the selected medical worker. The doctor can make a video call between the three parties including the patient and the medical staff, and can obtain, for example, the advice of a specialist in real time when performing telemedicine. This makes it possible to improve the accuracy of diagnosis and support the telemedicine of doctors.

The support device according to the present embodiment includes a specific unit that specifies the time or number of times related to a video call between any two of the doctor terminal device, the worker terminal device, and the target person terminal device.

The specific unit specifies the time or the number of times related to the video call between any two of the doctor terminal device, the worker terminal device, and the target person terminal device. That is, the time or number of video calls between the doctor terminal device and the subject terminal device, between the doctor terminal device and the worker terminal device, or between the worker terminal device and the subject terminal device is specified. .. This makes it possible to obtain information for calculating the cost of telemedicine.

The support device according to the present embodiment generates remote medical care assistance information based on the conversation content acquisition unit that acquires the conversation content between the telemedicine target person and the doctor, and the conversation content acquired by the conversation content acquisition unit. It is provided with an auxiliary information generation unit and an auxiliary information transmission unit that transmits the telemedicine auxiliary information generated by the auxiliary information generation unit to the doctor terminal device.

The conversation content acquisition department acquires the conversation content between the telemedicine target person and the doctor. The auxiliary information generation unit generates telemedicine auxiliary information based on the acquired conversation content. The auxiliary information generation unit can be, for example, an AI (artificial intelligence) engine composed of an algorithm that realizes a voice recognition function, a language analysis function, a machine learning function, or a trained model. Telemedicine assistance information includes information to support the telemedicine of a doctor. The auxiliary information transmission unit transmits the generated telemedicine auxiliary information to the doctor terminal device.

With the above configuration, the doctor can utilize the telemedicine assistance information, and thus can support the doctor's telemedicine.

The support device according to the present embodiment includes a list generation unit that generates a list of candidates for the medical worker based on the conversation content acquired by the conversation content acquisition unit, and the medical worker generated by the list generation unit. It is provided with a list transmission unit that transmits a list of candidates of the above to the doctor terminal device.

The list generation unit generates a list of candidates for medical staff based on the conversation content acquired by the conversation content acquisition unit. The list generation unit can be the AI (artificial intelligence) engine described above. The list transmission unit transmits the generated list of candidates for medical staff to the doctor terminal device.

The above configuration can provide physicians with suitable or optimal medical professional candidates for physicians and patients.

The support device according to the present embodiment includes a medical information acquisition unit that acquires medical information of the telemedicine target person, and the list generation unit is engaged in the medical treatment based on the medical information acquired by the medical information acquisition unit. Generate a list of candidates for the person.

The medical information acquisition department acquires medical information (for example, information related to medical examination, diagnosis, examination, etc.) of a telemedicine target person. The list generation unit generates a list of candidates for medical staff based on the acquired medical information. This makes it possible to provide doctors with candidates for the appropriate or optimal medical staff for doctors and patients.

The support device according to the present embodiment is a position information acquisition unit that acquires the position information of the worker terminal device, and a medical worker related to the worker terminal device based on the position information acquired by the position information acquisition unit. The providing unit is provided with a determination unit for determining whether or not to permit the support of the medical staff, and the providing unit provides a video call function to the worker terminal device of the medical worker who is determined to be permitted by the determination unit.

The position information acquisition unit acquires the position information of the worker terminal device. For example, by equipping the worker terminal device with a GPS receiver and transmitting its own position information acquired by the worker terminal device to the support device, the position information acquisition unit acquires the position information of the worker terminal device. Can be done.

The determination unit determines whether or not to permit the support of the medical staff related to the worker terminal device based on the acquired position information. For example, the location of a medical place where medical practice is permitted is registered in advance, and based on the acquired position information, it is determined whether or not the worker terminal device exists in the predetermined medical place, and the position is set to the predetermined medical place. If present, support for health care workers can be granted.

The providing unit provides a video call function to the worker terminal device of the medical worker who is determined to be permitted by the determination unit. This makes it possible to ensure that telemedicine is performed at a predetermined medical place by a medical worker and to record the fact, so that legal telemedicine can be performed.

1 Communication network 10 Main medical terminal device 11 Display screen 11a Window 12 Control unit 13 Communication unit 14 Input unit 15 Storage unit 16 Display control unit 17 Video call processing unit 20 Remote medical care terminal device 21 Display screen 22 Control unit 23 Communication unit 24 Camera 25 Microphone 26 Speaker 27 Human sensor 28 Storage unit 29 Operation unit 201 Display control unit 202 Video call processing unit 203 Interface unit 30 Specialist terminal device 31 Display screen 32 Control unit 33 Communication unit 34 Input unit 35 Storage unit 36 Display control unit 37 Video Call processing unit 50 Server 51 Control unit 52 1st communication unit 53 2nd communication unit 54 3rd communication unit 55 Video call function providing unit 56 Timer 57 Charge calculation unit 58 Patient DB
59 AI Engine Department 60 Auxiliary Information Generation Department 61 Consultation Staff DB
62 Support permission judgment unit 80 Display device 81 Display screen 101 Display button 102 Call button 103 Medical information 104, 106, 108 Character 105, 107, 109 Bar graph 110 Chart 111 Expert information 112 Priority order 113 Title 114 Reservation button 115 Call button 116, 117, 210 Icon 118 "Yes" Icon 119 "No" Icon

Claims (15)

A computer program that runs on a doctor's terminal device to make a computer perform telemedicine support.
On the computer
Processing to display the image of the telemedicine target person and the image of the doctor on the display screen,
A process of displaying an image of a medical worker different from the doctor in an area different from the area in which the image of the telemedicine subject and the image of the doctor are displayed .
A process of receiving telemedicine assist information generated based on the conversation content between the telemedicine target person and the doctor, including at least one of the voice, image, and utterance content of the telemedicine target person, from the support device.
A computer program that runs. On the computer
A remote generated based on the content of a conversation between the telemedicine subject and the doctor or medical information of the telemedicine subject in an area different from the area where the image of the telemedicine subject and the image of the doctor are displayed. The computer program according to claim 1, wherein a process for displaying medical assistance information is executed. On the computer
The computer program according to claim 1 or 2, wherein the process of displaying the medical information of the telemedicine subject on the display screen is executed. On the computer
A process of selectively displaying a list of candidates for the medical staff in an area different from the area in which the image of the telemedicine subject and the image of the doctor are displayed.
The computer program according to any one of claims 1 to 3, wherein the process of displaying an image of a medical worker selected from the candidate list is executed. On the computer
A claim for executing a process of selectively displaying a list of candidates for a medical worker in the other area based on the content of a conversation between the telemedicine target person and the doctor or medical information of the telemedicine target person. The computer program according to 4. On the computer
The computer program according to claim 5, wherein the candidate of the medical worker is given a priority and a process of displaying the candidate list is executed. On the computer
13. The computer program described in any one of the sections. On the computer
Any one of claims 1 to 7 for executing a process of displaying an index relating to the emotion of the telemedicine subject generated based on at least one of the voice, image and utterance content of the telemedicine subject. The computer program described in the section. On the computer
The index related to the emotion of the telemedicine subject generated at the time of this telemedicine is compared with the index related to the emotion of the telemedicine subject generated at the time of the telemedicine prior to this time. The computer program according to claim 8, wherein a process of displaying information indicating a change in emotion is executed. It is a support device that supports telemedicine.
An image receiver that receives the image of the doctor acquired by the doctor terminal device and the image of the telemedicine subject acquired by the target person terminal device, and the image receiver.
An image transmitting unit that transmits an image of a doctor received by the image receiving unit to the subject terminal device and transmits an image of a telemedicine subject received by the image receiving unit to the doctor terminal device.
An output unit that outputs a list of candidates for medical professionals different from the doctor to the doctor terminal device, and
The reception department that accepts the selection of medical staff from the list of candidates,
When the selection is accepted by the reception unit, the reception unit provides a video call function between the doctor terminal device, the target person terminal device, and the worker terminal device of the selected medical worker .
The conversation content acquisition unit that acquires the conversation content between the telemedicine target person and the doctor,
An auxiliary information generation unit that generates remote medical care auxiliary information based on a conversation content including at least one of the voice, an image, and an utterance content of the telemedicine target person acquired by the conversation content acquisition unit.
With the auxiliary information transmission unit that transmits the telemedicine auxiliary information generated by the auxiliary information generation unit to the doctor terminal device.
A support device equipped with. The support device according to claim 10, further comprising a specific unit for specifying the time or number of times related to a video call between any two of the doctor terminal device, the worker terminal device, and the target person terminal device. A list generation unit that generates a list of candidates for the medical staff based on the conversation content including at least one of the voice, the image, and the utterance content of the telemedicine subject acquired by the conversation content acquisition unit.
The support device according to claim 10 or 11 , further comprising a list transmission unit that transmits a list of candidates for the medical staff generated by the list generation unit to the doctor terminal device. It is equipped with a medical information acquisition department that acquires medical information of the telemedicine target person.
The list generator is
The support device according to claim 12 , wherein a list of candidates for the medical worker suitable for the doctor and the telemedicine target person is generated based on the medical information acquired by the medical information acquisition unit. The location information acquisition unit that acquires the location information of the worker terminal device,
It is provided with a determination unit for determining whether or not to permit the support of the medical worker related to the worker terminal device based on the position information acquired by the position information acquisition unit.
The providing part
The support device according to any one of claims 10 to 13 , which provides a video call function to a worker terminal device of a medical worker determined to be permitted by the determination unit. It is a support method that supports telemedicine,
Receive the image of the doctor acquired by the doctor terminal device and the image of the telemedicine subject acquired by the target person terminal device,
The received image of the doctor is transmitted to the subject terminal device, and the received image of the telemedicine subject is transmitted to the doctor terminal device.
A list of candidates for medical professionals different from the doctor is output to the doctor terminal device, and the list is output to the doctor terminal device.
Accepting the selection of medical professionals from the list of candidates,
When the selection is accepted, it provides a video call function between the doctor terminal device, the subject terminal device, and the worker terminal device of the selected medical worker.
Acquire the content of the conversation between the telemedicine target person and the doctor,
Generates telemedicine assistance information based on the acquired conversation content including at least one of the voice, image, and utterance content of the telemedicine subject.
A support method for transmitting the generated telemedicine assistance information to the doctor terminal device .

Images