WO2019038807A1

WO2019038807A1 - Information processing system and information processing program

Info

Publication number: WO2019038807A1
Application number: PCT/JP2017/029794
Authority: WO
Inventors: 哲生塩飽; 穂積金子; 一真岡本
Original assignee: リーズンホワイ株式会社
Priority date: 2017-08-21
Filing date: 2017-08-21
Publication date: 2019-02-28
Also published as: JPWO2019038807A1

Abstract

[Purpose] To provide an information processing system and an information processing program for allowing the contents of utterances to be reflected. [Solution] An information processing system is provided with: a reception unit 331 that, in relation to the utterance between a first user using a first telephone communication terminal 1 and a second user using a second telephone communication terminal 2, receives the utterance voices of the utterance performed by use of the first telephone communication terminal 1 or the second telephone communication terminal 2; a conversion unit 332 that converts voice data corresponding to the utterance voices received by the reception unit 331 to text data corresponding to the voice data; and a processing unit 333 that, on the basis of at least one of the voice data corresponding to the utterance voices received by the reception unit 331 or the text data as converted by the conversion unit 332, performs an utterance-voice-related processing that is a processing related to the utterance voices received by the reception unit 331.

Description

INFORMATION PROCESSING SYSTEM AND INFORMATION PROCESSING PROGRAM

The present invention relates to an information processing system and an information processing program.

Conventionally, in medical practice, communication between medical workers (for example, a doctor or a nurse) is generally performed in an oral conversation using a portable terminal (for example, a portable telephone). Therefore, for example, after the conversation on the portable terminal is ended, the conversation content may not be reflected by forgetting the content of the conversation or forgetting that the conversation has been made itself. there were.

Then, the medical information input device (refer patent document 1) which stores the information regarding medical treatment and assists the medical worker was proposed. In this medical information input device, the medical worker stores information related to medical treatment (for example, data of treatment performed on the patient by the medical worker, etc.), and the information is reflected in the medical field.

JP 2014-211828 A

However, when reflecting the contents of conversation between medical workers using a device such as the medical information input device of Patent Document 1, it was necessary for the medical workers to manually input the information, but the actual As medical personnel at medical sites are extremely busy, it may be difficult to secure time to manually input medical information, and it may be difficult to reflect the contents of conversations. The

This invention is made in view of the above, Comprising: It aims at providing the information processing system and information processing program which can reflect the uttered content.

In order to solve the problems described above and achieve the purpose, an information processing system according to claim 1 uses a first user using a first call terminal and a second user using a second call terminal. Receiving means for receiving an utterance voice of the utterance performed using the first call terminal or the second call terminal between the user and the user, and corresponding to the utterance voice received by the receiving means Converting means for converting voice data to text data corresponding to the voice data, the voice data corresponding to the speech received by the receiving means, or the text data among the text data converted by the converting means And processing means for performing speech related processing, which is processing related to the speech received by the receiving means, based on at least one of the data.

Further, in the information processing system according to claim 2, in the information processing system according to claim 1, the processing means sends the voice data or the text data to the first user or the second user. Data recognition processing for confirmation is performed as the uttered voice related processing.

Further, in the information processing system according to claim 3, in the information processing system according to

claim

1 or 2, the receiving unit is configured to transmit an utterance related to a request from the first user to the second user. The processing means performs request execution support processing for causing the second user to execute a request corresponding to the uttered voice received by the receiving means as the uttered voice related processing.

In the information processing system according to claim 4, in the information processing system according to claim 3, the processing means recognizes the second user the request corresponding to the uttered voice received by the receiving means. Request recognition processing for causing the request to be executed is performed as the request execution support processing.

In the information processing system according to claim 5, in the information processing system according to claim 3 or 4, whether the processing means has insufficient information in a request corresponding to the speech received by the reception means If it is determined that there is the shortage information, request information request processing for requesting the first user to compensate for the deficiency information is performed as the request execution support processing.

The information processing system according to claim 6 is the information processing system according to any one of claims 1 to 5, wherein the receiving means receives an utterance related to the use of an object as the utterance voice, The processing means performs usage information output processing for outputting information related to the use of the object as the utterance voice related processing.

The information processing system according to claim 7 is the information processing system according to any one of claims 1 to 6, wherein at least a speech storage unit for storing the text data converted by the conversion unit. The first user or the second user is a medical worker, and the receiving unit receives an utterance related to a state of a patient of the first user or the second user as the utterance voice. The processing means performs state information output processing for outputting information on the state of the patient as the speech voice related processing based on at least the text data stored in the speech storage means.

An information processing program according to claim 8 is an information processing program, wherein the computer is a second user using a first call terminal using a first call terminal and a second user using a second call terminal. Receiving means for receiving an utterance voice of the utterance performed using the first call terminal or the second call terminal, and a voice corresponding to the utterance voice received by the receiving means. At least one of conversion means for converting data into text data corresponding to the voice data, the voice data corresponding to the speech received by the reception means, or the text data converted by the conversion means Function as processing means for performing an uttered voice related process which is a process related to the uttered voice received by the receiving means based on the data of

According to the information processing system according to claim 1, it is related to the uttered voice based on the voice data corresponding to the uttered voice received by the receiving means or the data of at least one of the text data converted by the converting means. For example, since the first user or the second user can perform the speech-related process without manually inputting the contents of the speech, the speech-related process can be performed. It becomes possible to reflect the contents surely. In particular, for example, when applied to speech at a medical site, the content of the speech at the medical site can be reflected, and the activity at the medical site can be facilitated or the content of the speech at the medical site can be effective. It can be used to

According to the information processing system of the second aspect, by performing the data recognition process, for example, the first user or the second user can be made to confirm the voice data or the text data, so the content of the utterance can be It becomes possible to reflect on the first user or the second user. Further, for example, it is possible to remind the first user or the second user that there is an utterance performed using the first call terminal or the second call terminal.

According to the information processing system according to claim 3, for example, by performing the request execution support process, it becomes possible to support the second user to execute the request corresponding to the uttered voice, and the first use It is possible to facilitate the activities of the person and the second user.

According to the information processing system of the fourth aspect, by performing the request recognition process, for example, the second user can be made to recognize the request, and thus the second user can be notified that the request has been made. It will be possible to remind. In particular, for example, when the second user is made to recognize a request at a medical site, it is possible to facilitate activities at the medical site.

According to the information processing system according to the fifth aspect, by performing the request information request process, for example, the lack information corresponding to the uttered voice can be compensated, so that an appropriate request can be made, and the first use It is possible to further facilitate the activities of the person and the second user.

According to the information processing system of the sixth aspect, by performing the use information output process, for example, it is possible to output information regarding the use of the object, so that the contents of the utterance can be used to improve the object, etc. It is possible to make effective use of the contents of the utterance.

According to the information processing system of the seventh aspect, by performing the state information output process, for example, information on the state of the patient can be output, so that the contents of the utterance can be used for the treatment of the patient. It becomes possible to effectively utilize the contents of the utterance.

According to the information processing program according to claim 8, related to the uttered voice based on the voice data corresponding to the uttered voice received by the receiving means, or at least one of the text data converted by the converting means. For example, since the first user or the second user can perform the speech-related process without manually inputting the contents of the speech, the speech-related process can be performed. It becomes possible to reflect the contents surely. In particular, for example, when applied to speech at a medical site, the content of the speech at the medical site can be reflected, and the activity at the medical site can be facilitated or the content of the speech at the medical site can be effective. It can be used to

It is a figure which shows the example of utilization of the medical system which concerns on this Embodiment. 1 is a block diagram of a medical system. It is the figure which illustrated terminal information. It is the figure which illustrated utterance record information. It is a flowchart of a storage notification process. It is a flow chart of medicine information output processing.

Hereinafter, embodiments of an information processing system and an information processing program according to the present invention will be described in detail with reference to the drawings. However, the present invention is not limited by this embodiment.

[Basic concept of the embodiment]
First, the basic concept of the embodiment will be described. The embodiment relates generally to an information processing system and an information processing program. Here, the “information processing system” is a system that processes arbitrary information, specifically, a system that processes information of an utterance, for example, a dedicated system that processes information of an utterance, or a general-purpose system It is a concept including the system etc. which are realized by implementing the function which processes the information on utterance to a system. Further, this “information processing system” includes, for example, a system realized by an integrated computer, or a system realized by a plurality of computers distributed and communicable with each other, As an example, the receiving means, the converting means, and the processing means are provided.

The “reception means” is an utterance between the first user using the first call terminal and the second user using the second call terminal, and the first call terminal or the second It is a means to receive the uttered voice of the said utterance performed using a telephone terminal.

“Speech between the first user using the first call terminal and the second user using the second call terminal” means an utterance from the first user to the second user, or , An utterance from the second user to the first user, specifically, a dialog in which both perform interactively at the same time, or from one user to the other at the same time or a different time It is a concept that includes one-way utterance and so on.

The “first call terminal” is a call terminal used by a first user, and for example, a portable terminal such as a mobile phone such as a smartphone, a PHS telephone, or a tablet device, or a stationary telephone , A fixed type terminal such as a personal computer and the like. The “second call terminal” is another call terminal different from the first call terminal and is a call terminal used by the second user, and for example, the portable terminal described above, or the above-described Concept including a fixed type terminal and the like.

The “first user” is a user who uses the first call terminal, for example, a person registered as a user of the first call terminal, and as an example, medical services such as a doctor or a nurse It is a concept that includes a person or any person other than a medical worker (for example, a clerk in charge of a carrier, a driver, etc.). The “second user” is a person who is different from the first user and who uses the second call terminal, for example, a person registered as a user of the second call terminal, As an example, the concept includes the above-described health care worker, or any person other than the health care worker (for example, a carrier clerk, a driver, etc.) and the like.

The "uttered voice" is a voice generated by a voice, and is, for example, a voice that can be received by the information processing system via the first call terminal or the second call terminal.

The "conversion means" is a means for converting speech data corresponding to the speech received by the reception means into text data corresponding to the speech data. The “voice data” is, for example, information for specifying a waveform corresponding to the vibration of air by voice, and the “text data” is, for example, character information.

"Processing means" refers to speech data received by the receiving means based on voice data corresponding to speech voice received by the receiving means, or at least one of text data converted by the converting means. It is a means to perform the uttered voice related processing which is processing.

The "voice-related process" is a process related to the voice received by the receiving means, and more specifically, a process performed based on at least one of voice data and text data, for example This is a concept including data recognition processing, request execution support processing, usage information output processing, state information output processing, and the like.

The “data recognition process” is a process of outputting information for causing the first user or the second user to check voice data or text data, and for example, a process of notifying voice data or text data, etc. Is a concept that includes The “request execution support process” is a process of outputting information for causing the second user to execute a request corresponding to the uttered voice, and is a concept including, for example, a request recognition process, a request information request process, and the like. The “request recognition process” is a process of outputting information for causing the second user to recognize the request corresponding to the uttered voice, and, for example, the request content is stored as a memorandum (for example, a so-called reminder, a so-called ToDo list, etc.) It is a concept including processing to notify. The “request information request process” determines whether there is insufficient information in the request corresponding to the uttered voice, and when it is determined that the insufficient information is present, the first user is requested to compensate for the insufficient information. The process is a process of outputting information for requesting, and is a concept including, for example, a process of determining whether or not there is any information such as an execution time limit of the request content, and the like, as required. The “use information output process” is a process for outputting information on the use of an object, and for example, information on the use of medicine, information on the use of medical equipment, or information on the use of other things, etc. It is a concept that includes, for example, information on side effects of drugs, information that specifies the possibility of using a medical device (specifically, information that specifies the content of planned surgery), etc. It is an included concept. The “object” is an object to be uttered, and is a concept including, for example, an object related to medical treatment such as a drug or a medical device, or any object not related to medical treatment. The “state information output process” is a process for outputting information related to the condition of a patient, and is a concept including, for example, a process for outputting information related to the condition of treatment of the patient.

And in the embodiment shown below, when the "first call terminal" and the "second call terminal" are smart phones and the "first user" and the "second user" are doctors, "speech" A case where data recognition processing and usage information output processing are performed will be described as "voice related processing".

(Constitution)
First, the configuration of the medical system according to the embodiment will be described. FIG. 1 is a view showing an application example of the medical system according to the present embodiment, and FIG. 2 is a block diagram of the medical system. Although the number of call terminals included in the medical system 100 of FIG. 2 is arbitrary, the first call terminal 1 and the second call terminal 2 will be specifically exemplified and described here. The first call terminal 1 and the second call terminal 2 are call terminals having the same configuration as each other, but will be described by attaching “first” and “second” for convenience.

The medical system 100 of FIG. 2 schematically includes a first call terminal 1, a second call terminal 2, and a management server 3. The first call terminal 1, the second call terminal 2, and the medical server 100 in FIG. The management servers 3 are communicably connected to each other wirelessly via a network. This medical system 100 is an existing medical system (for example, a system capable of exchanging various information using a call terminal or a stationary terminal or the like between a plurality of doctors or a plurality of hospitals). ) May be realized as a separate system, or may be realized by incorporating it into the existing medical system, or a part of a so-called social networking service (SNS: Social Networking Service). It may be realized here by, for example, being incorporated into an existing medical system. The installation location and mounting method of the management server 3 are arbitrary, and can be configured by a plurality of distributed servers, etc., or one or more provided in a specific place such as a server management room of a hospital However, for convenience of explanation, it will be described as one server. The first call terminal 1 and the second call terminal 2 will be described below as being carried and used by a doctor who is working at a general hospital or the like, which is a relatively large hospital, for example.

(Configuration-first call terminal)
First, the configuration of the first call terminal 1 will be described. The first call terminal 1 is, for example, a smartphone assigned to a doctor (AA teacher) in the hospital who is the first user and used by the doctor, and as an example, the communication unit 11, the operation unit 12, and the display A speaker 14, a microphone 15, a recording unit 16, and a control unit 17 are provided.

(Configuration-first call terminal-communication unit)
The communication unit 11 is communication means for performing communication with each call terminal of the medical system 100, and performs, for example, voice communication with the second call terminal 2 via the management server 3. Although the specific type and configuration of the communication unit 11 are arbitrary, for example, the communication unit 11 can be configured to include a known wireless communication circuit and the like.

(Configuration-first call terminal-operation unit)
The operation unit 12 is an operation unit that receives an operation input by a user. Although the specific type and configuration of the operation unit 12 are arbitrary, for example, the operation unit 12 is configured as a known touch pad, and further, the touch pad is formed to be transparent or translucent, and the front surface of the display 13 is The touch panel is provided so as to overlap the display surface of the display 13 in FIG.

(Configuration-1st call terminal-Display)
The display 13 is display means for displaying various images under the control of the control unit 17. Although the specific type and configuration of the display 13 are optional, for example, the display 13 can be configured using a flat panel display such as a known liquid crystal display or an organic EL display.

(Configuration-1st call terminal-speaker)
The speaker 14 is an audio output unit that outputs various types of audio based on the control of the control unit 17. Although the specific type and configuration of the speaker 14 are arbitrary, for example, the speaker 14 can be configured using a known audio output circuit or the like.

(Configuration-1st call terminal-microphone)
The microphone 15 is a sound collection unit that receives a speech sound. Although the specific type and configuration of the microphone 15 are arbitrary, for example, it can be configured using a known microphone configuration (for example, a vibrating plate, a coil or the like).

(Configuration-first call terminal-recording unit)
The recording unit 16 is a recording unit that records programs necessary for the operation of the first call terminal 1 and various data. The recording unit 16 is configured using, for example, a flash memory as an external recording device. However, it is possible to use a magnetic recording medium such as a hard disk, or any other recording medium including an optical recording medium such as a DVD or a Blu-ray disc instead of or together with the flash memory.

(Configuration-first call terminal-control unit)
The control unit 17 is a control unit that controls the first call terminal 1, and more specifically, the CPU, various programs to be interpreted and executed on the CPU (a basic control program such as an OS, or the It is a computer comprising an internal memory such as a RAM for storing programs and various data, including an application program for realizing functions. In particular, the information processing program according to the embodiment substantially configures each part of the control unit 17 by being installed in the first call terminal 1 via an arbitrary recording medium or network (a management server 3 described later) The same applies to the control unit 33 of

(Configuration-second call terminal)
Next, the configuration of the second call terminal 2 will be described. The second call terminal 2 is, for example, a smartphone assigned to a doctor (BB teacher) in the hospital who is the second user and used by the doctor, and as an example, the communication unit 21, the operation unit 22, and the display A speaker 24, a microphone 25, a recording unit 26, and a control unit 27 are provided. The components of the second call terminal 2 are configured in the same manner as the components of the first call terminal 1 having the same name.

(Configuration-Management Server)
Next, the configuration of the management server 3 will be described. The management server 3 is an information processing system, and includes, for example, a communication unit 31, a recording unit 32, and a control unit 33.

(Configuration-Management Server-Communication Unit)
The communication unit 31 is a communication unit that performs communication with each call terminal of the medical system 100, and relays voice communication between call terminals of the medical system 100, for example. Although the specific type and configuration of the communication unit 31 are arbitrary, for example, the communication unit 31 can be configured to include known wireless communication circuits, relay circuits, and the like.

(Configuration-Management Server-Recording Unit)
The recording unit 32 is a recording unit that records programs necessary for the operation of the management server 3 and various data. The recording unit 32 is configured, for example, using a hard disk (not shown) as an external recording device. However, instead of the hard disk or together with the hard disk, any other recording medium may be used, including a magnetic recording medium such as a magnetic disk or an optical recording medium such as a DVD or a Blu-ray disc.

Further, the recording unit 32 includes, for example, a terminal information database 321 (hereinafter, the database is referred to as “DB”), a speech recording information DB 322, a voice data DB 323, and a text data DB 324.

(Configuration-Management Server-Recording Unit-Terminal Information DB)
The terminal information DB 321 is a terminal information storage that stores terminal information. The “terminal information” is information related to each call terminal of the medical system 100. FIG. 3 is a diagram illustrating terminal information. As shown in FIG. 3, the terminal information is configured, for example, by mutually associating the item "terminal ID" and the item "doctor name information" with the information corresponding to each item. Here, the information corresponding to the item “terminal ID” is terminal identification information that uniquely identifies each call terminal of the medical system 100 (hereinafter, “identification information” is referred to as “ID”) (in FIG. 3, “IDd1” that is the terminal ID of the first call terminal 1 and “IDd2” that is the terminal ID of the second call terminal 2). Further, the information corresponding to the item “doctor name information” is doctor name information specifying the name of the doctor who is using each call terminal of the medical system 100 (in FIG. 3, it is a description for convenience of description, The doctor whose image is illustrated on the left side of the drawing of FIG. 1 and whose name is the doctor who is using the first call terminal 1 “AA”, the doctor whose image is illustrated on the right side of the drawing of FIG. 1 “BB” which is the name of the doctor who is using the second call terminal 2). Then, for such terminal information, for example, after each call terminal of the medical system 100 is assigned (loaned) to a doctor in a hospital, the assignment result (loan result) is reflected, It stores by inputting using unillustrated input means (for example, a keyboard, a mouse, etc.) of the management server 3.

(Configuration-Management Server-Recording Unit-Terminal Information DB)
The speech recording information DB 322 is speech recording information storage means for storing speech recording information. The “speech record information” is information in which a speech is recorded, and more specifically, information in which information on a call (communication) between the communication devices of the medical system 100 is recorded. FIG. 4 is a diagram illustrating speech record information. As shown in FIG. 4, the speech recording information includes, for example, the item "source information", the item "destination information", the item "date and time information", the item "voice data identification information", and the item "text data identification information". "And information corresponding to each item are mutually associated and configured. Here, the information corresponding to the item "source information" is source information that specifies the source of the call (communication) (in FIG. 4, it is the terminal ID of the call terminal of the source, "IDd2", etc. ). Further, the information corresponding to the item “destination information” is transmission destination information for specifying a transmission destination (destination) of the call (communication) (in FIG. 4, it is the terminal ID of the call terminal of the destination, “IDd1 "etc). Further, the information corresponding to the item “date and time information” is date and time information specifying the date and time when the telephone call (communication) was performed (in FIG. 4, it is an 8-digit number for specifying month and day and hour and minute) To identify 14:01 on June 15, "06151401", etc.). Further, the information corresponding to the item "audio data identification information" is audio data identification information for identifying audio data stored in the audio data DB 323 (in FIG. 4, it is a file name of audio data, "vFile 1" etc). Further, the information corresponding to the item “text data identification information” is text data identification information identifying text data stored in the text data DB 324 (in FIG. 4, it is a file name of text data, “tFile1”. etc). Then, such utterance record information is stored by executing a storage notification process described later.

(Configuration-Management server-Recording unit-Voice data DB)
The voice data DB 323 is voice data storage means for storing voice data. As described above, “voice data” is, for example, information that specifies a waveform corresponding to the vibration of air due to voice, and more specifically, the voice of a conversation between call terminals of the medical system 100 The data to be specified is, for example, one stored as a file of audio data compressed by a known compression method. Such voice data is stored by executing storage notification processing described later.

(Configuration-Management server-Recording unit-Text data DB)
The text data DB 324 is text data storage means for storing text data, and is speech storage means for storing text data converted by the conversion unit 332 described later. As described above, “text data” is, for example, character information, which is converted from speech data by the conversion unit 332, and is stored as a text data file, for example. Such text data is stored by executing storage notification processing described later.

(Configuration-Management Server-Control Unit)
The control unit 33 in FIG. 2 is a control unit that controls the management server 3 and includes a receiving unit 331, a converting unit 332, and a processing unit 333 in functional concept. The receiving unit 331 is a receiving unit that receives an utterance voice of an utterance performed using the call terminal, which is an utterance between users using the call terminal of the medical system 100, and more specifically, An utterance between a first user using the first call terminal 1 and a second user using the second call terminal 2, the first call terminal 1 or the second call terminal 2 To receive the uttered voice of the utterance performed using The conversion unit 332 is a conversion unit that converts voice data corresponding to the utterance voice received by the reception unit 331 into text data corresponding to the voice data. The processing unit 333 relates to the speech voice received by the reception unit 331 based on the voice data corresponding to the speech voice received by the reception unit 331, or at least one of the text data converted by the conversion unit 332. Processing means for performing a speech related process, which is a process to be performed. The processing performed by each unit of the control unit 33 will be described later.

(processing)
Next, processing executed by the medical system 100 configured as described above will be described. Here, for example, storage notification processing and medicine information output processing will be described.

(Process-storage notification process)
First, storage notification processing will be described. FIG. 5 is a flowchart of the storage notification process (steps will be abbreviated as “S” in the following description of each process). The “storage notification process” is a process including data recognition process, and stores, for example, voice data and text data, and also causes the first user or the second user to check voice data or text data. Processing. Although the timing for executing the storage notification process is arbitrary, for example, when a call is made to the call terminal of the call destination using the call terminal of the medical system 100 (that is, each call terminal of the medical system 100 In the case where the communication of the uttered voice via the management server 3 has started) or the call terminal of the call destination is called using the call terminal of the medical system 100, within a predetermined time (for example, 30) Execution is started when, for example, the voice communication between the call terminal of the medical system 100 and the management server 3 is started, etc., if the telephone switches to the answering machine mode without communication in seconds). Here, the execution of the storage notification process will be described as execution of the storage notification process as execution of the storage notification process when the call is made to the call terminal of the call destination. In addition, a list (for example, a list such as a so-called address book) of the terminal ID of the own terminal and the terminal ID of the call terminal which is the candidate of the call destination is recorded in the recording unit of the call terminal of the medical system 100 (for example, the first The recording unit 16 of the call terminal 1 records a list as a candidate of the call destination including the terminal IDs “IDd1” and “IDd2” of the own terminal, and the recording unit 26 of the second call terminal 2 It is assumed that a list that is a candidate of a call destination including IDs “IDd2” and “IDd1” is recorded), and a call terminal that makes a call manages its own terminal ID and a call destination terminal ID The storage notification process will be described as being started after the execution of the storage notification process is started.

Further, for example, the doctor who is the request source who is the first user in FIG. 1 uses the first call terminal 1 to call the second call terminal 2 of the doctor who is the request destination who is the second user. If the doctor who is the client asks me to receive the medication M1 to patient P1, she developed pressure pleural effusion complications on July 1 and the side effects of anorexia also occurred. A case will be described by exemplifying the case where the patient P1 should be administered the drug M2 by 9:00 am on July 3 (hereinafter referred to as a request speech regarding the drug administration). In addition, since a well-known call process can be applied to the call between the first call terminal 1 and the second call terminal 2, only the process characteristic to the present application performed by the management server 3 will be described here. .

First, at SA1 in FIG. 5, the reception unit 331 starts recording. Specifically, although it is arbitrary, for example, the speech voice from the first call terminal 1 and the speech voice from the second call terminal 2 are received through the communication unit 31, and the voice data DB 323 is stored as voice data Start the recording process to continue. Then, when the doctor who made the request utters at the first call terminal 1, after the speech sound is collected by the microphone 15 of the first call terminal 1, the collected speech sound is transmitted via the communication unit 11. Is transmitted to the management server 3 and relayed by the management server 3 and transmitted to the second call terminal 2. However, when the recording process described above is started, the management server 3 The reception unit 331 receives and records the uttered voice transmitted from the first call terminal 1 to the management server 3. The recording by the management server 3 in the case where the requested doctor utters at the second call terminal 2 is also performed in the same manner as the case where the requesting doctor utters at the first call terminal 1.

Here, for example, when the doctor who made the request utters "request utterance regarding drug administration" at the first call terminal 1, the microphone 15 of the first call terminal 1 speaks uttered voice "request utterance for drug administration" After collecting the sound, the collected speech voice is transmitted to the management server 3 via the communication unit 11, and the transmitted speech speech is relayed by the management server 3 and transmitted to the second call terminal 2. However, when the above-mentioned recording process is started, the reception unit 331 of the management server 3 receives the uttered voice transmitted from the first call terminal 1 to the management server 3 and copes with the received uttered voice. The voice data corresponding to the “request utterance regarding drug administration” is generated and stored in the voice data DB 323 in a file format compressed by a known compression method.

In SA2 of FIG. 5, the reception unit 331 determines whether the call has ended. Specifically, although it is arbitrary, for example, it is determined whether or not the first call terminal 1 or the second call terminal 2 has disconnected the telephone communication by a known method, and the call is ended based on the determination result. It is determined whether or not. When the first call terminal 1 or the second call terminal 2 does not disconnect the communication of the telephone (that is, the communication of the telephone between the first call terminal 1 and the second call terminal 2 is performed). In the case where it is determined that the call has not ended (NO in SA2), SA2 is repeatedly executed until it is determined that the call has ended. When the first call terminal 1 or the second call terminal 2 disconnects the telephone communication, it is determined that the call has ended (YES in SA2), and the process proceeds to SA3. Here, for example, when the doctor as the request source performs an operation to cut off the communication of the telephone of the first call terminal 1, it is determined that the communication of the telephone is cut and the call is ended.

The receiving unit 331 ends the recording in SA3 of FIG. Specifically, although it is arbitrary, for example, the audio data stored between the start of the recording at SA1 and the end of the recording at SA3 after the above-described recording process is regarded as one file. After putting it together, a file name (a file name which can be uniquely identified by the audio data DB 323) is added to this one file according to a predetermined algorithm, and the audio data is stored in the audio data DB 323 with the attached file name. Do. Here, for example, a file name “vFile 3” is attached to one file of voice data corresponding to “request speech regarding drug administration”, and the file is stored in the voice data DB 323.

In SA4 of FIG. 5, the converting unit 332 converts voice data corresponding to the speech received by the receiving unit 331 into text data corresponding to the voice data and stores the converted text data. Specifically, although it is arbitrary, for example, the voice data stored in SA3 is acquired, the acquired voice data is converted to text data by a known conversion algorithm, and the converted text data is converted to a file name according to a predetermined algorithm (File name that can be uniquely identified in the text data DB 324) is added, and text data is stored in the text data DB 324 with the attached file name. In addition, since a known method can be used as a specific method of converting voice data into text data, detailed description will be omitted. Here, for example, “vFile3” of the voice data DB 323 is acquired, the acquired “vFile3” is converted into text data which is one file, and the converted text data is given a file name “tFile3” It stores in data DB324.

In SA5 of FIG. 5, the processing unit 333 stores speech recording information. Specifically, although it is optional, for example, each information in FIG. 4 (that is, source information, destination information, date and time information, voice data identification information, text data identification information) is specified as follows and stored Do.

First, for source information and destination information, for example, the terminal ID of the call terminal and the terminal ID of the call destination, which are transmitted from the call terminal of the medical system 100 to the management server 3 when starting the storage notification process And specifies the terminal ID of the call terminal making the acquired call as source information, and specifies the acquired terminal ID of the call destination as destination information. Here, for example, when the storage notification process is started, the first call terminal 1 making a call transmits “IDd1” which is its own terminal ID and “IDd2” which is a called party terminal ID to the management server 3 In this case, “IDd1” is specified as the sender information, and “IDd2” is specified as the sender information.

Also, with regard to date and time information, when storage notification processing is started by accessing a clocking unit (for example, a clock circuit such as a known timer circuit) not shown (that is, for example, for a call terminal of a call destination). The date and time of the call) is acquired, and the date and time information corresponding to the acquired date and time is specified. Here, for example, when 17:14 on July 2 is acquired as the date and time when the call is made to the call terminal of the call destination, 070211714 is specified.

Further, for voice data identification information, the file name of voice data stored at SA3 is identified, and for text data identification information, the file name of text data stored at SA4 is identified. Here, for example, “vFile 3” is identified as the audio data identification information, and “tFile 3” is identified as the text data identification information.

Then, after each information in FIG. 4 is specified as described above, the specified information is stored in the speech recording information DB 322 to store the speech recording information. Here, for example, each information of the third level from the upper side of the drawing of FIG. 4 is stored.

In SA6 of FIG. 5, the processing unit 333 sends a notification to confirm the voice data or text data to the first user or the second user. Specifically, although it is arbitrary, for example, as shown in FIG. 1, in order to recognize that a call has been made to the first user and the second user, for example, the first call terminal The notification 13 is performed by displaying the transmission source notification image G1 on the first display 13 and displaying the transmission destination notification image G2 on the display 23 of the second call terminal 2.

Here, the “source side notification image” G1 is information related to the uttered voice and is an image displayed on the call terminal which has made a call in the medical system 100, and, for example, the source side message information G11, It is an image including the sender side voice reproduction button G12 and the sender side text display button G13. The sender side message information G11 is information for specifying that the first user has made a request, and more specifically, is text information for specifying the date and time of the request and the doctor of the request destination. The source-side voice reproduction button G12 is a button for reproducing the stored voice data, and the source-side text display button G13 is a button for displaying the stored text data.

The “destination notification image” G2 is information related to the uttered voice and is an image displayed on the call terminal (that is, the call destination) called in the medical system 100. It is an image including the front side message information G21, the transmission side audio reproduction button G22, and the transmission side text display button G23. The transmission destination side message information G21 is information for specifying that the second user has been requested, and more specifically, is text information for specifying the date and time when the request was made and the doctor as the request source. The destination-side audio reproduction button G22 is a button for reproducing stored audio data, and the destination-side text display button G23 is a button for displaying stored text data.

More specifically, the processing unit 333 displays the source notification image G1 and the transmission destination notification image G2 of FIG. 1 based on the terminal information of FIG. 3 and the utterance recording information of FIG. Do. For details of the source notification image G1 of FIG. 1, first, the date and time information of FIG. 4 is acquired, and the date and time corresponding to the acquired date and time information is on the left side of ":" of the source message information G11 of FIG. indicate. Further, the transmission destination information of FIG. 4 is acquired, referring to FIG. 3, the doctor name information corresponding to the terminal ID of the acquired transmission destination information is acquired, and the acquired doctor name information is on the right side of “:”. Further, the message "To teacher" is displayed on the right side of the message to make the sender message information G11. Further, the voice data identification information of FIG. 4 is acquired, and a link to the voice data specified by the acquired voice data identification information among the voice data stored in the voice data DB 323 of FIG. 2 is generated and generated. After the generated link is associated with the transmission side audio reproduction button G12, the transmission side audio reproduction button G12 is displayed. Also, the text data identification information of FIG. 4 is acquired, and a link to text data specified by the acquired text data identification information among the text data stored in the text data DB 324 of FIG. 2 is generated and generated. After the generated link is associated with the sender-side text display button G13, the sender-side text display button G13 is displayed.

Here, for example, first, in the third row of information from the upper side of the drawing in FIG. 4, first, date and time information = “07021714” is acquired, and the date and time corresponding to the acquired date and time information = “July 2, 17:14 "" Is displayed on the left side of ":" of the source message information G11 of FIG. Further, the transmission destination information = “IDd2” in FIG. 4 is acquired, and referring to FIG. 3, the doctor name information = “BB” corresponding to the terminal ID of the acquired transmission destination information is acquired, and the acquired doctor name The information is displayed on the right side of ":", and the message "To teacher" is displayed on the right side of the ":" to make the sender side message information G11. Further, the voice data identification information = “vFile3” in FIG. 4 is acquired, and the voice data specified by the acquired voice data identification information among the voice data stored in the voice data DB 323 in FIG. After the link to the voice data corresponding to “request uttering regarding” is generated, and the generated link is associated with the sending side voice reproduction button G12, the transmission source side voice reproduction button G12 is displayed. Further, the text data identification information = “tFile3” in FIG. 4 is acquired, and the text data specified by the acquired text data identification information among the text data stored in the text data DB 324 in FIG. After the link to the text data corresponding to “request utterance regarding“) is generated and the generated link is associated with the transmission source side text display button G 13, the transmission source side text display button G 13 is displayed.

Also, in detail with respect to the transmission destination side notification image G2 of FIG. 1, first, the date and time information of FIG. 4 is acquired, and the date and time corresponding to the acquired date and time information is “:” of the transmission destination side message information G21 of FIG. Display on the left side. Also, the source information in FIG. 4 is acquired, and referring to FIG. 3, the doctor name information corresponding to the terminal ID of the acquired destination information is acquired, and the acquired doctor name information is on the right side of “:”. By displaying the text and further displaying the text "from the teacher" on the right side, destination message information G21 is made. Further, the voice data identification information of FIG. 4 is acquired, and a link to the voice data specified by the acquired voice data identification information among the voice data stored in the voice data DB 323 of FIG. 2 is generated and generated. After the generated link is associated with the destination voice reproduction button G22, the destination voice reproduction button G22 is displayed. Also, the text data identification information of FIG. 4 is acquired, and a link to text data specified by the acquired text data identification information among the text data stored in the text data DB 324 of FIG. 2 is generated and generated. After associating the generated link with the transmission destination side text display button G23, the transmission destination side text display button G23 is displayed.

Here, for example, in the third level information from the upper side of the drawing of FIG. 4, date / time information = “07021714”, sender information = “IDd2”, audio data identification information = “vFile3”, and text data identification information = “tFile3 Is displayed, and the transmission destination notification image G2 of FIG. 1 is displayed. In addition, a link to voice data corresponding to “request speech regarding drug administration” is associated with the transmission side audio reproduction button G22 of the transmission destination side notification image G2, and to the transmission side text display button G23. A link to text data corresponding to “request speech regarding drug administration” will be associated. This completes the storage notification process.

(Process-Storage notification process-Data confirmation)
As described above, at SA6 in FIG. 5, as shown in FIG. 1, the source notification image G1 is displayed on the display 13 of the first call terminal 1, and the call is sent to the display 23 of the second call terminal 2. Since the front notification image G2 is displayed, it is possible to make the first user or the second user recognize that there is a call, and confirm the audio data or the text data.

For example, the doctor who is the request source who is the first user can recognize that he / she has made a request by telephone by visually recognizing the sender message information G11 of the sender notification image G1. Become. Further, when the caller side voice reproduction button G12 is pressed, the control unit 17 of the first call terminal 1 makes the voice data (information related to the uttered voice) corresponding to the pressed caller side voice reproduction button G12 Since the voice is output via the speaker 14 and reproduced, the doctor as the request source can confirm the content of the “request utterance regarding drug administration” by voice. In addition, when the sender side text display button G13 is pressed, the control unit 17 of the first call terminal 1 displays text data (information related to speech) corresponding to the sender side text display button G13 pressed. As a result, display and output is performed via S13, and the request source doctor can confirm the content of "request utterance regarding drug administration" by text.

Also, for example, the doctor who is the request destination who is the second user can recognize that he / she is requested by telephone by visually recognizing the transmission destination side message information G21 of the transmission destination side notification image G2. It becomes. In addition, when the transmission side voice reproduction button G22 is pressed, the control unit 27 of the second call terminal 2 converts the voice data (information related to the speech) corresponding to the pressed transmission side voice reproduction button G22, Since the voice is output and reproduced through the speaker 24, the doctor as the request destination can confirm the content of the "request utterance regarding drug administration" by voice. In addition, when the transmission destination side text display button G23 is pressed, the control unit 27 of the second call terminal 2 displays text data (information related to speech) corresponding to the pressed transmission destination side text display button G23. As a result, display and output are performed through S.23, and the doctor of the request destination can confirm the content of "request speech regarding drug administration" by text.

(Process-Drug information output process)
Next, drug information output processing will be described. FIG. 6 is a flowchart of medicine information output processing. The “drug information output process” is a process including a usage information output process, for example, a process of outputting information related to the use of a drug, and as an example, a process of outputting information on a side effect of a drug. The timing to execute the drug information output process is arbitrary, but for example, it is repeatedly executed every predetermined time (for example, 12 hours to 24 hours, etc.), and after execution of the drug information output process is started. explain.

First, the processing unit 333 acquires data in SB1 of FIG. Specifically, for example, the text data of the text data DB 324 of the recording unit 32 of FIG. In addition, since the drug information output process is repeatedly performed at predetermined time intervals as described above, in order to prevent the same text data of the text data DB 324 from being redundantly performed a plurality of times, For example, the file name of the text data acquired at SB1 is recorded in the recording unit 32, and only text data not recorded in the recording unit 32 is acquired. Here, for example, text data or the like corresponding to “request speech regarding drug administration” having a file name “tFile 3” is acquired.

In SB2 of FIG. 6, the processing unit 333 determines whether to output information. Specifically, although it is arbitrary, for example, it is determined whether the text data acquired at SB1 includes a predetermined keyword, and it is determined whether to output information based on the determination result. The "predetermined keyword" is a keyword used to determine whether or not to output information, and relates to, for example, information contributing to the business of a drug provider (eg, a pharmaceutical company etc.) It is a keyword, for example, a keyword set by the provider side. Here, for example, it is assumed that “drug”, “side effect”, and “complication” are set as predetermined keywords. Specifically, with regard to SB1, when the text data acquired in SB1 does not include all of the predetermined keywords, it is determined that the information is not output (NO in SB2), and the process is ended. When the text data acquired in SB1 includes a predetermined keyword, it is determined that the information is to be output (YES in SB2), and the process shifts to SB3. Here, for example, the text data acquired at SB1 “The patient P1 was administered the drug M1 and developed complications of compression pleural effusion on July 1 and a side effect of anorexia also occurred. 7 Please administer the medication M2 to the patient P1 by 9:00 am on March 3. "contains all the keywords" drug "," side effects "and" complications ", It is determined that information is to be output.

The processing unit 333 outputs information at SB3 in FIG. Specifically, although it is arbitrary, for example, it is assumed that the management server 3 is communicably connected to a terminal device (for example, a smartphone or a stationary computer) on the medicine provider side, and acquired at SB1. The transmitted text data is output by transmitting it to the terminal device on the medicine provider side. Here, for example, text data (information relating to speech sound) corresponding to the “request speech regarding drug administration” having the file name “tFile 3” is transmitted. Then, the provider side of the drug that has received the text data corresponding to the “request administration for drug administration” changes the usage of the existing drug, improves the existing drug, or stores the received text data. It can be used to develop new drugs. This completes the information output process.

(Effect of the embodiment)
As described above, according to the embodiment, at least one of speech data corresponding to the speech received by the reception unit 331 or text data converted by the conversion unit 332 relates to the speech. For example, the first user or the second user manually inputs the content of the utterance by performing the utterance voice related processing (specifically, the data recognition processing and the use information output processing) which is the processing. Since it is possible to perform the utterance voice related processing, the contents of the utterance can be reliably reflected. In particular, for example, when applied to speech at a medical site, the content of the speech at the medical site can be reflected, and the activity at the medical site can be facilitated or the content of the speech at the medical site can be effective. It can be used to

Also, by performing data recognition processing, for example, the first user or the second user can be made to confirm voice data or text data, so the content of the utterance is reflected to the first user or the second user. It is possible to Also, for example, it becomes possible to remind the first user or the second user that there is an utterance performed using the first call terminal 1 or the second call terminal 2.

In addition, by performing use information output processing, for example, it is possible to output information regarding the use of an object (specifically, a drug), so that the contents of the utterance can be used to improve the object, etc. It becomes possible to effectively utilize the contents of the utterance.

[Modification]
Although the embodiments according to the present invention have been described above, the specific configuration and means of the present invention can be arbitrarily modified and improved within the scope of the technical idea of each invention described in the claims. Hereinafter, such a modified example will be described.

(About problem to be solved and effect of invention)
First of all, the problems to be solved by the invention and the effects of the invention are not limited to the contents described above, and the present invention solves the problems not described above, and the effects not described above. It may also play, or may only solve some of the listed tasks or only some of the listed effects.

(About distribution and integration)
In addition, each of the above-described electrical components is functionally conceptual and does not necessarily have to be physically configured as illustrated. That is, the specific form of the distribution and integration of each part is not limited to the illustrated one, and all or a part thereof is functionally or physically dispersed or integrated in any unit according to various loads, usage conditions, etc. Can be configured. Furthermore, the “system” in the present application is not limited to one configured by a plurality of devices, but includes one configured by a single device. In addition, the “device” in the present application is not limited to one configured by a single device, but includes one configured by a plurality of devices. The data structure of each piece of information (including DB) described in the above embodiment may be arbitrarily changed. The management server 3 may be omitted by distributing the function of the management server 3 to the first call terminal 1 or the second call terminal 2.

(About shape, number, structure, time series)
With regard to the components illustrated in the embodiments and the drawings, the shape, the numerical value, or the structure or the time-series correlation of a plurality of components may be arbitrarily modified and improved within the scope of the technical idea of the present invention. Can.

(About each process (1))
In addition, each process described in the above embodiment may be arbitrarily rearranged, omitted, changed, or a new process may be added. Specifically, for example, the conversion unit 332 of the management server 3 receives the speech sound transmitted to the management server 3 without waiting for the storage of the voice data of SA3 in SA4 of FIG. 5. Text data may be converted each time.

(About each process (2))
Further, for example, in the case of SB1 to SB3 in FIG. 6, although the case of processing using only text data has been described, the present invention is not limited thereto, and each processing may be performed using only voice data, or voice data and text Each process may be performed using both of the data. In other words, the processing unit 333 may be configured to perform only the text data, or may be configured to perform only the voice data, or the voice data and the text data may be processed for the utterance voice related processing. It may be configured to perform using both of the above (the same applies to the speech related processing of the modification).

(About each process (3))
Also, for example, as the "predetermined keyword" in SB2 of FIG. 6, for example, it is a keyword related to the information contributing to the business of the provider of the medical device (for example, medical device maker etc.). "Stomach cancer surgery" and "endoscopic surgery" may be set as keywords set by the provider side, and the management server 3 may output information to the terminal device of the provider of the medical device at SB3. . In this case, the medical device manufacturer gives the doctor a manual for the operation of the device for using the endoscopic surgery device in gastric cancer before surgery, or asks the doctor about the feeling of use of the device or the like after surgery. By doing so, it can be used for sales activities or product development (improvement) activities.

(About the output format of text data)
In addition, the text data displayed when the transmission source side text display button G13 or the like in FIG. 1 of the above-described embodiment is pressed may be displayed in association with the person who spoke. Specifically, at the time of voice recording, after recording in association with the speaker, each utterance content may be associated with the speaker and converted into text data, and then text data may be displayed in association with the speaker. .

(About the output of information)
In the above-described embodiment or modification, regarding the information described to be displayed on the display, the information corresponding to the display content is voiced from the speaker of each device (for example, the speaker 14 of the first call terminal 1 etc.) It may be configured to output, or may be configured to provide printing means such as a printer and print out on a sheet, or to communicate units of each device (for example, the first call terminal 1 The communication unit 11 or the like) may be configured to perform communication output.

(About Utterance-related processing)
In the above embodiment, the processing unit 333 of the management server 3 in FIG. 2 performs data recognition processing and usage information output processing as the uttered voice related processing, but the present invention is not limited to this. Perform the above-mentioned request execution support processing (specifically, request recognition processing, request information request processing) or status information output processing based on voice data of the voice data DB 323 and text data of the text data DB 324. It may be configured. The respective processes may be performed together with the process of SA6 of FIG. 4 (or the processes of SB1 to SB3 of FIG. 5) or in place of SA6 (or the processes of SB1 to SB3 of FIG. 5).

(About Utterance-related processing-Request execution support processing)
For the request execution support process, for example, the reception unit 331 receives an utterance related to the request for the second user from the first user as the utterance voice, and the voice data and the text are the same as in the embodiment. When data is stored, the processing unit 333 performs reminder as request recognition processing based on voice data of the voice data DB 323 and text data of the text data DB 324, outputs a ToDo list as request recognition processing, or Perform request information request processing. In addition, about the process here, it is necessary to identify that the uttered voice received by the receiving unit 331 is related to the request on the management server 3 side, and to process the identified uttered voice, For example, a predetermined operation by the user (for example, when making a call, “11” is input via the operation unit 12 or the like) or a predetermined utterance by the user (for example, “request item” or the like) Each process may be performed after identifying that it is related to the request by uttering a keyword or the like.

(About Utterance-related processing-Request execution support processing-Request recognition processing)
For the reminder, the processing unit 333 sets the second call terminal 2 to perform the following operation. For example, predetermined time intervals (for example, 1 hour interval to 2 hour intervals, or 12 hour intervals) until the second user performs a predetermined operation (operation to end output of reminder information) at the second call terminal 2 A message indicating that there is a request on the display 23 at a 24-hour interval etc.) or a predetermined time (9 am, 1 pm and 5 pm etc.) (for example, a message such as “request exists, please check”) Are displayed, or the message is output as voice via the speaker 24, or, if the vibrator function is installed, vibration is performed to set a reminder.

Further, with regard to the to-do list, the processing unit 333 sets the first call terminal 1 and the second call terminal 2 so as to perform the following operation. For example, the request content and the check box are associated with each other and displayed in a list on the display 23 of the second call terminal 2, and the second user performs a predetermined operation at the second call terminal 2 (check to show that the request has been executed) When an operation to put a check in the box is performed, a check is displayed in the displayed check box, and in this case, the first call terminal that is the request source side that the second call terminal 2 is checked Send to 1 and when the first call terminal 1 receives this check, a message indicating that the request has been executed (for example, a message such as "request has been executed") to the first call terminal Display on the display 13 of FIG. 1, or voice output of the message via the speaker 14, or vibration when the vibrator function is installed. Set to. Note that in the communication between these first call terminal 1 and the second call terminal 2, may be implemented using known techniques.

When configured in this way, by performing the request execution support process, for example, it becomes possible to support the second user to execute the request corresponding to the uttered voice, and the first user and the second user It is possible to facilitate the activities of In particular, by performing the request recognition process, for example, the second user can be made to recognize the request, so that it is possible to remind the second user that there is a request. Also, for example, when making the second user recognize a request at a medical site, it is possible to facilitate activities at the medical site.

(About Utterance-related processing-Request information request processing)
In the request information request process, the processing unit 333 first acquires the text data of the text data DB 324, and determines whether there is insufficient information in the request corresponding to the acquired text data. Here, the "insufficient information" is information lacking in the request for the uttered voice, and specifically, is information lacking for predetermined information, and, for example, In the case where the execution deadline is information that is predetermined, if the execution deadline is not included, the execution deadline corresponds to the shortage information. In addition, below, this execution deadline is illustrated and demonstrated. In the above determination, when the processing unit 333 determines that there is insufficient information in the request corresponding to the acquired text data, a message indicating that there is insufficient information on the display 13 of the first call terminal 1 (for example, “ There is no remark of the deadline, please call again to notify the deadline, etc.) and request the first user to make up for the missing information. On the other hand, when the processing unit 333 determines that there is no shortage information in the request corresponding to the acquired text data, the processing unit 333 does not have to output the above-described message because there is no need to compensate for the shortage information. When it is determined that there is no lack information in the request corresponding to the acquired text data, the display 13 of the first call terminal 1 makes the first user recognize that the request has been normally performed, A message indicating that the request has been successfully made (for example, a message such as “The request has been made without excess or deficiency.”) May be displayed.

When configured in this way, by performing the request execution support process, for example, it becomes possible to support the second user to execute the request corresponding to the uttered voice, and the first user and the second user It is possible to facilitate the activities of In particular, by performing request information request processing, for example, it is possible to compensate for the lack information corresponding to the uttered voice, so appropriate requests can be made, and the activities of the first user and the second user are made smoother. It is possible to

(About Utterance-related processing-Status information output processing)
In the state information output process, for example, the reception unit 331 receives an utterance relating to the state of the patient of the first user or the second user as an utterance voice, and voice data and text are received in the same manner as described in the embodiment. When the data is stored, the processing unit 333 performs processing for outputting information related to the condition of the patient based on the voice data of the voice data DB 323 and the text data of the text data DB 324. In addition, about the process here, it is necessary to identify that the uttered voice received by the receiving unit 331 is related to the state of the patient on the management server 3 side, and to process the identified uttered voice. In the same manner as, for example, “(for speech-related processing-request execution support processing)”, a predetermined operation of the user (for example, when making a call, “99” is input via the operation unit 12 Or, each process may be performed after identifying that it is related to the request by a predetermined utterance of the user (for example, uttering a predetermined keyword such as “the patient's condition”) .

Specifically, the receiving unit 331 receives and stores the phase of treatment (the state of the patient and the treatment performed for the disease, etc.) as speech voice, and the processing unit 333 stores the text data of the text data DB 324 Is acquired, and based on the acquired text data, the phase of the stored treatment is displayed on the display 13 of the first call terminal 1, the display 23 of the second call terminal 2, or the first call terminal 1 or the second Display and output on a terminal device (not shown) (for example, a smartphone or a stationary computer) of the managing doctor who manages the doctor who uses the call terminal 2. Here, for example, even if the patient's condition (for example, an inquiry result, an examination result, etc.) and the treatment (for example, an administered drug, an operation performed, etc.) are received, they are displayed in association with each other Good. In addition, from the viewpoint of improving the quality of medical practice, a predetermined standard path (phase of flow treatment that serves as a model until patient cures (patient's condition and treatment performed for the disease, etc.)) Alternatively, the actual treatment may be evaluated and the evaluation result may be displayed by comparing the reference pass with the actually performed treatment. When configured in this way, by performing state information output processing, for example, it is possible to output information about the state of the patient, so the content of the utterance can be used for the treatment of the patient, and the content of the utterance is made effective. It becomes possible to utilize.

(Other processing)
In addition, the control unit 33 of the management server 3 performs the following automatic extraction processing, assist processing, or dictionary processing via each call terminal based on the uttered voice or the stored voice data or text data. It may be configured to perform. The “automatic extraction process” is a process of automatically extracting particularly important information from the medical point of view, and performing display and management to prevent oversight, for example, “lifesaving”, “emergency”, “medication”, “retraction” This is a concept including processing such as highlighting in a text based on an utterance when a word such as “allergy” is uttered, or giving a warning when the correspondence confirmation button is not pressed within a predetermined time. In addition, “assist processing” is processing to support the business activities of the doctor, and for example, when the doctor gives informed consent to the patient or the family, the contents described and the conversation with the patient etc. are recorded, It is a concept including processing to be kept as a record of informed consent. The “dictionary-like process” is a process of outputting an answer to speech as voice according to the dictionary information stored in advance. For example, when the doctor utters “drug of disease name A”, “the disease name A Drugs are processed by voice to answer "a1, a2, a3" or when the doctor utters "drug X and drug Y, concomitant contraindications", the presence or absence of concomitant contraindications of drug X and drug Y, It is a concept that includes the process of making an answer by voice.

(Speech of multiple people)
Moreover, although the case where this application was applied to an utterance between two persons was demonstrated in the said embodiment, this application is applicable not only to this but the case where an utterance is performed by three or more persons, for example.

(About the feature)
Further, the features of the above-described embodiment and the features of the modification may be arbitrarily selected and combined.

(Supplementary note)
The information processing system according to supplementary note 1 is an utterance between a first user using a first call terminal and a second user using a second call terminal, the first call terminal or the first call terminal Receiving means for receiving the uttered voice of the uttered performed using the second call terminal, and converting the voice data corresponding to the uttered voice received by the receiving means into text data corresponding to the voice data Means, the speech data received by the receiving means based on data of at least one of the voice data corresponding to the speech voice received by the receiving means, or the text data converted by the converting means Processing means for performing speech related processing, which is processing related to.

The information processing system according to appendix 2, in the information processing system according to appendix 1, the processing means is data recognition for causing the first user or the second user to confirm the voice data or the text data. The process is performed as the uttered voice related process.

In the information processing system according to appendix 3, in the information processing system according to

appendix

1 or 2, the reception means receives an utterance relating to a request for the second user from the first user as the speech voice, and the process The means performs a request execution support process for causing the second user to execute a request corresponding to the uttered voice received by the receiving means as the uttered voice related process.

The information processing system according to appendix 4, in the information processing system according to appendix 3, the processing means is a request recognition process for causing the second user to recognize a request corresponding to the speech received by the reception means. As the request execution support process.

In the information processing system according to appendix 5, in the information processing system according to appendix 3 or 4, the processing means determines whether or not there is insufficient information in a request corresponding to the speech received by the reception means, When it is determined that there is the shortage information, request information request processing for requesting the first user to compensate for the deficiency information is performed as the request execution support processing.

The information processing system according to appendix 6, in the information processing system according to any one of appendixes 1 to 5, wherein the receiving means receives an utterance relating to use of an object as the speech, and the processing means Usage information output processing for outputting information on usage of the object is performed as the uttered voice related processing.

The information processing system according to appendix 7, in the information processing system according to any one of appendixes 1 to 6, further comprising: speech storage means for storing the text data converted by the conversion means, the first use The person or the second user is a medical worker, and the receiving means receives an utterance relating to the state of the patient of the first user or the second user as the speech, and the processing means at least A state information output process for outputting information on the state of the patient is performed as the speech voice related process based on the text data stored in the speech storage means.

The information processing program according to appendix 8 is an information processing program, and the computer speaks between a first user using a first call terminal and a second user using a second call terminal. Receiving means for receiving an utterance voice of the utterance performed using the first call terminal or the second call terminal, voice data corresponding to the voice voice received by the reception means, the voice Based on at least one of data of conversion means for converting into text data corresponding to data, said voice data corresponding to said speech received by said receiving means, or said text data converted by said conversion means And processing means for performing a speech related process, which is processing related to the speech received by the reception means.

(Effect of Supplementary Note)
According to the information processing system described in appendix 1, the speech data is related to the speech sound based on at least one of the speech data corresponding to the speech speech received by the reception means or the text data converted by the conversion means. By performing the uttered voice related process which is the process, for example, the uttered voice related process can be performed without the first user or the second user manually inputting the content of the uttered, so the uttered content Can be reliably reflected. In particular, for example, when applied to speech at a medical site, the content of the speech at the medical site can be reflected, and the activity at the medical site can be facilitated or the content of the speech at the medical site can be effective. It can be used to

According to the information processing system described in appendix 2, the first user or the second user can check, for example, the voice data or the text data by performing the data recognition process. It becomes possible to reflect to 1 user or the 2nd user. Further, for example, it is possible to remind the first user or the second user that there is an utterance performed using the first call terminal or the second call terminal.

According to the information processing system described in Appendix 3, by performing the request execution support process, for example, it becomes possible to support the second user to execute the request corresponding to the uttered voice, and the first user And the second user's activity can be facilitated.

According to the information processing system described in Appendix 4, by performing the request recognition process, for example, the second user can be made to recognize the request, so the second user remembers that there is a request. It is possible to In particular, for example, when the second user is made to recognize a request at a medical site, it is possible to facilitate activities at the medical site.

According to the information processing system described in Supplementary Note 5, by performing the request information request process, for example, it is possible to compensate for the lack information corresponding to the uttered voice, so it is possible to make an appropriate request, and the first user And the activity of the second user can be further facilitated.

According to the information processing system described in Appendix 6, by performing the use information output process, for example, information on the use of the object can be output, so that the contents of the utterance can be used to improve the object etc. It is possible to effectively use the contents of the utterance.

According to the information processing system described in Appendix 7, by performing the state information output processing, for example, information on the patient's state can be output, so the content of the utterance can be used for the treatment of the patient It is possible to effectively utilize the contents of

According to the information processing program described in appendix 8, the speech data is related to the speech sound based on the voice data corresponding to the speech sound received by the reception means or the data of at least one of the text data converted by the conversion means. By performing the uttered voice related process which is the process, for example, the uttered voice related process can be performed without the first user or the second user manually inputting the content of the uttered, so the uttered content Can be reliably reflected. In particular, for example, when applied to speech at a medical site, the content of the speech at the medical site can be reflected, and the activity at the medical site can be facilitated or the content of the speech at the medical site can be effective. It can be used to

Reference Signs List 1 first call terminal 2 second call terminal 3 management server 11 communication unit 12 operation unit 13 display 14 speaker 15 microphone 16 recording unit 17 control unit 21 communication unit 22 operation unit 23 display 24 speaker 25 microphone 26 recording unit 27 control unit 31 Communication unit 32 Recording unit 33 Control unit 100 Medical system 321 Terminal information DB
322 Speech record information DB
323 voice data DB
324 Text Data DB
331 receiver 332 converter 333 processor G1 source side notification image G11 source side message information G12 source side voice reproduction button G13 source side text display button G2 destination side notification image G21 destination side message information G22 destination Voice play button G23 Destination text display button

Claims

An utterance between a first user using a first call terminal and a second user using a second call terminal, using the first call terminal or the second call terminal Receiving means for receiving the uttered voice of the uttered speech to be performed;
Conversion means for converting voice data corresponding to the uttered voice received by the receiving means into text data corresponding to the voice data;
Related to the speech received by the receiving means based on at least one of the voice data corresponding to the speech received by the receiving means or the text data converted by the converting means Processing means for performing a speech related process, which is a process;
An information processing system comprising:
The processing means performs data recognition processing for causing the first user or the second user to confirm the voice data or the text data as the speech voice related processing.
The information processing system according to claim 1.
The receiving unit receives, as the speech sound, an utterance related to a request for the second user from the first user,
The processing means performs a request execution support process for causing the second user to execute a request corresponding to the uttered voice received by the receiving means as the uttered voice related process.
The information processing system according to claim 1 or 2.
The processing means performs, as the request execution support process, a request recognition process for causing the second user to recognize a request corresponding to the uttered voice received by the reception means.
The information processing system according to claim 3.
The processing means determines whether there is insufficient information in the request corresponding to the uttered voice received by the receiving means, and if it is determined that the insufficient information is present, the insufficient information is supplemented. Performing request information request processing requested to the first user as the request execution support processing;
The information processing system according to claim 3 or 4.
The receiving means receives an utterance relating to use of an object as the utterance voice,
The processing means performs usage information output processing for outputting information related to the use of the object as the speech voice related processing.
The information processing system according to any one of claims 1 to 5.
At least a speech storage means for storing the text data converted by the conversion means,
The first user or the second user is a medical worker,
The receiving means receives an utterance relating to a state of a patient of the first user or the second user as the utterance voice.
The processing means performs state information output processing for outputting information related to the state of the patient as the utterance voice related processing based on at least the text data stored in the utterance storage means.
The information processing system according to any one of claims 1 to 6.
An information processing program,
Computer,
An utterance between a first user using a first call terminal and a second user using a second call terminal, using the first call terminal or the second call terminal Receiving means for receiving the uttered voice of the uttered speech to be performed;
Conversion means for converting voice data corresponding to the uttered voice received by the receiving means into text data corresponding to the voice data;
Related to the speech received by the receiving means based on at least one of the voice data corresponding to the speech received by the receiving means or the text data converted by the converting means Processing means for performing a speech related process, which is a process;
Information processing program to function as.