WO2021215540A1 - 支援装置、会話制御装置及びプログラム - Google Patents

支援装置、会話制御装置及びプログラム Download PDF

Info

Publication number
WO2021215540A1
WO2021215540A1 PCT/JP2021/016535 JP2021016535W WO2021215540A1 WO 2021215540 A1 WO2021215540 A1 WO 2021215540A1 JP 2021016535 W JP2021016535 W JP 2021016535W WO 2021215540 A1 WO2021215540 A1 WO 2021215540A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
input
unit
event
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/016535
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
クリストフ ノイマン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Easy Dialog GK
Easydialog
Original Assignee
Easy Dialog GK
Easydialog
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Easy Dialog GK, Easydialog filed Critical Easy Dialog GK
Priority to US17/996,980 priority Critical patent/US12243524B2/en
Priority to JP2022517117A priority patent/JP7405467B2/ja
Publication of WO2021215540A1 publication Critical patent/WO2021215540A1/ja
Anticipated expiration legal-status Critical
Priority to JP2023207206A priority patent/JP7788737B2/ja
Priority to US19/039,328 priority patent/US20260004779A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/453—Help systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/02—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/225—Feedback of the input speech

Definitions

  • the present invention relates to a support device, a conversation control device and a program.
  • the present application claims priority based on US Provisional Application No. 63 / 014,721 filed in the United States on April 24, 2020, the contents of which are incorporated herein by reference.
  • Such technology is a technology for communication between devices and people. Therefore, some people have various ideas about how to interact. However, there are many people who have an idea but are not familiar with the computer program that controls the device, and such a person may have a heavy burden of implementing the idea.
  • an object of the present invention is to provide a technique for reducing the burden of labor required for implementing the technique for interaction between a device and a person.
  • One aspect of the present invention is a support device that supports the generation of a computer program that controls the operation of a device to be controlled, and is information output by an output source and words input to an input unit that accepts input of words.
  • the output control unit includes an output control unit that controls the operation of the output unit that outputs When information indicating a possible event is input, the input event indicated by the information is output to the output unit, and the output control unit outputs (N-1) in the conversation between the human devices. ) Indicates an event that may occur at the Nth position (N is an integer of 1 or more) when information indicating an event that may occur is input to the input unit. It is a support device that outputs information prompting the input of information to the output unit.
  • FIG. 1 is a first diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 2 is a second diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 3 is a third diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 4 is a fourth diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 5 is a fifth diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 5 is a flowchart showing an example of a flow of processing executed by the conversation control device 3 of the embodiment.
  • FIG. 1 is a diagram showing an example of the configuration of the support system 100 of the embodiment.
  • the support system 100 includes a support device 1, a management device 2, and a conversation control device 3.
  • the support device 1 supports the design of the computer program designer 991 that controls the operation of the device to be controlled.
  • the "computer program" to be designed includes not only so-called program code but also parameters and table values referred to in the execution of the program. Therefore, in the present embodiment, the design of the computer program includes not only the generation of the code of the program but also the determination of the value of the parameter referred to in the execution of the program and the generation of the table.
  • the device to be controlled is, for example, a smart speaker.
  • the device to be controlled may be, for example, a guidance robot or a security robot.
  • the operation terminal 993 and the operated device 994 of FIG. 1 are examples of devices to be controlled.
  • the support device 1 includes a display unit 101 and an input unit 102.
  • the display unit 101 includes display devices such as a CRT (Cathode Ray Tube) display, a liquid crystal display, and an organic EL (Electro-Luminescence) display.
  • the display unit 101 may be configured to include an interface for connecting these display devices to the support device 1.
  • the input unit 102 includes an input device such as a mouse, a keyboard, and a touch panel.
  • the input unit 102 may be configured to include an interface for connecting these input devices to the support device 1.
  • FIG. 2 is a first diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • the screen displayed by the display unit 101 includes an area A101, an area A102, and an area A103.
  • Area A101 is an area in which the input received word is displayed when the received word is input to the input unit 102.
  • the receiving word is input to the device to be controlled in the communication between the device to be controlled and the user 992 of the device to be controlled (hereinafter referred to as "user 992") (hereinafter referred to as "conversation between human devices"). It is a word that can be done.
  • the conversation between human devices is a phenomenon in which one of three types of events, a received word occurrence event, a given word occurrence event, and a response processing execution event, occurs repeatedly due to an event that occurred immediately before in each order. ..
  • the received word occurrence event is an event in which the user 992 inputs a word to the device to be controlled.
  • the given word occurrence event is an event in which the controlled device outputs a word.
  • the response processing execution event is an event in which the device to be controlled executes processing according to the input word (hereinafter referred to as “response processing”).
  • the word refers to a combination of one or a plurality of words composed of various lengths from a word to a long sentence.
  • the received word is, for example, "Please tell me the weather tomorrow". “Human Says:” described in FIG. 2 is an example of information indicating that the area is for displaying the received word.
  • Area A102 is an area in which the input given word is displayed when the given word is input to the input unit 102.
  • the given word is a word that may be output by the device to be controlled in the conversation between human devices.
  • the given word is, for example, "Tell me the weather tomorrow” if the received word is "Tell me the weather tomorrow", for example, "Tomorrow is sunny”.
  • “AI Says:” shown in FIG. 2 is an example of information indicating that the area is for displaying a given word.
  • the area A103 is an area in which the content of the response processing indicated by the input response processing candidate information is displayed when the information regarding the response processing candidate (hereinafter referred to as “response processing candidate information”) is input to the input unit 102.
  • candidates for response processing are, for example, the action of flowing "spring” from Vivaldi's "four seasons” when the received word is "Please flow spring from Vivaldi's four seasons.”
  • Candidates for response processing are similar, for example, when the received word is "Please play spring from Vivaldi's four seasons” and the data of the song “Spring” from Vivaldi's "Four seasons” could not be searched. It may be an operation of searching for another song to be played, another song of Vivaldi, another song reminiscent of "spring", and playing the searched song. In that case, it may be further defined to say "The song could not be found” as a given word in area A102.
  • “AI Does:” shown in FIG. 2 is an example of information indicating that the area indicates an area indicating information indicating a candidate for response processing.
  • information is displayed that prompts the designer 991 to input information indicating the first event that may occur in the conversation between human devices.
  • the information J101 of FIG. 2 is an example of information that prompts the designer 991 to input information indicating the first event that may occur in the conversation between human devices.
  • FIG. 3 is a second diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 3 shows the result of the word “good morning” being input to the input unit 102 as a given word while the screen of FIG. 2 is displayed. Since the word "good morning” was input to the input unit 102 as the given word, the word "good morning” which is the given word input to the area A102 is displayed on the screen of FIG.
  • the information J102 in FIG. 3 is an example of information indicating the input given word.
  • the input word "good morning” is a word input when the screen of the display unit 101 is the screen of FIG. Therefore, "good morning” input as a given word is a word generated in the first event of conversation between human devices, and is a word output by the device to be controlled. In order to show this to the designer 991, the word "good morning” is displayed on the screen of FIG. 3 at a position in the screen where the position in the height direction is the same as the information J101.
  • FIG. 3 shows information J103.
  • the information J103 is an example of information that prompts the designer 991 to input information indicating a second event that may occur in a conversation between human devices.
  • FIG. 4 is a third diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 4 shows the result in which the words “how are you” and the words “go away” are input to the input unit 102 as receiving words while the screen of FIG. 3 is displayed. Since “how are you” and “go away” are input to the input unit 102 as receiving words, the input receiving words "how are you” and “go away” are entered in the area A101 of the screen of FIG. Is displayed. By defining a plurality of recipients in this way, the flow of conversation can be branched. Both "how are you” and “go away” input as receiving words are words that may be input to the device to be controlled by the user 992.
  • the user 992 may input words having the same meaning or similar meanings as received words. Further, for example, “fine” may be defined as a given word for “how are you”. For example, for “go away”, the current time is acquired as a response processing candidate without defining the given word, and as the next operation, if the current time is in the morning time zone, the given word is “good morning”. Is defined, and it may be defined that the operation is not performed unless the current time is in the morning time zone.
  • FIG. 4 shows information J105.
  • the information J105 is an example of information that prompts the designer 991 to input information indicating a third event that may occur in a conversation between human devices.
  • FIG. 5 is a fourth diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 5 shows the result of inputting the character string “timeofday” and the character string “morning” as response processing candidate information while the screen of FIG. 4 is displayed.
  • Information J106 is an example of response processing candidate information displayed on the screen.
  • timeofday and “morning” are information indicating the operation of the device to be controlled, but are not computer programs that instruct the operation. Both “timeofday” and “morning” are designer 991 memorandums on what kind of processing the controlled device performs.
  • the response processing candidate information may be the processing program itself that may be executed by the controlled device, or may be a memorandum regarding the processing that the controlled device may execute as in the example of FIG. There may be.
  • a branch is defined in the output data (exchange flow information). For example, two or more branches are defined according to the result of the process "timeofday".
  • the designer 991 can execute the contents of the processing that the controlled device may execute even if the computer program that controls the controlled device cannot be generated. Can be recorded as a memorandum. The contents of the memorandum can be viewed by a person who has the technology to generate a computer program for controlling the device to be controlled. Therefore, even if the designer 991 itself cannot generate a computer program that controls the device to be controlled, the designer 991 can generate a computer program with the help of another person having a technique.
  • FIG. 5 shows information J107.
  • the information J107 is an example of information that prompts the designer 991 to input information indicating a fourth event that may occur in a conversation between human devices.
  • FIG. 6 is a fifth diagram showing an example of a screen displayed by the display unit 101 in the embodiment.
  • FIG. 6 shows the result in which the character string “sorry for disturbing you but I will wake you up now” is input to the input unit 102 as a given word while the screen of FIG. 5 is displayed. Since “sorry for disturbing you but I will wake you up now” was input to the input unit 102, the input word “sorry for disturbing you but I will” is entered in the screen area A102 of FIG. wake you up now ”is displayed.
  • Information J108 in FIG. 6 is an example of information indicating the input given word.
  • FIG. 6 shows information J109.
  • the information J109 is an example of information that prompts the designer 991 to input information indicating a fifth event that may occur in a conversation between human devices.
  • N is an integer greater than or equal to 1. It should be noted that such a number (for example, N) does not necessarily have to be displayed on the display unit 101.
  • the support device 1 generates exchange flow information based on the information input to the input unit 102.
  • the exchange flow information is text data information indicating the flow of occurrence of an event in a conversation between human devices.
  • An example of the flow is the flow of occurrence of an event in the conversation between human devices assumed by the designer 991, which is illustrated in FIGS. 2 to 6. Therefore, the support device 1 prompts the designer 991 to input information indicating an event that may occur in the conversation between human devices, displays the content of the input event, and causes the input event to occur.
  • the exchange flow information includes at least order information, execution subject information, and content information.
  • the order information indicates the order in which each event of the received word occurrence event, the given word occurrence event, and the response processing execution event occurs in the conversation between human devices.
  • Execution subject information is information indicating the subject that causes the event of each order indicated by the order information.
  • the execution subject information indicates, for example, an input source for inputting a received word into a device to be controlled, such as a user 992, for a received word occurrence event.
  • the execution subject information indicates, for example, a device to be controlled that is a subject that outputs a given word for a given word occurrence event.
  • the execution subject information indicates, for example, for a response processing execution event, a device to be controlled that is the subject that executes the response processing candidate indicated by the response processing execution information.
  • the content information indicates the content of the event in each order indicated by the order information.
  • the content information indicates, for example, the word itself of the receiving word for the event in which the receiving word occurs.
  • the content information indicates, for example, the word itself of the given word for the event in which the given word occurs.
  • the content information indicates, for example, the response processing candidates indicated by the response processing execution information for the response processing execution event.
  • the numbers indicated by the information J101, the information J103, the information J105, the information J107, and the information J109 in FIGS. 2 to 6 indicate the order of occurrence of the events in the conversation between human devices. Therefore, information J101, information J103, information J105, information J107, and information J109 are examples of order information.
  • the display unit 101 may display the order information.
  • these exchange flow information can be deleted individually or inserted in the middle. Further, the exchange flow information of the subsequent processing may be defined in common to the plurality of exchange flow information. Further, the numerical order of the displayed numbers does not necessarily have to follow the order of operations.
  • FIG. 7 is a diagram showing an example of exchange flow information of the embodiment.
  • FIG. 7 shows information J21, information J22, and information J23.
  • the information J21, the information J22, and the information J23 are information about an event that occurs in the exchange between the device to be controlled and the user 992.
  • the information shown in FIG. 7 is a specific example of the exchange flow information in the processing described with reference to FIGS. 2 to 6.
  • Information J21 indicates the first event that occurs in the exchange between the device to be controlled and the user 992.
  • Information J211 indicates that information J21 is information about the first event that occurs in the exchange between the controlled device and the user 992.
  • Information J211 in FIG. 7 is an example of order information.
  • Information J212 in FIG. 7 indicates that the subject of the event that occurs first in the interaction between the device to be controlled and the user 992 is the device to be controlled.
  • Information J212 in FIG. 7 is an example of execution subject information.
  • Information J213 in FIG. 7 shows the content of the first event that occurs in the communication between the device to be controlled and the user 992. Specifically, the information J213 indicates that the word "hello" is generated from the subject indicated by the information J212 in the first event that occurs in the exchange between the device to be controlled and the user 992.
  • Information J213 in FIG. 7 is an example of content information.
  • Information J22 indicates the second event that occurs in the communication between the device to be controlled and the user 992.
  • Information J221 indicates that information J22 is information about a second event that occurs in the interaction between the controlled device and the user 992.
  • Information J221 in FIG. 7 is an example of order information.
  • Information J222 in FIG. 7 indicates that the subject of the second event occurring in the interaction between the controlled device and the user 992 is the user 992.
  • Information J222 in FIG. 7 is an example of execution subject information.
  • Information J223 in FIG. 7 shows the content of the second event that occurs in the communication between the device to be controlled and the user 992. Specifically, the information J223 indicates that the word "how are you” is generated from the subject indicated by the information J222 in the second event that occurs in the exchange between the device to be controlled and the user 992. Information J223 in FIG. 7 is an example of content information.
  • the support device 1 is communicably connected to the management device 2 via the network 901.
  • the management device 2 includes a control unit 21 and a storage unit 22.
  • the control unit 21 includes a processor such as a CPU (Central Processing Unit) connected by a bus and a memory.
  • the control unit 21 controls the operation of each functional unit included in the management device 2.
  • the management device 2 is communicably connected to the support device 1 via the network 901.
  • the management device 2 acquires the exchange flow information generated by the support device 1 via the network 901 and records it in the storage unit 22.
  • the control unit 21 executes the process of acquiring the exchange flow information and the process of recording the acquired exchange flow information in the storage unit 22.
  • the management device 2 is communicably connected to the conversation control device 3 via the network 902.
  • the conversation control device 3 controls the operation of the controlled device such as the operated device 994 according to the received word output by the user 992 based on the exchange flow information generated by the support device 1. More specifically, the conversation control device 3 acquires text data indicating a receiving word output by the user 992, and causes the device to be controlled to perform an operation according to the exchange flow information based on the acquired text data.
  • the conversation control device 3 acquires the exchange flow information from the management device 2 via the network 902.
  • the conversation control device 3 controls the operation of the operated device 994 via the network 903, so that the device to be controlled executes the operation according to the exchange flow information based on the acquired text data.
  • the conversation control device 3 acquires text data from the operation terminal 993 via the network 903.
  • the operation terminal 993 accepts the input of the received word of the user 992.
  • the operation terminal 993 converts the input receiving word into text data.
  • the operation terminal 993 transmits the text data generated by the conversion to the conversation control device 3 via the network 903.
  • the operation terminal 993 is, for example, a personal computer capable of executing a process of converting an input receiver into text data.
  • the operation terminal 993 may be any as long as it can accept the input of the received word of the user 992 and can convert the input received word into text data.
  • the operation terminal 993 may be, for example, a mobile phone or a smartphone.
  • the operation terminal 993 may be a device having an AI (artificial intelligence) assistant function such as a smart speaker.
  • the operation terminal 993 does not necessarily have to be mounted in a housing different from that of the device to be operated 994, and may be integrally configured.
  • the method of inputting the received word to the operation terminal 993 by the user 992 may be any method as long as the received word can be converted into text data.
  • the method of inputting the received word to the operation terminal 993 by the user 992 is, for example, a method of executing an SNS (Social networking service) application that can be executed by the operation terminal 993 and inputting the received word using the running SNS application.
  • SNS Social networking service
  • the input may be performed by the user 992 speaking a voice corresponding to the received word.
  • the voice recognition process is performed, and the voice uttered by the user 992 is converted into text data and input to the operation terminal 993.
  • FIG. 8 is a diagram showing an example of the hardware configuration of the support device 1 in the embodiment.
  • the support device 1 includes a control unit 11 including a processor 91 such as a CPU (Central Processing Unit) connected by a bus and a memory 92, and executes a program.
  • the support device 1 functions as a device including a user interface 10, a control unit 11, a storage unit 12, and a communication unit 13 by executing a program.
  • a control unit 11 including a processor 91 such as a CPU (Central Processing Unit) connected by a bus and a memory 92, and executes a program.
  • the support device 1 functions as a device including a user interface 10, a control unit 11, a storage unit 12, and a communication unit 13 by executing a program.
  • the processor 91 reads the program stored in the storage unit 12, and stores the read program in the memory 92.
  • the support device 1 functions as a device including the user interface 10, the control unit 11, the storage unit 12, and the communication unit 13.
  • the user interface 10 includes a display unit 101 and an input unit 102.
  • the display unit 101 and the input unit 102 may be mounted as separate devices, or may be mounted as an integrated device such as a touch panel.
  • the control unit 11 controls the operation of various functional units included in the support device 1.
  • the control unit 11 generates, for example, exchange flow information.
  • the storage unit 12 is configured by using a computer-readable storage medium device such as a magnetic hard disk device or a semiconductor storage device.
  • the storage unit 12 stores various information about the support device 1.
  • the storage unit 12 stores, for example, various information generated as a result of processing executed by the control unit 11.
  • the storage unit 12 stores, for example, the exchange flow information generated by the control unit 11.
  • the storage unit 12 is an image of a screen (hereinafter referred to as “initial screen”) before all of the received word, the given word, and the response processing execution information are input to the input unit 102, such as the screen shown in FIG. Store data in advance.
  • the communication unit 13 includes a communication interface for connecting the support device 1 to an external device.
  • the communication unit 13 communicates with an external device via the network 901 by wire or wirelessly.
  • the external device is, for example, the management device 2.
  • FIG. 9 is a diagram showing an example of the functional configuration of the control unit 11 in the embodiment.
  • the control unit 11 includes an input control unit 110, a display control unit 111, an exchange flow information generation unit 112, a storage control unit 113, and a communication control unit 114.
  • the input control unit 110 controls the operation of the input unit 102.
  • the display control unit 111 controls the operation of the display unit 101.
  • the display control unit 111 executes, for example, an initial screen display process.
  • the initial screen display process is a process of reading the image data of the initial screen stored in the storage unit 12 and displaying the initial screen on the display unit 101.
  • the display control unit 111 executes, for example, a received word display process.
  • the received word display process is a process of displaying the received word input to the input unit 102 on the display unit 101.
  • the display control unit 111 executes, for example, a reminder information display process.
  • the reminder information display process is performed at the Nth position in the conversation between human devices when information indicating an event that may occur at the (N-1) th position in the conversation between human devices is input to the input unit 102.
  • This is a process of displaying information prompting the input of information indicating an event that may occur on the display unit 101.
  • the information indicating each event can be deleted individually or inserted in the middle.
  • An example of the change in the screen displayed by the display unit 101 due to the execution of both the received word display process and the reminder information display process is the change from the screen shown in FIG. 3 to the screen shown in FIG.
  • the change from the screen shown in FIG. 5 to the screen shown in FIG. 6 is also an example of the change in the screen displayed by the display unit 101 due to the execution of both the received word display process and the reminder information display process.
  • the display control unit 111 executes, for example, response processing candidate display processing.
  • the response processing candidate display processing is a process of displaying the response processing candidate indicated by the input response processing candidate information when the response processing candidate information is input to the input unit 102 on the display unit 101.
  • An example of the change in the screen displayed by the display unit 101 due to the execution of both the response process candidate display process and the reminder information display process is the change from the screen shown in FIG. 4 to the screen shown in FIG.
  • the display control unit 111 executes, for example, a given word display process.
  • the given word display process is a process of displaying the given word input to the input unit 102 on the display unit 101.
  • An example of the change in the screen displayed by the display unit 101 due to the execution of both the given word display process and the reminder information display process is the change from the screen shown in FIG. 2 to the screen shown in FIG.
  • the exchange flow information generation unit 112 generates exchange flow information based on the information input to the input unit 102.
  • the storage control unit 113 records various information generated by the control unit 11 in the storage unit 12.
  • the storage control unit 113 records, for example, the exchange flow information generated by the control unit 11 in the storage unit 12.
  • the storage control unit 113 records, for example, the information input to the input unit 102 (that is, the information acquired by the input control unit 110) in the storage unit 12.
  • the communication control unit 114 controls the operation of the communication unit 13.
  • the communication control unit 114 controls the operation of the communication unit 13 and transmits, for example, exchange flow information to the management device 2.
  • the management device 2 receives the transmitted exchange flow information and records it in the storage unit 22.
  • FIG. 10 is a flowchart showing an example of the flow of processing executed by the support device 1 of the embodiment.
  • Information is input to the input unit 102 (step S101).
  • the display control unit 111 executes any one of the received word display process, the response process candidate display process, and the given word display process according to the input information, so that the input information is displayed in the display unit 101. Is displayed, and the reminder information display process is executed (step S102).
  • the display unit 101 includes the input information and the information prompting the input of the information indicating the event that may occur in the conversation between the human devices after the occurrence of the event in which the input information occurs. , Is displayed.
  • FIG. 11 is a diagram showing an example of the hardware configuration of the conversation control device 3 in the embodiment.
  • the conversation control device 3 includes a control unit 31 including a processor 93 such as a CPU connected by a bus and a memory 94, and executes a program.
  • the conversation control device 3 functions as a device including a user interface 30, a control unit 31, a storage unit 32, and a communication unit 33 by executing a program.
  • the processor 93 reads the program stored in the storage unit 32, and stores the read program in the memory 94.
  • the conversation control device 3 functions as a device including the user interface 30, the control unit 31, the storage unit 32, and the communication unit 33.
  • the user interface 30 includes a display unit 301 and an input unit 302.
  • the display unit 301 includes display devices such as a CRT display, a liquid crystal display, and an organic EL display.
  • the display unit 301 may be configured to include an interface for connecting these display devices to the conversation control device 3.
  • the input unit 302 includes an input device such as a mouse, a keyboard, and a touch panel.
  • the input unit 302 may be configured to include an interface for connecting these input devices to the conversation control device 3.
  • the control unit 31 controls the operation of various functional units included in the conversation control device 3.
  • the control unit 31 acquires exchange flow information from the management device 2 via, for example, the communication unit 33 and the network 902.
  • the storage unit 32 is configured by using a computer-readable storage medium device such as a magnetic hard disk device or a semiconductor storage device.
  • the storage unit 32 stores various information related to the conversation control device 3.
  • the storage unit 32 stores various information generated as a result of processing executed by, for example, the control unit 31.
  • the storage unit 32 stores, for example, the exchange flow information acquired from the management device 2 by the control unit 31 via the communication unit 33.
  • the storage unit 32 may store the exchange flow information in advance before the text data indicating the received word is acquired by the communication unit 33, or may be in the reverse order. There is no limit to the order of memory. Further, the information stored in the storage unit 32 may be stored in another device (for example, the management device 2).
  • the communication unit 33 includes a communication interface for connecting the conversation control device 3 to an external device.
  • the communication unit 33 communicates with the management device 2 via the network 902 by wire or wirelessly.
  • the communication unit 33 communicates with the operation terminal 993 and the operated device 994 via the network 903 by wire or wirelessly.
  • the communication unit 33 receives, for example, text data indicating a received word by communicating with the operation terminal 993.
  • the communication unit 33 transmits an instruction to the operated device 994 to cause the operated device 994 to execute the operation indicated by the exchange flow information, which is an operation corresponding to the text data indicating the received word, for example. do.
  • a script that matches the word input in the area A103 (AIDoes) is started, and text data, exchange flow information, and the like are passed as arguments of the script. Then, the script finally returns some arguments including the character string of the input field on the right side of the area A103 (AIDoes).
  • FIG. 12 is a diagram showing an example of the functional configuration of the control unit 31 in the embodiment.
  • the control unit 31 includes an input control unit 310, a display control unit 311, a conversation control unit 312, a memory control unit 313, and a communication control unit 314.
  • the input control unit 310 controls the operation of the input unit 302.
  • the display control unit 311 controls the operation of the display unit 301.
  • the conversation control unit 312 determines an instruction to the operated device 994 based on the exchange flow information and the text data indicating the received word input to the communication unit 33. For example, when the received word indicated by the text data is the word "flow spring from Vivaldi's four seasons", the conversation control unit 312 operates the operation of flowing "spring” from Vivaldi's "four seasons". Decide to instruct.
  • the storage control unit 313 records various information generated by the control unit 31 in the storage unit 32.
  • the storage control unit 313 records in the storage unit 12, for example, information indicating an instruction to the operated device 994 determined by the control unit 31.
  • the storage control unit 313 records, for example, text data indicating a received word acquired via the communication unit 33 in the storage unit 12.
  • the communication control unit 314 controls the operation of the communication unit 33.
  • the communication control unit 314 controls the operation of the communication unit 33, and acquires, for example, exchange flow information from the management device 2.
  • the communication control unit 314 controls the operation of the communication unit 33, and transmits, for example, the instruction determined by the conversation control unit 312 to the operated device 994.
  • the communication control unit 314 acquires text data indicating a receiving word via, for example, the communication unit 33.
  • the instruction determined by the conversation control unit 312 is sent by the communication control unit 314 to the operated device 994 via the communication unit 33.
  • the operated device 994 Upon receiving the instruction, the operated device 994 performs an operation according to the instruction. Therefore, the conversation control unit 312 is a functional unit that controls the operation of the operated device 994 based on the received word. In other words, the conversation control unit 312 controls the interaction between the user 992 and the operated device 994 by controlling the operation of the operated device 994.
  • FIG. 13 is a flowchart showing an example of the flow of processing executed by the conversation control device 3 of the embodiment.
  • the communication control unit 314 acquires text data indicating the received word via the communication unit 33 (step S201).
  • the conversation control unit 312 determines an instruction to the operated device 994 based on the text data indicating the received word and the exchange flow information (step S202).
  • the communication control unit 314 transmits the instruction determined by the conversation control unit 312 to the operated device 994 (step S203). It should be noted that there is no restriction that the response process is performed after the received word.
  • the given word may be displayed for the received word, or other actions may be performed.
  • step S202 and step S203 is an example of the control of the operated device 994 by the conversation control unit 312.
  • the operated device 994 is pre-programmed by a person or device capable of generating a computer program for controlling the operated device 994 based on the exchange flow information so that the operated device 994 operates according to the instruction.
  • the support device 1 in the embodiment configured in this way causes the display unit 101 to display the input received word when the received word is input to the input unit 102. Further, the support device 1 also displays information prompting the input of information indicating an event that may occur next. Therefore, the support device 1 makes it easy for the designer 991 who uses the support device 1 to grasp the interaction between the device to be controlled and the user 992. Therefore, the support device 1 can reduce the burden of labor required for implementing the technique of communication between the device and a person.
  • the support device 1 displays the received word input to the input unit 102 on the display unit 101, and inputs information indicating an event that may occur next. Information that prompts you is also displayed.
  • the support device 1 thereby supports the expression of the idea by the designer 991. Therefore, the designer 991 does not need to input the code of the computer program into the support device 1.
  • the information input by the designer 991 to the support device 1 is a word exchanged between the device to be controlled and the user 992, and the device to be controlled (a device different from the device to be controlled described above). It may be information indicating the content of the process to be executed.
  • the designer 991 expresses what he wants to achieve with a computer program only by the words exchanged between the controlled device and the user 992 and the information indicating the contents of the processing executed by the controlled device. be able to.
  • the information generated by the support device 1 may be implemented by a person who has a technique to implement the device to be controlled (for example, a person different from the designer 991), or a device that generates a computer program based on the exchange flow information. May be implemented by. Therefore, the support device 1 can reduce the burden of labor required for implementing the technique of communication between the device and a person.
  • a program for managing the communication between the person and the device (for example, the communication between the user 992 and the operation terminal 993) may be implemented in the conversation control device 3 in advance.
  • the communication newly generated by the support device 1 is defined in the operation terminal 993, so that the operation terminal 993 may operate so as to be the defined communication.
  • a control program for the new operation terminal 993 is required.
  • this control program does not necessarily require the exchange generated by the support device 1. In that case, the exchange is performed with the contents defined in advance in the control program installed in the operation terminal 993.
  • the exchange flow information is text data. Therefore, the support system 100 can enable the user 992 to control the operated device 994 regardless of the application executed by the operating terminal 993 and the specifications of the operated device 994.
  • the support system 100 is used, for example, to allow the user 992 to obtain drug information more accurately.
  • Drug information can be obtained, for example, by searching the Internet for the name of the drug. However, as for the information searched on the Internet, for example, if it is a side effect, only the list is displayed, and it may not be easy to obtain information on taking a plurality of drugs. As a result, the user 992 may obtain false information about the drug.
  • the device to be controlled is, for example, a device capable of outputting a description of the drug.
  • a device capable of outputting a drug description is, for example, a smart speaker.
  • the user 992 reads the two-dimensional bar code attached to the medicine container in advance by using an operation terminal 993 that can read the two-dimensional bar code such as a smartphone.
  • the smartphone may transmit the information read by wireless communication or wired communication to the smart speaker, for example.
  • the user 992 can communicate with the device to be controlled via the operation terminal 993. In this way, the two-dimensional bar code indicates information for communicating with the device to be controlled.
  • the two-dimensional bar code does not necessarily have to be attached to the medicine container, and the operation terminal 993 used by the user 992 does not necessarily have to be a smartphone.
  • the drug container may be any as long as it contains information that enables communication with the device to be controlled.
  • the operation terminal 993 can also acquire the information attached to the medicine container, can communicate with the device to be controlled, and can convert the received word input from the user 992 into text data. It may be anything.
  • the user 992 who has started communication with the device to be controlled inputs a word for visiting information about the drug into the operation terminal 993 as a receiving word.
  • the words that ask for information about medicines are, for example, the question "User 992 is taking medicine A, medicine B, and medicine C three times a day. Is it okay to take medicine D?" Is.
  • the conversation control device 3 acquires text data indicating the received word input to the operation terminal 993.
  • the conversation control device 3 controls the operation of the operated device 994 based on the acquired text data and the exchange flow information generated in advance by the support device 1.
  • the conversation control unit 312 of the conversation control device 3 controls the operation of the operated device 994 based on the text data indicating the received word and the exchange flow information generated in advance by the support device 1.
  • the received word is the above-mentioned question, "User 992 is taking medicine A, medicine B, and medicine C three times a day. Is it okay to take medicine D further?"
  • the conversation control unit 312 instructs the operated device 994 to give the following drug determination instruction.
  • the drug determination instruction is an instruction to execute a process of determining whether or not there is no problem in taking the drug D for the user 992, and an execution of a process of outputting a word indicating the result of the determination. More specifically, it may operate as follows.
  • the operated device 994 returns two different texts to the conversation control device 3. For example, if the text is "talkdoctor", the next step would be the given word “I'm talking to a doctor. Do you want to look around?" And lead the user 992 into a doctor search conversation. If the text is "noproblem”, the given word is "that's okay”. Then, when asked "Would you like to participate in the questionnaire?", The questionnaire will start.
  • the operated device 994 determines whether or not there is no problem in taking the medicine D for the user 992 according to the instruction of the conversation control unit 312, and outputs a word indicating the result of the determination.
  • the exchange flow information used in the process of responding to such drug information is information generated in advance by the designer 991 using the support device 1.
  • the designer 991 receives a question about drug information, for example, and inputs it into the input unit 102 as a word.
  • the display control unit 111 displays the input received word on the display unit 101 by executing the word display process, and also executes the reminder information display process.
  • the designer 991 then inputs the process to be executed by the device to be controlled for the received word.
  • the display control unit 111 displays the input process on the display unit 101 and executes the reminder information display process. Subsequently, the designer 991 inputs a given word output by the device to be controlled.
  • the display control unit 111 displays the input given word on the display unit 101.
  • the exchange flow information generation unit 112 generates drug flow information based on the information input to the input unit 102.
  • the drug flow information is text data information indicating the flow of occurrence of an event in the drug-related exchange between the user 992 and the device to be controlled. That is, drug flow information is a kind of exchange flow information.
  • the drug flow information indicates, for example, that the received word input to the input unit 102 is a word output by the user 992 in the first event of the drug-related exchange between the user 992 and the device to be controlled.
  • the drug flow information is, for example, a process in which the device to be controlled executes the next process input to the input unit 102 in the event following the first event of the drug-related exchange between the user 992 and the device to be controlled. Is shown.
  • the drug flow information is, for example, a word that is output by the controlled device in the third event of the drug-related exchange between the user 992 and the controlled device, for example, the given word input next to the input unit 102. , Is shown.
  • a person or device capable of generating a computer program that controls the device to be controlled programs the operation of the device to be controlled so as to follow the flow of events indicated by the drug flow information. Therefore, the device to be controlled operates so as to follow the flow indicated by the drug flow information.
  • the support system 100 of the embodiment can be used for providing drug information.
  • user 992 can obtain more accurate information than searching for drug information on its own.
  • the designer 991 may input a given word for advancing the diagnosis by a doctor when a predetermined condition is satisfied at the time of generating the drug flow information.
  • the device to be controlled can output a given word for advancing the diagnosis of the doctor.
  • the assist system 100 may be applied, for example, to vehicle technology.
  • the user 992 is, for example, a tourist, and the device to be controlled is a communication robot that guides the tourist.
  • Text data information (hereinafter referred to as “sightseeing flow information”) indicating the flow of occurrence of events in the exchange between the tourist and the communication robot is generated in advance by the designer 991 using the support device 1.
  • Sightseeing flow information is a kind of exchange flow information.
  • the designer 991 When generating the tourist flow information, the designer 991 inputs a word expected to be asked by the tourist into the input unit 102 as a received word. The received word is displayed on the display unit 101, and the result of executing the reminder information display process is also displayed. Next, the designer inputs a given word indicating an answer to the received word into the input unit 102. The given word is displayed on the display unit 101, and the result of executing the reminder information display process is also displayed.
  • the exchange flow information generation unit 112 generates tourist flow information.
  • the tourist flow information indicates, for example, that the received word input to the input unit 102 is the received word output by the tourist in the first event of the exchange between the tourist and the communication robot.
  • the tourist flow information indicates, for example, that the given word input to the input unit 102 is a given word output by the communication robot in the event following the first event of the exchange between the tourist and the communication robot.
  • the received word output by tourists may be, for example, the word "How high is Tokyo Tower?”.
  • the given word output by the communication robot is "The height of Tokyo Tower is 333 meters.”
  • the received word output by the tourist may be the word "I want to go to the station”.
  • the given word output by the communication robot may be, for example, the question "Do you want to go to Yotsuya Station or Shinjuku Station?"
  • the reply may be input to the navigation device corresponding to the operated device 994. After that, the communication between the user 992 and the navigation device may be controlled.
  • the communication robot may output the given word, for example, "Tokyo Tower can be seen on the left” when it is installed on a bus or the like and passes through a specific predetermined place.
  • the designer 991 only inputs the words and the contents of the processing to be output to the device to be controlled. Therefore, by using the support device 1, even a person who is not familiar with the computer program can change the words to be output to the communication robot.
  • the language input to the support device 1 is not limited to a specific language and may be input in any language. Then, the input language may be translated into another language by using the technique of natural language processing. In such a case, even if the designer 991 inputs in one language, the device to be controlled can output words in multiple languages. Instead of translation, mapping to other languages may be done. Mapping is not just translation, but the execution of language processing according to other languages.
  • the support system 100 when the support system 100 is used for tourist information, a sudden disaster such as an earthquake occurs, and the evacuation route must be communicated to multinational tourists on the spot, the support system 100 is evacuated. Easy route transmission. This is because if the designer 991 inputs the evacuation route to the support device 1 in a specific language, it is translated into multiple languages and the words are output from the communication robot.
  • the support system 100 may be applied to the management of the robot.
  • An example of application of the support system 100 to robot management will be described with reference to a case where the robot is provided with a movable arm as an example.
  • the user 992 is the administrator of the robot, and the administrator inputs, for example, the receiving word "Please move the second arm up" to the operation terminal 993.
  • the robot which is the device to be controlled, is controlled by the conversation control device 3 and operates according to the received word.
  • the robot gives a word indicating whether or not the second arm has moved upward and outputs it as a word.
  • the administrator can grasp the situation of the robot by recognizing the given words output by the robot. It may operate as follows. First, the arm of the robot moves.
  • the operated device 994 outputs the result of the movement of the arm to the conversation control device 3. This output process may be an operation defined in the area A103.
  • the conversation control device 3 selects a given word and transmits the selected given word to the operation terminal 993.
  • the operation terminal 993 outputs the received given word (for example, displays it on the screen and reproduces the voice).
  • the above-mentioned effect can be obtained by operating in this way. Further, there is an effect that the operated device 994 does not need to directly communicate with the operating terminal 993.
  • Management flow information is a type of exchange flow information.
  • the designer 991 When generating the management flow information, the designer 991 inputs a word expected to be asked by the manager into the input unit 102 as a receiving word. The received word is displayed on the display unit 101, and the result of executing the reminder information display process is also displayed. Next, the designer inputs the given word output by the robot to be managed to the received word into the input unit 102. The given word is displayed on the display unit 101, and the result of executing the reminder information display process is also displayed.
  • the exchange flow information generation unit 112 generates management flow information.
  • the management flow information may indicate, for example, that the movement of the robot is the first event of interaction between the administrator and the robot to be managed.
  • the received word input to the input unit 102 is the received word output by the administrator in the first event of the exchange between the administrator and the robot to be managed.
  • the management flow information is, for example, a given word input to the input unit 102 and output by the managed robot in the event following the first event of the exchange between the administrator and the managed robot. Is shown.
  • the support system 100 may be used for managing such a robot.
  • a nurse may manage the health of a resident by writing out the resident's name and information on the resident's health such as the nurse's name, date, time, and body temperature on a paper table. be.
  • the work of writing on paper is burdensome. If the support system 100 is used, it is possible to record information on the health of the resident by voice without writing it out on paper.
  • the operation terminal 993 is a device capable of receiving voices indicating words such as voice speakers and smartphones and converting them into text data.
  • the operated device 994 is a device capable of recording text data.
  • the operated device 994 is a computer provided with a storage device such as a hard disk.
  • the conversation control device 3 receives the text data output by the operation terminal 993.
  • the conversation control device 3 is based on the received text data and text data information (hereinafter referred to as “nursing flow information”) indicating the flow of occurrence of an event in the exchange between the nurse and the operated device 994. Controls the device to be operated 994.
  • the operated device 994 may be a device configured as a database.
  • Nursing flow information is a type of exchange flow information.
  • the designer 991 When generating the nursing flow information, the designer 991 inputs a word expected to be issued by the nurse into the input unit 102 as a receiving word. The received word is displayed on the display unit 101, and the result of executing the reminder information display process is also displayed. Next, the designer inputs the process executed by the operated device 994 to the input unit 102 in response to the received word.
  • the process executed by the operated device 994 is, for example, a process of recording the received word in the storage device. The content of the process is displayed on the display unit 101, and the result of the execution of the reminder information display process is also displayed.
  • the exchange flow information generation unit 112 generates nursing flow information.
  • the nursing flow information indicates, for example, that the received word input to the input unit 102 is the received word uttered by the nurse in the first event of the exchange between the nurse and the operated device 994.
  • the nursing flow information indicates, for example, that the process input to the input unit 102 is the process executed by the operated device 994 in the event following the first event of the exchange between the nurse and the operated device 994. ..
  • the process executed by the operated device 994 in the event following the first event of the interaction between the nurse and the operated device 994 is, for example, a process of recording the received word in the storage device.
  • the nurse can record information on the health of the resident in the operated device 994 by voice.
  • Words indicating information on the health of the resident are input to the operation terminal 993.
  • Words that provide information about the health of residents are an example of receiving words.
  • information indicating the time when the information was recorded may also be recorded.
  • the operated device 994 may give a word indicating that the information has been recorded and output it as a word.
  • the information recorded in the operated device 994 can be viewed by other interested parties such as nurses and doctors.
  • the management of resident health information does not have to be done by voice, but may be done by entering characters. Even in such a case, if the words uttered by the nurse in the case of voice input and the words input in the case of text input are the same, the text data received by the conversation control device 3 is the same. Is.
  • the support system 100 can be applied in the same way if the facility has a nursing target. That is, the resident is an example of a nursing subject.
  • the support system 100 may be applied as required by a user who needs to simply register information during work.
  • the support system 100 can support the operated device 994 in multiple languages even if the designer 991 generates the exchange flow information in one language, which is the tourist information. It is not limited to the example of.
  • the operated device 994 can support multiple languages.
  • the support system 100 performs highly accurate translation, and the operated device 994 can output the highly accurate translation result. Further, since the conversation control device 3 also handles text data, the operated device 994 can output a highly accurate translation result. Therefore, the designer 991 who uses the support device 1 can implement the operated device 994 which supports multiple languages only by generating the exchange flow information in one language.
  • the translation process by natural language processing is executed by, for example, the exchange flow information generation unit.
  • the translation process by natural language processing may be executed by, for example, the conversation control unit.
  • the output of the operated device 994 does not necessarily have to be output to the user 992.
  • the operated device 994 is located at a place away from the user 992, and when there is a person other than the user 992 near the operated device 994, the user 992 passes through the operated device 994. You can talk with others. For example, when the user 992 inputs a word in the first language using the first application, the input language is translated into the language used by the other person located near the operated device 994. It may be output from the operated device 994.
  • the input to the input unit 102 may be a character input using an input device such as a keyboard or a touch panel, or may be a voice input.
  • the support device 1 may include a device that outputs sound instead of the display unit 101. In such a case, the content output by the display on the display unit 101 is output by voice.
  • a plurality of types of hardware as a user interface such as the input unit 102 and the display unit 101 can be applied. These can also be changed from the type of hardware that the designer 991 is working on to another type of hardware. For example, the designer 991 can input text using the keyboard at first, and the designer 991 can input the text by utterance from the middle.
  • the exchange flow information is recorded in a storage device such as a storage unit 12 of the support device 1 or a storage unit 22 of the management device 2, a person other than the designer 991 who generated the exchange flow information can also acquire the information. ..
  • the conversation control device 3 may transmit the history of exchanges between the user 992 and the operated device 994 to the management device 2 in the form of text data and record it in the storage unit 22.
  • the history of recorded exchanges can be viewed by other users. At this time, even if the application used for viewing the history between the user 992 and another user is different, both the user 992 and the other user can view the history of the exchange. This is because the history of exchanges is text data.
  • each of the support system 100, the support device 1, the management device 2, and the conversation control device 3 may be implemented by using a plurality of information processing devices that are communicably connected via a network. All or part of each function of the support system 100, the support device 1, the management device 2, and the conversation control device 3 is ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field Programmable Gate Array). ) And other hardware may be used.
  • the program may be recorded on a computer-readable recording medium.
  • the computer-readable recording medium is, for example, a flexible disk, a magneto-optical disk, a portable medium such as a ROM or a CD-ROM, or a storage device such as a hard disk built in a computer system.
  • the program may be transmitted over a telecommunication line.
  • the support device 1 is an example of a computer program generation support device.
  • the designer 991 is an example of an output source. It should be noted that the input of information to the input unit 102 does not necessarily have to be performed by a person such as the designer 991, and the information to be input in advance may be automatically input by a programmed device.
  • the display unit 101 is an example of an output unit.
  • the display control unit 111 is an example of an output control unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)
PCT/JP2021/016535 2020-04-24 2021-04-23 支援装置、会話制御装置及びプログラム Ceased WO2021215540A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US17/996,980 US12243524B2 (en) 2020-04-24 2021-04-23 Assistance device, conversation control device, and program
JP2022517117A JP7405467B2 (ja) 2020-04-24 2021-04-23 支援装置、会話制御装置及びプログラム
JP2023207206A JP7788737B2 (ja) 2020-04-24 2023-12-07 支援装置、会話制御装置及びプログラム
US19/039,328 US20260004779A1 (en) 2020-04-24 2025-01-28 Assistance device, conversation control device, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202063014721P 2020-04-24 2020-04-24
US63/014,721 2020-04-24

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US17/996,980 A-371-Of-International US12243524B2 (en) 2020-04-24 2021-04-23 Assistance device, conversation control device, and program
US19/039,328 Continuation US20260004779A1 (en) 2020-04-24 2025-01-28 Assistance device, conversation control device, and program

Publications (1)

Publication Number Publication Date
WO2021215540A1 true WO2021215540A1 (ja) 2021-10-28

Family

ID=78269369

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/016535 Ceased WO2021215540A1 (ja) 2020-04-24 2021-04-23 支援装置、会話制御装置及びプログラム

Country Status (3)

Country Link
US (2) US12243524B2 (https=)
JP (2) JP7405467B2 (https=)
WO (1) WO2021215540A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12243524B2 (en) 2020-04-24 2025-03-04 Easy Dialog G.K. Assistance device, conversation control device, and program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010073192A (ja) * 2008-08-20 2010-04-02 Universal Entertainment Corp 会話シナリオ編集装置、ユーザ端末装置、並びに電話取り次ぎシステム
JP2018032912A (ja) * 2016-08-22 2018-03-01 株式会社リコー 情報処理装置、情報処理方法、情報処理プログラムおよび情報処理システム
JP2018055385A (ja) * 2016-09-28 2018-04-05 株式会社オウケイウェイヴ クライアントシステム

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10817787B1 (en) * 2012-08-11 2020-10-27 Guangsheng Zhang Methods for building an intelligent computing device based on linguistic analysis
US11183170B2 (en) * 2016-08-17 2021-11-23 Sony Corporation Interaction control apparatus and method
JP6461058B2 (ja) * 2016-09-06 2019-01-30 国立大学法人京都大学 音声対話装置および音声対話装置を用いた自動対話方法
US10347244B2 (en) * 2017-04-21 2019-07-09 Go-Vivace Inc. Dialogue system incorporating unique speech to text conversion method for meaningful dialogue response
US11158311B1 (en) * 2017-08-14 2021-10-26 Guangsheng Zhang System and methods for machine understanding of human intentions
US11004013B2 (en) * 2017-12-05 2021-05-11 discourse.ai, Inc. Training of chatbots from corpus of human-to-human chats
US11037573B2 (en) * 2018-09-05 2021-06-15 Hitachi, Ltd. Management and execution of equipment maintenance
WO2021215540A1 (ja) 2020-04-24 2021-10-28 合同会社ＥａｓｙＤｉａｌｏｇ 支援装置、会話制御装置及びプログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010073192A (ja) * 2008-08-20 2010-04-02 Universal Entertainment Corp 会話シナリオ編集装置、ユーザ端末装置、並びに電話取り次ぎシステム
JP2018032912A (ja) * 2016-08-22 2018-03-01 株式会社リコー 情報処理装置、情報処理方法、情報処理プログラムおよび情報処理システム
JP2018055385A (ja) * 2016-09-28 2018-04-05 株式会社オウケイウェイヴ クライアントシステム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12243524B2 (en) 2020-04-24 2025-03-04 Easy Dialog G.K. Assistance device, conversation control device, and program

Also Published As

Publication number Publication date
JP2024015284A (ja) 2024-02-01
US20230335128A1 (en) 2023-10-19
JP7405467B2 (ja) 2023-12-26
JP7788737B2 (ja) 2025-12-19
JPWO2021215540A1 (https=) 2021-10-28
US12243524B2 (en) 2025-03-04
US20260004779A1 (en) 2026-01-01

Similar Documents

Publication Publication Date Title
US12176080B2 (en) System and method for review of automated clinical documentation from recorded audio
US12401749B2 (en) Method and system for virtual assistant conversations
EP3243200B1 (en) Processing of multimodal user input
US9053096B2 (en) Language translation based on speaker-related information
CN111801645A (zh) 具有经改进交互式动画会话界面系统的计算装置
US20130144619A1 (en) Enhanced voice conferencing
CN110021301A (zh) 数字助理服务的远场延伸
CN108337380A (zh) 自动调整用户界面以用于免提交互
US20110231792A1 (en) Virtual cultural attache
JP2025160161A (ja) 自動音声応答システム用の選択可能なコントロール
US20260004779A1 (en) Assistance device, conversation control device, and program
KR20200092446A (ko) 어체 변환이 가능한 기계 번역 방법 및 시스템
KR20110038448A (ko) 자동통역 단말기와 서버, 시스템 및 자동통역 서비스 방법
Chen et al. AudioBrowser: a mobile browsable information access for the visually impaired
JP7179512B2 (ja) 情報処理方法、情報処理装置、及びプログラム
CN109257942A (zh) 用户特定的声学模型
JP7098390B2 (ja) 情報処理装置
Brabant et al. Developing an interactive soft toy (‘sasha the bear’) to support refugee children’s communication with healthcare professionals: a preliminary hybrid-object design study
EM et al. Multilingual Voice Enabled Transformer Based Role Aware Virtual Assistant for Smart Campus Interaction
CN120412570A (zh) 信息显示方法及装置
Resurreccion et al. Lab 2–International Assistant Product Specification
Keshi et al. Avatar-Enhanced Voice Carebot for Cancer Patients: In-Hospital Supervised Pilot and Telehealth-Ready Design

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21793011

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase

Ref document number: 2022517117

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21793011

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 17996980

Country of ref document: US