JP2016156845A - Interaction support program, server and method for supporting user operation with user interaction system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program or the like for supporting a user operation that a user may adopt without sense of incompatibility in accordance with utterance contents from the user when utilizing a user interaction system.SOLUTION: A computer is functioned as: a support table in which an action pattern formed from a phrase of a part of speech and an action clause, and an identifier of an application that should be started based on the action clause are correspondingly registered beforehand; a fact pair table in which a pair (fact pair) of a situation clause and an action clause to be coupled by a causal word is registered; fact pair selection means for detecting a situation clause registered in the fact pair table from user intention text and using the fact pair table to detect an action clause corresponding to the situation clause; application start means which uses the support table to start an application based on an identifier corresponding to the detected action clause; and support text generation means by which support text including the detected action clause is generated and explicitly indicated to the user.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technology of a user interaction system.

  A user dialogue system that realizes natural dialogue with humans is becoming more popular, especially using smartphones and tablet terminals. 2. Description of the Related Art Conventionally, there is a technology that supports user's work according to utterance content from a user or situation information acquired by a sensor (for example, see Patent Document 1). Information that the user really wants can be provided by grasping the situation where the user who is working is placed and guiding the information conforming to the situation in an interactive manner. According to this technique, it is necessary to prepare the support information for the situation information in advance.

JP-A-10-143187 JP 2004-212802 A JP 2009-198614 A

Inui Takashi, Inui Kentaro, Matsumoto Yuji, "Automatic Acquisition of Causal Knowledge from Document Sets Based on Connection Signs", IPSJ Journal, Vol. 45, No. 3, pp. 919-933 (2004 ), [Online], [Search February 19, 2015], Internet <URL: http://ci.nii.ac.jp/naid/110002712142> Kentaro Torizawa, “Automatic Extraction of“ Common-sense ”Inference Rules from Corpus”, 9th Annual Conference of the Language Processing Society, pp.318-321 (2003), [online], [February 19, 2015 search ] Internet <URL: http://www.anlp.jp/proceedings/annual_meeting/2003/pdf_dir/B4-9.pdf> "Inference of user's utterance intention in dialogue system", Fire Country Symposium 2007, A-3-2, 2007., [online], [Search February 19, 2015], Internet <URL: http: // www .pluto.ai.kyutech.ac.jp / plt / endo-lab / publication.html> “A case study of comparison of several methods for corpus-based speech intention identification”, Proceedings of the 10th Conference of the Pacific Association for Computational Linguistics (PACLING2007), pp. 255-262, 2007., [online], [2015 Search February 19, 2011], Internet <URL: http://www.pluto.ai.kyutech.ac.jp/plt/shimada-lab/oldtopics.html>

  The user interaction system responds interactively to user utterances. For example, when the user utters “I caught a cold”, the response contents are, for example, “Are you okay?” “Would you like to go to sleep?” “Time to go to school, but when are you resting?”

  However, when the user agrees with the contents of the response from the user interaction system, the user may separately start an application or a search page and try to search for the destination or contact address again. Although the user interaction system can automatically start an application or a search page estimated from the content of the interaction, the user interaction system gives a sudden impression to the user and may be confused with the display. On the other hand, for example, even if the terminal automatically starts an application or a search page, the search key itself needs to be input by the user after all.

  Therefore, an object of the present invention is to provide a dialogue support program, a server, and a method that can be supported by a natural user operation with no sense of incongruity according to the utterance content from the user when using a user dialogue system. To do.

According to the present invention, there is provided a dialogue support program for causing a computer to function to support a user operation with respect to a user intention text determined by a user dialogue system,
A support table pre-registered in association with an action pattern composed of a part of speech and an action clause and an identifier of an application to be activated based on the action clause;
A fact-to-table that registers pairs of factual clauses and action clauses (facts vs.) linked by causal words;
A fact pair selection means for detecting a situation clause registered in the fact pair table from the user intention text and detecting an action clause corresponding to the situation clause using the fact pair table;
Using the support table, application launching means for launching an application based on the identifier corresponding to the detected action clause;
It is characterized by generating a support text including the detected action clause and causing the computer to function as support text generation means that is clearly indicated to the user.

According to another embodiment of the dialogue support program of the present invention,
The application activation means activates a search page based on the browser, and it is preferable that the computer further function to input a word corresponding to the part of speech phrase connected to the detected action clause as a search key.

According to another embodiment of the dialogue support program of the present invention,
The fact vs. table is generated from a number of text corpora for teachers,
Using a preset causal word list, extract causal words from the text corpus, extract "situation clauses" and "action clauses" sandwiching the causal words before and after, and match the action clauses registered in the support table It is also preferable to further cause the computer to function as a fact pair extracting means for registering the situation clause in the fact pair table.

According to another embodiment of the dialogue support program of the present invention,
It is preferable that the fact pair extraction means further causes the computer to function so as to register only the situation clauses registered in the preset situation clause word list in the fact pair table.

According to another embodiment of the dialogue support program of the present invention,
A situation clause is a predicate term structure with a predicate representing the situation,
It is also preferable that the computer further functions so that the action clause is a predicate term structure having a predicate representing an action and does not include a particle or an auxiliary verb having a negative meaning.

According to the present invention, there is provided a dialogue support server that supports a user operation on a terminal with respect to a user intention text that is mounted by a user dialogue system and is determined by a user dialogue system from an utterance text received from a terminal.
A support table pre-registered in association with an action pattern composed of a part of speech and an action clause and an identifier of an application to be activated based on the action clause;
A fact-to-table that registers pairs of factual clauses and action clauses (facts vs.) linked by causal words;
A fact pair selection means for detecting a situation clause registered in the fact pair table from the user intention text and detecting an action clause corresponding to the situation clause using the fact pair table;
Application starting means for transmitting control information for starting an application based on an identifier corresponding to the detected action clause to the terminal using the support table;
Support text generation means for generating support text including the detected action clause and transmitting the support text to the terminal is provided.

According to the present invention, there is provided a dialogue support method for a device equipped with a user dialogue system and for assisting a user operation in a terminal for a user intention text determined by a user dialogue system from an utterance text received from a terminal. ,
The device
A support table pre-registered in association with an action pattern composed of a part of speech and an action clause and an identifier of an application to be activated based on the action clause;
A fact-to-table that registers a set of factual clauses and action clauses (fact pairs) linked by causal words;
The device
A first step of detecting a situation clause registered in the fact pair table from the user intention text, and detecting an action clause corresponding to the situation clause using the fact pair table;
A second step of transmitting, to the terminal, control information for starting an application based on an identifier corresponding to the detected action clause using the support table;
And generating a support text including the detected action clause and transmitting the support text to the terminal.

  According to the dialogue support program, the server, and the method of the present invention, when using the user dialogue system, it is possible to support the user with a natural user operation with no sense of incongruity according to the utterance content from the user.

It is a function block diagram of the dialog assistance program in this invention. It is explanatory drawing showing the flow of the specific process in each function structure part of FIG. It is explanatory drawing showing extraction of the fact pair table in this invention. It is the screen of the user interface displayed on the terminal.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a functional configuration diagram of a dialogue support program according to the present invention.

  According to FIG. 1, a user dialogue system 10 that advances a dialogue process with a user is installed and executed on the server side that communicates with the terminal 2. The user accesses the server via the network using the terminal 2 such as a smartphone or a tablet. Of course, the user interaction system 10 may be installed only in a single device such as the terminal itself.

  The terminal 2 as a user interface for the user interaction system 10 has an input device and an output device for the user. The voice signal acquired by the microphone by the user's utterance is converted into text by voice recognition, and the text is transmitted to the user interaction system 10. The answer text output from the user interaction system 10 is converted into a voice signal by voice synthesis, and the voice signal is uttered from a speaker. Further, the terminal 2 is equipped with a touch panel display and can realize a natural dialogue with the user dialogue system 10.

  The dialogue support program (server) 1 includes the user dialogue system 10 and inputs “user intention text” determined by the user dialogue system from the utterance text received from the terminal 2. In response to the user intention text, the computer is caused to function so as to support user operations on the terminal 2.

The user dialogue system 10 is an existing one and generally includes a language analysis unit, an intention determination unit, a dialogue control unit, and a response generation unit.
The language analysis unit executes morphological analysis and syntax analysis from the user utterance text.
The intention determination unit estimates the intention of the user from the parsed user utterance text (see, for example, Non-Patent Documents 3 and 4). The intention determination unit prepares a teacher feature vector generated from a corpus text corresponding to each intention category in advance as a template group. Then, the intention determination unit creates a feature vector from the set of content words obtained by abstracting synonyms and numerical expressions from the text. The created feature vector is compared with the teacher feature vector, and the intention category to which the template having the highest similarity belongs is output as the intention estimation result.
The dialogue control unit outputs text to be answered to the user in accordance with the user's intention, for example, according to a dialogue scenario prepared in advance. The dialog is advanced by proceeding with the dialog process with the user (see, for example, Patent Documents 2 and 3). Others select the next dialog process based on the transition probability in order to proceed with a natural dialog as much as possible.
The response generation unit generates an answer text corresponding to the dialog process in the dialog control unit and clearly indicates it to the user.

  According to FIG. 1, the dialogue support program 1 includes a support table 11, a fact pair table 12, a fact pair selection unit 13, an application activation unit 14, and a support text generation unit 15. The dialogue support program 1 functions as a server and a single device by being executed by a computer mounted on the device. Further, the flow of processing of these functional components can be understood as a dialogue support method.

  FIG. 2 is an explanatory diagram showing a specific processing flow in each functional component of FIG.

[Support Table 11]
The support table 11 is registered in advance in association with an “action pattern” composed of a part of speech and an action clause and an identifier “application identifier” of an application to be activated based on the action clause.
According to FIG. 2, the support table 11 is registered as follows, for example.
[Action pattern] [Application identifier]
(<Part of speech><Actionclause>)
Go to <Noun Phrase> Map Search Application Identifier <Noun Phrase> Drink Product Search Application Identifier Contact <Noun Phrase> Telephone Application Identifier Send <Noun Phrase> Product Search Application Identifier Buy <Noun Phrase> Product Search Application Identifier The support table 11 is registered in advance by an operation manager of the user interaction system.

The map search application is a map search page based on a browser, in which, for example, a noun phrase such as a store type is input as a search key, and its position in the vicinity of the current position of the user is displayed.
The product search application is a search page based on a browser, in which a noun phrase such as a product name is input as a search key, and a sales page of the product is displayed.
The telephone application is preinstalled for a mobile phone, and for example, inputs a telephone number and places a call to the mobile phone network.

[Fact vs. table 12]
The fact pair table 12 is a table in which sets of situation clauses and action clauses (fact pairs) linked by causal words (connecting words) are registered.
The “situation clause” is a predicate term structure having a predicate representing a situation (including a noun whose semantic attribute is a matter).
The “action clause” is a predicate term structure having a predicate representing an action, and does not include a particle or an auxiliary verb having a negative meaning.
According to FIG. 2, the fact pair table 12 is registered as follows, for example.
[Situation section] [Action section]
<Cold> Go to <Hospital><Head> hurts <Headaches> Drink <Head><Call><Company><Hot> Buy <Ice><Cold> Go to <Coffee><Memorial The fact vs. table 12 may be registered by the operation manager of the user interaction system or extracted from the text corpus as shown in FIG. 3 to be described later. May be.

[Fact versus selector 13]
The fact pair selection unit 13 inputs “user intention text” output from the intention determination unit of the user interaction system. Then, the fact pair selection unit 13 detects the “situation clause” registered in the fact pair table from the user intention text, and detects the “action clause” corresponding to the situation clause using the fact pair table. .

According to FIG. 2, it is assumed that the user utters “It looks like a cold”. This utterance content is input to the user interaction system 10, and the user intention text “I am cold” is output from the intention determination unit. This user intention text is input to the fact pair selection unit 13. The fact pair selection unit 13 refers to the fact pair table 12 and selects the following fact pair.
[Situation section] [Action section]
<Cold> Go to <Hospital> The selected fact pair is output to the application activation unit 14.

[Application startup unit 14]
The application activation unit 14 uses the support table 11 to search for an application identifier corresponding to the detected action clause. According to FIG. 2, the following application identifiers are searched:
[Action pattern] [Application identifier]
Go to <noun phrase> Map search application identifier <hospital> corresponds to the noun phrase connected to the action clause.
Then, the application activation unit 14 transmits control information to activate the application based on the identifier to the terminal 2.

Examples of control information for starting an application include the following.
(1) Application identifier-> “Map search application identifier”
(2) Search key->"Hospital"
On the other hand, the terminal 2 activates the map search application and inputs “hospital” as a search key to display, for example, the position of the hospital around the current position of the user.

[Support Text Generation Unit 15]
The support text generation unit 15 generates support text including the detected action clause, and transmits the support text to the terminal 2. According to FIG. 2, the following support text is generated.
Go to <Hospital>->"How about going to the hospital?"
Here, the action pattern <noun phrase + action clause> is colloquially. This support text is clearly indicated to the user. Thereby, even if the map search application is automatically started, the user can recognize that he / she is recommended to go to the hospital and can accept it without feeling uncomfortable.

  FIG. 3 is an explanatory diagram showing extraction of the fact pair table in the present invention.

  According to FIG. 3, a fact-to-table is generated from a number of text corpora for teachers. The text corpus is a text group for teachers to extract fact pairs. The text corpus may be a large-scale text data obtained by accumulating dependency relationships of morpheme strings of each sentence by morphological analysis and syntax analysis.

[Fact vs. extraction unit 16]
The fact pair extraction unit 16 extracts “causal words” set in advance from the text corpus. The causal word is registered in advance in the causal word list. As causal words, there are, for example, “~ so ~” and “~~~”. Then, “situation clause” and “action clause” sandwiching the causal word are extracted, and a situation clause that matches the action clause registered in the support table 11 is registered in the fact pair table 12.

  For the extraction of the situation clause and the action clause connecting causal words, specifically, an existing technique can be used (see, for example, Non-Patent Documents 1 and 2). According to the technique described in Non-Patent Document 1, a causal relationship is extracted for Japanese text with the word “for” as a clue word. Further, according to the technique described in Non-Patent Document 2, it is assumed that a causal relationship is easily established when a parallel phrase exists in one sentence and verbs in the parallel phrase have a common object. Causal relations are extracted.

  It is also preferable that the fact pair extraction unit 16 registers only “situation clauses” registered in the preset “situation clause list” in the fact pair table. Only situation clauses to be registered as fact pairs can be specified in advance.

  Note that, for the action clauses registered in the support table 11, only the situation clauses with the highest occurrence frequency of fact pairs may be extracted. The appearance frequency here may be a TF-IDF (Term Frequency-Inverse Document Frequency) value focusing on independent words. TF-IDF refers to an index for identifying how characteristic a word that appears in a sentence is. TF (term frequency) represents the number of times the word appears in the sentence, and IDF (inverse document frequency) represents the natural logarithm of the number of sentences including the sentence in the entire corpus. Then, TF value × IDF value becomes the TF-IDF value of the word in the sentence. A word having a higher TF-IDF value is recognized as having a higher topicality (important).

  FIG. 4 is a user interface screen displayed on the terminal.

  According to FIG. 4, the touch panel display of the terminal 2 is displayed. “Character Agent” is displayed on the display, and a voice dialogue between the user and the agent may be advanced. Of course, the present invention is not limited to a voice dialogue, but may be a text dialogue.

  Also, according to FIG. 4, when the user utters “It looks like a cold”, the agent replies “How about going to the hospital?” As the support text, and the map search application is activated, and the search key is set to “Hospital”. "Is entered. The user can know that the agent recommends going to the hospital, and can visually recognize the position of the hospital around the current position of the user. That is, even if the application is automatically activated, the user does not have a mysterious impression by seeing or listening to the support text.

  As described above in detail, according to the dialogue support program, server, and method of the present invention, when a user dialogue system is used, the user is supported by natural user operation without a sense of incongruity according to the utterance content from the user. be able to.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

DESCRIPTION OF SYMBOLS 1 Dialog support program 10 User dialog system 11 Support table 12 Fact pair table 13 Fact pair selection part 14 Application starting part 15 Support text generation part 16 Fact pair extraction part 2 Terminal

Claims (7)

A dialogue support program for causing a computer to function to support a user operation with respect to a user intention text determined by a user dialogue system,
A support table pre-registered in association with an action pattern composed of a part of speech and an action clause and an identifier of an application to be activated based on the action clause;
A fact-to-table that registers pairs of factual clauses and action clauses (facts vs.) linked by causal words;
Fact pair selection means for detecting a situation clause registered in the fact pair table from the user intention text and detecting an action clause corresponding to the situation clause using the fact pair table;
Using the support table, application launching means for launching an application based on an identifier corresponding to the detected action clause;
A dialogue support program characterized by causing a computer to function as support text generation means for generating a series of support text including the detected situation clauses and the action clauses and indicating them to a user. The application activation means activates a search page based on a browser, and further causes the computer to function as a search key for inputting a word corresponding to a part of speech phrase connected to the detected act clause. The dialogue support program according to claim 1, wherein: The fact pair table is generated from a number of text corpora for teachers,
Using a preset causal word list, a causal word is extracted from the text corpus, a “situation clause” and an “action clause” sandwiching the causal word are extracted, and the action clause registered in the support table is extracted. 3. The dialogue support program according to claim 1, further causing the computer to function as fact pair extraction means for registering a situation clause that matches the fact clause in the fact pair table. 4. The dialogue according to claim 3, wherein the fact pair extraction unit further causes the computer to function so as to register only the situation clauses registered in the preset list of situation clauses in the fact pair table. Support program. The situation clause is a predicate term structure with a predicate representing the situation;
5. The act clause is a predicate term structure having a predicate representing an act, and further causes the computer to function so as not to include a particle or an auxiliary verb having a negative meaning. The dialogue support program according to any one of the above. A dialogue support server that is equipped with a user dialogue system and supports user operation on the terminal for user intention text determined by the user dialogue system from utterance text received from the terminal,
A support table pre-registered in association with an action pattern composed of a part of speech and an action clause and an identifier of an application to be activated based on the action clause;
A fact-to-table that registers pairs of factual clauses and action clauses (facts vs.) linked by causal words;
Fact pair selection means for detecting a situation clause registered in the fact pair table from the user intention text and detecting an action clause corresponding to the situation clause using the fact pair table;
Using the support table, application activation means for transmitting, to the terminal, control information to activate an application based on an identifier corresponding to the detected action clause;
A dialogue support server, comprising: support text generation means for generating a series of support text including the detected situation clause and the action clause and transmitting the support text to the terminal. A dialogue support method for a device, which is equipped with a user dialogue system and supports user operation on the terminal with respect to a user intention text determined by the user dialogue system from utterance text received from a terminal,
The device is
A support table pre-registered in association with an action pattern composed of a part of speech and an action clause and an identifier of an application to be activated based on the action clause;
A fact-to-table that registers a set of factual clauses and action clauses (fact pairs) linked by causal words;
The device is
Detecting a situation clause registered in the fact pair table from the user intention text, and detecting an action clause corresponding to the situation clause using the fact pair table;
A second step of transmitting, to the terminal, control information for starting an application based on an identifier corresponding to the detected action clause, using the support table;
And a third step of generating a series of support text including the detected situation clause and the action clause and transmitting the support text to the terminal.

Images