JP2001188785A - Device and method for processing conversation and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain natural topic transition. SOLUTION: For example, when conversation is started between a user and a robot in a step S1, a frame for a robot and a frame for a user are prepared by a control part in the robot. Items such as when, where, who, and what are set in those frames, and the conversation is progressed so that the set items can be filled. Those items are respectively managed by a value indicating the level of conversation, and the mean value of those values is calculated in a step S3. Then, whether or not the transition of the topic should be operated is judged based on the calculated value in a step S4, When it is judged that the transition of the topic should be operated, the transition of the topic is operated, and conversation related with the new topic is started.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a conversation processing apparatus and method, and a recording medium, and more particularly to a conversation processing apparatus and method and a recording medium suitable for use in a robot or the like that has a conversation with a user.

[0002]

2. Description of the Related Art Hitherto, as toys and the like, a large number of robots (including stuffed ones) that output a synthetic sound when a touch switch is pressed have been commercialized.

[0003] In addition, a standard conversation system (task-oriented) with a computer is used, and there are services such as reservation of air tickets and provision of a travel guide service. This does not mean a natural conversation with a person, including a chat, only by talking about a predetermined matter. Eliza (James Allen: Natura) tried to make natural conversations, including chats, between computers and humans.
l Language Understanding, disclosed on pages 6-9).

[0004]

The above-mentioned Eliza and others describe that the contents of conversations with humans (users) are as follows.
He hardly understands, in other words, he can only talk back like a parrot, so that there is a problem that the user gets tired immediately.

[0005] In order for the user to have a conversation in a natural flow without getting tired, it is necessary to avoid talking one topic for a long time and conversely changing the topic one after another. It is necessary. That is, a natural topic transition is an important element for performing a natural conversation.

The present invention has been made in view of such a situation, and uses a concept of a frame to calculate, as a numerical value, how much a talking topic is spoken, and calculates a topic according to the calculated value. The purpose of the present invention is to allow a conversation with the user to be performed naturally by causing the transition of.

[0007]

According to a first aspect of the present invention, there is provided a conversation processing apparatus for generating a frame composed of a plurality of items with respect to a first topic for conversation with a user. Setting means for setting a predetermined value for each item in the frame based on the content of the conversation with the user on the first topic, calculating means for calculating an average value set by the setting means, and calculating means A determination means for determining whether or not to transition to the second topic based on the average value calculated by the above, and a transition means for transitioning to the second topic based on the result of the determination by the determination means. Features.

[0008] The items include at least one of when, where, who, what, why, and the setting means is adapted to apply the item to the content of the conversation with the user on the first topic. If there is, the value of the item can be set so as to increase by a predetermined amount.

[0009] The information processing apparatus may further include an extracting means for extracting an item having a small value from the items, and a creating means for creating a sentence for conversation with a user for the item extracted by the extracting means. it can.

[0010] The determining means may determine whether or not to change the topic by using the average value and the probability value of changing the topic.

When the average value is determined to be larger than the threshold value, the determining means may determine that the topic is to be changed.

[0012] The conversation may be conducted by voice or text.

The robot can be built in the robot.

[0014] In the conversation processing method according to the present invention, a generation step of generating a frame composed of a plurality of items with respect to a first topic for conversation with a user, A setting step of setting a predetermined value for each item based on the content of a conversation with the user on the first topic, a calculating step of calculating an average value set in the processing of the setting step, and a processing of the calculating step A determination step of determining whether or not to transition to the second topic based on the average value calculated in the step, and a transition step of transitioning to the second topic based on the result of the determination in the processing of the determination step. It is characterized by the following.

According to a ninth aspect of the present invention, a program for a recording medium according to the first aspect of the invention relates to a first topic for conversation with a user. A setting step of setting a value for each item based on the content of conversation with the user on the first topic, a calculating step of calculating an average value of the values set in the processing of the setting step, and a processing of the calculating step. A determination step of determining whether to transition to the second topic based on the calculated average value; and a transition step of transitioning to the second topic based on a result of the determination in the determination step. It is characterized by.

[0016] The conversation processing apparatus according to claim 1, claim 8.
In the conversation processing method according to the first aspect and the recording medium according to the ninth aspect, a frame including a plurality of items is generated with respect to the first topic, and a first frame is generated for each item in the generated frame. A predetermined value is set based on the content of the conversation with the user regarding the topic, and it is determined whether or not to transition to the second topic based on the average value of the set values.

[0017]

FIG. 1 shows an example of the appearance of a robot according to an embodiment of the present invention, and FIG.
An example of the electrical configuration is shown.

In this embodiment, the robot has a dog shape, and leg units 3A, 3B, 3C, 3D are connected to the front, rear, left and right of the body unit 2, respectively. The head unit 4 and the tail unit 5 are connected to the front end and the rear end of the head unit 2, respectively.

The tail unit 5 is drawn out from a base 5B provided on the upper surface of the body unit 2 so as to bend or swing with two degrees of freedom. The body unit 2 includes a controller 1 for controlling the entire robot.
0, a battery 11 serving as a power source of the robot, and an internal sensor unit 14 including a battery sensor 12 and a heat sensor 13 are housed.

The head unit 4 includes a microphone (microphone) 15 corresponding to “ears” and a CCD (Ch) corresponding to “eyes”.
arge Coupled Device) camera 16, touch sensor 17 corresponding to tactile sensation, speaker 18 corresponding to "mouth", and the like.
Each is arranged at a predetermined position.

The joints of the leg units 3A to 3D, the joints of the leg units 3A to 3D and the body unit 2, the joints of the head unit 4 and the body unit 2, and the tail unit 5 etc. the coupling portion of the body unit 2, as shown in FIG. 2, the actuators 3AA ₁ to 3AA _K, respectively, 3BA ₁ to 3B
A _K , 3CA _{1 to} 3CA _K , 3DA _{1 to} 3DA _K , 4A ₁
To 4A _L, and 5A ₁ and 5A ₂ are arranged, whereby each coupling part is adapted to be able to rotate with a predetermined degree of freedom.

The microphone 15 in the head unit 4 collects surrounding sounds (sounds) including utterances from the user, and sends out the obtained sound signals to the controller 10. The CCD camera 16 captures an image of the surroundings and sends the obtained image signal to the controller 10.

The touch sensor 17 is provided, for example, on the upper part of the head unit 4 and “strokes” from the user.
It detects the pressure received by a physical action such as tapping or tapping, and sends the detection result to the controller 10 as a pressure detection signal.

The battery sensor 12 in the body unit 2 detects the remaining amount of the battery 11 and sends the detection result to the controller 10 as a battery remaining amount detection signal. The heat sensor 13 detects heat inside the robot,
The detection result is sent to the controller 10 as a heat detection signal.

The controller 10 has a CPU (Central Processes).
sing Unit) 10A, memory 10B, etc.
In the U10A, various processes are performed by executing a control program stored in the memory 10B. That is, the controller 10 includes the microphone 15 and the CCD camera 1
6. Based on the sound signal, image signal, pressure detection signal, remaining battery level detection signal, and heat detection signal provided from the touch sensor 17, the battery sensor 12, and the heat sensor 13, the surrounding conditions, commands from the user, To determine if there is any action from

Furthermore, the controller 10, based on the determination results and the like, to determine the subsequent actions, based on the determination result, the actuators 3AA ₁ to 3AA _K, 3BA ₁
To 3BA _K, 3CA ₁ to 3CA _K, 3DA ₁ to 3DA
_K, 4A ₁ to 4A _L, 5A _1, to drive the necessary of 5A _2, thereby, or to shake the head unit 4 up and down and right and left, or to move the tail unit 5, the leg units By driving 3A to 3D, the robot performs an action such as walking.

The controller 10 generates a synthesized sound as required, and supplies the synthesized sound to the speaker 18 for output, or a not-shown provided at the position of the "eye" of the robot.
Turns on, off or blinks the LED (Light Emitting Diode).

As described above, the robot can take an autonomous action based on the surrounding situation and the like.

FIG. 3 shows an example of a functional configuration of the controller 10 shown in FIG. Note that the functional configuration illustrated in FIG. 3 is realized by the CPU 10A executing a control program stored in the memory 10B.

The controller 10 includes a sensor input processing unit 31 for recognizing a specific external state, an emotion / instinct model unit 32 for accumulating the recognition results of the sensor input processing unit 31 and expressing the state of emotion and instinct, and a sensor. An action determining mechanism unit 33 that determines a subsequent action based on a recognition result of the input processing unit 31 and the like, a posture transition mechanism unit 34 that actually causes the robot to perform an action based on the determination result of the action determining mechanism unit 33,
Each actuator 3AA ₁ to control mechanism 35 for driving and controlling the 5A ₁ and 5A _2, and a sound processing unit 37 for controlling the output of the speech synthesizer 36, and speech synthesis unit 36 for generating a synthesized sound.

The sensor input processing unit 31 includes a microphone 15,
Based on audio signals, image signals, pressure detection signals, and the like provided from the CCD camera 16, the touch sensor 17, and the like, a specific external state, a specific action from the user, an instruction from the user, and the like are recognized, and the recognition result is obtained. Is transmitted to the emotion / instinct model unit 32 and the action determination mechanism unit 33.
Notify.

That is, the sensor input processing unit 31 has a voice recognition unit 31A. The voice recognition unit 31A uses a voice signal given from the microphone 15 in accordance with the control from the action determination mechanism unit 33. Perform voice recognition. Then, the speech recognition unit 31A uses the emotion / instinct model unit 32 and the action determination as instructions on the result of the speech recognition, such as “walk”, “down”, “follow the ball” and the like as state recognition information. Notify the mechanism unit 33.

The speech recognition section 31A also outputs the result of the speech recognition to the conversation processing section 38. this is,
This is for conducting a conversation with a user to be described later.

The sensor input processing section 31 has an image recognizing section 31B. The image recognizing section 31B performs an image recognizing process using an image signal supplied from the CCD camera 16. When the image recognition unit 31B detects, for example, a “red round object” or a “plane that is perpendicular to the ground and equal to or more than a predetermined height” as a result of the processing,
Image recognition results such as "there is a ball" and "there is a wall" are notified to the emotion / instinct model unit 32 and the action determination mechanism unit 33 as state recognition information.

Further, the sensor input processing section 31 has a pressure processing section 31C, and the pressure processing section 31C processes a pressure detection signal given from the touch sensor 17. Then, as a result of the processing, when detecting a pressure that is equal to or more than a predetermined threshold value and for a short period of time, the pressure processing unit 31C recognizes that “hit (struck)”, and if the pressure is less than the predetermined threshold value, When a long-term pressure is detected, it is recognized as “patched (complained)”, and the recognition result is notified to the emotion / instinct model unit 32 and the action determination mechanism unit 33 as state recognition information. I do.

The emotion / instinct model unit 32 manages an emotion model and an instinct model expressing the emotion of the robot and the state of the instinct. The action determining mechanism unit 33 determines the next action based on the state recognition information from the sensor input processing unit 31, the emotion / instinct state information from the emotion / instinct model unit 32, the passage of time, and the like. The contents of the action are sent to the attitude transition mechanism unit 34 as action command information.

The posture transition mechanism section 34 includes the action determination mechanism section 3
Based on the action command information supplied from 3, posture change information for changing the posture of the robot from the current posture to the next posture is generated and output to the control mechanism unit 35. Control mechanism unit 35 in accordance with the posture transition information from the attitude transition mechanism part 34 generates control signals for driving the actuators 3AA ₁ to 5A ₁ and 5A _2, which actuator 3AA ₁ to 5A ₁ and 5A ₂ Send out. Thus, the actuator 3AA ₁ to 5A ₁ and 5A ₂ in accordance with the control signal, to drive the robot,
Take action autonomously.

With the above-described configuration, the robot 1 can operate and also have a conversation with the user. The voice conversation system for performing a conversation includes a voice recognition unit 31A, a conversation processing unit 38, a voice synthesis unit 36, and a sound processing unit 37.

FIG. 4 is a diagram showing a detailed configuration of the speech recognition section 31A. The utterance of the user is input to the microphone 15, which converts the utterance into an audio signal as an electric signal. This voice signal is transmitted to the voice recognition unit 31
A is supplied to an AD (Analog Digital) converter 51 of A. A
In the D conversion unit 51, an audio signal as an analog signal from the microphone 15 is sampled, quantized, and converted into audio data as a digital signal. This audio data is supplied to the feature extraction unit 52.

The feature extraction unit 52 determines, for each appropriate frame, the audio data from the AD conversion unit 51, for example,
A feature parameter such as a spectrum, a linear prediction coefficient, a cepstrum coefficient, and a line spectrum pair is extracted and supplied to a feature buffer 53 and a matching unit 54. In the feature buffer 53, the feature parameters from the feature extracting unit 52 are temporarily stored.

The matching unit 54 refers to the acoustic model database 55, the dictionary database 56, and the grammar database 57 as necessary based on the feature parameters from the feature extraction unit 52 or the feature parameters stored in the feature buffer 53. While recognizing the voice input to the microphone 15 (input voice).

That is, the acoustic model database 55 stores acoustic models representing acoustic features such as individual phonemes and syllables in the language of the speech to be recognized. Here, as the acoustic model, for example, HMM (Hidden Markov
Model) can be used. Dictionary database 5
Reference numeral 6 stores a word dictionary in which information on pronunciation of each word to be recognized is described. The grammar database 57 stores grammar rules that describe how words registered in the word dictionary of the dictionary database 56 are linked (connected). Here, as the grammar rule, for example, a rule based on a context-free grammar (CFG), a statistical word chain probability (N-gram), or the like can be used.

The matching section 54 is a dictionary database 5
The sound model stored in the sound model database 55 is connected by referring to the word dictionary No. 6 to form a sound model (word model) of the word. Further, the matching unit 54 connects several word models by referring to the grammar rules stored in the grammar database 57, and uses the thus connected word models based on the feature parameters, for example, The voice input to the microphone 15 is recognized by the HMM method or the like. Then, the speech recognition result by the matching unit 54 is, for example,
It is output as text.

It should be noted that the matching section 54 is provided for the conversation processing section 3.
8, the information obtained therefrom can be received, and highly accurate speech recognition can be performed based on the conversation management information. Further, when it is necessary to perform the process again on the input voice, the matching unit 54 performs the process using the feature parameters stored in the feature amount buffer 53. This eliminates the need to request the user to speak again.

FIG. 5 is a diagram showing a detailed configuration of the conversation processing unit 38. The recognition result (text data) output from the voice recognition unit 31A is sent to the language processing unit 7 of the conversation processing unit 38.
1 is input. The language processing unit 71 converts the input speech recognition result based on the data stored in the dictionary database 72 and the grammatical database for analysis 73 into morphological analysis,
By performing an analysis such as a syntax analysis, language information such as word information and syntax information is extracted. Further, based on the contents described in the dictionary, the meaning and intention of the input speech utterance are also extracted.

That is, the dictionary database 72 stores information such as word notation and part-of-speech information necessary for applying the grammar for analysis, individual semantic information of words, and the like. Stores data describing restrictions on word chains based on information on each word stored in the dictionary database 72. Using these data, the language processing unit 71 analyzes the text data of the input speech recognition result.

The data stored in the analysis grammar database 73 includes regular grammar, context-free grammar, statistical word chain establishment, and language theory including semantics such as HPSG when including semantic analysis. Is data necessary for text analysis.

Based on the information extracted by the language processing section 71, the topic management section 74 manages and updates the current topic in the topic memory 77 during conversation, and prepares for the next topic transition (details will be described later). , The information managed in the conversation history memory 75 is appropriately updated. In addition, the topic management unit 74
When a topic transition occurs, the topic to be transitioned is determined with reference to information stored in the topic memory 76.

The conversation history memory 75 stores the contents of the conversation or the information extracted from the conversation, and is based on the topic currently being conversed (the topic stored in the topic memory 77 during conversation). It investigates what topic was spoken in the previous conversation and stores data used to control the transition of the topic.

The topic memory 76 stores a plurality of pieces of information for maintaining consistency in the content of the conversation when the conversation is being performed with the user. The topic memory 76 includes the topic management unit 7
4 is a memory that stores information to be referred to when searching for a transition destination topic at the time of causing a topic transition from 4, or when changing a topic following a change in topic from a user. The information stored in the topic memory 76 is added and updated by a method described later.

The conversation topic memory 77 stores information about the topic currently being talked about. Specifically, the information about the topic stored in the topic memory 76 is 1
First, the information selected by the topic management unit 74 is stored. The topic management unit 74 proceeds with the conversation with the user based on the information stored in the topic memory 77 during the conversation. Therefore, the information exchanged in the conversation manages, for example, which content has already been spoken, and the information is updated as appropriate.

The conversation generation unit 78 includes a topic memory 77 during conversation.
The data stored in the dictionary database 79 and the conversation generation rule database 80 are referred to based on the information on the topic in the conversation managed in the above and the information extracted by the language processing unit 71 from the utterance of the immediately preceding user. To generate an appropriate response sentence (text data).

The dictionary database 79 stores word information necessary for creating a response sentence. The dictionary database 72 and the dictionary database 79 may store the same information. Therefore, they can be shared.

The conversation generation rule database 80 stores rules regarding what kind of response sentence is generated and how based on the contents of the conversation topic memory 77. For example, if the topic is managed in a semantic frame structure, etc., together with the way of talking about the topic, such as talking about content that has not been talked about, putting in a companion first, etc. It also contains rules for generating language sentences. The method of generating a natural language sentence from this semantic structure can be realized by performing the reverse processing of the processing performed by the language processing unit 71.

In this way, the response sentence as text data generated by the conversation generation unit 78 is output to the speech synthesis unit 36.

FIG. 6 shows an example of the configuration of the speech synthesizer 36. The text output from the conversation processing unit 38 is input to the text analysis unit 91 as a target of the speech synthesis processing. The text analysis unit 91 refers to the dictionary database 92 and the analysis grammar database 93. While parsing that text.

That is, the dictionary database 92 stores a word dictionary in which part-of-speech information of each word, and information such as readings and accents are described. The analysis grammar database 93 stores the dictionary database 92. For words described in the word dictionary, grammatical rules for analysis such as restrictions on word chains are stored. Then, the text analysis unit 9
1 is based on the word dictionary and the grammatical rules for analysis,
An analysis such as morphological analysis or syntax analysis of the text input thereto is performed, and information necessary for rule-based speech synthesis performed by the rule synthesis unit 94 at the subsequent stage is extracted. Here, the information necessary for the rule speech synthesis includes, for example, information for controlling the position of a pause, accent and intonation, other prosody information, and phonological information such as pronunciation of each word.

The information obtained by the text analysis section 91 is supplied to a rule synthesis section 94, which uses a speech segment database 95 to generate a synthesized speech corresponding to the text input to the text analysis section 91. (Digital data) is generated.

That is, the speech segment database 95 stores speech segment data in the form of, for example, CV (Consonant, Vowel), VCV, CVC, and the like. Based on the information, necessary phoneme segment data is connected, and a pause, an accent, an intonation, and the like are appropriately added.
To generate speech data of a synthesized sound corresponding to the text input to the.

This audio data is supplied to a DA converter 96, where it is converted into an audio signal as an analog signal. This audio signal is supplied to a speaker (not shown),
As a result, a synthesized sound corresponding to the text input to the text analysis unit 91 is output.

As described above, the voice conversation system is configured. The robot 1 can have a conversation with the user by having the voice conversation system. Here, a conversation between people will be considered. When a person talks with another person, one topic is never talked about forever, and it is common to change the topic in a well-defined place. When a topic is changed, it may be switched to a completely unrelated topic, but switching to a related topic is a more natural conversation. This applies to a conversation between a person (user) and the robot 1.

Therefore, the robot 1 has a function of changing a topic (transition) in an appropriate scene when talking with the user. For that purpose, it is necessary to store topical information. In addition, it is necessary to store not only information that the user knows but also information that the user does not know when providing the topic to the user in order to talk with the user. . Therefore, it is necessary to store not only old information but also the latest information.

Therefore, the robot 1 is provided with a communication function (communication section 19 in FIG. 2) in order to obtain the latest information (hereinafter referred to as information n as appropriate). Here, information n
A case where the information n is downloaded from a server that provides the information will be described. 7A shows a case where the communication unit 19 provided in the robot 1 directly communicates with the server 101, and FIG. 7B shows a case where the communication unit 19 is provided as a communication network via the Internet 102, for example. And the server 101 communicate with each other.

In the case of the configuration shown in FIG. 7A, the communication unit 19 of the robot 1 is, for example, a PHS (Persona
l It can be realized by utilizing the technology used for the Handyphone System). For example, the communication unit 1
9 dials the dial of the server 101 while the robot 1 is charging, thereby connecting to the server 101 and downloading the information n.

In the case of the configuration shown in FIG. 7B, communication between the communication device 103 and the robot 1 is performed by wire or wirelessly. For example, the communication device 103 is configured by a personal computer. First, the user connects the personal computer to the server 1 via the Internet 102.
01. Then, from the server 101, information n
Is downloaded and temporarily stored in a storage device in the personal computer. The stored information n is transmitted, for example, by infrared radio or USB (Universal Serial Bus).
s) to the communication unit 19 of the robot 1 via a wire. Thus, the robot 1 can acquire the information n.

Further, the communication device 103 may automatically connect to the server 101 at a predetermined time, download the information n, and transmit the information n to the robot 1.

Next, the information n to be downloaded will be described. The same information n may be provided to all users as the information n, but the information n is not always valid information for all users. In other words, the taste differs for each user, and in order to establish a conversation with the user, only the information n that matches the taste of the user is downloaded and stored, or after all the information n is downloaded, the information n is selected. It is sufficient to store only information n that matches the user's taste.

FIG. 8 is a diagram showing a system configuration when the server 101 selects information n to be provided to the robot 1. The server 101 includes a topic database 110, a profile memory 111, and a filter 112A. The topic database 110 stores information n. The information n is stored for each category such as entertainment information and economic information. As will be described later, the robot 1 can provide information that the user did not know by providing a topic to the user using the information n, as described later, and has an advertising effect. Accordingly, a provider including a company that wants to advertise, etc.
Information n stored in 0 is provided.

The profile memory 111 stores information such as user preferences. The profile is supplied from the robot 1 and is updated as appropriate. Further, the profile may be created by storing topics (keywords) appearing many times when the robot 1 repeats the conversation with the user.
May be provided with a function of inputting and storing the information. Alternatively, the robot 1 may ask the user a question in a conversational manner, and create the user's answer to the question as a profile.

The filter 112A, based on the profile stored in the profile memory 111, selects information n suitable for the profile from information n stored in the topic database 110, that is, information suitable for the user's taste. Select n and output.

The information n output from the filter 112A is received by the communication unit 19 of the robot 1 by the method described with reference to FIG. The information n received by the communication unit 19 is stored in the topic memory 76 in the memory 10B. The information n stored in the storage memory 76 is used when a topic is changed.

The information processed and output by the conversation processing unit 38 is output to the profile creation unit 123 as appropriate. As described above, when a profile is created during a conversation with the user, the profile creation unit 12
3, a profile is created and stored in the profile memory 121. The profile stored in the profile memory 121 is appropriately transmitted to the profile memory 111 of the server 101 via the communication unit 19, so that the robot 1 in the profile memory 111
The profile corresponding to the user is updated.

In the case of the configuration shown in FIG. 8, the profile (user information) stored in the profile memory 111 may leak to the outside, which may cause a problem from the viewpoint of protecting privacy. There is. Therefore, it is possible to adopt a configuration in which the server 101 does not manage the profile. FIG. 9 is a diagram showing a system configuration when the profile is not managed on the server 101 side.

In the configuration shown in FIG. 9, the server 101
Only the topic database 110 is provided. The controller 10 of the robot 1 includes a filter 112B, and the controller 10 of the robot 1
B is newly provided. In the case of such a configuration, the server 101 provides all the information n stored in the topic database 110 to the robot 1. Information n received by the communication unit 19 of the robot 1
Are filtered by the filter 112B, and only the remaining information n is stored in the topic memory 76 as a result.

As described above, if the robot 1 selects the information n, the user's profile is not transmitted to the outside (it is not managed externally), so that the privacy of the user is reduced. It is protected.

Here, information handled as a profile will be described. Profile information includes age, gender, hometown, favorite actor, favorite sport, favorite place, favorite food, hobbies, nearest station, etc.
It also includes numerical information on how much you are interested in economic information, entertainment information, sports information, and the like.

By selecting based on such a profile, only information n that matches the user's taste can be obtained.
It is stored in the topic memory 76. The robot 1 transitions topics based on the information n stored in the topic memory 76 such that conversation with the user flows naturally. In order for conversations to take place naturally, the timing of topic transitions is also important. Next, a method of determining the timing for changing the topic will be described.

As a process for changing the topic, when a conversation with the user is started, the robot 1 creates a frame for itself and a frame for the user. The frame will be described with reference to FIG. At time t _1,
It is assumed that the robot 1 has introduced a new topic to the user, saying, "There was an accident in Narita yesterday." At this time, the robot frame 141 and the user frame 142 are created in the topic management unit 74.

The same items are prepared in the robot frame 141 and the user frame 142, that is, five items such as “when”, “where”, “who”, “what” and “why”. Is prepared. Since the robot 1 has provided the topic "The accident occurred in Narita yesterday", each item of the frame 141 on the robot side is set to 0.5. Here, it is assumed that the value set for each item takes a value of 0.0 to 1.0. A value of 0.0 indicates that the item is completely unknown (not talking at all), and a value of 1.0 indicates that all information is known (the item has been completely talked about). Is shown.

When the robot 1 provides a topic, it indicates that the robot 1 has obtained information on the topic. In other words, the provided topic is stored in the topic memory 76.
(Which was stored in the topic memory 76, but is moved to and stored in the topic memory 77 during conversation by becoming the topic currently being talked about).

As for the stored information, it is assumed that the user knows more information about the information, and it is assumed that the user does not. Therefore, when the robot 1 provides a topic, each item of the robot frame 141 relating to the topic has an initial value of 0.5.
Is set, and assuming that the user does nothing, each item of the user frame 142 is set to 0.0.

Although the value set as the initial value is 0.5 here, another value may be set. In addition, for example, the item “when” is specifically, usually “year”, “month”, “day”, “hour”, “minute”.
(Including the "second", it becomes 6 information,
In a conversation, it is usually assumed that it will not be a topic until the second, and it is not included here), and all information may be collected for the item "when".
Therefore, simply dividing 0.2 by dividing 1.0 into 5 equals one piece of information. For example, the word “yesterday” includes “
Judge that it contains three information of "year", "month", "day",
A value of 0.6 may be set.

In the above description, 0.5 is set for all items as initial values.
For example, when there is no keyword corresponding to the item "when" regarding the topic at that time, 0.0 may be set in the item.

As described above, when the conversation is started, a frame and a value of each item in the frame are set for the topic. The user is used when the robot 1 hears the utterance of “there was an accident at Narita yesterday, yesterday” at time t ₂ , saying “Eh?” If you made a speech, the robot 1, at time t _3, once again, to repeat the same speech.

Suppose that the user understands that the robot 1 has spoken due to repeated speeches, and at time t ₄ utters “yes”, which is used when it is understood that the speech has been made. , The user frame 142 is rewritten. The user knows the item “when” from the information “yesterday”, the item “where” from the information “at Narita”, and the item “what happened” from the information “there was an accident”. It is determined that they have been obtained, and the values of those items are set to 0.2.

The setting of 0.2 is merely an example, and other values may be set. For example, if the robot 1 has uttered all of the information that the robot 1 knows for the item “when” of the topic currently being talked about, the same value may be set for that item. good. For example, in this case, the robot 1
If only the keyword “Yesterday” has been acquired for the item “when”, the value of the item “when” in the user frame 142 has already been spoken to the user. Frame 141 "
0.5 set in the item "when" is set.

Here, if the user asks, at time t ₄ , instead of “yes”, but “when?” As shown in FIG. 11, the value set in the user frame 142 differs. come. That is, since the user has now asked a question relating to the item “when”, the robot 1 determines that the user is interested in the information regarding the item “when”, and the robot 1 The value is set to 0.4 which is larger than 0.2 which is a value set for another item. Thus, depending on the content of the conversation,
The values set for the items of each frame are different.

In the above description, the case where the robot 1 provided a topic to the user has been described. However, the case where the user provided a topic to the robot 1 will be described. As shown in FIG. 12, at time t ₁ , it is assumed that the user has uttered to the robot 1 “There is an accident in Narita”. Robot 1 receives the utterance
Are the robot frame 141 and the user frame 14
Create 2.

First, regarding the value of each item of the user frame 142, the value of the item “where” from the information “Narita” and the value of the item “what happened” from the information “there was an accident” , Respectively. Based on the same determination, each item in the robot frame 141 is set to the same value as the value of each item in the user frame 142.

[0090] for the pronunciation of such user, the robot 1 performs a response at time t _2. The robot 1 creates a response sentence so that the conversation proceeds in such a direction that there is no item having a value of 0.0 among the items in each frame. In this case, first, the value of the item of "when" the robot frame 141, since both the user frame 142 is 0.0, the robot 1 is at time t _2, the relative user question "When?" You

[0091] For this question, the user is, at time t _3, when it is assumed that the speech that "yesterday", in response to the speech, the value of each item in the frame is re-set. That is, since the information about the item “when” “yesterday” is obtained, the value of the item “when” in the robot frame 141 and the user frame 142 becomes 0.0.
Is reset to 0.2.

Further, at time t ₄ (FIG. 13), when the robot 1 asks the user the question “What time is it?”, And at time t ₅ , the user replies “After 8:00 p.m.”
Robot frame 141 and user frame 142
Has a value of 0.2 when the value of the item “when” is higher than 0.2.
It is reset to 6. As described above, when the robot 1 asks the user a question, the conversation proceeds in a direction in which the item having the value of 0.0 disappears, and a natural conversation is established.

At time t ₅ , if the user replies “I do not know”, as described above, the robot frame 141 and the user frame 142
The value of the item "when" is set to 0.6. This is done so that there is no need to ask a question again if you do not know each other, in other words, keep the value small. If you do so, it is assumed that you will ask a question again, so do it in order to prevent such a thing.
If a response such as "I do not know" is received, it is possible to determine that conversation about the item cannot be further performed, and the value of such item may be set to 1.0. .

By continuing such a conversation,
The value of each item of the robot frame 141 and the user frame 142 approaches 1.0. A value of 1.0 for all items indicates that the topic has been exhausted. In such a case, the transition of topics is a natural flow of conversation. Also, it is a natural flow of conversation that there is a case where a topic is changed before the story is exhausted. In other words, if a setting is made so that it is not possible to transition to the next topic unless one has always spoken out of one topic, the conversation may be persistent and fun. (Before the value of the item of item (1) becomes 1.0), a setting is made so that the topic may be changed.

With reference to the flowchart of FIG. 14, a method of controlling the timing at which a topic transition is performed using the above-described frame will be described. When a conversation is started for a new topic in step S1, a robot frame 141 and a user frame 142 are generated in the topic management unit 74 in step S2, and the value of each item is set. In step S3, an average value is calculated. The average value is the average value of the values of each item of the robot frame 141 and the user frame 142, in this case, 10 items.

After the average value is calculated, it is determined in step S4 whether or not the topic is to be changed. The value of the average value, when the threshold value above T ₁ since, may determine whether to transition the topic is provided a rule that transitions topic but,
If set to a small threshold value T _1, the conversation is often result in changes in limbo, conversely, when set large the threshold value T _1, the more that will come out importunity conversations It is assumed that such inconveniences as described above occur.

Therefore, in this embodiment, FIG.
The probability that a topic transitions is changed by an average value using a function as shown in FIG. That is, when the average value is between 0.0 and 0.2, the topic does not transition because the probability of the topic transitioning is zero. If the average value is between 0.2 and 0.5, the topic transitions with a probability of 0.1. When the average value is a value between 0.5 and 0.8, the probability is calculated according to the formula of probability = 3 × average value−1.4, and the topic transitions according to the probability. When the average value is a value between 0.8 and 1.0, a probability of 1.0, that is, a topic always transitions.

As described above, by using the average value and the probability value, it is possible to make the timing at which the topic changes, so that a more natural conversation can be performed. FIG. 15 shows an example, and another function may be used. When the average value is 0.2 or more, the probability value is not 0.0. For example, when the value of 4 items out of 10 items in the frame is 0.0, the topic changes. Rules such as setting the probability value to 0.0 may be provided.

Further, the function to be used may be changed depending on the time at which the conversation takes place. For example, by using different functions for morning and night, it is also possible to provide a function such that a conversation can be made shallower and wider in the morning than in the night.

Returning to the description of the flowchart of FIG. 14, when it is determined in step S4 that the topic is to be changed, the topic is changed (the method of extracting the target topic to be changed will be described later). The process from step S1 is repeated for the topic. On the other hand, if it is determined in step S4 that the topic does not change, the process proceeds to step S5, where the value of the item in the frame is reset for a new utterance, and the processing in step S3 and subsequent steps is performed on the value. Repeated.

Although the method of determining the timing of transition of the topic described above is performed using a frame, another method may be used. When a conversation is being held between the robot 1 and the user, the number of times the conversation is exchanged may be counted. This usually means that if the number of conversations increases, it is possible to judge that the topic has been sufficiently discussed, and it is also possible to determine whether or not to transition the topic based on the number of conversations. It is possible.

When the value obtained by counting the number of conversations is set as the count value N, the topic may be changed when the count value N exceeds a predetermined threshold value, or P = 1. The value P calculated by the formula of −1 / N
May be used instead of the average value in FIG.

Instead of counting the number of times conversations are exchanged, the timing at which topics are changed may be determined by counting the time during which conversations are exchanged. The time when the robot 1 speaks and the time when the user speaks are cumulatively added. The accumulated value T obtained by the cumulative addition is
The counter value N is used instead of the above-described counter value N. The topic may be changed when the added value T exceeds a predetermined threshold value.
= T / Tr, the value P calculated based on the equation
5 may be used instead of the average value.

When the count value N or the added value T is used as described above, the process of determining the timing for changing the topic is basically the same as that described with reference to the flowchart of FIG. The process of creating a frame is a process of initializing the counter value N (addition value T) to 0, the process of step S3 is omitted, and the process of step S5 updates the counter value N (addition value T). Processing.

[0105] In a conversation, a hammer is an important factor in determining whether or not the user is interested in the content being spoken.
It is preferable to change topics. Therefore, as a method of determining the timing of transition of a topic, there is a method of using the time change of the sound pressure of the utterance of the user. As shown in FIG. 16A, the input pattern is analyzed by section normalizing the input utterance (input pattern) of the user.

As for the user's utterance (sooting), what is assumed as a normalized analysis result is, for example, as shown in FIG.
As shown in (B), there are four patterns: a pattern intended to be affirmative, a pattern intended to be indifferent, a pattern intended to be a standard (which does not include intentional expression, merely a companion) and a pattern intended to be questionable. Which pattern is approximated by the result of section normalization of the input pattern can be determined by, for example, calculating the distance using the inner product value of some reference functions as a vector. It is.

When it is determined that the input pattern is a pattern intended for indifference, the topic may be changed immediately, or the number of times determined to be a pattern intended for indifference may be accumulated. Then, when the cumulative value Q becomes equal to or more than a predetermined value, the topic may be changed. Further, the number of conversations may be counted, and a value obtained by dividing the cumulative value Q by the counter value N is set as a frequency R, and the topic may be changed when the frequency R becomes a predetermined value or more. The frequency may be used as a substitute for the average value in FIG. 15 to transition the topic.

[0108] During a conversation, saying the same thing (parrot return) to what the other party has spoken often indicates that the subject is not interested in the topic. Utilizing such a thing, the degree of coincidence between what the robot 1 uttered and what the user uttered to the utterance is measured, a score value is obtained, and the topic is transited using the score value. As a method of calculating the score value, for example, the character sequence of words spoken by the robot 1 is simply compared with the character sequence of words spoken by the user, and the number of matching characters is used as the score value.

Using the score values obtained in this way, the topic is changed when the threshold value is exceeded, or the topic is changed using the average value in FIG. 15, similarly to the above-described method. .

In the above-described method, a pattern intended to be indifferent (a pattern in relation between sound pressure and time) is used, but topics may be transited by using a word intended to be indifferent as a trigger. The words that are intended to be indifferent are “Hm”, “Hee”, “A, yes”, “Yes, yes”, and the like, and these words are registered as a group of words that are intended to be indifferent. When it is determined that the words in the registered group have been uttered by the user, the topic is changed.

Further, when a conversation is stopped, that is, when the conversation is stopped, in other words, when it takes a long time to reply, the user is not interested in the topic and does not want to reply. You can think. Therefore,
The robot 1 may measure the time until the user responds to the utterance of the robot 1 itself, and may determine whether or not to change the topic according to the measured time.

For example, as shown in FIG. 17, when the time required for a response is 0.0 to 1.0 seconds, the topic is not changed, and when the time is 1.0 to 12.0 seconds, a predetermined function is used. Transition topics according to the probability value calculated by
When the time is longer than 2.0 seconds, the topic is always changed. FIG.
Is an example, and any function and second setting may be used.

The transition timing of a topic is determined by one or a combination of a plurality of the methods described above.

When the user receives an utterance that is desired to change the topic, such as “I'm good at that topic”, “Let's change”, “Let's change topic”, the above-described method is used. The topic is changed regardless of the timing for changing the topic.

Next, a method of extracting the topic of the transition destination when it is determined by the robot 38 that the conversation processing section topic is to be changed will be described. When transitioning from topic A talking to another topic B at that time, topic A and topic B need not have any relevance at all, but the transition to a topic that is somewhat relevant is that of conversation. In many cases, it does not impede the flow and is a natural flow. Therefore, in the present embodiment, transition to topic B related to topic A is made.

The information for changing the topic is stored in the topic memory 76, and when the conversation processing unit 38 determines that the topic is to be changed by the above-described method, the information is stored in the topic memory 76. The topic of the transition destination is extracted based on the information. Here, information stored in the topic memory 76 will be described.

As described above, the information stored in the topic memory 76 is downloaded and stored via a communication network such as the Internet. FIG.
Is a diagram for explaining information in a topic memory 76. FIG. In this case, the topic memory 76 stores four pieces of information. Each piece of information is composed of items such as "item", "when", "where", "who" and "what happened", and items other than "item" include the robot frame 141 (the user frame 142). Same as the item in parentheses.

Items have a title-like meaning and are provided for identifying the contents of the information.
Each piece of information has an attribute representing its contents. The example shown in FIG. 19 shows a case where a keyword is used as an attribute. As the keyword, an independent word (a word having a single meaning such as a noun or a verb) included in each information is selected and set. Each piece of information may be stored in a text format representing the content, but in the example shown in FIG. 18, the content is extracted and stored in a frame structure composed of pairs of items and their values (attributes: keywords). ing.

Referring to the flowchart of FIG. 20, the conversation processing unit 38 when the topic is changed from the robot 1 side.
The processing performed in will be described. Conversation processing unit 3
In step S11, the topic management unit 74 determines whether or not to cause a topic transition using the method described above. If it is determined in step S11 that a topic transition occurs, the process proceeds to step S12, and the degree of association between the current topic information and the topic information stored in the topic memory 76 is calculated. Here, a method of calculating the relevance will be described.

As the calculation of the degree of relevance, for example, the angle formed by the keyword vector, which is the attribute of the information, and the degree of coincidence of the classification (determining that information of the same classification or similar classification is similar information) For example, a method using such a method can be considered.
Also, define the relevance between keywords as a table,
There is also a method of calculating the relevance between the keyword of the current topic information and the keyword of the topic information stored in the topic memory 76 using the table. By adopting such a method, it is possible to calculate the degree of relevance including the connection between different keywords, and it is possible to transition topics in a natural flow.

Here, a method based on a table defining the degree of association between keywords will be described. In FIG.
4 shows an example of a table. FIG. 21 is a table in which the item “item” is created based on the information “bus accident” and the information “airplane accident”. The information selected as this table includes information on the topic currently talked and information that may be the next topic, in other words, information stored in the topic memory 77 during conversation (FIG. 5). This is information stored in the topic memory 76.

The information that the item is “bus accident” includes “
"Bus", "Accident", "February", "10th", "Sapporo", "Passenger", "10 people", "Injuries", "Slip"
There are nine keywords such as “Airplane”, “Accident”, and “2”
"Month", "10th", "India", "Passenger", "100"
There are eight keywords, "person" and "injury".

There are 72 (= 9 × 8) combinations for each keyword. Between each keyword,
The relevance score is described. The sum of these scores is defined as the degree of relevance of the two pieces of information. The table as shown in FIG.
(FIG. 7), the information may be provided to the robot 1 together with the created table. When the robot 1 stores information downloaded from the server 101, a table is created and stored. You may do it.

When a table is prepared in advance, information stored in the topic memory 77 during conversation and the topic memory 7
6 and the information stored in the server 10
It is assumed that it is downloaded from No. 1. In other words, when the topic transition occurs in the robot 1 or when the user transitions the topic, the topic memory 76 stores the information of the topic determined to be talking to the user. If so, it is possible to use a table created in advance. However, if the user causes a topic transition and it is determined that the topic is not stored in the topic memory 76, there is no table created in advance, and it is necessary to create a new one. Such processing will be described later.

The table is a thesaurus.
It is created by acquiring the relevance of words that are likely to appear statistically in the same context from a large amount of corpus with reference to (words are classified and arranged according to meaning. Classified vocabulary table).

Next, a method of calculating the degree of association will be specifically described with reference to the table shown in FIG. As described above, as the combination of keywords between the information “bus accident” and the information “airplane accident”, for example, “bus” and “airplane”, “bus” and “accident”, etc. Exists. In the example shown in FIG.
The degree of association between "bus" and "airplane" is 0.5, and the degree of association between "bus" and "accident" is 0.3.

As described above, the information stored in the conversation topic memory 77 and the topic memory 76, respectively,
Create a table and calculate the sum of the scores. However, when the sum is calculated in this manner, a topic (information) having a large number of keywords has a high possibility of having a large score, and a topic having a small number of keywords has only a score having a low relevance. More likely not to have. Therefore, when calculating the sum, the sum may be normalized by dividing by the number of keyword combinations used in calculating the relevance (72 in the example shown in FIG. 21).

When the transition from the topic A to the topic B is performed, the relevance between the keywords is referred to as the relevance ab. When the transition from the topic B to the topic A is performed, the relevance between the keywords is referred to as the relevance ba. Then, when the degree of association ab and the degree of association ba take the same score value, the lower left half (or upper right half) in the figure is used as shown in FIG. However, if it is set that the transition of a topic has a direction, it is necessary to use the entire table. However, the same algorithm can be used when using a part of the table or when using the entire table.

Create a table as shown in FIG.
When calculating the sum, instead of just calculating the sum,
The sum may be calculated by weighting the keywords in consideration of the current topic flow. For example,
The topic I am currently talking about is "A bus accident happened"
And As a keyword included in the content,
Although there are "buses" and "accidents", by weighting those keywords, the total sum of tables including those keywords is increased. For example, if the weight is set to 2, the degree of association between “bus” and “airplane” is 0.5 in the table of FIG. 21, but is doubled to 1.0 by performing the weighting.

By performing the weighting in this way, the contents of the topic before the transition and the topic after the transition become relevant, and the naturalness of conversation involving the topic transition can be increased. The weighted table may be used as a table (the table may be rewritten), or the table may be weighted without calculating the totality of the relevance.

Returning to the description of the flowchart in FIG. 20, when the relevance between the current topic and another topic is calculated in step S12 as described above, in step S13, the topic having the highest relevance, that is, Then, the information of the table with the highest total value is selected, and the selected topic is set as the transition destination topic. Then, step S14
In, a transition is made to the set topic, and a new conversation is started.

In step S15, the previous topic transition is evaluated, and the relevance table is updated according to the evaluation. The reason for providing such steps is that a user needs to create a table suitable for each user in order to have a natural conversation, because the same topic is felt differently by each user. For example, for the keyword “accident”, user A remembers “train accident”
User B remembers "airplane crash" and user C remembers "traffic accident". Also, if the user A makes a plan to travel to Sapporo and actually goes on a trip according to the plan, even if the user A is the same for the keyword “Sapporo”, before and after the travel, Then, remembering and proceeding with the contents of the conversation will be different.

That is, even if the topic is the same, not all users have a common feeling, and even the same user has a different feeling depending on time and the situation at that time. If the degree of association is dynamically changed, a more natural and fun conversation for the user can be provided. Therefore, step S1
Step 5 is provided. FIG. 22 is a flowchart illustrating details of the process in step S15.

In step S21, it is determined whether or not the topic transition was appropriate. This determination is made between the previous topic T-1 and the further previous topic T-2, based on the topic (topic T) transitioned in step S14. This determination is made, for example, on the robot 1 side.
How much information memorized about topic T-2 was conveyed to the user, for example, the keyword about topic T-2 was 1
If the number is 0, it can be determined by investigating how many of the 10 keywords have transitioned to topic T-1 at the time of transmission to the user.

When it is determined that many keywords have been transmitted, it means that the conversation time has been long.
Therefore, it is also possible to determine whether the transition was appropriate by determining whether the conversation about the topic T-2 has transitioned to the topic T-1 after a long time. Such a determination is to determine whether or not the user was favorable with respect to the topic T-2.

Using such a determination method, step S
If it is determined in step 21 that the topic transition is appropriate, the process proceeds to step S22, in which all keyword pairs between the topics T-1 and T-2 are created. In step S23,
The relevance table is updated so that the score value of the pair becomes large. In this way, by updating the relevance table, the transition in a similar combination is likely to occur from the next time.

If it is determined in step S21 that the topic transition is not appropriate, the relevancy table is not updated. This is to avoid using information on topic transitions determined to be inappropriate.

As described above, in order to change the topic, the degree of relevance between the information stored in the topic memory 77 during conversation and the information of all topics stored in the topic memory 76 is calculated, and the sum is calculated. , The determination of the transition destination topic increases the computational cost. Therefore,
After calculating the sum of all the information stored in the topic memory 76, the transition of the topic is performed while selecting the topic to be the transition destination, instead of determining the topic of the transition destination. Thereby, the calculation cost is kept low. The operation of the conversation processing unit 38 in such a case will be described with reference to the flowchart in FIG.

In step S31, the topic management unit 74
Determines whether or not to cause a topic transition by the method described above, and if it is determined to cause a topic transition, the process proceeds to step S32. In step S32,
One topic information is selected from the topic memory 76. In step S33, the degree of association between the selected information and the information stored in the topic memory 77 during conversation is calculated. The calculation of the relevance and the summation performed in step S33 are performed in the same manner as in the case described with reference to the flowchart in FIG.

In step S34, in step S33
It is determined whether or not the total value calculated in the step has exceeded the threshold value. If it is determined in step S33 that the total value does not exceed the threshold value, the process returns to step S32, where information on a new topic is read from the topic memory 76, and the information is processed.

On the other hand, if it is determined in step S34 that the total value has exceeded the threshold value, the flow advances to step S35 to determine whether or not the topic has recently been talked about. For example, it is assumed that the topic information read from the topic memory 76 in the process in step S32 is a topic before the topic currently being talked about. The repetition of the same topic is unnatural and may cause the conversation to be unpleasant. To prevent such a situation, the process in step S35 is provided.

The processing in step S35 is performed by checking the conversation history memory 75 (FIG. 5). By examining the information in the conversation history memory 75, if it is determined that the topic is not a topic recently talked, the process proceeds to step S36. If it is determined that the topic is a topic recently spoken, the process returns to step S32, and the subsequent steps are performed. The process is repeated. In step S36, a transition is made to the selected topic.

FIG. 24 shows an example of a conversation between the robot 1 and the user. At time t ₁ , the robot 1 determines that among the information stored in the topic memory 76,
The item "item (FIG. 19)" is selected as "bus accident" and conversation is started. First, the robot 1, "we had an accident of bus in Sapporo." And speaks, the user is against it, at time t _2, to question and "When?".
The robot 1 responds to the question at time t _{3 by} saying “
December 10 ", the user receives the answer,
At time t _4, to the new questions and "to No person is you want to hurt?".

At the time t_FiveIn "10 people
The user responds at time t₆In,
And that ’s a conversation.
During this time, the above-described processing is repeatedly performed. So
Then, the robot 1 moves at time t ₇In, the transition of the topic
Judge that it will happen, and as a new topic, item
Chooses the topic "airplane crash". This is
As mentioned before, the topics before and after the transition
Keys such as "", "February", "10th", "Injury"
This is because the codes match and the degree of association is determined to be high.

[0145] The robot 1, a result that caused the transition of the topic, at time t _7, "on the same day, but it is there was also an airplane accident" speaks. In contrast, a user is, at time t _8, "the guy in India?" And interested, to the speech, such as to check. Then, in order to continue the conversation further, the robot 1 responds to the user's question at time t _9.
Affirmatively, "Yes, this is an accident whose cause is unknown," and further provide the user with facts of unknown cause. The user you to time t _10, "how much hurt was that?" And ask questions, the robot 1, at time t _11, to reply with "100 people".

As described above, by transiting topics by the above-described method, a natural conversation can be established.

[0147] It should be noted that, in conversation example shown in FIG. 24, the user is, at time t _8, "I Wait a minute. Was it what the cause of the bus accident?", Such as, not accept the transition of the topic If an explicit utterance is made to return to the topic before the transition, or if there is time to respond to the transitioned topic, it is determined that the transitioned topic was not accepted by the user, and the transition is made. Return to the topic before the conversation and continue the conversation.

In the above description (in the case where a table relating to all topics is created and the highest sum value is selected as the transition destination topic), when transitioning the topic, the topic memory 76 If there is information on a topic that is suitable for making a transition, in other words, even if the degree of relevance is low compared to other information, it will be selected as the transition destination topic. It is assumed that the flow will no longer flow (transition to a completely different topic).

In order to prevent such a situation, for example, in a situation where only topics whose relevance (sum value) is equal to or less than a predetermined value can be selected, or by selecting one topic in the above description, If the sum of the topics is equal to or greater than the threshold, in the method of using that topic as the transition destination topic, if no topic with the threshold or higher is found, say words such as "By the way" or "Speaking", A completely different topic may be provided to the user.

Further, in the above description, the case where the robot 1 makes a transition to a topic has been described. However, it is also assumed that the user makes a transition to a topic. With reference to the flowchart of FIG. 25, an operation performed by the conversation processing unit 38 to perform a process corresponding to a case where the user has changed topics will be described.
In step S41, the topic management unit 74 of the robot 1
Determines whether the topic spoken by the user is related to the topic currently being talked about (the topic stored in the talking topic memory 77). This determination can be made using the same method as the method of calculating the degree of association between topics (keywords) used when the robot 1 voluntarily transitions topics.

That is, the degree of relevance between the keyword group extracted from the single utterance of the user and the keyword of the topic currently being talked on is calculated, and if a predetermined threshold condition is satisfied, it is determined that there is relevance. . For example, suppose the user uttered, "Speaking of which, there is a snow festival in Sapporo, right?" When keywords are extracted from the utterance, there are "Sapporo" and "Snow Festival". These keywords,
The degree of relevance between topics is calculated using the keyword group of the topic currently being talked about, and whether or not there is relevance is determined based on the calculation result.

If it is determined in step S41 that the process is related to the current topic, the process of the flowchart ends because there is no need to perform the process of following the topic transition of the user. On the other hand, when it is determined in step S41 that the topic is not related to the topic currently being talked to, the process proceeds to step S42. In step S42, it is determined whether or not topic transition is allowed.

The determination as to whether or not the topic transition is allowed is made, for example, by the robot 1
This is done by setting rules such as not permitting if there is still information to be spoken. Further, the above-described processing when the topic is changed from the robot 1 side may be performed in the same manner. In other words, when it is determined that the timing of the topic transition is not reached on the robot 1 side, the topic transition is not permitted. However, if the setting is made in this way, the topic transition can be determined only by the robot 1 side. Therefore, when the topic is transitioned from the robot 1 side, the topic is transitioned from the user side. In such a case, processing such as setting a probability value is required so that the transition is easy.

If it is determined in step S42 that the transition of the topic is not permitted, the topic is not changed, and the process of this flowchart is terminated. On the other hand, if it is determined in step S42 that the transition of the topic is permitted, it is necessary to recognize the topic that the user is talking about. Therefore, in step S43, the topic that the user is talking is retrieved from the topic memory 76.

As a method of searching the topic memory 76 for the topic that the user is talking about, the keyword extracted from the user's utterance and all the keywords stored in the topic memory 76 are the same as in the method performed in step S41. By calculating the degree of relevance (sum) of the topics (information) to the keyword group, the information having the largest calculation result is first set as a candidate for the topic that the user is talking about, and the calculation result of the candidate is If the value is equal to or more than the predetermined value, the information is determined to be a topic that the user is talking about. Such a method has a high probability of being consistent with the topic the user is talking about and is reliable, but at the expense of computational cost.

Therefore, one piece of information is selected from the topic memory 76, the degree of relevance of the information to the keyword group is calculated, and if the calculation result is equal to or more than a predetermined value, the topic is discussed by the user. To be determined. By repeatedly performing such processing until information having a value equal to or more than a predetermined value is detected, a topic to which the user has transitioned is searched.

By performing such a search process, it is determined in step S44 whether or not a topic presumed to be the topic talked by the user has been searched. If it is determined in step S44 that the topic has been searched, the process proceeds to step S45, in which the searched topic (information) is moved to the topic memory 77 during conversation.
The topic has changed.

On the other hand, if it is determined in step S44 that no topic has been searched, in other words, if it is determined that there is no information in which the total value of the relevance exceeds a predetermined value, the flow proceeds to step S46. Since coming to the process of step S46 means that the user is talking information other than the information that the robot 1 can know, it is determined that the topic has changed to a topic unknown to the robot 1 and the conversation topic memory 77 Clear the information in

When a transition to an unknown topic occurs, the robot 1
Keeps talking by asking a question to the user.
Further, during the conversation, information about the topic is stored in the topic memory 77 during the conversation. When a new topic is thus input, the robot 1 updates the above-described relevance table. With reference to the flowchart in FIG. 26, a process when the table is updated with a newly input topic will be described. In step S51,
A new topic is entered. As situations in which a new topic is input, it is assumed that the user speaks about a topic of information that the robot 1 has not acquired, or that the user downloads the information n via a network or the like.

When a new topic is input, step S5
In 2, a keyword is extracted from the input topic. Then, in step S53, all pairs of the extracted keywords are generated. In response to the result, in step S54, the relevance table between the keywords is updated. The processing in step S54 is the same as the processing in step S23 in the flowchart shown in FIG. 21, and a description thereof will be omitted.

As described above, the case where the topic transition occurs from the robot 1 side and the case where the topic transition occurs from the user side are mixed in the actual conversation. Therefore, the conversation processing unit 3
Figure 8 shows the general flow of topic transitions
6 is followed. That is, step S61
, A process of following the topic transition on the user side is performed. This processing is the processing of the flowchart in FIG.

As a result of the processing in step S61, step S61
At 62, it is determined whether the user has transitioned the topic. That is, in the flowchart of FIG.
If it is determined in step S41 that the topic is related to the current topic, it is determined in step S62 that the topic has not been changed, and in step S41 it is determined that the topic is not related to the current topic. If the subsequent processing has been performed, it is determined in step S62 that the topic has been changed.

If it is determined in step S62 that the topic has not been changed, the process proceeds to step S63, in which the robot 1 voluntarily changes the topic. This processing is the processing of the flowchart in FIG. 20 or FIG.

As described above, giving priority to the topic transition of the user over the topic transition of the robot 1 means giving the user the initiative of the conversation. When the processes of step S61 and step S63 are interchanged, it means that the robot 1 has been given the initiative of the conversation. Utilizing such a thing, for example, when the robot 1 grows up by the way of contact of the user, when the robot 1 is set to take the initiative of the conversation, and when the robot 1 is well-trained Alternatively, the setting may be made so that the user takes the initiative in the conversation.

In the above description, the case where the keyword included in the information is used as the attribute has been described. However, as shown in FIG. 28, the classification, location, time, etc. may be used. When such attributes are used, in the example shown in FIG. 28, one or two
Often only has one value. In such a case, it is possible to perform the same processing as in the case of the keyword. For example, in the case of classification as an attribute, it basically has only one value, but it can be handled as a special example in the case of having a plurality of values like a keyword. (Creating a table) is possible.

A plurality of attributes such as a keyword and a classification may be used in combination. When a plurality of attributes are used in combination, the relevance is calculated for each attribute, a weighted linear sum is obtained, and the result is used as a final determination result.

As described above, the topic memory 76 stores topics (information) suitable for the user's tastes (profiles) for natural conversation and natural topic transition. . In addition, it has been described above that the profile is acquired in a conversation between the robot 1 and the user, or that the robot 1 is connected to a computer and the user inputs to the robot 1 using the computer. Here, by conversation with the user,
A case where the robot 1 creates a profile of the user will be described with a specific example.

As shown in FIG. 29, at time t ₁ ,
The robot 1 asks the user "What happened yesterday?" To this question, the user at time t _2, to reply with "I saw a movie called title A". From this response, information “Title A” is added to the user profile. further,
At time t ₃ , the robot 1 asked “was interesting?”
At time t ₄ , the user replies, “It was interesting. In particular, actor C, who was in the role of B, was performing well.” From this response, the information “Actor C” is added to the profile.

In this way, the robot 1 acquires the user's preferences from the conversation. For the purpose of acquiring the taste, in the example of the conversation shown in FIG. 29, if the user replies “not interesting” at time t ₄ , “Title A” may not be added to the profile. .

After several days, according to such a profile,
For example, it is assumed that information such as “Latest work“ Title B ”starring actor C, released tomorrow, and screened at XX hall in Shinjuku” is downloaded from the server 101 to the robot 1. On the other hand, at time t ₁ ′, the user says, “A new movie starring Actor C will be released.” Since the user praised Actor C several days ago, Interested in the topic, at time t ₂ ′, “From when? "
The robot 1 has already acquired information on when it will be released. In addition, information on the nearest movie theater can already be obtained from the information (profile) of the station nearest to the user. In this example, the information has already been obtained.

At time t ₃ ′, the robot 1 replies to the user's question, “From tomorrow. If it is Shinjuku, it will be screened at the XX hall” based on the acquired information.
The user obtains the information and utters “I want to see” at time t ₄ ′.

[0172] In this way, by transmitting information based on the user's profile in a manner of conversation, natural advertising can be performed. That is, in the above-described conversation example, the advertisement of the movie "Title B" was performed.

By using the profile stored in the server 101 or the profile voluntarily provided by the user, the advertising agency or the like can send a direct mail such as a product advertisement of the company to the user. May be.

In the above-described embodiment, the conversation with the user is made by voice. However, the present invention can be applied to a case where the conversation is made by text.

The above-described series of processing can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, it is possible to execute various functions by installing a computer in which the programs constituting the software are embedded in dedicated hardware, or by installing various programs For example, it is installed from a recording medium to a general-purpose personal computer or the like.

As shown in FIG. 30, this recording medium is distributed separately from a computer in order to provide the user with the program. The magnetic disk 211 (including a floppy disk) on which the program is recorded, the optical disk 2
12 (CD-ROM (Compact Disk-Read Only Memory), DVD
(Including a Digital Versatile Disk), a magneto-optical disk 213 (including an MD (Mini-Disk)), or a package medium such as a semiconductor memory 214, as well as a user installed in a computer in advance. Is stored in the program
The hard disk includes a ROM 202 and a storage unit 208.

[0177] In this specification, the steps of describing a program provided by a medium are not necessarily performed in chronological order but may be performed in chronological order according to the described order. Alternatively, it also includes individually executed processing.

In this specification, the system is defined as:
It represents the entire device composed of a plurality of devices.

[0179]

As described above, according to the conversation processing apparatus of the first aspect, the conversation processing method of the eighth aspect, and the recording medium of the ninth aspect, a plurality of items relating to the first topic are provided. Is generated, and for each item in the generated frame, a predetermined value is set based on the content of the conversation with the user on the first topic, and based on the average value of the set values, Since it is determined whether or not to transition to the second topic, it is possible to have a natural conversation with the user.

[Brief description of the drawings]

FIG. 1 is a perspective view illustrating an external configuration example of a robot according to an embodiment of the present invention.

FIG. 2 is a block diagram showing an example of the internal configuration of the robot shown in FIG.

FIG. 3 is a block diagram illustrating a functional configuration example of a controller 10 of FIG. 2;

FIG. 4 is a block diagram showing an internal configuration of a speech recognition unit 31A.

FIG. 5 is a block diagram showing an internal configuration of a conversation processing unit 38.

FIG. 6 is a block diagram showing an internal configuration of a speech synthesis unit 36.

FIG. 7 is a block diagram showing a system configuration when downloading information n.

FIG. 8 is a diagram showing a detailed configuration of the system of FIG. 7;

FIG. 9 is a diagram showing another detailed configuration of the system of FIG. 7;

FIG. 10 is a diagram illustrating the timing of topic transition.

FIG. 11 is a diagram illustrating the timing of topic transition.

FIG. 12 is a diagram illustrating the timing of topic transition.

FIG. 13 is a diagram illustrating the timing of topic transition.

FIG. 14 is a flowchart illustrating the timing of topic transition.

FIG. 15 is a diagram illustrating a relationship between an average value for determining a topic transition timing and a probability value.

FIG. 16 is a diagram illustrating an utterance pattern.

FIG. 17 is a diagram illustrating a relationship between a time at which a conversation for determining a topic transition timing is interrupted and a probability value;

FIG. 18 is a diagram illustrating information stored in a topic memory 76.

FIG. 19 is a diagram illustrating a case where an attribute is a keyword.

FIG. 20 is a flowchart illustrating topic transition.

FIG. 21 is a diagram illustrating a table.

FIG. 22 is a flowchart showing details of a process in step S15 of the flowchart in FIG. 20;

FIG. 23 is another flowchart illustrating topic transition.

FIG. 24 is a diagram illustrating an example of a conversation exchanged between the robot 1 and a user.

FIG. 25 is a flowchart illustrating an operation of the robot 1 when a user makes a topic transition.

FIG. 26 is a flowchart illustrating updating of a relevance table.

FIG. 27 is a flowchart illustrating the operation of the conversation processing unit 38.

FIG. 28 is a diagram illustrating attributes.

FIG. 29 is a diagram illustrating an example of a conversation exchanged between the robot 1 and a user.

FIG. 30 is a diagram illustrating a medium.

[Explanation of symbols]

10 controller, 10A CPU, 10B memory, 15 microphone, 16 CCD, 17 touch sensor, 18 speaker, 19 communication unit, 31 sensor input processing unit, 31A voice recognition unit, 31B image recognition unit, 31C pressure processing unit, 32 emotion / Instinct model section, 33 action decision mechanism section, 34 attitude transition mechanism section, 35 control mechanism section, 36 voice synthesis section, 37
Sound processor, 38 conversation processor, 74 topic manager, 75 conversation history memory, 76 topic memory,
77 topic memory during conversation, 101 server, 103
Communication device, 110 topic database, 111
Profile memory, 112 filters, 141 Robot frame, 142 User frame

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G10L 15/00 G10L 3/00 551H 9A001 15/22 571U (72) Inventor Hideki Shimomura Kitashinagawa, Shinagawa-ku, Tokyo 6-7-35 Sonny Co., Ltd. (72) Inventor Osamu Hanata 6-7-35 Kita Shinagawa, Shinagawa-ku, Tokyo (72) Inventor Hiroki Saijo 6-chome Kita-Shinagawa, Shinagawa-ku, Tokyo 7-35 Inside Sony Corporation (72) Inventor Toshiya Ogura 7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo F-term inside Sony Corporation (Reference) 2C150 BA06 BA11 CA01 CA02 DA24 DA26 DA27 DA28 DF03 DF04 DF06 DF33 ED42 ED52 EF16 EF23 EF29 EF33 EF36 3F060 AA00 BA10 CA14 5B091 AA15 BA03 CB12 CB32 CC02 CC03 CD15 5D015 AA01 AA05 KK02 KK04 LL02 LL11 5D045 AB30 9A001 BB01 BB03 BB04 CC05 EE05 FF03 GG05 HH11 HH13 HH16 HH17 HH18 HH19 HH21 HH33 JJ25 JJ27 KK31 KK37 KK44 KK62 KZ08 LL03

Claims (9)

[Claims] 1. A conversation processing apparatus for conversing with a user, comprising: a generation unit configured to generate a frame composed of a plurality of items with respect to a first topic to be talked to by the user; Setting means for setting, for each of the items, a predetermined value based on the content of a conversation with the user on the first topic; calculating means for calculating an average value of the values set by the setting means; Determining means for determining whether to transition to a second topic based on the average value calculated by the means; and transition means for transitioning to the second topic based on the result of the determination by the determining means. A conversation processing device comprising: 2. The method according to claim 1, wherein the item includes at least one of when, where, who, what, and why, and the setting means includes: If any of the items apply,
2. The conversation processing apparatus according to claim 1, wherein the value of the item is set so as to increase by a predetermined amount. 3. An extraction unit for extracting an item having a small value from among the items, and a creation unit for creating a sentence for having a conversation with the user with respect to the item extracted by the extraction unit. The conversation processing device according to claim 1, wherein: 4. The conversation processing apparatus according to claim 1, wherein the determination unit determines whether or not to change the topic using the average value and a probability value of changing the topic. . 5. The conversation processing apparatus according to claim 1, wherein the determining unit determines that a topic is changed when the average value is determined to be larger than a threshold value. 6. The conversation processing apparatus according to claim 1, wherein the conversation is performed by voice or text. 7. The conversation processing device according to claim 1, wherein the conversation processing device is built in a robot. 8. A conversation processing method of a conversation processing apparatus for conversation with a user, wherein a generation step of generating a frame composed of a plurality of items with respect to a first topic of conversation with the user; A setting step of setting a value for each of the items in the generated frame based on the content of the conversation with the user on the first topic, and calculating an average value of the values set in the processing of the setting step A calculating step, based on the average value calculated in the processing of the calculating step, a determining step of determining whether to transition to a second topic, based on a result of the determination in the processing of the determining step,
And a transition step for transitioning to the second topic. 9. A conversation processing program for conversation with a user, comprising: a generation step of generating a frame composed of a plurality of items with respect to a first topic of conversation with the user; A setting step of setting a value for each of the items in the generated frame based on the content of the conversation with the user on the first topic, and calculating an average value of the values set in the processing of the setting step A calculating step, based on the average value calculated in the processing of the calculating step, a determining step of determining whether to transition to a second topic, based on a result of the determination in the processing of the determining step,
And a transition step for transitioning to the second topic. A recording medium having recorded thereon a computer-readable program.