JP2015011621A - Conversation processing device, control method, control program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acquire information about a profile of a user from another user.SOLUTION: A conversation processing server (1) which manages a profile of each member, performs user authentication of a member with whom an information processing device (2) performs conversation, and also controls the information processing device (2) to question the member about profile of another member other than the member.

Description

  The present invention relates to an apparatus for collecting user profiles.

  Conventionally, various techniques are known in which a robot estimates human relationships.

  For example, Patent Document 1 listed below discloses a technique for accurately estimating the family structure of a person photographed by a camera without performing a face image registration process.

  Patent Document 2 discloses a robot apparatus that, after personally authenticating a person who is talking, records the communication information of the person in a communication database in association with the person and the person with whom the person is talking. Has been.

JP 2011-123657 A (released on June 23, 2011) JP 2010-267143 A (published on November 25, 2010)

  However, the conventional technology as described above does not ask a user other than the user about the user's profile, and does not register the user's profile based on a response from the other user. That is, the above-described conventional technology estimates the configuration of the entire family or the human relationship, and does not recognize the detailed profile of each user. A robot estimates a family structure or a human relationship based on a family photographed image or a conversation between users. The robot collects and registers a user's profile by talking with the user. It is not a thing.

  That is, the above-mentioned Patent Document 1 discloses a technique for recognizing a family image by recognizing a face image, but describes a method for presenting a question to a user and registering each user's profile. Absent.

  In addition, the above-mentioned Patent Document 2 discloses a technique for collecting conversation after the robot has approached the place where the conversation is being performed and personal authentication is performed. The mechanism for registering answers is not described.

  The present invention has been made in view of the above problems, and an object thereof is to realize a conversation processing device or the like that queries another user's profile to another user and registers the user's profile. It is in.

  In order to solve the above problems, a conversation processing device according to an aspect of the present invention includes a user detection unit that detects one of a plurality of users, and the user detection unit detects one of the plurality of users. When the profile items of the users other than the detected user among the plurality of users are not registered in the storage unit that stores the profile items of the plurality of users in association with the respective users. Message generating means for generating a message asking the user who has detected the item, and question presenting means for presenting the message generated by the message generating means to the detected user from the own device or via another device; The content obtained based on the detected user's answer to the question presented by the question presenting means was not registered. Serial is characterized in that it comprises a, and profile registration means for registering in the storage section as the profile fields.

  According to one aspect of the present invention, a message asking about the unregistered profile of a user whose profile item is unregistered is presented to another user other than the user, and a response from the other user is presented. Based on this, it is possible to register the profile item for the user.

  Therefore, it becomes possible to register a profile item of a certain user based on the viewpoint from another user other than the user. Also, the user's profile item can be acquired without asking the user, for example, a message addressed to the user can be generated based on the user's profile item that is not asking a certain user. it can. Therefore, the user can be surprised by the message to be presented.

It is a block diagram which shows an example of the principal part structure of the conversation processing server which concerns on one Embodiment of this invention. It is a figure which shows the outline | summary of the conversation system containing the conversation processing server of FIG. It is a figure which shows the data structure and specific example of the content of the question memorize | stored matched with the conditions etc. which produce | generate about the question which the conversation processing server of FIG. 1 produces | generates. It is a figure which shows the data structure of the profile data containing the several profile item for every user which the conversation processing server of FIG. 1 holds, and a specific example. It is a figure which shows the data structure and specific example of the data for authentication which the conversation processing server of FIG. 1 hold | maintains for each user. It is a flowchart which shows the outline | summary of a process of the conversation processing server of FIG. It is a flowchart which shows the flow of the family number registration process in the flowchart of FIG. It is a flowchart which shows the flow of the family name registration process in the flowchart of FIG. It is a flowchart which shows the flow of the family profile registration process in the flowchart of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the process example in which the profile of each member of a family is registered in the conversation system of FIG. It is a figure which shows the data structure and specific example of the content of the message memorize | stored matched with the conditions etc. which produce | generate about the message which the conversation processing server of FIG. 1 produces | generates. It is a block diagram which shows an example of a principal part structure of the information processing apparatus which concerns on other forms of implementation of this invention.

Embodiment 1
Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. In the following, an example in which the conversation processing device according to an embodiment of the present invention is applied to a conversation system in a home will be described.

  In the conversation system, a user's voice acquired by an information processing device placed in a home is recognized by the conversation processing server, while a message generated by the conversation processing server is output by the information processing device. Thus, a communication system is provided for each member (for example, a father, a mother, a child, and a grandparent) of a family in a household to have a conversation with an information processing apparatus.

  In the following drawings, the same or corresponding parts are denoted by the same reference numerals, and description thereof will not be repeated. In addition, dimensional relationships such as length, size, and width, and shapes in the drawings are appropriately changed for clarity and simplification of the drawings, and do not represent actual dimensions and shapes. Furthermore, in FIG. 1 to FIG. 19, “Robo” refers to an information processing apparatus.

  In order to facilitate understanding of the conversation processing server 1 (conversation processing apparatus) according to an embodiment of the present invention, the outline of the conversation system 100 is first organized below.

(Outline of conversation system)
FIG. 2 is a diagram showing an outline of the conversation system 100.

  As shown in FIG. 2, the conversation system 100 according to the present embodiment includes a conversation processing server 1 and an information processing apparatus 2 (another apparatus), and further includes, for example, a news distribution server 3A, information retrieval An external information providing server 3 such as the server 3B may be included. The conversation processing server 1 communicates with the information processing device 2 and the information providing server 3.

  The information processing device 2 is, for example, a self-propelled information processing device placed in a home. When a family member (for example, a father or a mother) talks to or encounters a family member, the information processing device 2 Acquire voice and face images. Then, the voice and face image information of the member (hereinafter referred to as “voice information” and “face image information”) is transmitted to the conversation processing server 1. Further, the information processing apparatus 2 receives a message from the conversation processing server 1 and outputs the message by voice.

  The conversation processing server 1 performs a user authentication process for each member of the family based on the voice information and face image information received from the information processing apparatus 2. Further, the voice information is analyzed to grasp the contents, and a message corresponding to the contents is generated. Although the details will be described later, the conversation processing server 1 can spontaneously generate a message having contents that are not related to the contents of the voice information. The conversation processing server 1 transmits the generated message to the information processing device 2 and causes the information processing device 2 to output the message by voice.

  In the conversation system 100, when the information processing apparatus 2 meets a family member (for example, a mother) or is spoken by a member, the information processing apparatus 2 uses the conversation processing server 1 to transmit the voice information and face image information of the member. Send to. The conversation processing server 1 authenticates the member based on the voice information and face image information received from the information processing device 2 and then generates a message asking a profile of another member (for example, a dad) other than the member. The message is transmitted to the information processing apparatus 2. The information processing apparatus 2 receives the message from the conversation processing server 1 and outputs the message as a voice. That is, the member (for example, a mother) is a member other than the member (for example, a father). ) Ask about the profile. When the information processing apparatus 2 obtains a response to the question from the member (for example, a mother), that is, a response for a profile of a member other than the member (for example, a father), the audio information related to the response Is transmitted to the conversation processing server 1. The conversation processing server 1 receives the voice information related to the response from the information processing apparatus 2, recognizes the voice information, and other than the member (for example, mother) that the information processing apparatus 2 talks to or meets. Get profiles of members (eg, dad). The conversation processing server 1 repeats the above processing to acquire the profile of each member of the family based on responses from other members of the family, and builds the profile of all members of the family.

  In the example illustrated in FIG. 2, the conversation processing server 1 first causes the information processing apparatus 2 to output a voice message “What's your mother's birthday?” ((1) in FIG. 2). As a premise of this processing of the conversation processing server 1, the conversation processing server 1 receives the face image information and the voice information from the information processing apparatus 2, and recognizes that the following situation has already occurred. . That is, the conversation processing server 1 informs the information processing device 2 of the face image information and the voice that the mother is speaking to the information processing device 2 or the information processing device 2 meets the mother. Receive and recognize at least one of the information. Therefore, the conversation processing server 1 recognizes that a situation in which a mother is present at least around the information processing apparatus 2 has occurred.

  As shown in (2) of FIG. 2, in response to the question from the information processing device 2 “What's the birthday of mom and dad?”, The mom asked, “My dad ’s birthday is June 10.” I answered. The information processing apparatus 2 transmits this answer of the mother to the conversation processing server 1 as voice information.

  The conversation processing server 1 recognizes the voice information related to the mother's answer received from the information processing apparatus 2 and registers the father's birthday as the father's profile.

  When the information processing device 2 meets a family member or speaks from a family member on June 10, the information processing device 2 transmits at least one of the face image information and voice information of the member to the conversation processing server. 1 to send. The conversation processing server 1 determines that the information processing device 2 has met or was spoken based on at least one of the face image information and the voice information received from the information processing device 2 and that the member is a father. Then, the following processing is performed. That is, first, referring to the registered father's profile, it is understood that “June 10 is the father's birthday”. Next, it is confirmed that “Today's date is June 10”. Then, a condition that “the member the information processing apparatus 2 meets or is talking to is a father”, a condition that “Today's date is June 10”, and “June 10 is The following message is generated based on the condition that it is “the birthday of the father”. That is, based on the above three conditions, the conversation processing server 1 generates a message “Daddy, happy birthday!”, Transmits the message to the information processing device 2, and sends the message to the information processing device 2. "Daddy, happy birthday!"

  When the information processing apparatus 2 receives the message from the conversation processing server, the dad says, “Dad, happy birthday!” To the father on June 10 ((3) in FIG. 2).

  As a result, as shown in (4) of FIG. 2, the father is blessed by the information processing apparatus 2 with his birthday that has not been directly asked by the information processing apparatus 2. "Thank you for my birthday?"

  That is, in the example illustrated in FIG. 2, the conversation processing server 1 causes the information processing device 2 to ask the mother about the father's profile, obtains a response from the mother, and enhances the father's profile. Then, the conversation processing server 1 causes the information processing device 2 to output a message to the dad based on the dad's profile.

  Therefore, in the conversation system 100, a user (for example, a father) makes a message from the information processing apparatus 2 that is not directly asked by the information processing apparatus 2, for example, a message related to a profile such as his / her birthday. That is, the conversation processing server 1 causes the information processing apparatus 2 to ask a user (mother) different from the certain user about the profile of a certain user (for example, father). And the conversation processing server 1 registers the profile of the said certain user (for example, father) by carrying out the voice recognition of the reply from said another user (mother). In addition, the conversation processing server 1 performs information processing for the certain user (for example, dad) based on the profile for the certain user (for example, dad) acquired from the other user (for example, mother). The device 2 is made to output a message by voice. Therefore, in the conversation system 100, the user can feel an unexpectedness that could not be felt in the conversation with the robot so far.

  Furthermore, the conversation processing server 1 has an information search function for collecting necessary information via the Internet. As shown in the figure, the conversation processing server 1 can access any information providing server 3 (for example, news distribution server 3A, information retrieval server 3B) connected to the Internet. Although not shown, there may be a large number of information providing servers with which the conversation processing server 1 can communicate with the information providing servers 3C, 3D,.

  In the example shown in FIG. 2, the conversation processing server 1 not only receives the news information automatically distributed by the news distribution server 3A on a regular basis, but also requests information from the information search server 3B to obtain necessary information. Is acquired from the information search server 3B.

  The conversation processing server 1 provides the information obtained from the information providing server 3 such as the news distribution server 3A and the information search server 3B based on the content of the information and the profile of each member of the family. The member to be determined can be determined. That is, the conversation processing server 1 can determine the content of information provided to each member of the family using the profile data while enriching the profile data of the family. For example, when a news such as “Today's professional baseball result bulletin” is acquired from the news distribution server 3A, the conversation processing server 1 refers to the profile data and recognizes that the father's “hobby is baseball”. Dad is decided to offer to. In addition, for example, referring to profile data, if the mother recognizes that “the recent interest is a nearby bargain shop”, the father may decide where to provide information on retail stores or facilities near the house. it can. Furthermore, for example, regarding weather forecast information in which all members of the family have a certain interest in common, all the members of the family may be determined to be provided.

  The conversation processing server 1 can provide each member with information that is likely to be of interest to each member using the profile data.

  In the following, a conversation system 100 that can provide unexpected and high-interest information to a certain user by enriching the user's profile information while asking another user. Will be described in more detail. First, the information processing apparatus 2 included in the conversation system 100 will be described.

(Outline of information processing equipment)
In the present embodiment, the information processing apparatus 2 is, for example, a self-propelled cleaner that automatically cleans the floor. In addition to the cleaning function, the information processing apparatus 2 includes an operation log storage function, a remaining charge detection and output function, an image shooting function, a voice acquisition function, a voice output function, and the like. Further, the information processing apparatus 2 has a function of transmitting a control signal to a home device (not shown) such as an air conditioner (air conditioner), a lighting device, a refrigerator, and a personal computer and operating the control signal.

  As illustrated in FIG. 1, the information processing device 2 includes a control unit 20, a microphone 21, a camera 22, a speaker 23, and an information processing device communication unit 24.

  The microphone 21 acquires sound and converts it into an electric signal. The camera 22 acquires an image and converts it into an electrical signal. The speaker 23 outputs a message notified from the information processing device communication unit 24 to the outside as a voice.

  The control unit 20 can determine whether the sound acquired by the microphone 21 is a human voice, or can determine whether the image acquired by the camera 22 is a human face image. . If the acquired sound or image is a person's voice or face image, the information is notified to the information processing device communication unit 24 as sound information or face image information.

  The information processing device communication unit 24 communicates with the conversation processing server 1. That is, the information processing apparatus 2 transmits face image information and audio information to the conversation processing server 1 via the information processing apparatus communication unit 24 and receives a message from the conversation processing server 1.

  As described above, when the information processing apparatus 2 talks to the user, that is, when the microphone 21 acquires the user's voice, the voice information related to the voice is transmitted to the conversation processing server via the information processing apparatus communication unit 24. 1 to send. Further, when the information processing apparatus 2 meets the user, that is, when the camera 22 acquires the face image of the user, the face processing information about the face image is transmitted to the conversation processing server 1 via the information processing apparatus communication unit 24. Send to. Further, the information processing apparatus 2 receives a message from the conversation processing server 1 via the information processing apparatus communication unit 24 and outputs the message from the speaker 23 as a voice.

  Next, the details of the conversation processing server 1 that generates a message to be output to the information processing apparatus 2 will be described.

(Configuration of conversation processing server)
FIG. 1 is a block diagram illustrating an example of a main configuration of the conversation processing server 1.

  If the outline is organized first, the conversation processing server 1 detects the user authentication unit 103 (user detection means) for detecting any one of the plurality of users, and the user authentication unit 103 detects one of the plurality of users. When the profile items of the users other than the detected user among the plurality of users are unregistered in the storage unit 13 that stores the profile items of the plurality of users in association with the respective users, A message generation unit 106 (message generation unit) that generates a message for asking the user who has detected the profile item, and a message generated by the message generation unit 106 via the information processing device 2 (another device) The first communication unit 11 (question presenting means) to be presented to the detected user, and the detection for the question presented by the first communication unit 11 Comprising the contents obtained based on the user's answer, the profile registration unit 105 for registering in the storage unit 13 as the profile item was the unregistered (profile registration means), a.

  That is, the conversation processing server 1 presents a message asking about another unregistered profile of a user whose profile item is unregistered to another user other than the user, and based on a response from the other user. Thus, the profile item for the user can be registered.

  Therefore, it becomes possible to register a profile item of a certain user based on the viewpoint from another user other than the user. Also, the user's profile item can be acquired without asking the user, for example, a message addressed to the user can be generated based on the user's profile item that is not asking a certain user. it can. Therefore, the user can be surprised by the message to be presented.

  As shown in FIG. 1, the conversation processing server 1 includes a control unit 10, a first communication unit 11, a second communication unit 12, and a storage unit 13.

  The first communication unit 11 is for the conversation processing server 1 to communicate with the information processing device 2.

  The second communication unit 12 is for the conversation processing server 1 to communicate with the external information providing server 3. Specifically, the conversation processing server 1 communicates with the news distribution server 3 </ b> A and the information search server 3 </ b> B via the second communication unit 12.

  The storage unit 13 stores various data used by the conversation processing server 1. The storage unit 13 includes (1) a control program executed by the control unit 10 of the conversation processing server 1, (2) an OS program, (3) an application program for executing various functions, and (4) the application program. Various data to be read when executing are stored. The above data (1) to (4) are, for example, ROM (read only memory), flash memory, EPROM (Erasable Programmable ROM), EEPROM (registered trademark) (Electrically EPROM), HDD (Hard Disc Drive), etc. It is stored in a non-volatile storage device.

  The conversation processing server 1 may include a temporary storage unit (not shown). The temporary storage unit is a so-called working memory that temporarily stores data used for calculation, calculation results, and the like in the course of various processes executed by the conversation processing server 1, and is a volatile storage such as a RAM (Random Access Memory). Consists of devices.

  Which data is to be stored in which storage device is appropriately determined based on the purpose of use, convenience, cost, physical restrictions, and the like of the conversation processing server 1.

  The storage unit 13 stores profile data 132 including a plurality of profile items for each user. As shown in the figure, the storage unit 13 may further store authentication data 131, question scenario data 133, conversation data 134, and the like. Details of these data stored in the storage unit 13 will be described later.

  The control unit 10 controls the functions of the conversation processing server 1 including voice recognition processing, user authentication processing, profile registration processing, message generation processing, and the like. The illustrated control unit 110 includes, as functional blocks, a face information acquisition unit 101, a voice information acquisition unit 102, a user authentication unit 103, a voice recognition unit 104, a profile registration unit 105, a message generation unit 106, and a provision information acquisition unit 107. It is included.

  Each functional block of the control unit 10 described above includes, for example, a storage device (storage unit 12) in which a CPU (central processing unit) or the like is realized by a ROM (read only memory), an NVRAM (non-volatile random access memory), or the like. This can be realized by reading the program stored in the RAM into a RAM (random access memory) (not shown) and executing it.

  Hereinafter, details of each functional block in the control unit 10 will be described.

(Outline of each functional block)
The face information acquisition unit 101 acquires the face image information transmitted by the information processing apparatus 2 via the first communication unit 11 and notifies the user authentication unit 103 of the face image information.

  The voice information acquisition unit 102 acquires the voice information transmitted by the information processing apparatus 2 via the first communication unit 11 and notifies the user authentication unit 103 and the voice recognition unit 104 of the voice information.

  The user authentication unit 103 is a functional block that executes user authentication processing. That is, the user authentication unit 103 is a member who has spoken to or met the information processing apparatus 2 based on at least one of audio information notified from the audio information acquisition unit 102 and face image information notified from the face information acquisition unit 101. Identify who the person is. Further, the message generation unit 106 is notified of the specified result or the result that the specified result could not be specified.

  Specifically, when at least one of voice information from the voice information acquisition unit 102 and face image information from the face information acquisition unit 101 is acquired, the authentication data 131 in the storage unit 13 is referred to. Then, the user authentication unit 103 compares at least one of the audio information acquired from the audio information acquisition unit 102 and the face image information from the face information acquisition unit 101 with the authentication data 131 in the storage unit 13.

  Here, the voice print and face image information of each member is stored in the storage unit 13 as authentication data 131 in association with the family ID for identifying each member.

  When the authentication data 131 includes a voiceprint that matches the voiceprint of the voice information acquired from the voice information acquisition unit 102, the user authentication unit 103 acquires a family ID associated with the voiceprint. When the authentication data 131 includes face image information that matches the face image information acquired from the face information acquisition unit 101, the user authentication unit 103 sets the family ID associated with the face image information. get. In this way, the user authentication unit 103 acquires the family ID of the member who has spoken to or met the information processing apparatus 2 based on the notified voice information and face image information. Then, the user authentication unit 103 notifies the message generation unit 106 of the acquired family ID.

  When the notified voice information and face image information do not match the voice information and face image information of the members already registered in the authentication data 131, the user authentication unit 103 notifies the message generation unit 106 of the determination result. To do. In addition, the user authentication unit 103 associates the voice print information included in the voice information notified from the voice information acquisition unit 102 and the face image information notified from the face information acquisition unit 101 with the newly added family ID, Stored in the authentication data 131.

  For example, when only voice print information and face image information of a user whose family ID is 1 is registered in the authentication data 131, the voice print information and face image information are notified from the voice information acquisition unit 102 and the face information acquisition unit 101. Then, the user authentication unit 103 performs the following process. In other words, the user authentication unit 103 first refers to the authentication data 131 and determines whether there is voice print information and face image information that matches the notified voice print information and face image information. When the matching voiceprint information and face image information are stored in the authentication data 131, the user authentication unit 103 acquires the family ID associated with the voiceprint information and face image information, and sends the family ID as a message. Notify the generation unit 106. When the matching voiceprint information and face image information are not stored in the authentication data 131, the user authentication unit 103 uses the voiceprint information and face image information notified from the voice information acquisition unit 102 and the face information acquisition unit 101 as “ It is stored in authentication data 131 in association with “family ID: 2”. In addition, the user authentication unit 103 informs the message generation unit 106 that the member who has acquired the voiceprint information and the face image information this time is a member that has not been registered in the authentication data 131 and the family ID of the member is 2 is notified.

  The voice recognition unit 104 is a functional block that executes voice recognition processing. That is, the voice recognition unit 104 performs voice recognition processing on the voice information acquired from the voice information acquisition unit 102 and notifies the profile registration unit 105 and the message generation unit 106 of the processing result. Note that the voice recognition process itself can be performed using conventional technology, and thus the description thereof is omitted.

  The profile registration unit 105 is a functional block that executes profile registration processing. That is, the profile registration unit 105 registers the profile of each member as the profile data 132 in the storage unit 13 based on the result of the voice recognition process performed by the voice recognition unit 104. The profile data 132 will be described in detail later, but for each member (more precisely, for each family ID), there are a plurality of profiles such as name, role at home, age, birthday, hobby, favorite food. This is information for registering profile items.

  For example, the voice recognition unit 104 performs voice recognition processing on the voice information acquired from the voice information acquisition unit 102, and the voice information is “Dad's birthday is June 10”. If determined, the following processing is further executed. That is, the voice recognition unit 104 first notifies the profile registration unit 105 of the processing result “Dad's birthday is June 10th”. Further, the profile registration unit 105 receives this notification from the voice recognition unit 104 and registers “June 10” in the “birthday” column of “dad” in the profile data 132.

  The message generation unit 106 is a functional block that executes message generation processing. That is, the message generation unit 106 generates a message to be output to the information processing apparatus 2 based on the question scenario data 133 and outputs the message to the first communication unit 11.

  Here, although details will be described later, in the question scenario data 133, a message generated by the message generation unit 106 and a condition for generating the message are stored in association with each other.

  The message generation unit 106 generates a message while referring to the profile data 132 based on the question generation rule defined by the question scenario data 133. For example, if a certain profile item of a member is not registered in the profile data 132 in which the profile item for each member is stored, the message generation unit 106 generates a message asking about the profile item of the member. Can do. Specifically, in the profile data 132, when the profile item “birthday” of the father whose family ID is “1” is not registered, “when is your father's birthday” or “your birthday” "When is it?"

  As described above, the message generation unit 106 is notified of the family ID from the user authentication unit 103, that is, the information processing device 2 is spoken or notified of the member who has met. Therefore, the expression of the question can be controlled according to the member who the information processing apparatus 2 talks to. For example, when the information processing apparatus 2 is talked or met by a member other than the father, a message “When is the father's birthday?” Can be generated as a question asking about the father's birthday. When the information processing apparatus 2 is spoken or met by a father, a message “When is your birthday?” Can be generated as a question asking about the father's birthday.

  Although details will be described later, the message generation unit 106 executes the above-described control relating to the expression of the question depending on whether the “questionee” of the question scenario data 133 is “person” or “non-person”. can do. The message generation unit 106 determines the content of the message to be generated according to the “member who talks to the question” and “who is the question about the profile item” according to the “question target” of the question scenario data 133. That is, the expression of the question can be controlled.

  In addition, the message generation unit 106 notifies the information stored as the profile item of each member in the profile data 132 to the provided information acquisition unit 107 as a search word. Although details will be described later, the provided information acquisition unit 107 acquires information related to the search word from the information search server 3B based on the search word notified from the message generation unit 106, and outputs the information to the message generation unit 106 To do.

  Further, the message generator 106 generates a message based on each profile item of each member in the profile data 132. For example, referring to the profile data 132 and confirming that “June 10” is registered in the “birthday” field of the father whose family ID is “1”, the message generator 106: Execute the process. That is, the message generation unit 106 generates “Dad, Happy Birthday!” As a message to be output as a voice when the information processing apparatus 2 talks to or meets the father on June 10.

  In addition, when the message generation unit 106 is notified of the information acquired by the provision information acquisition unit 107 from the external information provision server 3 via the second communication unit 12 from the provision information acquisition unit 107, the message generation unit 106 receives the information. Such a message is generated. For example, when the distribution information acquisition unit 107 acquires distribution news such as breaking news such as “Today's professional baseball results (drawn with Tigers, Dragons)” automatically distributed from the news distribution server 3A, the information generation unit 107 obtains this information as a message generation unit. 106 is notified. Based on the information notified from the provision information acquisition unit 107, the message generation unit 106 generates a message “Today, Tigers has drawn with Dragons!”.

  The message generation unit 106 can determine the destination of the message “Today, Tigers has drawn with Dragons!” Based on each profile item of each member in the profile data 132. For example, referring to the profile data 132, if it is confirmed that “professional baseball game” is registered in the “hobby 2” field of the father whose family ID is “1”, the message generating unit 106 The destination of the message about the baseball result is determined to be “dad”. Therefore, for example, the message generation unit 106 utters a message “Today, Tigers has drawn with Dragons!” To the information processing device 2 only when the information processing device 2 is talked to or met by a father. Can be made.

  Further, the message generator 106 can generate a standard response message in response to a standard message from a member. For example, although not shown, a typical message from a member and a typical response message to the message may be associated with each other and stored in the storage unit 13 as typical conversation data. In the above-mentioned standard conversation data, a greeting message “Good morning” from a member is associated with a response message “Good morning”. In addition, a response message such as “I understand” or “I understand!” Is associated with the message “Yes” when a member requests the information processing apparatus 2 to process something. By referring to the above-mentioned standard conversation data, the message generator 106 can prompt the information processing apparatus 2 to provide a standard response to a standard message from a member.

  Note that the message generation unit 106 operates the information processing apparatus 2 so that the information processing apparatus 2 continues to move in the house, as well as a message that causes the information processing apparatus 2 to output the voice. It is also possible to transmit an instruction command related to

  If the functions of the message generation unit 106 are organized again, it will be as follows. That is, the message generation unit 106 generates a message based on the question scenario data 133 and the like. Then, the generated message is transmitted to the information processing device 2 via the first communication unit 11, and the information processing device 2 outputs the message by voice.

  For example, the message generation unit 106 can cause the information processing apparatus 2 to speak a question for confirming an unregistered profile item in the profile data 132. Furthermore, the message generation unit 106 can grasp who the information processing apparatus 2 talks to or meets with the notification from the user authentication unit 103. Therefore, the message generator 106 can cause the information processing apparatus 2 to ask a question about the profile item of a certain member to the member himself / herself or ask a member other than the member to ask a question. You can change the expression of the question according to the person you want to ask.

  Furthermore, the message generation unit 106 can cause the information processing apparatus 2 to speak a topic corresponding to each member based on the information stored in the profile data 132. That is, based on the information “Dad's birthday is June 10th” stored in the profile data 132, “Dad, Happy Birthday!” The information processing apparatus 2 can speak. In addition, based on the information “the father's hobby is watching a baseball game” stored in the profile data 132, a message regarding a professional baseball result bulletin that is likely to be of interest to the father is sent to the father. The processing apparatus 2 can speak.

  Note that the above functions by the message generation unit 106 may be realized by the user setting unit 106a, the blank space detection unit 106b, and the message determination unit 106c included in the message generation unit 106. That is, although details will be described later, the user setting unit 106 a generates a message asking about the number of members registered in the profile data 132 and the authentication data 131 with reference to the question scenario data 133. Also, the blank space detection unit 106b refers to the profile data 132, detects an unregistered profile item and a member (family ID) associated with the unregistered profile item, and sends the detection result to the message determination unit 106c. Notify Further, the message determination unit 106c should generate the message scenario data by referring to the question scenario data 133 based on the unregistered profile item notified from the blank space detection unit 106b and the family ID associated with the unregistered profile item. Determine the message.

  The provided information acquisition unit 107 acquires information from the external information providing server 3 via the second communication unit 12 and notifies the message generation unit 106 of the information.

  Specifically, the provided information acquisition unit 107 acquires news distributed from the news distribution server 3A, and notifies the message generation unit 106 of the news.

  The provided information acquisition unit 107 acquires information related to the search word from the information search server 3B based on the search word notified from the message generation unit 106. Specifically, the provided information acquisition unit 107 requests the information search server 3B to output a search result based on the search word, and the search result output by the information search server 3B in response to the request is provided as the provided information. Get as.

  Next, details of various data stored in the storage unit 13 will be described.

(About information stored in the storage unit)
As described above, the storage unit 13 stores profile data 132 including a plurality of profile items for each user. 2, the storage unit 13 may further store authentication data 131, question scenario data 133, conversation data 134, and the like.

  FIG. 5 is a diagram illustrating a data structure and a specific example of the authentication data 131 held by the conversation processing server 1 for authenticating each user.

  The authentication data 131 stores the face information and voiceprint information of each member for each family ID for identifying each member.

  FIG. 4 is a diagram showing a data structure and a specific example of profile data 132 including a plurality of profile items for each family member. Specifically, the profile data 132 stores, for each family ID, a plurality of profile items such as name, role in the home, age, birthday, hobby, favorite food, and the like. In other words, the profile items of family members are stored in the storage unit 13 as profile data 132 in association with each member.

  In the profile data 132, the content and number of profile items can be changed. That is, FIG. 4 shows profile data 132 in which six profile items such as name, role in the home, age, birthday, hobby 1 and hobby 2 can be registered for each family ID. However, in the profile data 132, for example, the profile item “hobby 2” can be changed to “favorite food”. Further, while maintaining the six profile items, a profile item “favorite food” can be added to increase the total number of profile items in the profile data 132 to seven.

  The family ID in the authentication data 131 and the family ID in the profile data 132 correspond to each other, and the same family ID indicates the same member in the authentication data 131 and the profile data 132. Specifically, in both the authentication data 131 and the profile data 132, the member with the family ID “1” is “Ichiro” who is “dad”, and the member with the family ID “2” It is “Kazuko” who is “Mom”.

  FIG. 3 is a diagram illustrating a data structure and a specific example of the question scenario data 133. The question scenario data 133 is information about the combination of the contents of the question and the conditions under which the question is generated for the question generated by the conversation processing server 1, that is, the question generation rules are organized. For example, the message generation unit 106 generates a message while referring to the profile data 132 based on the question generation rule defined by the question scenario data 133. Specifically, when there is an unregistered profile item for a certain member in the profile data 132, the message generator 106 generates a question message for the unregistered profile item based on the question scenario data 133. To do.

  In the question scenario data 133 of FIG. 3, the column “Question Item” indicates an outline of the question “What is the question?”, And basically corresponds to the profile item in the profile data 132. For example, when a profile item “birthday” of a certain member is not registered, the birthday of the member based on the question generation rule stored in “question item: birthday” of the question scenario data 133 A message is generated asking. However, “question item: the number of family members” does not correspond to each profile item in the profile data 132, but when generating a question about the total number of members (family ID) to be registered in the profile data 132 It is a question generation rule. Although details will be described later, it is possible to ask questions efficiently by grasping the total number of family members who will construct profiles at an earlier stage than asking questions about each profile item of each member. It becomes.

  The column “Questionee” indicates “who the information processing device 2 asks the question”, that is, “who the information processing device 2 talked to or met” ing. Note that “person” in the column “Question Target” indicates that “the information processing apparatus 2 is the person who asks a question about a profile item of a certain member”. Yes. Further, “other than the person” indicates that “the information processing apparatus 2 is a member other than the certain member who asks a question about the profile item of the certain member”. That is, for example, when the information processing apparatus 2 is asked to ask the father about his father's name, age, birthday, etc., the “questionee” is the “person”. Further, when the information processing apparatus 2 asks a member other than the father a question about the father's birthday, the “question target” is “other than the person himself / herself”.

  The column “Question timing” indicates “Timing to cause the information processing apparatus 2 to ask a question”, that is, “Condition to cause the information processing apparatus 2 to ask a question”.

  The column “Question Phrase” indicates “the message that the information processing apparatus 2 speaks” itself. Note that “**” in the column of “Question Phrase” indicates “name of member having a profile item for which data is not registered” or “in-home role” such as father, mother, child in the profile data 132. It is.

  For example, in the profile data 132, when the “birthday” of the father whose family ID is “1” is not registered, the message generator 106 is based on the “question item: birthday” row of the question scenario data 133. The following message can be generated. That is, when the information processing apparatus 2 is talked to or meets with a father, that is, “questionee: the person”, a message “Which is your birthday?” Generated. In addition, when the information processing apparatus 2 is talked to or met with a member other than the dad, that is, the “questionee: other than the person himself”, “By the way, if the father ’s birthday is Is generated.

  Note that the data structure of the question scenario data 133 is not limited to that shown in FIG. 3, and may be any information as long as the contents of the question generated by the message generation unit 106 are associated with the conditions for generating the question. .

  FIG. 18 is a diagram illustrating a data structure and a specific example of the conversation data 134. Conversation data 134 is information about a combination of the content of the message, conditions for generating the message, and the like for a message generated by conversation processing server 1 (specifically, message generation unit 106).

  For example, when it is December 25, that is, when “speaking condition: December 25” is satisfied, the information processing apparatus 2 is talked to or met by an arbitrary member of the family, and the conversation processing server 1 causes the information processing apparatus 2 to say "Merry Christmas!"

  Here, “second category: voluntary information provision” of “first category: information provision” includes combinations of the following two types of messages and the generation conditions of the messages.

  One is a combination of a message generated by the conversation processing server 1 and a generation condition when the conversation processing server 1 acquires news information from the news distribution server 3A. For example, when the conversation processing server 1 receives a professional baseball bulletin from the news distribution server 3A, the information processing apparatus 2 processes information processing when a “professional baseball game” is spoken or met by a hobby father. It shows that the apparatus 2 speaks about the bulletin.

  One is a message generated by the conversation processing server 1 when a search result based on information stored in a certain profile item of a certain member in the profile data 132 is acquired from the information search server 3B, and a generation Combinations with conditions are shown. For example, when the information processing apparatus 2 talks to or meets the father, the information processing apparatus 2 speaks about the search result for “okonomiyaki” that is the “favorite food” of the father.

  Although not shown, the storage unit 13 may further store data for determining the priority order of the content of the message generated by the message generation unit 106.

  For example, when the information processing apparatus 2 talks to or meets a certain member A (for example, a mother) and there is an unregistered profile item in a member B (for example, a father) other than the member A, The conversation processing server 1 causes the information processing apparatus 2 to preferentially ask questions about the unregistered profile items of the member B. When there is no member with an unregistered profile item other than the member A, the member A is asked a question about the unregistered profile item. Furthermore, it is desirable that when all profile items are registered for all members, it is preferable to make a remark based on already registered profile items, rather than questions about profile items.

  Furthermore, it is desirable that not only “who asks questions about who's profile item” but also the contents of the questions are stored with data for determining priority. For example, as will be described in detail later, the conversation processing server 1 causes the information processing apparatus 2 to first ask the “total number of families to which the member belongs”, then ask the “name of each member”, and finally “ It is desirable to ask the member a profile item other than the name.

(Outline of processing)
When the conversation processing server 1 causes the information processing device 2 to ask each family member a question, that is, the message generation unit 106 transmits a message to the information processing device 2 via the first communication unit 11. In principle, there are the following two timings.

  First, when the information processing apparatus 2 is talked to by a family member. At this time, the conversation processing server 1 makes the information processing apparatus 2 make a question after making the member respond to the content of the conversation. That is, when the information processing device 2 is spoken by a family member, at least one of the voice information and the face image information of the member is transmitted to the conversation processing server 1. The conversation processing server 1 authenticates the member based on at least one of the voice information and the face image information received from the information processing device 2, generates a message corresponding to the member, and sends the message to the information processing device 2. The information processing apparatus 2 outputs the message by voice.

  Second, each time the information processing device 2 meets a family member, the conversation processing server 1 causes the information processing device 2 to speak to the member. That is, when the information processing apparatus 2 meets a family member while moving in the house, at least one of the voice information and face image information of the member is transmitted to the conversation processing server 1. The conversation processing server 1 authenticates the member based on at least one of the voice information and the face image information received from the information processing device 2, generates a message corresponding to the member, and sends the message to the information processing device 2. The information processing apparatus 2 outputs the message by voice.

  Accordingly, in the following description, “question timing” refers to the timing at which the information processing apparatus 2 talks to a family member or meets a family member. Further, “detecting the timing of the question” means that the information processing device 2 outputs to the conversation processing server 1 the face image information and voice information of members who talk to or meet the information processing device 2, and the conversation processing server 1 1 means that the face image information and the voice information are received.

  FIG. 6 is a flowchart showing an outline of processing in which the conversation processing server 1 constructs a family profile. As shown in FIG. 6, the conversation processing server 1 first performs a family number registration process in step 100 (hereinafter abbreviated as S100), then performs a family name registration process (S200), and finally, Family profile registration processing (S300) is performed.

  The conversation processing server 1 grasps the total number of members to register profile items at an early stage, and thereafter causes the information processing device 2 to efficiently ask the profile items of all members of the family. It is possible to go. For example, if it is possible to grasp that the total number of family members is 6 in the state where the family ID and name of two persons, father and mother, have already been registered, the remaining 4 members are required to register the family ID and name. It can be estimated that it is a person. Therefore, for example, after confirming the total number of family members, the conversation processing server 1 makes the information processing device 2 ask the question “What are the names of the remaining four people?” So that all the members of the family can be efficiently It will be possible to build a profile.

  On the other hand, if you don't know the total number of family members, you can't ask questions like "What are the names of the remaining four?" Furthermore, confirmation of whether or not the family IDs of all the family members have been registered is delayed or cannot be made, and the profile of the whole family cannot be constructed efficiently.

  Further, by acquiring the profile items other than the name after listening to the name, the user can feel the conversation with the information processing apparatus 2 natural. For example, when the information processing device 2 asks the mother about the child's hobbies, he / she first asks “What is the child's name?” After confirming the child's name, for example, if the child's name is Taro, it is natural to ask "What is Taro's hobby?" Therefore, after the conversation processing server 1 can register each member's name, the conversation processing server 1 asks the information processing apparatus 2 to ask questions about profile items other than the name of the member who can register the name. It becomes possible to make it natural.

  However, the order of this processing from S100 to S300 is not essential, and merely shows a general flow of processing. For example, as will be described later with reference to FIG. 10 or the like, when the information processing apparatus 2 is first placed in the home and is spoken or met by a family member for the first time, first, the member's number of members is not registered. It is desirable to ask for a name. This is because it is unnatural to ask a member who has been talked to or met for the first time about the total number of family members. Until the number of family IDs stored in the authentication data 131 and the profile data 132 reaches a certain number (for example, 2), a rule that the family name registration process is performed instead of the family number registration process is stored in the storage unit 13. It may be stored. Then, the message generation unit 106 may generate a question according to this rule stored in the storage unit 13.

  FIG. 7 is a flowchart showing the flow of the family number registration process.

  First, the conversation processing server 1 detects the timing of a question (S101). That is, the information processing device 2 transmits the voice information and face image information of the member who is spoken or met to the conversation processing server 1 via the information processing device communication unit 24, and the conversation processing server 1 transmits the voice information. And the face image information is received.

  Specifically, the conversation processing server 1 refers to the question scenario data 133, and the message generation unit 106 acquires a question that matches the timing of the question (S102). That is, the message generation unit 106 is registered in the “question item: number of family members” row of the question scenario data 133 and generates a question according to the question generation rule. Specifically, the message generation unit 106 generates a message “Where is your family?” And transmits the message to the information processing apparatus 2 via the first communication unit 11.

  The information processing apparatus 2 receives the message from the conversation processing server 1 and outputs a voice message from the speaker 23, “By the way (if any), how many families are there?” (S103). In response to the question from the information processing apparatus 2, the member responds, for example, “I am a family of six”.

  The information processing apparatus 2 acquires the answer (answer by voice) from the member (S104). Then, the information processing device 2 transmits voice information related to the voice to the conversation processing server 1 via the information processing device communication unit 24.

  The conversation processing server 1 executes speech recognition processing on the speech information related to the answer from the member received from the information processing device 2 (S105). Specifically, the voice recognition unit 104 performs voice recognition processing on the voice information.

  When the speech recognition process by the speech recognition unit 104 is successful (Yes in S106), the speech recognition unit 104 notifies the processing result, that is, the content of a statement such as “Family of 6” to the profile registration unit 105. . The profile registration unit 105 registers family IDs for the number of people in the profile data 132 based on the processing result notified from the voice recognition unit 104 (S107).

  When the voice recognition process by the voice recognition unit 104 fails (No in S106), the conversation processing server 1 again detects the timing of the question, that is, the situation where the information processing apparatus 2 is spoken or met by the members. (S101).

  It is desirable to perform the family composition registration process in parallel with the family number registration process. In other words, questions about the roles of “Dad”, “Mom”, “Children”, “Grandpa”, “Grandma” in the home of each member, and the profile item “Domestic role” of each member as much as possible It is desirable to obtain it at an early stage. For example, even in a situation where the name of a certain member is not known, if “home role” is known, for example, “What is the name of“ child ”?” This is because the profile item of the member can be questioned.

  In the family composition registration process, for example, “I am a new information processing device 2 that came to my house. I want you to tell me about the family that lives together.” It is only necessary to collect information related to the family structure, such as “home role”. In addition, for example, from the remarks such as “I am a mom's Kazuko” and “I am a daddy ’s Ichiro”, not only the “in-home role” (mom and dad) of the member who made the remarks, It may be determined that “it is a family structure with children”.

  FIG. 8 is a flowchart showing the flow of the family name registration process.

  First, the conversation processing server 1 detects the timing of a question (S201). That is, the information processing device 2 transmits the voice information and face image information of the member who is spoken or met to the conversation processing server 1 via the information processing device communication unit 24, and the conversation processing server 1 transmits the voice information. And the face image information is received.

  The user authentication unit 103 of the conversation processing server 1 refers to the authentication data 131 and executes user authentication processing using the voice print information and face image information included in the voice information (S202). That is, the user authentication unit 103 registers voice print information and face image information that match the voice print information and face image information included in the voice information received by the conversation processing server 1 from the information processing apparatus 2 in the authentication data 131. Make sure that When there is matching voice print information and face image information, the user authentication unit 103 acquires the family ID associated with the voice print information and face image information from the authentication data 131 and notifies the message generation unit 106 of the family ID. To do. If there is no matching voiceprint information and face image information, the user authentication unit 103 is a member who has not met the voiceprint information and face image information, that is, the information processing apparatus 2 has been spoken for the first time or met for the first time. This is notified to the message generator 106.

  When the result of the user authentication process is notified from the user authentication unit 103, the message generation unit 106 acquires a question that matches the timing of the question based on the question scenario data 133 (S203).

  When the family ID already registered in the authentication data 131 is notified from the user authentication unit 103, the message generation unit 106 first refers to the profile data 132 and notifies the family ID notified from the user authentication unit 103. Other than the above, the home role column of the member whose “name” column is not registered even though the family ID is registered in the profile data 132 is acquired. Next, the message generation unit 106 is registered in the “question item: family name” of the question scenario data 133 and is registered in the line “question target: other than the person” and generates a question according to the question generation rule. . For example, when the family ID notified from the user authentication unit 103 is 2, when the family ID is 3 and the “name” of the member whose home role is a child is not registered in the profile data 132, The message generation unit 106 generates the following message. In other words, a question is generated, “By the way, what is your child's name?”. Then, the message generator 106 transmits the message to the information processing device 2.

  When the user authentication unit 103 notifies that the member who the information processing apparatus 2 talks to or meets is the member who talked for the first time or met for the first time, the message generation unit 106 executes the following processing. That is, the message generation unit 106 generates a question in accordance with the question generation rule registered in the “question item: family name” of the question scenario data 133 and registered in the “question target person: principal” line. In other words, it generates the message "Why is your name?"

  As described above, the message generation unit 106 generates a message that matches the timing of the question based on the question scenario data 133 and transmits the message to the information processing apparatus 2.

  The information processing apparatus 2 receives the message from the conversation processing server 1 and utters the question (S204). In response to the question from the information processing apparatus 2, the member answers the name of the member whose name is heard. The information processing apparatus 2 acquires the answer (answer by voice) from the member (S205). Then, the information processing device 2 transmits voice information related to the voice to the conversation processing server 1 via the information processing device communication unit 24. The conversation processing server 1 performs voice recognition processing on the voice information related to the answer from the member received from the information processing apparatus 2 (S206).

  When the voice recognition process by the voice recognition unit 104 is successful (Yes in S207), the voice recognition unit 104 notifies the processing result to the profile registration unit 105. The profile registration unit 105 registers the name of the member who heard the name in the profile data 132 based on the processing result notified from the voice recognition unit 104. (S208).

  If the voice recognition process fails (No in S207), the conversation processing server 1 again detects the timing of the question, that is, confirms whether the information processing apparatus 2 is spoken or met by a member. (S201).

  In the user authentication process of S202, when the member who the information processing apparatus 2 talks to or meets is the first member, the user authentication unit 103 stores the voice print information and face image information of the member in the authentication data 131. Register (S209).

  Note that the “registration of the first member's voice print information and face image information to the authentication data 131” by the user authentication unit 103 in S209 does not have to be executed after S208. For example, in S202, after the user authentication process, a process of “registration of voiceprint information and face image information of a new member to the authentication data 131” may be performed. That is, the user authentication unit 103 does not register voice print information and face image information that match the voice print information and face image information included in the voice information acquired by the conversation processing server 1 from the information processing apparatus 2 in the authentication data 131. After confirming the above, the following judgment is made. That is, it is determined that the member who the information processing apparatus 2 talks to or meets is the member who talked for the first time or met for the first time. The user authentication unit 103 notifies the message generation unit 106 of the determination result. Further, the user authenticating unit 103 associates the voice print information and the face image information included in the voice information acquired from the information processing apparatus 2 by the conversation processing server 1 and not registered in the authentication data 131 with the new family ID. And registered in the authentication data 131.

  In the above description, when the message generation unit 106 is notified of the registered family ID from the user authentication unit 103 to the authentication data 131 in S203, the message generation unit 106 corresponds to a family ID other than the registered family ID. Suppose you want to generate a message asking for a member's name. That is, in S203, when the conversation processing server 1 “the information processing apparatus 2 talks to or meets a member whose family ID has already been registered in the conversation processing server 1”, the conversation processing server 1 sets the names of members other than the member. It explained that it generates a message to ask a question. For example, when the information processing apparatus 2 talks to a mother whose family ID has already been registered in the conversation processing server 1, the conversation processing server 1 generates the following message. That is, a message for asking the name of a member who is a member other than the mother and whose family name is registered in the profile data 132 but whose “name” field is not registered is generated.

  However, in S203, the conversation processing server 1 determines that the name of the member is unknown when “the information processing apparatus 2 talks to or meets a member whose family ID has already been registered in the conversation processing server 1”. If this happens, a message asking the member himself about the name of the member may be generated. For example, a mother has already heard that there are two children, and has already spoken with these two children, and the family ID, voiceprint information, and face image information of the two children have already been registered It is. However, for some reason, the names of these two children have not yet been registered. Under such circumstances, when the information processing device 2 is talked to by these two children, the conversation processing server 1 generates a message “Please tell me your name” and the information processing device 2 The message may be output by voice to the two children.

  FIG. 9 is a flowchart showing the flow of the family profile registration process.

  First, the conversation processing server 1 detects the timing of a question (S301). That is, the information processing apparatus 2 transmits the voice information and face image information of the member who talked or met to the conversation processing server 1, and the conversation processing server 1 receives the voice information and face image information.

  The conversation processing server 1 executes user authentication processing based on the voice information and face image information received from the information processing apparatus 2. The conversation processing server 1 further generates a question in accordance with the question generation rule defined in the “person” of the “questionee” of the question scenario data 133, or is defined in the “non-person” row. It is determined whether to generate a question according to the question generation rule (S302). That is, the question to be output to the information processing apparatus 2 is a question related to the profile item of the member to which the information processing apparatus 2 is spoken or met in S301, or a question related to the profile item of a member other than the member. To decide.

  For example, as described above, if there is an unregistered profile item for a member other than the principal, the priority is given to the question about the unregistered profile item of the member other than the principal. ”. By acquiring a profile item of a certain member from a member other than the certain member, it becomes possible to construct a profile for the certain member based on various viewpoints. Further, for example, “do not ask children about profile items other than names” may be used. This method is particularly effective when, for example, the child is still young and the credibility of information acquired from the child is low. Furthermore, “if the information processing apparatus 2 speaks or meets a plurality of times from the same member within a predetermined time (for example, 30 minutes), the second and subsequent times ask questions about the profile of the member itself” It may be. This is because if you ask questions about people other than yourself, you may feel disregarded and feel uncomfortable. These methods may be stored in the storage unit 13 as data.

  Based on the method exemplified above, in S302, the message generation unit 106 determines which of the question generation rules defined in “Question target person: principal” or “Question target person: non-person” in the question scenario data 133. To determine whether to generate a question.

  When the message generation unit 106 determines to generate a question in accordance with the question generation rule defined in the “Principal” line of “Question Target” in the question scenario data 133 (Yes in S302), the message generation unit 106 Performs the following processing.

  In addition, if it is confirmed again just in case, the question generation rule in the case of “questionee: person” is that the member himself / herself has not been registered with respect to the member to which the information processing apparatus 2 is spoken or met. It is a question generation rule applied when generating a question about a profile item. Further, the question generation rule in the case of “questionee: other than the person” is to generate a question regarding unregistered profile items of members other than the member with respect to the member to which the information processing apparatus 2 has spoken or met. It is a question generation rule applied at the time. For example, when a question about the father's birthday is given to the father, the question is generated in accordance with the question generation rule in the case of “questionee: person”. Further, when asking the mother about the father's birthday, the question is generated according to the question generation rule in the case of “question target: other than the person himself / herself”.

  In the case of Yes in S302, the message generation unit 106 first acquires the family ID of the above-mentioned person, that is, the member who the information processing apparatus 2 talked to or met in S301 from the user authentication unit 103 (S303). .

  Next, the message generator 106 searches the profile data 132 for a field item that does not contain data, that is, a profile item in which no data is registered, with the family ID of the person (S304).

  In the profile data 132, when there is an unregistered profile item in the person's family ID (Yes in S 305), the message generator 106 acquires a question regarding the person's unregistered profile item from the question scenario data 133. (S306). That is, the message generation unit 106 generates a question message related to the unregistered profile item according to the question generation rule defined in the “question target person: principal” row of the question scenario data 133. Then, the message generation unit 106 transmits the generated message to the information processing device 2. Thereafter, the process proceeds to S307, which will be described later.

  If there is no unregistered profile item in the family ID of the person in the profile data 132 (No in S305), the process proceeds to S312. S312 will be described later.

  When the message generation unit 106 generates a question in accordance with the question generation rule defined in the “non-person” row of “question target” of the question scenario data 133 (No in S302), the message generation unit 106 executes the following processing.

  The message generation unit 106 acquires the family ID of a member other than the person himself (the member to whom the information processing apparatus 2 is spoken or met in S301) (S312). That is, the message generation unit 106 first obtains the family ID of the person from the user authentication unit 103. Then, among the family IDs registered in the profile data 132 or the authentication data 131, a family ID other than the family ID of the person is acquired.

  Next, the message generation unit 106 searches the profile data 132 for a field item that does not contain data, that is, a profile item in which data is not registered, with the family ID of the member other than the person (S313). .

  If there is an unregistered profile item in the family ID of the member other than the person in the profile data 132 (Yes in S314), the message generation unit 106 is associated with the family ID of the member other than the person “ "Name" is acquired (S315).

  Here, for example, when a plurality of profile items are unregistered for each of a plurality of members, the family ID and name of any one member among them and any of the unregistered profile items of the members What is necessary is just to acquire the name of one profile item. For example, “age” and “birthday” for “mom”, “birthday” and “hobby” for “dad”, “age”, “birthday” and “hobby” for “grandpa” are not registered , The profile data 132 may acquire any of the following. That is, the profile data 132 may acquire the mother's family ID, name, and profile item name such as age or birthday. Further, the profile data 132 may acquire a father's family ID, name, and profile item name such as birthday or hobby. Further, the profile data 132 may acquire the grandfather's family ID, name, and profile item name of any age, birthday, or hobby.

  If there is no unregistered profile item in the family ID of the member other than the person in the profile data 132 (No in S314), the message generating unit 106 ends the family profile registration process. This is because there are no unregistered profile items in the profile data 132.

  Subsequent to S315, the message generator 106 further acquires a question regarding unregistered profile items of members other than the person from the question scenario data 133 (S316). That is, the message generation unit 106 generates a question message related to the unregistered profile item according to the question generation rule defined in the “question target: non-person” line of the question scenario data 133. Then, the message generation unit 106 transmits the generated message to the information processing device 2. Thereafter, the process proceeds to S307.

  The information processing apparatus 2 receives the message transmitted from the conversation processing server 1 in S306 or S316, and executes voice output of the message (S307). In response to this voice output from the information processing apparatus 2, the member responds by voice.

  The information processing apparatus 2 acquires the answer (answer by voice) from the member (S308) and transmits the voice information related to the answer to the conversation processing server 1.

  The conversation processing server 1 performs voice recognition processing on the voice information received from the information processing apparatus 2 and related to the answer from the member (S309).

  When the voice recognition process is successful (Yes in S310), the voice recognition unit 104 notifies the profile registration unit 105 of the processing result of the voice recognition process. The profile registration unit 105 registers the profile data 132 based on the processing result notified from the voice recognition unit 104 (S311).

  If the speech recognition process fails (No in S310), the conversation processing server 1 again detects the timing of the question, that is, confirms whether the information processing apparatus 2 is spoken or met by a member. (S301).

  As described above, the user setting unit 106a included in the message generation unit 106 may particularly perform the above-mentioned family number registration process. That is, the user setting unit 106 a may generate a message asking about the number of members registered in the profile data 132 and the authentication data 131 with reference to the question scenario data 133. The family number registration process is not a process for generating a question about an unregistered profile item in the profile data 132, but asks the number of members registered in the profile data 132 and the authentication data 131, and registers the number. It is processing. That is, the family number registration process “detects an unregistered profile item and a family ID associated with the profile item by referring to the profile data 132” and “question scenario data 133 based on the profile item and the family ID. And the process of “determining the message to be generated”. Therefore, the family number registration process may be executed by the user setting unit 106a. In addition, the blank detecting unit 106b may execute the process of “detecting an unregistered profile item and a family ID associated with the profile item with reference to the profile data 132”. The message determination unit 106c may execute the process of “determining a message to be generated by referring to the question scenario data 133 based on the detection result of the blank space detection unit 106b”.

  In summary, the control method of the conversation processing server 1 detects one of the plurality of users in the user detection step (S202, S302) for detecting any one of the plurality of users and the user detection step. When the plurality of users are detected in the storage unit 13 (more precisely, the profile data 132 of the storage unit 13) that stores the profile items of the plurality of users in association with the respective users. When a profile item of a user other than the user is unregistered, a message generation step (S203, S306 and S316) for generating a message asking the user who has detected the profile item, and a message generated in the message generation step To the detected user from your device or via other devices. The contents obtained based on the detected user's answer to the question presented in the question presenting step (S204, S307) and the question presented in the question presenting step are registered in the storage unit as the unregistered profile item. And a profile registration step (S208, S311).

(Specific example of building a family profile while talking to users)
Hereinafter, a specific case in which the conversation processing server 1 constructs a family profile while allowing the information processing apparatus 2 to have a conversation with a member will be described with reference to FIGS. For clarity and simplification of the drawings, the processing in the conversation processing server 1 is omitted in FIGS. 10 to 17, and the functions realized in the information processing apparatus 2 by the processing in the conversation processing server 1 and the information processing The explanation is focused on the conversation between the device 2 and the members.

  FIG. 10 shows a conversation between the information processing apparatus 2 and the member (mother) when a family member (“mother” in the example of FIG. 10) speaks to the information processing apparatus 2 for the first time in the conversation system 100. ing. In the example illustrated in FIG. 10, the conversation processing server 1 does not perform the family number registration process until the number of family IDs stored in the authentication data 131 and the profile data 132 reaches a certain number (for example, 2). Perform family name registration process.

  In (1) of FIG. 10, first, the mother speaks to the information processing apparatus 2 by saying “Clean up!”, That is, “Clean the room!”. It is assumed that the mother is a member who speaks or meets the information processing apparatus 2 for the first time in this home.

  The information processing device 2 receives voice information related to the mother's voice acquired by the microphone 21 and face image information related to the mother's face image acquired by the camera 22 via the information processing device communication unit 24. Send to. At this point, profile items such as family ID, voiceprint information, face image information, and name / role / home role / age of “Mom” are registered in the conversation processing server 1 (profile data 132, etc.). Absent. Therefore, if the information processing apparatus 2 recognizes a person's voice or recognizes a person's face image, it is unknown who the person is, but anyway, the face image and the sound are acquired and information about them is acquired. Is transmitted to the conversation processing server 1.

  The conversation processing server 1 acquires the voice information and face image information from the information processing device 2. Then, user authentication processing is executed using the voiceprint information and face image information included in the voice information. Specifically, the user authentication unit 103 refers to the authentication data 131 and determines that there is no family ID stored in association with the voice information (the voiceprint information included therein) and the face image information. The determination result is notified to the message generation unit 106.

  The message generation unit 106 generates a question to be output to the information processing device 2 based on the result of the user authentication process notified from the user authentication unit 103, the registration situation in the question scenario data 133 and the profile data 132, and the like. Here, as described above, the message generation unit 106 refers to the authentication data 131 and the profile data 132, and there is no registered family ID, that is, the number of family IDs is a certain number (for example, 2). If it is less, the family name registration process has priority over the family number registration process.

  Therefore, the message generator 106 follows the question generation rules defined in the “question item: name”, “questionee: person”, and “question timing: when spoken” of the question scenario data 133, , Your name is (who are you)? "

  Further, the voice recognition unit 104 of the conversation processing server 1 performs voice recognition processing on the above-mentioned “clean up!” Remarks of the mother, recognizes that the instruction is a cleaning execution instruction “I want you to clean the room”, and The message generation unit 106 is notified of the recognition result. In response to the execution instruction as described above, the message generation unit 106 generates a response message “I understand” based on the above-described standard conversation data and the like.

  Then, the message generation unit 106 combines the generated question and response messages, and transmits a message “I understand. Who are you?” To the information processing apparatus 2.

  The information processing apparatus 2 receives the message from the conversation processing server 1 and tells the mother, “I understand. Who are you?” ((2) in FIG. 10). In response to the voice output from the information processing apparatus 2, the mother responds to the information processing apparatus 2 with "I am a mom's Kazuko" ((3) in FIG. 10).

  The information processing apparatus 2 acquires voice information (including voiceprint information) related to the response from the mother and face image information of the mother ((4) in FIG. 10). Then, the information processing device 2 transmits the face image information and voice information of the mother to the conversation processing server 1.

  The conversation processing server 1 first performs user authentication processing based on the mother's face image information and voice information received from the information processing apparatus 2 and further performs voice recognition processing. Then, the conversation processing server 1 registers the name “Kazuko” and the status of “Mom” in the home in the storage unit 13 as profile data 132 in combination with, for example, “Family ID: 2” (FIG. 10). (5)).

  As described above, the family ID, voiceprint information, and face image information of “mother” may be registered in the authentication data 131 at any one of the following two timings. In other words, it may be performed after the timing of acquiring the statement “clean up!” By the mother of (1), or after the timing of acquiring the statement “mama's Kazuko” by the mother of (3). You may go.

  FIG. 11 shows a case where the information processing apparatus 2 is spoken from an unregistered member (dad) in the conversation system 100 when a member of the family (mother) has already been registered in the conversation processing server 1. A conversation between the information processing apparatus 2 and the member (dad) is shown. Also in the example illustrated in FIG. 11, the conversation processing server 1 does not perform the family number registration process until the number of family IDs stored in the authentication data 131 and the profile data 132 reaches a certain number (for example, 2). The family name registration process is performed.

  In (1) of FIG. 11, first, the father speaks to the information processing apparatus 2 by saying “Turn on the air conditioner!”. The information processing device 2 transmits to the conversation processing server 1 voice information related to the above-mentioned utterance of the father and face image information related to the face image of the father. The conversation processing server 1 acquires the voice information and face image information from the information processing device 2. Then, user authentication processing is executed using the voiceprint information and face image information included in the voice information. At this stage, only the mother's family ID (family ID: 2) shown in FIG. 10 is registered in the authentication data 131 and the profile data 132. Therefore, the user authentication unit 103 refers to the authentication data 131 and is stored in association with the voice information (voice print information included) and the face image information related to the father's statement “Turn on the air conditioner!”. It is determined that there is no family ID. Then, the user authentication unit 103 notifies the message generation unit 106 of the determination result.

  The message generation unit 106 generates a question to be output to the information processing device 2 based on the result of the user authentication process notified from the user authentication unit 103, the registration situation in the question scenario data 133 and the profile data 132, and the like. Here, as described above, the message generation unit 106 refers to the authentication data 131 and the profile data 132, and when the registered family ID is less than a certain number (for example, 2), the number of family members registration process is performed. It is assumed that the family name registration process is prioritized. As described above, in this stage, the family ID registered in the authentication data 131 and the profile data 132 is only “family ID: 2”, that is, the family ID registered in the authentication data 131 and the profile data 132 is already registered. There is one family ID.

  Therefore, the message generator 106 follows the question generation rules defined in the “question item: name”, “questionee: person”, and “question timing: when spoken” of the question scenario data 133, , Your name is (who are you)? "

  Also, the voice recognition unit 104 of the conversation processing server 1 recognizes that the dad's statement “Turn on the air conditioner!” Is voice recognition processing and recognizes that the instruction is to turn on the air conditioner. The result is notified to the message generator 106. In response to the execution instruction as described above, the message generation unit 106 generates a response message “I understand” based on the above-described standard conversation data and the like.

  Then, the message generation unit 106 combines the generated question and response messages, and transmits a message “I understand. Who are you?” To the information processing apparatus 2.

  The information processing apparatus 2 receives the above message from the conversation processing server 1 and tells the father, “I understand. Who are you?” ((2) in FIG. 11). In response to the voice output from the information processing apparatus 2, the father responds to the information processing apparatus 2 as “I am a dad of daddy” ((3) in FIG. 11).

  The information processing apparatus 2 acquires voice information (including voiceprint information) related to the response from the father and face image information of the father ((4) in FIG. 11). Then, the information processing apparatus 2 transmits the face image information and voice information of the father to the conversation processing server 1.

  The conversation processing server 1 first performs a user authentication process based on the father's face image information and voice information received from the information processing apparatus 2, and further performs a voice recognition process. Then, the conversation processing server 1 registers the name “Ichiro” and the status in the home “Dad” in the storage unit 13 as profile data 132 in combination with, for example, “Family ID: 1” (FIG. 11). (5)).

  As in the case of FIG. 10, the family ID, voiceprint information, and face image information of “dad” are registered in the authentication data 131 after the timing at which the utterance from the father in (1) is acquired. However, you may go to the timing which acquired the remark from the father of (3).

  FIG. 12 shows that in the conversation system 100, when the information processing apparatus 2 is talked to by a member (mother) already registered in the conversation processing server 1, the information processing apparatus 2 It is a figure which shows the case which is asking the total number of families.

  First of all, mom is, the information processing apparatus 2, is talking to say "Hello!" (FIG. 12 (1)). The information processing device 2 transmits to the conversation processing server 1 voice information related to the mother's speech and face image information related to the mother's face image. The conversation processing server 1 acquires the voice information and face image information from the information processing device 2. Then, user authentication processing is executed using the voiceprint information and face image information included in the voice information. At this stage, the mother (family ID: 2) and the father (family ID: 1) shown in FIGS. 10 and 11 are registered in the authentication data 131 and the profile data 132. Therefore, the user authentication unit 103 refers to the authentication data 131, are stored in association with and face image information (voiceprint information included in) audio information of the speech as "Hello!" Mother family The message generation unit 106 is notified of the ID (family ID: 2).

  When the message generation unit 106 is notified of “family ID: 2” from the user authentication unit 103, the message generation unit 106 generates a question to be output to the information processing apparatus 2 based on the registration situation in the question scenario data 133 and the profile data 132. To do. For example, as described above, the message generation unit 106 refers to the authentication data 131 and the profile data 132, and if the registered family ID is a certain number (for example, 2) or more, the message generation unit 106 performs the family name registration process. In addition, priority can be given to the family number registration process. Here, as described above, in this stage, the mother (family ID: 2) and the father (family ID: 1) are registered in the authentication data 131 and the profile data 132, that is, registered. There are two family IDs. Accordingly, the message generation unit 106 performs the family number registration process as follows, for example.

  That is, the message generator 106 follows the question generation rule defined in “Question item: number of family members” of the question scenario data 133 and says, “By the way, how many families are there (how many families are there?)?” Generate a question.

  The voice recognition unit 104 of the conversation processing server 1, a remark that mothers of the "Hello" to speech recognition process, recognizing that routine greeting of "Hello", the message generation unit 106 to the recognition result Notice. Message generator 106, to the routine greeting as described above, on the basis of the fixed conversation data and the like described above, to generate a response message "Hello.".

  Then, the message generation unit 106, a combination of the generated above-mentioned questions and the response message, "Hello. By the way, the family? In are many people," a message that is transmitted to the information processing apparatus 2.

  The information processing apparatus 2 receives the message from the conversation processing server 1, to the mother, to speak with "Hello. By the way, do you family How many people?" (In FIG. 12 (2)). In response to the voice output from the information processing apparatus 2, the mother responds to the information processing apparatus 2 with "Six family members" ((3) in FIG. 12).

  The information processing device 2 acquires the voice related to the response from the mother and transmits the voice information related to the voice to the conversation processing server 1. When the conversation processing server 1 receives the voice information from the information processing device 2, the conversation processing server 1 performs voice recognition processing and performs the following processing on the profile data 132. That is, the conversation processing server 1 performs voice recognition processing on the response from the member to the above-mentioned question about the number of family members, and stores in the profile data 132 of the storage unit 13 for the number of family members according to the result of the recognition processing. A blank line is added so that the family ID can be registered. For example, a blank line corresponding to “the total number of family members—the number of users already registered (stored in the storage unit)” is added. In the above example, the mother (family ID: 2) and the father (family ID: 1) are already stored in the profile data 132, that is, the number of registered family IDs is two. Further, the above-mentioned answer (“It is a family of six people”) in the mother's (3) is subjected to voice recognition processing, and it is determined that the total number of family members is six. Therefore, the profile registration part 105 adds the line for "4 people (= 6 people-2 people)" to the profile data 132 ((4) of FIG. 12).

  To summarize the above, in the conversation processing server 1, the plurality of members (users) belong to one family community (group), and the message generator 106 sends a message for confirming the total number of users belonging to the group. The profile registration unit 105 generates each profile item as an unregistered state so that the user's profile items for the total number of users obtained based on the user's answer detected by the voice recognition unit 104 can be registered. Set in the storage unit 13.

  That is, the conversation processing server 1 can set the total number of members to register profile items. Therefore, based on the set total number of users, it is possible to efficiently generate a message for asking about each user's profile item. That is, when a user is detected, it is possible to determine how many other users other than the user are present, that is, how many other users are present when asking the user about unregistered profile items of the other users. Can be determined. For example, if the total number of users who should register the profile item is unknown, first check whether there is a user who should register the profile item. A situation occurs that asks questions about profile items. In other words, when the total number of users is unknown, every time a user is detected, it is necessary to check whether there is another user other than the user every time. Can not do it. On the other hand, by setting the total number of users who should register the profile item, it is possible to determine the number of other users whose profile items are not registered, and confirm the existence of another user each time. Such inefficient questions can be omitted. That is, it is possible to determine the number of users who have unregistered profile items, and to omit a question for confirming the existence of the user who should register the profile items.

  FIG. 13 shows that when the information processing apparatus 2 is talked to by a member (mother) registered in the conversation processing server 1, the information processing apparatus 2 asks the member (mother) members other than the member (mother). It is a figure which shows the case which is asking about the profile of. That is, when there is a member (family ID) with an unregistered profile item in the profile data 132, the conversation processing server 1 asks members other than the member about the unregistered profile item of the member.

  First, the mother speaks to the information processing apparatus 2 saying, “How are you?” ((1) in FIG. 13). The information processing device 2 transmits to the conversation processing server 1 voice information related to the mother's speech and face image information related to the mother's face image. The conversation processing server 1 executes user authentication processing using the voice information and face image information acquired from the information processing apparatus 2. At this stage, the mother (family ID: 2) and the father (family ID: 1) are registered in the authentication data 131. In the profile data 132, the names of the mother (family ID: 2) and the father (family ID: 1) are registered. That is, “name: Ichiro” and “in-house role: dad” are associated with “family ID: 1”, and “family ID: 2” are associated with “name: Kazuko” and “in-house”. "Role: Mom" is registered. The profile data 132 further includes two lines in which “family ID” and “name” are not registered, and only “children” are registered in “home role”.

  As described above, it is preferable that the conversation processing server 1 performs not only the family number registration process but also the family structure registration process. In this family structure registration process, the member whose family ID has been registered in the authentication data 131 and the profile data 132 is inquired about the family structure. Based on the results of the family composition registration process and the family number registration process, the conversation processing server 1 estimates the number of members whose information processing device 2 has not yet spoken or met and the role of the member in the home. can do. That is, the conversation processing server 1 can register the following data in the profile data 132 based on the results of the family structure registration process and the family number registration process. That is, the information processing device 2 has not yet been talked to or met, that is, the “in-home role” and “number of people” of members who have not registered “family ID” and “name”, and profile data 132. Can be registered.

  In the user authentication process, the user authentication unit 103 refers to the authentication data 131 and corresponds to voice print information and face image information that match the voice print information and face image information included in the voice information acquired from the information processing apparatus 2. “Family ID: 2” is acquired as the attached family ID. Then, the user authentication unit 103 notifies the message generation unit 106 of “family ID: 2”.

  When the message generation unit 106 is notified of “family ID: 2” from the user authentication unit 103, the message generation unit 106 generates a question to be output to the information processing apparatus 2 based on the registration situation in the question scenario data 133 and the profile data 132. To do. For example, the message generation unit 106 refers to the profile data 132, and “Family ID” and “Name” are not registered, and there are two members who are registered only as “Children” in “Home role”. Grasp that. At this time, the message generation unit 106 generates the following message according to the question generation rules associated with “question item: name” and “question target person: other than the person” in the question scenario data 133. That is, a question is generated, “By the way, what is the name of“ Children ”(what is the name of“ Children ”)?

  Further, the speech recognition unit 104 of the conversation processing server 1 performs speech recognition processing on the mother's speech “How are you?” And recognizes it as a typical greeting asking for the current state, and the recognition result is a message generation unit 106. Notify The message generation unit 106 generates a response message “I'm fine” in response to the above-mentioned standard greeting based on the above-mentioned standard conversation data and the like.

  Then, the message generation unit 106 combines the generated question and response messages, and sends a message to the information processing apparatus 2 "I'm fine. By the way, what is your child's name?"

  The information processing apparatus 2 receives the message from the conversation processing server 1 and tells the mother, “I'm fine. By the way, what is the name of the child?” ((2) in FIG. 13). In response to the audio output from the information processing apparatus 2, the mother responds to the information processing apparatus 2 with "Taro and Hanako" ((3) in FIG. 13).

  The information processing device 2 acquires the voice related to the response from the mother and transmits the voice information related to the voice to the conversation processing server 1. When the conversation processing server 1 receives the voice information from the information processing device 2, the conversation processing server 1 performs voice recognition processing and performs the following processing on the profile data 132. That is, the conversation processing server 1 registers “Taro” and “Hanako” in each of the “name” fields in the two rows of “home role: child” of the profile data 132 ((4 in FIG. 13). )).

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  The conversation processing server 1 according to the present embodiment, when the information processing apparatus 2 is spoken or met by a member, sends a message to the member based on the profile item registered in the profile data 132. The processing apparatus 2 is made to speak.

  FIG. 14 shows that the conversation processing server 1 gives a message (action) for celebrating a birthday to the member (Taro) based on the birthday of the member registered in the profile data 132 in the information processing apparatus 2. It is a figure which shows the case made to raise. Details will be described below.

  First, Taro-kun is talking to the information processing apparatus 2 saying “Let's play!” ((1) in FIG. 14). The information processing apparatus 2 transmits to the conversation processing server 1 voice information related to Mr. Taro's remarks and face image information related to Taro's face image. The conversation processing server 1 acquires the voice information and face image information from the information processing device 2.

  When the conversation processing server 1 acquires the voice information and face image information from the information processing apparatus 2, first, the conversation processing server 1 executes a user authentication process using the voiceprint information and face image information included in the voice information. Specifically, the user authentication unit 103 refers to the authentication data 131, and the voice information corresponding to the voice information (included in the voice print information) and the face image information related to Mr. Taro ’s statement “Let's play!” And whether the face image information is stored in the authentication data 131. Then, when matching voice print information and face image information are found, “family ID: 3” is acquired as the family ID stored in association with the voice print information and face image information, and this is generated as the message generation unit 106. Notify That is, the user authentication unit 103 notifies the message generation unit 106 that the information processing apparatus 2 is spoken or the member who has met is “Taro-kun”.

  When the message generation unit 106 is notified of the “family ID: 3” from the user authentication unit 103, the message generation unit 106 refers to the profile data 132, the name of the member corresponding to the “family ID: 3”, the home role, age, A birthday, a hobby, etc. are acquired ((2) of FIG. 14). That is, the conversation processing server 1 refers to the profile data 132 of the storage unit 13 and profile items such as domestic role, age, birthday, hobby, etc. regarding Taro who is a member corresponding to “family ID: 3”. Information related to is acquired. As described in the first embodiment, the conversation processing server 1 asks a member other than the member (for example, mother) about the information related to the profile of a certain member (for example, Mr. Taro), and Information related to the member's profile (for example, birthday) is registered.

  In FIG. 14, the message generation unit 106 refers to the profile data 132 and acquires that “Taro” ’s“ Birthday ”is“ December 8 ”. When the date when the information processing apparatus 2 talks to Mr. Taro saying “Let's play!” Is “December 8”, the following message is generated. That is, the message generation unit 106 generates a message “Taro, today is your birthday! Congratulations!”.

  Further, the speech recognition unit 104 of the conversation processing server 1 performs speech recognition processing on the above-mentioned “Let's play!” Speech of Taro, recognizes it as a standard greeting “Let's play!”, And sends the recognition result as a message. Notify the generation unit 106. The message generation unit 106 generates a response message “I understand” based on the above-mentioned standard conversation data and the like in response to the above-mentioned standard greeting.

  The message generator 106 combines the message “Taro-kun, today is a birthday! Congratulations!” And the above response message, and “Okay. Taro-kun, today is a birthday! Congratulations!” Is sent to the information processing apparatus 2.

  When the information processing apparatus 2 receives the above message from the conversation processing server 1, the information processing apparatus 2 tells Taro, “Okay. Taro, today is your birthday! Congratulations!” ((3) in FIG. 14) ).

  Since Mr. Taro did not think that the information processing device 2 would give the above blessing about his birthday that was never asked by the information processing device 2, he listened to the above statement, “Wow, I was surprised! Thank you!” (Fig. 14 (4)).

  Therefore, in the conversation processing server 1 according to the present embodiment, the message generation unit 106 generates a message based on the profile data 132 (profile item) registered in the storage unit 13 in association with the user detected by the user authentication unit 103. Is generated.

  The conversation processing server 1 can generate a message addressed to the user based on the profile item of the user who has not asked a certain user himself / herself. Therefore, the conversation processing apparatus can make the user feel unexpectedness with respect to the message presented by the conversation processing apparatus.

[Embodiment 3]
The following will describe another embodiment of the present invention with reference to FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  In the present embodiment, the information processing device 2 is not directed to the user when the user talks to the user but when the user moves around the house and meets the user, that is, when the user's face image is acquired by the camera 22. Take action.

  That is, as described above, the information processing apparatus 2 is a self-propelled cleaner, and moves around the house by itself, and the face image of the user that the information processing apparatus 2 meets with the camera 22 is transferred to the conversation processing server 1. Can be sent.

  FIG. 15 shows that when the father's birthday is not registered in the profile data 132 and the information processing apparatus 2 meets the mother, the conversation processing server 1 first asks the information processing apparatus 2 about the father's birthday. It is a figure which shows the case made to do. FIG. 15 further shows that the conversation processing server 1 makes a message (action) for celebrating the birthday of the father based on the birthday of the father registered in the profile data 132 by the response from the mother. This shows the case that causes Details will be described below.

  First, it is assumed that the “birthday” of the father (name: Ichiro) of “family ID: 1” is not registered in the profile data 132. At this time, the conversation processing server 1 sends at least one of voice information and face image information of members other than the father, for example, a mother of “family ID: 2” and a child of “family ID: 3” from the information processing apparatus 2. Until it is acquired, an instruction to continue the movement in the house is transmitted to the information processing device 2.

  The information processing device 2 moves around the house in accordance with the above instruction from the conversation processing server 1 and obtains at least one of the voice and face image of the member each time a member is encountered, and the voice information of the voice and the face image At least one of the face image information is transmitted to the conversation processing server 1. The conversation processing server 1 executes a user authentication process for the member to which the information processing apparatus 2 is spoken or met by at least one of the voice information (voice print information included) and the face image information acquired from the information processing apparatus 2. To do. When the conversation processing server 1 determines that the information processing device 2 is talked to or the member who has met is a member other than the father, the conversation processing server 1 generates the following message asking the father's birthday, and sends it to the information processing device 2. Let them speak. That is, the conversation processing server 1 causes the information processing apparatus 2 to make the information processing apparatus 2 say a message “When is the father's birthday?” To members other than the father.

  In the example shown in (1) of FIG. 15, the information processing apparatus 2 meets the mother, and the conversation processing server 1 causes the information processing apparatus 2 to ask the mother “when is the birthday of the mother and father?” ing. The mother responds to the above-mentioned question from the information processing apparatus 2 with “Dad's birthday is June 10th” ((2) in FIG. 15).

  The information processing device 2 transmits the mother's response to the conversation processing server 1 as voice information. The conversation processing server 1 executes voice recognition processing on the above-mentioned response from the mother, and based on the processing result, the item “birthday” of the father (name: Ichiro) of “family ID: 1” in the profile data 132 “June 10” is stored in (3) of FIG.

  The conversation processing server 1 recognizes that the information processing apparatus 2 has met the father (family ID: 1) on June 10 based on at least one of the voice information and the face image information received from the information processing apparatus 2. Then, the following processing is executed.

  That is, the conversation processing server 1 refers to the profile data 132, confirms the item “birthday” associated with “family ID: 1”, and acquires “June 10”. Then, it is grasped that the “birthday” of the members of “name: Ichiro” and “home role: dad” associated with “family ID: 1” is “June 10” today. The conversation processing server 1 generates a message “Daddy, happy birthday!” And transmits the message to the information processing apparatus 2.

  When the information processing apparatus 2 receives the message from the conversation processing server 1, the information processing apparatus 2 says to the father “Dad, happy birthday!” ((4) in FIG. 15).

  Dad did not expect the information processing device 2 to give the above blessing about his birthday, which has not been asked by the information processing device 2, so he listened to the above statement, Oh, why is my birthday, but thank you! ”(Fig. 15 (5)).

  As shown in the above example, the conversation processing server 1 is only when the information processing apparatus 2 meets a certain member, that is, when the information processing apparatus 2 can acquire only a face image. Even so, the user authentication process can be executed based on the face image information relating to the face image. Then, based on the result of the user authentication process, the profile information related to the user is acquired from the profile data 132, and a message based on the profile information related to the user stored in the profile data 132 is generated for the user. Can do.

  In the above example, the conversation processing server 1 generates the message “Dad, happy birthday!” After the information processing apparatus 2 meets the father.

  However, the conversation processing server 1 may generate a message “Dad, happy birthday!” Before the information processing apparatus 2 is talked to or met by the father. That is, the conversation processing server 1 generates a message “Dad, happy birthday!” In advance based on today's date (June 10) and the information stored in the profile data 132. Also good. Then, the conversation processing server 1 may transmit to the information processing apparatus 2 an instruction to “continue moving in the house until the dad is met” together with the above message.

  When the information processing apparatus 2 receives the instruction, the information processing apparatus 2 starts to move in the house, and transmits the voice information and face image information of the member to the conversation processing server 1 each time the family member speaks or meets the information. Then, the conversation processing server 1 continues to move in the house until it is notified that the family ID of the member is 1. Then, as soon as it is notified from the conversation processing server 1 that the family ID of the member is 1, the message “Dad, happy birthday!” Received from the conversation processing server 1 in advance is output as a voice.

[Embodiment 4]
Another embodiment of the present invention will be described below with reference to FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  In the present embodiment, the conversation processing server 1 causes the information processing apparatus 2 to ask the information processing apparatus 2 about the profile item based on the profile item newly added to the profile data 132. The conversation processing server 1 further obtains provision information related to the profile information from the external information provision server 3 based on the profile information stored in the profile data 132, and sends a message about the provision information to the information processing apparatus. 2 is outputting sound.

  As described above, the contents and number of profile items in the profile data 132 can be changed. For example, when a new profile item “favorite food” is added to the profile data 132, the conversation processing server 1 sends a “like” to each member (each family ID) to the information processing device 2. Ask questions about “nice food”.

  In addition, the message generation unit 106 notifies the information stored as the profile item of each member in the profile data 132 to the provided information acquisition unit 107 as a search word. When the provided information acquisition unit 107 is notified of the search word from the message generation unit 106, the provided information acquisition unit 107 acquires information related to the search word from the external information providing server 3 such as the information search server 3B, and the message generation unit It outputs to 106.

  FIG. 16 shows that when a new profile item “favorite food” is added to the profile data 132, the conversation processing server 1 sends information about the “favorite food” to the information processing apparatus 2. It is a figure which shows the case which is asking a question. FIG. 16 further shows a case where the conversation processing server 1 provides voice information to the information processing apparatus 2 based on the “favorite food” of the father registered in the profile data 132. Show. Details will be described below.

  First, a father (family ID: 1) is talking to the information processing apparatus 2 saying “Oh, I'm free” ((1) in FIG. 16). The information processing device 2 transmits to the conversation processing server 1 voice information related to the above-mentioned utterance of the father and face image information related to the face image of the father. The conversation processing server 1 acquires the voice information and face image information from the information processing device 2.

  When the conversation processing server 1 acquires the voice information and face image information from the information processing apparatus 2, first, the conversation processing server 1 executes a user authentication process using the voiceprint information and face image information included in the voice information. Specifically, the user authentication unit 103 associates the voice print information and the face image information that match the voice print information and the face image information included in the voice information as the family ID stored in the authentication data 131. "Family ID: 1" is acquired. Then, the user authentication unit 103 notifies the message generation unit 106 of “family ID: 1”, that is, that the information processing apparatus 2 is spoken or the member who has met is “dad”.

  When the message generation unit 106 is notified of “family ID: 1” from the user authentication unit 103, the message generation unit 106 refers to the profile data 132, the name of the member corresponding to “family ID: 1”, the home role, age, Get birthdays, hobbies, favorite foods, etc. Then, when confirming that the profile item “favorite food” associated with “family ID: 1” is unregistered, the message generator 106 says “Dad, do you have any favorite food?” Generate a question message. Then, the message generator 106 transmits the question message to the information processing device 2.

  When the information processing apparatus 2 receives the message from the conversation processing server 1, the information processing apparatus 2 asks the father, “Dad, do you have any favorite food?” ((2) in FIG. 16). In response to the question from the information processing device 2, the father responds to the information processing device 2 "I want to eat okonomiyaki" ((3) in FIG. 16).

  The information processing apparatus 2 transmits the above-mentioned response from the father as voice information to the conversation processing server 1. The conversation processing server 1 executes voice recognition processing on the above-mentioned response from the father, and stores “okonomiyaki” in “favorite food” of “family ID: 1” in the profile data 132 based on the processing result ( FIG. 16 (4)).

  The message generation unit 106 refers to the profile data 132 and notifies the provided information acquisition unit 107 of “okonomiyaki” registered in “favorite food” of “family ID: 1” as a search word.

  When the provided information acquisition unit 107 is notified of the search word from the message generation unit 106, the provided information acquisition unit 107 notifies the information providing server 3 (more precisely, the information search server 3B) with a search expression such as “okonomiyaki, recommendation”. The search result output is requested ((5) in FIG. 16). When the provided information acquisition unit 107 acquires a search result such as “Omoni (location: XX prefecture-Tsuruhashi)” from the information search server 3B, the provided information acquisition unit 107 notifies the message generation unit 106 of the search result.

  Based on the search result notified from the provided information acquisition unit 107, the message generation unit 106 generates a message “Omoni in Tsuruhashi is recommended for Okonomiyaki” and sends the message to the information processing apparatus 2. Send. When the information processing apparatus 2 receives the above message from the conversation processing server 1, the information processing apparatus 2 says to the father that "Okonomi Yaki is recommended in Tsuruhashi!" ((6) in FIG. 16).

  Accordingly, the conversation processing server 1 causes the information processing apparatus 2 to provide each member with a topic that is likely to be of interest to the information processing device 2 based on the profile information of each member stored in the profile data 132. It becomes possible.

  Therefore, the conversation processing server 1 according to the present embodiment includes the provision information acquisition unit 107 that acquires the provision information estimated to be highly interested based on the profile data 132 (profile item) from the external information provision server 3. The message generation unit 106 is a user who has detected the message including the provision information acquired by the provision information acquisition unit 107 by the user authentication unit 103, and is interested based on the profile item stored in the profile data 132. Generated for users estimated to be high.

  That is, the conversation processing server 1 can acquire the provision information that is estimated to be of high interest of the user based on the profile item and present a message including the provision information to each user.

[Embodiment 5]
Another embodiment of the present invention will be described below with reference to FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  In the present embodiment, the conversation processing server 1 sends a message related to information acquired from the external information providing server 3 such as news based on the profile information of each member stored in the profile data 132 to the information processing apparatus 2. To provide the best user.

  FIG. 17 shows information about professional baseball results distributed from the news distribution server by the conversation processing server 1 for the father of “family ID: 1” whose hobby is “watching baseball” with reference to the profile data 132. A case is shown in which the processing device 2 is outputting sound. Details will be described below.

  The conversation processing server 1 acquires distribution news such as breaking news such as “Today's professional baseball results (drawn with Tigers, Dragons)” from the information providing server 3 (more precisely, the news distribution server 3A) (FIG. 17). (1)). Specifically, the provision information acquisition unit 107 acquires provision information distributed by the news distribution server 3A. The provision information acquisition unit 107 notifies the message generation unit 106 of the acquired provision information.

  The message generation unit 106 refers to the profile data 132 to determine the delivery news provider, that is, the utterance target person when the information processing device 2 outputs a message related to the delivery news as a voice (FIG. 17). (2)). For example, the message generation unit 106 refers to the profile data 132 and uses “professional baseball game” as hobbies 2 of a father (family ID: 1, name: Ichiro) and a child (family ID: 3, name: Taro). To get. When the distribution news from the news distribution server 3A includes a news type such as “sports-professional baseball”, the message generation unit 106 sets the news type of the distribution news and the “family ID: It is determined that “Hobby 2” of “1 and 3” matches. Based on the determination result, the message generation unit 106 acquires “family IDs: 1 and 3” as the family IDs of members who are likely to be interested in the distribution news.

  When the information processing apparatus 2 speaks or meets a family member, the information processing apparatus 2 transmits at least one of the voice information and face image information of the member to the conversation processing server 1. Then, the conversation processing server 1 performs user authentication processing based on at least one of voice information and face image information received from the information processing apparatus 2. When the conversation processing server 1 obtains the user authentication processing result that the information processing device 2 is spoken or met as a result of the user authentication processing and the “family ID: 1 or 3” is obtained, the distribution news A message related to is generated. For example, when the information processing apparatus 2 is spoken or notified by the user authentication unit 103 that the member who has met is the father of “family ID: 1”, the message generation unit 106 generates the following message, It transmits to the information processing device 2. That is, the message generation unit 106 generates a message such as “Daddy, today, Tigers has drawn with Dragons!” And transmits the message to the information processing apparatus 2.

  When the information processing apparatus 2 receives the above message from the conversation processing server 1, the dad says, “Daddy, today, Tigers has drawn with Dragons!”, Providing voice information about the professional baseball results Is performed ((3) of FIG. 17).

  A father whose “professional baseball game” is a “hobby” receives the above information from the information processing apparatus 2 and says “Yes, sorry!” ((4) in FIG. 17).

  Therefore, the conversation processing server 1 according to the present embodiment includes the provision information acquisition unit 107 that acquires the provision information from the external information provision server 3, and the message generation unit 106 provides the provision information acquired by the provision information acquisition unit 107. Is generated for the user who is estimated to be highly interested in the provision information acquired by the provision information acquisition unit 107 based on the profile data 132.

  That is, the conversation processing server 1 can recognize topics and information that are likely to be of interest for each member based on the profile data 132. Then, when information such as news is acquired, a member who is highly likely to be interested in the information can be selected as a person to be provided with the information according to the content of the information. In other words, information that is likely to be of interest to each member can be output to the information processing apparatus 2 by voice output to each member.

[Embodiment 6]
In each of the embodiments described above, the conversation processing server 1 performs user authentication processing, voice recognition processing, profile registration processing, message generation processing, and the like. Then, the information processing apparatus 2 transmits voice information and face image information to the conversation processing server 1, receives a message from the conversation processing server 1, and outputs the message as synthesized speech. However, the information processing apparatus may perform user authentication processing, voice recognition processing, profile registration processing, message generation processing, and the like.

  The information processing apparatus 4 (conversation processing apparatus) according to the present embodiment is a self-propelled cleaner that automatically cleans the floor, and further includes only the own apparatus, user authentication processing, voice recognition processing, and profile. Registration processing, message generation processing, and the like can be performed.

  That is, the information processing apparatus 4 includes a user authentication unit 203 (user detection unit) that detects one of a plurality of users, and when the user authentication unit 203 detects one of the plurality of users, When the profile item of the user other than the detected user among the plurality of users is not registered in the storage unit 25 that stores the profile item in association with each user, the user who has detected the profile item is not registered. A message generating unit 206 (message generating unit) that generates a message for asking a question, a speaker 23 (question presenting unit) that presents the message generated by the message generating unit 206 to the detected user from its own device, and a speaker 23 The contents obtained based on the detected user's answer to the question presented by Comprising a profile registration unit 205 for registering in the storage section 25 as a was the profile item (profile registration means), a.

  FIG. 19 is a block diagram illustrating an example of a main configuration of the information processing apparatus 4.

  As illustrated in FIG. 19, the information processing device 4 includes a control unit 20, a microphone 21, a camera 22, a speaker 23, an information processing device communication unit 24, and a storage unit 25.

  The microphone 21, camera 22, and speaker 23 are the same as the microphone 21, camera 22, and speaker 23 of the information processing apparatus 2, and thus description thereof is omitted.

  The information processing device communication unit 24 is for the information processing device 4 to communicate with the external information providing server 3. Specifically, the information processing device 4 communicates with the news distribution server 3 </ b> A and the information search server 3 </ b> B via the information processing device communication unit 24.

  The storage unit 25 is similar to the storage unit 13 of the conversation processing server 1 and stores various data used by the information processing apparatus 4. The storage unit 25 stores profile data 252, authentication data 251, question scenario data 253, conversation data 254, and the like. These data stored in the storage unit 25 are basically stored in the profile data 132, authentication data 131, question scenario data 133, conversation data 134, etc. stored in the storage unit 13 of the conversation processing server 1. Since it corresponds, detailed description is abbreviate | omitted.

  The control unit 20 performs overall control of functions of the information processing apparatus 4 including user authentication processing, voice recognition processing, profile registration processing, message generation processing, and the like. The illustrated control unit 20 includes, as functional blocks, a face information acquisition unit 201, a voice information acquisition unit 202, a user authentication unit 203, a voice recognition unit 204, a profile registration unit 205, a message generation unit 206, and a provision information acquisition unit 207. It is included. Also for each of these functional blocks, the face information acquisition unit 101, voice information acquisition unit 102, user authentication unit 103, voice recognition unit 104, profile registration unit 105, message generation unit included in the control unit 10 of the conversation processing server 1 106 and the provided information acquisition unit 107, and detailed description thereof is omitted.

[Modification]
In each of the embodiments described above, the message generation unit 106 of the conversation processing server 1 transmits a message that causes the information processing apparatus 2 to output a voice via the first communication unit 11. However, the message generation unit 106 may output not only the message that causes the information processing device 2 to output the sound via the first communication unit 11 but also the information processing device 2. Hereinafter, the information other than the message that the message generation unit 106 outputs to the information processing device 2 via the first communication unit 11 will be described in detail.

  In each of the embodiments described so far, for example, after the conversation processing server 1 recognizes that the information processing apparatus 2 has been spoken to or met by the father, the conversation processing server 1 will be notified, “Dad, happy birthday! Is generated and the information processing apparatus 2 speaks.

  However, the message “Daddy, happy birthday!” Does not necessarily have to be generated after the information processing apparatus 2 has spoken to or met the father. In other words, the conversation processing server 1 generates a message “Dad, happy birthday!” In advance in the morning, while generating an instruction to “continue moving in the house until the dad meets the father”. Then, it may be transmitted to the information processing apparatus 2 together with the message.

  As described above, the conversation processing server 1 (specifically, the message generation unit 106) can determine in advance the content of the message to be generated and the destination of the message based on the question scenario data 133 and the like. it can. Therefore, the conversation processing server 1 may transmit an instruction to the information processing device 2 to continue moving in the home, together with the message, to the information processing device 2 until the destination is met.

[Embodiment 7]
Control blocks of conversation processing server 1 and information processing device 4 (particularly face information acquisition unit 101, voice information acquisition unit 102, user authentication unit 103, voice recognition unit 104, profile registration unit 105, message generation unit 106, acquisition of provided information) Unit 107, face information acquisition unit 201, voice information acquisition unit 202, user authentication unit 203, voice recognition unit 204, profile registration unit 205, message generation unit 206, and provided information acquisition unit 207) are integrated circuits (IC chips). It may be realized by a logic circuit (hardware) formed in the same manner, or may be realized by software using a CPU (Central Processing Unit).

  In the latter case, the conversation processing server 1 and the information processing apparatus 4 include a CPU that executes instructions of a program that is software that realizes each function, and a ROM in which the program and various data are recorded so as to be readable by a computer (or CPU). (Read Only Memory) or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
A conversation processing device (conversation processing server 1, information processing device 4) according to aspect 1 of the present invention includes user detection means (user authentication unit 103, user authentication unit 203) for detecting any one of a plurality of users, When the user detecting means detects one of the plurality of users, the storage unit that stores the profile items of the plurality of users in association with the respective users is stored in a storage unit other than the detected user among the plurality of users. When a user's profile item is unregistered, message generation means (message generation unit 106, message generation unit 206) for generating a message asking the user who has detected the profile item, and a message generated by the message generation unit Is detected from the own device (information processing device 4) or via another device (information processing device 2). The contents obtained based on the detected user's answer to the question presented by the question presenting means (first communication unit 11, speaker 23) presented to the user and the question presented by the question presenting means are the unregistered profile. Profile registration means (profile registration unit 105, profile registration unit 205) for registering as items in the storage unit.

  In the method for controlling a conversation processing device according to the sixth aspect of the present invention, a user detection step (S202, S302) for detecting any one of a plurality of users, and one of the plurality of users is detected in the user detection step. When the profile items of the users other than the detected user among the plurality of users are not registered in the storage unit that stores the profile items of the plurality of users in association with the respective users. A message generation step (S203, S306 and S316) for generating a message for asking the user who has detected the item, and the message generated in the message generation step is detected from the own device or via another device. The question presenting step to be presented to the user (S204, S307) and the question presenting step Including the contents obtained on the basis of the answers of the user who the detection to the question presented by flop, the profile registration step of registering in the storage section as the profile item was the unregistered (S208, S311), the.

  According to the above configuration and method of the conversation processing device of the present invention, a message asking about the unregistered profile of the user whose profile item is unregistered is presented to another user other than the user, Based on the response from the other user, the profile item for the user can be registered.

  Therefore, it becomes possible to register a profile item of a certain user based on the viewpoint from another user other than the user. Also, the user's profile item can be acquired without asking the user, for example, a message addressed to the user can be generated based on the user's profile item that is not asking a certain user. it can. Therefore, the user can be surprised by the message to be presented.

  In the conversation processing device according to aspect 2 of the present invention, in the aspect 1, the plurality of users belong to one group, and the message generation unit generates a message for confirming the total number of users belonging to the group. The profile registration means may set each profile item in the storage unit as an unregistered state so that the user's profile items for the total number of users obtained based on the detected user's answer can be registered. Good.

  According to said structure, the total number of the users who should register the said profile item can be set. Therefore, based on the set total number of users, it is possible to efficiently generate a message for asking about each user's profile item. That is, when a user is detected, it is possible to determine how many other users other than the user are present, that is, how many other users are present when asking the user about unregistered profile items of the other users. Can be determined. For example, if the total number of users who should register the profile item is unknown, first check whether there is a user who should register the profile item. A situation occurs that asks questions about profile items. In other words, when the total number of users is unknown, every time a user is detected, it is necessary to check whether there is another user other than the user every time. Can not do it. On the other hand, by setting the total number of users who should register the profile item, it is possible to determine the number of other users whose profile items are not registered, and confirm the existence of another user each time. Such inefficient questions can be omitted. That is, it is possible to determine the number of users who have unregistered profile items, and to omit a question for confirming the existence of the user who should register the profile items.

  In the conversation processing device according to aspect 3 of the present invention, in the aspect 1 or 2, the message generation means is based on the profile item registered in the storage unit in association with the user detected by the user detection means. A message may be generated.

  According to said structure, the message addressed to this user can be produced | generated based on the profile item of this user who has not questioned a certain user himself / herself. Therefore, the conversation processing apparatus can make the user feel unexpectedness with respect to the message presented by the conversation processing apparatus.

  The conversation processing device according to aspect 4 of the present invention is the information processing unit (provided information acquiring unit 107, provided information acquiring unit) for acquiring provided information from the external information providing server (3) in any of the above aspects 1 to 3. 207), wherein the message generation means estimates that the message including the provision information acquired by the information acquisition means is highly interested in the provision information acquired by the information acquisition means based on the profile item. It may be generated for the address.

  According to said structure, the message containing the provision information estimated that the said user's interest is high can be shown to each user based on a profile item.

  The conversation processing device according to aspect 5 of the present invention is the information acquisition means for acquiring, from any of the above aspects 1 to 4, provided information that is estimated to be highly interested based on the profile item from an external information providing server. (Providing information acquisition unit 107, providing information acquisition unit 207), wherein the message generation unit is a user who has detected the message including the provision information acquired by the information acquisition unit by the user detection unit, You may produce | generate to the user who estimated that interest is high based on a profile item.

  According to said structure, the provision information estimated that the said user's interest is high based on a profile item can be acquired with respect to each user, and the message containing this provision information can be shown.

  The conversation processing apparatus according to each aspect of the present invention may be realized by a computer. In this case, the conversation processing apparatus is realized by the computer by causing the computer to operate as each unit included in the conversation processing apparatus. A control program for the conversation processing apparatus and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  The present invention can be widely applied to an apparatus for collecting user profiles.

1 Conversation processing server (conversation processing device)
2 Information processing devices (other devices)
3 Information provision server (information provision server)
4. Information processing device (conversation processing device)
3A News distribution server (information provision server)
3B Information retrieval server (information provision server)
11 1st communication part (question presenting means)
13 Storage Unit 23 Speaker (Question Presentation Unit)
25 storage unit 103 user authentication unit (user detection means)
105 Profile registration section (profile registration means)
106 Message generator (message generator)
107 Provided information acquisition unit (information acquisition means)
203 User authentication unit (user detection means)
205 Profile registration section (profile registration means)
206 Message generator (message generator)
207 Provided information acquisition unit (information acquisition means)

Claims (8)

User detection means for detecting any one of a plurality of users;
When the user detecting means detects one of the plurality of users, the storage unit storing the profile items of the plurality of users in association with the respective users, and the user other than the detected user among the plurality of users If the user's profile item is unregistered, message generating means for generating a message asking the user who detected the profile item,
Question presenting means for presenting the message generated by the message generating means to the detected user from its own device or via another device;
Profile registration means for registering the contents obtained based on the detected user's answer to the question presented by the question presenting means in the storage unit as the unregistered profile item, Conversation processing device. The multiple users belong to one group,
The message generation means generates a message for confirming the total number of users belonging to the group,
The profile registration means sets each profile item as an unregistered state in the storage unit so that the user's profile items for the total number of users obtained based on the detected user's answer can be registered. The conversation processing apparatus according to claim 1. The conversation processing according to claim 1, wherein the message generation unit generates a message based on the profile item registered in the storage unit in association with the user detected by the user detection unit. apparatus. It further comprises information acquisition means for acquiring provided information from an external information providing server,
The message generation means generates a message including the provision information acquired by the information acquisition means to a user who is estimated to be highly interested in the provision information acquired by the information acquisition means based on the profile item. The conversation processing apparatus according to claim 1, wherein the conversation processing apparatus is characterized. It further comprises information acquisition means for acquiring provided information estimated to be highly interested based on the profile item from an external information providing server,
The message generation means generates a message including the provision information acquired by the information acquisition means to a user who is detected by the user detection means and estimated to be highly interested based on the profile item. The conversation processing device according to any one of claims 1 to 4, wherein: A user detection step of detecting any one of a plurality of users;
When one of the plurality of users is detected in the user detection step, the detected user among the plurality of users is stored in a storage unit that stores the profile items of the plurality of users in association with the respective users. A message generation step of generating a message for asking the user who detected the profile item when the profile item of the user other than is unregistered;
A question presenting step for presenting the message generated in the message generating step to the detected user from the own device or via another device;
A profile registration step of registering the content obtained based on the detected user's answer to the question presented in the question presenting step in the storage unit as the unregistered profile item. A method for controlling the conversation processing device.   A control program for causing a computer to function as the conversation processing apparatus according to claim 1, wherein the control program causes the computer to function as each of the above-described means.   A computer-readable recording medium storing the control program for the conversation processing apparatus according to claim 7.

Images