JP2016115257A - Communication system, server device, robot, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication system for performing customer service corresponding to an individual.SOLUTION: A communication system 1 includes a wearable terminal 100, a server device 200, and a speakable robot 300. The wearable terminal 100 records a keyword, associates the keyword with user's identification information and transmits the keyword to the server device 200 on the basis of the fact that the user of the wearable terminal 100 speaks a predetermined keyword to the robot 300 and the wearable terminal 100, and the robot 300 records the keyword, and transmits the keyword to the server device 200. The server device 200 transmit information about the user specified by the received identification information to the robot when the keyword received from the wearable terminal 100 matches the keyword received from the robot 300. The robot 300 makes an utterance on the basis of the information.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a communication system, a server device, a robot, an information processing method, and a program.

  With the spread of the network environment, the penetration of IOT (Internet of Things) that connects all things to the Internet, and the evolution of robot technology, robots specialized for specific purposes in every part of society work on behalf of people. It is becoming a world that takes charge of business. In addition to production robots used in factories, security robots, cleaning robots, and customer service robots that can communicate easily with voice are also emerging.

  For example, Patent Literature 1 discloses a customer service system using a robot that can move autonomously as the customer service robot. In this customer service system, when there are a plurality of persons to be serviced, the customer service order is determined in consideration of the degree of interest of each person in the robot.

  Patent Document 2 discloses a support robot that cooperates with station equipment such as automatic ticket gates and ticket machines. This support robot determines a moving speed and a customer service attitude according to the content of the customer's action information. The support robot approaches the station service device at the determined moving speed, and supports the station service device or the like with the determined customer service attitude (for example, executes trouble handling with the customer).

  Conventionally, digital signage is known. For example, Patent Document 3 discloses a store server that communicates with digital signage. This store server identifies a customer who is a customer who is watching an advertisement displayed on digital signage. Furthermore, the store server identifies the sales clerk to be notified based on at least one of the advertisement viewed by the customer targeted for customer service and the position of each sales clerk.

JP 2009-248193 A JP 2013-140539 A JP2013-84182A

  However, in Patent Documents 1 and 2, an individual cannot be authenticated. Therefore, the robots in Patent Documents 1 and 2 cannot perform customer service for each authenticated individual.

  Moreover, the store server of patent document 3 can identify a customer, but cannot identify who the customer is. That is, the store server cannot authenticate the individual. It is also possible to identify an individual by using a camera or an IC (integrated circuit) card at a terminal or a signage terminal (digital signage) in a store, and the terminal can respond to the individual. However, from the viewpoint of customer service at a store, complicated work occurs.

  The present invention has been made in view of the above-described problems, and its purpose is to perform customer service according to individuals, a communication system, a server device and a robot constituting the communication system, and an information processing method in the communication system The present invention relates to an information processing method in a server device, an information processing method in a robot, a program for controlling the server device, and a program for controlling the robot.

  According to an aspect of the present invention, a communication system includes a robot capable of speaking, a mobile terminal, and a server device. Based on the fact that the user of the mobile terminal has uttered a predetermined keyword to the robot and the mobile terminal, the mobile terminal records the keyword and uses the recorded keyword as the user identification information. The robot records the keyword in association with each other, and transmits the recorded keyword to the server device. When the keyword received from the mobile terminal matches the keyword received from the robot, the server device transmits information about the user specified by the received identification information to the robot. The robot speaks based on the information.

  Preferably, the server device transmits, as information, the first information associated with the first keyword to the robot when the keyword is the first keyword, and when the keyword is the second keyword, As information, the second information associated with the second keyword is transmitted to the robot.

  Preferably, the mobile terminal associates the identification information and the first position information indicating the current position of the mobile terminal device with the keyword, and transmits the keyword to the server device. The robot associates the keyword with the second position information indicating the current position of the robot, and transmits it to the server device. The server device transmits information to the robot on the condition that it is determined that the current position of the mobile terminal matches the current position of the robot based on the first position information and the second position information.

  Preferably, the robot restricts the utterance of information that can be specified by the user when the utterance is based on the information.

  Preferably, the robot specifies a person who can be determined to be interested in the robot from passers-by around the robot based on a predetermined criterion. Request an utterance. Based on the fact that the identified person utters the keyword to the mobile terminal having the robot and the person as the user, the mobile terminal associates the keyword with the identification information to the server device. Then, the robot transmits the keyword to the server device.

  Preferably, the robot further utters the passerby to call the store using the robot.

  Preferably, the robot images a passerby with a camera, and selects a person to be called out from passersby based on the feature points of the image obtained by the imaging. The robot identifies a person who can be determined to be interested in the robot from among the passers-by around the robot based on a predetermined criterion from among the selected persons.

  Preferably, the communication system further includes a display device. The robot causes the display device to execute display based on the information.

  Preferably, the communication system includes a first display device and a second display device as display devices. The robot is self-propelled and causes the display device closer to the robot of the first display device and the second display device to execute display based on information.

  When the other situation of this invention is followed, the server apparatus can communicate with the robot and mobile terminal which can speak. The server device associates the keyword recorded in the mobile terminal with the identification information of the user based on the fact that the user of the mobile terminal speaks a predetermined keyword to the robot and the mobile terminal. When the receiving means for receiving the keyword recorded in the robot from the terminal and the keyword received from the mobile terminal matches the keyword received from the mobile terminal, the identification information received is specified. Transmitting means for transmitting information about the user to the robot.

  According to still another aspect of the present invention, the robot can speak to communicate with the server device. The robot records a keyword based on the fact that a user of a mobile terminal that can communicate with the server device speaks a predetermined keyword to the robot, and transmits the recorded keyword to the server device. Receiving means for receiving information on the user specified by the identification information of the mobile terminal from the server device, on condition that the keyword received from the robot and the keyword received from the mobile terminal match, and information And utterance means for uttering based on.

  If the further another situation of this invention is followed, the information processing method will be performed in the communication system provided with the robot which can speak, a mobile terminal, and the server apparatus. The information processing method is based on the fact that the user of the mobile terminal utters a predetermined keyword to the robot and the mobile terminal, and the mobile terminal records the keyword and stores the recorded keyword. A step of transmitting the keyword to the server device in association with the user identification information; and a step of recording the keyword and transmitting the recorded keyword to the server device. In the information processing method, the server device transmits, to the robot, information related to the user specified by the received identification information when the keyword received from the mobile terminal matches the keyword received from the robot; Further comprising the step of speaking based on the information.

  If the further another situation of this invention is followed, the information processing method will be performed in the server apparatus which can communicate with the robot which can speak, and a mobile terminal. The information processing method is based on the fact that the user of the mobile terminal speaks a predetermined keyword to the robot and the mobile terminal, and moves the keyword recorded in the mobile terminal in association with the identification information of the user. If the keyword received from the mobile terminal and the keyword received from the robot match the keyword received from the mobile terminal and the keyword received from the mobile terminal are identified by the received identification information Transmitting information about the user to the robot.

  According to still another aspect of the present invention, the information processing method is executed in an utterable robot that communicates with a server device. The information processing method includes a step of recording a keyword based on the fact that a user of a mobile terminal that can communicate with the server device speaks a predetermined keyword to the robot, and transmitting the recorded keyword to the server device. Receiving information on the user specified by the identification information of the mobile terminal from the server device on the condition that the keyword received from the robot and the keyword received from the mobile terminal match, and information The robot utters based on

  When the further another situation of this invention is followed, a program controls the server apparatus which can communicate with the robot which can speak, and a mobile terminal. The program associates the keyword recorded in the mobile terminal with the user identification information based on the fact that the user of the mobile terminal speaks a predetermined keyword to the robot and the mobile terminal. When the keyword received from the robot and the keyword received from the mobile terminal match the keyword received from the robot, the step of receiving the keyword recorded by the robot and the keyword received from the robot is related to the user specified by the received identification information And transmitting the information to the robot.

  When the further another situation of this invention is followed, a program controls the robot which can speak and communicates with a server apparatus. The program records a keyword based on the fact that a user of a mobile terminal that can communicate with the server device speaks a predetermined keyword to the robot, and transmits the recorded keyword to the server device; On the basis of the information received from the server device regarding the user specified by the mobile terminal identification information, on the condition that the keyword received from the robot and the keyword received from the mobile terminal match. The robot's processor.

  According to the above invention, the robot can perform customer service according to the individual.

It is a figure showing an example of the place where the communication system concerning this Embodiment is utilized. FIG. 3 is a diagram for explaining an overview of processing executed in the communication system 1; It is a figure for demonstrating the outline | summary of personal DB (Data Base) 3 in which several personal information was stored. It is a figure showing an example of the information output from digital signage. 3 is a sequence diagram for explaining a flow of processing performed in the communication system 1. FIG. 2 is a functional block diagram for explaining a functional configuration of each device constituting the communication system 1. FIG. 2 is a diagram illustrating a typical hardware configuration of wearable terminal 100. FIG. 3 is a diagram illustrating a typical example of a hardware configuration of a server device 200. FIG. 2 is a diagram illustrating a hardware configuration of a robot 300. FIG. 6 is a diagram for explaining an overview of a personal DB 3A stored in the server device 200 instead of the personal DB 3. FIG. It is a figure showing the structure by which the shop 800 is equipped with several digital signage.

The communication system according to each embodiment of the present invention will be described below with reference to the drawings. In the following description, the same reference numerals are assigned to the same members. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
[Embodiment 1]
<A. Outline of processing>
FIG. 1 is a diagram illustrating an example of a place where the communication system according to the present embodiment is used. Referring to FIG. 1, a plurality of passers-by 900 pass in front of a store 800. The store 800 is typically a store that sells products or provides services. In FIG. 1, a boutique that sells products is taken as an example of the store 800.

  A digital signage 400 is installed on the wall surface of the store 800. The digital signage 400 is a display device (for example, a liquid crystal display) for displaying advertisements such as products handled in the store 800.

  In the store 800, a self-propelled robot 300 is arranged to serve customers. As an example, the robot 300 calls the passerby 900 to the store 800 instead of the store clerk of the store 800.

  FIG. 2 is a diagram for explaining an outline of processing executed in the communication system 1. Referring to FIG. 2, the communication system 1 includes a wearable terminal 100 owned by a passerby 900, a server device 200 on the cloud, a robot 300, and a digital signage 400. Hereinafter, processes executed in the communication system 1 will be described in order.

  First, the robot 300 makes an utterance for calling (calling) the store 800 using the robot 300 to a passerby 900 (see FIG. 1) walking in the passage in front of the store 800. (Process (i)). The robot 300 typically utters the call for one or more passers-by 900 selected from the plurality of passers-by 900. Details of the selection process will be described later.

  Each time the robot 300 performs a call, the robot 300 confirms a response to the call (utterance) of the passer-by 900 as a call target (process (ii)). The robot 300 identifies a passer-by 900 that responds to the call (that is, a person who can be determined to be interested in the robot 300) among the plurality of passers-by 900 that the robot 300 has called.

  The robot 300 makes an utterance request for a keyword to the passerby 900 who has responded to the call (processing (iii)). The passerby 900 (passerby 900 shown in FIG. 2) having received the utterance request utters the keyword (process (iv)). Specifically, the passerby 900 utters a keyword to the robot 300 and the wearable terminal 100.

  Wearable terminal 100 records a keyword spoken by passerby 900, and uses the recorded keyword as user identification information (hereinafter referred to as “user ID”) and information indicating the current position of wearable terminal 100 (hereinafter referred to as “user ID”). , Also referred to as “position information”) and transmitted to the server apparatus 200 (process (v)). The robot 300 records a keyword spoken by the passerby 900, and transmits the recorded keyword to the server device 200 in association with the position information of the robot 300 (process (vi)). For convenience of explanation, the configuration in which the processing (vi) is performed after the processing (v) is described as an example, but the processing (v) and the processing (vi) are usually performed in parallel.

  The server device 200 authenticates the passerby 900 by receiving the user ID from the wearable terminal 100. Further, the server device 200 performs a collation process based on the information received from the wearable terminal 100 and the information received from the robot 300 (process (vii)). Specifically, the server device 200 determines whether or not the keyword received from the wearable terminal 100 matches the keyword received from the robot 300. Furthermore, the server apparatus 200 determines whether the current position of the wearable terminal 100 and the current position of the robot 300 match based on the position information received from the wearable terminal 100 and the position information received from the robot 300 (more specifically, Whether or not it is within a predetermined distance).

  When it is determined that the keywords match and the current position of the wearable terminal 100 matches the current position of the robot 300, the server device 200 includes information about the user specified by the received user ID (hereinafter, (Referred to as “personal information”) is transmitted to the robot 300 (process (viii)).

  Based on the reception of personal information of the passer-by 900, the robot 300 performs customer service with the passer-by 900 using the personal information (processing (ix)). Typically, the robot 300 utters the passerby 900 including content that the passerby 900 may be interested in, referring to the personal information. Furthermore, the robot 300 uses the personal information to display on the digital signage 400 an advertisement for a product recommended for the passer-by 900 who is serving customers (processing (x)). That is, the robot 300 changes the advertisement output from the digital signage 400 to an advertisement suitable for the passer-by 900 who is serving customers.

  Here, the “keyword” is information that only the individual can know when applying this system, and the individual can know the information provided according to the keyword (FIG. 10 described later).

  As described above, according to the communication system 1, since the robot 300 uses personal information, it is possible to perform customer service according to the individual. Therefore, the efficiency of customer service using the robot 300 can be improved. Further, since the user ID is acquired from the wearable terminal 100, it is not necessary for the passerby 900 to perform a user ID transmission operation (for example, presentation of an ID card to the robot 300).

  In addition, although the example using the wearable terminal 100 is given in FIG. 2, it is not limited to the wearable terminal 100. The communication system 1 may be configured to use a mobile terminal such as a smartphone. In the above description, it is determined whether the current position of the wearable terminal 100 and the current position of the robot 300 match based on the position information received from the wearable terminal 100 and the position information received from the robot 300. Is not a mandatory process.

<B. Specific contents of processing>
Below, the detail of the process performed with the communication system 1 is demonstrated. Specifically, details of the call to the passer-by 900, details of narrowing (specification) of the customer after the call, details of the keyword request process, and details of the customer after the verification will be described.

<B1. Call to passers-by>
The robot 300 images a plurality of passers-by 900 with a camera mounted on the robot 300, and selects a person to be called out from the plurality of passers-by 900 based on the feature points of the image obtained by the imaging.

  Specifically, the robot 300 determines gender, age (age group), clothes, walking speed, and the like based on the image. As a result, the robot 300 selects a passer-by 900 targeted by the store 800 including the passer-by 900 to be sold for the merchandise to be sold from a plurality of passers-by 900. The robot 300 calls the selected passerby 900 (process (i)).

  More specifically, the robot 300 takes into account the clothes of the selected passer-by 900 and interrogate the features that only the passer-by 900 notices, and performs the call. For example, the robot 300 utters “A lady wearing a hat there, listen to me”.

<B2. Narrow down customer service>
Based on a predetermined criterion, the robot 300 identifies a passer-by 900 that has responded to the call from among a plurality of passers-by 900 that the robot 300 has called. That is, the robot 300 narrows down the customer service from a plurality of passers-by 900 that the robot 300 has called.

  Specifically, when it is determined that the passer-by 900 who the robot 300 has called has performed the following operation as the above-mentioned predetermined reference, the robot 300 is referred to the passer-by 900 who has performed the operation. Narrow down. Examples of the operation include “turned around”, “turned around and smiled”, “has eyes”, “approached toward robot 300”, “talked”, and the like.

<B3. Keyword request processing>
When the above-mentioned narrowing down is performed, the robot 300 requests the narrowed passer-by 900 to speak the keyword as described above (processing (iii) in FIG. 2). Specifically, the robot 300 interlaces the keyword utterance request in the conversation in consideration of the feature points obtained by the imaging. For example, the robot 300 utters "You in yellow clothes, tell me about you. Say the keyword if you like!"

  Wearable terminal 100 displays supplementary explanation on display 1591 (FIG. 7) of wearable terminal 100 based on the utterance of robot 300. Wearable terminal 100 displays, for example, “When you utter a keyword, your personal information will be sent from the cloud to robot 300”. Note that the present invention is not limited to this, and information actually provided may be displayed to allow the user to confirm the information.

<B4. Customer service after verification>
When the server device 200 succeeds in matching keywords and position information, the server device 200 transmits personal information specified based on the user ID to the robot 300. In this case, as described above, the robot 300 performs service to the passer-by 900 using the personal information of the passer-by 900.

  FIG. 3 is a diagram for explaining an overview of a personal DB (Data Base) 3 in which a plurality of personal information is stored. Referring to FIG. 3, in personal DB 3, for each user ID, as personal information, gender, age, hobby, occupation, clothing size, clothing preference, favorite color, possessed clothing, desired product, Various information such as... Is stored.

  The server device 200 transmits the personal information associated with the user ID received from the wearable terminal 100 to the robot 300 among the plurality of personal information. For example, when the server apparatus 200 receives the user ID “80001” from the wearable terminal 100, the gender “male”, the age “28”, the hobby “drive”, the occupation “company employee”, and the clothes size “170 to 175 cm”. , M ”, clothing preference“ mode system ”, favorite color“ black ”,... As described above, the robot 300 performs customer service for the passerby 900 using personal information.

  In addition, as described above, the robot 300 changes the advertisement output from the digital signage 400 to an advertisement suitable for the passer-by 900 who is serving customers. That is, the robot 300 changes the operation mode of the digital signage 400 from the mode for displaying general advertisements to the mode for customer service. Hereinafter, the change process will be described with a specific example.

  FIG. 4 is a diagram illustrating an example of information output from the digital signage 400. FIG. 4A is a diagram showing the advertisement before the change (display contents at normal time), and FIG. 4B is a diagram showing the advertisement after the change. Referring to FIG. 4A, digital signage 400 displays an advertisement for a new product among a plurality of handled products. Referring to FIG. 4B, digital signage 400, as an example, with the start of customer service using personal information, instead of a new product, advertisement of a recommended product to passerby 900 specified by the user ID Is displayed.

  When the robot 300 causes the digital signage 400 to execute such a change process (display content switching process), the robot 300 can serve the passerby 900 with more specific information presentation. It becomes possible. The display change instruction is sent from the robot 300, but the content to be displayed (product advertisement) may be sent from the robot 300 or sent from the server device 200 without going through the robot 300. You may come.

  When the customer service ends, the robot 300 returns the operation mode of the digital signage 400 from the customer service mode to a mode for displaying a general advertisement. Whether the customer service has ended is determined based on, for example, (i) the movement of the target customer such as the target person leaving the robot 300 and the store 800 or the target person proceeding to the cash register at the store 800, or (Ii) Judgment is made based on the fact that the customer-facing person issues a word of “thank you” or refuses customer service to the robot.

<C. Control structure>
FIG. 5 is a sequence diagram for explaining the flow of processing performed in the communication system 1. Referring to FIG. 5, in step S <b> 2, robot 300 calls passer-by 900 to store 800. In step S4, the robot 300 detects the reaction of the passerby 900 using various sensors, cameras, and / or microphones. In step S6, the robot 300 issues a keyword utterance request. In step S8, the spoken keyword is recorded based on the passer-by 900 speaking the keyword. In step S10, wearable terminal 100 records the spoken keyword.

  In step S <b> 12, wearable terminal 100 transmits user ID stored in or input to wearable terminal 100 and position information of wearable terminal 100 to server apparatus 200 in association with the keyword. In step S <b> 14, the robot 300 associates the keyword with the position information of the robot 300 and transmits it to the server device 200.

  In step S <b> 16, server device 200 performs collation using keywords and position information. Specifically, as described above, the server device 200 determines whether or not the keywords match each other and whether or not the current position of the wearable terminal 100 matches the current position of the robot 300. If the verification is successful, the server device 200 extracts personal information from the personal DB 3 based on the user ID received from the wearable terminal 100 in step S18.

  In step S <b> 20, the server device 200 transmits the extracted personal information to the robot 300. In step S22, the robot 300 starts customer service using personal information. In step S <b> 24, the robot 300 transmits product advertisement information to the digital signage 400. In step S <b> 26, the digital signage 400 displays a product advertisement based on the received advertisement information.

<D. Functional configuration>
FIG. 6 is a functional block diagram for explaining a functional configuration of each device (100, 200, 300, 400) constituting the communication system 1. With reference to FIG. 6, the communication system 1 includes the wearable terminal 100, the server device 200, the robot 300, and the digital signage 400 as described above.

(D1. Wearable terminal 100)
The wearable terminal 100 includes a storage unit 101, a control unit 102, a communication processing unit 103, a position information acquisition unit 104, a recording processing unit 105, and a display unit (not shown). The communication processing unit 103 includes a transmission unit 1031 and a reception unit 1032.

  The storage unit 101 stores the operating system of the wearable terminal 100, various application programs, and various data. The storage unit 101 corresponds to a ROM (Read Only Memory) 152, a RAM (Random Access Memory) 153, and a flash memory 154 (FIG. 7), which will be described later.

  The control unit 102 controls the operation of the wearable terminal 100. Specifically, the control unit 102 controls the operation of the wearable terminal 100 based on an operating system and various applications. The control unit 102 is realized by a CPU (Central Processing Unit) 151 (FIG. 7) described later executing an operating system and application programs.

  The communication processing unit 103 is typically used for communication with the server device 200. The transmission unit 1031 transmits various data to the server device 200. The receiving unit 1032 receives various data from the server device 200. The communication processing unit 103 corresponds to a communication IF (InterFace) 157 (FIG. 7) described later.

  The position information acquisition unit 104 acquires position information of the current position of the wearable terminal 100. The position information acquisition unit 104 corresponds to a GPS receiver 162 (FIG. 7) described later.

  The recording processing unit 105 collects sound such as voice and stores it in the storage unit 101. Specifically, the recording processing unit 105 converts the collected analog data into digital data. When the digital data is sent to the control unit 102 by the recording processing unit 105, the digital data is stored in the storage unit 101.

  More specifically, the recording processing unit 105 records a keyword issued by the user of the wearable terminal 100. The control unit 102 associates the recorded keyword, the position information received from the position information acquisition unit 104, and the user ID, and sends the associated keyword to the communication processing unit 103. The transmission unit 1031 associates the keyword, the position information of the wearable terminal 100, and the user ID, and transmits them to the server device 200.

(D2. Server device 200)
The server device 200 includes a storage unit 201, a control unit 202, and a communication processing unit 203. The control unit 202 has a matching processing unit 2021. The communication processing unit 203 includes a transmission unit 2031 and a reception unit 2032.

  The storage unit 201 stores the operating system of the server device 200, various application programs, and various data. The storage unit 201 stores a personal DB 3 (FIG. 3). The storage unit 201 corresponds to a ROM 252, a RAM 253, and an HDD (Hard Disc Drive) 254, which will be described later (FIG. 8).

  The control unit 202 controls the operation of the server device 200. Specifically, the control unit 202 controls the operation of the server device 200 based on an operating system and various applications. The control unit 202 is realized by a CPU 251 (FIG. 8) described later executing an operating system and application programs.

  The communication processing unit 203 is typically used for communication with the wearable terminal 100 and the robot 300. The transmission unit 2031 transmits various data to the wearable terminal 100 and the robot 300. The receiving unit 2032 receives various data from the wearable terminal 100 and the robot 300. The communication processing unit 203 corresponds to a communication IF 257 (FIG. 8) described later.

  More specifically, the receiving unit 2032 receives a keyword, position information of the wearable terminal 100, and a user ID from the wearable terminal 100. The receiving unit 2032 receives a keyword and position information of the server device 200 from the robot 300.

  Collation processing unit 2021 collates the keyword received from wearable terminal 100 with the keyword received from robot 300. Furthermore, the collation processing unit 2021 collates the position information received from the wearable terminal 100 and the position information received from the robot 300. In other words, the collation processing unit 2021 determines whether or not the user of the wearable terminal 100 is near the robot 300.

  When the collation is successful, the control unit 202 reads personal information corresponding to the received user ID from the personal DB 3 stored in the storage unit 201. The transmission unit 2031 transmits the read personal information to the robot 300.

(D3. Robot 300)
The robot 300 includes a storage unit 301, a control unit 302, a communication processing unit 303, a position information acquisition unit 304, an imaging unit 305, an image processing unit 306, a recording processing unit 307, a driving unit 308, and a voice. And an output unit 309. The control unit 302 includes a drive control unit 3021 and an utterance control unit 3022. The communication processing unit 303 includes a transmission unit 3031 and a reception unit 3032.

  The storage unit 301 stores an operating system of the robot 300, various application programs, and various data. The storage unit 301 corresponds to a ROM 352, a RAM 353, and a flash memory 354, which will be described later (FIG. 9).

  The control unit 302 controls the operation of the robot 300. Specifically, the control unit 302 controls the operation of the robot 300 based on an operating system, various applications, and the like. The control unit 302 is realized by a CPU 351 (FIG. 9) described later executing an operating system and application programs.

  The communication processing unit 303 is typically used for communication with the server device 200 and the digital signage 400. The transmission unit 3031 transmits various data to the server device 200 and the digital signage 400. The receiving unit 3032 receives various data from the server device 200 and the digital signage 400. Note that the communication processing unit 303 corresponds to a communication IF 361 (FIG. 9) described later.

  The position information acquisition unit 304 acquires position information on the current position of the robot 300. The position information acquisition unit 304 corresponds to a GPS receiver 358 (FIG. 9) described later.

  The imaging unit 305 images a subject such as a passerby 900. The image processing unit 306 performs predetermined image processing on image data obtained by imaging. The imaging unit 305 and the image processing unit 306 correspond to a camera 357 (FIG. 9) described later.

  The recording processing unit 307 collects sound such as voice and stores it in the storage unit 301. Specifically, the recording processing unit 307 converts the collected analog data into digital data. The digital data is stored in the storage unit 301 by the recording processing unit 307 sending the digital data to the control unit 302.

  The drive control unit 3021 controls driving of the drive unit 308. The drive unit 308 corresponds to a motor 359 and wheels 360 described later (FIG. 9). The robot 300 can run by the drive control unit 3021 and the drive unit 308.

  The utterance control unit 3022 controls the voice output from the voice output unit 309. Specifically, the utterance control unit 3022 controls utterance contents, voice quality, intonation, and the like. The audio output unit 309 corresponds to a speaker 356 (FIG. 9) described later.

  More specifically, the control unit 302 causes the audio output unit 309 to make an utterance for calling the passerby 900 into the store 800. At that time, the control unit 302 selects a person to be called out from the passers-by 900 around the robot 300 based on the feature points of the image obtained by the imaging by the imaging unit 305.

  After performing the calling, the control unit 302 specifies a person who can be determined to be interested in the robot 300 from the passers-by 900 around the robot 300 based on a predetermined criterion. That is, the control unit 302 narrows down passers-by 900. Specifically, as described above, the control unit 302 narrows down the service target to passers-by 900 who have performed a predetermined action. The narrowing down is performed based on the characteristics of the image obtained by the imaging unit 305 (the passer-by 900 turns around), the content of the recorded voice (for example, the passer-by 900 speaks), and the like.

  The control unit 302 causes the narrowed passer-by 900 to output a keyword utterance request from the voice output unit 309 by voice. The recording processing unit 307 records a keyword issued by a passerby 900 (a user of the wearable terminal 100). The control unit 302 associates the recorded keyword with the position information received from the position information acquisition unit 104 and sends the associated keyword to the communication processing unit 303. The transmission unit 3031 associates the keyword with the position information of the robot 300 and transmits it to the server device 200. Thereafter, the receiving unit 3032 receives personal information from the server device 200. The transmission unit 3031 transmits product advertisement information based on the received personal information to the digital signage 400.

(D4. Digital signage 400)
The digital signage 400 includes a storage unit 401, a control unit 402, a communication processing unit 403, and a display unit 404. The control unit 402 includes a display control unit 4021.

  The storage unit 401 stores the operating system of the digital signage 400, various application programs, and various data. The control unit 402 controls the operation of the digital signage 400. Specifically, the control unit 402 controls the operation of the digital signage 400 based on an operating system, various applications, and the like. The communication processing unit 403 is typically used for communication with the robot 300. The transmission unit 4031 transmits to various robots 300. The receiving unit 4032 receives various data from the robot 300.

  A display control unit 4021 controls display of an image on the display unit 404. When the receiving unit 4032 receives the product information described above from the robot 300, the display control unit 4021 changes the display content from displaying the currently displayed information to displaying the product information. For example, the display control unit 4021 performs a process of switching the display content on the display unit 404 from the state of FIG. 4A to the state of FIG.

<E. Hardware configuration>
FIG. 7 is a diagram illustrating a typical example of the hardware configuration of wearable terminal 100. Referring to FIG. 7, wearable terminal 100 includes, as main components, CPU 151 that executes a program, ROM 152 that stores data in a nonvolatile manner, data generated by execution of the program by CPU 151, or an input device. RAM 153 for storing the input data in a volatile manner, flash memory 154 for storing the data in a nonvolatile manner, LED 155, switch 156, communication IF (Interface) 157, power supply circuit 158, touch screen 159, , An operation key 160, a camera 161, a GPS (Global Positioning System) receiver 162, and a microphone 163. Each component is connected to each other by a data bus. The touch screen includes a display 1591 and a touch panel 1592.

  The power supply circuit 158 is a circuit that steps down the voltage of the commercial power received via the outlet and supplies power to each part of the wearable terminal 100. The switch 156 is a main power switch for switching whether or not to supply power to the power circuit 158 and other various push button switches.

  The touch screen 159 is a device for displaying various data and receiving input. The display 1591 includes a screen for displaying an image.

  The communication IF 157 performs data transmission processing for the server device 200 and data reception processing transmitted from the server device 200. The LED 155 is various display lamps that indicate the operating state of the wearable terminal 100. For example, the LED 155 represents the on / off state of the main power supply of the wearable terminal 100, the read / write state to the flash memory 154, and the like. The operation key 160 is a key (operation button) for the user of the wearable terminal 100 to turn on or off the main power. As described above, the camera 161 is an imaging device for imaging a subject such as a person in front of the wearable terminal 100.

  The GPS receiver 162 is a device for acquiring the current position of the wearable terminal 100 using GPS. The microphone 163 is a device for collecting the voice of the user of the wearable terminal 100 and the like. In the present embodiment, the spoken keyword is collected by microphone 163. The collected sound (audio data after digital conversion) is sent to the CPU 151 and subjected to predetermined processing.

  The processing in the wearable terminal 100 is realized by each hardware and software executed by the CPU 151. Such software may be stored in advance in the flash memory 154. The software may be stored in other storage media and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by the reading device or downloaded via the communication IF 157 or the like and then temporarily stored in the flash memory 154. The software is read from the flash memory 154 by the CPU 151 and stored in the RAM 153 in the form of an executable program. CPU 151 executes the program.

  Each component which comprises the wearable terminal 100 shown by the figure is general. Therefore, it can be said that the essential part of the present invention is RAM 153, flash memory 154, software stored in a storage medium, or software that can be downloaded via a network. Since the operation of each hardware of wearable terminal 100 is well known, detailed description will not be repeated.

  The recording medium is not limited to a DVD-RAM, and a fixed program such as a semiconductor memory such as a DVD-ROM, a CD-ROM, an FD, a hard disk, a magnetic tape, a cassette tape, an optical disk, an EEPROM, and a flash ROM is supported. It may be a medium to be used. The recording medium is a non-temporary medium that can be read by the computer. The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

  FIG. 8 is a diagram illustrating a typical example of the hardware configuration of the server apparatus 200. Referring to FIG. 8, server apparatus 200 includes, as main components, CPU 251 that executes a program, ROM 252 that stores data in a nonvolatile manner, data generated by execution of the program by CPU 251, or an input device. RAM 253 for storing the input data in a volatile manner, HDD 254 for storing the data in a nonvolatile manner, LED 255, switch 256, communication IF (Interface) 257, power supply circuit 258, display 259, and operation keys 260. Each component is connected to each other by a data bus.

  The power supply circuit 258 is a circuit that steps down the voltage of the commercial power received via the outlet and supplies power to each part of the server device 200. The switch 256 is a main power switch for switching whether or not to supply power to the power circuit 258 and other various push button switches. The display 259 is a device for displaying various data.

  The communication IF 257 performs processing for transmitting data to the wearable terminal 100 and processing for receiving data transmitted from the wearable terminal 100.

  The LED 255 is various display lamps that indicate the operating state of the server device 200. For example, the LED 255 represents an on or off state of the main power supply of the server apparatus 200, a read or write state to the HDD 254, and the like. The operation key 260 is a key (keyboard) used for the user of the server device 200 to input data to the server device 200.

  The processing in the server device 200 is realized by each hardware and software executed by the CPU 251. Such software may be stored in the HDD 254 in advance. The software may be stored in other storage media and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by a reading device or downloaded via the communication IF 257 or the like and then temporarily stored in the HDD 254. The software is read from the HDD 254 by the CPU 251 and stored in the RAM 253 in the form of an executable program. The CPU 251 executes the program.

  Each component which comprises the server apparatus 200 shown by the figure is a general thing. Therefore, it can be said that the essential part of the present invention is RAM 253, HDD 254, software stored in a storage medium, or software that can be downloaded via a network. Since the operation of each hardware of server device 200 is well known, detailed description will not be repeated.

  The recording medium is not limited to a DVD-RAM, and a fixed program such as a semiconductor memory such as a DVD-ROM, a CD-ROM, an FD, a hard disk, a magnetic tape, a cassette tape, an optical disk, an EEPROM, and a flash ROM is supported. It may be a medium to be used. The recording medium is a non-temporary medium that can be read by the computer. The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

  FIG. 9 is a diagram illustrating a hardware configuration of the robot 300. Referring to FIG. 9, the robot 300 includes a CPU 351 that executes a program, a ROM (Read Only Memory) 352, a RAM (Random Access Memory) 353, a flash memory 354, an operation key 355, a speaker 356, The camera 357, the microphone 358, the GPS receiver 358, the motor 359, the wheel 360, the communication IF (Interface) 361, and the microphone 362 are included at least. The constituent elements 351 to 359 and 361 are connected to each other by a data bus.

  The antenna 113 is connected to the communication IF 112. The antenna 113 and the communication IF 112 are used for wireless communication with other mobile terminals, fixed telephones, and PCs (Personal Computers) via a base station, for example.

  The ROM 352 is a nonvolatile semiconductor memory. The ROM 352 stores a boot program for the robot 300 in advance. The flash memory 354 is a nonvolatile semiconductor memory. The flash memory 354 may be configured as a NAND type as an example. The flash memory 354 volatilely stores various data such as an operating system of the robot 300, various programs for controlling the robot 300, data generated by the robot 300, and data acquired from an external device of the robot 300. .

  The GPS receiver 358 is a device for acquiring the current position of the robot 300 using GPS. The microphone 362 is a device for collecting the voice of the user of the robot 300 and the like. In the present embodiment, the spoken keyword is collected by microphone 362. The collected sound (audio data after digital conversion) is sent to the CPU 351 and subjected to predetermined processing.

  The processing in the robot 300 is realized by each hardware and software executed by the CPU 351. Such software may be stored in advance in the flash memory 354. The software may be stored in a memory card or other storage medium (not shown) and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is downloaded via the antenna 113 and the communication IF 112 and then temporarily stored in the flash memory 354. The software is read from the flash memory 354 by the CPU 351 and further stored in the flash memory 354 in the form of an executable program. The CPU 351 executes the program.

An essential part of the present invention can be said to be software stored in the flash memory 354 or other storage medium, or software that can be downloaded via a network. The recording medium is not limited to DVD-ROM, CD-ROM, FD, and hard disk, but is fixed such as semiconductor memory such as magnetic tape, cassette tape, optical disk, optical card, mask ROM, EPROM, EEPROM, and flash ROM. A medium carrying a program may be used. The recording medium is a non-temporary medium that can be read by the computer. The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.
[Embodiment 2]
In the first embodiment, the configuration in which one piece of personal information is associated with the user ID in the server device 200 has been described. In the present embodiment, a configuration in which a plurality of personal information is associated with a user ID will be described.

  FIG. 10 is a diagram for explaining an overview of the personal DB 3A stored in the server device 200 instead of the personal DB 3. Referring to FIG. 10, in the personal DB 3A, for each user ID and each keyword, as personal information, gender, age, hobby, occupation, clothing size, clothing preference, favorite color, possessed clothing, Various information such as desired products, etc. is stored. That is, in the server device 200, a plurality of keywords can be registered for each individual, and personal information can be registered for each keyword.

  Note that the configuration of the personal DB 3A shown in FIG. 10 is an example, and the size of clothes, the size of shoes, the clothes they have, the destination of goods, etc. can be set as keywords. In this case, the user can convey information without being asked about personal information by speaking a keyword in the dialogue with the robot 300.

  In the case of the above configuration, the following processing is executed. When a plurality of keywords are registered in the server device 200 by the user of the wearable terminal 100, the user utters one of the plurality of keywords in response to the keyword utterance request from the robot 300.

  For example, in the case of a user whose user ID is “80001”, “sunflower” and “frying pan” are registered as keywords. Separate personal information is associated with “sunflower” and “frying pan”.

  In this case, when the user utters “sunflower”, the server device 200 uses personal information as a gender “male”, age “28”, hobby “drive”, Personal information such as size “175 cm, M”, clothes preference “mode system”, favorite color “black” is transmitted to the robot 300. On the other hand, when the user utters “Frying pan”, the server apparatus 200 uses personal information as sex “male”, age “28”, occupation “company employee”, etc. Personal information such as food “Yakiniku” and disliked food “green pepper” is transmitted to the robot 300.

  As described above, the server device 200 transmits personal information corresponding to the keyword to the robot 300. Therefore, the robot 300 uses the personal information corresponding to the keyword spoken by the user to contact the user.

  The user can receive a customer service based on the personal information from the robot 300 by speaking one keyword after considering whether the robot 300 is to be notified of personal information based on any of the keywords. it can. That is, the user can receive different customers from the robot 300 by using different keywords.

The server device 200 may be configured to receive a plurality of keywords from the wearable terminal 100 and notify the robot 300 of each piece of personal information corresponding to each of the plurality of keywords. In the server device 200, each individual can manually or automatically register personal information for a keyword.
[Embodiment 3]
In this embodiment, customer information of a store 800 is stored in the server device 200, and a configuration in which the robot 300 uses customer information when calling is described.

  The server device 200 stores, as customer information, face images of customers who have visited the store before (accurately, feature amounts of faces) and history information of purchased products. When calling, the robot 300 has a content that can be understood only by the customer when the image obtained by the image of the passerby 900 matches the stored image (that is, when the customer can be identified). Make a call. For example, the robot 300 speaks to a customer who has purchased pants “Thank you the other day. The best vest for pants is available.”

  According to such a configuration, it is possible to increase the probability of successful call-in. That is, the possibility that the customer who is the passerby 900 can be served by the robot 300 is increased. As a result, the possibility that the customer can enter the store 800 increases.

Note that the determination of whether the images match may be performed by the robot 300 or the server device 200.
[Embodiment 4]
Prior to calling, the robot 300 may acquire information representing the desire of the user (passerby 900) of the wearable terminal 100 from the wearable terminal 100, and may call that consider the request of the user. For example, when the robot 300 acquires the information “XXX company” from the wearable terminal 100, the user speaks to the user of the wearable terminal 100 that “the latest down jacket made by XXX has arrived”. To do. According to such a configuration, it is possible to increase the probability of successful call-in.
[Embodiment 5]
In the present embodiment, processing in the case where a plurality of digital signage is provided in the store 800 will be described.

  FIG. 11 is a diagram illustrating a configuration in which the store 800 includes a plurality of digital signage. Referring to FIG. 11, a plurality of passers-by 900 pass in front of store 800. Two digital signage 400 </ b> A and 400 </ b> B are installed on the wall surface of the store 800 at positions separated from each other.

  When the robot 300 starts customer service using personal information, the robot 300 displays product information on the digital signage closer to the robot 300 out of the two digital signage 400A and 400B. For example, in the case of FIG. 11, the robot 300 has information on products corresponding to the passer-by 900 who is serving customers using personal information only in the digital signage 400A of the plurality of digital signage 400A, 400B (for example, FIG. 4 (B)) is displayed. That is, the robot 300 changes only the display of the digital signage located near the robot 300.

When the robot 300 performs such processing, the passer-by 900 who is serving customers can easily confirm the information displayed on the digital signage.
[Embodiment 6]
In the first embodiment and the like, the configuration in which the robot 300 does not have a display has been described as an example, but the present invention is not limited to this. When the robot 300 has a display, the robot 300 displays information on the product on the display of the robot 300 instead of displaying information on the product corresponding to the passerby 900 who is serving customers using personal information on the digital signage 400. May be displayed.

<Summary>
(1) The communication system 1 includes a robot 300 capable of speaking, a wearable terminal 100, and a server device 200. Based on the fact that the user of wearable terminal 100 speaks a predetermined keyword to robot 300 and wearable terminal 100, wearable terminal 100 records the keyword, and uses the recorded keyword as user identification information. The robot 300 records the keyword and transmits the recorded keyword to the server device 200. When the keyword received from wearable terminal 100 matches the keyword received from robot 300, server device 200 transmits information (personal information) about the user specified by the received identification information to robot 300. The robot 300 speaks based on the information.

  According to the above configuration, the robot 300 can perform customer service according to the user (individual) of the wearable terminal 100.

  (2) When the keyword is the first keyword, the server device 200 transmits the first information associated with the first keyword to the robot 300 as information, and when the keyword is the second keyword Transmits to the robot 300 the second information associated with the second keyword as information.

  According to the above configuration, the user can receive different customers from the robot 300 by using different keywords.

  (3) The wearable terminal 100 associates the identification information with the first position information indicating the current position of the wearable terminal 100 device and transmits the keyword to the server device 200. The robot 300 associates the second position information indicating the current position of the robot 300 with the keyword, and transmits it to the server device 200. The server device 200 transmits information to the robot 300 on the condition that the current position of the wearable terminal 100 and the current position of the robot 300 match based on the first position information and the second position information. .

  According to the above configuration, information is not transmitted to the robot 300 unless the user of the wearable terminal 100 is near the robot 300. Therefore, transmission of information not intended by the user can be prevented.

  (4) The robot 300 restricts the utterance of information that can be specified by the user when speaking based on the information. According to said structure, it can prevent that the information which can specify individuals, such as a personal name, can be known by others (other passers-by 900).

  (5) The robot 300 identifies a person who can be determined to be interested in the robot 300 from the passers-by 900 around the robot 300 based on a predetermined criterion. Request keyword utterances. When the identified person utters a keyword to the wearable terminal 100 using the robot 300 and the person as a user in response to a request, the wearable terminal 100 associates the keyword with identification information and the server device. 200, the robot 300 transmits the keyword to the server device 200.

  According to the above configuration, a person who can determine that he / she is interested in the robot 300 can receive a customer using the information (personal information).

  (6) The robot 300 further utters the passer-by 900 to call the store using the robot 300. Therefore, the robot 300 can identify the passerby 900 who is likely to receive the customer by confirming the response of the passerby 900.

  (7) The robot 300 images the passerby 900 with the camera 357, and selects a person to be called out from the passerby 900 based on the feature points of the image obtained by the imaging. The robot 300 specifies a person who can be determined to be interested in the robot 300 from among the passers-by 900 around the robot 300 based on a predetermined criterion from among the selected persons. According to the above configuration, it is possible to specify a person who can be determined to be interested in the robot 300 from among the passers-by 900 using the characteristics of the passer-by 900.

  (8) The communication system 1 further includes a digital signage 400. The robot 300 causes the digital signage 400 to execute display based on the information. Therefore, the robot 300 can serve customers using the digital signage 400.

  (9) The communication system 1 includes a digital signage 400A and a digital signage 400B as the digital signage 400. The robot 300 is self-propelled, and causes the digital signage 400 closer to the robot 300 of the digital signage 400A and the digital signage 400B to perform display based on information. According to the above configuration, the robot 300 can serve customers using the digital signage 400 closer to the robot 300.

  (10) The server device 200 can communicate with the robot 300 and the wearable terminal 100 that can speak. The server device 200 associates the keyword recorded in the wearable terminal 100 with the identification information of the user based on the fact that the user of the wearable terminal 100 speaks a predetermined keyword to the robot 300 and the wearable terminal 100. Received from the wearable terminal 100 and received from the receiving unit 2032 that receives the keyword recorded in the robot 300 from the robot 300, and the keyword received from the wearable terminal 100 matches the keyword received from the robot 300. A transmission unit 2031 that transmits information about the user specified by the identification information to the robot 300.

  (11) The robot 300 can speak to communicate with the server device 200. The robot 300 records a keyword based on the fact that a user of the wearable terminal 100 that can communicate with the server apparatus 200 speaks a predetermined keyword to the robot 300, and transmits the recorded keyword to the server apparatus 200. Information on the user specified by the identification information of the wearable terminal 100 from the server device 200 on condition that the transmission unit 3031 matches the keyword received from the robot 300 and the keyword received from the wearable terminal 100. A receiving unit 3032 for receiving and an utterance unit (speech control unit 3022 and voice output unit 309) for uttering based on information are provided.

  The embodiment disclosed this time is an exemplification, and the present invention is not limited to the above contents. The scope of the present invention is defined by the terms of the claims, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  1 communication system, 100 wearable terminal, 200 server device, 300 robot, 400, 400A, 400B digital signage, 800 stores, 900 passers, 3, 3A personal DB.

Claims (16)

A communication system including a robot capable of speaking, a mobile terminal, and a server device,
Based on the user of the mobile terminal speaking a predetermined keyword to the robot and the mobile terminal,
The mobile terminal records the keyword, transmits the recorded keyword to the server device in association with the identification information of the user,
The robot records the keyword and transmits the recorded keyword to the server device.
When the keyword received from the mobile terminal matches the keyword received from the robot, the server device transmits information about the user specified by the received identification information to the robot,
A communication system in which the robot speaks based on the information. The server device
When the keyword is the first keyword, the information is transmitted to the robot as the information, the first information associated with the first keyword,
2. The communication system according to claim 1, wherein when the keyword is a second keyword, second information associated with the second keyword is transmitted to the robot as the information. The mobile terminal associates the identification information with the first location information representing the current location of the mobile terminal device and transmits the keyword to the server device,
The robot associates the keyword with second position information representing the current position of the robot, and transmits the second position information to the server device.
The server device, on the condition that the current position of the mobile terminal and the current position of the robot coincide with each other based on the first position information and the second position information, The communication system according to claim 1, wherein the communication system transmits to a robot.   The communication system according to any one of claims 1 to 3, wherein the robot restricts the utterance of information that can be specified by the user when speaking based on the information. The robot is
Identifying a person who can be determined to be interested in the robot from passers-by around the robot, based on predetermined criteria;
Request the specified person to speak the keyword;
Based on the specified person speaking the keyword to the mobile terminal with the robot and the person as the user in response to the request by the user,
The mobile terminal associates the keyword with the identification information and transmits the keyword to the server device,
The communication system according to claim 1, wherein the robot transmits the keyword to the server device.   The communication system according to claim 5, wherein the robot further utters the passer-by to call a store using the robot. The robot is
Capture passers-by with a camera,
Based on the feature points of the image obtained by the imaging, select the person to be called out from the passers-by,
The person who can judge that he / she is interested in the robot among the passers-by around the robot is specified from the selected person based on the predetermined criterion. The communication system described. The communication system further includes a display device,
The communication system according to claim 1, wherein the robot causes the display device to perform display based on the information. The communication system includes a first display device and a second display device as the display device,
The robot is
Self-propelled,
The communication system according to claim 8, wherein a display device closer to the robot among the first display device and the second display device executes display based on the information. A server device capable of communicating with a robot capable of speaking and a mobile terminal,
Based on the fact that the user of the mobile terminal has uttered a predetermined keyword to the robot and the mobile terminal, the keyword recorded in the mobile terminal is associated with the identification information of the user. Receiving means for receiving from the robot the keyword recorded in the robot and receiving from the mobile terminal;
A server apparatus comprising: a transmission unit configured to transmit information about a user specified by the received identification information to the robot when the keyword received from the mobile terminal matches the keyword received from the robot. An utterable robot that communicates with a server device,
A transmission of recording the keyword and transmitting the recorded keyword to the server device based on the fact that a user of a mobile terminal that can communicate with the server device speaks a predetermined keyword to the robot Means,
Reception that receives information about the user specified by the identification information of the mobile terminal from the server device, on condition that the keyword received from the robot matches the keyword received from the mobile terminal Means,
A robot comprising speech means for speaking based on the information. An information processing method in a communication system including a robot capable of speaking, a mobile terminal, and a server device,
Based on the user of the mobile terminal speaking a predetermined keyword to the robot and the mobile terminal,
The mobile terminal recording the keyword and transmitting the recorded keyword to the server device in association with the user identification information;
The robot recording the keyword and transmitting the recorded keyword to the server device;
When the server device matches the keyword received from the mobile terminal and the keyword received from the robot, the information about the user specified by the received identification information to the robot,
The robot includes a step of speaking based on the information. An information processing method in a server device capable of communicating with a robot capable of speaking and a mobile terminal,
Based on the fact that the user of the mobile terminal has uttered a predetermined keyword to the robot and the mobile terminal, the keyword recorded in the mobile terminal is associated with the identification information of the user. Receiving from the mobile terminal the keyword recorded in the robot and received from the robot;
An information processing method comprising: transmitting information related to a user specified by the received identification information to the robot when the keyword received from the mobile terminal matches the keyword received from the robot. An information processing method in an utterable robot that communicates with a server device,
Recording a keyword based on the fact that a user of a mobile terminal capable of communicating with the server device speaks a predetermined keyword to the robot, and transmitting the recorded keyword to the server device When,
Receiving information on the user specified by the identification information of the mobile terminal from the server device on the condition that the keyword received from the robot matches the keyword received from the mobile terminal. When,
And a step of speaking by the robot based on the information. A program for controlling a robot capable of speaking and a server device capable of communicating with a mobile terminal,
Based on the fact that the user of the mobile terminal has uttered a predetermined keyword to the robot and the mobile terminal, the keyword recorded in the mobile terminal is associated with the identification information of the user. Receiving from the mobile terminal the keyword recorded in the robot and received from the robot;
A step of transmitting information relating to a user specified by the received identification information to the robot when the keyword received from the mobile terminal matches the keyword received from the robot; A program to be executed. A program for controlling an utterable robot that communicates with a server device,
Recording a keyword based on the fact that a user of a mobile terminal capable of communicating with the server device speaks a predetermined keyword to the robot, and transmitting the recorded keyword to the server device When,
Receiving information on the user specified by the identification information of the mobile terminal from the server device on the condition that the keyword received from the robot matches the keyword received from the mobile terminal. When,
A program for causing a processor of the robot to execute a step of speaking based on the information.

Images