JP2017152913A - Communication system, communication terminal, server device, and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication system allowing a user to have, in a predetermined location, conversation suitable for the location.SOLUTION: A portable communication terminal 100 allowing a user to have conversation and autonomously imaging the surroundings determines whether the communication terminal 100 arrives at a predetermined location based on positional information representing a current position of the communication terminal 100. The communication terminal 100 images the surroundings of the communication terminal 100 using a camera in the predetermined location. The communication terminal 100 transmits to a server device 200, positional information of the predetermined location and image data which are obtained by the imaging. The server device 200 generates dictionary data for voice recognition based on the positional information and the image data that are sent from the communication terminal 100. The server device 200 transmits the generated dictionary data to the communication terminal 100. The communication terminal 100 makes a conversation with a user 700 using the dictionary data based on receiving the dictionary data.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a communication system including a server device and a communication terminal, the communication terminal, the server device, and an information processing method in these systems, terminals, and devices.

  Conventionally, a voice recognition system is known. In the speech recognition system, dictionary data for speech recognition is used.

  For example, a speech recognition system disclosed in Japanese Patent Laying-Open No. 2015-079237 (Patent Document 1) generates a location vocabulary that is dictionary data related to a location, and performs speech recognition using the generated location vocabulary.

  In addition, the speech recognition system disclosed in Japanese Patent Application Laid-Open No. 2006-195302 (Patent Document 2) includes a place where a vehicle is traveling (specifically, each of an urban area, a mountainous area, and an expressway) and the vehicle. A configuration is disclosed in which dictionary data for voice recognition is switched based on image data obtained by imaging the movement of the passenger's mouth.

  Japanese Unexamined Patent Application Publication No. 2001-154893 (Patent Document 3) discloses a portable and conversational robot. The robot acts based on the voice recognition result. In addition, the robot captures an image of the surroundings of the robot and recognizes an image obtained by the imaging. Further, the robot controls the weighting for the word that is the target of speech recognition based on the image recognition result.

Japanese Patent Laying-Open No. 2015-079237 JP 2006-195302 A JP 2001-154893 A

  However, in a conventional system or the like, a conversation suitable for the current location cannot be performed with the user.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a communication system in which a communication terminal can carry out a conversation suitable for a current location with a user, and communication constituting the communication system. An object is to provide a terminal and a server device, and an information processing method in the communication system, the communication terminal, and the server device.

  According to an aspect of the present invention, a communication system includes a server device and a portable communication terminal that can talk and autonomously image the surroundings. The communication terminal determines whether the communication terminal has arrived at a predetermined location based on position information indicating the current position of the communication terminal. The communication terminal images the surroundings of the communication terminal with a camera at the predetermined location. The communication terminal transmits the position information of the predetermined location and the first image data obtained by the imaging to the server device.

  The server device generates dictionary data for speech recognition based on the position information and the first image data sent from the communication terminal. The server device transmits the generated dictionary data to the communication terminal. The communication terminal has a conversation with the user of the communication terminal using the dictionary data based on the reception of the dictionary data.

  According to another aspect of the present invention, the communication terminal is a portable terminal capable of talking and autonomously imaging the surroundings. The communication terminal uses the voice input unit and the voice output unit, based on the conversation control means configured to have a conversation with the user of the communication terminal, and the position information indicating the current position of the communication terminal. Determination means for determining whether or not the terminal has arrived at a predetermined location; imaging means for imaging the periphery of the communication terminal with a camera at the predetermined location; and the position of the predetermined location Transmitting means for transmitting information and image data obtained by the imaging to the server device, and dictionary data for speech recognition generated based on the position information and the image data are received from the server device. Receiving means. The conversation control means has a conversation with the user of the communication terminal using the dictionary data.

  According to still another aspect of the present invention, the server device communicates with a portable communication terminal that can talk and autonomously image the surroundings. The server device receives the image data of the subject imaged at the predetermined location by the communication terminal and the position information of the predetermined location from the communication terminal, and is sent from the communication terminal. Based on the received position information and the image data, there is provided dictionary data generating means for generating dictionary data for speech recognition, and transmitting means for transmitting the generated dictionary data to the communication terminal.

  If the further another situation of this invention is followed, the information processing method will be performed in the communication system provided with the server apparatus and the portable communication terminal in which the conversation is possible and the surroundings can be imaged autonomously. The information processing method includes the step of determining whether or not the communication terminal has arrived at a predetermined location based on position information indicating a current position of the communication terminal; In a predetermined place, the step of imaging the surroundings of the communication terminal with a camera, the communication terminal, the position information of the predetermined place, and the first image data obtained by the imaging, Transmitting to the server device, the server device generating dictionary data for speech recognition based on the position information and the first image data sent from the communication terminal, and the server A device transmitting the generated dictionary data to the communication terminal; and the communication terminal receiving the dictionary data based on the dictionary data. And a step of performing user and conversation of the communication terminal using the.

  According to still another aspect of the present invention, the information processing method is executed in a portable communication terminal capable of conversation and autonomously imaging the surroundings. According to an information processing method, the communication terminal is predetermined based on a step of having a conversation with a user of the communication terminal using a voice input unit and a voice output unit, and position information indicating a current position of the communication terminal. A step of determining whether or not the vehicle has arrived; a step of capturing an image of the surroundings of the communication terminal by a camera at the predetermined location; position information of the predetermined location; and Transmitting the received image data to the server device, and receiving dictionary data for speech recognition generated based on the position information and the image data from the server device. In the conversation step, the dictionary data is used to perform a conversation with the user of the communication terminal.

  If the further another situation of this invention is followed, the information processing method will be performed in the server apparatus which communicates with the portable communication terminal in which the conversation is possible and the surroundings can be imaged autonomously. An information processing method includes: receiving from the communication terminal image data of a subject imaged at a predetermined location by the communication terminal; and position information of the predetermined location from the communication terminal; Based on the received position information and the image data, there are provided a step of generating dictionary data for speech recognition, and a step of transmitting the generated dictionary data to the communication terminal.

  According to the present invention, it becomes possible for a communication terminal to perform a conversation suitable for a current location with a user.

It is a figure for demonstrating schematic structure of the communication system concerning this Embodiment. It is a figure for demonstrating the process when a communication terminal arrives at a restaurant. It is a figure for demonstrating in detail the process performed at a restaurant. It is a figure showing the typical example of the hardware constitutions of the communication terminal. It is a figure showing the typical example of the hardware constitutions of a server apparatus. It is a figure showing the state where the user is going to the restaurant which is a destination from a house according to schedule data. It is a functional block diagram for demonstrating the functional structure of a communication terminal. It is a figure for demonstrating schematic structure of the visit history information memorize | stored in the memory | storage part. It is a functional block diagram for demonstrating the functional structure of a server apparatus. It is a figure for demonstrating schematic structure of the data table memorize | stored in the memory | storage part of the server apparatus. It is a sequence chart for demonstrating the flow of a process in a communication system. It is a flowchart for demonstrating the flow of the process performed with a communication terminal. It is a flowchart for demonstrating the flow of the process performed with a server apparatus.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[Embodiment 1]
<A. System configuration>
FIG. 1 is a diagram for explaining a schematic configuration of a communication system according to the present embodiment. Referring to FIG. 1, the communication system 1 includes a portable communication terminal 100 that can talk and that can autonomously image the surroundings, and a server device 200. Hereinafter, as the communication terminal 100, a terminal (so-called robot-type terminal) that can automatically move a movable part that configures a housing by executing a program will be described as an example.

  Specifically, the communication terminal 100 includes a hand, a foot, a head, a torso, and the like. The communication terminal 100 is typically configured as an autonomous mobile body capable of walking. The head is configured to be rotatable within a predetermined angle with respect to the trunk. The head has a built-in camera. The communication terminal 100 is not limited to the humanoid robot as described above.

  The communication terminal 100 is used in various places by being carried by the user 700. Communication terminal 100 communicates with server apparatus 200 via base station 500 and network 600.

<B. Outline of processing>
Hereinafter, an outline of processing in the communication system 1 will be described. The communication terminal 100 determines whether or not the communication terminal 100 has arrived at a predetermined location based on position information indicating the current location of the communication terminal 100. Hereinafter, the restaurant 300, which is one of the destinations of the user 700, will be described as an example of the predetermined place.

  FIG. 2 is a diagram for explaining processing when the communication terminal 100 arrives at the restaurant 300. Referring to FIG. 2, communication terminal 100 captures an image of surroundings of communication terminal 100 with a built-in camera in restaurant 300.

  The communication terminal 100 images the inside of the restaurant 300 by changing the direction of the built-in camera. By such imaging, the communication terminal 100 can, for example, have a menu 921 placed on the table 911, a menu 923 hung on the wall, a dish placed on the table, a plate placed on the table, and a glass placed on the table. It is possible to obtain image data in which the staff's name tag and other information in the store are reflected.

  Note that the communication terminal 100 can change the orientation of the camera without walking by rotating the head with a built-in camera relative to the torso. The communication terminal 100 may change the position and orientation of the camera by a combination of walking and head rotation.

  FIG. 3 is a diagram for explaining in detail the processing performed in the restaurant 300. Referring to FIG. 3, when communication terminal 100 arrives at restaurant 300, a predetermined notification process is executed.

  Specifically, communication terminal 100 performs an utterance for obtaining permission for imaging by a camera from user 700 of communication terminal 100. Specifically, the communication terminal 100 performs an utterance to obtain permission for imaging around the communication terminal 100 from the user 700.

  For example, since the communication terminal 100 is in a bag or a pocket of clothes possessed by the user 700, and the voice does not reach the user 700 even when the communication terminal 100 speaks, the communication terminal 100 Before, you may vibrate with a built-in vibrator. Alternatively, in such a case, the communication terminal 100 may sound a predetermined alarm. As an example, whether or not the communication terminal 100 is in the back can be determined by the brightness around the communication terminal 100.

  When the user 700 makes an utterance that gives an imaging permission to the communication terminal 100, the communication terminal 100 starts imaging around the communication terminal 100. The imaging conditions can be set as appropriate in advance. For example, the imaging time interval (imaging cycle) can be set to a preset time interval. The time interval may be set based on the change time of the camera orientation. It is also possible to define an upper limit for the number of images to be captured. Furthermore, the communication terminal 100 may be configured so that the imaging conditions can be set by speaking before allowing the imaging.

  Note that the utterance giving the imaging permission may be a special phrase set in advance, as well as a commonly used word (for example, “good”, “OK”, etc.).

  When imaging is performed, the communication terminal 100 transmits image data obtained by the imaging to the server device 200 together with the position information of the current location of the communication terminal 100. The transmission of the image data only needs to be associated with the position information, and all the image data may be sent collectively to the server device after all imaging is completed, or the image data is sequentially transmitted for each imaging, You may transmit to the server apparatus 200.

  The server device 200 generates user dictionary data for voice recognition based on the position information and image data sent from the communication terminal 100. The server device 200 transmits the generated user dictionary data to the communication terminal 100.

  Specifically, the server device 200 determines a keyword related to the restaurant 300 that is a predetermined place using the position information and the image data. More specifically, the server device 200 determines a keyword related to the restaurant 300 using position information, image data, and a database prepared in advance (FIG. 10). Further, the server device 200 generates user dictionary data using the determined keyword, and transmits the user dictionary data to the communication terminal 100.

  The communication terminal 100 receives user dictionary data from the server device 200. The communication terminal 100 has a conversation with the user 700 by performing voice recognition using the user dictionary data.

  As described above, the server device 200 generates user dictionary data using a keyword determined based on position information of a predetermined place and image data of the place. Therefore, the server device 200 generates user dictionary data including a lot of data related to a predetermined place, rather than a configuration in which a keyword is determined without using at least one of the position information and the image data. It becomes possible.

  Therefore, by using such user dictionary data, the communication terminal 100 can perform a conversation with a user that is suitable for a predetermined place as compared to a configuration that does not use the user dictionary data.

  In addition, in the above, the case where only the inside of the restaurant 300 is imaged is described as an example, but the present invention is not limited to this. When the communication terminal 100 arrives in front of the restaurant 300, the user 700 may make an utterance for obtaining an imaging permission.

  Further, the place where the utterance of permission for photographing is performed may be a place away from the restaurant 300. That is, the place where the communication terminal 100 starts imaging may be a place away from the restaurant 300.

  Hereinafter, as described above, a description will be given of a configuration in which an utterance for obtaining imaging permission is given to the user 700 before the communication terminal 100 arrives in front of the restaurant 300. Specifically, a configuration in which imaging is started when the communication terminal 100 reaches a place away from the restaurant 300 by a predetermined distance on the condition that the communication terminal 100 has obtained imaging permission.

<C. Hardware configuration>
FIG. 4 is a diagram illustrating a typical example of the hardware configuration of the communication terminal 100. Referring to FIG. 4, communication terminal 100 includes, as main components, CPU 151 that executes a program, ROM 152 that stores data in a nonvolatile manner, data generated by execution of the program by CPU 151, or an input device. RAM 153 for storing the input data in a volatile manner, flash memory 154 for storing the data in a nonvolatile manner, LED 155, operation keys 156, switch 157, GPS (Global Positioning System) receiver 158, communication It includes an IF 159, a power supply circuit 160, a touch screen 161, a microphone 162, a speaker 163, a camera 164, a driving device 165, and antennas 1581 and 1591. Each component is connected to each other by a data bus.

  The touch screen 161 includes a display 1611 and a touch panel 1612. The antenna 1581 is an antenna for the GPS receiver 158. The antenna 1591 is an antenna for the communication IF 159.

  The LED 155 is various display lamps that indicate the operation state of the communication terminal 100. For example, the LED 155 represents an on or off state of the main power supply of the communication terminal 100, a read or write state to the flash memory 154, and the like.

  The operation key 156 is a key (operation button) for the user of the communication terminal 100 to turn on or off the main power. The switch 157 is a main power switch for switching whether or not to supply power to the power circuit 160 and other various push button switches.

  The GPS receiver 158 acquires position information on the current position of the communication terminal 100 based on radio waves from GPS satellites. The position information acquired by the GPS receiver 158 is transmitted to the server device 200 via the communication ID 159. The start timing of acquisition of position information by the communication terminal 100 will be described later.

  The communication IF 159 performs processing for transmitting data to the server device 200 and processing for receiving data transmitted from the server device 200.

  The power supply circuit 160 is a circuit that steps down the voltage of the commercial power received via the outlet and supplies power to each part of the communication terminal 100.

  The touch screen 161 is a device for displaying various data and receiving input. The display 1611 includes a screen for displaying an image.

  The microphone 162 collects sounds around the communication terminal 100. For example, the microphone 162 collects sound based on the utterance of the user 700.

  The speaker 163 outputs sound. The speaker 163 speaks for communication with a user or the like in a certain aspect.

  The camera 164 is an imaging device for imaging a subject around the communication terminal 100. Image data obtained by imaging with the camera 164 is transmitted to the server apparatus 200 via the communication ID 159.

  The driving device 165 is a driving mechanism for driving the hand, foot, and head of the communication terminal 100. Note that the communication terminal 100 walks when the foot is driven by the driving device 165. Further, the direction of the camera 164 is changed when the head is rotated with respect to the trunk by the driving device 165.

  The processing in the communication terminal 100 is realized by each hardware and software executed by the CPU 151. Such software may be stored in advance in the flash memory 154. The software may be stored in other storage media and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by the reading device or downloaded via the communication IF 159 or the like and then temporarily stored in the flash memory 154. The software is read from the flash memory 154 by the CPU 151 and stored in the RAM 153 in the form of an executable program. CPU 151 executes the program.

  Each component which comprises the communication terminal 100 shown by the figure is a general thing. Therefore, it can be said that the essential part of the present invention is RAM 153, flash memory 154, software stored in a storage medium, or software that can be downloaded via a network. In addition, since the operation | movement of each hardware of the communication terminal 100 is known, detailed description is not repeated.

  The recording medium is not limited to a DVD-RAM, and a fixed program such as a semiconductor memory such as a DVD-ROM, a CD-ROM, an FD, a hard disk, a magnetic tape, a cassette tape, an optical disk, an EEPROM, and a flash ROM is supported. It may be a medium for The recording medium is a non-temporary medium that can be read by the computer. The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

  FIG. 5 is a diagram illustrating a typical example of the hardware configuration of the server apparatus 200. Referring to FIG. 5, server apparatus 200 includes, as main components, CPU 251 that executes a program, ROM 252 that stores data in a nonvolatile manner, data generated by execution of the program by CPU 251, or an input device. RAM 253 for storing the input data in a volatile manner, HDD 254 for storing the data in a nonvolatile manner, LED 255, switch 256, communication IF (Interface) 257, power supply circuit 258, display 259, and operation keys 260. Each component is connected to each other by a data bus.

  The power supply circuit 258 is a circuit that steps down the voltage of the commercial power received via the outlet and supplies power to each part of the server device 200. The switch 256 is a main power switch for switching whether or not to supply power to the power circuit 258 and other various push button switches. The display 259 is a device for displaying various data.

  Communication IF 257 performs a data transmission process for communication terminal 100 and a data reception process for data transmitted from communication terminal 100.

  The LED 255 is various display lamps that indicate the operating state of the server device 200. For example, the LED 255 represents an on or off state of the main power supply of the server apparatus 200, a read or write state to the HDD 254, and the like. The operation key 260 is a key (keyboard) used for the user of the server device 200 to input data to the server device 200.

  The processing in the server device 200 is realized by each hardware and software executed by the CPU 251. Such software may be stored in the HDD 254 in advance. The software may be stored in other storage media and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by a reading device or downloaded via the communication IF 257 or the like and then temporarily stored in the HDD 254. The software is read from the HDD 254 by the CPU 251 and stored in the RAM 253 in the form of an executable program. The CPU 251 executes the program.

  Each component which comprises the server apparatus 200 shown by the figure is a general thing. Therefore, it can be said that the essential part of the present invention is RAM 253, HDD 254, software stored in a storage medium, or software that can be downloaded via a network. Since the operation of each hardware of server device 200 is well known, detailed description will not be repeated.

  The recording medium is not limited to a DVD-RAM, and a fixed program such as a semiconductor memory such as a DVD-ROM, a CD-ROM, an FD, a hard disk, a magnetic tape, a cassette tape, an optical disk, an EEPROM, and a flash ROM is supported. It may be a medium for The recording medium is a non-temporary medium that can be read by the computer. The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

<D. Details of processing>
(D1. Data transmission of communication terminal 100)
FIG. 6 is a diagram showing a state in which the user 700 is heading from the home 800 to the restaurant 300 as a destination (predetermined place) according to the schedule data.

  Referring to FIG. 6, user 700 leaves home 800 in order to go to restaurant 300 with position of communication terminal 100 (position P0). FIG. 6 shows a state in which the user 700 is carrying the communication terminal 100 in a dedicated case 400.

  When the communication terminal 100 determines that the time difference t between the current time T1 and the scheduled time T0 registered in the schedule book (for example, the reservation time of the restaurant 300) is equal to or less than the threshold Th1 (position P1), the communication terminal 100 Acquisition of position information is started at a predetermined cycle. Furthermore, the communication terminal 100 transmits to the server apparatus 200 the name of the destination, the number information indicating the number of times the destination has been visited in the past, and the number of days information indicating the number of days elapsed since the previous visit. The destination name, the number of times information, and the number of days information may be transmitted only once.

  If the communication terminal 100 determines that the distance D between the current location and the destination is equal to or less than the threshold Th2 (position P2), the communication terminal 100 performs an utterance (notification process) for obtaining permission for imaging. The communication terminal 100 images the surroundings of the communication terminal 100 at a cycle (timing) in which M images (M is a natural number) are imaged per minute on the condition that permission for imaging is obtained from the user 700.

  Communication terminal 100 starts transmission of position information when imaging is performed and a plurality of pieces of image data obtained by imaging to server device 200. Further, the transmission of the position information and the image data is performed until the communication terminal 100 arrives at the destination.

  More specifically, the communication terminal 100 calculates a required time T2 to reach the destination from the moving speed Vm of the communication terminal 100 and the threshold value Th2, and images per minute at a rate of (N−M) / T2. Increase the number. N is a natural number larger than M.

(D2. Functional configuration of communication terminal 100)
FIG. 7 is a functional block diagram for explaining a functional configuration of the communication terminal 100. Referring to FIG. 7, communication terminal 100 includes control unit 111, storage unit 112, position information acquisition unit 113, imaging unit 114, drive unit 115, audio input unit 116, and audio output unit 117. And a communication processing unit 118.

  The control unit 111 controls the overall operation of the communication terminal 100. The control unit 111 includes a display control unit 1111, a conversation control unit 1112, a drive control unit 1113, an interval calculation unit 1114, and a determination unit 1115.

  The communication processing unit 118 is used for communication with the server device 200 via the network 600. The communication processing unit 118 includes a transmission unit 1181 for transmitting data to the server device 200 and a reception unit 1182 for receiving data from the server device 200.

  The storage unit 112 stores an operating system, a plurality of application programs, visit history information D8, destination position information, schedule data, and threshold values Th1 and Th2. Further, the storage unit 112 stores image data of the subject imaged by the imaging unit 114. The storage unit 112 stores the user dictionary data based on the reception of the user dictionary data for speech recognition from the server device 200. If the user dictionary data is already stored in the storage unit 112, the user dictionary data already stored in the storage unit 112 is updated with the user dictionary data newly received from the server device 200. The update of the user dictionary data may be a replacement of the user dictionary data or an addition of a data difference.

  The schedule data is data input by the user using a schedule book application or the like. The schedule data includes date and time information, destination information, and the like. For example, in the schedule data, contents such as “meal at the restaurant 300 at 13:00 on March 1, 2016” are described.

  In the destination location information, as an example, location information of a visited location (for example, restaurant 300) set in the schedule data is stored. The position information is acquired from various server devices via the network 600 via the communication processing unit 118. Specifically, the control unit 111 reads out the visited place described in the schedule data, and acquires the position information of the visited place. The location information of the visited place may be latitude and longitude information or address information.

  The visit history information D8 is generated based on the schedule data and the location information of the destination. In the visit history information D8, the visit date / time and position information are stored in association with the name of the place visited in the past (FIG. 8).

  The position information acquisition unit 113 starts acquiring the position information of the current position of the communication terminal 100 when the time difference t described above becomes equal to or less than the threshold Th1. The position information acquisition unit 113 sends the acquired position information to the control unit 111. In this case, the determination unit 1115 of the control unit 111 determines whether or not the communication terminal 100 has arrived at a predetermined location (for example, a destination such as the restaurant 300) based on the acquired position information.

  When the distance D becomes equal to or smaller than the threshold Th2, the imaging unit 114 starts imaging around the communication terminal 100 and sends image data obtained by the imaging to the control unit 111. Note that the imaging processing by the imaging unit 114 is performed based on a command from the control unit 111. For example, the control unit 111 sequentially changes the orientation of the imaging unit 114 and causes the imaging unit 114 to perform imaging. Further, the control unit 111 controls the imaging timing as described above.

  When imaging by the imaging unit 114 is started, the control unit 111 associates the image data obtained by imaging with the position information of the place where the imaging is performed via the transmission unit 1181, and the server device 200. The process to send to is started.

  The voice input unit 116 collects voices around the communication terminal 100 and sends the collected voices to the control unit 111 as digital data.

The display control unit 1111 of the control unit 111 causes the display unit 119 to display various types of information.
Control for driving the drive control unit 1113 and the drive unit 115 is executed. Thereby, the communication terminal 100 can move the movable part. For example, when the communication terminal 100 arrives at a destination (for example, a restaurant 300), the communication terminal 100 can walk or rotate the head with respect to the torso. As a result, the communication terminal 100 can change the position and orientation of the imaging unit 114.

  Based on the visit history information D8, the control unit 111 calculates the number of times the current destination has been visited in the past. The calculated result is stored in the storage unit 112. As described above, the communication terminal 100 stores the frequency information indicating the number of times the user has visited the destination in the past.

  The interval calculation unit 1114 calculates the date interval between the current visit and the previous visit. That is, the interval calculation unit 1114 calculates the number of days that have elapsed since the last visit.

  The control unit 111 associates the number-of-times information and the number of days information indicating the number of days elapsed since the previous visit with the image data obtained by the imaging and the position information of the place where the imaging is performed, The data is transmitted to the server apparatus 200 via 118.

  Further, the control unit 111 transmits the above-described data and information to the server device 200, and then transmits the user dictionary data generated by the server device 200 based on these data and information via the receiving unit 1182 to the server device. 200. User dictionary data is stored in the storage unit 112.

  The conversation control unit 1112 controls the conversation with the user. Further, the conversation control unit 1112 analyzes the voice data input from the voice input unit 116 and causes the voice output unit 117 to output (speak) the contents based on the analysis result. Specifically, the conversation control unit 1112 starts a conversation using the user dictionary data acquired from the server device 200.

  Note that the position information acquisition unit 113, the imaging unit 114, the drive unit 115, the audio input unit 116, the audio output unit 117, the communication processing unit 118, and the display unit 119 are respectively the GPS receiver 158, the camera 164, This corresponds to the driving device 165, the microphone 162, the speaker 163, the communication IF 159, and the display 1611. The control unit 111 is realized by the CPU 151 executing an operating system and various programs stored in the memory. The storage unit 112 corresponds to the memory of FIG. Further, how to use the threshold values Th1 and Th2 will be described later.

  FIG. 8 is a diagram for explaining a schematic configuration of the visit history information D8 stored in the storage unit 112. Referring to FIG. 8, the visit history information D8 includes a name of a visited place, a visit date / time, and latitude / longitude information. The visit history information D8 may include address information together with the latitude / longitude information or instead of the latitude / longitude information. As described above, the control unit 111 generates the number of times information and the number of days information based on the visit history information D8.

(D3. Functional configuration of server device 200)
FIG. 9 is a functional block diagram for explaining a functional configuration of the server apparatus 200. Referring to FIG. 9, server apparatus 200 includes a control unit 211, a storage unit 212, and a communication processing unit 213.

  The control unit 211 controls the overall operation of the server device 200. The control unit 211 includes a keyword determination unit 2111 and a dictionary data generation unit 2112.

  The storage unit 212 stores an operating system, a plurality of application programs, a data table D10, and a dictionary data table.

  The communication processing unit 213 performs communication processing with the communication terminal 100 via the network 600. The communication processing unit 213 includes a transmission unit 2131 and a reception unit 2132. Specifically, in a certain aspect, receiving unit 2132 receives position information, image data, number-of-times information, and number-of-days information from communication terminal 100. These data (position information, image data, number of times information, number of days information) are stored in the storage unit 212 by the control unit 211.

  The keyword determination unit 2111 of the control unit 211 uses the various data received from the communication terminal 100 (position information, image data, number of times information, and number of days information) and the data table D10 (FIG. 10) to select keywords. decide. A specific example of the keyword determination method will be described later.

  The dictionary data generation unit 2112 generates user dictionary data based on the keyword determined by the keyword determination unit 2111 and the dictionary database stored in the storage unit 212. Note that generation of user dictionary data from a keyword uses a conventionally known method, and thus will not be described here.

  The control unit 211 transmits the generated user dictionary data to the communication terminal 100 via the transmission unit 2131.

  FIG. 10 is a diagram for explaining a schematic configuration of the data table D10 stored in the storage unit 212 of the server device 200. Referring to FIG. 10, data table D10 includes a data table for each genre.

  Each data table is divided based on the number of days and the number of visits. For example, in each data table, the interval of days is divided into three categories of less than one month, more than one month, less than one year, and more than one year. In each data table, the number of visits is divided into three categories: first time, second time, third time or more. That is, each data table is divided into nine sections, and in principle, a plurality of items are stored in each section.

  Focusing on one category, priorities are assigned to a plurality of items. For example, in less than one month and the first division (upper left column), the priority of “landscape around the building” is first and the priority of “appearance of the building” is second.

Details of the keyword determination method using the data table D10 will be described later.
(D4. Control structure)
FIG. 11 is a sequence chart for explaining the flow of processing in the communication system 1. Referring to FIG. 11, in sequence SQ2, if communication terminal 100 determines that time difference t has become equal to or less than threshold value Th1, it starts acquiring position information at a predetermined cycle. In sequence SQ4, when the communication terminal 100 determines that the distance D is equal to or less than the threshold value Th2, the communication terminal 100 starts imaging of the surroundings. In sequence SQ6, communication terminal 100 transmits position information, image data, number-of-times information, and number-of-days information to server apparatus 200.

  In sequence SQ8, server device 200 determines a keyword using position information, image data, number-of-times information, number-of-days information, and data table D10. In sequence SQ10, server device 200 generates user dictionary data using a keyword. In sequence SQ12, server device 200 transmits the generated user dictionary data to communication terminal 100.

  In sequence SQ14, communication terminal 100 performs a conversation using the user dictionary data received from server device 200.

  FIG. 12 is a flowchart for explaining the flow of processing performed in communication terminal 100. With reference to FIG. 12, in step S102, the communication terminal 100 determines whether or not the time difference t between the current time T1 and the scheduled time T0 is equal to or less than a threshold value Th1. When communication terminal 100 determines that time difference t has become equal to or smaller than threshold value Th1 (YES in step S102), it starts acquiring position information of the current location in step S104. If communication terminal 100 determines that time difference t is not equal to or smaller than threshold value Th1 (NO in step S102), the process returns to step S102.

  In step S <b> 106, the communication terminal 100 calculates the destination name, the number of times the destination has been visited in the past, and the number of days elapsed since the previous visit, and transmits the calculation result to the server device 200. That is, the communication terminal 100 transmits the number information and the day number information to the server device 200. Note that the transmission timing of the number information and the day information is not limited to this timing. For example, the communication terminal 100 may be configured to transmit the destination name, the number-of-times information, and the number-of-days information together with the position information and the image data.

  In step S108, the communication terminal 100 determines whether or not the distance D between the current position and the destination is equal to or less than the threshold value Th2. When communication terminal 100 determines that distance D is equal to or smaller than threshold value Th2 (YES in step S108), in step S110, utterance for obtaining permission for imaging is performed. If communication terminal 100 determines that distance D is not equal to or smaller than threshold value Th2 (NO in step S108), the process returns to step S108.

  In step S112, the communication terminal 100 images the surroundings of the communication terminal 100 at a cycle of M sheets per minute on condition that the permission for imaging is obtained. In step S <b> 114, the communication terminal 100 starts transmission of the acquired position information and transmission of image data obtained by imaging to the server device 200.

  In step S116, the communication terminal 100 calculates a required time T2 to reach the destination from the moving speed Vm of the communication terminal 100 and the threshold value Th2, and images per minute at a rate of (N−M) / T2. Increase the number.

  In step S <b> 118, the communication terminal 100 receives user dictionary data from the server device 200. In step S120, the communication terminal 100 starts a conversation using the received user dictionary data.

  In step S122, the communication terminal 100 determines whether or not a predetermined distance from the destination by using the current location information. If communication terminal 100 determines that the predetermined distance has been reached (YES in step S122), acquisition of position information and imaging of the current location are terminated in step S124. If communication terminal 100 determines that it is not a predetermined distance away (NO in step S122), the process returns to step S122.

  FIG. 13 is a flowchart for explaining the flow of processing performed in the server apparatus 200. Referring to FIG. 13, in step S <b> 202, server device 200 determines the name of the destination, the number of times the user 700 has visited the destination in the past (specifically, information on the number of times), and the previous time from communication terminal 100. The number of days elapsed since the day of the visit (specifically, the number of days information) is received.

  In step S <b> 204, the server apparatus 200 starts receiving the destination name, position information, and image data sent from the communication terminal 100. Note that the name of the destination may include a genre. In step S206, the server device 200 determines whether or not a predetermined time has elapsed after receiving the position information and the image data. When server device 200 determines that a predetermined time has elapsed (YES in step S206), in step S208, the name of the destination, data table D10, the number of visits (number of times information), and the number of days elapsed (days information) Is used to extract a predetermined number (K) of image data from the received image data. If server device 200 determines that the predetermined time has not elapsed (NO in step S206), it returns the process to step S206.

The details of the processing in step S208 will be described as follows.
The server device 200 identifies the genre (restaurant, amusement park, hospital,...) Related to the place from the name of the destination. The server device 200 uses a data table (FIG. 10) of the specified genre. For example, when a restaurant genre is selected, the server apparatus 200 uses the data table shown in FIG. Note that the server device 200 may specify the genre using position information acquired from the communication terminal 100 when the genre cannot be specified only by the destination name.

  When the genre is specified, the server device 200 refers to one division corresponding to the number of times indicated in the number-of-times information and the number of days indicated in the number-of-days information from among the nine categories of the data table. Specifically, the server apparatus 200 reads a plurality of items described in the one category.

  The server device 200 determines image data corresponding to the read items from the received image data. Specifically, the server device 200 extracts a corresponding number of the plurality of items from the plurality of image data by a predetermined number (K) based on the priority order. An example will be described as follows.

  For example, assume that the number of visits is two and the visit interval is less than one month. The value of K is set to 3. In this case, the image data relating to the menu (recommendation) having the first priority, the image data relating to the dish having the priority of the third priority, and the image data relating to the tableware having the priority of the sixth are included in the plurality of image data. Suppose that image data related to the name tag with the priority of 7 and a plurality of image data related to items not listed in the column where the number of visits is twice and the visit interval is less than one month are included. In this case, the server apparatus 200 extracts three pieces of image data in descending order of priority from the plurality of received image data. Specifically, the server apparatus 200 has image data related to new (recommended) with the first priority, image data related to the dish with the priority of 3rd, and image data related to the tableware with the priority of 6th. And extract.

  In step S210, the server device 200 determines a keyword using the extracted image data and position information. The server apparatus 200 sequentially sends position information in association with the image data. The server apparatus 200 includes position information on at least a destination (predetermined place) among the plurality of position information. It is preferable to determine a keyword using. Further, the server device 200 (specifically, the keyword determination unit 2111) is configured to determine the keyword using the extracted image data and the position information of the place (shooting place) where the image data is obtained. ) May be configured.

  The keyword determination will be described in more detail as follows. The server device 200 analyzes the extracted K pieces of image data. For example, the server device 200 performs character recognition processing or pattern matching processing on K pieces of image data. Thereby, the server apparatus 200 typically obtains a plurality of keywords.

  Further, the server device 200 extracts keywords used for creating user dictionary data from the plurality of keywords using the position information. For example, when it can be determined that the place specified by the position information is a restaurant, the server device 200 extracts a keyword that is highly related to the restaurant from a plurality of keywords. As an example, the server device 200 stores a degree of association between a word and a phrase with respect to a plurality of words and excludes a word (keyword) having a high degree of association.

  Alternatively, the server device 200 may delete unnecessary keywords from these keywords using position information. For example, when it can be determined that the place specified by the position information is a restaurant, the server device 200 excludes a hospital from a plurality of keywords when a hospital is included as a keyword. As an example, the server apparatus 200 stores a degree of association between a word and a phrase with respect to a plurality of words, and excludes a word (keyword) having a low degree of association.

  In step S212, the server device 200 generates user dictionary data using the dictionary database and the determined keyword. In step S <b> 214, the server device 200 transmits the generated user dictionary data to the communication terminal 100. In step S <b> 216, server apparatus 200 determines whether or not position information and image data are no longer received from communication terminal 100.

  When server device 200 determines that it has not been received (YES in step S216), the series of processing ends. If server device 200 determines that it is received (NO in step S216), it uses the destination name, data table D10, the number of visits (number of times information), and the number of days elapsed (days information) in step S218. Then, a predetermined number (K pieces) of image data is extracted from the received image data (excluding the already extracted image data). Thereafter, the server apparatus 200 advances the process to step S210.

[Embodiment 2]
In the above, the predetermined place (destination) is a place specified by an input operation by the user 700 of the communication terminal 100. For example, the predetermined place is a place entered by the user 700 in the schedule book as described above.

  However, the present invention is not limited to this. The communication terminal 100 may acquire a recommended spot or a hot spot in the network from the server device 200 as information on the predetermined location.

[Embodiment 3]
In the above description, the configuration in which the communication terminal 100 automatically captures an image while changing the orientation of the camera 164 has been described as an example. However, the present invention is not limited to this. Since the communication terminal 100 can talk, the communication terminal 100 may instruct the user to change the orientation of the camera 164. In this case, the communication terminal 100 may be configured to take an image on the condition that the orientation of the camera 164 is changed to the orientation according to the instruction.

[Embodiment 4]
The notification process described above may include not only vibration and speech, but also movements of the movable part such as raising and lowering arms.

[Embodiment 5]
When communication terminal 100 makes an utterance for obtaining permission for imaging, if permission for imaging is not obtained from user 700, permission for imaging is given at a predetermined timing (for example, after a predetermined time has elapsed since the utterance). It is preferable to configure communication terminal 100 so that the utterance for obtaining is performed again. In this case, in the second and subsequent utterances (utterances for obtaining permission for imaging), the content of the utterances and the tone (inflection) of the utterances may be changed from the first utterances (utterances for obtaining the permission for imaging). .

[Embodiment 6]
When the communication terminal 100 arrives at the destination without obtaining permission for imaging, the communication terminal 100 preferably performs an utterance for obtaining permission for imaging.

[Summary]
Hereinafter, main processes among the processes described above and advantages obtained by the processes will be described.
(1) The communication terminal 100 determines whether or not the communication terminal 100 has arrived at a predetermined place (for example, a destination such as the restaurant 300) based on position information indicating the current position of the communication terminal 100. The communication terminal 100 images the surroundings of the communication terminal 100 with a camera 164 (imaging unit 114) at a predetermined location. The communication terminal 100 transmits at least position information of a predetermined location and image data obtained by imaging (hereinafter also referred to as “first image data”) to the server device 200.

  Server device 200 generates user dictionary data for speech recognition based on the position information and the first image data sent from communication terminal 100. The server device 200 transmits the generated user dictionary data to the communication terminal 100.

  Communication terminal 100 has a conversation with the user of communication terminal 100 using the user dictionary data transmitted from server device 200 at least in a predetermined place.

  According to said structure, the server apparatus 200 produces | generates user dictionary data using the keyword determined based on the positional information on a predetermined place, and the image data of the said place. Therefore, the server device 200 generates user dictionary data including a lot of data related to a predetermined place, rather than a configuration in which a keyword is determined without using at least one of the position information and the image data. It becomes possible.

Therefore, by using such user dictionary data, the communication terminal 100 can perform a conversation with a user that is suitable for a predetermined place as compared to a configuration that does not use the user dictionary data.
(2) The communication terminal 100 further transmits to the server device 200 frequency information indicating the number of times the user of the communication terminal 100 has visited a predetermined location in the past. The server device 200 generates user dictionary data based on the position information, the first image data, and the frequency information.

According to the above configuration, the server device 200 generates user dictionary data in consideration of the number of visits of the user. Therefore, it is possible to generate user dictionary data in which the conversation with the user 700 is denser than when the server device 200 generates user dictionary data without using the number information.
(3) The communication terminal 100 further stores date information representing a date when the user 700 has visited a predetermined place in the past. Based on the date information, the communication terminal 100 calculates the number of days that have elapsed since the previous visit to a predetermined location. The communication terminal 100 further transmits day information indicating the calculated elapsed days to the server device 200. The server device 200 generates user dictionary data based on the position information, the first image data, the number of times information, and the number of days information.

According to said structure, the server apparatus 200 produces | generates user dictionary data further considering the elapsed days from the day visited last time. Therefore, it is possible to generate user dictionary data in which conversation with the user 700 is denser than when the server device 200 generates user dictionary data without using the elapsed days (days information).
(4) The communication terminal 100 starts imaging around the communication terminal 100 on condition that the distance between the communication terminal 100 and a predetermined location is equal to or less than a threshold value. The communication terminal 100 further transmits the second image data obtained by imaging until reaching a predetermined location to the server device 200. The server device 200 includes the position information, the first image data, and the first image data. User dictionary data is generated based on the second image data, number-of-times information, and number-of-days information.

According to said structure, the server apparatus 200 produces | generates user dictionary data in consideration of the 2nd image data obtained by imaging around the predetermined place. Therefore, it is possible to generate user dictionary data in which conversation with the user 700 is denser than when the server apparatus 200 generates user dictionary data without using the second image data.
(5) The communication terminal 100 shortens the imaging time interval as it approaches a predetermined location.

According to said structure, the server apparatus 200 can receive more image data of the place near a predetermined place than a distant place. Therefore, the server device 200 can generate user dictionary data including more data related to a predetermined place than the configuration in which the communication terminal 100 captures images at the same time interval.
(6) The server device 200 determines a keyword related to a predetermined location using the position information, the first image data, and the second image data. The server device 200 generates user dictionary data using the determined keyword.

According to the above configuration, the position information of the predetermined location, the first image data obtained by imaging at the predetermined location, and the second obtained by imaging at the location close to the location. Using this image data, it is possible to generate a keyword related to a predetermined location used for generating user dictionary data.
(7) The server apparatus 200 stores a database in which a plurality of items are stored with priorities for each of a plurality of combinations of the number of times and the date interval. Server device 200 uses a data table D10 and the number-of-times information and the number-of-days information transmitted from communication terminal 100 to determine a predetermined number of first image data and second image data. Extract image data. The server device 200 determines a keyword using the extracted image data and position information.

According to said structure, the server apparatus 200 can extract the image data according to frequency | count information and days information in an order from a high priority. Therefore, the server device 200 can generate user dictionary data in which the conversation with the user 700 is denser than the configuration in which image data corresponding to the number information and the number of days information is not extracted as described above.
(8) When the communication terminal 100 determines that the distance between the communication terminal 100 and a predetermined location is equal to or less than the threshold value, the communication terminal 100 executes a predetermined notification process.

According to said structure, the user of the communication terminal 100 can know that it approached the predetermined place. That is, it is possible to know that the timing for starting imaging by the communication terminal 100 has come. Therefore, the user 700 can change the state of the communication terminal 100 so that the communication terminal 100 can capture a scene around the user 700. For example, when the communication terminal 100 is trapped, the notification process is motivated to be removed from the bag.
(9) The predetermined notification process includes an utterance for obtaining permission for imaging around the communication terminal 100 from the user of the communication terminal 100. The communication terminal 100 images the surroundings of the communication terminal 100 with a camera on the condition that permission for imaging is obtained from the user 700.

According to the above configuration, it is possible to prevent the communication terminal 100 from capturing an image without permission from the user 700. In addition, the user 700 can recognize the necessity of imaging by utterance by the communication terminal 100.
(10) The communication terminal 100 receives position information of a predetermined location from the server device 200.
(11) The predetermined place is a place designated by an input operation by the user of the communication terminal 100.
(12) The communication terminal 100 can change the orientation of the camera 164. When the communication terminal 100 determines that the communication terminal 100 has arrived at a predetermined location, the communication terminal 100 changes the camera direction and captures a plurality of images around the communication terminal 100. The communication terminal 100 transmits position information of a predetermined place and a plurality of first image data to the server device 200.

According to said structure, the server apparatus 200 can produce | generate user dictionary data using the several image data obtained by imaging a predetermined place from several angles.
(13) When the communication terminal 100 captures an image of the surroundings of the communication terminal 100 with a camera at a predetermined location, the communication terminal 100 performs an utterance for changing the orientation of the communication terminal 100 by the user.

According to said structure, when a user changes direction of the communication terminal 100, the communication terminal 100 can image a predetermined place from several angles.
(14) The communication terminal 100 is a portable terminal capable of talking and autonomously imaging the surroundings. The communication terminal 100 uses the voice input unit 116 and the voice output unit 117, the conversation control unit 1112 configured to have a conversation with the user of the communication terminal 100, and the position information indicating the current position of the communication terminal 100. A determination unit 1115 that determines whether or not the communication terminal 100 has arrived at a predetermined location; an imaging unit 114 that captures the surroundings of the communication terminal 100 with a camera at the predetermined location; The transmission unit 1181 that transmits the position information of the location and the image data obtained by imaging to the server apparatus 200, and the user dictionary data for voice recognition generated based on the position information and the image data are stored in the server apparatus. 200 to receive from 200. The conversation control unit 1112 has a conversation with the user of the communication terminal 100 using the user dictionary data.
(15) The server device 200 communicates with the portable communication terminal 100 that can talk and autonomously image the surroundings. The server apparatus 200 receives the image data of the subject imaged at the predetermined location by the communication terminal 100 and the position information of the predetermined location from the communication terminal 100, and sends from the communication terminal 100. A dictionary data generation unit 2112 that generates user dictionary data for speech recognition based on the positional information and image data that has been received, and a transmission unit 2131 that transmits the generated user dictionary data to the communication terminal 100 are provided.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  DESCRIPTION OF SYMBOLS 1 Communication system, 100 Communication terminal, 111, 211 Control part, 112,212 Storage part, 113 Position information acquisition part, 114 Imaging part, 115 Drive part, 116 Voice input part, 117 Voice output part, 118,213 Communication processing part 119 Display unit, 158 GPS receiver, 162 microphone, 163 speaker, 164 camera, 165 driving device, 200 server device, 300 restaurant, 400 case, 500 base station, 600 network, 700 user, 800 home, 911 table, 921 Menu, 1112, conversation control unit, 1113 drive control unit, 1114 interval calculation unit, 1115 determination unit, 1181, 2131 transmission unit, 1182, 2132 reception unit, 2111 keyword determination unit, 2112 dictionary data generation unit, D8 visit history information D10 data table, P0, P1, P2 position.

Claims (18)

A communication system comprising a server device and a portable communication terminal capable of talking and autonomously imaging the surroundings,
The communication terminal is
Based on the location information representing the current location of the communication terminal, determine whether the communication terminal has arrived at a predetermined location,
In the predetermined place, the surroundings of the communication terminal are imaged by a camera,
Transmitting the position information of the predetermined location and the first image data obtained by the imaging to the server device;
The server device
Based on the position information and the first image data sent from the communication terminal, generate dictionary data for speech recognition,
Transmitting the generated dictionary data to the communication terminal;
The communication terminal is
A communication system for carrying out a conversation with a user of the communication terminal using the dictionary data based on reception of the dictionary data. The communication terminal further transmits frequency information representing the number of times the user of the communication terminal has visited the predetermined place in the past to the server device,
The communication system according to claim 1, wherein the server device generates the dictionary data based on the position information, the first image data, and the frequency information. The communication terminal is
Further storing date information representing a date the user has visited the predetermined location in the past;
Based on the date information, calculate the number of days elapsed since the previous visit to the predetermined place,
Further transmitting days information representing the calculated elapsed days to the server device,
The server device
The communication system according to claim 2, wherein the dictionary data is generated based on the position information, the first image data, the frequency information, and the days information. The communication terminal is
On the condition that the distance between the communication terminal and the predetermined location is equal to or less than a threshold, start imaging around the communication terminal,
The second image data obtained by imaging until reaching the predetermined location is further transmitted to the server device,
The server device
The communication system according to claim 3, wherein the dictionary data is generated based on the position information, the first image data, the second image data, the number-of-times information, and the number-of-days information.   The communication system according to claim 4, wherein the communication terminal shortens the time interval of the imaging as it approaches the predetermined location. The server device
Using the position information, the first image data, and the second image data, a keyword related to the predetermined location is determined,
The communication system according to claim 5, wherein the dictionary data is generated using the determined keyword. The server device
For each of a plurality of combinations of the number of times and the interval of dates, a database storing a plurality of items with priorities is stored.
Extracting a predetermined number of image data from the first image data and the second image data using the database and the number-of-times information and the number-of-days information transmitted from the communication terminal And
The communication system according to claim 6, wherein the keyword is determined using the extracted image data and the position information.   The communication terminal according to any one of claims 1 to 7, wherein when the communication terminal determines that the distance between the communication terminal and the predetermined location is equal to or less than a threshold value, the communication terminal executes a predetermined notification process. The communication system described. The predetermined notification process includes an utterance for obtaining permission for imaging around the communication terminal from a user of the communication terminal,
The communication system according to claim 8, wherein the communication terminal captures an image of the surroundings of the communication terminal with the camera on the condition that permission for imaging is obtained from the user.   The communication system according to any one of claims 1 to 9, wherein the communication terminal receives position information of the predetermined location from the server device.   The communication system according to any one of claims 1 to 9, wherein the predetermined location is a location designated by an input operation by a user of the communication terminal. The communication terminal is
The orientation of the camera can be changed,
When it is determined that the communication terminal has arrived at a predetermined location, a plurality of images are captured by changing the orientation of the camera around the communication terminal,
The communication system according to any one of claims 1 to 11, wherein position information of the predetermined location and a plurality of the first image data are transmitted to the server device.   12. The communication terminal according to any one of claims 1 to 11, wherein the communication terminal performs an utterance for changing the orientation of the communication terminal by the user when the camera is imaged around the communication terminal at the predetermined location. The communication system according to item. A portable communication terminal capable of talking and autonomously imaging the surroundings,
Conversation control means configured to have a conversation with the user of the communication terminal using a voice input unit and a voice output unit;
Determining means for determining whether or not the communication terminal has arrived at a predetermined location based on position information indicating the current position of the communication terminal;
Imaging means for imaging the periphery of the communication terminal by a camera at the predetermined location;
Transmitting means for transmitting the position information of the predetermined location and the image data obtained by the imaging to a server device;
Receiving means for receiving dictionary data for speech recognition generated based on the position information and the image data from the server device;
The conversation control means is a communication terminal that has a conversation with a user of the communication terminal using the dictionary data. A server device that communicates with a portable communication terminal capable of talking and autonomously imaging the surroundings,
Receiving means for receiving, from the communication terminal, image data of a subject imaged at a predetermined location by the communication terminal and position information of the predetermined location;
Dictionary data generating means for generating dictionary data for speech recognition based on the position information and the image data sent from the communication terminal;
A server apparatus comprising: a transmission unit that transmits the generated dictionary data to the communication terminal. An information processing method in a communication system comprising a server device and a portable communication terminal capable of conversation and autonomously imaging the surroundings,
Determining whether the communication terminal has arrived at a predetermined location based on position information representing a current position of the communication terminal; and
The communication terminal imaging the surroundings of the communication terminal with a camera at the predetermined location;
The communication terminal transmitting the position information of the predetermined location and the first image data obtained by the imaging to the server device;
The server device generating speech recognition dictionary data based on the position information and the first image data sent from the communication terminal;
The server device transmitting the generated dictionary data to the communication terminal;
An information processing method comprising: a step of having a conversation with a user of the communication terminal using the dictionary data based on the communication terminal receiving the dictionary data. An information processing method in a portable communication terminal capable of talking and autonomously imaging the surroundings,
Using a voice input unit and a voice output unit to perform a conversation with the user of the communication terminal;
Determining whether the communication terminal has arrived at a predetermined location based on position information representing a current position of the communication terminal;
Imaging the surroundings of the communication terminal with a camera at the predetermined location;
Transmitting the position information of the predetermined location and the image data obtained by the imaging to a server device;
Receiving dictionary data for speech recognition generated based on the position information and the image data from the server device,
An information processing method of performing a conversation with a user of the communication terminal using the dictionary data in the conversation step. An information processing method in a server device that communicates with a portable communication terminal capable of conversation and being able to autonomously image the surroundings,
Receiving from the communication terminal image data of a subject imaged at a predetermined location by the communication terminal and position information of the predetermined location;
Generating dictionary data for speech recognition based on the position information and the image data sent from the communication terminal;
Transmitting the generated dictionary data to the communication terminal.

Images