JP6969811B2 - Voice response device - Google Patents

Description

Cross-reference of related applications

This international application is the second Japanese patent application filed with the Japan Patent Office on June 18, 2012.
It claims priority based on 012-137065, Japanese Patent Application No. 2012-137066, and Japanese Patent Application No. 2012-137067, and Japanese Patent Application No. 2012-137065, Japanese Patent Application. The entire contents of No. 2012-137066 and Japanese Patent Application No. 2012-137067 are incorporated herein by reference.

The present invention relates to a voice response device that makes a response to input character information by voice.

As the above-mentioned voice response device, there is known a device that searches a dictionary for an answer to an input question and outputs the searched answer by voice (see, for example, Patent Document 1). Further, a technique for generating an answer to a question based on the content of a dialogue with a user is also known (see, for example, Patent Document 2).

Japanese Patent No. 4832097 Japanese Patent No. 4924950

In the above technique, only one question is set to give one answer specified by the dictionary.
One aspect of the present invention is to improve usability for the user in a voice response device that makes a response to the input voice by voice.

One aspect of the present disclosure is a voice response device.
A voice response unit configured to respond to the input voice by voice,
A voice setting unit configured to set automatic conversation by voice,
If the automatic conversation mode is ON, the transmission unit configured to transmit the fact that the automatic conversation mode is set to the server together with the ID for identifying itself, and the transmission unit.
To prepare for.
In addition, in other aspects of this disclosure,
In the invention of the first aspect,
It is a voice response device that responds to the input character information by voice.
A response acquisition means for acquiring a plurality of different responses to the character information,
A voice output means for outputting a plurality of different responses with different voice colors, and
It is characterized by being equipped with.

According to such a voice response device, a plurality of responses can be output with different voice colors, so that even if a solution for one character information cannot be specified as one, a user can output different solutions with different voice colors. It can be output in an easy-to-understand manner. Therefore, it is possible to improve the usability for the user.

The voice response device of the present invention may be configured as, for example, a terminal device owned by the user, or may be configured as a server that communicates with the terminal device. Further, the character information may be input to a keyboard or the like using an input means, or may be input by converting voice into character information.

By the way, in the above-mentioned voice response device, as in the invention of the second aspect,
A voice input means for the user to input voice, and the input voice is converted into character information.
A voice transmission means for transmitting to an external device that generates a plurality of different responses to the character information and transmits the response to the voice response device.
Equipped with
The response acquisition means may acquire the response from the external device.

According to such a voice response device, since the voice response device can input voice, the character information can be input by voice. Further, since the response can be generated in the external device, the processing load in the voice response device can be reduced.

In the voice transmission means, the operation of "converting the input voice into character information" may be performed by a voice response device or an external device.
Further, in the above-mentioned voice response device, as in the invention of the third aspect,
The voice response device or the external device includes a response recording means for recording a plurality of different responses including a positive response and a negative response to each character information for each of the plurality of character information.
The response acquisition means acquires the positive response and the negative response as the plurality of different responses.
The voice output means may reproduce the positive response and the negative response with different voice colors.

According to such a voice response device, responses from different positions such as positive response and negative response can be reproduced with different voice colors, so that the voice is reproduced as if another person is speaking. Can be done. Therefore, it is possible to make it difficult for the user who listens to the voice to feel a sense of discomfort.

The voice color may be changed depending on the type of response and the wording used in the response. For example, when responding with a gentle tone, the voice of a calm female may be played, and when responding with a violent tone, the voice of a brave man may be used. That is, the response content and the personality may be associated with each other, and the voice color may be set according to the personality.

Further, the voice response device may be configured to be used at the reception desk of a workplace or a company as in the invention of the fourth aspect, or may be configured to convey to someone that it is difficult for the user to directly tell.

When using a voice response device at the reception, the name and company name of the person who comes to the sales are recorded in advance on the voice response device or an external device, and the person who comes to the reception gives this name or company name. In that case, a response may be generated to play the voice of the refusal.

Also, if you want to convey something that is difficult to say instead, for example, if you talk to the device today that you want to say something like this before dating, you can set an appropriate timing (for example, a preset time). , When a certain amount of time has passed since the conversation was interrupted), the voice response device should speak (play the voice) instead.

Alternatively, it may be configured to speak a word that triggers something difficult to say, such as a word such as "Did you say something to her?" That is, instead of outputting the response immediately, the response may be output when the reproduction condition is satisfied, such as after a certain period of time has elapsed.

Further, in the above-mentioned voice response device, as in the invention of the fifth aspect, the external device or the voice response device may acquire information for generating a response to the character information from another voice response device. .. Further, in the above-mentioned voice response device, when information for generating a response to character information is requested from another voice response device as in the invention of the sixth aspect, the information corresponding to this request is returned. You may.

In this case, the voice response device is provided with sensors for detecting position information, temperature, humidity, illuminance, noise level, etc., and a database such as dictionary information, and extracts necessary information as requested. It should be.

According to such a voice response device (external device), it is possible to acquire information for generating a response from another voice response device. In this case, information unique to the other voice response device, such as the position of the other voice response device, can be acquired.

In addition, it is possible to transmit information unique to itself to other voice response devices.
Further, in the above-mentioned voice response device, as in the invention of the seventh aspect, a response output by itself or another voice response device (for example, a positive response or a negative response) is input as text information, and the response is received. You may want to generate a response to make a counterargument. In other words, from the user's point of view, we can hear discussions from both the pros and cons. Then, after listening to this discussion, the user can make a final decision.

This configuration can be realized using one or more voice response devices. In this case, in order for the plurality of voice response devices to exchange voice, the voice may be directly input / output, or wireless communication or the like may be used.

Further, in the invention of the eighth aspect,
It is a voice response device that responds to the input character information by voice.
A personality information acquisition means for acquiring personality information in which the personality of a user or a person related to the user is associated with a preset classification, and
A response acquisition means for acquiring response candidates representing a plurality of different responses to the character information, and
A voice output means for selecting a response to be output from the response candidates according to the personality information and outputting the selected response.
It is characterized by being equipped with.

According to such a voice response device, it is possible to make a different response depending on the personality of the user or a person (related person) related to the user. Therefore, it is possible to improve usability for the user.

Further, in the above-mentioned voice response device, as in the invention of the ninth aspect,
A first personality information generation means for generating personality information of the user or the related person based on answers to a plurality of preset questions is provided.
The personality information acquisition means may acquire the personality information generated by the personality information generation means.

According to such a voice response device, personality information can be generated in the voice response device. When generating personality information, well-known personality analysis techniques (Rorschach test, Szondi test, etc.) may be used. In addition, when generating personality information, aptitude test technology used by companies and the like for recruitment tests may be used.

Further, in the above-mentioned voice response device, as in the invention of the tenth aspect,
A second personality information generation means for generating personality information of the user or the related person based on the character string included in the input character information is provided.
The personality information acquisition means may acquire the personality information generated by the personality information generation means.

According to such a voice response device, personality information can be generated in the process of using the voice response device by the user.
Further, in the above-mentioned voice response device, as in the invention of the eleventh aspect,
A preference information generation means for generating preference information indicating a tendency of preference of the user or the related person based on a character string included in the character information is provided.
The voice output means may select a response to be output from the response candidate based on the preference information and output the selected response.

According to such a voice response device, it is possible to respond according to the preference of the user or a person concerned.
Further, in the above-mentioned voice response device, as in the invention of the twelfth aspect, the user's behavior (conversation, the place moved, what is reflected by the camera) is learned (recorded and analyzed), and the user's conversation is performed. You may try to make up for the lack of words in.

For example, if the user answers "I like curry" to the question "Is it okay with hamburger steak today?", This device supplements "Because it was hamburger steak yesterday." However, the reason why he said that curry is good is transmitted.

Further, such a configuration can be carried out during a telephone call, or may be configured to freely participate in the conversation of the user.
Further, in the above-mentioned voice response device, as in the invention of the thirteenth aspect,
Response candidate acquisition means for acquiring response candidates from a predetermined server or the Internet,
May be provided.

According to such a voice response device, response candidates can be acquired not only from the own device or an external device but also from any device connected by the Internet, a dedicated line, or the like.
Further, in the above-mentioned voice response device, as in the invention of the 14th aspect,
Character information generation means that converts user actions into character information,
May be provided.

Here, the movements referred to in the present invention correspond to those caused by movements of muscles such as conversation, handwriting of characters, and gestures (for example, sign language).
According to such a voice response device, the user's operation can be converted into character information.

Further, in the above-mentioned voice response device, as in the invention of the fifteenth aspect,
The character information generation means converts the voice produced by the user into character information and stores the habits (pronunciation habits, etc.) at the time of utterance as learning information (capture the characteristics and record these characteristics).
You may do so.

According to such a voice response device, character information can be generated based on the learning information, so that the accuracy of character information generation can be improved.
Further, in the above-mentioned voice response device, as in the invention of the 16th aspect,
A transfer means for transferring the learning information to another voice response device,
May be provided.

According to such a voice response device, the learning information recorded by the voice response device can be used even when the user uses another voice response device. Therefore, even when another voice response device is used, the accuracy of generating character information can be improved.

Further, in the above-mentioned voice response device, as in the invention of the 17th aspect, any one of the user's behavior and operation may be detected, and learning information or personality information may be generated based on these. ..

According to such a voice response device, for example, when it is detected that a user jumps on a train for several days in a row, the user is urged to leave the house a few minutes earlier from the next day, or the user is likely to get angry from the conversation. When it is detected that there is a tendency, it is possible to output a voice or music that suppresses the mood.

Further, in the above-mentioned voice response device, as in the invention of the eighteenth aspect,
The other device information acquisition means for acquiring the information recorded in the other voice response device from the other voice response device may be provided.

According to such a voice response device, a response can be generated based on the information recorded in another voice response device.
Further, in the above-mentioned voice response device, as in the invention of the 19th aspect,
A reproduction condition determining means for determining whether or not the condition of the voice response device meets the reproduction condition set as a condition for outputting voice in advance when the character information is not input.
A message reproduction means for outputting a preset message when the reproduction conditions are met, and
May be provided.

According to such a voice response device, voice can be output even when character information is not input (that is, when the user does not speak). For example, by forcibly making the user speak, it can be used as a measure for suppressing drowsiness while driving a car. In addition, safety can be confirmed by determining whether or not a person living alone responds.

Further, in the above-mentioned voice response device, as in the invention of the 20th aspect,
The message reproduction means may acquire news information and output a message related to the news in the form of a question asking for a user's answer.

With such a voice response device, it is possible to have a conversation about news, so it is possible to suppress that the conversation is always the same. As the content of the conversation, for example, if you can get information about the stock price of a certain company, you can say, "Today's stock price of XX company has risen by XX yen. Did you know?" ..

Further, in the above-mentioned voice response device, as in the invention of the 21st aspect,
The voice output means or the message reproduction means may add externally acquired information (news, environment (temperature, weather, location information, etc.)) separately acquired to the preset message and output the message.

According to such a voice response device, it is possible to output a response in which a predetermined message and the acquired information are combined.
Further, in the above-mentioned voice response device, as in the invention of the 22nd aspect,
A plurality of messages may be acquired, and the message to be played may be selected and output according to the playback frequency of the messages.

According to such a voice response device, by making it difficult to play a message with a high playback frequency, randomness at the time of message playback can be achieved, or by dare to repeatedly play a message with a high playback frequency, attention and memory can be obtained. It can promote fixation.

Further, in the above-mentioned voice response device, as in the invention of the 23rd aspect,
Unanswered transmission means to send user-identifying information and the fact that an answer was not obtained to a preset contact when a response or message cannot be obtained.
May be provided.

With such a voice response device, it is possible to notify a contact when an answer cannot be obtained. Therefore, for example, it is possible to report an abnormality of an elderly person living alone at an early stage.
Further, in the above-mentioned voice response device, as in the invention of the 24th aspect,
The message reproduction means memorizes the conversation content and asks a question to obtain the same content as the heard content (memory confirmation process).
You may do so.

With such a voice response device, it is possible to confirm the memory ability of the user and to fix the memory.
Further, in the above-mentioned voice response device, as in the invention of the 25th aspect,
Speaking accuracy detection means that detects the accuracy of the pronunciation and accent of the voice input by the user,
An accuracy output means that outputs the detected accuracy,
May be provided.

With such a voice response device, the accuracy of pronunciation and accent can be confirmed. For example, it is effective when practicing a foreign language.
Further, in the above-mentioned voice response device, as in the invention of the 26th aspect,
The accuracy degree output means may output the voice including the closest word when the accuracy degree is a certain value or less.

With such a voice response device, the user can confirm the accuracy of pronunciation and accent.
Further, in the above-mentioned voice response device, as in the invention of the 27th aspect,
The message reproduction means may output the same question again when the accuracy is equal to or less than a certain value.

According to such a voice response device, an accurate answer can be obtained by outputting the same question.
Further, in the above-mentioned voice response device, as in the invention of the 28th aspect,
A connection control means that identifies a communication partner by the input character information and connects a communication destination preset for each communication partner to the communication partner.
May be provided.

With such a voice response device, it is possible to assist reception work and telephone correspondence.
In particular, in the above-mentioned voice response device, as in the invention of the 29th aspect,
The connection control means may identify a sales activity (sales) and a visitor, and reproduce a message to decline if it is a sales activity.

According to such a voice response device, a person who may interfere with the work of the user can be excluded without taking any action.
Further, in the voice response device, as in the invention of the thirtieth aspect, the keyword included in the input character information (particularly voice) may be extracted and connected to the connection destination to which the keyword corresponds. For example, a keyword such as the name of the other party may be associated with the connection destination in advance.

With such a voice response device, it is possible to assist operations such as telephone transfer and call to reception.
Further, in the above-mentioned voice response device, as in the invention of the 31st aspect, the requirement that the other party speaks may be recognized based on the keyword, and the outline spoken by the other party may be conveyed to the user.

According to such a voice response device, it is possible to assist the work of agency with the customer.
Further, in the above-mentioned voice response device, as in the invention of the 32nd aspect,
Emotions that read emotions from the voice of the voice input by the user and output which emotions usually correspond to, including at least one of anger, joy, embarrassment, sadness, and uplifting. A determination means may be provided.

According to such a voice response device, it is possible to output a response according to the emotion of the user.
Next, the invention of the 33rd aspect is
When the character information is input, a response generation means that generates a response according to an image captured by capturing the surroundings of the voice response device, and a response generation means.
A voice output means for outputting the response by voice and
It is characterized by being equipped with.

According to such a voice response device, the response can be output by voice according to the captured image. Therefore, usability can be improved as compared with a configuration in which a response is generated only from character information.

Specific configurations of the present invention include, for example, inputting character information so as to respond to what is recognized, and outputting by voice what is recognized from the captured image (someone). ..

By the way, in the above-mentioned voice response device, as in the invention of the 34th aspect,
A position specifying means search means for searching an object included in the character information from the captured image by image processing and specifying the position of the searched object, and a search means.
Guidance means to guide to the position of the object and
May be provided.

According to such a voice response device, the user can be guided to the object in the captured image.
Further, in the above-mentioned voice response device, as in the invention of the 35th aspect,
A voice input video acquisition means for acquiring a moving image of the shape of the user's mouth when inputting character information by voice, and
A character information conversion means for converting the voice into character information and estimating the unclear part of the voice based on the moving image to correct the character information.
May be provided.

According to such a voice response device, since the utterance content can be estimated from the shape of the mouth, it is possible to satisfactorily estimate the unclear part of the voice.
Further, in the above-mentioned voice response device, as in the invention of the 36th aspect,
The message reproduction means may detect annoyance or agitation of the user by detecting an unexpectedly emitted voice, and may generate a message for suppressing the annoyance or agitation.

According to such a voice response device, when the user is irritated or upset, it is possible to suppress them. Therefore, it is possible to suppress the occurrence of troubles between the user and the surroundings.
Further, in the above-mentioned voice response device, as in the invention of the 37th aspect,
When providing guidance to the destination, it is equipped with a route information acquisition means for acquiring route information such as weather, temperature, humidity, traffic information, and road surface condition to the destination.
The message reproduction means may output the route information by voice.

According to such a voice response device, the situation (route information) to the destination can be notified to the user by voice.
Further, in the above-mentioned voice response device, as in the invention of the 38th aspect,
A line-of-sight detection means for detecting the user's line of sight,
When the user's line of sight does not move to a predetermined position in response to the call by the message reproducing means, the line-of-sight movement request transmitting means that outputs a voice requesting the line of sight to move to the predetermined position, and the line-of-sight request transmitting means.
May be provided.

With such a voice response device, the user can be made to look at a specific position. Therefore, it is possible to surely confirm the safety when driving the vehicle.
In the above-mentioned voice response device, as in the invention of the 39th aspect,
A change request transmission means for observing the position of the body part and the facial expression and outputting a voice requesting the change of the position of the body part and the facial expression may be provided when the change to the call is small. ..

According to such a voice response device, it is possible to move the position of a part of the user's body to a specific position or to induce the user to make a specific facial expression. The present invention can be used when driving a vehicle, performing a physical examination, or the like.

Further, in the above-mentioned voice response device, as in the invention of the 40th aspect,
A broadcast program acquisition means for acquiring a broadcast program similar to the broadcast program that the user watches, and
When a broadcast program is interrupted, a broadcast program complement means that complements the interrupted broadcast program by outputting the broadcast program acquired by itself,
May be provided.

According to such a voice response device, it is possible to supplement the broadcast program that the user watches without interruption.
Further, in the above-mentioned voice response device, as in the invention of the 41st aspect,
When the user sings a song without lyrics with lyrics, the song with lyrics is compared with the lyrics attached by the user, and lyrics are added so that the lyrics are output by voice in the part where only the user's lyrics are not present. Having the means.

According to such a voice response device, it is possible to supplement a part (a part where the lyrics are interrupted) that the user cannot sing in so-called karaoke.
Further, in the above-mentioned voice response device, as in the invention of the 42nd aspect,
When a character is included in the captured image, when the user asks a question about how to read this character, the information of this character is acquired from the outside and the reading of the character contained in this information is output by voice. means,
May be provided.

With such a voice response device, it is possible to teach the user how to read characters.
Further, in the above-mentioned voice response device, as in the invention of the 43rd aspect,
Equipped with a behavioral environment detection means that detects the behavior of the user and the surrounding environment of the user,
The message generation means may generate a message according to the detected behavior and the surrounding environment.

With such a voice response device, it is possible to notify a dangerous place, an exclusion zone, or the like. In addition, it is possible to detect that the user has abnormal behavior.
Further, in the above-mentioned voice response device, as in the invention of the 44th aspect,
A health condition determination means for determining a health condition based on an image taken by a user, and a health condition determination means.
Health message generation means that generates messages according to health status,
May be provided.

According to such a voice response device, the health condition of the user can be managed.
Further, in the above-mentioned voice response device, as in the invention of the 45th aspect,
A means of reporting to a given contact when the health condition is below the standard value,
May be provided.

According to such a voice response device, it is possible to make a report when the health condition of the user is equal to or less than the reference value. Therefore, the abnormality can be notified to others at an earlier stage.
Further, in the voice response device, as in the invention of the 46th aspect, information about the user may be output in response to an inquiry from a person other than the user.

According to such a voice response device, for example, if the distance of a walk, which is the meal content of the user, is detected, it is possible to answer a question at a hospital or the like on behalf of the user. You may also learn about your health condition and self-introduction.

It should be noted that the invention of each aspect does not need to be premised on another invention, and can be an independent invention as much as possible.

It is a block diagram which shows the schematic structure of the voice response system to which this invention is applied. It is a block diagram which shows the schematic structure of a terminal device. It is a flowchart which shows the voice response terminal processing which MPU of a terminal apparatus performs. It is a flowchart which shows the voice response server processing which the arithmetic unit of a server executes. It is explanatory drawing which shows an example of the response candidate DB. It is a flowchart which shows the automatic conversation terminal processing which MPU of a terminal apparatus performs. It is a flowchart which shows the automatic conversation server processing executed by the arithmetic unit of a server. It is a flowchart which shows the message terminal processing which MPU of a terminal apparatus performs. It is a flowchart which shows the message server processing which the arithmetic part of a server executes. It is a flowchart which shows the guidance terminal processing which MPU of a terminal apparatus performs. It is a flowchart which shows the guidance server processing which the arithmetic part of a server executes. It is a flowchart which shows the reception process executed by the arithmetic unit of a server. It is a flowchart which shows the information providing terminal processing which MPU of a terminal apparatus performs. It is explanatory drawing which shows an example of a personality DB. It is a flowchart which shows the personality information generation processing which MPU of a terminal apparatus performs. It is explanatory drawing which shows an example of a preference DB. It is a flowchart which shows the preference information generation processing executed by the arithmetic unit of a server. It is explanatory drawing which shows the combination example of a personality classification and a preference. It is a flowchart which shows the operation character input process executed by the arithmetic unit of a server. It is a flowchart which shows the other terminal use processing executed by the arithmetic unit of a server. It is a flowchart which shows the storage confirmation process which the arithmetic unit of a server executes. It is a flowchart which shows the pronunciation determination process 1 executed by the arithmetic unit of a server. It is a flowchart which shows the pronunciation determination process 2 executed by the arithmetic unit of a server. It is a flowchart which shows the pronunciation determination process 3 executed by the arithmetic unit of a server. It is a flowchart which shows the emotion determination process executed by the arithmetic unit of a server. It is a flowchart which shows the emotion response generation processing executed by the arithmetic unit of a server. It is a flowchart which shows the guidance process which a calculation part of a server executes. It is a flowchart which shows the move request process 1 executed by the arithmetic unit of a server. It is a flowchart which shows the move request process 2 executed by the arithmetic unit of a server. It is a flowchart which shows the broadcast music complement processing which the arithmetic part of a server executes. It is a flowchart which shows the character explanation processing executed by the arithmetic unit of a server. It is a flowchart which shows the action response terminal processing which the arithmetic part of a server executes. It is a flowchart which shows the action response server processing which the arithmetic part of a server executes.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
[Structure of this embodiment]
The voice response system 100 to which the present invention is applied is a system configured such that the server 90 generates an appropriate response to the voice input in the terminal device 1 and the terminal device 1 outputs the response by voice. Is. Specifically, as shown in FIG. 1, the voice response system 100 is configured such that a plurality of terminal devices 1 and a server 90 can communicate with each other via a communication base station 80 and an Internet network 85.

The server 90 has a function as a normal server device. In particular, the server 90 includes a calculation unit 101 and various databases (DB). The calculation unit 101 includes a CPU and R.
It is configured as a well-known arithmetic unit equipped with memory such as OM and RAM, and based on the program in the memory, it communicates with the terminal device 1 etc. via the Internet network 85, and reads / writes data in various DBs. Alternatively, various processes such as voice recognition and response generation for having a conversation with the user who uses the terminal device 1 are performed.

As shown in FIG. 1, the various DBs include voice recognition DB 102, predictive conversion DB 103, voice DB 104, response candidate DB 105, personality DB 106, learning DB 107, preference DB 108, news DB 109, weather DB 110, reproduction condition DB 111, handwritten characters / sign language. It includes a DB 112, a terminal information DB 113, an emotion determination DB 114, a health determination DB 115, a karaoke DB 116, a report destination DB 117, a sales DB 118, a client DB 119, and the like. The details of these DBs will be described each time the processing is explained.

Next, as shown in FIG. 2, the terminal device 1 includes an action sensor unit 10, a communication unit 50, a notification unit 60, and an operation unit 70 in a predetermined housing.
The behavior sensor unit 10 includes a well-known MPU 31 (microprocessor unit), a memory 39 such as ROM and RAM, and various sensors. In the MPU 31, the sensor elements constituting the various sensors are inspected (humidity, wind speed, etc.). For example, a process for driving a heater for optimizing the temperature of the sensor element is performed so that it can be detected satisfactorily.

The behavior sensor unit 10 has, as various sensors, a three-dimensional acceleration sensor 11 (3DG sensor), a three-axis gyro sensor 13, a temperature sensor 15 arranged on the back surface of the housing, and humidity arranged on the back surface of the housing. The sensor 17, the temperature sensor 19 arranged on the front of the housing, the humidity sensor 21 arranged on the front of the housing, the illuminance sensor 23 arranged on the front of the housing, and the illuminance sensor 23 arranged on the back of the housing. It includes a wetness sensor 25, a GPS receiver 27 for detecting the current location of the terminal device 1, and a wind speed sensor 29.

The behavior sensor unit 10 also includes an electrocardiographic sensor 33, a heart sound sensor 35, a microphone 37, and a camera 41 as various sensors. The temperature sensors 15 and 19 and the humidity sensors 17 and 21 measure the temperature or humidity of the external air of the housing as an inspection target.

The three-dimensional acceleration sensor 11 applies acceleration to the terminal device 1 in three orthogonal directions (vertical direction (Z direction), housing width direction (Y direction), and housing thickness direction (X direction)). Detects and outputs this detection result.

The 3-axis gyro sensor 13 has an angular velocity applied to the terminal device 1 in the vertical direction (Z direction), in any two directions orthogonal to the vertical direction (width direction of the housing (Y direction), and in the housing). The angular acceleration in the thickness direction (X direction) (assuming each counterclockwise velocity in each direction is positive) is detected, and this detection result is output.

The temperature sensors 15 and 19 are configured to include, for example, a thermistor element whose electrical resistance changes according to temperature. In this embodiment, the temperature sensors 15 and 19 detect the temperature in degrees Celsius, and all the temperature displays described in the following description are performed in degrees Celsius.

The humidity sensors 17 and 21 are configured as, for example, a well-known polymer membrane humidity sensor. This polymer film humidity sensor is configured as a capacitor in which the amount of water contained in the polymer film changes according to a change in relative humidity and the dielectric constant changes.

The illuminance sensor 23 is configured as a well-known illuminance sensor including, for example, a phototransistor.
The wind speed sensor 29 is, for example, a well-known wind speed sensor, and calculates the wind speed from the electric power (heat dissipation amount) required to maintain the heater temperature at a predetermined temperature.

The heart sound sensor 35 is configured as a vibration sensor that captures the vibration caused by the beat of the user's heart, and the MPU 31 considers the detection result by the heart sound sensor 35 and the heart sound input from the microphone 37, and the vibration caused by the beat. Distinguish between noise and other vibrations and noise.

The wetness sensor 25 detects water droplets on the surface of the housing, and the electrocardiographic sensor 33 detects the heartbeat of the user.
The camera 41 is arranged in the housing of the terminal device 1 so that the outside of the terminal device 1 is the imaging range.

The communication unit 50 includes a well-known MPU 51, a radiotelephone unit 53, and a contact memory 55, and can acquire detection signals from various sensors constituting the behavior sensor unit 10 via an input / output interface (not shown). It is configured. Then, the MPU 51 of the communication unit 50 executes processing according to the detection result by the behavior sensor unit 10, the input signal input via the operation unit 70, and the program stored in the ROM (not shown).

Specifically, the MPU 51 of the communication unit 50 has a function as an motion detection device for detecting a specific motion performed by the user, a function as a positional relationship detection device for detecting a positional relationship with the user, and a function depending on the user. It executes a function as an exercise load detection device for detecting an exercise load and a function for transmitting a processing result by the MPU 51.

The radiotelephone unit 53 is configured to be able to communicate with, for example, a base station of a mobile phone, and the MPU 51 of the communication unit 50 outputs the processing result of the MPU 51 to the notification unit 60 or via the radiotelephone unit 53. To send to a preset destination.

The contact memory 55 functions as a storage area for storing the location information of the visit destination of the user. The contact memory 55 records information on contacts (telephone numbers, etc.) to be contacted when an abnormality occurs in the user.

The notification unit 60 includes, for example, a display 61 configured as an LCD or an organic EL display, an illumination 63 composed of LEDs capable of emitting light in, for example, seven colors, and a speaker 65. Each unit constituting the notification unit 60 is driven and controlled by the MPU 51 of the communication unit 50.

Next, the operation unit 70 includes a touch pad 71, a confirmation button 73, a fingerprint sensor 75, and a rescue request lever 77.
The touch pad 71 outputs a signal according to the position and pressure touched by the user (user, guardian of the user, etc.).

The confirmation button 73 is configured to close the contact of the built-in switch when pressed by the user, and the communication unit 50 can detect that the confirmation button 73 has been pressed. There is.

The fingerprint sensor 75 is a well-known fingerprint sensor, and is configured so that the fingerprint can be read by using, for example, an optical sensor. In addition, instead of the fingerprint sensor 75, a means capable of recognizing human physical characteristics such as a sensor recognizing the shape of a vein in the palm (means capable of performing biometrics authentication: means of identifying an individual). Any means that can be done) can be adopted.

It also has a rescue request lever 77 that is connected to a predetermined contact when operated.
[Processing of this embodiment]
The processing performed in such a voice response system 100 will be described below.

The voice response terminal process performed by the terminal device 1 is a process of receiving voice input by the user, sending the voice to the server 90, and reproducing this response by voice when the response to be output from the server 90 is received. .. It should be noted that this process is started when the user inputs that voice input is to be performed via the operation unit 70.

Specifically, as shown in FIG. 3, first, the state of accepting the input from the microphone 37 (ON state) is set (S2), and the imaging (recording) by the camera 41 is started (S4). Then, it is determined whether or not there is a voice input (S6).

If there is no voice input (S6: NO), it is determined whether or not a time-out has occurred (S8). Here, the time-out indicates that the permissible time for waiting for processing has been exceeded, and here, the permissible time is set to, for example, about 5 seconds.

If the time-out has occurred (S8: YES), the process proceeds to the process of S30 described later. If the time-out has not occurred (S8: NO), the process returns to S6.
If there is a voice input (S6: YES), the voice is recorded in the memory (S10), and it is determined whether or not the voice input is completed (S12). Here, it is determined that the voice input is completed when the voice is interrupted for a certain period of time or more, or when it is input to end the voice input via the operation unit 70.

If the voice input is not completed (S12: NO), the process returns to S10. If the voice input is completed (S12: YES), the data such as the ID for identifying itself, the voice, and the captured image are packet-transmitted to the server 90 (S14). The process of transmitting data may be performed between S10 and S12.

Subsequently, it is determined whether or not the data transmission is completed (S16). If the transmission is not completed (S16: NO), the process returns to S14.
Further, if the transmission is completed (S16: YES), it is determined whether or not the data (packet) transmitted by the voice response server processing described later has been received (S18). If no data has been received (S18: NO), it is determined whether or not a timeout has occurred (S20).

If the time-out has occurred (S20: YES), the process proceeds to the process of S30 described later. If the time-out has not occurred (S20: NO), the process returns to S18.
Further, if the data is received (S18: YES), the packet is received (S22). In this process, one or a plurality of different responses to the character information are associated with different voices.

Then, it is determined whether or not the reception is completed (S24). If the reception is not completed (S24: NO), it is determined whether or not the time-out has occurred (S26).
If the time-out has occurred (S26: YES), the fact that an error has occurred is output via the notification unit 60, and the voice response terminal processing is terminated. If the time-out has not occurred (S26: NO), the process returns to the process of S22.

If the reception is completed (S24: YES), the response based on the received packet is output from the speaker 65 by voice (S28). In this process, when a plurality of responses are reproduced, the plurality of responses are reproduced with different voice colors. When such processing is completed, the voice response terminal processing is terminated.

Subsequently, the voice response server processing performed by the server 90 (external device) will be described with reference to FIG. The voice response server process is a process of receiving voice from the terminal device 1, performing voice recognition that converts the voice into character information, and generating a response to the voice and returning it to the terminal device 1. In particular, in the present embodiment, a plurality of responses may be transmitted in association with voices having different voice colors.

As for the details of the voice response server processing, as shown in FIG. 4, first, it is determined whether or not a packet from any of the terminal devices 1 has been received (S42). If no packet has been received (S42: NO), the process of S42 is repeated.

Further, if the packet is received (S42: YES), the terminal device 1 of the communication partner is specified (S44). In this process, the terminal device 1 is specified by the ID of the terminal device 1 included in the packet.

Subsequently, the voice included in the packet is recognized (S46). Here, in the voice recognition DB 102, a large number of voice waveforms and a large number of characters are associated with each other. Further, the predictive conversion DB 103 is associated with a word that tends to be used following a certain word.

Therefore, in this process, by referring to the voice recognition DB 102 and the predictive conversion DB 103, a well-known voice recognition process is performed and the voice is converted into character information.
Subsequently, the captured image is image-processed to identify the object in the captured image (S48). Then, the emotion of the user is determined based on the waveform of the voice, the ending of the word, and the like (S50).

In this process, the user refers to the emotion determination DB 114 in which the waveform (voice color) of the voice, the ending of the word, and the like are usually associated with the emotion classifications such as anger, joy, confusion, sadness, and uplifting. It is determined whether the emotion of is applicable to any of the categories, and the determination result is recorded in the memory. Subsequently, by referring to the learning DB 107, the word frequently spoken by the user is searched, and the part where the character information generated by the voice recognition is ambiguous is corrected.

The learning DB 107 records the characteristics of each user, such as words often spoken by the user and habits during pronunciation. In addition, data is added / corrected to the learning DB 107 in a conversation with the user.

Subsequently, the corrected character information is specified as the input character information (S54), and a sentence similar to the character information is searched for as an input from the response candidate DB 105 to acquire a response from the response candidate DB 105 (S56). .. Here, as shown in FIG. 5, the response candidate DB 105 is uniquely associated with input character information, first output, first output voice color, second output, and second output voice color.

For example, as shown in the first row of Fig. 5, when the text information "Today's * weather" is input, the first output "Today's * weather is *" becomes the voice of female 1. It is output in association with each other. However, the "*" part is acquired by accessing the weather DB 110 in which the area name and the weather forecast for several days in the area are associated with each other.

In addition, when the text information "Today's * weather" is input, the weather at the timing when today's weather changes is also acquired from the weather DB 110, and the second output "However, * is *" is a man. It is output in association with the voice color of 1. If today's Tokyo weather is sunny and tomorrow's weather is rainy, and "Today's Tokyo weather" is entered, the voice of Woman 1 will output "Today's Tokyo weather is sunny." In the voice of Man 1, "However, it will rain tomorrow." Will be output.

In the present embodiment, the case where a plurality of responses are output has been described, but when there is only one answer to the input, only one response is given. Therefore, it is determined whether or not there is only one response (S58). If there is only one response (S58: YES), the process proceeds to S62, which will be described later.

If there are a plurality of responses (S58: NO), the response content and the voice color are associated with each other (S60). Here, the voice DB 104 stores an artificial voice database for each voice color, and in this process, the voice color set for each response is associated with the voice color in the database.

Subsequently, the response content is converted into voice (S62). In this process, the response content (character information) is output as voice based on the database stored in the voice DB 104.

Then, the generated response (voice) is packet-transmitted to the terminal device 1 of the communication partner (S64). It should be noted that the packet may be transmitted while generating the voice of the response content.
Then, the conversation content is recorded (S68). In this process, the input character information and the output response content are recorded in the learning DB 107 as conversation content. At this time, the keywords (words recorded in the voice recognition DB 102) included in the conversation content, the characteristics at the time of pronunciation, and the like are recorded in the learning DB 107.

When such processing is completed, the voice response server processing is terminated.
[Effect of this embodiment]
The voice response system 100 described in detail as described above is a system that makes a response to the input character information by voice, and the terminal device 1 (MPU31) acquires a plurality of different responses to the character information and a plurality of them. The different responses of are output with different voices.

According to such a voice response system 100, a plurality of responses can be output with different voice colors, so that different solutions can be used with different voice colors even when one solution for one character information cannot be specified. It can be output in an easy-to-understand manner. Therefore, it is possible to improve the usability for the user.

Further, in the voice response system 100, the terminal device 1 inputs the voice by the user via the microphone 37, and the server 90 (calculation unit 101) converts the input voice into character information for the character information. Generates a plurality of different responses and sends them to the terminal device 1. Then, the terminal device 1 acquires a response from the server 90.

According to such a voice response system 100, since voice can be input in the terminal device 1, the character information can be input by voice. Further, since the server 90 can be configured to generate a response, the processing load on the voice response system 100 can be reduced.

Further, in the voice response system 100, the server 90 converts the voice uttered by the user into character information and accumulates habits (pronunciation habits, etc.) at the time of utterance as learning information (capturing the characteristics and incorporating these characteristics). Record it).

According to such a voice response system 100, character information can be generated based on learning information, so that the accuracy of character information generation can be improved.
Further, in the voice response system 100, the server 90 reads emotions from the voice color of the voice input by the user, and usually among emotions including at least one of anger, joy, embarrassment, sadness, and uplifting. , Outputs which emotion corresponds to.

According to such a voice response system 100, it is possible to output a response according to the emotion of the user.
[Modified example of the first embodiment]
In the present embodiment, voice recognition is used as a configuration for inputting character information, but the input is not limited to voice recognition and may be input using an input means (operation unit 70) such as a keyboard or a touch panel. Further, although the operation of "converting the input voice into character information" is performed by the server 90, it may be performed by the terminal device 1.

Further, in the voice response system 100, the server 90 receives a response candidate DB 105 in which a plurality of different responses including a positive response and a negative response to each character information are recorded for each of the plurality of character information. The terminal device 1 may acquire a positive response and a negative response as a plurality of different responses, and reproduce the positive response and the negative response with different voices.

For example, as shown in the second row shown in FIG. 5, when a voice saying "Can I buy something?" Is input, positive information such as a good reputation is associated with a female voice for this item. Output. On the other hand, negative information such as bad reputation is output with a voice different from that of a female voice (here, a male voice) to which positive information is associated.

According to such a voice response system 100, responses from different positions such as a positive response and a negative response can be reproduced with different voice colors, so that the voice can be reproduced as if another person is speaking. Can be done. Therefore, it is possible to make it difficult for the user who listens to the voice to feel a sense of discomfort.

The voice color may be changed depending on the type of response and the wording used in the response. For example, when responding with a gentle tone, the voice of a calm female may be played, and when responding with a violent tone, the voice of a brave man may be used. That is, the response content and the personality may be associated with each other, and the voice color may be set according to the personality.

Further, in the voice response system 100, a response (for example, a positive response or a negative response) output by its own terminal device 1 or another terminal device 1 is input as character information, and a counterargument to this response is made. You may want to generate a response for. In other words, from the user's point of view, we can hear discussions from both the pros and cons. Then, after listening to this discussion, the user can make a final decision.

This configuration can be realized by using one or a plurality of terminal devices 1. In order for the plurality of terminal devices 1 to exchange voice with each other, the voice may be directly input / output, or wireless communication or the like may be used. When the plurality of terminal devices 1 and the server 90 communicate with each other, the data may be transmitted to the other terminal device 1 in the process of S66.

Further, in the voice response system 100, the calculation unit 101 learns (records and analyzes) the user's behavior (conversation, moved place, what is reflected by the camera), and supplements the lack of words in the user's conversation. You may do so.

For example, if the user answers "I like curry" to the question "Is it okay with hamburger steak today?", This device supplements "Because it was hamburger steak yesterday." However, the reason why he said that curry is good is transmitted.

Further, such a configuration can be carried out during a telephone call, or may be configured to freely participate in the conversation of the user.
Further, in the voice response system 100, the server 90 may acquire response candidates from a predetermined server or the Internet.

According to such a voice response system 100, response candidates can be acquired not only from the server 90 but also from any device connected by the Internet, a dedicated line, or the like.
[Second Embodiment]
[Processing of the second embodiment]
Next, another form of the voice response system will be described. In the following embodiments of the present embodiment (second embodiment), only the parts different from the voice response system 100 of the first embodiment are described in detail, and the same parts as the voice response system 100 of the first embodiment are the same. The description will be omitted by adding the reference numerals.

In the voice response system of the second embodiment, voice is output even when the user does not input the character information. Specifically, the terminal device 1 carries out the automatic conversation terminal processing shown in FIG. The automatic conversation terminal process is, for example, a process that is started when the power of the terminal device 1 is turned on, and is a process that is repeatedly executed thereafter.

In the automatic conversation terminal processing, first, it is determined whether or not the setting for automatic conversation is turned ON (S82). It should be noted that whether or not to perform automatic conversation can be set by the user via the operation unit 70 or by inputting voice.

If the automatic conversation is OFF (OFF) (S82: NO), the automatic conversation terminal processing is terminated. If the automatic conversation mode is ON (S82: YES), the fact that the automatic conversation mode is set is transmitted to the server 90 together with the ID for identifying itself (S84).

Subsequently, it is determined whether or not a packet from the server 90 has been received (S86). If no packet has been received (S86: NO), the process of S86 is repeated. Further, if the packet is received (S86: YES), the same processing as in S22 to S30 described above is performed, and when these processing are completed, the automatic conversation terminal processing is terminated.

Further, the server 90 executes the automatic conversation server process shown in FIG. 7. The automatic conversation server process is, for example, a process that is started when the power of the server 90 is turned on and then repeatedly executed.

In the automatic conversation server processing, first, it is determined whether or not the terminal device 1 has received the fact that the automatic conversation mode has been set (S92). If it has not been received that the automatic conversation mode has been set (S92: NO), the process proceeds to S98.

If it has been received that the automatic conversation mode has been set (S92: YES), the terminal device 1 to be the communication partner is specified based on the ID included in the received packet (S94), and the communication partner is addressed. Set to have an automatic conversation (S96). Subsequently, it is determined whether or not the reproduction condition is satisfied for each of the terminal devices 1 for which automatic conversation is set (S98).

Here, the playback condition is, for example, that a certain time has passed since the previous conversation (voice input), a certain time of the day, or when the weather is specific, one of the sensor values is abnormal. Indicates when the value is indicated.

If the reproduction condition is not satisfied (S98: NO), the automatic conversation server processing is terminated. Further, if the reproduction condition is satisfied (S98: YES), a message corresponding to the reproduction condition is generated (S100).

Here, the message according to the playback conditions may be, for example, a fixed phrase such as "Good morning." Or "Hello.", Or the latest news obtained from the news DB 109 in which the latest news is automatically updated. It may be about the news of. If you want to send a message about the latest news, for example, if you can get information about the stock price of a certain company, "Today's stock price of XX company has increased by XX yen. Did you know? "And so on.

When this process is completed, the above-mentioned processes S42 to S54 are performed. Then, when the processing of S54 is completed, it is determined whether or not a predetermined answer has been obtained from the terminal device 1 which is the communication partner (S112). Here, the predetermined answer may be, for example, some kind of voice or a specific answer. The specific answer is, for example, to the question "Do you know?", The answer "I know" or "I don't know", and to the question "How is the weather now?" On the other hand, those that include words that indicate the weather, such as "it's raining" and "it's sunny", are applicable.

If there is a predetermined answer (S112: YES), the automatic conversation server processing is terminated. If there is no predetermined answer (S112: NO), the message transmitted in S100 is retransmitted (S114). When the message is retransmitted in this way, the voice color is changed to generate a voice with a strong voice and a harsh tone.

Subsequently, the report destination DB 117 in which the terminal device 1 and the report destination are associated with each other in advance is referred to, and a notification that there is no response to the predetermined report destination is transmitted (S116). When such processing is completed, the automatic conversation server processing is terminated.

[Effect of the second embodiment]
In the above voice response system 100, the server 90 determines whether or not the situation of the voice response system 100 meets the reproduction condition set as the condition for outputting the voice in advance when the character information is not input. Then, when the reproduction conditions are met, a preset message is output.

According to such a voice response system 100, voice can be output even when character information is not input (that is, when the user does not speak). For example, by forcibly making the user speak, it can be used as a measure for suppressing drowsiness while driving a car. In addition, safety can be confirmed by determining whether or not a person living alone responds.

Further, in the voice response system 100, the server 90 acquires news information and outputs a message related to the news in the form of a question asking for a user's answer.
According to such a voice response system 100, since it is possible to have a conversation about news, it is possible to suppress that the conversation is always the same.

Further, in the voice response system 100, the server 90 adds and outputs separately acquired externally acquired information (news, environment (temperature, weather, location information, etc.)) to a preset message.

According to such a voice response system 100, it is possible to output a response in which a predetermined message and the acquired information are combined.
Further, in the voice response system 100, when the server 90 cannot obtain a response or a response to the message, the information identifying the user and the response to the preset contact cannot be obtained. Send.

According to such a voice response system 100, it is possible to notify a contact when an answer cannot be obtained. Therefore, for example, it is possible to report an abnormality of an elderly person living alone at an early stage.

[Modified example of the second embodiment]
Further, in the voice response system 100, the server 90 may acquire a plurality of messages and select and output the message to be reproduced according to the reproduction frequency of the messages.

According to such a voice response system 100, by making it difficult to reproduce a message having a high reproduction frequency, randomness at the time of message reproduction can be achieved, or by dare to repeatedly reproduce a message having a high reproduction frequency, an alert or a memory can be obtained. It is possible to promote the establishment of.

[Third Embodiment]
[Processing of the third embodiment]
Next, in the voice response system of the third embodiment, the terminal device 1 instead conveys that it is difficult for the user to directly tell someone. For example, before a date, if you talk to the device today to say something like this, at an appropriate time (for example, a preset time or a certain amount of time has passed since the conversation was interrupted). Allow the voice response system 100 to speak (play voice) instead.

Specifically, the terminal device 1 carries out the message terminal processing shown in FIG. 8, and the server 90 carries out the message server processing shown in FIG. The message terminal processing is, for example, a processing that is started when the power of the terminal device 1 is turned on and then repeatedly executed.

In the message terminal processing, as shown in FIG. 8, first, it is determined whether or not the message mode is set by the user (S132). If the message mode is not set (S132: NO), the process of S132 is repeated.

If the message mode is set (S132: YES), the processes of S2 to S8 are executed, and if an affirmative determination is made in S6, the message mode flag is turned on in the memory of the terminal device 1. (S134). Then, the processing of S10 to S16 is carried out.

If an affirmative determination is made in S16, it is determined whether or not a packet from the server 90 has been received (S136). If no packet has been received (S136: NO), the process of S136 is repeated. Further, if the packet is received (S136: YES), the processes of S24 to S30 are executed, and the message terminal process is terminated.

Next, the message server process is, for example, a process that is started when the power of the server 90 is turned on, and is then repeatedly executed. Specifically, first, it is determined whether or not a packet has been received from any of the terminal devices 1 (S142). If no packet has been received (S142: NO), the process proceeds to S156, which will be described later.

Further, if the packet is received (S142: YES), the terminal device 1 of the communication partner is specified (S44), and it is determined whether or not the packet contains a mode flag such as a message mode flag (S144). .. If there is no mode flag (S144: NO), the process proceeds to S148.

If there is a mode flag (S144: YES), the server 90 also sets the mode by setting the flag corresponding to the terminal device 1 of the communication partner to the ON state (S146). For example, if the message mode flag corresponds to the message mode, the processes of S46 to S152 described later are executed, and if the guidance mode flag described later corresponds to the guidance mode, S46 to S176 (see FIG. 11) are executed. Will be.

Subsequently, it is determined whether or not the message flag is in the ON state (S148). If the message flag is in the ON state (S148: YES), the processes S46 to S54 are performed, and then the message reproduction conditions are extracted (S150).

Here, the message reproduction condition can be set in advance by the user via the operation unit 70 of the terminal device 1, and the time and position correspond, for example. The message reproduction condition is transmitted to the server 90 at the time of packet transmission of the message terminal processing.

Subsequently, the message and the voice (voice color) are associated with each other and recorded in the memory (S152), and the process proceeds to S156. If the message flag is in the OFF state (S148: NO), processing related to another mode is performed (S154), and it is determined whether or not the reproduction timing has been reached (S156). Here, the reproduction timing indicates the content set in the message reproduction condition.

If it is not the reproduction timing (S156: NO), the message server processing is immediately terminated. If it is the reproduction timing (S156: YES), the processes of S62 to S64 are executed, and the message server process is terminated.

[Effect of the third embodiment]
According to the voice response system of the third embodiment, the voice input by the user is not immediately reproduced, but can be reproduced when the message reproduction condition is satisfied after a certain period of time.

For example, as shown in the third row of Fig. 5, if you enter "Tell Mr. XX to XX", the sentence you want to convey will be displayed after Mr. XX's voice is recognized (after you hear it). It will be played.

[Modified example of the third embodiment]
In the third embodiment, the content spoken by the user is reproduced, but a word that triggers a difficult thing to say, for example, "Did you say something to her?" It may be configured to speak such words. Specifically, the terminal device 1 carries out the guidance terminal processing shown in FIG. 10, and the server 90 carries out the guidance server processing shown in FIG.

The guidance terminal process is, for example, a process that is started when the power of the terminal device 1 is turned on and then repeatedly executed. For example, it is a process that is started when the power of the terminal device 1 is turned on and then repeatedly executed.

In the guidance terminal process, as shown in FIG. 10, first, it is determined whether or not the guidance mode is set by the user (S162). If the induction mode is not set (S162: NO), the process of S162 is repeated.

If the guidance mode is set (S162: YES), the processes of S2 to S8 are executed, and if an affirmative judgment is made in S6, the guidance mode flag is turned ON in the memory of the terminal device 1. (S164). Then, the processing of S10 to S16 is carried out.

If an affirmative determination is made in S16, it is determined whether or not a packet from the server 90 has been received (S166). If no packet has been received (S166: NO), the process of S166 is repeated. Further, if the packet is received (S166: YES), the processes of S24 to S30 are executed, and the guidance terminal process is terminated.

Next, the guidance server process is, for example, a process that is started when the power of the server 90 is turned on and then repeatedly executed. Specifically, the above-mentioned processes of S142 to S146 are executed. Then, it is determined whether or not the induction flag is in the ON state (S172).

If the induction flag is in the ON state (S172: YES), the processes S46 to S54 are performed, and then the induction regeneration conditions are extracted (S174).
Here, in the guided reproduction condition as well as the message reproduction condition, the user can set in advance via the operation unit 70 of the terminal device 1, and the time and the position correspond, for example. The guided reproduction condition is transmitted to the server 90 at the time of packet transmission of the message terminal processing.

Subsequently, the guidance content is generated, and the guidance content is associated with the voice (voice color) and recorded in the memory (S176). Here, as the guidance content, for example, a word expressing a desire such as "want" or "hope" included in the input character information is searched, the keyword before these words is extracted, and these keywords are guided. The word registered as a word is output as the guidance content. The keyword and the word indicating the guidance content are associated with each other in advance and recorded in the response candidate DB 105.

Subsequently, the above-mentioned processing of S156 or less is performed, and the server processing is terminated. If the guidance flag is in the OFF state (S172: NO), processing related to other modes is performed (S154), the above-mentioned processing S156 or less is performed, and the server processing is terminated.

According to the configuration of the modified example of the third embodiment, the user can be guided to speak the desired word instead of directly outputting the desired word.
[Fourth Embodiment]
[Processing of the fourth embodiment]
Next, an example of using the terminal device 1 for reception work will be described. In the present embodiment, the terminal device 1 is installed at a reception desk of a company or the like. It can also be used for telephone reception such as company representative telephones and telephone banking. Here, in the present embodiment, the processing of S56 in the first embodiment is realized by replacing it with the reception processing shown in FIG.

In the reception process, as shown in FIG. 12, first, it is determined whether or not the character information includes the company name (S192). In this process, it is determined whether or not a general name or a company name (recorded in the voice recognition DB 102) is included.

If the character information does not include the company name or the personal name (S192: YES), a response for asking the company name and the personal name is generated (S194), and the reception process is terminated. This process produces a response, for example, "Please tell us your name and your requirements."

If the character information includes the company name or the personal name (S192: NO), the company name or the personal name is extracted from the sales DB 118 and the client DB 119 (S196). Here, in the sales DB 118, the names of companies and persons in charge who have come to sales in the past, or the names of claimers who only make complaints are recorded. Further, in the client DB 119, the company name, the person in charge of the company, the person in charge on the user side (company side) of the terminal device 1, the schedule such as the scheduled visit time, and the contact information for each person in charge are recorded in association with each other. ing.

Subsequently, it is determined whether or not the company name or individual name can be extracted from the sales DB 118, that is, whether or not the company name or individual name included in the character information is included in the sales DB 118 (S198). If the company name or individual name can be extracted from the sales DB 118 (S198: YES), a sales refusal response (response for refusing the agency) to decline the sales is generated (S200), and the acceptance process is terminated.

If the company name and personal name cannot be extracted from the sales DB 118 (S198: NO), the person who came to the reception visits at a close time (for example, within one hour before and after the current time) in the schedule in the client DB 119. It is determined whether or not the person is coming (S202). If the person is visiting at a near time (S202: YES), the contact information of the person in charge of this person is extracted from the client DB 119 so that this person and the person who came to the reception can have a conversation. , Connect to this person (S204). In this process, the person in charge may be connected to an extension telephone, a mobile phone, or the like.

Subsequently, a reception response for the client is generated (S206). Here, as a reception response for the client, for example, a response such as "Thank you very much, Mr. XX. Please wait for a while because we are connected to the person in charge." Is generated. When such processing is completed, the reception processing is terminated.

Also, if you are not a visitor at a near time (S202: NO), you can connect to a preset reception contact so that this person in charge and the person who came to the reception can have a conversation. Connect to the receptionist (S208). Then, a normal reception response is generated (S210).

Here, as a normal reception response, for example, a response such as "Please wait for a while because you are connected to the reception" is generated. When such processing is completed, the reception processing is terminated.

[Effect of the fourth embodiment]
The voice response system 100 is configured to be used at the reception desk of a workplace or a company. In this configuration, the name and company name of the person who comes to the sales are recorded in advance in the sales DB 118 of the server 90, and if the person who comes to the receptionist gives this name or the company name, the voice of the complaint to refuse is heard. Generate a response to play.

Further, in the voice response system 100, the server 90 identifies a communication partner by the input character information, and connects the communication destination and the communication partner preset for each communication partner.
According to such a voice response system 100, it is possible to assist reception work and telephone correspondence. Further, according to such a voice response system 100, a person who may interfere with the work of the user can be excluded without taking any action.

Further, in the voice response system 100, the server 90 extracts a keyword included in the input character information (particularly voice) and connects to the connection destination to which the keyword corresponds. In addition, for example, a keyword such as the name of the other party and the connection destination are associated in advance.

According to such a voice response system 100, it is possible to assist operations such as telephone transfer and call to reception.
[Modified example of the fourth embodiment]
In the above embodiment, the connection destination is set according to the other party, but by applying this technology, for example, in the telephone reception such as telephone banking and telephone shopping, the requirement (keyword included in the character information) is set. You may recognize it and change the connection destination according to your requirements.

Further, in the voice response system 100, the server 90 may recognize the requirement spoken by the other party based on the keyword and convey the outline spoken by the other party to the user.
According to such a voice response system 100, it is possible to assist the business of agency with the customer.

[Fifth Embodiment]
[Processing of the fifth embodiment]
Next, the terminal device 1 may receive a request from the other terminal device 1 and provide the information requested by the other terminal device 1.

In this configuration, the server 90 requests the necessary information from the other terminal device 1 in the process of S56, acquires the necessary information from the other terminal device 1, and then generates a response. Then, in the terminal device 1 that provides necessary information, the information providing terminal processing shown in FIG. 13 is performed. The information providing terminal process is, for example, a process started when there is a request from the server 90.

As shown in FIG. 13, the information providing terminal process first extracts the information providing destination (S222). This information providing destination indicates another terminal device 1 requesting information, and an ID for identifying the other terminal device 1 is included in the request from the server 90.

Subsequently, it is determined whether or not the person is the other party who is permitted to provide the information (S224). Here, in the terminal information DB 113, the ID of a person who permits the provision of information, such as a family member or a friend, is recorded in advance. In this process, the determination is made by referring to the terminal information DB 113.

If the other party permits the provision of information (S224: YES), the information requested from its own memory 39, various sensors, etc. is acquired (S226), and this data is transmitted to the server 90 (S228). Further, if the other party does not permit the provision of information (S224: NO), the server 90 is transmitted to the effect that the provision of information is refused (S230).

When such processing is completed, the information providing terminal processing is terminated.
In this configuration, for example, as shown in the fourth row of FIG. 5, the server 90 requests the position information from the terminal device 1 of Mr. XX in response to the question "What is Mr. XX doing?" Then, the terminal device 1 returns the position information.

Then, the server 90 recognizes Mr. XX's action based on the location information. For example, if you are moving on the railroad track at a speed faster than the speed at which humans run, it is judged that you are moving on the train, and "Mr. XX is on the train. It seems that you are returning home." Will generate a response.

[Effect of the fifth embodiment]
In the voice response system 100, the server 90 acquires the information recorded in the other terminal device 1 from another terminal device 1 different from the requesting terminal device 1, and provides the information to the other terminal device 1. That is, in the voice response system 100, the server 90 acquires information for generating a response to the character information from the other terminal device 1.

According to such a voice response system 100, a response can be generated based on the information recorded in the other terminal device 1.
Further, in the voice response system 100, when the terminal device 1 requests information for generating a response to the character information from another terminal device 1, the terminal device 1 returns the information corresponding to the request.

In this configuration, the terminal device 1 is provided with sensors for detecting position information, temperature, humidity, illuminance, noise level, etc., and a database such as dictionary information, and extracts necessary information according to a request.

According to such a voice response system 100, it is possible to acquire information unique to the other terminal device 1, such as the position of the other terminal device 1. In addition, it is possible to transmit information unique to itself to another terminal device 1.

[Sixth Embodiment]
[Processing of the sixth embodiment]
Next, in the voice response system of the sixth embodiment, the personality DB 106 in which the personality information in which the personality of the user or the person related to the user is associated according to the preset classification is prepared is prepared. ing. As shown in FIG. 14, for example, the personality DB 106 records the names of users and related persons in association with the personality classification of these persons.

Further, in the personality DB 106 shown in FIG. 14, a personality test is performed on users and related persons, and the test results are also recorded. Here, when generating personality information, a well-known personality analysis technique (Rorschach test, Szondi test, etc.) may be used. In addition, when generating personality information, aptitude test technology used by companies and the like for recruitment tests may be used.

When generating personality information, for example, the personality information generation process shown in FIG. 15 is performed. The personality information generation process is, for example, a process that is started when it is input that the terminal device 1 uses the operation unit 70 or the like to generate personality information.

In the personality information generation process, as shown in FIG. 15, first, the microphone 37 is turned on (S242), and one of the predetermined four-choice questions is output by voice (S244). At this time, the four-choice question may be acquired from the server 90, or the question recorded in the memory 39 in advance may be set.

Subsequently, it is determined whether or not there is a voice response from the target person (user or a related person thereof) (S246). If there is no answer (S246: NO), the process of S246 is repeated.
If there is an answer (S246: YES), conversation parameters such as word endings and conversation speed are extracted (S248), and it is determined whether or not the current problem is the final problem (S250). If it is not the final problem (S250: NO), the next problem is selected (S252), and the process returns to S242.

If it is the final question (S250: YES), the personality analysis is performed by answering the four-choice question (S254), and the personality analysis is performed by the conversation parameter (S256). Here, in the personality analysis using conversation parameters, those who are confident in themselves tend to have a strong flexion, those who are not confident tend to have a weak flexion, those who are impatient have a fast conversation speed, and those who are calm have a slow conversation speed. You can catch trends and so on.

Subsequently, these personality analysis results are comprehensively analyzed (S258), such as by weighted averaging, and sorted into personality categories (S260). In detail, the personality of the subject obtained by the test is scored and sorted into personality categories according to the score.

Subsequently, the subject and the personality classification are associated with each other (S262) and recorded in the personality DB 106 (S264). That is, the relationship between the target person and the personality classification is transmitted to the server 90. At this time, the test result is also transmitted to the server 90, and the server 90 constructs the personality DB 106 as shown in FIG. When such processing is completed, the personality information generation processing is terminated.

When using the personality DB 106 generated in this way, a response candidate DB 105 in which a personality classification and a different response are associated with each other is prepared. Then, the server 90 acquires response candidates representing a plurality of different responses to the character information in the processing of S56, selects a response to be output from the response candidates according to the personality information, and in the processing of S60 and S64, the response candidate is selected. Output the selected response.

[Effect of the sixth embodiment]
In the voice response system 100, the terminal device 1 generates personality information of a user or a related person based on answers to a plurality of preset questions, and acquires the generated personality information.

According to such a voice response system 100, personality information can be generated in the server 90 or the terminal device 1.
Further, in the voice response system 100, the calculation unit 101 generates personality information of the user or a related person based on the character string included in the input character information.

According to such a voice response system 100, personality information can be generated in the process of using the voice response system 100 by the user.
Further, according to such a voice response system 100, it is possible to make a different response depending on the personality of the user or a person (related person) related to the user. Therefore, it is possible to improve usability for the user.

[Variation example of the sixth embodiment]
In the sixth embodiment, the response may be narrowed down to one according to the personality and then output, or the plurality of responses may be output in association with voices having different voice colors.

Further, among the above-mentioned personality information generation processes, the processes of S248 and S254 to S264 may be performed on the server 90. In this case, as in the first embodiment, the server 90 may specify the terminal device 1 while exchanging voices and problems between the terminal device 1 and the server 90.

Further, in the voice response system 100, the server 90 may detect any one of the user's actions and operations and generate learning information or personality information based on these.

According to such a voice response system 100, for example, when it is detected that the user jumps on the train for several days in a row, the user is urged to leave the house several minutes earlier from the next day, or the user gets angry from the conversation. When it is detected that it tends to be easy, it is possible to output a voice or music that suppresses the mood.

[7th Embodiment]
[Processing of the 7th embodiment]
Next, in the voice response system of the seventh embodiment, the preference DB 108 in which the preference information in which the preferences of the user and the related persons are associated according to the preset categories is recorded is prepared. In the preference DB 108, for example, as shown in FIG. 16, the names of users and related persons and the preferences of these persons are the types of preferences such as food preference (food), color preference (color), and hobby. It is recorded in association with each of.

In particular, for food preferences, sweet party (sweet), spicy party (spicy), average in between, and for color preferences, warm color (warm), cool color (cold), intermediate average, hobbies Is classified into indoor hobbies (inside), outdoor hobbies (outside), and both indoor and outdoor hobbies (inside and outside).

When constructing such a preference DB 108, for example, the preference information generation process shown in FIG. 17 is executed. The preference information generation process is performed, for example, between S48 and S54.
Specifically, as shown in FIG. 17, a keyword related to preference is extracted from the character information (S282), and an object related to preference is extracted from the objects specified by image processing (S284). In the preference DB 108, the keywords related to the preference are associated with the type of preference and the classification within the type (sweet, average, spicy, etc. if the taste of food), and were extracted in these processes. When a keyword or an object is included in the preference DB 108, it is extracted as related to the preference.

Subsequently, the counter is incremented for each group of keywords related to preference (S288). For example, when the type of preference is "food preference" and the type is "spicy" such as kimchi is extracted, the counter corresponding to "food preference" and "spicy" is incremented. ..

Then, the preference information (preference DB 108) is updated based on the counter value (S290). That is, for each "type of preference", the "type" having the largest counter value is recorded in the preference DB 108 as a feature of the preference of the user or the person concerned as the one that best matches the preference. When such a process is completed, the preference information generation process is terminated.

When using the preference DB 108 generated in this way, a response candidate DB 105 in which different responses are associated with each preference is prepared, and the server 90 prepares a plurality of different responses to the character information in the process of S56. A response candidate representing a response is acquired, a response to be output from the response candidate is selected according to preference information, and the selected response is output in the processes of S60 and S64.

[Effect of the 7th embodiment]
In the voice response system 100, the server 90 generates preference information indicating a tendency of preference of a user or a related person based on a character string included in the character information. Then, the response to be output from the response candidates is selected based on the preference information, and the selected response is output.

According to such a voice response system 100, it is possible to respond according to the preference of the user or a person concerned. For example, when the user asks the terminal device 1 "what does Mr. XX want?" When buying a present of the person concerned, a response according to the preference information can be obtained.

[Modified example of the seventh embodiment]
As shown in FIG. 18, the response candidate DB 105 may have a table in which the personality classification and the preference information are associated with each other.

For example, in the example shown in FIG. 18, the personality classification and the color preference are associated with each other, and the products that can be presumed to be happy for a woman to receive as a gift are arranged in a matrix.
In the process of S56, it is also possible to generate a response by adding both personality and taste in this way.

[Eighth Embodiment]
[Processing of the eighth embodiment]
In the above embodiment, the voice is converted into character information, but the operation by the user may be converted into character information.

Specifically, the terminal device 1 may capture the user's operation as an captured image and transmit it to the server 90, and the server 90 may perform, for example, the operation character input process shown in FIG. The operation character input process is a process started when a part of the user's body is reflected in the captured image in the process of S48.

In the operation character input process, as shown in FIG. 19, first, a captured image is acquired (S302). Then, it is determined whether the user is trying to input characters by handwriting or by sign language (S304, S308).

In these processes, for example, when the upper body of the user is shown together with the face in the captured image, it is determined that the user is trying to input characters in sign language, and the user's face is not shown in the captured image. If the hand is reflected, it is determined that the character is being input by handwriting.

If a character is to be input by handwriting (S304: YES), the behavior of the fingertip or the pen tip is recorded (S306), and the behavior is converted into character information based on this behavior (S312). Here, in the handwritten character / sign language DB 112, the behavior when handwriting the character and the character are associated with each other, and the movement of the hand and the character expressed by the sign language are associated with each other. In the process of S312, character information is generated by referring to the handwritten character / sign language DB 112.

Further, if an attempt is made to input a character in sign language (S304: NO, S308: YES), the sign language content is recognized with reference to the handwritten character / sign language DB 112, and the above-mentioned processing of S312 is performed. Further, if no attempt is made to input characters by handwriting or sign language (S308: NO), input processing by another method is performed (S314).

Then, the characters input by the action and the characters input by the voice are associated with each other, and whether or not there is a similar voice (whether or not the degree of matching between the reference waveform based on the character and the pronunciation waveform is equal to or higher than the reference value). Is determined (S316). If there is such a voice input (S316: YES), the accent and pronunciation characteristics when the user inputs this character are recorded in the learning DB 107 in association with the character (S318), and the operation character input process is performed. To finish.

If there is no such voice input (S316: NO), the operation character input process is terminated.
[Effect of the eighth embodiment]
In the voice response system 100, since the operation by the user is converted into character information, the user can input the character information without speaking out.

[Variation example of the eighth embodiment]
The operation of the present embodiment may be caused not only by handwriting of characters or gestures (for example, sign language) but also by the movement of muscles.

[9th Embodiment]
[Processing of the ninth embodiment]
The contents of the learning DB 107 may be made available in the other terminal device 1 when the other terminal device 1 different from the terminal device 1 normally used by the user is used. In this case, the other terminal device 1 transmits the ID and password of the terminal device 1 that is normally used to the server 90 together with the usage request.

Then, the server 90 executes the other terminal use process shown in FIG. The other terminal usage process is a process that is started when a usage request is received.
In the process of using another terminal, as shown in FIG. 20, first, it is determined whether or not the ID and the password have been input (S332). If the ID and password have not been entered (S332: NO), the process of S332 is repeated.

Further, if the ID and the password are input (S332: YES), it is determined whether or not the authentication by the ID and the password is completed (S334). If the authentication is completed (S334: YES), the fact that the authentication is completed is transmitted to the other terminal device 1 (S336), and the other terminal device 1 transmits the learning DB 107 of the terminal device 1 corresponding to the ID and the password. Set to use (S338).

If the authentication is not completed (S334: NO), an error is transmitted to the other terminal device 1 (S340), and the processing for using the other terminal is terminated.
[Effect of the ninth embodiment]
Further, in the voice response system 100, the server 90 transfers the learning information of one terminal device 1 to another terminal device 1.

According to such a voice response system 100, even when a user who uses a certain terminal device 1 uses another terminal device 1, the learning information recorded in the certain terminal device 1 (recorded in the server 90). Learning information) can be used. Therefore, even when another terminal device 1 is used, the accuracy of generating character information can be improved. This is particularly effective when the user has a plurality of terminal devices 1.

Further, in the voice response system 100, the server 90 outputs information about the user in response to an inquiry from a person other than the user.
According to such a voice response system 100, for example, if the distance of a walk, which is the meal content of the user, is detected, it is possible to answer a question at a hospital or the like on behalf of the user. You may also learn about your health condition and self-introduction.

[Variation example of the ninth embodiment]
Similar to the configuration of the ninth embodiment, when the request for terminating the use and the ID and the password are received, the use of the learning DB 107 for the terminal device 1 corresponding to the ID and the password may be terminated (prohibited).

[10th Embodiment]
[Processing of the tenth embodiment]
In the voice response system of the tenth embodiment, the server 90 stores the conversation content and asks a question to obtain the same content about the heard content. Specifically, in S100 of the automatic conversation server process shown in FIG. 7, the memory confirmation process shown in FIG. 21 is executed.

In the memory confirmation process, as shown in FIG. 21, past conversation contents are extracted from the learning DB 107 (S352), and a question having a keyword included in any of the conversation contents as an answer is generated (S353). When such a process is completed, the memory confirmation process is terminated.

In the memory confirmation process, you can ask, for example, "What was the menu for dinner yesterday?" Or "Where did you go three days ago?"
[Effect of the tenth embodiment]
According to such a voice response system 100, it is possible to confirm the memory ability of the user and to fix the memory. It is also considered to be effective in suppressing the progression of dementia in the elderly.

[11th Embodiment]
[Processing of the eleventh embodiment]
Next, the voice response system of the eleventh embodiment is configured so that the user can practice a foreign language by using the terminal device 1 and the server 90.

Specifically, the pronunciation determination process 1 shown in FIG. 22, the pronunciation determination process 2 shown in FIG. 23, and the pronunciation determination process 3 shown in FIG. 24 are executed in order. However, the server 90 executes one of the pronunciation determination processes 1 to 3 each time the voice response server process (FIG. 2) is executed. Further, each of the pronunciation determination processes 1 to 3 is executed as the process of S56 described above.

First, in the pronunciation determination process 1, as shown in FIG. 22, a response to instruct to input a predetermined sentence by voice is generated (S362). In this process, for example, a sentence that serves as a model for a foreign language is generated, and the sentence is encouraged to imitate and speak following the model. When this process is completed, the pronunciation determination process 1 is terminated.

Next, when a voice is input in association with the pronunciation determination process 1, the pronunciation determination process 2 is performed. In the pronunciation determination process 2, as shown in FIG. 23, the accuracy of pronunciation and accent is scored (S372). In this process, the voice is regarded as a waveform, and the degree of coincidence of the waveform with that of the sample sentence as the waveform is scored.

Then, this score is recorded in the memory (S374), and the pronunciation determination process 2 is terminated. Subsequently, the pronunciation determination process 3 is performed. In the pronunciation determination process 3, as shown in FIG. 24, first, it is determined whether or not the score is less than the threshold value (S382).

If the score is less than the threshold value (S382: YES), a response to instruct to input the same sentence again is generated (S384). In this process, for example, a response is generated to encourage the user to imitate and speak again following the example.

Further, if the score is equal to or higher than the threshold value (S382: NO), a response indicating that the pronunciation is good and prompting to input the next sentence is generated (S386). For example, generate a response such as "Good pronunciation. Let's move on."

When such a process is completed, the pronunciation determination process 3 is terminated.
[Effect of the 11th embodiment]
In the voice response system 100, the server 90 detects the accuracy of the pronunciation and accent of the voice input by the user, and outputs the detected accuracy.

According to such a voice response system 100, the accuracy of pronunciation and accent can be confirmed. For example, it is effective when practicing a foreign language.
Further, in the voice response system 100, the server 90 outputs the same question again when the accuracy is equal to or less than a certain value.

According to such a voice response system 100, an accurate answer can be obtained by outputting the same question.
[Modified example of the eleventh embodiment]
In the voice response system 100, when the accuracy is equal to or less than a certain value, the server 90 may output a voice including the word closest to the pronunciation made by the user for confirmation.

According to such a voice response system 100, the user can confirm the accuracy of pronunciation and accent.
[12th Embodiment]
[Processing of the twelfth embodiment]
Next, the voice response system of the twelfth embodiment will be described. In the voice response system of the twelfth embodiment, the user's emotion is detected from the voice input by the user, and a response that heals the user is generated according to the emotion.

Specifically, the emotion determination process shown in FIG. 25 and the emotion response generation process shown in FIG. 26 are executed. The emotion determination process is performed as the details of the above-mentioned S50 process, and as shown in FIG. 25, first, the emotion is scored from the voice color, the strength of the flexion of the sentence, the length of one sentence, the conversation speed, the unexpected words, and the like. (S392), then the emotions are classified according to the score and recorded in the memory (S394).

When such a process is completed, the emotion determination process is terminated. Subsequently, in the above-mentioned process of S56, the emotion response generation process is executed.
Specifically, as shown in FIG. 26, first, the emotion classification set in the emotion determination process is determined (S412). If the emotion classification is normal (S412: normal), a normal greeting such as "hello" is generated as a response (message) (S414).

If the emotion classification is anger (S412: anger), a sentence for calming the other party's emotions, such as "Did you bother me?", Is generated as a response (S416). Further, if the emotion classification is joy (S412: joy), a greeting with a brighter nuance as compared with a normal greeting, such as "Today is fun", is generated as a response (S418).

If the emotion classification is confusing (S412: confused), a greeting message for caring for the other party such as "What's wrong?" Is generated as a response (S420). When such a process is completed, the emotion response generation process is terminated.

[Effects of the 12th Embodiment]
In the voice response system 100, the server 90 detects annoyance or agitation of the user by detecting an unexpectedly emitted voice, and generates a message for suppressing the annoyance or the agitation.

According to such a voice response system 100, when the user is irritated or upset, it is possible to suppress them. Therefore, it is possible to suppress the vocalization of troubles between the user and the surroundings.

[13th Embodiment]
[Processing of the thirteenth embodiment]
Next, the voice response system of the thirteenth embodiment will be described. In the voice response system of the thirteenth embodiment, a process of guiding the user to an object in the captured image is performed. This process is performed on the server 90 as the details of the process of S56 described above.

When a voice input such as "Please guide the way to the tower you can see" in the terminal device 1, the guidance process is performed in the process of S56. In the guidance process, as shown in FIG. 27, first, the terminal position information is acquired from the GPS receiver 27 or the like of the terminal device 1 (S432).

Then, based on the voice (character information) and the image processing, the target object is specified from the objects in the captured image, and this position is specified (S434). In this process, the position of the object is specified in the map information (which may be acquired from the outside or may be held by the server 90) based on the shape of the object, the relative position, and the like. For example, when a tower is shown in the captured image, the tower is specified on the map from the position of the terminal device 1 and the shape of the tower.

Subsequently, the route to this object is searched (S436), and the route information is acquired (S438). This process can be realized by using the same process as that in a well-known cloud-type navigation device.

Then, a response for guiding the route is generated (S440). Also in this process, it is sufficient to generate a response similar to the guidance provided by the navigation device.
When such a process is completed, the guidance process is terminated. When the guidance process is performed while the user is moving, the automatic conversation server process may be used to reproduce the message on the condition that the user reaches the point to be guided.

[Effect of the thirteenth embodiment]
In the voice response system 100, when the character information is input, the server 90 generates a response corresponding to the captured image captured around the voice response system 100, and outputs this response by voice.

According to such a voice response system 100, a response can be output by voice according to the captured image. Therefore, usability can be improved as compared with a configuration in which a response is generated only from character information.

Further, in the voice response system 100, the server 90 searches for an object included in the character information from the captured image by image processing, identifies the position of the searched object, and guides the object to the position of the searched object.

According to such a voice response system 100, the user can be guided to an object in the captured image.
Further, in the voice response system 100, the server 90 acquires route information such as weather, temperature, humidity, traffic information, and road surface condition to the destination when guiding to the destination, and the route information is voiced. Output.

According to such a voice response system 100, the situation (route information) to the destination can be notified to the user by voice.
[Modified example of the thirteenth embodiment]
In addition to the above configuration, character information may be input so that what is recognized responds, and what is recognized from the captured image (someone) may be output by voice.

Further, in the voice response system 100, the server 90 may acquire a moving image of the shape of the user's mouth when inputting character information by voice instead of the processing of S48. In this case, instead of the processing of S52, the voice may be converted into character information, and the unclear part of the voice may be estimated and the character information may be corrected based on the moving image.

According to such a voice response system 100, since the utterance content can be estimated from the shape of the mouth, an unclear part of the voice can be estimated satisfactorily.
[14th Embodiment]
[Processing of the 14th embodiment]
Next, the voice response system of the 14th embodiment will be described. In the voice response system of the 14th embodiment, a predetermined operation is requested from the user, and it is determined whether or not the user has performed the operation according to the request. In this configuration, in the automatic conversation terminal process shown in FIG. 6 and the automatic conversation server process shown in FIG. 7, the move request process 1 shown in FIG. 28 and the move request process 2 shown in FIG. 29 are the details of the process of S56 described above. It will be carried out in order.

First, when the processing of S54 is completed, the movement request processing 1 is started, and in the movement request processing 1, as shown in FIG. 28, a response (message) instructing to move the line of sight or the head to a predetermined position is output. (S452). When this process is completed, the move request process 1 is terminated.

Subsequently, when the processing of S54 is completed next, the movement request processing 2 is started, and in the movement request processing 2, it is determined whether or not the line of sight or the position of the head has moved as instructed as shown in FIG. 29 (as shown in FIG. 29). S462). In this processing, the motion of the user is detected by processing the image captured by the camera and using the detection results of various sensors of the terminal device 1. When the line of sight is detected by image processing, a well-known line-of-sight recognition technique may be adopted.

If the line of sight or head does not move as instructed (S462: NO), the response generated in S452 is output again (S464). Further, if the line of sight or the head is moving as instructed (S462: YES), another arbitrary response is generated (S466).

When such a process is completed, the move request process 2 is terminated.
[Effect of the 14th embodiment]
The voice response system 100 detects the line of sight of the user, and if the line of sight of the user does not move to a predetermined position in response to the call, outputs a voice requesting the line of sight to move to a predetermined position.

According to such a voice response system 100, the user can be made to look at a specific position. Therefore, it is possible to surely confirm the safety when driving the vehicle.
In the voice response system 100, the server 90 observes the position of the body part and the facial expression, and outputs a voice requesting the position of the body part and the facial expression to be changed when there is little change in the call. do.

According to such a voice response system 100, it is possible to move the position of a part of the user's body to a specific position or to induce the user to make a specific facial expression. The present invention can be used when driving a vehicle, performing a physical examination, or the like.

[15th Embodiment]
[Processing of the fifteenth embodiment]
Next, the voice response system of the fifteenth embodiment will be described. In the voice response system of the fifteenth embodiment, when the user inputs a broadcast program or music as voice, a process for complementing the interruption of the broadcast program or music is performed.

In this configuration, as the details of the above-mentioned S56, the broadcast music complement processing shown in FIG. 30 is performed. In the broadcast music complement processing, as shown in FIG. 30, first, it is determined whether or not the broadcast program or music (if the user sings, the song) is interrupted (S482).

If it is interrupted (S482: YES), the broadcast program or music synchronized in the process of S492 described later is set as the response content (S484), and the broadcast music complement processing is terminated. If it is not interrupted (S482: NO), the broadcast program is acquired if the broadcast program is being watched (S486), and the corresponding music is acquired if the music is being played (S488).

Here, in the karaoke DB 116, the music and the lyrics are recorded in association with each other, and when the music is acquired in this process, the music with the lyrics is acquired.
Subsequently, the broadcast program or music to be viewed by the user is specified (S490). Then, the broadcast program or music is acquired and prepared so that it can be played back in synchronization with the broadcast program or music to be viewed by the user (S492), and the broadcast music complement processing is completed.

[Effect of the 15th embodiment]
In the voice response system 100, the server 90 acquires a broadcast program similar to the broadcast program to be viewed by the user, and when the broadcast program is interrupted, outputs the broadcast program acquired by itself to output the interrupted broadcast program. Complement.

According to such a voice response system 100, it is possible to supplement the broadcast program that the user watches without interruption.
Further, in the voice response system 100, when the user sings a song without lyrics with lyrics, the server 90 compares the song with lyrics with the lyrics attached by the user, and only the lyrics of the user. The lyrics are output by voice in the part where there is no.

According to such a voice response system 100, it is possible to supplement a part (a part where lyrics are interrupted) that a user who uses a so-called karaoke device cannot sing.
[16th Embodiment]
[Processing of the 16th embodiment]
Next, the voice response system of the 16th embodiment will be described. In the voice response system of the 16th embodiment, when a character is included in the captured image and the terminal device 1 receives a question about how to read the character, the information of the character is acquired from the outside and the character is obtained. The reading of the characters contained in the information is output by voice.

In this configuration, as the details of S56 described above, the character commentary processing shown in FIG. 31 is performed. In the character commentary processing, as shown in FIG. 31, first, it is determined whether or not a reading question has been received, for example, "how to read" (S502). If the reading question is received (S502: YES), the reading is searched from another server or the like connected via the Internet network 85 for the image-recognized character (S504), and the obtained reading is set as the response. (S506), and the character commentary processing is terminated.

If it is not a reading question (S502: NO), it is a "meaning of words" question like the content described in the Japanese dictionary. It is determined whether or not it has been received (S508). If a question of meaning is received, the meaning of the image-recognized character (word) is searched from another server connected via the Internet network 85 (S510), and the obtained meaning is set as a response (S510). S512), the character explanation process is terminated.

[Effect of the 16th embodiment]
According to such a voice response system 100, the reading of the image-recognized character is searched from another server or the like, and the obtained reading is set as the response. Therefore, the user is informed of how to read the character and the meaning of the word. I can teach you.

[17th Embodiment]
[Processing of the 17th embodiment]
Next, the voice response system of the 17th embodiment will be described. In the voice response system of the 17th embodiment, the server 90 detects an abnormal behavior or a fine state of the user of the terminal device 1 based on the sensor value detected by the terminal device 1, and reports when there is an abnormality. Carry out the process.

Specifically, the terminal device 1 implements the action response terminal process shown in FIG. 32, and the server 90 implements the action response server process. In the action response terminal processing, as shown in FIG. 32, first, the output from various sensors mounted on the terminal device 1 is acquired (S522), and the image captured by the camera 41 is acquired (S524). Then, the output and the captured image by the acquired various sensors are packet-transmitted to the server 90 (S526), and the action response terminal processing is terminated.

Next, in the action response server processing, as shown in FIG. 33, first, the above-mentioned processes S42 to S44 are performed. Subsequently, the behavior such as wandering is specified based on the position information of the terminal device 1 (detection result by the GPS receiver 27) (S532), and the environment of the user is determined based on the detection results by the temperature sensors 15, 19 and the like. Detect (S534). Then, the abnormality is detected (S536).

In this process, anomalies are detected based on changes in location information and the environment. For example, when the user does not move in a place of high temperature or low temperature, or when the user exists in a place where the user does not usually go, the abnormality is detected (S536). Alternatively, the location information and the environment are scored, and if this score is below the reference value (outside the reference range), it is judged to be abnormal.

Subsequently, it is determined whether or not an abnormality has been detected (S538). If no abnormality is detected (S538: NO), the action response server processing is terminated. If an abnormality is detected (S538: YES), a message indicating that there is an abnormality is generated (S540), and a predetermined contact is notified (S542). Then, the above-mentioned processes S62 to S68 (excluding S66) are executed, and the action response server process is terminated.

[Effect of the 17th embodiment]
In the voice response system 100, the server 90 detects the user's behavior and the user's surrounding environment, and generates a message according to the detected behavior and the surrounding environment.

According to such a voice response system 100, it is possible to notify a dangerous place, an exclusion zone, and the like. In addition, it is possible to detect that the user has abnormal behavior.

Further, in the voice response system 100, the server 90 determines the health state based on the captured image captured by the user, and generates a message according to the health state.
According to such a voice response system 100, the health condition of the user can be managed.

Further, in the voice response system 100, the server 90 notifies a predetermined contact when the health condition is lower than the reference value.
According to such a voice response system 100, when the health condition of the user is equal to or less than the reference value, the notification can be made. Therefore, the abnormality can be notified to others at an earlier stage.

[Other embodiments]
The embodiments of the present invention are not limited to the above embodiments, and various embodiments may be adopted as long as they belong to the technical scope of the present invention.

For example, the voice response system 100 may mediate exchanges between two parties and between multiple parties. In detail, when it is necessary to give way to each other at an intersection or the like, the terminal devices 1 may negotiate which vehicle enters the intersection first. In this case, each terminal device 1 transmits information on the movement direction when approaching the intersection and the approach speed to the intersection to the server 90, and the server 90 sends information to each terminal device 1 according to the movement direction and the approach speed. Priority may be set, and voices such as "Torare" and "Enterable" may be generated and output according to the priority.

Further, when the terminal device 1 accepts an incoming call (incoming call) for a communication that needs to be answered in real time, such as voice communication, the incoming call may be accepted only when it is convenient for the user. Specifically, when the user's face can be imaged by the camera 41, it may be regarded as a time convenient for the user and the incoming call may be accepted.

Furthermore, there are some people who are uncomfortable if they do not answer even if they call the other party during voice communication or the like. In order to suppress such feelings, the situation of the other party may be communicated to the user who is waiting for the response from the other party. For example, if the user's schedule is managed in the terminal device 1 and the user does not answer the incoming call, what the user is doing or the free time of the user's schedule is searched for. It is conceivable to let the user know when they can respond.

Further, if the user does not answer the incoming call, the location of the user may be notified to the caller. For example, if the user is connected to the Internet or the like via a smartphone or a personal computer, it is possible to know which terminal is being operated. It is conceivable to identify the location of the user from this information and inform the caller.

Further, it may be determined whether or not the user can answer the incoming call by using the position information using GPS or the like. Based on location information, it is possible to determine whether or not you are in a car, whether or not you are at home, etc. For example, if the user is on the move or on the bed, it is highly public or sleepy. It may be judged that the call cannot be answered by judging that the call is medium. If the incoming call cannot be answered in this way, it is conceivable to inform the caller of what the user is doing as described above.

Further, in order to acquire the position information, a configuration using a security camera can be considered. In recent years, since security cameras are installed in various places, it is possible to recognize the position of the user by using these security cameras and using a configuration for identifying the person such as face recognition. .. In addition, the security camera may be used to determine the situation such as what the user is doing (whether or not he / she can answer the phone). In addition, whether or not the incoming call can be answered can be determined by the condition that another fixed-line telephone is used (the incoming call cannot be answered while the fixed-line telephone is in use).

Furthermore, when the user of the terminal device 1 wants to have a conversation with someone, the user's personality learning result is used to call the terminal device that is presumed to be compatible with each other among an unspecified number of users. May be good. Further, in such a case, a topic that is likely to be exciting (a topic that both users are interested in (extracted by using the learning result)) may be spoken to the user.

Further, when the voice response device is not used for a long time (when the user has not spoken for a reference time or more), the voice response device may give some words to the user.
At this time, the language to be spoken may be selected by using the position information such as GPS.

[Relationship between the means described in the means for solving the claims or the problems (the present invention) and the configuration in the embodiment]
The terminal device 1 and the server 90 in the above embodiment correspond to an example of the voice response device of the present invention. Further, the processing of 22 and S56 in the above embodiment corresponds to an example of the response acquisition means of the present invention.

Further, the processing of S28, S60, and S64 in the above embodiment corresponds to an example of the audio output means of the present invention. Further, the processing of S2 and S6 in the above embodiment corresponds to an example of the voice input means of the present invention.

Further, the processing of S14 in the above embodiment corresponds to an example of the voice transmission means of the present invention. Further, the response candidate DB 105 in the above embodiment corresponds to an example of the response recording means of the present invention.

Further, the processing of S56 in the above embodiment corresponds to an example of the personality information acquisition means of the present invention. Further, the processing of S22 and S56 in the above embodiment corresponds to an example of the response acquisition means of the present invention.

Further, the processing of S28, S60, and S64 in the above embodiment corresponds to an example of the audio output means of the present invention. Further, the processing of S254, S258, and S260 in the above embodiment corresponds to an example of the first personality information generating means and the second personality information generating means of the present invention. Further, the processing of S56 in the above embodiment corresponds to an example of the personality information acquisition means of the present invention.

Further, the processing of S22 and S56 in the above embodiment corresponds to the response acquisition means of the present invention. Further, the processing of S28, S60, and S64 in the above embodiment corresponds to an example of the audio output means of the present invention.

Further, the processing of S254, S258, and S260 in the above embodiment corresponds to an example of the first personality information generating means and the second personality information generating means of the present invention.
Further, the processing of S48 and S56 in the above embodiment corresponds to an example of the response generating means of the present invention. Further, the processing of S28, S60, and S64 in the above embodiment corresponds to an example of the audio output means of the present invention.

Further, the modification of the modification: S48 in the above embodiment corresponds to an example of the voice input moving image acquisition means of the present invention. Further, the processing of S52 in the above embodiment corresponds to an example of the character information conversion means of the present invention.

Further, the preference information generation process in the above embodiment corresponds to an example of the preference information generation means of the present invention. Further, the processing of S56 in the above embodiment corresponds to an example of the response candidate acquisition means of the present invention.

Further, the operation character input process in the above embodiment corresponds to an example of the character information generation means of the present invention. Further, the other device information acquisition means The processing using another terminal in the above embodiment corresponds to an example of the transfer means of the present invention.

Further, the treatment of S98 in the above embodiment corresponds to an example of the reproduction condition determining means of the present invention. Further, the processing of S100 in the above embodiment corresponds to an example of the message reproducing means of the present invention.

Further, the processing of S116 in the above embodiment corresponds to an example of the unanswered transmission means of the present invention. Further, the processing of S372 in the above embodiment corresponds to an example of the utterance accuracy detecting means of the present invention.

Further, the processing of S374 in the above embodiment corresponds to an example of the accuracy matching output means of the present invention. Further, the processing of S204 in the above embodiment corresponds to an example of the connection control means of the present invention.

Further, the processing of S50 in the above embodiment corresponds to an example of the emotion determination means of the present invention. Further, the processing of S438 in the above embodiment corresponds to an example of the route information acquisition means of the present invention.

Further, the treatment of S462 in the above embodiment corresponds to an example of the line-of-sight detecting means of the present invention. Further, the processing of S464 in the above embodiment corresponds to an example of the line-of-sight movement request transmitting means of the present invention.

Further, the processing of S464 in the above embodiment corresponds to an example of the change request transmitting means of the present invention. Further, the processing of S486 in the above embodiment corresponds to an example of the broadcast program acquisition means of the present invention.

Further, the processing of S484 in the above embodiment corresponds to an example of the broadcast program complementing means and the lyrics adding means of the present invention. Further, the processing of S504 and S506 in the above embodiment corresponds to an example of the reading output means of the present invention. Further, the processing of S522 and S524 in the above embodiment corresponds to an example of the behavioral environment detecting means of the present invention.

Further, the treatment of S538 in the above embodiment corresponds to an example of the health condition determining means of the present invention. Further, the treatment of S540 in the above embodiment corresponds to an example of the health message generation means of the present invention.

Further, the processing of S542 in the above embodiment corresponds to an example of the reporting means of the present invention.

1 ... Terminal device, 10 ... Behavior sensor unit, 11 ... Dimensional acceleration sensor, 13 ... Axis gyro sensor, 15 ... Temperature sensor, 17 ... Humidity sensor, 19 ... Temperature sensor, 21 ... Humidity sensor, 23 ... Illumination sensor, 25 ... Wet sensor, 27 ... GPS receiver, 29 ... wind speed sensor, 33 ... electrocardiographic sensor, 35 ... heart sound sensor, 37 ... microphone, 39 ... memory, 41 ... camera, 50 ... communication unit, 53 ... wireless telephone unit, 55 ... Contact memory, 60 ... Notification unit, 61 ... Display, 63 ... Illumination, 65 ... Speaker, 70 ... Operation unit, 71 ... Touch pad, 73 ... Confirmation button, 75 ... Fingerprint sensor, 77 ... Relief request lever, 80 ... Communication base station, 85 ... Internet network, 90 ... Server, 100 ... Voice response system, 101 ... Calculation unit, 102 ... Voice recognition DB, 103 ... Predictive conversion DB, 104 ... Voice DB, 105 ... Response candidate DB, 106 ... Character DB, 107 ... Learning DB, 108 ... Preference DB, 109 ... News DB, 110 ... Weather DB, 111 ... Playback condition DB, 112 ... Handwritten characters / handwriting DB, 113 ... Terminal information DB, 114 ... Sensory judgment DB, 115 ... Health judgment DB, 116 ... Karaoke DB, 117 ... Report destination DB, 118 ... Sales DB, 119 ... Client DB.

Claims (5)

A voice response unit configured to respond to the input voice by voice,
A voice setting unit configured to set automatic conversation by voice,
A determination unit configured to determine whether or not the setting for automatic conversation is turned on, and a determination unit.
When the determination unit determines that the automatic conversation mode is ON, the transmission unit configured to transmit the fact that the automatic conversation mode has been set to the server together with the ID for identifying itself. When,
A reproduction determination unit configured to determine whether or not a preset reproduction condition is satisfied, and a reproduction determination unit.
If the reproduction condition is satisfied, a generation unit configured to generate a question-type message requesting the user's answer, which is a message corresponding to the reproduction condition, and
A voice response device equipped with. The voice response device according to claim 1.
An end unit configured to end the automatic conversation when the determination unit determines that the automatic conversation is OFF.
A voice response device further equipped with. The voice response device according to claim 1 or 2.
A personality recognition unit configured to recognize the personality of the user of the voice response device based on the input voice, and
A distribution unit configured to distribute the recognized personality to any of the prepared personality categories, and
A recording unit configured to record the user and the personality classification to which the recognized personality is assigned in a database in association with each other.
Further prepare
The voice response unit is a voice response device configured to select a response according to a recognized personality. The voice response device according to any one of claims 1 to 3.
With a microphone and a speaker,
The voice response unit is a voice response device configured to acquire a voice response to a voice input using the microphone from a server and generate the response from the speaker. The voice response device according to any one of claims 1 to 4.
A voice response device configured to output that an error has occurred when the response is not obtained from the server within an allowable time.

Images