JP2017159850A - Response system and response program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique that is able to reduce the possibility that concentration of a user may be decreased due to output of a response.SOLUTION: A response system comprises: an input acceptance section that accepts input of a user; a response generating section that generates a response to the input; a steering state determination section that determines whether the user is steering or not; and a response output section that, when input by the user to the response is requested once or more times and the user is steering, outputs the response after the steering is finished.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a response system and a response program.

  Conventionally, a voice recognition technique for recognizing a user's utterance such as a vehicle is known. For example, Patent Document 1 discloses a configuration in which voice input is performed when a vehicle state such as a radio wave condition does not satisfy a predetermined condition in a configuration in which voice is transmitted from a terminal to a voice recognition server to perform voice recognition. Is disclosed. Patent Document 2 discloses a configuration in which dictation is prohibited while a vehicle is running in a vehicle-mounted speech recognition device.

JP 2003-345391 A JP 2003-162295 A

In the above-described prior art, execution of speech recognition is prohibited under specific conditions (speech recognition is not started). However, even if the start timing of voice recognition is limited, there are few merits for the user. For example, utterances that serve as triggers for starting speech recognition under various conditions during driving rarely hinder user concentration. On the other hand, when a user who needs to respond to changes in the situation, such as driving a vehicle, is requested to input a user's operation or reply, other actions may be performed while concentrating on driving. It may be necessary to do so, and the burden on the user may become excessive.
The present invention has been made in view of the above problems, and an object of the present invention is to provide a technique capable of reducing the possibility that the concentration of users is hindered by the output of responses.

  In order to achieve the above object, an input receiving unit that receives a user's input, a response generating unit that generates a response to the input, a steering state determination unit that determines whether the user is steering, a response A response system is provided that includes a response output unit that outputs a response after the steering ends when the user is requested to input at least once and the user is steering.

  Furthermore, in order to achieve the above object, the computer includes an input receiving unit that receives a user's input, a response generating unit that generates a response to the input, and a steering state determination unit that determines whether or not the user is steering A response program is configured to function as a response output unit that outputs a response after the steering is completed when an input by the user for the response is requested at least once and the user is steering.

  That is, in the response system and the response program, when the user inputs one or more responses to the response, and the user is steering, the response to the user input is output after the steering is completed. When the user inputs more than one response to the response, the user identifies the response or action corresponding to the recognized content after recognizing the response, and further responds to the response from the response system. Need to do. Therefore, the user needs to concentrate on the thought to determine the response or action corresponding to the response.

  And when the user is steering, the user should concentrate on driving, and if the user is required to concentrate on responding to the request from the response system or focusing on the action, There is a possibility of burden. Therefore, when the user is requested to input one or more times for the response and the user is steering, if the response output is postponed until the steering is completed, the user can output the response. It is possible to reduce the possibility that the concentration of the light is hindered.

It is a block diagram which shows a navigation system. FIG. 2A is a flowchart showing response processing, and FIG. 2B is a flowchart showing external response generation processing. 3A is an example of postponing response output, FIG. 3B is an example of output after postponement, and FIG. 3C is a diagram illustrating an example of response output.

Here, embodiments of the present invention will be described in the following order.
(1) Configuration of navigation system:
(2) Response processing:
(3) External response generation processing:
(4) Other embodiments:

(1) Configuration of navigation system:
FIG. 1 is a block diagram showing a configuration of a navigation system 10 according to an embodiment of the present invention. The navigation system 10 includes a control unit 20 including a CPU, a RAM, a ROM, and the like, and the control unit 20 can execute a desired program recorded in the ROM or the local storage medium 30. In this embodiment, a navigation program can be executed as one of the programs. The navigation program can cause the control unit 20 to realize a function of displaying a current location and a map around the current location on the display unit and a function of searching and guiding a route to the destination.

  In addition, the navigation program includes a response program, and the control unit 20 executes a function of performing a voice conversation between the user and the navigation system 10 by the processing of the response program 21. The dialogue is realized by executing an input by the user's uttered voice and a response from the navigation system 10.

  A vehicle in which the navigation system 10 is used includes a GPS receiver 41, a vehicle speed sensor 42, a gyro sensor 43, a user I / F unit 44, a communication unit 45, and a steering sensor 46. The GPS receiver 41 receives radio waves from GPS satellites and outputs a signal for calculating the current location of the vehicle via an interface (not shown). The vehicle speed sensor 42 outputs a signal corresponding to the rotational speed of the wheels provided in the vehicle. The control unit 20 acquires this signal via an interface (not shown) and acquires the vehicle speed. The gyro sensor 43 detects angular acceleration about turning in the horizontal plane of the vehicle, and outputs a signal corresponding to the direction of the vehicle.

  The control unit 20 acquires this signal and acquires the traveling direction of the vehicle. The control unit 20 acquires the current location of the vehicle by specifying the travel locus of the vehicle based on output signals from the vehicle speed sensor 42 and the gyro sensor 43 and the like. The output signal of the GPS receiver 41 is used for correcting the current location of the vehicle specified by the vehicle speed sensor 42, the gyro sensor 43, and the like.

  The user I / F unit 44 is an interface unit for providing various information to the user and receiving various inputs from the user, and includes a display unit, an operation input unit, a speaker, a microphone, and the like (not shown). ing. The control unit 20 can display, on the display unit, a map and route around the current location of the vehicle, a facility search result, and the like by the function of the navigation program. Moreover, the control part 20 can acquire a user's speech sound with a microphone, and can output arbitrary sounds including a sound from a speaker based on various sound data.

  The communication unit 45 includes a circuit for wirelessly communicating with the external system 50, and arbitrary information is exchanged between the control unit 20 and the external system 50 via the communication unit 45. In the present embodiment, the control unit 20 can transmit information indicating the user's uttered voice to the external system 50 via the communication unit 45.

  The external system 50 includes an external storage medium (not shown), and an external database 50a is recorded on the external storage medium. When the external system 50 acquires information indicating the uttered voice, the external system 50 performs voice recognition based on the external database 50a, and generates an external response that is a response to the character string as a recognition result. When the external response is generated, the external system 50 transmits information indicating the external response to the navigation system 10. The control unit 20 can receive information indicating the external response via the communication unit 45.

  In the present embodiment, the external database 50a includes information that can be updated and information that can be increased over time. For example, the external system 50 performs a process of collecting various news information, weather information of each place, traffic information of an arbitrary road, etc., and records and manages the collected information as an external database 50a. The external system 50 can search for information to be searched from the external database 50a and generate it as an external response.

  The steering sensor 46 is a sensor that outputs the rotation angle of the steering included in the vehicle, and the control unit 20 can acquire the steering angle based on the output signal of the steering sensor 46. The steering angle may be acquired as, for example, an angle in which the steering operation is not performed at 0 °, a specific rotation direction is positive, and the reverse rotation direction is negative.

  A local database 30a is recorded in the local storage medium 30. The local database 30a includes map information 30a1 and a voice database 30a2. The map information 30a1 is information used for specifying the current location, searching for facilities, and the like, node data indicating the positions of nodes set on the road, and shape interpolation points for specifying the shape of the road between the nodes. It includes data, link data indicating the connection between nodes, facility data indicating the location, attributes, names, etc. of facilities existing on and around the road.

  Therefore, the facility data is data in which records for each of a plurality of facilities are configured, and information for each of a plurality of items such as a position, an attribute, and a name is associated with each record. In the present embodiment, the attributes of each facility are associated with information indicating the type of facility, for example, a restaurant, a convenience store, a public facility, and the like. In this embodiment, the user can register an arbitrary facility and an arbitrary address as a home point, and information indicating the home is associated with the facility, the address, and the like.

  The voice database 30a2 is information that is referred to when a user's uttered voice is recognized and converted into a character string. The voice database 30a2 can be various information according to an algorithm for executing voice recognition. For example, the control unit 20 creates a phoneme string by examining a feature amount corresponding to a phoneme from the waveform of a speech voice, and obtains a character string that is likely to correspond to the phoneme string by comparing the phoneme string with an acoustic model and a language model. When having the configuration, the voice database 30a2 includes information indicating the acoustic model and the language model.

  The response program 21 includes an input reception unit 21a, a response generation unit 21b, a steering state determination unit 21c, and a response output unit 21d in order to output a response to a user input. The input receiving unit 21a is a program module that causes the control unit 20 to realize a function of receiving user input. In the present embodiment, a configuration is adopted in which the control unit 20 specifies the content that the user wants to respond to based on the user's utterance voice, and the control unit 20 uses the microphone to utter the user's utterance voice. To get.

  The response generation unit 21b is a program module that causes the control unit 20 to realize a function of generating a response that is a response to an input. That is, the control unit 20 performs voice recognition on the uttered voice received by the process of the input receiving unit 21a by the process of the response generation unit 21b, and generates a local response based on the recognition result of the uttered voice. In addition, the control unit 20 causes the external system 50 to perform speech recognition of the uttered speech, and generates an external response based on the recognition result. The local response and the external response are combined and regarded as a response system response.

  Various modes of input and response can be assumed. For example, an example in which the input and response are a request for information and presentation of information, or an example in which an instruction and execution are performed is assumed. In the present embodiment, an example is assumed in which an input is a destination designation or a facility search request (designation of a search condition) as a destination, and a response is a destination setting designated or an output of a search result. . In the speech recognition, for example, the control unit 20 creates a phoneme string by examining the feature amount corresponding to the phoneme from the waveform of the uttered speech accepted by the processing of the input accepting unit 21a, and the acoustic model recorded as the speech database 30a2. This can be realized by comparing the language model with the phoneme sequence to obtain a character string that is likely to correspond to the phoneme sequence.

  When the character string is acquired, the control unit 20 determines from the character string whether the user input is a destination designation or a facility search request as a destination. When the user's input is designation of the destination, the control unit 20 searches for the designated spot or facility with reference to the map information 30a1 and acquires it as the destination. In this case, the control unit 20 regards the information indicating the acquired destination as a response (information (character string) indicating the destination is output by the processing described later). Note that when the user's input is the designation of the destination, the external response is not generated by the external system 50.

  On the other hand, when the user input is a search request for a facility as a destination, the control unit 20 specifies a search target and a search condition based on a character string indicating the user input, and refers to the local database 30a. The search object is searched according to the search condition. Furthermore, the control unit 20 transmits information indicating the speech voice to the external system 50 via the communication unit 45. When the external system 50 acquires information indicating the uttered voice, the external system 50 refers to the external database 50a and recognizes the uttered voice. The voice recognition can be realized by the same processing as the recognition in the control unit 20. When voice recognition is performed and a character string is specified, the external system 50 specifies a search target and a search condition indicated by the character string, and acquires a search result by referring to the external database 50a. When the search result is obtained, the external system 50 transmits the search result to the navigation system 10, and the control unit 20 acquires the search result via the communication unit 45.

  With the above processing, the response generation by the local database 30a or the response generation using the external database 50a is performed. When the response generation using the external database 50a is also performed, the control unit 20 combines both the search results by the local database 30a and the search results by the external database 50a, for example, and makes a response to the input. .

  Since the external system 50 can communicate with a plurality of navigation systems 10, if the maintenance of the external database 50 a is performed, the effect can be enjoyed by the plurality of navigation systems 10. For this reason, the external database 50a includes data for recognizing words indicating search targets and search items that are not included in the local database 30a from the character string with high probability. Therefore, by using voice recognition and response generation by the external system 50 together, there is a high possibility that more advanced recognition and response generation will be performed. As described above, in a configuration in which a response is generated using not only the local database 30a but also the external database 50a, a time lag that can be recognized by the user from when the user inputs to when the response is generated. In some cases, the case where the user is steering is likely to occur when the generation of the response is completed. Therefore, in this embodiment in which a response is generated using the external database 50a, an advantage of adopting a configuration that does not output a response during steering tends to appear.

  However, it is not essential that both the local database 30a and the external database 50a generate voice recognition and a response based on the recognition result, and voice recognition and response generation are performed by either or both of the databases. Good. For example, a configuration in which the control unit 20 determines a database to be referred to according to various rules may be employed. Of course, if only one database is referred to, the other database may be omitted.

  The steering state determination unit 21c is a program module that causes the control unit 20 to realize a function of determining whether or not the user is steering. That is, the control unit 20 acquires the output signal of the steering sensor 46 and acquires the steering angle of the steering. Then, when the absolute value of the steering angle is not less than or equal to the threshold value, it is considered that the vehicle is being steered.

  The response output unit 21d is a program that causes the control unit 20 to implement a function of outputting a response after the steering is completed when the user is requested to input the response one or more times and the user is steering. It is a module. That is, if a response is output when the user is steering, the user's concentration is likely to be hindered. Therefore, when the steering is in progress, the control unit 20 postpones the output of a response that requires input by the user until the steering is completed. Specifically, referring to the determination result obtained by the process of the steering state determination unit 21c, when the steering is in progress, the control unit 20 performs immediate output of the response or postponement of the output based on the type of response.

  For this reason, in this embodiment, a response output even during steering and a response whose output is postponed during steering are distinguished in advance by the content of the response. In other words, when the user is requested to input a response, the user identifies the response or action corresponding to the recognized content after recognizing the response, and further responds to the response from the response system. There is a need to do. Therefore, the user needs to concentrate on the thought to determine the response or action corresponding to the response.

  And when the user is steering, the user should concentrate on driving, and if the user is required to concentrate on responding to the request from the response system or focusing on the action, There is a possibility of burden. Therefore, in the present embodiment, when the response is a response that requires a user's response or action, the response is regarded as a response in which the output is postponed during steering.

  On the other hand, when an input by the user for the response is not requested, it is regarded as an output response even during steering. That is, in this embodiment, even if the user is steering, if the user does not request an input for the response, the user may concentrate on the steering even if the response is made. Considered small. In the present embodiment, it is possible to determine whether or not an input by the user for the response is requested according to the content of the process to be performed by the control unit 20 in response. Of course, information indicating whether or not an input by the user for the response is requested is associated with each response mode, and the control unit 20 receives the input by the user for the response based on the information. It may be configured to determine whether or not it is required.

  When the steering is being performed and an input by the user for the response is requested, the control unit 20 waits without outputting the response. Even when the vehicle is being steered, if the user does not require an input for the response, the control unit 20 outputs the response. In addition, when the determination result by the process of the steering state determination unit 21c does not indicate that the steering is being performed, the control unit 20 causes the user I / F unit 44 to output the response generated by the process of the response generation unit 21b. . Therefore, even when the output of the response is postponed due to the steering, the response is output when the steering is completed.

  Various modes of response can be assumed, and in the present embodiment, the control unit 20 outputs the voice that is the utterance sound of the character string to the user I / F unit 44 based on the character string indicating the response. Let Therefore, the control unit 20 outputs information indicating the voice that is the utterance sound of the response to the speaker of the user I / F unit 44. As a result, sound indicating a response is output from the speaker of the user I / F unit 44.

  According to the above configuration, during steering, a response that can hinder the user's concentration is not output, and it is possible to reduce the possibility that the user's concentration is hindered by the output of the response. Furthermore, it is unlikely that the user's concentration is disturbed, and it is possible to prevent the output from being postponed until it is not necessary to postpone the output of the response. Therefore, in this case, the response speed can be increased.

(2) Response processing:
Next, response processing executed by the navigation system 10 will be described. In the navigation system 10, the response process shown in FIG. 2A is started by various triggers such as a user operation and detection of a predetermined word by a microphone. In the response process, the control unit 20 receives an input by the uttered voice by the process of the input receiving unit 21a (step S100). That is, the control unit 20 acquires waveform information indicating the user's uttered voice via the microphone of the user I / F unit 44. 3A and 3C show a screen example 44a of the display unit of the user I / F unit 44. The road is shown as a line, the planned route is shown as a thick line, the vehicle is shown as C, and the destination is shown as G. . FIG. 3A shows an example in which the user U utters “tell me a convenience store nearby”, and FIG. 3C shows an example in which the user U utters “going home”. Yes.

  Next, the control unit 20 transmits the uttered voice to the external system 50 by the process of the response generation unit 21b (step S105). That is, the control unit 20 transmits the waveform information indicating the uttered voice acquired by the process of step S <b> 100 to the external system 50 via the communication unit 45. However, if it is not necessary to use the external database 50a to generate a response to the user's input, for example, if the input by the user's utterance is the designation of the destination as shown in FIG. 3C, step S105 is omitted. In the present embodiment, an example is assumed in which the uttered voice is not transmitted to the external system 50 when the destination is specified. Of course, when the user's input is a search for a facility as a destination, the uttered voice is transmitted to the external system 50.

  Next, the control unit 20 performs voice recognition based on the local database 30a by the processing of the response generation unit 21b (step S110). That is, the control unit 20 refers to the voice database 30a2, analyzes the uttered voice acquired by the process of step S100 using a predetermined voice recognition algorithm, and acquires a character string having a high probability as the content of the uttered voice. Here, it is assumed that “Tell me about a nearby convenience store” is recognized as a character string in the example shown in FIG. 3A, or “Return to home” is recognized as a character string in the example shown in FIG. 3C.

  Next, the control part 20 acquires a search result based on the local database 30a by the process of the response generation part 21b (step S115). That is, the control unit 20 specifies a search target and a search condition from the character string acquired in the process of step S110. For example, in the example shown in FIG. 3A, since the character string “Tell me about a nearby convenience store” is obtained as a speech recognition result, the control unit 20 makes the facility a search target and associates the convenience store attribute with it. The search condition is that the current location is close to the current location. In the example shown in FIG. 3C, since the character string “return to home” is obtained as the voice recognition result, the control unit 20 sets the facility or address as the search target and associates the home information. Search conditions.

  Then, the control unit 20 refers to the map information 30a1 in the local database 30a and acquires a search target that matches the search condition. In the example illustrated in FIG. 3A, the control unit 20 searches for a facility having a convenience store attribute. Further, when searching for facilities, the control unit 20 specifies the current location based on the outputs of the GPS receiving unit 41, the vehicle speed sensor 42, and the gyro sensor 43, and the specified number is in order of increasing distance from the current location to each facility. Search for facilities. When the search result is obtained, the control unit 20 specifies information indicating the name and position of the searched facility and sets it as a local response. In the example shown in FIG. 3C, the control unit 20 searches for a facility or address associated with home information, and uses the searched location or address of the facility as a local response.

  Next, the control unit 20 determines whether or not an external response has been received by the processing of the response generation unit 21b (step S120). That is, when the utterance voice transmitted in step S105 is received by the external system 50, an external response generation process is performed in the external system 50. When an external response is generated, information indicating the external response is received from the external system 50. Sent to the navigation system 10. Therefore, the control unit 20 determines whether or not the external response transmitted by the external system 50 has been acquired via the communication unit 45. If it is not determined in step S120 that an external response has been received, the control unit 20 waits until it is determined that an external response has been received (however, in FIG. 3C, information indicating the utterance voice is transmitted to the external system 50). Therefore, the control unit 20 skips step S120.) In the example shown in FIG. 3A, information indicating the current location is transmitted to the external system 50 by the processing of the control unit 20, and the convenience store attribute facility near the current location is searched by the external system 50 to be an external response.

  Next, the control part 20 produces | generates a response by the process of the response production | generation part 21b (step S125). That is, the control unit 20 combines the search result (local response) acquired in step S115 and the search result (external response) acquired from the external system 50 by the process of step S120. At this time, the control unit 20 deletes duplicate results in both search results. In the example shown in FIG. 3A, a search result in which the duplicate of the search result in step S115 and the search result acquired from the external system 50 by the process in step S120 is deleted is acquired. In the example shown in FIG. 3C, since the search result is not acquired in step S120, the control unit 20 is in a state where the search result acquired by the process of step S115 is acquired.

  Furthermore, the control unit 20 determines a process to be performed when a response is output. In the present embodiment, processing to be performed at the time of response output is determined in advance for each input content of the user. For example, when the user input is a search request for a facility as a destination as shown in FIG. 3A, the output of the search result and the reception of the selection of the destination are processes to be performed. On the other hand, when the user's input is designation of a destination as shown in FIG. 3C, output of the designated destination and guidance of the route to the destination are processing to be performed.

  Next, the control unit 20 determines whether or not further user input is required for the response generated in step S125 by the processing of the response output unit 21d (step S127). That is, the control unit 20 determines whether or not further user input is required for the response based on the content of the processing as the response acquired in step S125. For example, as in the example shown in FIG. 3A, when the destination selection is accepted at the time of the response, the user needs to input to select the destination. It is determined that further user input is required. As in the example shown in FIG. 3C, when there is only presentation of information in response, the user does not need to input, so the control unit 20 does not further input the user in response to the response. Determine that it is not necessary.

  If it is not determined in step S127 that further user input is required for the response, the control unit 20 skips step S130 and outputs a response through the processing of the response output unit 21d (step S135). That is, the control unit 20 outputs a control signal for outputting the character string indicating the response generated in step S125 to the user I / F unit 44. As a result, the user I / F unit 44 outputs a character string indicating a response by voice. FIG. 3C shows an example in which “the destination is set at home”, which is a sentence composed of a character string indicating a response, is output. Further, the control unit 20 refers to the map information 30a1, searches for a route from the current location to the home which is the destination, and starts route guidance.

  On the other hand, when it is determined in step S127 that further user input is required for the response, the control unit 20 determines whether or not the steering is being performed by the process of the steering state determination unit 21c ( Step S130). That is, the control unit 20 refers to the output signal of the steering sensor 46 and acquires the current steering rotation angle. And if the absolute value of the said rotation angle is larger than the threshold value which can be considered that it is not rotating, the control part 20 will determine with it being steering. If it is not determined in step S130 that the vehicle is steering, the control unit 20 repeats the determination in step S130. That is, when the user is steering in the vehicle, the control unit 20 postpones the output of the response until the steering is completed. In FIG. 3A, the user of vehicle C is steering to turn right. Therefore, when the vehicle C exists at the position shown in FIG. 3A, the output of the response is postponed even if the user U speaks “Tell me about a nearby convenience store” and the response has been generated.

  In the period in which the output of the response is postponed until the steering is finished, the control unit 20 may present to the user that the output of the response is postponed. In this case, the control unit 20 specifies information indicating that the output of the response has been postponed by selecting a predetermined character string or image, and outputs a control signal for outputting the information to the user I / F unit. 44 for output. As a result, the user I / F unit 44 outputs information indicating that the output of the response has been postponed. In FIG. 3A, the information indicating that the output of the response is postponed is the character string “display the list after turning right”, and the utterance sound of the character string is output from the speaker of the user I / F unit 44. An example is shown.

  On the other hand, when it determines with it being steering in step S130, the control part 20 outputs a response by the process of the response output part 21d (step S135). In the example illustrated in FIG. 3A, the control unit 20 outputs a control signal for displaying the search results in order from the current location to the user I / F unit 44. As a result, on the display unit of the user I / F unit 44, the search results are displayed in order from the current location. In addition, the control unit 20 outputs a control signal for outputting sound indicating the display content to the user I / F unit 44. As a result, sound indicating the display content is output from the speaker of the user I / F unit 44.

  FIG. 3A shows a screen example 44 a of the display unit of the user I / F unit 44. In this example, the control unit 20 acquires the distance from the current location to each facility based on the positions of the plurality of facilities acquired as responses and the current location. Then, the control unit 20 sorts each facility according to the distance, and outputs a control signal for displaying the name of each facility and the distance from the current location in the sorted order. In the screen example 44a of FIG. 3A, the names of convenience stores A, B, C, D, and E are 0.5 km, 1.2 km, 2.2 km, 2.4 km, and 2.7 km from the current location, respectively. Show. Further, FIG. 3A schematically shows a state in which “Nearby convenience store is displayed”, which is an example of sound indicating display contents, is output from the navigation system 10.

(3) External response generation processing:
Next, an external response generation process executed by the external system 50 will be described. The external system 50 executes the external response generation process shown in FIG. 2B when a transmission request for the spoken voice is made from the navigation system 10. When the external response generation process is started, the external system 50 receives the input content (step S200). That is, the external system 50 acquires information indicating the speech voice transmitted from the navigation system 10 by a communication unit (not shown).

  Next, the external system 50 performs voice recognition based on the external database 50a (step S205). That is, the external system 50 refers to the external database 50a, analyzes the utterance voice indicated by the information received in step S200 with a predetermined voice recognition algorithm, and obtains a character string having a high probability as the content of the utterance voice. To do. In the example shown in FIG. 3A, when the uttered voice is transmitted to the external system 50, “Tell me about a nearby convenience store” is recognized as a character string. In this case, information indicating the current location of the vehicle is also transmitted to the external system 50 by the processing of the control unit 20.

  Next, the external system 50 acquires a search result based on the external database 50a (step S210). That is, the external system 50 refers to the external database 50a, and specifies a search target and a search condition from the character string acquired in the process of step S205. For example, in the example shown in FIG. 3A, since the character string “Tell me about a nearby convenience store” is obtained as a voice recognition result, the control unit 20 makes the facility a search target and associates the convenience store attribute with it. Is a search condition.

  Then, the control unit 20 refers to the external database 50a, searches for a search target that matches the search condition, and acquires a specified number of facilities in the order of the distance from the current location to each facility as a search result. When the search result is obtained, the control unit 20 specifies information indicating the name and position of the searched facility and sets it as an external response. When the external response is generated, the external system 50 transmits the external response to the navigation system 10 (step S215). That is, the external system 50 transmits information indicating the external response acquired by the process of step S210 to the navigation system 10 via the communication unit.

(4) Other embodiments:
The above embodiment is an example for carrying out the present invention, and when a response is requested by the user one or more times and the user is steering, a response is output after the steering is completed. As long as this is done, various other embodiments can be adopted. For example, the moving body that moves together with the navigation system 10 is arbitrary, and may be a vehicle or a pedestrian, and various examples are assumed. The response system may be a device mounted on a vehicle or the like, a device realized by a portable terminal, or realized by a plurality of devices (for example, a client and a server). It may be a system.

  Furthermore, at least a part of the input reception unit 21a, the response generation unit 21b, the steering state determination unit 21c, and the response output unit 21d constituting the response system may be divided into a plurality of devices. For example, after the controller 20 performs voice recognition based on the voice database 30a2, a character string after voice recognition is transmitted to the external system 50, and an external response generated in the external system 50 is acquired, or installed in a vehicle For example, the ECU may be configured to determine the steering state. Of course, a part of the configuration of the above-described embodiment may be omitted, and the processing order may be changed or omitted. For example, step S105 may be executed in parallel with the processing after step S110, or may be executed after step S120.

  The input reception part should just be able to receive a user's input. That is, the response system is a system that executes a response to the user's input, and the input receiving unit only needs to be able to receive the user's input so that the user can specify the content that the user wants to respond to. Various modes can be assumed for the input. For example, the input may be realized by the user operating the operation unit, or may be realized by acquiring the user's uttered voice using a microphone or the like.

  The response generation unit only needs to be able to generate a response to the input. That is, since the user's input content is content that requests a response to the response system, the response generation unit identifies the input content and executes a process for generating a response according to the input content. The specification of the input content can be realized by various methods according to the input mode. For example, when the input is selection of an option by operating the operation unit, input of a command, or the like, the input content can be specified by specifying the selected option and specifying the input command. When the user's uttered voice is an input, the input content can be specified by performing voice recognition and converting the voice into a character string.

  Generation of a response according to the input content can be realized by executing various processes according to the input content. For example, if the input content is specified by options and commands, it is only necessary to predetermine processing to be executed for each option and command. Of course, in each process, the process may be executed using parameters input by the user. Further, when the user's uttered voice is an input, a process to be executed may be specified by analyzing the contents converted into a character string, and the process may be executed. For example, if the string is "Tell me about a nearby convenience store", the current location is acquired, the convenience stores in the vicinity are searched, and the sorting from the current location to the convenience store is performed. Obtained as a response.

  Various modes of input and response can be assumed. For example, an example in which the input and response are a request for information and presentation of information, or an example in which an instruction and execution are performed is assumed. More specific examples of the case where the input and response are information request and information presentation include an example of information request that matches the search condition and information showing the search result. Of course, various types of information can be assumed for the information to be provided, such as facility information, weather information, traffic information, information on newly opened stores, store price ranges, word-of-mouth reviews, and recommended stores. Various information may be assumed. As a more specific example in the case where the input and response are an instruction and an execution, a command for reproducing a file stored in a storage medium (reproduction of music, moving images, etc.) and its reproduction can be mentioned.

  The steering state determination unit only needs to be able to determine whether or not the user is steering. That is, the steering state determination unit determines whether the user can output the output of a sensor (for example, a steering angle sensor, an acceleration sensor, or a position sensor) that detects the steering state or a change in the vehicle that can estimate the change in the steering state. What is necessary is just to be able to determine whether it is steering.

  The period during which the steering should be performed may be a period during which the user should not concentrate on the response. In addition to the period during which the user is actually operating the steering, the period during which the user is preparing for steering, It may be a period estimated to be released. As a period during which preparation for steering is being performed or a period during which steering is estimated to be performed, for example, a lane change or traveling in a non-straight direction is performed depending on a blinking period, a planned travel route, or the like. Estimated period, parking operation, etc., period of lane change, driving in a non-straight direction, parking operation, etc., depending on the user's line of sight and face, etc. .

  The response output unit only needs to be able to output a response after the steering is completed when an input by the user for the response is requested at least once and the user is steering. That is, if a response is output when the user is steering, the user's concentration is likely to be hindered. Therefore, when the steering is in progress, the response output unit postpones the output of a response that requires one or more inputs by the user until the steering is completed.

  A response that requires one or more inputs by a user is a response that requires a user response or action to the response. Such a response is, for example, insufficient for realizing the function only by the response, and a response in which the function is realized by the user's response or action is assumed.

  Therefore, when the function can be realized simply by returning a response to the user's input, for example, the user's input in the route guidance is the designation of the destination, and the response is the utterance confirmation of the destination In this case, since the user's further input for the response is not required, the response does not correspond to a response that requires one or more inputs by the user. On the other hand, when the user input in the route guidance is the designation of the destination attribute, and the response is a request for destination candidate presentation and destination selection, the destination is designated by further input of the user to the response There is a need. Therefore, in this case, the response corresponds to a response that requires one or more inputs by the user.

  It should be noted that input requests for responses are burdensome for the user to input in response to the requests, that is, it is necessary to concentrate for consideration in order to determine recognition and responses corresponding to responses. It is sufficient if it is such a request. Therefore, as such a request, for example, a request in a state where the input content can be changed according to the content of the response can be cited. Various modes of response output can be assumed, and information output, command execution, and the like may be used. Examples of the former include an example in which a display on an output unit such as a display or an audio output from an output unit such as a speaker is a response output. As the latter, for example, music is output by an output unit such as a speaker. Can be mentioned.

  Further, the response output unit may be configured to output a response when the user is steering, and when an input by the user for the response is not requested. That is, even if the user is steering, if the user does not request an input for the response, the response output unit is less likely to prevent the user from concentrating on the steering even if the response is made. And output a response. According to this configuration, it is possible to prevent postponing the output until it is not necessary to postpone the output of the response, and it is possible to speed up the response of the response.

  Further, the response output unit may be configured to output a response after the steering is completed when the number of user options for the response is equal to or greater than a threshold value and the user is steering. That is, when there are options that the user can select for the response, the user must consider and select which option to select. Therefore, if an input to select an option for a response is required when the vehicle is being steered, delaying the output for the response reduces the possibility of the user's concentration being hindered by the output of the response Is possible.

  The degree to which the concentration of users is hindered increases as the number of options increases. Therefore, if the number of options is selected in advance so that the concentration is excessively hindered by the selection being requested during the steering process, the output is postponed depending on the required degree of input complexity. It is possible to specify when not to be performed. The threshold value may be determined in advance, may be a fixed value, or may dynamically change according to the response, the type of input, or the like.

  In such a configuration, for example, in the case where a response for presenting options to the user is generated in step S125 in the above-described embodiment, the control unit 20 compares the number of the options with a threshold value in step S127, and exceeds the threshold value. This can be realized by a configuration in which step S130 is executed when the value is equal to or less than the threshold value and step S130 is skipped.

  Further, the response output unit may be configured to output a response after the steering is finished when the length of the response is equal to or longer than a predetermined length and the user is steering. In other words, the longer the response length, the higher the degree of concentration required for the user to recognize the response. Therefore, if the length of the response is equal to or longer than the predetermined length and the user is steering, the response is output after the steering is completed. When it is high, it is possible to prevent the user's ability to concentrate on steering from being hindered.

  Such a configuration is realized by, for example, a configuration in which the control unit 20 specifies the length of the response in step S127 based on the number of characters, the period during which the voice is output, and the like, and compares the length with a predetermined length. Is possible. That is, when it is determined in step S127 that the response length is equal to or longer than the predetermined length, the control unit 20 executes step S130, and the response length is not determined to be equal to or longer than the predetermined length. In this case, it can be realized by a configuration in which the control unit 20 skips step S130.

  Various other examples of the determination in step S127 can be assumed. For example, when a combination of a user input and a response is regarded as one dialogue, the number of dialogues is equal to or greater than a threshold value. Alternatively, a configuration in which step S130 is executed and step S130 is skipped when it is not equal to or greater than the threshold may be employed.

  Furthermore, as in the present invention, when a user has requested input for a response one or more times and the user is steering, a method of outputting a response after the steering is completed is a program or method. Is also applicable. The system, program, and method as described above can be realized as a single device or can be realized as a plurality of devices, and include various aspects. For example, it is possible to provide a navigation system, method, and program provided with the above means. Further, some changes may be made as appropriate, such as a part of software and a part of hardware. Furthermore, the invention can be realized as a recording medium for a program for controlling the system. Of course, the software recording medium may be a magnetic recording medium, a magneto-optical recording medium, or any recording medium to be developed in the future.

  DESCRIPTION OF SYMBOLS 10 ... Navigation system, 20 ... Control part, 21 ... Response program, 21a ... Input reception part, 21b ... Response generation part, 21c ... Steering state determination part, 21d ... Response output part, 30 ... Local storage medium, 30a ... Local database , 30a1 ... map information, 30a2 ... voice database, 41 ... receiving unit, 42 ... vehicle speed sensor, 43 ... gyro sensor, 44 ... user I / F unit, 44a ... screen example, 45 ... communication unit, 46 ... steering sensor, 50 ... External system, 50a ... External database

Claims (6)

An input reception unit for receiving user input;
A response generator for generating a response to the input;
A steering state determination unit that determines whether or not the user is steering;
A response output unit that outputs the response after the steering is completed when the user is requested to input the response one or more times and the user is steering;
A response system comprising: The input is
The spoken voice of the user,
The response is
Generated based on the recognition result of the speech,
The response system according to claim 1. The response output unit
If the user is steering, the response is output if no input by the user for the response is required;
The response system according to claim 1. The response output unit
If the number of options of the user for the response is greater than or equal to a threshold and the user is steering, the response is output after the steering is terminated;
The response system according to any one of claims 1 to 3. The response output unit
If the length of the response is equal to or longer than a predetermined length and the user is steering, the response is output after the steering is completed.
The response system in any one of Claims 1-4. Computer
An input reception unit for receiving user input,
A response generator for generating a response to the input;
A steering state determination unit that determines whether or not the user is steering;
A response output unit that outputs the response after the steering is completed when the input by the user to the response is requested at least once and the user is steering;
As a response program to function as.

Images