JP4736982B2 - Operation control device, program - Google Patents

Description

 The present invention relates to an operation control device having a simple operation reception function based on a voice recognition result.

For example, there is a demand for easily realizing destination setting in a navigation device based on voice input by a speaker.
In the navigation device described in Patent Document 1, the conversation spoken in the passenger compartment is recorded, the recorded voice is recognized when the button is pressed, and the location name is extracted based on the recognized conversation content. The destination is set using the point name.

According to this method, since the destination can be set using the name of the point that naturally appears in the conversation, the user can consciously set the destination without speaking to the voice recognition device. It is.
Japanese Patent Laid-Open No. 2005-316022

  The prior art is a technique for extracting a point name from a voice recognition result. However, depending on the content of the conversation, the location name may not appear. In such a case, the point name itself cannot be extracted, and as a result, the destination cannot be set.

For example, consider the following conversation example between user A and user B.
User A: “Do you want to eat delicious food?”
User B: “That ’s right, how about the ramen shop we went to last time?”
User A: “Like”
In this conversation, since the point name itself does not appear, the conventional technique of “extracting the point name” cannot be used.

  On the other hand, when setting the above-mentioned ramen shop as a destination in the navigation device, for example, the following is performed. There is a method of searching based on a history of setting a ramen shop as a destination when the ramen shop that has appeared during the above conversation remains in the past. That is, if there is a history, it is possible to search for the corresponding ramen shop from the history list and designate it as the destination by operating “Destination Setting” → “History” by menu selection in the navigation device.

  However, such an operation is troublesome. The topic of a ramen shop has appeared during the conversation, so it would be convenient if you could use it well and set the destination more easily.

  The present invention has been made in view of such problems, and an object thereof is to simplify operation reception from a user by making good use of a speech recognition result.

  According to the operation control device of the present invention, the speech recognition unit analyzes the “speech uttered by the speaker” input via the speech input unit, and stores a comparison target pattern used for speech recognition. The result recognized using is output as a recognition result. The shortcut button creation unit creates a shortcut button that is a button for instructing contents to be instructed by performing a plurality of operations in a single operation based on the recognition result in the speech recognition unit. The display control unit displays the created shortcut button on the screen. When the operation control unit receives various operations including operations on the shortcut buttons displayed on the screen via the reception unit, the operation control unit controls the operation of the control target device according to the received operation.

  The first correspondence storage means stores the correspondence between the function attribute and the function modification attribute and the word, where the function attribute is an attribute indicating the function to be operated of the control target device assumed from the word. The function modification attribute is an attribute indicating a relatively lower function used when realizing the function to be operated. The second correspondence storage means stores the correspondence between the function attribute and function modification attribute and the operation reception screen.

  The attribute determination unit determines the function attribute and the function modification attribute corresponding to the recognition result in the voice recognition unit using the correspondence relationship of the first correspondence relationship storage unit. The operation reception screen determination unit determines an operation reception screen corresponding to the function attribute and the function modification attribute determined by the attribute determination unit using the correspondence relationship of the second correspondence relationship storage unit. The shortcut button creation unit creates a shortcut button corresponding to the operation reception screen determined by the operation reception screen determination unit.

  Thus, by making good use of the voice recognition result and creating a shortcut button, it is possible to simplify the operation reception from the user. In order to facilitate understanding of the effect, a specific example will be described.

  For example, it is assumed that the device to be controlled by the operation control device is a car navigation device, and a conversation such as that introduced in the above “problem to be solved by the invention” is made. If the “search” function attribute is associated with the word “ramen shop”, a shortcut button for guiding to an operation reception screen (for example, a facility search screen) capable of searching for a ramen shop can be created. In addition, if the word “Previous” is associated with the function modifier attribute “History” in the search function, operation reception that allows “history search” using the recognition words “Previous” and “Ramen shop” is accepted. You can create a shortcut button to navigate to the screen.

  The device to be controlled by the operation control device is not limited to the car navigation device, and various devices can be adopted. It may be an in-vehicle device or not. However, in the case of an in-vehicle device including a car navigation device, a shortcut button for recognizing a conversation between the driver and a passenger in the passenger seat or the rear seat and receiving an operation related to the operation of the in-vehicle device is created. Is very effective.

  By the way, as can be seen from the above conversation example, for example, the conversation is not based on the function of the navigation device called destination setting, but a shortcut button is created based on a word appearing in an ordinary conversation. ing. In other words, a shortcut button convenient for the user is created by constantly recognizing such a conversation. However, there may be a case where the user does not want to be always recognized. Therefore, as shown in claim 2, the voice input unit may be configured to input voice to the voice recognition unit only when an instruction to perform voice recognition is given through the reception unit. .

  According to a third aspect of the present invention, the shortcut button creation unit may create a shortcut button by adding a function name or a related picture or photo to the button design. This makes it easier to understand what the shortcut buttons mean.

  According to a fourth aspect of the present invention, the shortcut button creation unit may change at least one of the size, position, and color of the created shortcut button according to the elapsed time since the button was created. In this way, the user can easily grasp intuitively when the shortcut button is created.

  By the way, a program for functioning as a voice recognition unit, a shortcut button creation unit, an attribute determination unit, and an operation reception screen determination unit in the operation control device according to any one of claims 1 to 5 as described in claim 6 May be executed by a computer built in the operation control device. In this case, for example, the program is recorded on a computer-readable recording medium such as a flexible disk, a magneto-optical disk, a CD-ROM, a hard disk, a ROM, and a RAM, and the program is stored in the computer as necessary. It can function as an operation control device by loading and starting.

Embodiments of the present invention will be described below with reference to the drawings.
[Description of configuration]
FIG. 1 is a block diagram illustrating a schematic configuration of an in-vehicle system according to an embodiment.

This in-vehicle system 50 is a system that is mounted on a vehicle and can execute an information input / output function with respect to the outside including a navigation function and a telephone.
(1) Description of the in-vehicle system 50 This in-vehicle system 50 is similar to the position detector 51 for detecting the current position of the vehicle, the operation switch group 52 for inputting various instructions from the user, and the operation switch group 52. A remote control terminal (hereinafter referred to as a remote controller) 53a capable of inputting various instructions and separated from the in-vehicle system 50, a remote control sensor 53b for inputting a signal from the remote controller 53a, a communication device 54, a map A map data input device 55 for inputting map data and the like from a map storage medium in which data and various information are recorded, a display unit 56 for displaying maps and various information, and for outputting various guide voices and the like A voice output unit 57; a microphone 58 that inputs voice and outputs voice information; a voice recognition related unit 60 that performs voice recognition related processing; Various processes are executed in accordance with the input from the position detector 51, the operation switch group 52, the remote control sensor 53b, the communication device 54, the map data input device 55, the microphone 58, and the voice recognition related unit 60, and the communication device 54, A display unit 56, a voice output unit 57, and a control unit 59 for controlling the voice recognition related unit 60 are provided.

The position detector 51 receives a radio wave transmitted from an artificial satellite for GPS (Global Positioning System) via a GPS antenna and is added to the vehicle and a GPS receiver 51a that detects the position, direction, speed, and the like of the vehicle. A gyroscope 51b for detecting the magnitude of the rotational motion and a distance sensor 51c for detecting the distance traveled from the longitudinal acceleration or the like of the vehicle are provided. Each of the sensors 51a to 51c has an error of a different property, and is configured to be used while complementing each other.

  The operation switch group 52 includes a touch panel configured integrally with the display surface of the display unit 56 and mechanical key switches provided around the display unit 56. The touch panel and the display unit 56 are laminated and integrated, and there are various types of touch panels, such as a pressure-sensitive method, an electromagnetic induction method, a capacitance method, or a combination of these. It may be used.

The communication device 54 is for communicating with a contact specified by the set contact communication information, and is composed of a mobile communication device such as a mobile phone.
The map data input device 55 is a device for inputting various data stored in a map data storage medium (not shown) (for example, a hard disk or a DVD-ROM). Map data storage media include map data (node data, link data, cost data, background data, road data, name data, mark data, intersection data, facility data, etc.), voice data for guidance, voice recognition data, etc. Is remembered. Instead of inputting these data from the map data storage medium, these data may be input via a communication network.

  The display unit 56 is a color display device such as a liquid crystal display, an organic EL display, or a CRT, and any of them may be used. The display screen of the display unit 56 includes a mark indicating the current location identified from the current position of the vehicle detected by the position detector 51 and the map data input from the map data input device 55, a guide route to the destination, and a name. Additional data such as landmarks and various facility marks can be displayed in an overlapping manner. Also, facility guides can be displayed.

The voice output unit 57 can output facility guidance and various guidance voices input from the map data input device 55.
The microphone 58 outputs an electric signal (voice signal) based on the inputted voice to the control unit 59 when the user inputs voice (speaks). The input voice is predetermined by the voice recognition unit 60.

The voice recognition related unit 60 will be described later.
The control unit 59 is configured around a well-known microcomputer including a CPU, ROM, RAM, I / O, and a bus line connecting these configurations, and various control units 59 are based on programs stored in the ROM and RAM. Execute the process. For example, the current position of the vehicle is calculated as a set of coordinates and traveling directions based on each detection signal from the position detector 51, and a map near the current position read via the map data input device 55 is displayed on the display unit 56. Based on the display processing to be performed, the point data stored in the map data input device 55, and the destination set in accordance with the operation of the operation switch group 52, the remote controller 53a, etc. A route guidance process for calculating and guiding the calculated route is performed.

  For example, the control unit 59 inputs a telephone number by the operation switch group 52 or the like in a state where a screen for receiving a telephone number is displayed on the display unit 56, and gives an instruction to make a call to the other party of the input telephone number. When the operation switch group 52 or the like is used, a control process for making a call via the communication device 54 is executed.

(2) Description of Voice Recognition Related Unit 60 As shown in FIG. 2, the voice recognition related unit 60 includes a voice input unit 61, a voice recognition unit 62, an attribute determination unit 63, an operation reception screen determination unit 64, A shortcut button creation unit 65, a recognition dictionary 66, an attribute information database 67, and a device operation information database 68 are provided.

  The voice input unit 61 is for inputting the voice uttered by the speaker, converts the voice signal input from the microphone 58 into digital data, and outputs the digital data to the voice recognition unit 62. In order to analyze the feature amount of the input voice, the voice input unit 61 cuts out frame signals in a section of, for example, about several tens of ms at regular intervals, and determines whether the input signal is a voice section including voice. It is determined whether the noise section does not contain. Since the signal input from the microphone contains not only the speech to be recognized but also noise, the speech section and the noise section are determined. Many methods have been proposed as this determination method. For example, the short-time power of the input signal is extracted at regular intervals, and depending on whether or not the short-time power equal to or greater than a predetermined threshold continues for a certain period. A method of determining whether a speech section or a noise section is often used. Then, when it is determined that the voice section, the input signal is output to the voice recognition unit 63.

  The recognition dictionary 66 stores comparison target patterns in units of phonemes. The voice recognition unit 62 outputs the result (character string) recognized using the recognition dictionary 66 to the attribute determination unit 63 as a recognition result based on the voice signal input through the voice input unit 61.

  The attribute information database 67 is a database that stores the correspondence between function attributes and function modification attributes and words. In addition, the device operation information database 68 stores a correspondence relationship between the function attribute and the function modification attribute and the operation reception screen. These two types of databases will be described later with reference to the drawings.

The attribute determination unit 63 determines the function attribute and the function modification attribute corresponding to the recognition result in the voice recognition unit 62 using the correspondence relationship of the attribute information database 67.
The operation reception screen determination unit 64 determines an operation reception screen corresponding to the function attribute and function modification attribute determined by the attribute determination unit 63 using the correspondence relationship of the device operation information database 68.

  The shortcut button creation unit 65 creates a shortcut button corresponding to the operation reception screen determined by the operation reception screen determination unit 64. The shortcut button created by the shortcut button creation unit 65 is displayed on the display unit 56 by the control unit 59. For example, a shortcut button as shown in FIG. 6 is displayed.

  As shown in FIG. 2, the control unit 59 can control the voice input unit 61 to switch between a state in which a voice signal is input from the voice input unit 61 to the voice recognition unit 62 and a state in which no voice signal is input. Has been. This state switching can be instructed by the user via the operation switch group 52 or the like. That is, when an instruction to perform voice recognition is given from the user via the operation switch group 52 or the like, the control unit 59 controls the voice input unit 61 and the voice input unit 61 sends a voice to the voice recognition unit 62. Make sure that the signal is input. On the other hand, when the user gives an instruction not to execute voice recognition via the operation switch group 52 or the like, the control unit 59 controls the voice input unit 61, and the voice input unit 61 sends a voice to the voice recognition unit 62. Make sure that no signal is input.

Here, specific examples of the attribute information database 67 and the device operation information database 68 will be described.
(2a) About the attribute information database 67 An example of the attribute information database 67 is shown in FIG. Here is the word ramen ramen shop? ? Examples are store, telephone, reservation, last time, usual, nearby, detour. “Ramen shop ??” refers to a specific store name.

Each of these words is associated with a function attribute and a function modification attribute.
The function attribute is an attribute indicating a function to be operated of the control target device assumed from words such as “search”, “telephone”, and “route change”. When the navigation function of the in-vehicle system 50 is assumed, the above-mentioned “search”, “route change”, etc. are considered as “attributes indicating functions to be activated”, and information input from outside including a telephone is also possible. When the output function is assumed, “telephone” is considered as “an attribute indicating a function to be activated”.

  The function modification attribute is an attribute indicating a relatively lower level function or information used when realizing the function to be operated. For example, when the function attribute is “search” for the word ramen, genre search is considered as a subordinate function of the search function, and therefore “genre = ramen” is associated as a function modification attribute.

  Also, for words such as “Ramen shop XX store” that points to a specific store name, it is assumed that not only a search but also a function to call the store is used, so “search” "Call" is associated. The function modification attribute “facility = ramen shop XX store” is associated with the facility search as a subordinate function of the search function and the identification of the other party to call.

  In addition, the words “search information = history (latest)” “search information = history (most frequent)” “search information = neighboring” are used as function modification attributes for the words “previous”, “normal”, and “near”, respectively. Are associated. Further, the function attribute “route change” is associated with the word “bypass” and “change condition = bypass” is associated with the function modification attribute.

(2b) Device Operation Information Database 68 An example of the device operation information database 68 is shown in FIG. An operation acceptance screen is set corresponding to the combination of the function attribute and the function modification attribute. The operation reception screen is, for example, a search screen for a navigation function or a screen for receiving an operation for making a call using a telephone function. This will be specifically described.

  When the function attribute is “search” and the function modification attribute is not set, the operation reception screen is a “search screen”. Genre search, peripheral search, and the like exist as subordinate functions of the search function. The “search screen” here refers to the top screen of the search. On the other hand, when the function attribute is “search” and the function modification attribute is “genre = XXX”, the operation reception screen is “search screen designated as genre = XXX”. When the function attribute is “search” and the function modifier attribute is “search information = periphery”, the operation reception screen is “search information specified as search information = periphery”, and the function attribute is “ When the function modification attribute is “search information = history (latest)” in “Search”, the operation reception screen is “search screen designated as“ search information = history (latest) ””.

  When the function attribute is “call” and the function modification attribute is not set, the operation reception screen is a “screen for waiting for input of a telephone number”. Also, if the function attribute is “Call” and the function modifier attribute is “Facility = XXX (← This is a phone number)”, the operation reception screen displays “Phone number XXX as the destination of the call. “Specify and wait for instructions to make a call”.

  Up to this point, the schematic configuration of the in-vehicle system has been described, but the correspondence between each part of the in-vehicle system and the terms in the claims will be described. The voice input unit 61, the voice recognition unit 62, the attribute determination unit 63, the operation reception screen determination unit 64, the shortcut button creation unit 65, and the recognition dictionary 66 have the same name voice input unit, voice recognition unit, attribute determination unit, and operation reception, respectively. It corresponds to a screen determination unit, a shortcut button creation unit, and a recognition dictionary. The control unit 59 corresponds to a display control unit and an operation control unit, and the operation switch group 55 corresponds to a reception unit. The attribute information database 67 corresponds to the first correspondence storage unit, and the device operation information database 68 corresponds to the second correspondence storage unit.

[Description of operation]
Next, control processing for displaying a shortcut button on the display unit 56 based on the result of voice recognition of conversation between passengers of the vehicle or monologue among operations of the in-vehicle system 50 will be described with reference to FIG. This control process is executed by the control unit 59 and the speech recognition related unit 60.

  The premise that the process of FIG. 5 is executed will be described. As described above, when the user gives an instruction via the operation switch group 52 or the like, the state where the voice signal is input from the voice input unit 61 to the voice recognition unit 62 and the state where it is not input can be switched. ing. Therefore, when an instruction to not perform voice recognition is given from the user via the operation switch group 52 or the like, the control unit 59 controls the voice input unit 61, and the voice input unit 61 sends a voice to the voice recognition unit 62. Make sure that no signal is input. Therefore, the process shown in FIG. 5 is not executed. On the other hand, when an instruction to perform voice recognition is given from the user via the operation switch group 52 or the like, the control unit 59 controls the voice input unit 61, and the voice input unit 61 sends a voice to the voice recognition unit 62. Make sure that the signal is input. The process shown in FIG. 5 is executed in such a state.

  In the first step S <b> 10, the voice input unit 61 inputs a conversation voice (here, including not only a conversation between passengers but also a driver's monologue) from the microphone 58. Then, the input voice signal is converted into digital data and output to the voice recognition unit 62.

In S20, the voice recognition unit 62 breaks down into word strings based on the input voice signal. In S30, attribute information is extracted for each word.
In subsequent S40, it is determined whether or not there is a function attribute in the attribute information extracted in S30. This determination is made based on the attribute information database 67 shown in FIG. If there is no function attribute (S40: NO), the process returns to S10, and if there is a function attribute (S40: YES), the process proceeds to S50.

  In S50, it is determined whether there are a plurality of function attributes. If there are a plurality of function attributes (S50: YES), the process proceeds to S60, and the function attribute having the first priority is determined. Here, it is conceivable that the priority order of functions is determined by the following method, for example. (1) Majority decision, (2) Ranking by part of speech of input words (for example, priority is given to a function attribute attached to a verb), (3) According to a predetermined priority order table.

  When the function attribute having the first priority is determined in S60, the process proceeds to S70. If a negative determination is made in S50, that is, if there is one function attribute (S50: NO), the process proceeds to S70 without processing S60.

  In S70, the function modification attributes corresponding to the function attributes are collected from the words whose attribute information is determined in S30. This collection is also performed based on the attribute information database 67 shown in FIG.

  In S80, an operation acceptance screen is determined from the determined function attribute and function modification attribute. This operation acceptance screen is determined based on the device operation information database 68 shown in FIG.

When the operation acceptance screen is determined, the process proceeds to S90 to create a shortcut button.
S10 to S90 are processes executed in the speech recognition related unit 60. The data relating to the shortcut button created in S90 is output to the control unit 59, and the control unit 59 links the corresponding operation reception screen to the shortcut button (S100). Then, a shortcut button is displayed on the display unit 56 (S110). For example, a shortcut button is displayed as shown in FIG.

  After the shortcut button is displayed in this way, when the user presses the shortcut button, a so-called shortcut function is exhibited, and the operation reception screen that is normally displayed only after performing a plurality of operations can be performed with a single operation. Can be migrated. Then, in response to an operation received on the operation reception screen (of course, it is received from the user via the operation switch group 52 or the like), a search function or a telephone number is received. These controls are executed by the control unit 59.

[Explanation of effects, etc.]
In the in-vehicle system 50 according to the present embodiment, the voice recognition unit 62 of the voice recognition related unit 60 analyzes the “voice produced by the speaker” input via the voice input unit 61 and uses the recognition dictionary 66. The recognized result is output as a recognition result. The attribute determination unit 63 determines the function attribute and the function modification attribute corresponding to the recognition result using the correspondence relationship of the attribute information database 67. The operation reception screen determination unit 64 determines an operation reception screen corresponding to the function attribute and function modification attribute determined by the attribute determination unit 63 using the correspondence relationship of the device operation information database 68. The shortcut button creation unit 65 creates a shortcut button corresponding to the operation reception screen determined by the operation reception screen determination unit 64. This shortcut button is displayed on the display unit 56 by the control unit 59.

Thus, by making good use of the voice recognition result and creating a shortcut button, it is possible to simplify the operation reception from the user.
This point will be further described with reference to FIGS.

For example, consider the following conversation example between user A and user B.
User A: “Do you want to eat delicious food?”
User B: “Yes, what about ramen shops?”
User A: “Like”
In such a conversation, a word having a function attribute of “ramen restaurant” is included. Therefore, based on the attribute information database 67 shown in FIG. 3, the function attribute “search” and the function modification attribute “genre = ramen” are determined for “ramen restaurant”. When the operation reception screen is determined based on the device operation information database 68 shown in FIG. 4 based on these function attributes and function modification attributes, the operation reception screen becomes a “search screen designated as genre = ramen”.

  For example, as shown in FIG. 6A, when the operation reception screen is determined from the conversation as described above while the map is displayed on the display unit 56 in the in-vehicle system 50, a shortcut to the operation reception screen is performed. Is displayed on the map displayed on the display unit 56 in a superimposed manner. In the example of FIG. 6A, “name indicating function” “ramen” is added to the shortcut button. In this case, since it is a shortcut button to the operation reception screen capable of executing the search function designated as genre = ramen, “ramen” is considered as a name indicating the function. If the user operates this shortcut button, it is possible to perform a shortcut to an operation reception screen that can perform a genre-designated search among the search functions and execute a search function that is designated as genre = ramen, with only one operation. .

  As for the shortcut button, as shown in FIG. 6A, the letter “ramen” may be added, or the letter “notice” is added in the meaning of a representative button indicating that there is some notice. Alternatively, the letters “SC” indicating a shortcut button may be added.

  Of course, regarding the design of the shortcut button, it is also possible to give a related picture or photograph instead of adding the function name as described above. For example, instead of displaying characters, a design image showing ramen may be written.

In addition, the function modification attribute may be expressed so that the user can understand it. A specific example will be described with reference to FIG.
For example, in response to the basic utterance “Would you like to go to a department store?” “Do you want to go to a nearby department store?” Two applied utterances can be considered. FIG. 7 shows the attributes for these four utterances and the corresponding operation acceptance screen. The function attributes are all “search”, but the function modification attributes are different in each case.

  The example shown in the fourth row (bottom row) of FIG. 7 is a case of a basic utterance “Would you like to go to a department store?” And the function modifier attribute is “genre: department store”, so it is a facility search. In addition, an operation reception screen in which “department” is designated as a facility corresponds.

    The example shown in the first level (uppermost level) in FIG. 7 is a case of an utterance “Let's go to a nearby department store?”. As shown in FIG. 3, since the function modification attribute “search information = periphery” is set for “near”, the operation reception screen for peripheral search corresponds.

  The example shown in the second row of FIG. 7 is a case of an utterance “Let's go to the usual department store?”. As shown in FIG. 3, since the function modification attribute “search information = history (most frequent)” is set for “normal”, the history search operation acceptance screen displayed in order of the frequency of occurrence corresponds.

  The example shown in the third row of FIG. 7 is the case of the utterance “Would you like to go to the department store of XX?” And the function modification attribute is “area specification = XX”, so the area was specified as XX. The facility search operation reception screen corresponds.

  With regard to these, as shown in FIG. 7, a shortcut button with the letters “department” may be displayed in any case. For example, “peripheral department stores” or “ A mode in which characters such as “history department store” are added may be used. This makes it easier to understand what the shortcut buttons mean.

FIG. 8 shows how much operation burden is reduced by using the shortcut button in the example shown in FIG.
For example, a description will be given of an “operation reception screen for facility search in which an area is designated as XX”, which corresponds to the case of “Let's go to a department store of XX?”. In the case of a normal operation, five operations of “destination setting” → “facility” → “others” → “department store” → “OO (← area designation operation)” are required.

  In addition, a “periphery search operation acceptance screen” corresponding to the case of “Let's go to a nearby department store?” If it is a normal operation, four operations of “Destination setting” → “Peripheral facilities” → “Department store” → “Current location (← designation based on the distance from the current location)” are required.

  Also, a “history search operation acceptance screen” corresponding to the case of “Would you like to go to the usual department store?” Will be described. In the case of normal operation, two operations of “destination setting” → “history facility” are required.

In either case, if the shortcut button is displayed as in the present embodiment, the user can perform a shortcut to the same operation reception screen by operating the shortcut button once.
[Another embodiment]
(1) In the embodiment described above, the recognition dictionary 66 and the attribute information database 67 are configured separately as shown in FIG. 2, but as shown in FIG. You may comprise as the information database 66a.

  In this case, the function of the attribute determination unit 63 shown in FIG. In other words, the voice recognition unit 62a shown in FIG. 9 is configured to determine attributes as well as voice recognition.

  (2) Regarding the shortcut button, the following device may be used. That is, at least one of the size, position, and color of the shortcut button is changed according to the elapsed time since the button was created. In this way, the user can easily grasp intuitively when the shortcut button is created. For example, when the size of the shortcut button is reduced with the elapsed time, a user who recognizes that the size of the shortcut button is reduced can also select not to operate the shortcut button. In other words, if the shortcut button is created according to the content of the conversation a little while ago, the current user may think that such a shortcut button operation is unnecessary. Therefore, it is effective mainly for the user to consider whether or not the shortcut button operation is necessary.

  (3) In the above embodiment, only one shortcut button is displayed, but a plurality of shortcut buttons may be displayed. That is, a new shortcut button may be displayed based on the conversation after the shortcut button is displayed. At this time, there is a method of deleting old shortcut buttons and displaying only new shortcut buttons. For example, a method of displaying all of the latest predetermined (for example, two or three) shortcut buttons is also conceivable.

  In such a case, it is easy to distinguish by changing at least one of the size, position and color of the shortcut button according to the elapsed time as described in (2) above. It is also conceivable to change at least one of the size, position, and color of the shortcut button depending on the order of creation. In this way, it is convenient for the user to easily determine at which timing the shortcut button corresponds to the conversation.

  (4) In the said embodiment, application to the vehicle-mounted system 50 was demonstrated. In the above example, an example of a system capable of executing a navigation function and an information input / output function with an external device including a telephone is given. However, an operation acceptance screen for controlling the operation of another in-vehicle device as a control target device. Application such as displaying is also possible. For example, a car air conditioner, a car audio, and other in-vehicle devices.

  The application destination is not limited to the in-vehicle system. For example, the present invention can be similarly applied to a navigation device or a telephone device that is not on-vehicle. Further, the present invention can also be applied to an indoor air conditioner or audio device. Furthermore, the present invention can be similarly applied to, for example, various search devices set at street corners. For example, if a shortcut button is displayed based on a conversation naturally performed by users in front of such a search device, the user can use a desired operation reception screen with a simple operation.

  However, in the case of an in-vehicle system, since the voice input from the microphone is (almost) limited to the vehicle occupant, the created / displayed shortcut button is likely to be in line with the passenger's request, It is very effective.

It is a block diagram which shows schematic structure of the vehicle-mounted system of embodiment. It is the block diagram which showed the structure of the speech recognition related unit mainly functionally. It is explanatory drawing which shows an example of an attribute information database. It is explanatory drawing which shows an example of an apparatus operation information database. It is a flowchart which shows the control processing which displays a shortcut button on a display part based on the result of carrying out the voice recognition of the conversation of the passengers of a vehicle, or monologue. It is explanatory drawing for showing that the operation reception from the user was made simple by creating a shortcut button. It is explanatory drawing for showing that the operation reception from the user was made simple by creating a shortcut button. It is explanatory drawing for showing that the operation reception from the user was made simple by creating a shortcut button. It is a block diagram which shows schematic structure of the vehicle-mounted system of another embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 50 ... Vehicle-mounted system, 51 ... Position detector, 51a ... GPS receiver, 51b ... Gyroscope, 51c ... Distance sensor, 52 ... Operation switch group, 53a ... Remote control, 53b ... Remote control sensor, 54 ... Communication apparatus, 55 ... Operation Switch group 55 ... Map data input device 56 ... Display unit 57 ... Voice output unit 58 ... Microphone 59 ... Control unit 60 ... Voice recognition unit 60 ... Voice recognition related unit 61 ... Voice input unit 62 ... voice recognition unit, 62a ... voice recognition unit, 63 ... attribute determination unit, 64 ... operation acceptance screen determination unit, 65 ... shortcut button creation unit, 66 ... recognition dictionary, 66a ... recognition dictionary + attribute information database, 67 ... attribute information Database, 68 ... equipment operation information database.

Claims (6)

A voice input unit for inputting the voice uttered by the speaker;
A recognition dictionary storing comparison target patterns used for speech recognition;
A voice recognition unit that analyzes a voice input through the voice input unit and outputs a result of recognition using the recognition dictionary as a recognition result;
Based on the recognition result in the voice recognition unit, a shortcut button creating unit that creates a shortcut button that is a button for instructing a content that is normally instructed by performing a plurality of operations in one operation;
A display control unit for displaying a shortcut button created by the shortcut button creation unit on a screen;
A reception unit that receives input of various operations;
When receiving various operations including an operation for the shortcut button displayed on the screen through the reception unit, an operation control unit that controls the operation of the control target device according to the received operation;
It is a storage means for storing a correspondence relationship between a function attribute and a function modification attribute and a word, and the function attribute is an attribute indicating a function to be operated of the control target device assumed from the word, The function modification attribute is an attribute indicating a relatively low-order function used when realizing the function to be operated, a first correspondence relationship storage unit;
A second correspondence storage unit that is a storage unit that stores a correspondence between the function attribute and the function modification attribute and the operation reception screen;
An attribute determination unit that determines a function attribute and a function modification attribute corresponding to the recognition result in the voice recognition unit using a correspondence relationship of the first correspondence relationship storage unit;
An operation reception screen determination unit that determines an operation reception screen corresponding to the function attribute and the function modification genus determined by the attribute determination unit using the correspondence relationship of the second correspondence relationship storage unit;
With
The operation control device, wherein the shortcut button creation unit creates a shortcut button corresponding to the operation reception screen determined by the operation reception screen determination unit. The operation control device according to claim 1,
The reception unit is capable of receiving an instruction as to whether or not to execute voice recognition in the voice recognition unit,
The operation control device is configured so that voice is input from the voice input unit to the voice recognition unit only when an instruction to execute the voice recognition is made through the reception unit. . The operation control device according to claim 1 or 2,
The operation control device, wherein the shortcut button creation unit creates a shortcut button by assigning a function name or a related picture or photograph to the design of the button. In the operation control device according to any one of claims 1 to 3,
The operation control device, wherein the shortcut button creation unit changes at least one of a size, a position, and a color of the created shortcut button according to an elapsed time since the button was created. The operation control device according to any one of claims 1 to 4,
The operation control device is characterized in that the device to be controlled is a vehicle-mounted device including a car navigation device.   A program for causing a computer to function as a voice recognition unit, a shortcut button creation unit, an attribute determination unit, and an operation reception screen determination unit in the operation control device according to any one of claims 1 to 5.