JP2002116854A - Information input device, information input method and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information input device capable of smoothly performing a speech input without requiring any skillful operation. SOLUTION: In a target application, the recognized result of a speech recognizing means for defining the labels of overlapped menus or links as recognition vocabularies can be confirmed with a screen or synthetic speech. In the case of a non-overlapped speech input, the input is defined as a short cut input, and in the case of an overlapped speech input, a value inputted by referring to the past history is preferentially used as the value of an intermediate operation to be uniquely decided so that the speech confirmation can be performed. Thus, it is possible to perform smooth speech input operation.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information input device, an information input method, and a storage medium, and more particularly, to input through a plurality of procedures using menus and links in a conventional window system, web browser, or the like. The present invention relates to a voice interface device that enables smooth input of shortcuts by using voice input for an interface.

[0002]

2. Description of the Related Art Generally, as an interface means for an operation to an application such as a window system or a web browser, a menu or a link is usually used to input a desired command or obtain desired information. I had to go through the steps and enter it.

[0003] On the other hand, (a) a function of assigning buttons and labels to a series of frequently used operation procedures and inputting a shortcut by designating the buttons and labels, and (b) voice input. A window system, a web browser, and the like that hold a function of directly inputting by using means or the like are also appearing.

[0004]

However, in the above-mentioned conventional apparatus, there is a problem that the operation itself of giving a shortcut button or label is cumbersome in (a) above. There are also problems such as the limited number of buttons and labels that can be provided and the need to store labels.

[0005] In the case of (b), since direct input needs to be exclusive, the values of menus and links are restricted, and if the user is not familiar with the values, it cannot be used freely. There were drawbacks.

SUMMARY OF THE INVENTION In view of the above problems, it is an object of the present invention to provide an information input device capable of performing a smooth voice input without requiring a skilled operation.

[0007]

An information input device according to the present invention comprises: a speech recognition unit that uses menu and link labels with duplication in a target application as a recognition vocabulary; and a recognition result of the speech recognition unit. A recognition result confirming means for presenting to a user for confirmation, an intermediate operation generating means for generating a list of intermediate operations for uniquely determining an overlapping voice input in the target application, From the list of intermediate operations, the intermediate operation candidate creating means for creating an intermediate operation candidate to be presented to the user, the result recognized by the voice recognition means, and the intermediate operation candidate creating means And a confirmation response generation means for generating a synthesized voice for presenting the created intermediate operation candidate to the user for confirmation. It is characterized by a door. Another feature of the present invention is that the recognition result confirming means informs the user of the recognition result by a screen or a synthesized voice to confirm the result. Another feature of the present invention is that an event collection unit that collects the format and label of an event that can be input to the application from the application to be interfaced through the communication unit including the API, An event duplication determining means for determining whether or not the label of the event collected by the event collecting means is duplicated; and, if the event duplication determining means determines that the label of the event is duplicated, the event is determined. An intermediate operation generating means for generating a list of intermediate operations for uniquely determining, a format and a label of the event collected by the event collecting means, a flag indicating the presence or absence of duplication determined by the event duplication determining means, and List of intermediate operations that uniquely determine an event in the intermediate operation generation means An event holding means for holding, an intermediate operation candidate creating means for creating an intermediate operation candidate to be presented to the user from the list of intermediate operations for the voice input having the overlap, and a voice input with the user via the interface. A voice input / output means for outputting, and a voice input from the voice input / output means, either one of the event labels held in the event holding means, or affirmative or negative for voice confirmation output by the synthesized voice output means. Voice recognition means for recognizing the information, a recognition result holding means for holding the recognition result recognized by the voice recognition means, and an event held in the event holding means based on the recognition result held in the recognition result holding means. The event is not uniquely determined by the recognition result determining means for determining whether or not the event is determined When it is determined, the intermediate operation list creating unit that presents to the user a list of intermediate operations for uniquely determining an event from the intermediate operations held in the event holding unit, and the intermediate operation list creation unit that is held in the recognition result holding unit An acknowledgment generation unit for generating a synthesized voice to be presented to the user from the recognition result and the list of intermediate operations created by the intermediate operation candidate creation unit; and an application targeted for an interface from the recognition result holding unit and the history holding unit. And an event issuing means for issuing an event to an application targeted by the interface via a communication means including an API. Another feature of the present invention is that the event that can be input to the application is a command that can be input in a menu or a link that can be moved by clicking a mouse.
Another feature of the present invention is that a history holding means for holding a history of recognition results held in the recognition result holding means, a history of recognition results held in the history holding means, An intermediate operation candidate creating unit that creates an intermediate operation candidate to be presented to the user with reference to the list of intermediate operations held in the holding unit. Another feature of the present invention is that, for a specific event, a priority intermediate operation instructing means for inputting an instruction by the user from the voice recognition means to the event and a specific intermediate operation to be given with priority. A priority intermediate operation holding means for holding a priority intermediate operation instructed by the priority intermediate operation instructing means, an event held in the priority intermediate operation holding means, an intermediate operation, and an intermediate held in the event holding means. A priority intermediate operation assigning unit that creates a candidate for an intermediate operation to be presented to the user with reference to the list of operations. Another feature of the present invention is that, for a specific event, a default intermediate operation holding unit that holds an event and a specific intermediate operation that is given priority in advance, and a default intermediate operation holding unit that holds the event. A default intermediate operation providing unit that creates a candidate for an intermediate operation to be presented to the user by referring to the performed event, the intermediate operation, and a list of the intermediate operations held in the event holding unit. And

An information input method according to the present invention includes an event collecting step of collecting a format of an event that can be input to an application from a target application of the interface via a communication means including an API and a label of the event,
An event duplication determination step of determining whether or not the label of the event collected by the event collection step is duplicated, and when the event duplication determination step determines that the label of the event is duplicated, An intermediate operation generating step of generating a list of intermediate operations for uniquely determining the event, the format and label of the event collected by the event collecting step, and the presence / absence of duplication determined in the event duplication determining step An event holding step of holding a flag and a list of intermediate operations for uniquely determining an event in the intermediate operation generation step in an event holding unit; a voice input / output step of performing voice input / output processing for a user; The voice input in the output step is one of the event labels held in the event holding unit. Alternatively, a voice recognition step of recognizing whether or not the voice confirmation output by the synthesized voice output processing is positive or negative, a recognition result holding step of storing a recognition result recognized by the voice recognition step in a recognition result holding unit, and a recognition result holding step A recognition result determining step of determining whether the event held in the event holding unit is uniquely determined from the recognition result held in the unit; and determining that the event is not uniquely determined in the recognition result determining step. The intermediate operation list creation step of presenting to the user a list of intermediate operations for uniquely determining an event from the intermediate operations held in the event holding unit, and the recognition held in the recognition result holding unit Acknowledgment generation for generating a synthesized voice to be presented to the user from the result and the list of intermediate operations created in the intermediate operation candidate creation step An event generating step of generating an input event of an application targeted by the interface from the recognition result holding unit and the history holding unit; and issuing an event to the interface and the target application via communication means including an API. An event issuing step is performed.
Another feature of the present invention is that a history holding step of holding a history of the recognition results held in the recognition result holding unit in a history holding unit, and a history of the recognition results held in the history holding unit. And an intermediate operation candidate creating step of creating an intermediate operation candidate to be presented to the user with reference to the intermediate operation held in the event holding unit. Another feature of the present invention is that a priority intermediate operation in which a user designates an event and a specific intermediate operation to be given preferentially in the voice recognition step for a specific event among the above events. An instruction step; a priority intermediate operation holding step of holding the priority intermediate operation instructed by the priority intermediate operation instruction step in the intermediate operation holding unit; an event and an intermediate operation held in the priority intermediate operation holding unit; A priority intermediate operation providing step of creating a candidate for an intermediate operation to be presented to the user with reference to the intermediate operation held in the holding unit. Another feature of the present invention is that, among the above-described events, a specific intermediate operation that is given preferentially to an event is held in a default intermediate operation holding unit in advance in a default intermediate operation holding unit. Default intermediate operation providing step of creating a candidate for an intermediate operation to be presented to a user by referring to a process, an event and an intermediate operation held in the default intermediate operation holding unit, and an intermediate operation held in the event holding unit And is performed.

[0009] A storage medium according to the present invention is characterized in that a program constituting each means described above is stored so as to be readable from a computer. Another feature of the present invention is that a program for executing the above-described information input method is stored so as to be readable from a computer.

[0010]

Since the present invention has the above technical means, the user can confirm the result of the recognition by the voice recognition means using the menu and link labels accompanied by the duplication in the target application as the recognition vocabulary by the screen or the synthesized voice. In the case of a voice input having no overlap, the input is used as a shortcut input. In addition, in the case of a voice input having a duplication, a value input in the past, a value registered by a user, or a value preliminarily set by the device is used as a value of an intermediate operation for uniquely determining a value. By doing so, a smoother voice input operation is possible.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [First Embodiment] A first embodiment of an information input device, an information input method and a storage medium according to the present invention will be described below in detail with reference to the accompanying drawings. FIG.
1 is a block diagram illustrating a schematic configuration of a voice interface device according to an embodiment of the present invention.

In FIG. 1, reference numeral 1 denotes a voice input unit, which is used by a user to input voice via a microphone, a modulator, or the like. Reference numeral 2 denotes a CPU, which performs various controls in the voice interface device of the present embodiment and a target application.

Reference numeral 3 denotes a ROM for storing a control program executed by the CPU 2. This ROM
3 stores a control program for executing control described in a flowchart described later and an application to be used by the voice interface device in the present embodiment.

Reference numeral 4 denotes a RAM, which provides a work area for the CPU 2 to execute various controls. Reference numeral 5 denotes an external memory which stores events of an application which is a target of the voice interface of the apparatus of the present embodiment. Reference numeral 6 denotes a voice output unit that generates and outputs voice based on the synthesized voice signal, and provides the user with the synthesized voice via a modulator, a speaker, or the like. Reference numeral 7 denotes a bus, which interconnects the above-described components, and enables data transfer between the components.

FIG. 2 is a block diagram showing a functional configuration of the voice interface device of the present embodiment. In FIG. 2, reference numeral 101 denotes a format and a label of an event that can be input to an application to be interfaced (a command that can be input by a menu or a link that can be moved by clicking a mouse) and a label thereof through an API or other communication means. Event collection unit.

Reference numeral 102 denotes an event duplication determination unit that determines whether or not the labels of the events collected by the event collection unit 101 are duplicated. Reference numeral 103 denotes an event that is duplicated by the event duplication determination unit 102. An intermediate operation generation unit that generates a list of intermediate operations for uniquely determining an event in a case.

Reference numeral 104 denotes the format and label of the event collected by the event collection unit 101, a flag indicating the presence or absence of duplication determined by the event duplication determination unit 102, a list of intermediate operations generated by the intermediate operation generation unit 103, and the like. This is an event holding unit that holds each data item.

Reference numeral 105 denotes a voice input / output unit for performing voice input / output with the user. Reference numeral 106 denotes a voice input from the voice input / output unit 105, which is one of an event label held in the event holding unit 104, and This is a voice recognition unit that recognizes whether the voice confirmation output by the synthesized voice output unit 112 described later is positive or negative.

Reference numeral 107 denotes a recognition result holding unit for holding the recognition result recognized by the voice recognition unit 106;
Reference numeral denotes a history holding unit that holds the history of the recognition results held in the recognition result holding unit 107. 109 is a recognition result holding unit 1
The event holding unit 104 uses only the recognition result held in the
Is a recognition result determination unit that determines whether or not the event held in is determined uniquely.

Reference numeral 110 denotes an event holding unit 104 when the recognition result determination unit 109 determines that it is not uniquely determined.
And an intermediate operation creating unit for creating an intermediate operation for uniquely determining an event from the intermediate operation held in the history holding unit 108 and the history of the recognition result held in the history holding unit 108.

An intermediate operation candidate creating unit 111 creates an intermediate operation candidate to be presented to the user with reference to the history holding unit 109 from a list of intermediate operations for uniquely determining an event by the intermediate operation determining unit 110. Reference numeral 112 denotes an acknowledgment generation unit that generates a synthetic voice for confirming to the user the recognition result held in the recognition result holding unit 107 and the intermediate operation candidate created by the intermediate operation candidate creation unit.

Reference numeral 113 denotes an event generation unit which generates an input event of an application to be interfaced with reference to the event storage unit 104, the recognition result storage unit 107, and the history storage unit 108, and 114 denotes communication means such as an API. An event issuing unit that issues an event to an application targeted by the interface via the interface. The event collecting unit 101 to the event issuing unit 114
5 interconnected.

Next, the operation of the apparatus of this embodiment will be described. FIG. 3 is a flowchart showing an operation procedure of the voice interface device of the present embodiment. In FIG. 3, first, in step S201, an event that can be input to an application to be interfaced (a command that can be input by a menu or a link that can be moved by mouse click) in the event collection unit 101.
An event collection process is performed to collect the format and its label via communication means such as an API.

Subsequently, in step S202, the event duplication determination unit 102 performs an event duplication determination process of determining whether or not the labels of the events collected by the event collection unit 101 are duplicated. If the result of this determination is that there is an overlap, the process moves to step S203; otherwise, the process jumps from step S203 and moves to step S204.

In step S203, the intermediate operation determining unit 1
In step 03, an intermediate operation determination process for determining an intermediate operation for uniquely determining an event is performed, and step S2 is performed.
Move to 04.

In step S204, the event collection unit 1
01, a flag indicating the presence or absence of duplication determined by the event duplication determination unit 102, and an intermediate operation determination unit when the event duplication determination unit 102 determines that there is duplication. At 103, an event holding process for holding an intermediate operation for uniquely determining an event is performed, and the routine goes to Step S205.

In step S205, the voice input / output unit 10
5 is input to the voice recognition unit 106.
A voice recognition process is performed to recognize whether any of the event labels stored in the event storage unit 104 and the voice confirmation output by the synthesized voice output unit 112 is positive or negative, and then the process proceeds to step S206.

In step S206, step S205
If the result of the voice recognition recognized in step S1 is affirmative or negative for the voice confirmation output by the synthesized voice output unit 112, the process proceeds to step S213; otherwise, the process proceeds to step S207.

In step S207, the voice recognition unit 106
The recognition result recognized by the recognition result holding unit 107,
Then, a recognition result history holding process held in the history holding unit 108 is performed, and then the process proceeds to step S208.

In step S208, the recognition result determination unit 1
In step 08, it is determined whether or not the recognition result held in the recognition result holding unit 107 includes an overlap with reference to the event holding unit 104. If there is, the process proceeds to step S 209. Move to step S211.

In step S209, the intermediate operation determination unit 1
In step 10, an intermediate operation extraction process for extracting a list of intermediate operations held in the event holding unit 104 is performed, and after the process ends, the flow proceeds to step S210.

In step S210, the intermediate operation candidate creating unit 111 refers to the history of the recognition results held in the history holding unit 108 in ascending order, and includes a list of intermediate operations extracted by the intermediate operation determination unit 110. If it has been, an intermediate operation candidate creating process is performed to set it as an intermediate operation candidate, and then the process proceeds to step S211.

In step S211, the acknowledgment generation unit 1
In step 12, an acknowledgment generation process is performed to generate a synthesized voice for checking with the user from the recognition result held in the recognition result holding unit 107, and then the process proceeds to step S212.

In step S212, the voice input / output unit 10
In step 5, the synthesized voice to be confirmed generated by the confirmation response generation unit 112 or the synthesized voice to present the candidate for the intermediate operation created by the intermediate operation candidate creation unit 111 is output, and the process returns to step S201.

In step S213, step S206
If the determination in step is affirmative, the process proceeds to step S214. If the determination is negative, the process proceeds to step S210. In step S214, the event generation unit 114 refers to the event holding unit 104, generates an event to be transmitted to the application, and performs an event issuing process of transmitting the event generated in the event issuing unit 115 to the application. Move on.

As described above, the voice interface device of the present embodiment is provided with the voice recognition means that uses the labels of the menus and links that overlap in the target application as the recognition vocabulary, and displays the recognition results on the screen or the screen. In addition to checking the synthesized speech, if the speech input has no overlap, use that input as the shortcut input.If the speech input has overlap, refer to the past history as the value of the intermediate operation to determine uniquely. Since the input value is used as a priority for confirmation, a smoother operation can be realized.

[Second Embodiment] Next, a second embodiment of the present invention will be described with reference to FIG. The first mentioned above
In the embodiment described above, the case where the candidate is presented with reference to the past history when the intermediate operation of claim 5 is not uniquely determined has been described. There is no unit 111 and step S207
In, the recognition result holding process for holding the recognition result recognized by the speech recognition unit in the recognition result holding unit 107 is performed, and the process in step S211 is omitted.

In the case where the intermediate operation is not uniquely determined and the user registers the intermediate operation in advance, a specific intermediate operation to be given preferentially to the event with respect to the specific event is sounded. A priority intermediate operation instructing unit 116 to which a user inputs an instruction from the recognizing unit 105, a priority intermediate operation holding unit 117 that holds a priority intermediate operation instructed by the priority intermediate operation instructing unit 116, and a priority intermediate operation holding unit 11
7. The priority intermediate operation assigning unit 118 that creates a candidate for an intermediate operation to be presented to the user by referring to the event and the intermediate operation held in 7 and the intermediate operation held in the event holding unit.
Is provided.

Prior to step S201, a priority intermediate operation instructing process in which the user inputs a specific intermediate operation given preferentially to the event from the voice input / output unit 105 is performed for the specific event.

In the intermediate operation candidate generation processing in step S 211, the intermediate operation held in the priority intermediate operation holding unit 117 by the priority intermediate operation giving unit 118 is set as a candidate.

At this time, when another intermediate operation is included in both the history holding unit 108 and the priority intermediate operation holding unit 117, both of them may be presented as candidates or one of them is given priority. It doesn't matter.

In the case where the default intermediate operation which is prioritized is registered in the apparatus when the intermediate operation of claim 7 is not uniquely determined, a specific intermediate event is given preferentially to an event with respect to a specific event. A default intermediate operation holding unit 119 for holding an operation and a default intermediate operation holding unit 11
And an intermediate operation held in the event holding means, and a default intermediate operation providing unit 120 for creating a candidate for an intermediate operation to be presented to the user.

Then, in the intermediate operation candidate generation processing in step S211, the default intermediate operation giving unit 1
At 20, the intermediate operation held in the default intermediate operation holding unit 119 is set as a candidate.

At this time, when a plurality of the history storage unit 108, the priority intermediate operation storage unit 117, and the default intermediate operation storage unit 119 include another intermediate operation, all of them may be presented as candidates. Alternatively, either one may be given priority.

The present invention may be applied to a system composed of a plurality of devices or an apparatus composed of one device. A recording medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus executes the program code stored in the storage medium. Needless to say, this can also be achieved by executing the reading.

In this case, the program code itself read from the recording medium implements the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

As a recording medium for supplying the program code, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, C
A D-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, and the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS and the like running on the computer are actually executed based on the instructions of the program code. It goes without saying that a part or all of the above-described processing is performed, and the functions of the above-described embodiments are realized by the processing.

Further, after the program code read from the recording medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

[0050]

As described above, according to the present invention,
Make it possible to confirm the result of recognition by the voice recognition means that uses the labels of menus and links with duplication as recognition vocabulary on the screen and synthetic speech. In the case of a voice input having a duplication, a value that is input in the past, a value registered by a user, or a value specified in advance by a device is preferentially checked as a value of an intermediate operation for uniquely determining the value. Therefore, it is possible to provide an information input device capable of performing a smooth voice input without requiring a skilled operation, and to realize a smoother voice input operation.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of a voice interface device according to a first embodiment.

FIG. 2 is a block diagram illustrating a functional configuration of the voice interface device according to the first embodiment.

FIG. 3 is a flowchart illustrating an operation procedure of the interface device according to the first embodiment.

FIG. 4 is a block diagram illustrating a functional configuration of a voice interface device according to a second embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 101 Event collection part 102 Event duplication determination part 103 Intermediate operation generation part 104 Event storage part 105 Voice input / output part 106 Voice recognition part 107 Recognition result storage part 108 History storage part 109 Recognition result determination part 110 Intermediate operation list preparation part 111 Intermediate operation Candidate creator 112 Acknowledgment generator (synthesized sound output unit) 113 Event generator 114 Event issuing unit 115 Bus

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Shigeki Shibayama 3-30-2 Shimomaruko, Ota-ku, Tokyo F-term in Canon Inc. (reference) 5E501 AA01 BA05 CA08 CB15 EA21 FA32 FA43

Claims (13)

[Claims] 1. A speech recognition unit that uses menu and link labels with duplication in a target application as a recognition vocabulary, and presents a recognition result of the speech recognition unit to a user for confirmation. A recognition result confirming means; an intermediate operation generating means for generating a list of intermediate operations for uniquely determining an overlapped voice input in the target application; and From the list, an intermediate operation candidate creating unit that creates an intermediate operation candidate to be presented to the user, a result recognized by the voice recognition unit, and an intermediate operation candidate created by the intermediate operation candidate creating unit are presented to the user. And an acknowledgment generating means for generating a synthesized voice for making a confirmation. 2. The information input device according to claim 1, wherein the recognition result confirming unit informs a user of the recognition result by a screen or a synthesized voice and causes the user to confirm the result. 3. An event collecting means for collecting a format and a label of an event which can be input to an application from an application to be interfaced through an communication means including an API, and an event collected by the event collecting means. And an intermediate operation for uniquely determining an event when the event duplication determining means determines that the label of the event is duplicated. An intermediate operation generating means for generating a list of the event, a format and a label of the event collected by the event collecting means, a flag indicating the presence or absence of duplication determined by the event duplication determining means, and an event generated by the intermediate operation generating means. Event holding means for holding a list of uniquely determined intermediate operations An intermediate operation candidate creating means for creating an intermediate operation candidate to be presented to the user from the list of the intermediate operations for the voice input having the overlap, and an audio input / output for performing audio input / output with the user via the interface. Means, a sound input from the sound input / output means, any one of the label of the event held in the event holding means,
Alternatively, a voice recognition unit that recognizes whether or not the voice confirmation output by the synthesized voice output unit is affirmative, a recognition result holding unit that holds a recognition result recognized by the voice recognition unit, and a recognition result holding unit that holds the recognition result. A recognition result determining unit that determines whether or not the event held in the event holding unit is uniquely determined from the recognition result; and if the recognition result determining unit determines that the event is not uniquely determined, An intermediate operation list creating unit that presents a list of intermediate operations for uniquely determining an event from the intermediate operations held in the event holding unit to the user; a recognition result held in the recognition result holding unit; and the intermediate operation An acknowledgment generating means for generating a synthesized voice to be presented to a user from a list of intermediate operations created by the candidate creating means; Result holding means, an event generation unit interface from the history holding means for generating an input event of the application of interest, the application that the interface is intended,
An information input device, comprising: an event issuing unit that issues an event via a communication unit including an API. 4. The information input device according to claim 3, wherein the event that can be input to the application is a command that can be input by a menu or a link that can be moved by clicking a mouse. 5. A history holding means for holding a history of recognition results held in said recognition result holding means, a history of recognition results held in said history holding means, and an intermediate operation held in said event holding means. 5. The information input device according to claim 4, further comprising: an intermediate operation candidate creating unit that creates a candidate for an intermediate operation to be presented to the user by referring to the list. 6. A priority intermediate operation instruction means for allowing a user to input an event and a specific intermediate operation to be given preferentially to a specific event from said voice recognition means, and said priority intermediate operation instruction means. Refer to the priority intermediate operation holding means for holding the priority intermediate operation designated by, the event held in the priority intermediate operation holding means, the intermediate operation, and the list of the intermediate operations held in the event holding means. The information input device according to claim 4, further comprising a priority intermediate operation providing unit that generates a candidate for an intermediate operation to be presented to the user. 7. A default intermediate operation holding means for holding in advance an event and a specific intermediate operation given preferentially for a specific event; an event held in the default intermediate operation holding means; And a default intermediate operation providing means for creating a candidate for an intermediate operation to be presented to the user with reference to a list of intermediate operations held in the event holding means. The information input device according to claim 1. 8. An event collection step of collecting a format and a label of an event that can be input to an application from an application to be interfaced through communication means including an API, and an event collected by the event collection step An event duplication determining step of determining whether or not the label of the event is duplicated; and, if it is determined by the event duplication determining step that the label of the event is duplicated, the event is uniquely determined. An intermediate operation generating step of generating a list of intermediate operations; a format and a label of an event collected by the event collecting step; a flag indicating whether or not duplication has been determined in the event duplication determining step; and an intermediate operation generating step. A list of intermediate operations that uniquely determine an event is stored in the event storage. An event holding step to hold, a voice input / output step of performing a voice input / output process for a user, and a voice input in the voice input / output step, any one of event labels held in the event holding unit, Alternatively, a voice recognition step of recognizing whether or not the voice confirmation output by the synthesized voice output processing is positive or negative, a recognition result holding step of storing the recognition result recognized by the voice recognition step in a recognition result holding unit, and a recognition result holding step A recognition result determining step of determining whether an event held in the event holding unit is uniquely determined from the recognition result held in the unit; and determining that the event is not uniquely determined in the recognition result determining step. In this case, a list of intermediate operations for uniquely determining an event from the intermediate operations held in the event holding unit is provided to the user. Creating a list of intermediate operations to be shown, and generating a synthesized voice to be presented to the user from a list of the intermediate results created in the intermediate operation candidate creating process and the recognition result held in the recognition result holding unit. An event generating step of generating an input event of an application targeted by the interface from the recognition result holding unit and the history holding unit;
An event issuing step of issuing an event via communication means including a PI. 9. A history holding step of holding a history of recognition results held in the recognition result holding unit in a history holding unit, a history of recognition results held in the history holding unit, and holding in the event holding unit. 9. An information input method according to claim 8, further comprising: performing an intermediate operation candidate creating step of creating an intermediate operation candidate to be presented to the user with reference to the performed intermediate operation. 10. A priority intermediate operation instructing step in which a user instructs and inputs an event and a specific intermediate operation to be given preferentially to a specific event among the events in the voice recognition step; A priority intermediate operation holding step of holding the priority intermediate operation instructed by the operation instruction step in the intermediate operation holding unit; an event and an intermediate operation held in the priority intermediate operation holding unit; and a middle held in the event holding unit. 9. A priority intermediate operation providing step of creating a candidate for an intermediate operation to be presented to the user with reference to the operation.
Or the information input method described in 9. 11. A default intermediate operation holding step of previously holding, in a default intermediate operation holding unit, a specific intermediate operation to be given with priority to an event with respect to a specific event among the events; Performing a default intermediate operation giving step of creating a candidate for an intermediate operation to be presented to the user by referring to the event and the intermediate operation held in the unit and the intermediate operation held in the event holding unit. The information input method according to claim 8. 12. A storage medium storing a program constituting each means according to claim 1 so as to be readable from a computer. 13. A storage medium storing a program for executing the information input method according to any one of claims 8 to 11 so as to be readable from a computer.