JP2005327306A5 - - Google Patents

Description

Window display device used for on-demand interface device

The present invention, computer applications, OA equipment, help function to assist the user's operation in household appliances, to window display device for use in on-demand interface equipment for automatic execution function.

  Applications that use speech recognition are increasing, but most of them are command-initiated using commands.

Further, there is a technique described in Patent Document 1 as an on-demand interface device that displays an agent as an anthropomorphic character and explains operations and the like. An agent explains the operation by retrieving the most appropriate one from the operation explanation database for the request sentence input by the user and executing the script associated with the result.
JP 2000-207085 A

  When speech input is performed using dictation instead of commands in order to enable natural language input in an application that inputs speech, the recognition accuracy is inevitably worse than when only commands are used, and subsequent processing is also affected. Comes out. The enrollment provided by the speech recognition engine can increase the recognition accuracy, but the general user is unfamiliar with the concept of enrollment, and the accuracy of speech recognition is that the application used does not work well. It is hard to notice that it is bad.

  Also, while this voice recognition accuracy is low, you cannot use the application as expected, and every time you input something, only the same message “I don't know” is output, and the user is unwilling to use it. There is a problem.

  Next, in an application that allows both voice input and keyboard input, the voice input button can be pressed to start voice input, and the key input button can be pressed to start key input. If there is no such thing as a dialog that is always displayed and an interface agent that uses anthropomorphic characters is displayed, such a button cannot be displayed. Therefore, a method of assigning a voice input start command and a keyboard input start command to a keyboard or the like can be considered. However, if two keys are assigned, there is a possibility that the user will be confused.

  Next, when explaining the operation by displaying the agent, there is no problem if the agent is displayed when the explanation of the operation is started and the agent is deleted when the explanation is completed, but the agent is always displayed. In some cases, it is difficult to know when the explanation of the operation is finished.

  In addition, if you want the agent to explain the operation, but do not prepare a dialog to display the search results and use an agent-only interface, enter the same request text and perform a search again to make the same explanation again. There is a problem of having to let them. In the case of an agent-only interface, the search target mode, the volume level display during voice input, and the edit box during keyboard input are displayed at specific positions on the screen regardless of the agent. If it is displayed in the window, the user's eyes always face the agent, so there is a problem that it is difficult for the user to understand.

  There is also a problem that when the on-demand interface device is activated for the first time, the user does not know what to do.

The present invention has been made in view of the above situation, and an object thereof is to provide a window display device used for an on-demand interface device with improved usability.

  The present invention provides means for solving such problems in the prior art, and the invention of each claim comprises the following technical means.

According to the first aspect of the present invention, a window display on a window system type computer system having a main window that can be moved by a user and autonomously moved by a program, and one or more sub-windows other than the main window. The apparatus is characterized by comprising sub-window moving means for moving the sub-window while maintaining a certain relative position in accordance with the movement of the main window.

The invention of claim 2 obtains a timer means for generating an interrupt at every predetermined time in a window display device of claim 1, the position of the main window when sub-window moving means interruption by the timer means is generated The sub-window is moved from the main window to a certain relative position.

According to a third aspect of the present invention, in the window display device according to the first or second aspect of the present invention, the window display device further comprises subwindow movement setting means capable of setting the subwindow not to be moved for each subwindow.

According to a fourth aspect of the present invention, in the window display device according to the first or second aspect of the present invention, the window display device further comprises subwindow display setting means capable of setting the subwindow not to be displayed for each subwindow.

According to a fifth aspect of the present invention, in the window display device according to the first or second aspect , when the subwindow moves outside the display range of the screen, the position of the subwindow is corrected so that the subwindow is displayed within the display range. In-screen display position correction means is provided.

According to a sixth aspect of the present invention, in the window display device according to the fifth aspect , when the sub window is moved so as to overlap the main window, the position of the sub window is corrected so as not to overlap the main window. It is characterized by providing a means.

According to a seventh aspect of the present invention, in the window display device according to the fifth aspect , there is provided an inter-subwindow position correcting means for correcting the position of the subwindow so that the subwindows do not overlap each other when the subwindows are moved overlapping each other. It is characterized by.

According to an eighth aspect of the present invention, in the window display device according to the fifth aspect , in accordance with the contents set in the window display priority setting means and the window display priority setting means capable of setting the display priority of the main window and each subwindow. Window display priority changing means for changing the display priority when the main window and each subwindow overlap is provided.

According to a ninth aspect of the present invention, in the window display device according to the first or second aspect , the position of the sub-window is arranged so that the sub-window is superimposed on the main window so as to reduce the total display area of the main window and the sub-window. Sub-window position correcting means for reducing the total display area to be corrected is provided.

A tenth aspect of the present invention is the window display device according to the first or second aspect , wherein the subwindow display area is corrected so that the subwindows are displayed so as to overlap each other so as to reduce the total display area of the subwindows. It is characterized by comprising a reduction position correcting means.

The invention according to claim 11 is the window display device according to claim 1 or 2 , wherein the subwindow is displayed so that the subwindow is not hidden under other windows on the screen other than the main window and the subwindow. A front display means is provided.

According to a twelfth aspect of the present invention, in the window display device according to any one of the first to eleventh aspects, the main window is an agent output means of anthropomorphic characters, and the sub-window represents a current state such as a search mode. It is characterized by being status output means.

A thirteenth aspect of the present invention is the window display device according to any one of the first to eleventh aspects, further comprising voice input means for a user to input voice, wherein the main window is an agent output means of anthropomorphic characters. The sub-window is a sound level output means for displaying the volume level of the sound input by the sound input means.

According to a fourteenth aspect of the present invention, in the window display device according to any one of the first to eleventh aspects, the main window is an agent output means of anthropomorphic characters, and the sub-window is a request sentence by a method other than voice input by the user. The request sentence input display means for displaying the input contents and the input cursor of the request sentence input for performing the input.

In the window display device according to the present invention, the following effects can be obtained.

According to the first and second aspects of the present invention, the sub-window displaying the information related to the main window is moved along with the movement of the main window, so that the sub-window having the necessary information can be moved to a place where the user can easily see. it can. Moreover, since the subwindow is moved not only when the user moves the main window but also when the main window itself moves autonomously, the user does not lose sight of the position of the subwindow.

According to the third and fourth aspects of the present invention, the sub-window that is not necessary to be displayed is dynamically separated by not moving the sub-window that moves accompanying it or not displaying it on the screen. Can do.

In the inventions of claims 5 to 11 , the position of the main window and each subwindow is corrected so that it is displayed when it moves outside the screen or overlaps, or when the subwindow gets in the way. By displaying so as to overlap each other or not hiding in other windows, it is possible to display according to the situation.

According to the twelfth to fourteenth aspects of the present invention, for a voice on demand interface having an agent as a main interface, a status display showing the current search mode, a voice level display showing the volume level of voice input, a keyboard, etc. By moving the edit box display at the time of inputting a request sentence as a subwindow accompanying the movement of the agent, the display of these subwindows can be easily seen by the user. In particular, in the case of an agent interface, since the user talks to the agent, the user's line of sight is directed to the agent, and displaying in this way makes it easier to see the information.

  Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows a schematic configuration of an example of a voice on demand interface apparatus using the window display apparatus of the present invention. This voice-on-demand interface device includes a voice input means 1 such as a microphone for inputting a search request sentence and a user instruction by voice, a keyboard for inputting a search request sentence and a user instruction other than voice, and the like. Request input means 2, voice input means 1, voice input means 1, input start means 3 for notifying the control means 5 that input of a request text or input of a user instruction is started by the request text input means 2. In order to select a desired result of the user from among the search results output from the speech recognition means 4 for recognizing the speech input in step 5, the control means 5 for controlling the voice on-demand interface device, and the output means 7. The search result of the function DB 8 for the request text input from the selection means 6, the voice input means 1 and the request text input means 2, and the image and voice of the agent as an anthropomorphic character are output. Output means 7 such as a display or a speaker, a function DB 8 that stores a script describing a help explanation and an operation procedure for explaining a device on which a voice on-demand interface device is mounted, voice input Search failure response DB 9 that stores a message to be output to the output means 7 when the search result of the function DB 8 with respect to the request sentence input from the means 1 or the request sentence input means 2 is zero, and an agent action script, control means 5 includes a command DB 10 in which commands for giving instructions to 5 are stored.

  The voice input unit 1 may double as the selection unit 6, and the request sentence input unit 2 may double as the input start unit 3 and the selection unit 6. The function DB 8, the search failure response DB 9, and the command DB 10 may be stored in an external storage device connected to the control means 5, may be distributed, or may exist on the network.

  FIG. 2 shows a schematic configuration of an example of the control means 5. This control means 5 includes a search means 11 for searching the function DB 8, a storage means 12 for storing which result the user has selected by the selection means 6 from the results searched by the search means 11, Voice recognition adjustment recommendation means 13 for recommending the user to adjust the voice recognition of the voice recognition means 4 when the user does not select any search result continuously n times or more with reference to the means 12, search means The search failure output means 14 for outputting the contents of the search failure response DB 9 to the output means 7 at random when the search result at 0 is 0, and the search result at the search means 11 is 0. The search failure number storage means 15 for storing the information, the input mode storage means 16 for storing whether or not the input mode of the user's request sentence or instruction is voice input, and the function DB 8 are detected by the search means 11. The function execution means 17 for executing the function selected by the selection means 6 by the user among the results obtained, the agent output means 18 for outputting the agent as an anthropomorphic character to the output means 7, and the output by the agent output means 18 From the agent position storage means 19 for storing the position of the agent on the screen, the agent position return means 20 for changing the position of the agent output by the agent output means 18, the voice input means 1 and the request sentence input means 2 One or more sub-windows are moved in accordance with the movement of the main window output to the command processing means 21 and the output means 7 for processing the command when the input request statement matches the one stored in the command DB 10. Sub-window moving means 22 to perform, control at regular intervals Whether to perform sub-window movement by timer means 23 for interrupting stage 5, sub-window movement means 22 by sub-window movement means 22, sub-window movement setting means 24 for setting each sub-window, or whether to display sub-windows by sub-window movement means 22 The sub-window display setting means 25 for setting each sub-window and the position of the sub-window so that the sub-window is displayed on the screen when the sub-window moves out of the screen of the output means 7 by the movement of the sub-window by the sub-window moving means 22. When the sub window is displayed on the output means 7 so as to overlap the main window due to the movement of the sub window by the sub window on-screen display position correcting means 26 and the sub window moving means 22 to be corrected, the sub window is overlapped with the main window. When the subwindows are overlapped on the screen of the output means 7 by the movement of the subwindows by the subwindow position correcting means 27 and the subwindow moving means 22 for correcting the position of the corresponding subwindow so that the subwindows are not overlapped, the subwindows are overlapped with each other. A window for setting which window is displayed with priority when the main window and each sub-window overlap each other by the movement of the sub-window by the sub-window moving means 22 and the sub-window moving means 22 for correcting the position of the corresponding sub-window. In accordance with the setting of the display priority order setting means 29 and the window display priority order setting means 29, the window display priority for changing the display priority order of the main window and each subwindow on the screen of the output means 7 is displayed. Subwindow for reducing the total display area for correcting the position of the subwindow so as to reduce the total display area of the main window and each subwindow displayed on the screen of the output means 7 by the movement of the subwindow by the rank changing means 30 and the subwindow moving means 22 Sub-window display area reducing position correcting means 32 for correcting the position of the sub-window so that the total display area of each sub-window displayed on the screen of the output means 7 is reduced by the movement of the sub-window by the position correcting means 31 and the sub-window moving means 22. The sub-window front display means 33 and the search means 11 display each sub-window on the screen of the output means 7 so that each sub-window is not hidden under the main window or other windows other than each sub-window. Status output means 34 for outputting the search mode to the output means 7, voice level output means 35 for outputting the sound volume level inputted from the voice input means 1 to the output means 7, and request sentence input means 2 Referring to the request text input / output means 36 and the storage means 12 for displaying the character string input in step 1 and the cursor, the voice input is performed when the user does not select any search result continuously n times or more. The voice input method explanation display means 37 for outputting the explanation of the voice input method by the means 1 to the output means 7, and a message for prompting the output means 7 to input when there is no input from the voice input means 1 for a predetermined time or more. The voice input promoting means 38 is included.

First, as an example of a voice on-demand interface device using the window display device of the present invention, voice input means for a user to input voice, and voice recognition means for voice recognition from voice input means And a database to be searched, a search means for searching the database using the result of speech recognition by the voice recognition means as a request sentence, an output means for outputting the search result of the search means, and an output means An on-demand interface device comprising a selection means for selecting a result desired by a user from among the results, a storage means for storing a selection result in the selection means or that nothing has been selected; The user is advised to adjust the voice input means when the contents stored in the storage means are selected n times consecutively and no selection result is selected. Or a speech recognition means for recognizing speech input from the speech input means, and a search target. An on-demand interface device comprising a certain database, search means for searching the database using the result of speech recognition by the speech recognition means, and output means for outputting the search result of the search means, A search failure response DB that holds a plurality of sentences for notifying the user that the search result was 0, and a random sentence from among the sentences included in the search failure response DB when the selection result by the search means is 0 In the second example including the search failure output means for selecting a sentence to output to the output means, and in the second example, the search failure from the search failure output means when the search is performed by the search means When the search failure number storage means for storing whether or not the answer DB sentence has been output and the fact that the search failure response DB sentence has been output n times in succession are stored in the search failure number storage means for be described a third embodiment with a speech recognition adjustment recommendation means recommends the user to make the adjustment.

An example of a flow diagram of the processing of voice recognition adjustment recommendation unit 13 as a search failure output unit 14 shown in FIG. The user inputs a search request sentence for searching the function DB 8 from the voice input means 1 (S1). An example of the function DB 8 is shown in FIG. The function name and the function description become a search target character string, and the description of the operation procedure and the action script are used by the function execution means 17 and the agent output means 18 when explaining the operation by the agent. The voice input by the function execution voice input means 1 is converted into a character string by the voice recognition means 4 (S2). The converted character string is sent to the control means 5, and the function DB 8 is searched by the search means 11 in the control means 5 (S3). Here, it is assumed that the voice recognition result by the voice recognition means 4 is “document”. Then, the search means 11 performs a search from the function DB 8 and selects a function to be executed by the output means 7. Print 2. Save and search results are output (S5). Here, when the user inputs “1” by the selection means 6 (S6), the function execution means 17 and the agent output means 18 execute the “print” function (S7) and execute it in the storage means 12. Is stored, the answer is “No” (S6), or when the next search is executed (S3), the storage means 12 is stored that has not been executed. The contents stored in the storage means 12 are:
"centering"
"save"
It looks like no execution. The voice recognition adjustment recommendation means 13 monitors the storage means 12 and adjusts the voice recognition means 4 to the output means 7 when it is stored in the storage means 12 that it has not been executed more than n times (S8). The user is advised that it should be done (S11). For example, when you do not execute more than 5 times,
Voice recognition engine may not be recognized properly Do you want to enroll the voice recognition engine?
To the output means 7 to encourage the user to enroll the speech recognition system. When the search means 11 performs a search in the above-described procedure (S3), when the search result is 0 (S4), the search failure output means 14 searches the output means 7 with reference to the search failure response DB9. (S9) is output. An example of the search failure response DB 9 is shown in FIG. In this case, when there are no search results, the search failure output means 14 randomly selects a response sentence from these,
Is the voice of the output means 7 bad?
Is output as follows. Further, the search means 11 causes the search failure number storage means 15 whose number of search results is the number of cases (S3). The contents stored in the search failure frequency storage means 15 are 8 cases, 10 cases and 0 cases. The voice recognition adjustment recommendation means 13 monitors the search failure frequency storage means 15 and outputs the output means when it is stored in the search failure frequency storage means 15 that the number of searches is zero or more consecutively (S10). 7 is recommended to the user that the voice recognition means 4 should be adjusted (S11). For example, when there are no search results for 5 consecutive times,
Voice recognition engine may not be recognized properly Do you want to enroll the voice recognition engine?
To the output means 7 to encourage the user to enroll the speech recognition system.

Further, as an example of a voice on-demand interface device using the window display device of the present invention, voice input means for a user to input voice and voice recognition means for voice recognition from voice input means And a database to be searched, a search means for searching the database using the result of speech recognition by the voice recognition means as a request sentence, an output means for outputting the search result of the search means, and an output means An on-demand interface device comprising a selection means for selecting a result desired by a user from among the results, a storage means for storing a selection result in the selection means or that nothing has been selected; Explanation of the method of voice input by the voice input means when the contents stored in the storage means are not selected n times consecutively and no selection result is selected In the fourth example including the voice input method explanation display means for outputting to the output means, and whether the search failure response DB sentence is output from the search failure output means when the search means performs a search. Search failure number storage means for storing the information, and a description of the voice input method by the voice input means when the fact that the search failure response DB sentence has been output n times consecutively is stored in the search failure number storage means In the fifth example provided with the voice input method explanation display means for outputting the voice input method explanation display means 37 in place of the voice recognition adjustment recommendation means 13 in the above explanation, it is continuously performed n times or more. The voice input method by the voice input means 1 will be explained to the user when the execution is not performed or when the number of searches is zero or more consecutively. For example, when the execution is not performed continuously five times or more,
In order to perform voice input, the user presses the input start button and asks the user to say “I want to enlarge the text” to the output means 7 to explain to the user the voice recognition method. The voice input method explanation display means 37 not only explains the voice input method in this way, but also explains what function name function is included in the function DB 8 or when the function DB 8 is executed. A sample screen representing the state of the above may be displayed, or help for the voice on-demand interface device may be displayed.

Next , as an example of a voice on demand interface device using the window display device of the present invention, voice input means for a user to input voice, and voice recognition for voice recognition from voice input means. And an input mode for holding a request sentence input means for a user to input a request sentence by a method other than voice input and a mode for inputting by the voice input means or by the request sentence input means In an on-demand interface device comprising a storage means, if the voice input mode is in the voice input mode according to the input mode held in the input mode storage means, the voice input from the voice input means is a request text input means if the input mode is not voice. A sixth example provided with an input starting means for accepting an input from a user for starting a request text input from will be described. FIG. 6 shows a flowchart of processing in the sixth example . In order to search the function DB 8, it is necessary to input a request sentence from the voice input means 1 or the request sentence input means 2. The input mode storage means 18 stores whether or not the input mode at that time is voice input. Keep it. When starting the request text input, a start signal is sent to the input start means 3 (S12), and the input mode stored in the input mode storage means 18 is referred to (S13). Input from 1 is started (S14), and if not in the voice input mode, input from the request sentence input means 2 is started (S15). For example, an input button is prepared as the input start means 3, and if the voice input mode is set, the voice input is started when the input button is pressed, and if the voice input mode is not set, a character input dialog is output. The information is displayed on the screen of the means 7.

Next, as a voice on-demand interface device using the window display device of the present invention, an input means for accepting an input of a request sentence from a user, a function database storing a function script for executing a function, Search means for searching the function database from the request text input by the input means, output means for outputting the search result of the search means, and a function script desired by the user from the results output to the output means Selection means for selecting the function, function execution means for executing the function script selected by the selection means, and agent output means for displaying anthropomorphic characters at the same time when the function script is executed by the function execution means In the on-demand interface device, the function execution means before executing the function script Agent position storage means for storing the position of the personalized character and agent position return means for moving the personified character to the position stored in the agent position storage means after the function execution means executes the function script. An example will be described.

FIG. 7 shows an example of a state when the function is explained by the voice on-demand interface device of this example . This is an example when the function DB 8 is as shown in FIG. 4 and “centering” is executed. In accordance with the action script described here, the function execution unit 17 executes the function, and the agent output unit 18 outputs the agent to the output unit 7. In the case of this “centering” function, the agent explains to select a character to be centered, and then points to the location while the agent moves and teaches to select centering in the edit menu. An example of a flowchart of the process of the seventh example is shown in FIG. First, the agent position storage means 19 stores the coordinates of the agent displayed on the screen of the output means 7 (S16). Next, the agent explains the operation according to the procedure described above (S17). Then, after the explanation of the operation is finished, the coordinates of the agent are moved to the position where the agent position return means 20 was before explaining the operation of the agent with reference to the coordinates stored in the agent position storage means 19 (S18). In the display example of FIG. 7, after explaining the “centering” function (FIGS. 7B and 7C), the agent returns to the position before the operation explanation (FIG. 7A). .

Next, as an example of a voice on-demand interface device using the window display device of the present invention, an input means for accepting an input of a request sentence from a user, a function database storing a function script for executing a function, , A search means for searching the function database from the request text input by the input means, an output means for outputting the search result of the search means, and a function desired by the user from the results output to the output means In an on-demand interface device provided with a selection means for selecting a script, a storage means for storing a function script selected by the selection means, and another process is executed instead of performing a search by the search means A command database that holds commands for identifying For the eighth embodiment of comprising a command processing means for performing a specific process in accordance with the content of the function script stored in the storage means rather than a search by the search means when matching the command stored in the base explain.

An example of a flow chart of processing in the eighth example is shown in FIG. The request sentence (S19) input from the voice input means 1 or the request sentence input means 2 is checked to see if it matches the command sent to the command processing means 21 and stored in the command DB 10 (S20). If not, normal search processing is performed by the search means 11 (S21), and if they match, command processing is performed by the command processing means 21 (S22). An example of the contents of the command DB 10 is shown in FIG. For example, if “again” is input, the input is interpreted as a command, and a predetermined command is executed. In this case, the description of the operation executed immediately before is performed again. In addition, it is possible to display a help for the operation explanation executed immediately before, or to implement a command for slowly executing the operation explanation executed immediately before again.

Next , the window display device of the present invention used for the above-described on-demand interface device will be described. FIG. 11 shows a display example on the screen of the output means 7 of the agent and search mode, voice level, and request text input edit box of the voice on-demand interface apparatus. (A) is a single display of agents by the agent output means 18, (b) is a display of the search mode simultaneously by the status output means 34, (c) is a further display of the sound level by the sound level output means 35, (D) is an example in which an edit box for request text input is displayed by the request text output means 35 instead of the voice level display in (c). In this voice on-demand interface device, when the user moves the agent, or when the agent moves on the screen by explaining the operation of the agent, the related windows other than the agent are also moved simultaneously. The flow of processing at that time is shown in FIG. First, nothing is done until an interrupt is issued from the timer means 23 (S23). For example, the generation interval of this interrupt is 0.1 seconds. If an interrupt is generated by the timer means 23, display processing is performed if it is displayed based on the setting stored in the subwindow display setting means 25 whether or not each subwindow is initially displayed. Hide (S24). For example, in FIG. 11C, the request text input edit box is not displayed, and in FIG. 11D, the voice level display is not displayed.

  Next, whether or not each subwindow is to be moved is determined based on the setting stored in the subwindow movement setting means 24 if it is moved, and if it is not moved, the movement process is not performed ( S25). For example, when it is desired to fix the status display such as the search mode displayed in FIG. 11B without being moved along with the agent, the setting is set so as not to move. Next, the sub-window moving means 22 checks the current coordinates of the agent and moves the sub-window to the destination where the agent has moved (S26). For example, when the status display indicating the agent and the search mode is performed in the state as shown in (e-1) of FIG. 11, if the agent moves as shown in (e-2), the sub-window moving means 22 displays the status display. Is moved to the destination of the agent as shown in (e-3). Next, it is confirmed whether or not the subwindow moved by the display position correcting means 25 in the subwindow screen is hidden and displayed outside the screen (S27), and if it is hidden outside the screen, it is moved into the screen (S31). ). For example, when the status display moves and is hidden outside the screen as shown in (f-1) in FIG. 11, the position of the status display is corrected and displayed in the screen as shown in (f-2). To be displayed. Next, it is confirmed whether or not the agent is overlapped with the subwindow to which the main window / subwindow position correcting means 27 has moved (S28). If the agent is displayed so as to overlap, the subwindow is displayed so as not to overlap the agent (S32). ). For example, when the agent and the status display are overlapped as shown in (f-2) of FIG. 11, the status display is corrected and displayed at a position not overlapping with the agent as shown in (f-3). So that

  As another processing method when the agent and the subwindow overlap, it is confirmed whether the agent is overlapped with the subwindow to which the window display priority order changing unit 30 has moved (S28). There is also a method of determining the display priority of each window according to the display priority of the main window and the subwindow stored in the rank setting means 29 (S32). For example, when the agent and status display are overlapped as shown in (f-2) of FIG. 11 and the window display priority setting unit 29 is set to display the agent with priority. The status display is displayed so as to be hidden under the agent as in (f-4). Since the agent is an interface with the user, usually the agent is displayed with priority as shown in (f-4), but when the request text is entered from the edit box, it is input that the edit box is hidden under the agent. For example, when the agent and the edit box overlap as shown in (g-1), the edit box can be set to be displayed with priority as shown in (g-2). Next, it is confirmed whether the position correction means 28 between subwindows moves and subwindows do not overlap (S29), and when it overlaps, a subwindow is moved so that subwindows may not overlap (S33). For example, when the status display and the sound level display overlap as shown in (h-1) of FIG. 11, the status display is moved as shown in (h-2). Next, the sub-window topmost display means 33 checks whether the sub-window is hidden under a window other than the agent and other sub-windows (S30). If it is hidden, the sub-window is displayed in front. (S34). For example, when another application window hides the status display window as shown in (g-1) of FIG. 11, the status display window is displayed on the front as shown in (g-2). Do not hide under other applications. When the correction of the sub window position is completed, the process waits for the timer interrupt to occur again (S23).

  Further, when the display of the agent or subwindow displayed on the screen of the output means 7 is obstructed, the total display area of the agent and the subwindow can be reduced by using the subwindow position correcting means 31 for reducing the total display area, The display area reduction correcting means 32 can be used to reduce the total display area of the subwindow. An example of a flowchart of this process is shown in FIG. When reducing the total display area of the sub-window including the agent (Yes in S35), the position of the sub-window is corrected so that the upper left coordinates of the agent and each sub-window are the same (S36), and the total display of only the sub-window is performed. When the area is decreased (no in S35), the position of the subwindow is corrected so that the upper left coordinates of each subwindow are the same (S37). For example, when the agent and each sub-window are displayed as shown in FIG. 14A, the total display area of the agent and the sub-window is reduced by using the sub-window position correcting means 31 for reducing the total display area (b). When the subwindow, the agent, and the subwindow are displayed in an overlapping manner as shown in FIG. 6B and the total display area of the subwindow is reduced using the subwindow display area reduction correcting means 32, the subwindows are displayed in an overlapping manner as shown in FIG. To do.

  As mentioned above, the content in embodiment mentioned so far is not limited to the said description, unless the main point of this invention is changed.

It is a schematic block diagram of an example of the audio | voice on-demand interface apparatus which uses the window display apparatus of this invention. 3 is a schematic configuration diagram of an example of a control unit 5. FIG. It is a figure which shows an example of the flow of a process of a speech recognition adjustment recommendation means and a search failure output means. It is a figure which shows an example of the content of function DB8. It is a figure which shows an example of the content of search failure response DB9. It is a figure which shows an example of the flow of a process in the case of inputting a request sentence by methods other than a voice input in a voice on demand interface apparatus . Is a diagram showing an example of a state when to perform the described functions by voice on-demand interface device. It is a figure which shows an example of the flow of a process in case a function is demonstrated with a voice | voice on demand interface apparatus . It is a figure which shows an example of the flow of a process in the case of performing a function using a command with an audio | voice on-demand interface apparatus . It is a figure which shows an example of the content of command DB10. It is a figure which shows an example of the display method of the agent displayed on an audio | voice on-demand interface apparatus using the window display apparatus of this invention, a search mode, an audio | voice level display, and a request sentence input edit box. It is a figure which shows an example of the flow of the subwindow position correction process in the window display apparatus of this invention. It is a figure which shows an example of the flowchart of the process for reducing the total display area of the window displayed. It is a figure which shows an example of a display when the process for reducing the total display area of the window displayed is performed.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Voice input means, 2 ... Request sentence input means, 3 ... Input start means, 4 ... Voice recognition means, 5 ... Control means, 6 ... Selection means, 7 ... Output means, 8 ... Function DB, 9 ... Search failure response DB: 10 ... Command DB, 11 ... Search means, 12 ... Storage means, 13 ... Voice recognition adjustment recommendation means, 14 ... Search failure output means, 15 ... Search failure count storage means, 16 ... Input mode storage means, 17 ... Function Execution means, 18 ... agent output means, 19 ... agent position storage means, 20 ... agent position return means, 21 ... command processing means, 22 ... subwindow movement means, 23 ... timer means, 24 ... subwindow movement setting means, 25 ... subwindow Display setting means 26... Sub-window display position correction means 27... Main window sub-window position correction means 28. Inter-window position correcting means, 29 ... Window display priority setting means, 30 ... Window display priority changing means, 31 ... Sub-window position correcting means for reducing the total display area, 32 ... Sub-window display area reducing position correcting means, 33 ... Sub-window Front display means 34... Status output means 35. Audio level output means 36. Request text input output means 37 37 Voice input method explanation display means 38.

Claims (14)

  In a window display device on a window system type computer system comprising a main window that can be moved by a user and can be moved autonomously by a program, and one or more sub-windows other than the main window, the main window A window display device comprising sub-window moving means for moving the sub-window while maintaining a certain relative position in accordance with the movement of the sub-window.   2. The window display device according to claim 1, wherein the timer means for generating an interrupt at regular intervals and the sub-window moving means obtain the position of the main window when the previous interrupt is generated by the timer means to obtain the sub-window. The window display device is characterized in that it is moved from the main window to a certain relative position.   3. The window display device according to claim 1, further comprising sub-window movement setting means capable of setting the sub-window not to be moved for each of the sub-windows.   3. The window display device according to claim 1, further comprising sub-window display setting means capable of setting the sub-window not to be displayed on each of the sub-windows.   3. The window display device according to claim 1 or 2, wherein when the sub window moves out of the display range of the screen, the sub window in-screen display position correcting means corrects the position so that the sub window is displayed within the screen display range. A window display device comprising:   6. The window display device according to claim 5, further comprising: a sub-window position correcting unit for correcting a position of the sub-window so as not to overlap the main window when the sub-window is moved so as to overlap the main window. A window display device characterized by that.   6. The window display device according to claim 5, further comprising inter-subwindow position correcting means for correcting the position of the previous subwindow so that the subwindows do not overlap each other when the subwindows overlap each other and are moved. Window display device.   6. The window display device according to claim 5, wherein a window display priority setting means capable of setting a display priority of the main window and each of the sub-windows, and a previous main window according to the set contents of the window display priority setting means. And a window display priority changing means for changing the display priority when the sub-windows overlap each other.   3. The window display device according to claim 1, wherein the position of the sub window is corrected so that the sub window is displayed so as to overlap the main window so as to reduce a total display area of the main window and the sub window. A window display device comprising subwindow position correcting means for reducing the total display area.   The window display device according to claim 1 or 2, wherein the position correction of the subwindow display area is performed to correct the position of the subwindow so that the subwindows are displayed in an overlapping manner so as to reduce the total display area of the subwindow. A window display device comprising means.   3. The window display device according to claim 1, wherein said subwindow is displayed in such a manner that said subwindow is not hidden under other windows on the screen other than said main window and said subwindow. A window display device comprising:   12. The window display device according to claim 1, wherein the main window is an agent output means for anthropomorphic characters, and the sub-window is a status output means for indicating a current state such as a search mode. An on-demand interface device characterized by being.   12. The window display device according to claim 1, further comprising voice input means for a user to input voice, the main window is an agent output means for anthropomorphic characters, and the sub-window is An on-demand interface device, comprising: a sound level output means for displaying a volume level of a sound input by the sound input means.   12. The window display device according to claim 1, wherein the main window is an agent output means for anthropomorphic characters, and the sub-window is used to input a request sentence by a method other than voice input. An on-demand interface device, characterized in that it is a request sentence input display means for displaying an input content and an input cursor of a request sentence input.