JP2005056170A - Interactive operation supporting system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an interactive operation supporting system to operate household electric appliances or information apparatuses according to an intuitive instruction without complicating a command uttered by a user. <P>SOLUTION: A plurality of characters are arranged on a picture, and certain functions owned by household electric appliances or information apparatuses are associated with respective characters, and presented to a user. Then, the user is able to view the displayed characters in order to start the operation of the household electric appliances or information apparatuses by calling the names of virtual agents present in the apparatuses. Also, it is possible for the user to select his or her desired function from a plurality of functions owned by the apparatuses according to an intuitive instruction such as the name of characters. Thus, it is possible to prevent the command uttered by the user from being complicated. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an interactive operation support system using a character agent that supports user operations on various home appliances and information devices having a plurality of functions.

  Conventionally, as an interface used for various home appliances such as a television receiver and various information devices such as a mobile phone, a method of selecting an operation menu displayed on the screen via a remote control or a touch panel, or a pictogram called an icon is used. The method of specifying is the mainstream.

  On the other hand, with the improvement of information processing technology in recent years, the functions of various home appliances are steadily improving. For example, in the case of a television, it is possible to receive multi-channel broadcasts by changing from analog broadcasts to digital broadcasts, receive data broadcasts, and receive user-participation broadcasts through two-way communication. There are examples such as becoming.

  When operating a device with such high functions, the number of operation menus displayed on the screen is increased or the number of operation menus displayed at one time is increased in a so-called hand-operated interface such as the above-described remote control or touch panel. Instead of limiting it to a few, measures such as deepening the function hierarchy have been taken. However, when the number of operation menus increases, the user needs to find a desired function from among the many menu items presented, which causes a problem that the operation becomes complicated. Further, if the function hierarchy is deepened, the number of options presented at the same time is reduced, but the deep function hierarchy must be followed until the target function is reached, and there is a problem that the operation becomes complicated.

  Therefore, recently, an interactive operation support system has been proposed in which a character is displayed on a display and a user operates a device in a form in which the user talks with the character on the display. According to this system, since the device side recognizes the voice uttered by the user and analyzes the user's request based on the recognition result, the user can operate the device. The trouble of searching for a desired option and the trouble of following a deep function hierarchy are not required, and the load at the time of device operation can be reduced.

For example, according to Patent Document 1, when a user commands a process that requires a response time that is close to a natural language, the user's anxiety is not caused by feeding back the progress of the device to the user. This is an interactive operation support system. According to this, it is possible to easily operate the device without the user feeling uneasy based on the dialogue with the assistant appearing on the display.
JP 2002-41276 A

  On the other hand, the networking of devices has progressed, and various devices have started to have aspects such as multifunction devices having various functions as well as dedicated machines having a single function so far. For example, mobile phones are always carried and can be used at any time. In addition to simple phone functions, e-mail transmission / reception functions and photo shooting functions are also available. It comes to have a wide variety of functions, such as the function to output. Also, in the home, research on home servers that collect information in the home has been conducted, and according to this, in the home such as confirmation of the locked state from the operation of the air conditioner, confirmation of food stored in the refrigerator, etc. It is assumed that all devices can be operated from a single terminal.

  In order to operate a device having such a large number of functions, it is necessary to utter a command for specifying the function even if it is a voice command. For example, when operating an information terminal having functions such as a schedule management function and a TV program guide function, it is only a command such as “Tomorrow at 8:00?” That is a command for the schedule management function or a command for the TV program guide function. It is necessary to make the user utter a command to which a function name is added (such as “What is the schedule for tomorrow at 8:00?” Or “What is the TV program at tomorrow at 8:00?”).

  However, if the command length to be uttered by the user is lengthened, the content to be uttered by the user becomes complicated, and there is a high possibility that the user forgets the command. It is expected to occur.

  It is an object of the present invention to interactively operate a user operation on an information device having a large number of functions, without complicating a command issued by a user even on a device with a complicated operation. An object of the present invention is to provide an interactive operation support system capable of operating a device with an intuitive command.

  In order to achieve such an object, an interactive operation support system according to claim 1 of the present invention includes a display means, a character control means for generating a character image and presenting a character to the user via the display means, Speech recognition means, speech output means for synthesizing the words spoken by the character, and externally output via the speech output means, speech input means, and user's voice input via the speech input means Input speech recognition means, name storage means for storing character names individually associated with each function group of the composite device, and user words acquired by the input speech recognition means are stored in the name storage means. A function that determines whether or not the name of the character is included, and if so, selects the function corresponding to the character name from the multiple functions of the device Selection means and a central control means for selecting the function of the device via the function selection means according to the user's words acquired by the input voice recognition means, and determining the words and actions of the character based on the selected functions. It is an interactive operation support system characterized by doing.

  The interactive operation support system according to claim 2 is characterized in that the character control means generates a plurality of character images, and the plurality of character images appear simultaneously on the display means. It is.

  In the interactive operation support system according to claim 3, when the name of the character held by the name storage means is included in the user's words acquired by the input voice recognition means, the central control means The interactive operation support system is characterized by issuing a command to the character control means so as to change the action of the character corresponding to.

  The interactive operation support system according to claim 4 is characterized in that the central control means realizes a help function by the character by setting an explanation regarding the function corresponding to the name of the character as a word spoken by the character. Is an interactive operation support system.

  The interactive operation support system according to claim 5 further comprises name changing means for changing the correspondence between the name of the character held by the name storage means and the function group, and the character according to the user's preference. This is an interactive operation support system characterized in that the name of the user can be changed.

  With the above-described configuration, the interactive operation support system of the present invention can interactively operate user operations on information devices having a large number of functions. It is possible to operate the device by an intuitive command without complicating the command to be performed.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1)
FIG. 1 is a diagram showing an overall hardware configuration of an interactive operation support system according to an embodiment of the present invention. The system is configured as an information device equipped with, for example, a schedule management function, a TV program guide function, and an e-mail transmission / reception function. The interactive operation support system interacts with a character displayed on the display to Each function of the TV program guide function and the mail transmission / reception function can be provided. Hereinafter, each part will be described with reference to FIG.

  The central control unit 10 is a central processing unit that controls each unit of the interactive operation support system 1 according to various control programs and control data.

  The storage device 50 is capable of storing a large amount of data such as a magnetic disk and an optical disk. The storage device 50 stores a control program and control data for executing the interactive operation support system according to the present invention. Has been. Specific examples of the control program include an operating system OS program that comprehensively controls the entire interactive operation support system 1, a speech recognition program that converts speech data into character data, and a speech synthesis that converts character data into speech data. Program, character animation control program for controlling character expression and motion, character voice control program for controlling character utterance and voicing suppression, screen output control program for outputting character screen via display, speaker A voice output control program for outputting character voice, and a function selection program for switching a function desired by the user from a plurality of functions provided by the interactive operation support system. Specific examples of the control data include character image data for generating a character image, character animation data for generating a character's facial expression and motion animation, utterance content data defining what the character speaks, There is operation command data that defines operation commands to be input by voice.

  Further, in the case of being configured as an information device equipped with a schedule management function, a TV program guide function, and a mail transmission / reception function as in the interactive operation support system 1 as shown in FIG. As an example of a program, a schedule management control program for holding schedule data of a user and presenting the schedule data to the user via a display, TV program guide data from the program guide distribution server 70 via a wide area network 60 such as the Internet For example, a program guide data acquisition program for acquiring data, a mail transmission / reception program for transmitting / receiving mail via the mail server 80 connected by the wide area network 60, and the like. Examples of control data include calendar date data, user schedule data, program guide data acquired from the program guide distribution server 70, mail texts sent and received by the user in the past, and an address book in which mail destinations are recorded. Mail data, etc. are included.

  The display 40, such as a plasma display or a liquid crystal display, can present a character image to the user. In the example of the interactive operation support system 1 shown in FIG. 1, as an example of the contents displayed on the display 40, in addition to a character image, a television program guide, a user schedule list, a mail text, and the like are displayed.

  Furthermore, as shown in FIG. 2, the storage device 50 of the interactive operation support system 1 according to the present invention stores character name data in which character names and functions provided by the operation support system are associated one-to-one. keeping. As an example of the character name data, as shown in FIG. 2, “Nanako” with name ID number 0 is assigned as the character name corresponding to the TV program guide function with ID number 0, and the schedule with ID number 1 is assigned. A character name corresponding to the management function is assigned “Takafumi” with the name ID number 1 and a character name corresponding to the mail transmission / reception function with the ID number 2 is assigned “Takuya” with the name ID number 2. And so on.

  FIG. 3 is a functional block diagram showing the system configuration of the interactive operation support system 1 according to the embodiment of the present invention.

  As shown in FIG. 3, the interactive operation support system 1 includes a display means 101, a character control means 102, a voice output means 103, an output voice control means 104, a voice input means 105, and an input voice recognition means 106. And name storage means 107, function selection means 108, central control means 109, and name change means 110. In the example of FIG. 3, the TV program guide unit 201, the schedule management unit 202, and the mail transmission / reception unit 203 are further provided so that each function of the schedule management function, the TV program guide function, and the mail transmission / reception function is interactive. The operation support system can be provided, and each of these functions may be a means for realizing another function (for example, a video recording function).

  The display unit 101 displays a character that is a partner of a dialogue with the user when the user performs an interactive operation. Also, when each function provided by the interactive operation support system 1 presents information to the user, such as when the TV program guide unit 201 displays a TV program guide list or when the schedule management unit 202 displays a schedule list. Is also displayed by the display means 101. Specifically, the display device 40 corresponds to the display unit 101.

  The character control unit 102 generates a character image from the character image data and character animation data stored in advance, and presents the character to the user via the display unit 101. The character control means 102 is not limited to a single character image control according to an instruction from the central control means 109, and generates a plurality of character images at the same time or displays a plurality of character images simultaneously. Multi-character image control such as changing the motion is also performed. Specifically, the character control means 102 is configured by character image data and character animation data stored in the storage device 50 and arithmetic processing by the central control unit 10. More specifically, the character image data is a description of the three-dimensional shape of the character, and data such as vertex coordinates and colors constituting the character are held.

  The character animation data describes how the vertex coordinates that make up the character change with respect to the time axis, such as changes in the facial expression of the character (such as a happy face or a sad face) and mouth. Changes in shape (mouth shape when uttering “A”, mouth shape when uttering “I”, etc.) and character movement (raising hands, walking, etc.) as changes in vertex coordinates keeping. These character image data and character animation data are stored for a plurality of characters, and the central control means 109 designates a character to be drawn and an animation to be applied to the character, so that the character control means 102 has animation. Generate a character image.

  The voice output means 103 presents the words uttered by the character to the user as voice. Specifically, the speaker 20 corresponds.

  The output voice control unit 104 generates voice data for presenting utterance content data defining the content spoken by the character to the user as voice via the voice output unit 103. The output voice control means 104 generates not only monotonous voice data but also changed voice data, such as changing the speaking speed or changing the inflection of the voice according to the instruction of the central control means 109. Also do. Specifically, the output speech control means 104 is configured by character utterance content data stored in the storage device 50 and arithmetic processing by the central control unit 10. More specifically, a plurality of spoken contents of the character are stored in a text format, and voice data is generated from the utterance contents of the character selected by the central control means 109 using an existing speech synthesis method.

  The voice input means 105 acquires the voice spoken by the user as a voice input signal to the interactive operation support system. Specifically, the microphone 30 corresponds.

  The input voice recognition unit 106 converts the voice input signal acquired via the voice input unit 105 into a text format, and performs analysis processing of the content spoken by the user. Specifically, the input speech recognition unit 10 is configured by the speech recognition program stored in the storage device 50 and the arithmetic processing by the central control unit 10. More specifically, the speech recognition program not only performs so-called phoneme analysis (clarifies the relationship between sound and characters) but also morphological analysis (word and part of speech), which is well known as an existing natural language analysis method. It is also possible to use a technique for clarifying word form change and arrangement) and syntactic analysis (clarifying the relationship between groups of words and phrases).

  The name storage means 107 stores the names of characters associated with a plurality of functions provided by the interactive operation support system 1. Specifically, the character name stored in the storage device 50 corresponds, and the content is “Nanako with name ID number 0 as the character name corresponding to the TV program guide function with ID number 0, as shown in FIG. "Is assigned as a character name corresponding to the schedule management function with ID number 1 and" Takafumi "with ID number 1 is assigned as a character name corresponding to the mail transmission / reception function with ID number 2. For example, “Takuya” with name ID number 2 is assigned.

  The function selection means 108 determines whether or not the name of the character stored in the name storage means 107 is included in the content uttered by the user, and if it is included, the interactive operation support system 1 A function corresponding to the character name is selected from a plurality of provided functions. Specifically, the function selection means 108 is configured by the function selection program stored in the storage device 50 and the arithmetic processing by the central control unit 10.

  The central control unit 109 instructs the function selection unit 108 to select a function from the content of the user's utterance acquired by the input voice recognition unit 106, and activates the selected function among the functions provided by the interactive operation support system 1. . Also, based on the device operation commands held in advance, the device operation commands corresponding to the user's utterance content are extracted. Further, the action of the character is determined according to the contents of the operation command, and an instruction is given to the character control means 102 to change the character action. In addition, the content of the utterance of the character is determined according to the content of the operation command, and an instruction to create output audio data is issued to the output audio control means 104.

  FIG. 12 is a flowchart showing the overall flow of the operation of this embodiment.

  First, the content uttered by the user is input to the system as a voice input signal via the voice input means 105, and then the input voice recognition means 106 converts it into text-like utterance contents (S10). Next, the central control unit 109 instructs the function selection unit 108 to select a function corresponding to the user's utterance content from among a plurality of functions provided by the interactive operation support system 1. First, the selection means 108 determines whether or not the user's utterance content includes a name that matches the character name stored in the name storage means 107 (S20). YES), the function ID is stored in order to select the function corresponding to the name at that time (S30). Next, the central control unit 109 refers to a list of operation commands held in advance by the central control unit 109, and whether or not an operation command for the currently selected function is included in the content uttered by the user. Is determined (S40).

  FIG. 13 shows an example of a list of operation commands held by the central control means 109.

  This example shows a list of operation commands effective for each of the function ID numbers 0 to 2 (television program guide function, schedule management function, mail transmission / reception function). Specifically, the TV program guide function indicates that voice commands such as “when tomorrow at 9:00?”, “Show the list” and “recommended?” Are accepted as operation commands, and the mail transmission / reception function has “ This indicates that voice commands such as “Show mail” and “I want to send mail” are accepted. For ease of explanation, relatively long operation commands consisting of a plurality of clauses are listed here as examples. However, in practice, information on each morpheme necessary for natural language analysis is stored. In addition, an effective operation command is configured by a combination thereof. The central control unit 109 refers to the operation command list and determines whether or not the operation command accepted by the currently selected function ID is included in the utterance content. If an operation command is included (YES in S40), an instruction to execute the operation command is issued to the currently selected function (S50). Specifically, when the TV program guide function is currently selected, the TV program guide unit 201 is instructed to execute an operation command (listed, etc.) spoken by the user.

  Next, the central control means 109 selects an animation and utterance content corresponding to the operation command uttered by the user from the character animation data and utterance content data held in advance, and the character control means 102 and the output voice control means 104. On the other hand, by instructing the generation of the character image and the generation of the voice data, the character image and the voice are presented to the user (S60).

  In order to describe an actual operation example of the interactive operation support system 1 according to the embodiment of the present invention, a description will be given using a specific example with reference to the drawings.

  FIG. 4 is a diagram showing an example of a screen presented to the user by the display unit 101 immediately after starting the interactive operation support system 1 or when the device is in an idle state where no operation is performed.

  In this figure, three characters are displayed. This is because the interactive operation support system 1 according to the embodiment of the present invention provides three functions of a TV program guide function, a schedule management function, and a mail transmission / reception function. For this reason, the number of characters presented to the user may be increased or decreased by increasing or decreasing the number of functions provided by the interactive operation support system. In this figure, the size of the three characters displayed is substantially the same, but the character that the user speaks first may be induced by displaying only one specific character in a large size. Further, the character control means 102 holds the animation motion of the character in advance, and changes the character image based on the animation motion, so that each displayed character does not stand still but performs a proper motion. You may make it go.

  FIG. 5 shows an example of a screen presented to the user by the display means 101 when the user speaks “What is the name?” With the intention of knowing the name of the character, and is presented to the user by the voice output means 103. It is the figure which showed the audio | voice example.

  In this figure, when the user says “What is the name?”, The name of the character and the name of the function corresponding to the character name are spoken so that the plurality of characters presented on the display means 101 each introduce themselves. Is shown.

  Such a response is realized by the following processing. First, the content spoken by the user is input to the system as a voice input signal via the voice input means 105. The input voice recognition means 106 analyzes the voice input signal to acquire that the user's utterance content is “name is” (S10). Next, the central control unit 109 instructs the function selection unit 108 to select a function corresponding to the user's utterance content from among a plurality of functions provided by the interactive operation support system 1. The selection means 108 does not perform any processing because there is no character name matching “name is” (NO in S20). Next, the central control means 109 determines from the voice command list previously held by the central control means that the utterance “name is” is a command corresponding to “character self-introduction” (YES in S40). . Next, the central control means 109 refers to the character name held in the name storage means 107, acquires the name of each character and its function name (S50), and sends the character name to the output voice control means 104. And the function name are output by voice, and at the same time, the character control unit 102 is instructed to set an animation for making each character appear to speak. The output sound control means 104 and the character control means 102 generate character sound and image data, respectively, and present them to the user via the sound output means 103 and the display means 101 (S60).

  FIG. 6 is a diagram showing an example of a screen presented to the user by the display unit 101 and an example of a voice presented to the user by the audio output unit 103 when the user speaks the name of a certain character.

  In this figure, when the user says “Nanako”, which is the name of the character, the character named “Nanako” reacts to the user's call, and the function corresponding to the character is the “TV program guide function”. The figure which is showing to the user that it is is shown. Such a response is realized by the following processing.

  First, the content spoken by the user is input to the system as a voice input signal via the voice input means 105. The input voice recognition means 106 analyzes the voice input signal to acquire that the user's utterance content is “Nanako” (S10). Next, the central control unit 109 instructs the function selection unit 108 to select a function corresponding to the user's utterance content from among a plurality of functions provided by the interactive operation support system 1. The selection means 108 searches for a name that matches “Nanako” in the character names stored in the name storage means 107, and determines that the function that matches “Nanako” is the “TV program guide function”. Obtain (YES in S20). Next, the function selection means 108 stores the function ID “0” in order to switch to the TV program guide function (S30). Next, the central control unit 109 refers to a list of operation commands held in advance by the central control unit 109, and determines whether or not an operation command for the function with the function ID 0 is included in the contents spoken by the user. However, it is determined that the operation command is that the user's utterance content is only the name (YES in S40). Next, the central control means 109 determines that it is necessary to provide function guidance as a self-introduction of the character from the operation command of only the name (S50), and is in charge of the “TV program guide function” for the output audio control means 104 At the same time as outputting a certain sound, the character control means 102 is instructed to set an animation for making the character appear to be speaking. The output sound control means 104 and the character control means 102 generate character sound and image data, respectively, and present them to the user via the sound output means 103 and the display means 101 (S60).

  FIG. 7 shows a screen example presented to the user by the display unit 101 and a voice example presented to the user by the voice output unit 103 when the user continuously speaks the character name and the device operation command. FIG.

  In this figure, when the user utters the same operation command “when is 9:00 tomorrow?” Following each of the different character names “Nanako” and “Takashi”, “Nanako” who is in charge of the TV program guide function is When the same operation command is given, such as “Takashi” who presents the TV program from 9:00 tomorrow to the user and presents the schedule of the user at 9:00 tomorrow to the user. However, it is the figure which showed a mode that a different reaction for every character is shown to a user.

  Such a response is realized by the following processing. First, the voice “Nanako, 9 o'clock tomorrow?” Spoken by the user is input to the system as a voice input signal via the voice input means 105. The input speech recognition means 106 analyzes the speech input signal and acquires that the user's utterance content is “Nanako, 9am tomorrow?” (S10). Next, the central control unit 109 instructs the function selection unit 108 to select a function according to the user's utterance content. Next, the function selection unit 108 detects that “Nanako” that matches the name stored in the name storage unit 107 is included in the user's utterance content (YES in S20), and the function matches “Nanako”. In order to select a certain “television program guide function”, the function ID No. 0 is stored (S30). Next, the central control unit 109 refers to a list of operation commands held in advance by the central control unit 109, and determines whether or not an operation command for the function with the function ID 0 is included in the contents spoken by the user. Judgment is made and it is judged that the command is a coincidence command “Tomorrow at 9:00?” (YES in S40). Next, the central control unit 109 issues an operation command “Tomorrow at 9:00?” To the television program guide unit 201 corresponding to the function ID 0. The TV program guide 201 acquires program guide data for 9:00 tomorrow as an operation command corresponding to “when is 9:00 tomorrow?” (S50). Next, the central control unit 109 causes the output voice control unit 104 to output the program guide data from 9:00 tomorrow as a voice, and at the same time, causes the character control unit 102 to appear as if the character is speaking. Instruct to set animation. The output sound control means 104 and the character control means 102 generate character sound and image data, respectively, and present them to the user via the sound output means 103 and the display means 101 (S60).

  On the other hand, when the user generates “Takashi, 9 o'clock tomorrow?”, The function selection unit 108 selects the “schedule management function” corresponding to “Takashi” (S30). Issues an operation command “Tomorrow at 9:00?” To the schedule management means 202. The schedule management unit 202 acquires the user schedule for tomorrow at 9:00 as an operation command corresponding to “Tomorrow at 9:00?” (S50). Next, the central control unit 109 causes the output voice control unit 104 to output the user schedule from 9 o'clock tomorrow at the same time, and at the same time, an animation for making the character control unit 102 appear as if the character is speaking. Instruct to set. The output sound control means 104 and the character control means 102 generate character sound and image data, respectively, and present them to the user via the sound output means 103 and the display means 101 (S60). In this way, a different response for each character can be presented to the user in response to the same operation command “9:00 tomorrow”.

  FIG. 8 shows an example of a screen presented to the user by the display unit 101 when the user utters an operation command for adding a function name that the character is not in charge of following the character name, and the voice output unit 103. It is the figure which showed the audio | voice example shown to a user by.

  In this figure, the character name “Nanako”, who is in charge of the TV program guide function, is followed by an operation command such as “Please email”. It is the figure which showed a mode that two functions of a transmission / reception function were selected.

  Such a response is realized by the following processing. First, the content spoken by the user is input to the system as a voice input signal via the voice input means 105. The input voice recognition means 106 analyzes the voice input signal to acquire that the user's utterance content is “Nanako, please email” (S10). Next, the central control unit 109 instructs the function selection unit 108 to select a function according to the user's utterance content. Next, the function selection unit 108 detects that “Nanako” that matches the name stored in the name storage unit 107 is included in the user's utterance content (YES in S20), and the function matches “Nanako”. In order to select a certain “television program guide function”, the function ID No. 0 is stored (S30). Next, the central control means 109 detects that “Please mail” is not an operation command for the TV program guide function but an operation command for adding the mail transmission / reception function to the currently selected character (YES in S40). For the name list stored in the name storage means 107, the character name corresponding to the mail transmission / reception function is changed to “Nanako” (S50). Next, the central control unit 109 causes the output voice control unit 104 to output a voice indicating that the functions in charge of “Nanako” are the “TV program guide function” and the “mail transmission / reception function”, and at the same time, the character The control unit 102 is instructed to set an animation for making the character appear to speak. The output sound control means 104 and the character control means 102 generate character sound and image data, respectively, and present them to the user via the sound output means 103 and the display means 101 (S60).

  FIG. 9 shows an example of a screen presented to the user by the display means 101 when the user utters an operation command for changing the character name following the character name, and is presented to the user by the voice output means 103. It is the figure which showed the audio | voice example. This figure shows how the TV program guide function is selected by speaking “Nika” in the future by speaking the operation command “Change to Noka” after the character name “Nanako”. It is a figure. Such a response is realized by the following processing. The input voice recognition means 106 analyzes the voice input signal to acquire that the user's utterance content is “change Nanako to Norika” (S10). Next, the central control unit 109 instructs the function selection unit 108 to select a function according to the user's utterance content. Next, the function selection unit 108 detects that “Nanako” that matches the name stored in the name storage unit 107 is included in the user's utterance content (YES in S20), and the function matches “Nanako”. In order to select a certain “television program guide function”, the function ID No. 0 is stored (S30). Next, the central control means 109 detects that “change to Norika” is not an operation command for the TV program guide function but an operation command for changing the name of the character (YES in S40), and the name storage means 107 The name of “Nanako” is changed to “Nika” for the stored name list (S50). Next, the central control unit 109 changes the name of the character previously called “Nanako” to “Nika” to the output voice control unit 104, and the function of “Nika” is “TV program guide”. At the same time that the function is “voiced”, an instruction is given to the character control means 102 to set an animation for making the character appear as if it is speaking. The output sound control means 104 and the character control means 102 generate character sound and image data, respectively, and present them to the user via the sound output means 103 and the display means 101 (S60).

  The interactive operation support system according to the present invention can interactively operate a user operation on an information device having a large number of functions, and has a complicated command issued by a user even on a complicated operation device. The dialogue using the character agent that supports the user's operation on various home appliances and information devices with multiple functions, which has the effect of allowing the device to be operated with intuitive commands without having to It is useful as a mold operation support system.

The figure which shows the whole hardware structure of the interactive operation assistance system concerning the Example of this invention. The figure which shows an example of character name data The block diagram which shows the system configuration | structure of the interactive operation assistance system concerning the Example of this invention. The figure which showed the example of a screen display when an interactive operation support system is in an idle state The figure which showed the example of a screen display when giving an instruction to present a name to a character The figure which showed the example of a screen display when a user utters the name of a character The figure which showed the example of a screen display when operating a television program guidance function and a schedule management function via a plurality of characters The figure which showed the example of a screen display when operation which changed correspondence with a character name and a function was performed The figure which shows the example in which the character name data shown in FIG. 2 were changed by operation shown in FIG. A figure showing an example of the screen display when an operation to change the character name is performed The figure which shows the example in which the character name data shown in FIG. 2 were changed by operation shown in FIG. Flow chart showing the overall flow of operation support system Figure showing an example of the list of operation commands by function

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Interactive operation support system 10 Central control part 20 Speaker 30 Microphone 40 Display 50 Storage device 60 Network 70 Program schedule distribution server 80 Mail server 101 Display means 102 Character control means 103 Voice output means 104 Output voice control means 105 Voice input means 106 Input speech recognition means 107 Name storage means 108 Function selection means 109 Central control means 110 Name change means 201 Television program guide means 202 Schedule management means 203 Mail transmission / reception means

Claims (5)

An interactive operation support system that supports user operations on a composite device having a plurality of functions,
Display means;
A character control unit that generates a character image and presents the character to the user via the display unit; a voice output unit;
Output speech control means for synthesizing the words spoken by the character and outputting externally via the speech output means;
Voice input means;
Input voice recognition means for recognizing the voice of the user input via the voice input means;
Name storage means for storing names of characters individually associated with a plurality of functions of the composite device;
It is determined whether or not the name of the character held in the name storage means is included in the user's words acquired by the input voice recognition means, and if included, the name of the character from a plurality of functions of the device A function selection means for selecting a function corresponding to
A central control means for selecting a function of the device via the function selection means based on the user's words acquired by the input voice recognition means, and determining a character's words and actions based on the selected functions. Interactive operation support system characterized by The interactive operation support system according to claim 1, wherein the character control means generates a plurality of character images, and the plurality of character images appear simultaneously on the display means. When the user's words acquired by the input speech recognition means include the name of the character held by the name storage means, the central control means changes the action of the character corresponding to the character name. The interactive operation support system according to claim 1 or 2, wherein a command is issued to the character control means. The said central control means implement | achieves the help function by a character by setting the description regarding the function corresponding to the name of a character as a word which a character speaks, The claim 1 characterized by the above-mentioned. Interactive operation support system. Furthermore, it is provided with a name changing means for changing the correspondence between the name of the character held by the name storage means and the function group, and the name of the character can be changed according to the user's preference. 5. An interactive operation support system according to any one of claims 1 to 4.

Images