JPH0981352A - Method and device user interfacing applying display of human image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform the display that clearly instructs the information on the messages of a system, etc., by personifying and displaying the type and state of the task under execution via a task personification display means and also generating the human image actions in a text read-aloud mode. SOLUTION: When the personification display is instructed by the display control information 123, a task personification display control part 105 displays with personificatiry the type and state of the task under execution to a user via the human image actions. The part 105 also has an access to a personification display data base 106 using the task state information 120 to acquire a series of action patterns of a human image that defined the human image actions in response to the task and outputs the action patterns as the action control information 124. A message display part 108 generates and displays the image data 126 on the message window where the system information 122 is displayed and outputs the information 122 and the information 124 to generate the actions with which the human image points out the message window.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user interface of a computer system or a device incorporating a computer, and in particular, presenting a human image accompanied by motions and facial expressions to the user, and a dialog between the user and the device, and a computer. The present invention relates to a user interface method for displaying a state of a task executed on a device, a message of the device, and the like, and a device for displaying the same.

[0002]

2. Description of the Related Art In a conventional computer system or a device having a built-in computer, in order to inform a user of task execution information, character display by a text message,
There is a graphical display method using graphs and bitmaps. For example, in Japanese Patent Application No. 61-075571, "Operating state display method of arithmetic processing unit", a technique of notifying a user of a system state by a text message is disclosed.
There is also a technique of outputting voice data to output a message of the system. For example, a technique of outputting audio data in accordance with the output of an image is disclosed in “Image information generating device with audio” of HEI 3-282945. And
"Multimodal Response in Real-Time Spoken Dialogue System" (8th Symposium on Human Interface, pp.693-698,
In 1992), there was a technique for displaying an animation of a human figure in accordance with a voice dialogue between a user and a computer.

[0003]

When a user has a dialogue with a computer system or a device incorporating a computer, the characteristics and quality of the user interface, which is the dialogue portion, greatly affect the usability of the system and the entire device. By introducing human movements into this user interface,
It is expected to help intuitive understanding of the information presented in the system and improve the efficiency of the dialogue.

Conventionally, for example, a technique for displaying a network load, a CPU consumption amount of a process, and the like in a graph has been developed. However, although these techniques are suitable for transmitting information that can be expressed numerically such as system load and CPU consumption, there is a problem that it cannot be effectively expressed in the case of information that cannot be expressed numerically such as data retrieval and file transfer. . In addition, there is a problem that it is difficult to understand the graph or bitmap representation of the task information unless the numbers and figures are observed in detail. There is a technique for outputting a system message or the like by voice, but if only voice is output, there is a problem that the user feels strange. In addition, in the animation display technology of voice dialogue and human image, the situation of the voice response of the system is displayed by using the human image, but the contents of the dialogue, the type of task, or the internal state of the system cannot be effectively shown to the user. There's a problem.

An object of the present invention is to provide an interface method and apparatus for displaying a human figure, which effectively uses a personified display and voice synthesis in a user interface of a computer system to interact with a user and display system information. Is to provide.

[0006]

A user interface method for displaying a human figure according to the present invention is provided in a computer device or a device having a built-in computer for working while interacting with a user. A user interface method by a human figure display that provides a user interface using a computerized element, which controls an input device,
Receiving input from the user as a string,
Define the configuration information such as the name and attribute of the task instruction to be executed on the computer device, store the task information in the task instruction dictionary and control the dialogue with the user, and refer to the task instruction dictionary and input from the user Parse the generated character string, generate it as a task command, and output it, send the task command to the computer device, execute the task command, and inquire the computer device to check the status of the task being executed. A step of collecting task status information, task execution information as task result information, and messages generated by a computer as system information, outputting the information, and further outputting display control information defining the expression format of these information. And, in response to the task command, the type of motion of the human image used for anthropomorphic display and the motion information describing the motion of the human image are defined, and In order to display the type and execution state of the task instruction in the form of the motion and posture of the human figure by referring to the anthropomorphic display database according to the step of storing in the display database and the display control information and the task state information. And generating text motion of task result information into voice data according to the display control information and the task result information, and outputting and reading the text. And generating image data of a message window displaying the system information according to the display control information and the system information, and outputting the operation control information.
A step of generating and outputting motion control information for generating a motion of a human figure pointing to the window, and generating a video signal of the human figure motion according to the motion control information,
The output step includes the step of outputting the image signal of the person image motion and the image data of the message window to the output device.

Further, the interface device for displaying a human figure of the present invention is provided in a computer device or a device having a built-in computer which carries out work while interacting with a user, and uses an anthropomorphic element such as a motion of a human image. A user interface device for providing a user interface by displaying a human figure, which controls an input device, receives an input from a user as a character string, and an instruction name or attribute of a task executed by a computer device. Of the task instruction dictionary to be stored by controlling the configuration information of the user and the dialogue with the user, and by referring to the task instruction dictionary, the character string input by the user is analyzed and generated and output as the task instruction. The dialogue control unit and the task command are transmitted to the computer device,
The task execution unit that executes the task instruction and the computer are inquired, and the status of the task being executed is used as the task status information, the result of the task execution is used as the task result information, and the message generated by the computer is used as the system information. An information display control unit that collects, outputs, and further outputs display control information that defines the expression format of these information, and the type of motion of the person image used for anthropomorphic display in response to the task command, By defining motion information that describes the motion of a human figure,
In order to display the type and execution state of the task command in the form of the motion and posture of the human figure by referring to the stored anthropomorphic display database and the display control information and task state information and referring to the anthropomorphic display database. According to the task anthropomorphic display control unit that generates the operation control information, the text data of the task result information is synthesized with the voice data according to the display control information and the task result information, and is output to read the text. A text-to-speech section for generating motion control information for generating a motion, and for generating and outputting image data of a message window displaying the system information according to the display control information and the system information, and further pointing to the window. A message display unit for generating and outputting motion control information for generating a motion of a human figure; and the motion control According broadcast has to generate a video signal of a person image operation, a human image motion generating unit for outputting a video signal of a person image operation, a video output unit that outputs to the output device image data of the message window.

The text-to-speech unit decomposes the text data from the task result information into word units,
Based on the text analysis unit to output, and the words and phrases decomposed from the text, generate motion control information for generating a human figure motion corresponding to the text, and output the motion command generation unit and the motion of the human image. By defining the type, motion information that describes the motion of each part of the human figure, and the relationship between the motion type and the motion information, the stored motion pattern database is synchronized with the voice output of text and the motion of the human figure. It has a voice action synchronization control unit for controlling and a voice synthesizing unit for synthesizing text information into voice and outputting it.

Furthermore, the message display unit refers to the hand motion pattern database that stores motion information of each part of the hand corresponding to the motion type of the hand of the person image and the hand motion pattern database, and A motion generation unit that generates and outputs motion control information for generating a motion of an image hand, and a message window that generates image data of a message window that displays system information using the motion control information. And a generation unit.

[0010]

According to the present invention, by using a task personification display means, a person image motion generation means, a hand motion generation means, etc. At the same time as anthropomorphic display and text-to-speech output, generation of human figure action when reading text,
It is possible to display information such as system messages so that the person's image clearly points.

According to the present invention, the input of the user is analyzed, the character string of the analysis result is output as a task command by referring to the task command dictionary, and by executing the command, task status information, task result information, and system information. Is collected,
Display control information is generated. By combining this display control information and other information, refer to the anthropomorphic expression database,
Obtain operation control information for anthropomorphic display, text reading, and message display. In accordance with this operation control information, the operation image data of the person image is generated, and the operation image data of the person image and the image data of the message window are output together with the text reading voice.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a diagram showing an embodiment of a user interface device for displaying a human figure according to the present invention, and is a diagram showing a configuration of an embodiment of the first invention. Input control unit 100
Receives input from the user, converts it into a character string, and outputs it. The dialogue control unit 101 analyzes the user input sequence from the input control unit 100, refers to the task instruction dictionary 102 that defines the names and attributes of the task instructions, and outputs the task instruction 119. The task execution unit 103 sends the input task command 119 to the computer device and starts executing the task. After the execution of the task is started, the information display control unit 104 makes an inquiry to the computer device, and the data regarding the state of the task under execution is the task state information, the data regarding the result of the task execution is the task result information, and the computer device. Collects and outputs the message data of as the system information, and further this information. The display control information 123 that defines the expression format is generated and output. According to the display control information 123 and the task state information 121, the task anthropomorphic display control unit 105 corresponds to the task command and the type of action of the person image used for the anthropomorphic display and the action information describing the action of the person image. With reference to the anthropomorphic display database 106 that defines and stores, the operation control information 124 for displaying the type and execution state of the task command in the form of the motion and posture of the human figure is generated. Text-to-speech section 10
7 is task result information 12 according to the display control information 123.
The text data of No. 1 is synthesized with the voice data, output, and the motion control information 124 that defines the motion of the person image reading the text is generated. Message display unit 108
According to the display control information 123, the image data 126 of the message window displaying the system information 122.
Is generated and output, and motion control information 124 that generates a motion of a human figure pointing to the window is generated and output.
The person image motion generation unit 109 follows the motion control information 124
A video signal 125 of a person image is generated and output. Then, the video output unit 110 outputs the video signal 125 of the person image and the image data 126 of the message window to the output device.

Each part will be described in detail below.

The input control unit 100 will be described. When operating a computer device or a device with a built-in computer, a user uses a device such as a keyboard, a mouse, or a light pen to communicate with the computer device and input a command to the computer device. In the input control unit 100, the input of the user is converted into the form of a character string and output by using software called a device driver that controls these devices.

The task command dictionary 102 defines the types of tasks that can be recognized and executed by the system, and the types and number of necessary parameters corresponding to the tasks. For example, the task instruction dictionary 102 defines and stores data in the following format.

Number of task name parameters Type search> = 1 character help = 1 character guide = 0 None For example, the definition for the task name search in the first line is that the number of required parameters is one or more, and Indicates that the type is character.

The dialogue control unit 101 will be described. The dialogue control unit 101 analyzes the sentence sequence input by the user and determines the validity as a task command. For example,
If the user enters the string "search calculator", first the two strings "se
It is decomposed into "arch" and "calculator". The decomposed first character string "search" is the task name and the second character string "calculator"
Is a parameter. Based on the decomposed task name "search", the task instruction dictionary 102 is referenced to determine the validity of the input instruction. Determining the correctness of an instruction consists of whether the parsed task name exists, whether the number of parameters meets the required number of parameters, and whether the parameter type matches the defined type. Done by If the command is not valid, it is ignored and a new user input to the input control unit 100 is requested. If it is valid, the analyzed task name and parameter are output as the task instruction 119.

The task execution unit 103 will be described. The task execution unit 103 sends the task command 119 obtained from the dialogue control unit 101 to the computer device, and requests the start of task execution. Then, after the execution of the task is started, the information display control unit 1 requests the collection of the task status, the display request, and the like.
04.

The information display control unit 104 will be described.
After the execution of the task is started, the computer is inquired to obtain the information on the status of the task being executed. For example, the task status information 120 is output by collecting information such as whether the task is being executed or completed. Then, when the task ends, the execution result is acquired from the computer device and output as the task result information 121. In addition, the computer device may generate an error or a warning during the execution of the task. When a message such as an error or a warning occurs, the information display control unit 104 acquires these messages from the computer device and outputs them as the system information 122. Also, the display control information 123 that defines the format for displaying these data is generated. For example, if the task is still being executed, the display control information 123 is defined so as to perform an anthropomorphic display of the task. And the task is finished,
The display control information 123 is defined so that the text of the task result information is read aloud. Further, when the computer device generates a message such as an error or a warning, the system information 122
The display control information 123 is defined so as to output.

The task personification display control unit 105 will be described. When the display control information 123 instructs the anthropomorphic display of the task, the state and type of the task being executed can be displayed to the user in an anthropomorphic manner by using the action of the human figure. Taking the task of copying data on a computer as an example, an intuitive expression can be achieved by performing an operation in which a person image lifts an icon that is a graphic representing the data of the copy source and moves it to an icon that represents the copy destination. it can. If the icon representing the data is still in the middle of movement, it indicates that the copy is being executed, and when the target icon is reached, it can indicate that the task is completed.

The anthropomorphic expression database 106 will be described. The anthropomorphic expression database 106 defines and stores the correspondence between the motion pattern and the anthropomorphic display of task commands for generating a motion expression of a human figure and the motion pattern. The motion pattern is a pattern in which typical human motions are classified and classified. The operation pattern is described by an operation type and an operation parameter. The types of motions are classified into motions such as “nodling”, “raising hands”, and “lifting things”.
The motion parameters are the direction and amount of movement of each part of the human body,
It also defines the time of movement. Therefore, the motion pattern is a description of a human motion such as "move, left f 5". In this description, "move hand" is the type of action, "left" is the direction,
And "5" represents the degree of motion. Then, the series of motion patterns described above are associated with the task, and the motion of the person image can be generated by acquiring and generating the motion pattern. The task anthropomorphic display control unit 105 accesses the anthropomorphic display database 106 by using the task state information 120, acquires a series of motion patterns of a human image that defines the motion of the human image corresponding to the task, and performs the operation. It is output as the control information 124.
The text reading unit 107 will be described. According to the display control information 123, the task result information 121 is read aloud after the execution of the task is completed. The text reading unit 107
Task result information 1 output from the information display control unit 104
It has a function of synthesizing and outputting 21 text data by voice, and a function of generating motion control information 124 for generating motions and facial expressions of a human image while actually reading the text.

The message display unit 108 displays the system information 122 and the function of generating and outputting the image data 126 of the message window in which the system information 122 is displayed, and the message window and the system information 122 displayed on it. To bring attention to
It has a function of generating and outputting motion control information 124 for generating a motion in which a person image points a message window.

The person image motion generator 109 will be described. The person image generation unit 109 follows the operation control information 124
Generates an image of a human figure. In the inside of the person image generation unit 109, the person image data necessary for generating the video signal 125 is stored in association with the operation pattern forming the operation control information 124. It has a function of reading data and generating a video signal 125. For example, when a person image is displayed, the person image data is stored as information such as coordinate values or polygons in association with each operation pattern, and the person image data is stored in the operation pattern information of the operation control information 124. In accordance with this, the video signal 125 of the human image is sequentially read out.

The video output unit 110 will be described. The image signal 125 of the person image generated by the person image motion generation unit 109 or the image data 126 generated by the message display unit 108 is converted into a physical signal that can be displayed on an actual display device and displayed.

An embodiment of the second invention will be described. FIG. 2 shows an embodiment of the present invention. In the text-to-speech unit 107 of the first invention, when the display control information 123 specifies voice output of text, the text data from the task result information 121 is analyzed by the text analysis unit 201 and decomposed into word units. It is sent to each part.

Based on the words and phrases decomposed from the text data, the motion command generation unit 202 includes the motion type of the human image, the motion information describing the motion of each part of the human image, and the motion type and the motion information. By referring to the motion pattern database 203 that defines and stores the relationship, the motion control information 124 for generating the human figure motion corresponding to the text is generated and output. Then, the voice action synchronization control unit 204 controls the synchronization between the voice output of the text and the action of the person image. The speech synthesis unit 205 synthesizes text information into speech and outputs it.

Each part will be described in detail below.

The text analysis unit 201 will be described.
When the display control information 123 specifies voice output of text, the text of the task result information 121 is received, and the text is decomposed into words based on the delimiter of the text and output.

The operation command generator 202 will be described.
A series of motion patterns that define the motion of the human figure is generated corresponding to the words of the decomposed text. The motion patterns are divided into a group of head motion patterns corresponding to the head of a word and a group of other general motion patterns. That is, when a person image motion is generated for a certain phrase, first, the leading motion pattern is selected, and then the general motion pattern is selected. The motion patterns in the group of head motion patterns are composed of motion patterns that are generally found when starting speech, and the group of general motion patterns are composed of motion patterns that are often seen in the middle of a conversation.

The operation pattern database 203 will be described. The motion pattern database 203 defines and stores motion patterns and motion information thereof as described in the first embodiment of the invention. Further, a label indicating whether the motion pattern is the head motion pattern or the general motion pattern is attached, and the motion pattern moves to the next motion pattern (MPO) as shown in FIG. Groups (MP1, MP2, ...
MPn, called continuous operation pattern) is stored. Further, the operation pattern database 203 also stores time information regarding the time required to complete the operation of each operation pattern.

The generation of the motion control information 124, which is composed of a series of motion patterns that describe continuous motions of a human figure, for the words and phrases of the decomposed text will be described. First, one initial operation pattern is arbitrarily selected from the first operation pattern group of the operation pattern database 203 (for example, MP0 in FIG. 4 is selected), and the operation pattern group (MP1 after MP0 is selected. , M
One arbitrary operation pattern (for example, MP1) is selected from P2, ..., MPn). Like MP0,
A continuous operation pattern as shown in FIG. 4 is defined for MP1 as well, and one operation pattern is arbitrarily selected from the continuous operation patterns of MP1. In this way, the operation pattern can be repeatedly selected within the total time of the operation described below (time information for generating one operation pattern is stored in the operation pattern database 203). The sequence of motion patterns selected in this way is used as motion control information 124 for the person image motion generation unit 10
It is output to 9, and continuous motion generation of a human image is performed.

The voice operation synchronization control section 204 will be described. When performing an action while reading the text to the person image,
Consideration must be given to the synchronization of motion and voice. Here, based on the voice synthesis speed (the number of characters / second) of the text-to-speech synthesis unit 205, the number of characters of the text phrase can be used to calculate the total voice output time required for the voice synthesis output of the text.

Next, the determination of the operation start position will be described. The beginning of the phrase of the text or the fixed position of the phrase is set as the start position of the action generation. For example, when the length of the phrase is shorter than a certain number of characters (threshold of the number of characters), the beginning of the phrase is set as the operation start time. In this case, the total voice output time of the text is equal to the total movement time of the human figure. On the contrary, when the word / phrase is longer than this number of characters (threshold of the number of characters), the operation of the person image is started at a certain interval from the beginning of the word / phrase. In this case, the total time of the movement of the person image corresponds to a value obtained by subtracting the shifted interval from the total audio output time.
In this way, the motion generation and voice output start signals are respectively sent to the person image motion generation unit 109 and the text-to-speech synthesis unit 20.
By transmitting the result to 5, the synchronized output of the motion and the synthesized voice becomes possible.

The text-to-speech synthesizer 205 will be described. It is possible to output text data as voice by using a conventional rule voice synthesis method, like a human utterance. For example, first, voice waveform data corresponding to a word or a character in a text is prepared in a computer device. The synthesized text is decomposed into words or characters, and speech waveform data corresponding to the words or characters is obtained. The voice waveform data of each word or character is continuously output to a voice output device such as a speaker to synthesize text with voice.

An embodiment of the third invention will be described. FIG. 3 shows an embodiment of the present invention. In the message display unit 108 of the first invention, the hand motion generation unit 301 uses the system information 122 and the display control information 123 to store motion information of each part of the hand corresponding to the motion type of the hand of the human figure. Motion control information 1 for generating a motion of a hand of a person by referring to the motion pattern database 302
24 is generated and output. Message window generator 3
03 uses the data from the operation control information 124 to generate message window image data 126 for displaying the system information 122.

Each part will be described in detail below.

First, the hand movement pattern database 30
2 will be described. The motion of the hand of the person image is synthesized from the motion of the upper arm and the motion of the forearm. The movement of the upper arm can be generated by rotation around the shoulder, the movement of the forearm around the elbow, and the movement of the palm around the wrist. The hand movement pattern database 302 stores, as movement information, the angle of the rotational movement of the upper arm and the forearm, which corresponds to the hand movement pattern. For example, for the motion pattern of the hand "raise your left hand to the side,"
0, 30), forearm (15, 0, -20) ", specifically, the rotation data of the upper arm and the forearm are defined.
However, data such as "upper arm (0, 0, 30)"
With the shoulder of the person image as the origin, the direction connecting the left and right shoulders is the X axis, the direction facing the head is the Y axis, and the direction orthogonal to the front of the person image is the Z axis. X, Y, Z It represents the rotation angle of the upper arm with respect to the axis.

The hand motion generator 301 will be described.
When the system information 122 is displayed according to the display control information 123, the system information 122 can be effectively displayed to the user by moving the message window for displaying the system information 122 and the action of the person image pointing to it. it can. FIG. 5 shows an example in which the person's hand continuously operates to lift the message window from the lower part of the display device of the computer device.
Here, corresponding motion patterns are defined at several stages of starting, midway, and ending the hand motion, and the motion information of each hand motion pattern, that is, the hand motion pattern is defined from the hand motion pattern database 302. Get the rotation angle of each joint. The data of the motion pattern of the hand thus obtained is output as motion control information 124 to the person image motion generation unit 109 and the message window generation unit 303.

The message window generator 303 will be described. The position information for displaying the message window on the display is generated using the hand movement control borrowing information 124 output from the hand movement generation unit 301. Here, the position of the tip of the hand can be calculated based on the rotation angles of the upper arm and the forearm included in the motion data of the hand. For example,
FIG. 6 shows how the upper arm and the forearm of the hand rotate on the XY plane in the XYZ coordinate system, but the same calculation can be performed in the three-dimensional coordinate system. Points A, B, C
Indicate the positions of the shoulder, elbow and tip of the hand, respectively, and α1, α
Reference numerals 2 are rotation angles of the upper arm and the forearm with respect to the Z axis (data such as 30 and -20, which are z components of (0, 0, 30) and (15, 0, -20) described above). Since the lengths (wl, w2) of the upper arm and the forearm of the person image are determined, the position of the tip C of the hand can be easily calculated from the rotation angles α1 and α2 and the lengths wl and w2 of the upper arm and the forearm. When the calculated tip position of the hand is set as the upper left corner position of the message window, and the horizontal and vertical lengths of the window are set to constant values, the message window can be uniquely determined. The system information 122 and the message window are generated and output to the image data 126 by using a character output routine or a drawing routine for a graphic of the computer.

[0040]

As described above, the user interface device for displaying a human image provided by the present invention intuitively displays the type and status of the task executed on the computer device by the operation of the human image, and Simultaneously with the text-to-speech output of text, it is possible to generate the action of the human figure when reading the text, and to display information such as system messages so that the human figure clearly points, which is effective and Comfortable device operability is realized.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a user interface device for displaying a person image according to an embodiment of the first invention.

FIG. 2 is a configuration diagram of a user interface device for displaying a person image according to an embodiment of the second invention.

FIG. 3 is a configuration diagram of a user interface device for displaying a person image according to an embodiment of the third invention.

FIG. 4 is a diagram showing an example of a structure of an operation pattern and its continuous operation pattern.

FIG. 5 is a diagram showing an example of display of a message window and movement of a hand.

FIG. 6 is a diagram showing an example of calculating the tip position of the hand from the rotation angles of the upper arm and the forearm of the hand.

[Explanation of reference numerals] 100 input control unit 101 dialogue control unit 102 task command dictionary 103 task execution unit 104 information display control unit 105 task anthropomorphic display control unit 106 anthropomorphic display database 107 text reading unit 108 message display unit 109 person image action Generation unit 110 Video output unit 119 Task command 120 Task status information 121 Task result information 122 System information 123 Display control information 124 Motion control information 125 Video signal 126 Image data 201 Text analysis unit 202 Motion command generation unit 203 Motion pattern database 204 Voice motion Synchronization control unit 205 Speech synthesis unit 301 Hand motion generation unit 302 Hand motion pattern database 303 Message window generation unit

Claims (4)

[Claims] 1. A user interface by a human figure display provided in a computer device or a device having a built-in computer for performing work while interacting with a user, and providing a user interface using an anthropomorphic element such as movement of a human image. A method for controlling an input device, receiving input from a user as a character string, and defining configuration information such as an instruction name and attributes of a task executed on a computer, and storing it in a task instruction dictionary. Controlling the step and the interaction with the user, referring to the task instruction dictionary, analyzing the character string input by the user, generating as a task instruction, outputting, and transmitting the task instruction to the computer device. , The step of executing the task instruction, and the computer device is inquired, and the state of the task being executed is used as the task state information. Corresponding to the task command, the step of collecting the output of the execution result as the task result information, the message generated by the computer as the system information, and outputting the display control information that defines the expression format of these information. A type of motion of a person image used for anthropomorphic display and a step of defining motion information describing the motion of the human image and storing the motion information in an anthropomorphic display database, according to the display control information and task state information, Referring to the anthropomorphic display database, generating operation control information for displaying the type and execution state of the task instruction in the form of the movement and posture of the human image, and according to the display control information and the task result information. , Text data of task result information is synthesized with voice data, output, and motion for generating the motion of a human figure that reads the text aloud. Generating control information, generating image data of a message window displaying the system information according to the display control information and the system information, outputting the image data, and further generating an action of a human figure pointing to the window. Generating and outputting motion control information, generating and outputting a video signal of a human figure motion according to the motion control information, outputting a video signal of a human image motion, and outputting image data of a message window A user interface method for displaying a person image, the method including: outputting to a device. 2. A user interface with a human figure display provided in a computer device or a device having a built-in computer for performing work while interacting with a user, and providing a user interface using an anthropomorphic element such as a motion of a human image. A device that controls input devices, receives input from the user as a character string, and a task instruction that defines and stores configuration information such as the name and attribute of the task instruction executed by the computer. A dialogue control unit that controls a dialogue between a dictionary and a user, refers to the task instruction dictionary, analyzes a character string input by the user, generates a task instruction, and outputs the task instruction, and a task instruction to a computer device. Inquires of the task execution unit that sends and executes the task instruction and the computer device, and sets the status of the task being executed as task status information, and An information display control unit that collects and outputs the message generated by the computer as system information, and outputs the display control information that defines the expression format of these information, and the task instruction. Corresponding to, the type of motion of the person image used for anthropomorphic display, define the motion information that describes the motion of the human image, stored anthropomorphic display database, according to the display control information and task state information, A task anthropomorphic display control unit for generating operation control information for displaying the type and execution state of a task instruction in a form such as a motion and posture of a human image by referring to the anthropomorphic display database; According to the information and the task result information, the text data of the task result information is combined with the voice data and output, and the action of the person image to read the text is generated. A text-to-speech unit for generating operation control information for generating a message window image data for displaying the system information according to the display control information and the system information, and further outputting an image of a person pointing to the window. And a message display unit for generating and outputting motion control information for generating a motion image, and a human image motion generating unit for generating and outputting a video signal of a human image motion according to the motion control information, A user interface device for displaying a human image, which has a video signal and a video output section for outputting image data of a message window to an output device. 3. The text reading unit decomposes the text data from the task result information into word units, and outputs the text analysis unit, and a person image corresponding to the text based on the words decomposed from the text. A motion command generation unit that generates and outputs motion control information for generating a motion, motion type of a human image, motion information that describes the motion of each part of the human image, motion type and motion information And a stored action pattern database, a voice action synchronization control unit that controls the synchronization between the voice output of text and the action of a human figure, and a voice synthesis unit that synthesizes text information into voice and outputs it. The user interface device according to claim 2, further comprising: 4. The message display unit refers to a hand motion pattern database that stores motion information of each part of the hand corresponding to a motion type of a human image Motion control information to generate and output the motion control information for generating the hand motion, and message window generation that generates the image data of the message window that displays the system information using the motion control information. The user interface device according to claim 2, further comprising a section.