JP2001075698A - Metaphor interface device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow even a user who does not have any special operation knowledge or technique to operate this device by providing a substitute processing mechanism visualized on a metaphor environment. SOLUTION: This metaphor interface device is provided with an inputting device 2 for detecting the input coordinate position of a user corresponding to a display device 1 and converting it into event data corresponding to the state of a metaphor environment, an operation substitute device 5 for receiving a substitute processing procedure, outputting event data equivalent to those obtained by the operation of the user and realizing the substitute executing function of the user operation, an event interpreting device 3 for receiving the event data, selectively executing the corresponding function from the function group, outputting the executed result, generating a substitute processing procedure corresponding to a certain operation at the time of receiving event data requesting the substitute execution of the operation and outputting it to the operation substitute means, and a metaphor environment generating device 4 for forming a new display screen expressing the executed result by using a metaphor and outputting the state of the new metaphor environment to the inputting device 2.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus, and more particularly, to the appearance and operation of an object existing in a physical world outside the computer so that a logical operation state inside the computer can be used by a user unfamiliar with operation. The present invention relates to a metaphor interface device that provides a metaphor environment that simulates the above.

[0002]

2. Description of the Related Art As a first prior art, in a conventional metaphor interface device using a window system for realizing a desktop metaphor, a screen display is easy for a user who has a certain knowledge of the operation, but a background knowledge is required. The user who does not have it is difficult to understand the meaning of the display. For example, in the metaphor interface device disclosed in JP-A-2-250113 or JP-A-4-288864, a window indicates an individual function or content when each application is focused on, and an icon is when the device itself is focused. A window for main input and output, and icons indicating the functions that can be provided and the processes being executed simultaneously are displayed on the same screen. In this case, no special meaning is given to the positional relationship on the display screen, and the user can distinguish between windows and icons by the difference in the display area and the meaning of the characters and figures drawn inside. It is necessary to memorize. Also, displaying objects from different viewpoints on the same screen confuses the inexperienced user's understanding.

As a second prior art, in a conventional metaphor interface device in which an explanation display for indicating a detailed meaning of an icon or the like which is an object on the metaphor environment is added to reduce the memory load of the user, for example, Kaiping 1
As shown in JP-173139A and JP-A-4-168482, information such as a keyword or a symbol is added to an icon, but it is effective for a user who can understand the added symbol or keyword. However, a user who has no prior knowledge has a burden of storing new keywords and symbols. In the case where a function explanation window as shown in JP-A-3-144719 is always displayed on a screen in a manual format, sufficient information is provided to the user, but reading the explanation itself is complicated. At the same time, the explanation display occupies a large screen area and hides the information of the operation target, thereby lowering the operation efficiency.

[0004] As a third prior art, RPG (roll
In a conventional metaphor interface device that simulates the scenes and events of the real world in everyday life, as represented by a playing game, the operation of the object that represents oneself in the metaphor environment becomes complicated and operation efficiency increases. Decrease. For example, "Map and Room" (5-169) described in the proceedings of the 46th National Convention of IPSJ
In pages 5 to 170, a network service is provided by a map or a city metaphor capable of expressing a spatial extent, but an object that expresses itself in the same way as in the real world is set on a road (moving) set in an operation environment. Possible route)
Therefore, an operation of moving to a destination (an application to be started) is required in accordance with the above, the operation becomes complicated, and the operation efficiency decreases.

As a fourth prior art, in a conventional metaphor interface device using a metaphor of a device or the like that a user uses daily, it is possible to understand the operation and display without performing special training or education. However, the functions that can be provided by the operation system of the conventional device applied as a metaphor are limited, and only functions and services equivalent to those of the conventional device can be provided. For example, JP-A-3-8
When using the metaphor of an existing device such as a TV set or a video as disclosed in Japanese Patent No. 4622 or Japanese Patent Application Laid-Open No. 4-52719, the operation and operation can be easily understood only by daily experience. It is difficult for the user to understand functions (such as screen editing) that are not available, and a service that fully demonstrates the functions of the metaphor interface device cannot be provided.

[0006]

In this conventional metaphor interface device, as shown in the first prior art,
In order for the user to distinguish between windows and icons, it is necessary to memorize the difference in display area and the meaning of characters and figures drawn inside, and display objects from different viewpoints on the same screen. However, there is a problem that the user is confused. Further, as shown in the second prior art, a user who does not have prior knowledge has a burden of storing new keywords and symbols for understanding additional information, and reading the added explanation itself is complicated. However, there is a problem that the operation display is reduced because the explanation display hides the information of the operation target. Further, as described in the third related art, there is a problem that operation of an object representing oneself in a metaphor environment is complicated and operation efficiency is reduced. Furthermore, as shown in the fourth prior art, there is a problem that the functions of the metaphor interface device cannot be sufficiently exhibited.

[0007]

The metaphor interface device of the present invention simulates the appearance and operation of an object existing in the external physical world in order to express the logical operation state inside the computer to the user in an easily understandable manner. In a metaphor interface device using a metaphor environment, a display means for performing two-dimensional display and a user input coordinate position corresponding to the display means are detected, and converted into event data corresponding to the state of the metaphor environment and output. Input means for generating and outputting event data requesting a proxy process when the user's input indicates a proxy process for an operation, and a proxy process procedure describing operation contents and operation conditions of the operation On behalf of the user operation by outputting the same event data as when the user operates under specified conditions Operation proxy means for realizing functions and event data that receives these event data, selectively executes the corresponding function from a group of functions prepared in advance, outputs the execution result, and requests proxy execution of a certain operation , An event interpreting means for generating a proxy processing procedure corresponding to the operation and outputting it to the operation proxy means, and a new display screen for receiving the execution result and expressing the execution result using a metaphor And a metaphor environment generating means for outputting the new metaphor environment state to the input means while outputting the generated metaphor environment state to the display means. Further, the metaphor interface device of the present invention is characterized in that the input means forms an integrated input / output means for realizing a direct operation together with the display means.

Further, the metaphor interface device of the present invention uses a metaphor environment simulating the appearance and operation of an object existing in the external physical world in order to express the logical operation state inside the computer to the user in an easily understandable manner. Display means for performing two-dimensional display, and integrated input / output correction writing force means for realizing a direct operation together with the display means, and detects a user input coordinate position corresponding to the display means. It receives input means for converting and outputting event data according to the state of the metaphor environment and proxy processing procedures describing the operation details and operation conditions of a certain operation, and is equivalent to the case where the user operates under the specified conditions Operation proxy means for realizing a proxy execution function of user operation by outputting various event data, and these event data Receive and execute the corresponding function selectively from a group of functions prepared in advance, output the execution result, and, when receiving event data requesting the proxy execution of a certain operation, proxy processing procedure corresponding to the operation And an event interpreting unit that outputs the execution result to the operation proxy unit, receives the execution result, forms a new display screen that expresses the execution result using a metaphor, and outputs the new display screen to the display unit. Metaphor environment generating means for outputting the state of the metaphor environment to the input means.

Further, the metaphor interface device of the present invention generates event data corresponding to data received from a communication line, outputs the event data to the event interpreting means, and receives the metaphor environment state output by the metaphor environment generating means. Communication control means for transmitting necessary data to a communication line, and means for performing bidirectional communication with another metaphor interface device connected via the communication line.

Also, in the metaphor interface device of the present invention, the event interpreting means may input event data from the input means or the operation proxy means, and request a proxy execution of an operation having the input event data. A proxy processing event determining means for determining whether or not the event data is input from the proxy processing event determining means when the determination is a request for proxy execution; A proxy processing procedure generating means for generating a processing procedure and outputting the processing data to the operation proxy means; and inputting the event data from the proxy processing event determining means when the determination is not a request for proxy execution, and executing a corresponding processing by an application program. And an object control means for executing and obtaining the execution result. The features.

Also, in the metaphor interface device according to the present invention, the metaphor environment generating means may include a metaphor rule storing means for storing a metaphor rule describing a metaphor rule, and the execution result input from the event interpreting means. A metaphor management means for reading the metaphor rule from the metaphor rule storage means and instructing a change of an operation state such as a display screen; an operation state determined and held according to an instruction of the metaphor management means; To output the operation state from the state storage device, read the display image from the screen data storage unit, and form and output a display screen. And display control means.

[0012]

According to the metaphor interface device of the present invention, the operating environment and the processing operation are expressed by using the metaphor simulating the scenery and the events of the real world such as the city, and the user can display the contents by using only the knowledge obtained on a daily basis. It can be understood and solves the first prior art problem without extra memory load or confusion.

[0013] Further, there is provided an operation proxy means for performing a complicated process which places a burden on the user, and this operation proxy means provides the service by fully exhibiting the functions of the metaphor interface apparatus. In addition to solving the problems of the prior art, it is possible to unify the operation systems of these provided services by operation proxy means.

Further, the operation proxy means is represented as a character on the world represented by the metaphor environment, and the processing is visualized as the movement of the character. Since the user can understand the outline of the operation in a shorter time than in the case of reading the message expressed by the following expression, the screen area occupied by the message display and the display time can be reduced. Solve the problem.

Further, by having an integrated input / output means which can be operated by the user without any special training or education, the user can directly operate the object on the screen independently of the processing of the operation proxy means. Thus, the problem of the third prior art is solved without lowering the operation efficiency due to having an object representing itself in the system.

[0016]

Next, the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a first embodiment of the present invention. In a metaphor interface device according to this embodiment, a display device 1 performs two-dimensional display. The input device 2 detects an input coordinate position corresponding to the display device 1 at the time of user input, converts the coordinate position into event data according to the state of the metaphor environment, and outputs the event data. Operation proxy device 5
Realizes a proxy execution function of a user operation by receiving a proxy processing procedure describing operation contents and operation conditions of a certain operation, and outputting event data equivalent to a case where the user operates under specified conditions. Event analysis device 3
Receives event data output from the input device 2 and the operation proxy device 5, selectively executes a corresponding function from a group of functions prepared in advance, and outputs the execution result. Further, when receiving the event data requesting the proxy execution of a certain operation, the event interpretation device 3 generates a proxy processing procedure corresponding to the operation and outputs it to the operation proxy device 5. The metaphor environment generation device 4 receives the execution result of the event interpretation device 3, forms a new display screen using a metaphor simulating real world scenes and events that the user can perceive in daily life, and outputs it to the display device 1. I do. Further, the metaphor environment generation device 4 outputs the state of the new metaphor environment to the input device 2.

Referring to FIG. 2, which shows an example of the event interpretation device 3. The proxy processing event determination device 11 is
And event data that is output from the operation proxy device 5, and determines whether the event data is a request for proxy execution of an operation. If the received event data is a request for proxy execution, , And selectively outputs the result to the proxy processing procedure generation device 12 and to the object control device 13 in other cases. Proxy processing procedure generator 1
2 receives the event data requesting the proxy execution of the operation from the proxy processing event discriminating apparatus 11, generates a proxy processing procedure describing the operation content and operation conditions of the corresponding operation, and outputs the generated proxy processing procedure to the operation proxy apparatus 5. The application program 14 is a group of programs describing processing contents corresponding to the event data. Object control device 13
Receives the event data from the proxy processing event determination device 11, acquires and executes the corresponding process from the application program 14, and outputs the execution result.

FIG. 3 shows an example of the metaphor environment generating device 4.
See The metaphor rule storage device 16 includes, for example,
The rules of the applied metaphor (corresponding to the physical laws in the real world), such as the character movement range and display method in the city metaphor composed of characters representing the operation environment and characters representing the proxy processing operation The described metaphor rule is stored. The metaphor environment management device 15
Receiving the execution result which is the output of the event interpretation device 3,
In accordance with the metaphor rule read from the metaphor rule storage device 16, the status holding device 17 is instructed to change the operation state of the display screen or the like. The state holding device 17 holds the current operation state and outputs the operation state to the input device 2 and the display control device 18. The state holding device 17 changes the operation state according to an instruction from the metaphor environment management device 15.
The screen data storage device 19 accumulates a display image of the applied metaphor, for example, a scene of a city or an appearance of a character in the city metaphor. Display control device 18
Receives the current operation state from the state holding device 17,
A necessary display image is read from the screen data storage device 19 to form a display screen, and is output to the display device 1.

Referring to FIG. 6, which shows an example of a display screen of the metaphor interface device according to the present invention, the operation world is expressed as a city metaphor. An object in the operation world is composed of a building icon for instructing activation of an application program, and a character for instructing a proxy operation and displaying its operation. The user
These objects can be operated by selecting (pointing operation) with the input device 2. When a building icon is selected, a corresponding application is activated and an application execution screen is displayed. During execution of the application, input to the application is performed by selecting an object such as a list or a soft button on the display screen. When the execution of the application is completed (e.g., by selecting an end button), the screen returns to the metaphor screen of the city before activation. Similarly, when a character is selected, a proxy processing instruction screen is displayed by selecting a soft button or a list. Thereafter, an object on the display screen is selected and a proxy processing instruction is performed. When the instruction of the proxy process is completed, the screen returns to the town metaphor screen. The proxy process instructed in this way is performed when the designated condition such as the reservation time is satisfied.
Execution starts. During the execution of the proxy process, a motion display such as the character on the screen visiting the building in the city is performed, and the state of selection and execution of the application is visually shown to the user. Furthermore, by selecting a character in motion, the details of the instruction and the execution status are displayed on the screen.

The operation of this embodiment will be described with reference to FIGS. 1, 2, 3 and 6. When the user selects a building icon in a state where the operation world (the metaphor screen of the city) as shown in FIG. 6 is displayed on the display device 1, the input device 2 detects input coordinates corresponding to the display device 1, Corresponding event data (application start request) is generated from the current state of the metaphor environment (the building icon is displayed at the input position). The object control device 13 receives the event data via the proxy process event determination device 11, selectively executes a corresponding process from the application program 14, and outputs an execution result (application start completion or the like). The metaphor environment management device 15 receives the execution result, obtains the rules (rules relating to application mobility) stored in the metaphor rule storage device 16, determines the corresponding screen display state, and stores the screen display state in the state holding device 17. To change (display the application startup screen). The state holding device 17 changes the operation state according to the instruction, and changes the new operation state to the input device 2 and the display control device 18.
Output to The display control device 18 reads a necessary display image (application start screen or the like) from the screen data storage device according to the new operation state, forms a display screen, and outputs the display screen to the display device 1. In this way, the application start screen is displayed as a result of the user selecting the building icon. Further, the input device 2 generates event data (such as an input to an application) from a coordinate position of a subsequent user input according to the received new operation state. This event data is similarly received by the object control device 13 and processed as input data during application execution. The result is compared with the metaphor rule in the metaphor environment management device 15,
The operation state (display screen etc.) of the state holding device 17 is changed. Further, the display on the display device 1 is changed via the display control device 18, and the event data subsequently generated by the input device 2 is also changed. When the user performs an input to terminate the application, the state holding device 1 is similarly operated.
7 is changed, and the screen returns to the town metaphor screen.

When the user selects a character on the street metaphor screen, the input device 2 generates event data (start of proxy processing instruction), and the object control device 13 activates an application for instructing the proxy device. This result is reflected on the display of the display device 1 via the state holding device 17 (a proxy processing instruction screen is displayed). After instructing the proxy process in the same manner as the application operation, when the user inputs the end of the instruction (such as selecting a soft button), the input device 2 generates event data indicating the end of the instruction together with event data indicating the end of the instruction. . The event data indicating the end of the instruction is transmitted to the proxy processing event determination device 11.
Is received by the object control device 13 and the operation state held by the state holding device 17 is changed, and the display returns to the street metaphor screen. The event data indicating the proxy processing request is output to the proxy processing procedure generation device 12 via the proxy processing event determination device 11. The proxy processing procedure generation device 12 receives the event data, generates a proxy processing procedure describing operation contents and operation conditions of the corresponding operation, and outputs the generated processing to the operation proxy device 5. The execution of the proxy process is realized by the operation proxy device 5 outputting the same event data to the event interpreting device 3 as in the case where the user operates according to the contents and conditions of the procedure given in this way. In the proxy process, the metaphor environment management device 15 receiving the processing result of the object control device 13
Instructs the state holding device 17 to change the character display state. The display control device 18 receives the changed operation state of the state holding device 17, changes the character display (image change, movement, etc.), and outputs it to the display device 1. In this way, the proxy execution function of the user operation is provided, and the execution state is visually shown to the user.

As described above, by providing the operation world unified by the metaphor of the city, it is easy to visually understand the execution contents of the application and the proxy processing, and the display contents and the display contents can be obtained only by the knowledge that the user can obtain daily. You can understand the operation. Furthermore, by providing a mechanism that performs processing that must be executed under specific conditions such as reservation processing and complex processing such as information search or editing on behalf of the user, special operation knowledge and technology are provided to the user. It is possible to provide a service fully utilizing the functions of the metaphor interface device without making a request. For example,
When collecting information on a certain product, complicated and complicated operations such as copying necessary information while starting various applications and recording the information in a memo pad application are required. By executing this as a proxy process using simple keywords such as product name and function (information collection etc.),
The load on the user is greatly reduced. Further, since the execution of the proxy processing is visualized as an operation in the operation world, the user can give an instruction while confirming the operation, and the reliability and efficiency of the operation are improved. Furthermore, even when the user does not know the method of collecting information, the user can understand the operation by giving an instruction as a proxy process and following the movement of the character on the screen. As described above, by using the manual as an operation manual, an educational effect for the user can be expected.

Referring to FIG. 4 showing a block diagram of a second embodiment of the present invention, the metaphor interface device of this embodiment is similar to that of FIG. 1 like a display and a touch panel mounted on the front surface of the display surface. Display device 1
And the input device 2 form an integrated input / output device 10 for realizing a direct operation. In this way, by realizing the direct operation, even a user who does not have a special operation technique can use the apparatus, and the education period for the user to use the apparatus is greatly reduced. In addition, the operation of selecting a character or the like only needs to touch an object on the screen with a finger or a pen, and the operation efficiency is higher than that of a conventional metaphor interface device in which a user operates an object representing himself in a metaphor environment. Is improved. Furthermore, compared to devices that indicate the relative movement direction and movement distance from the current coordinate position, such as a mouse and cursor keys, the time required for operation is greatly reduced, and moving objects that were difficult with a mouse or cursor keys Selection operation can be performed easily. For this reason, even if the character moves in the metaphor environment, the user can easily select (touch) the character, and the effect of visualizing the proxy operation is sufficiently exhibited without increasing the user's operation load. it can.

Referring to FIG. 5, which shows a block diagram of a third embodiment of the present invention, the metaphor interface device of this embodiment has a communication control device 6 in addition to the configuration of the embodiment of FIG.
Has a function of performing bidirectional communication with another metaphor interface device connected via a communication line. Data from another metaphor interface device is received by the communication control device 6 via a communication line, converted into corresponding event data, and output to the event interpretation device 3. The event interpretation device 3 selectively executes a corresponding function, and the metaphor environment generation device 4
A display screen using the metaphor is generated and displayed on the display device 1. In addition, the communication control device 6 receives the state of the metaphor environment from the metaphor environment generation device 4 and transmits necessary data to another metaphor interface device via a communication line. A connection request from another metaphor interface device is received by the communication control device 6 via a communication line,
Convert to event data. The event interpretation device 3 receives the event data and activates the communication application. The metaphor environment generation device 4 receives the execution result, generates a display screen using the metaphor, and displays a character representing a communication partner on the screen of the display device 1.
Further, the communication control device 6 receives the state of the metaphor environment from the metaphor environment generation device 4, generates communication start request data, and transmits the data to another metaphor interface device via a communication line. In this way, when two-way communication is established, the user can display information such as the name of the other party on the screen by selecting a character on the screen, and can start applications such as videophones with each other. It is. When complicated processing according to a specific procedure is required, for example, when information is provided in response to a request from a communication partner, event data from the communication control device 6
The operation proxy device 5 can perform an operation of a necessary procedure within a range predetermined by the user. When communication ends,
The display of the partner character disappears from the display 1 screen.

As described above, when the communication service is provided, by displaying the character representing the communication partner on the screen, the operation at the start of communication can be easily understood, and the communication between users can be facilitated. For example, it is possible to obtain prior information such as a name and purpose before starting communication between users such as a telephone, thereby supporting a shift to natural communication and appropriate correspondence of the user. Also, by realizing communication between characters (communication function between both proxy processing devices) by both proxy processing functions, it is possible to collect information without requiring user operation. For example, if collection of interesting information is instructed in advance as a proxy process, necessary information is automatically collected at the time of communication with another metaphor interface device. In addition, by designating in advance a user who wants to share information, information can be shared without the user performing operations such as information transfer. This reduces the load on the user,
Information exchange opportunities increase. Further, since the communication between the characters is visualized, the user can easily confirm and correct the processing content as needed. This makes it possible to realize efficient and highly reliable processing that accurately reflects the user's request.

[0027]

As described above, according to the metaphor interface device of the present invention, an operation proxy device for performing complicated operations on behalf of a user, and the contents of screen display and the operation of the device only with knowledge that the user can obtain daily. To provide a metaphor environment generation device that provides a metaphor environment whose state can be understood, an integrated input / output device whose operation is direct and easy to understand, and a communication control device that realizes bidirectional communication with another metaphor interface device. In addition, it is possible to provide a service fully utilizing the functions of the metaphor interface device in a unified operation system without requiring the user to have special operation knowledge or technology. As a result, there is no user confusion due to the complexity of the screen display and the operation system as compared with the conventional metaphor interface device. In addition, the memory load and the educational period of the user are greatly reduced, and the information communication service can be provided to a person who has not been able to use the service due to difficulty in operation. Furthermore, since the message is visually shown as movement information, the outline of the operation can be understood in a shorter time than when reading a text or the like, and the screen area occupied by the message and the display time are greatly reduced. In addition, there is an effect of user education. In addition, at the time of communication, it is possible to provide advance information with the same operability, and to facilitate communication and support a user's appropriate response. In addition, efficient and reliable proxy processing can be realized, and it is possible to increase opportunities for information exchange while reducing the operation load.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of the present invention.

FIG. 2 is a block diagram illustrating an example of an event interpretation device.

FIG. 3 is a block diagram illustrating an example of a metaphor environment generation device.

FIG. 4 is a block diagram showing a second embodiment of the present invention.

FIG. 5 is a block diagram showing a third embodiment of the present invention.

FIG. 6 is a diagram showing an example of a display screen of the metaphor interface device according to the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Display device 2 Input device 3 Event interpretation device 4 Metaphor environment generation device 5 Operation proxy device 6 Communication control device 10 Integrated input / output device 11 Proxy processing event discrimination device 12 Proxy processing procedure generation device 13 Object control device 14 Application program 15 Metaphor Environment management device 16 Metaphor rule storage device 17 State holding device 18 Display control device 19 Screen data storage device

Claims (6)

[Claims] 1. A metaphor interface device that uses a metaphor environment that simulates the appearance and operation of an object existing in an external physical world in order to express a logical operation state inside a computer to a user in an easy-to-understand manner. Display means for performing display; detecting a user input coordinate position corresponding to the display means, converting the data into event data corresponding to the state of the metaphor environment and outputting the event data, and instructing a proxy process for an operation having a user input In the case where the user performs an operation under specified conditions, it receives input means for generating and outputting event data requesting proxy processing, and a proxy processing procedure describing the operation details and operation conditions of a certain operation. Operation proxy means for realizing the proxy execution function of user operation by outputting event data equivalent to the case, and these event data , Selectively execute the corresponding function from a group of functions prepared in advance, output the execution result, and, when receiving event data requesting the execution of a certain operation by proxy, perform proxy processing corresponding to the operation. An event interpreting means for generating a procedure and outputting the result to the operation proxy means; receiving the execution result, forming a new display screen expressing the execution result using a metaphor and outputting the screen to the display means; A metaphor interface device comprising: a metaphor environment generation unit that outputs a new metaphor environment state to the input unit. 2. The metaphor interface device according to claim 1, wherein said input means forms an integrated input / output means for realizing a direct operation together with said display means. 3. A metaphor interface device using a metaphor environment that simulates the appearance and operation of an object existing in an external physical world in order to express a logical operation state inside a computer to a user in an easy-to-understand manner. A display means for performing display; and an integrated input / output correction writing force means for realizing a direct operation together with the display means, detecting a user's input coordinate position corresponding to the display means and responding to the state of the metaphor environment. Input means for converting and outputting event data, and proxy processing procedures describing the operation contents and operation conditions of a certain operation, and outputting the same event data as when the user operates under the specified conditions An operation proxy unit that implements a proxy execution function for user operations, receives these event data, and responds from a group of functions prepared in advance. Selectively executing a corresponding function, outputting an execution result thereof, and, when receiving event data requesting a proxy execution of a certain operation, generating a proxy processing procedure corresponding to the operation; Receiving the execution result, forming a new display screen that expresses the execution result using metaphor, outputting the new display screen to the display means, and inputting the new state of the metaphor environment to the input unit. And a metaphor environment generating means for outputting to the means. 4. Generating event data corresponding to data received from a communication line, outputting the generated event data to the event interpreting means, receiving a metaphor environment state output by the metaphor environment generating means, and transmitting necessary data to the communication line. 4. The communication device according to claim 1, further comprising communication control means for transmitting, and means for performing bidirectional communication with another metaphor interface device connected via a communication line.
3. The metaphor interface device according to claim 1. 5. A surrogate processing event discriminating means in which the event interpreting means receives event data from the input means or the operation surrogate means and judges whether the input event data requires a proxy execution of an operation. Means for inputting the event data from the proxy processing event determining means when the determination is a request for proxy execution, and generating a proxy processing procedure describing operation contents and operation conditions of a corresponding operation; A proxy processing procedure generating means for outputting to the means, and inputting the event data from the proxy processing event determining means when the determination is not a request for proxy execution, obtaining and executing a corresponding process from an application program, and executing 5. The method according to claim 1, further comprising an object control means for outputting a result. File interface device. 6. A metaphor rule storage means for storing metaphor rules describing metaphor rules, a metaphor rule storage means for inputting the execution result from the event interpretation means, and a metaphor rule storage means for storing the metaphor rule from the metaphor rule storage means. Metaphor management means for instructing the change of the operation status such as reading display screen, state holding means for determining and holding the operation state according to the instruction of the metaphor management means, and outputting the state of the metaphor environment to the input device, Screen data storage means for storing the display image of the metaphor;
5. A display control means for inputting the operation state from the state holding device, reading a display image from the screen data storage means, and forming and outputting a display screen. Or the metaphor interface device according to 5.