JPS63141121A - Vision applied interaction system - Google Patents

Abstract

PURPOSE:To perform interaction easy to be recognized by a user, by describing the interaction by using vision expression corresponding to the intention of the user, and also, applying conversion according to the syntax of a language used in an application processing from the description of the interaction. CONSTITUTION:The user selects vision information offered by an input means such as, for example, a mouse, etc., and inputs a retrieval request as shown on an interaction history display picture in figure from a hardware 18. In an example shown in figure, each item such as weather, retrieval execution, a city, and a data are selected as the retrieval request, and it corresponds to the intention of the user that is (desired to know the weather in Tokyo today). A vision interaction description generating part 12 generates the interaction description shown in figure from inputted vision information, and sends it to a retrieval language conversion part 13. The retrieval language conversion part 13 interprets the interaction description based on the character of each retrieval item and relation among retrieval items, and converts it to a retrieval language used in a retrieval processing.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention expresses information that is easy for users to understand in a system using a computer, and based on this,
This invention relates to a visual interaction method that allows input in any order.

[Conventional technology]

Traditionally, when interacting with a system using a computer, the user selects the most appropriate command from the system-provided language to express the intended task, and inputs it as text according to the syntax of the system-provided language. By doing so, it was done.

In this interactive method, the user is required to have knowledge about a huge number of commands, select an appropriate command from these commands, and input it according to the fixed syntax of the language provided by the system.

On the other hand, there is a method in which commands corresponding to tasks that the user will need are set in advance and presented as a menu in a way that the user can see. This method includes
Some menus are presented as text, while others are presented using visual representations called icons. According to this, it is possible to express expressions that correspond to the minimum necessary work, regardless of knowledge about commands. Furthermore, in a method of presenting menus using icons, the menu representation is easy for users to understand.

[Problem that the invention seeks to solve]

However, even in the above-mentioned method, only commands corresponding to the limited processes provided by the system are presented to the user as a menu, and the user must use the menu to input data according to the syntax of the language provided by the system. be. Therefore, when users express their intentions and input them into the system, they are limited in the generation of accurate descriptions and their syntax, and there is a problem in that they are unable to conduct dialogues that are appropriate to the characteristics of the users.

An object of the present invention is to solve the problems of the conventional methods and to provide an interactive method using visual information that is easy for individual users to understand and operate.

[Means for solving problems]

The visual application dialog method of the present invention presents the information that the user should input to the input/output hardware in a visual representation, and also uses the input/output hardware to specify the input that the user specifies based on the presented information. a visual dialogue description generation unit that generates a dialogue description based on information; and an application that interprets the dialogue description, syntaxizes it according to an application processing language used in the application processing unit, converts it into the application processing language, and then outputs it to the application processing unit. It is composed of a processing language conversion unit, and a control unit that controls the visual interaction description generation unit and the applied processing language conversion unit, and is characterized in that it is possible to input in a free procedure using visual expression.

[Effect]

The principle of the visual application interaction system according to the present invention will be explained below using the drawings. FIG. 1 is a functional block diagram of the present invention.

In FIG. 1, under the control of the control unit 1, the visual interaction description generation unit 2 first generates an interaction description in visual representation corresponding to the process that the user is trying to perform, and the to be presented.

The visual representation generated here includes an operation on the conceptual object of the user, an operation representing the user's concept, a description of the operation consisting of an operation that controls the above two types of operations, a description about the object of the operation, It corresponds to a description of a user's perspective regarding dialogue, as well as a description of a combination of operations, objects, and perspectives.

The user selects an expression suitable for his/her intention from among the visual expressions using a free syntax suitable for the user, and inputs the selected expression to the visual interaction description generation section 2 from the input/output hardware 5.

The visual interaction description generation unit 2 generates a corresponding interaction description from the input expression and sends it to the applied processing language conversion unit 3.

The application processing language conversion unit 3 converts the dialogue description sent from the visual dialogue description generation unit 2 into an application processing language based on the syntax of the application processing language used by the application processing unit 6, and sends it to the application processing unit 6. Output.

The input/output hardware 5 and the application processing section 6 are controlled by the interaction control section 4.

〔Example〕

Hereinafter, an embodiment of the visual application interaction system of the present invention will be described.

FIG. 2 is an example of an interactive screen of a system that performs weather information retrieval work using the visual application and interactive method of the present invention. In FIG. 2, the dialog screen is composed of, from the top, a dialog description presentation screen 1, a dialog description presentation screen 2, a dialog history display screen, and a search result display screen.

FIG. 3 is a block diagram of the search system. The visual interaction description generation unit 12 generates a visual description corresponding to the date, city, weather, temperature, search execution, etc. required for the weather information search operation from the interaction description presentation screen l of the output hardware 17. 2 to the user. The user selects the presented visual information using an input means such as a mouse, and inputs a search request as shown on the dialogue history display screen in FIG. 2 using the input hardware 18. The search request shown on the dialogue history display screen in Fig. 2 selects the following items: weather, search execution, and city date, and the user's request is “I want to know the weather in Tokyo today.”
It corresponds to the intention.

The visual interaction description generation unit 12 generates, from the input visual information,
Based on the correspondence between the visual information and the dialogue description, a corresponding dialogue description shown in FIG. 4 is generated, and this dialogue description is output to the search language conversion unit 13.

The search language conversion unit 13 interprets the dialog description based on the properties of each search item and the relationship between the search items, and converts it into a search language used in search processing.

The visual interaction description generation unit 12 and the search language conversion unit 13 are
Each is controlled by the control section 11. Also, output hardware 17. The input coverware 18 and the search processing section 16, which will be described later, are each controlled by the interaction control section 14.

A sentence consisting of the following items: date, city, weather or temperature, and search execution command is the minimum unit sentence in the search process of the system. Items included in the dialog description in FIG. 4 are date, city, weather, and search execution command, and this dialog description constitutes a minimum unit sentence. Further, specific values for dates and cities, and item names for weather are described as actual values for each item. Therefore, when the search language conversion unit 13 uses the date and city as conditions in the minimum unit sentence in the search process of the system, the above-mentioned dialogue description,
Interpret it as a search request to search for weather. Based on the interpretation, the search language conversion unit 13 converts the dialog description into a search language. In the conventional system, this search language is directly written by the user in the format shown in FIG. 5, for example.

The search language is output to the search processing section 16, and the search processing section 1
The search results in step 6 are displayed on the search result display screen by the output hardware 17.

〔Effect of the invention〕

As explained above, according to the visual applied dialogue method of the present invention, the dialogue is described using a visual expression that corresponds to the user's intention, and the dialogue description is converted according to the syntax of the language used in applied processing. By doing so, it becomes possible to conduct a dialogue that is easy for the user to understand and operate, and that is adapted to the characteristics of the user.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing the configuration of the visual application interaction system of the present invention, FIG. A block diagram of the system shown in FIG. 4 is a diagram showing an example of dialog description, and FIG. 5 is a diagram showing an example of a conventional search language. l, 11... Control unit 2.12... Visual interaction description generation unit 3... Application processing language conversion unit 4.14... Dialogue control unit 5... Input/output hardware 6 ... Application processing section 13 ... Search language conversion section 16 ... Search processing section

Claims (1)

[Claims] (1) The information that the user should input is presented to the input/output hardware in a visual representation, and based on the presented information, an interaction description is generated based on the input information specified by the user using the input/output hardware. a visual interaction description generation unit that interprets the interaction description, syntaxizes it according to an application processing language used in the application processing unit, converts it into an application processing language, and then outputs it to the application processing unit; A visual applied dialogue method comprising a control part for controlling the visual dialogue description generation part and an applied processing language conversion part, and capable of inputting in a free procedure using visual expression.