JPH03268157A - Interaction device - Google Patents

Abstract

PURPOSE:To enable a beginner and a skilled person to easily operate the device by displaying submenus hierarchically in order by an interaction means or setting data directly in an input field by a key input device. CONSTITUTION:The main menu interaction means DM of the interaction means 6 displays a menu for the specification of operation objects and operation contents first. Then the submenu interaction means DS of the interaction means 6 displays a lower-order menu for operating one item in the main menu in hierarchically every time the item is specified on a screen indication device 3. When a field where data input by the key input device 2 is enabled is set for the items of the menus, the interaction means 6 enables the data input by the key input device 2. Consequently, the beginner can know the operating method for the operation items by opening lower-order menus in order and the skilled person can set data directly in the input field, so the operability is improved.

Description

Detailed Description of the Invention [121 Aspects of the Invention] (Industrial Field of Application) The present invention provides a key input means, a screen display device, and a system capable of specifying and inputting arbitrary coordinates on the display screen of the screen display device. The present invention relates to an interactive device that is equipped with a screen instruction means and that inputs various information in an interactive manner with an operator.

(Prior art) Generally, computer systems are equipped with maintenance tools for various types of data storage and screen data, and human interfaces have been improved so that information with complex data structures can be edited in an easy-to-understand manner. It is being said. In addition, a thick operation manual can be stored in the computer system, and desired items of the operation manual can be displayed as a guide on a display window formed on the display screen of a CRT display device while the computer system is being operated. Some also have operating manuals available for reference.

For human interfaces, for example, we can replace operation menus with icons (pictograms) consisting of images that can easily identify the operation items, so that operators can intuitively identify the operation target, and By separating operations on selected objects, such as selection and data settings, into separate operations, you can easily decide what you want to do and how.
Efforts have been made to enable the operator's intentions to be input more clearly.

(Problems to be Solved by the Invention) However, such conventional techniques have the following disadvantages.

In other words, depending on the operation item, - degree selection operation []
There are some cases where it is difficult to express the target term L1 so that it can be specified, and in reality there are many such operation items, so it is possible to unify the operation model. However, there is a problem in that different operation environments are provided depending on the operation item.

In addition, the guide display, which allows you to check the contents of the operation manual on the CR1" display screen, allows you to randomly call up items that the operator requests to see. In any case, the operator needs to read the contents of the operation manual, which is composed of text, and when the operator operates with the intention of ``I want this setting to be done.'' However, the user is forced to interrupt that work and shift to the task of ``reading the manual,'' resulting in poor operability.

One possible solution to this inconvenience would be to include and display sufficient information to serve as an operation guide in the dialogue menu, but such an operation guide may not be useful information for beginners. However, it is unnecessary for experts, and there are problems in that the operation screen is wasted to display the operation guide, and it takes time to change the screen, resulting in poor operability.

In addition, by using encoded numerical values and increasing the weight of key input operations, it is possible to reduce the amount of input data, which improves the efficiency of data setting for operation items. Although this method is effective for experienced users, for beginners, it is necessary to refer to an operation manual or guide, which is rather time-consuming.

The present invention has been made in view of the above circumstances, and one object thereof is to provide a dialog device with good operability.

[Structure of the Invention] (Means for Solving the Problems) The present invention displays a menu for specifying an operation target and operation contents, and displays the menu at the top every time one item of the menu is specified by a screen instruction means. Hierarchically display lower-level menus for operating the eyes.If each menu item is set to Field 1, which allows data input using a key input means, data can be entered using a key input means. It is equipped with dialogue processing means.

(Function) Therefore, beginners can learn how to operate the operation items by sequentially opening the F menu, and
Since a skilled person directly sets and inputs data into the input fields 1 to 1, operability is improved.

(Embodiments) Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 shows an interactive device according to an embodiment of the present invention.

The display device 1 is, for example, a screen display device such as a CRT display device, and the input device 2 is for generating key input data, such as a keyboard device, for example.
The screen instruction device 3 is used to specify arbitrary coordinates on the display screen of the display device 1 and to perform selection operations on displayed figures.

The display control device 4 is used to output input data from the input device 2 and the screen instruction device 3 to the input means 5, and to form screen information to be displayed on the display device 1.

The input means 5 outputs the input data input from the display control device 4 to the dialogue means 6, and when the dialogue means 6 is set to enable key input, the input device F? A command for displaying the characters input from 1 at the current key input cursor position and moving the key input cursor position to the next character input position is output to the display means 7.

Further, when coordinate input is enabled by the interaction means 6, the input means 5 outputs a command to that effect to the display control device 4 via the display means 7. As a result, from then on, the display control device 4 moves the coordinate input cursor displayed on the screen of the display device 'lη1 according to the coordinates input from the screen instruction device 3, and the screen instruction device 3 notifies the selection operation. When the coordinate input cursor is deleted.

The interaction means 6 displays the main menu, determines the operation item of the main menu based on the key input data, coordinate data, and selection operation data inputted from the input means 5, and displays the sub menu corresponding to the item. It displays menus and sets data in fields (described later) set as operation items, and the display information is output to the display means 7, and the corresponding display is displayed on the screen of the display device 1. - to be done. In addition, the details of the operation are not shown in the figure.
The first place processing means is notified.

Further, the interaction means 6 displays a main menu and zero or more submenus, but the processing related to the display of each menu is executed by the main menu-interaction means DM and the sub-menu-interaction means DS as independent processes. do. In this case, the main menu-interaction means DS is positioned as the top-level process, and the upper-level process generates lower-level processes for displaying sub-menus as necessary, and the sub-menu-interaction means DS are placed in the order of generation. It is set in the lower process to define the hierarchical relationship of the entire menu.

In the following explanation, the menu displayed by the main menu display means I or the submenu generation means DS that generated the submenu dialogue means DS displaying a certain menu will be referred to as the parent menu of that menu. A menu whose parent menu is a certain menu is called a child menu of that parent menu.

An example of a menu displayed on the display device 1 by the interaction means 6 is shown in FIG.

In this case, when the "Main input data type" item of the main menu MM is selected, the submenu 8 old for operating that item is displayed, and the "main memory data" of the submenu 8 old is displayed. An item has been selected and a submenu St'12 for operating the item is displayed. Furthermore, “Data type J” in this submenu SM2
An item has been selected and a submenu SM3 for operating that item is displayed.

In this way, when you select an item on main menu H, a submenu for operating that item will be displayed as a child menu, and below, when you operate submenu item 1, a lower submenu will be displayed as a child menu. will be displayed as .

Further, at this time, in each field of the child menu, the contents obtained by converting the contents of the corresponding field 1 to value of the parent menu into the expression format of the child menu are set as default values.

Therefore, for unknown items, the operator can obtain information necessary for operation by sequentially displaying lower-level submenus.

In addition, for items in the main menu MM and submenu items in which a field for inputting symbol/numeric information is set, after selecting the item using the screen instruction device 3, Since the data can be directly manipulated using the software, operability for highly skilled operators is improved.

Now, the menu shows Figure 3 (a), (b),
As shown in (c), there are three types.

In the menu MNa, the contents of the operation items are set in the left column, and the field for inputting the title for the item is set in the right column, and the menu MNa is displayed at the top. The contents of the current operation item are displayed, and a completion box is formed to indicate that data entry into the field is complete.

Further, in this menu MNa, when an item [] is selected using the screen instruction device 3, a child menu corresponding to that item is displayed.

In the menu MNb, only the contents of the operation items are set, and the contents of the operation item displayed by the menu MNb are displayed at the top. Also, this menu MNb
Now, if you select an item using the screen instruction device 3,
A child menu corresponding to that item will be displayed.

In the menu MNc, the contents of the operation items are set in the right column, and a number indicating the order of the operation item in the menu is added to the left column. Further, at the top, the contents of the operation items displayed by the menu MNc are displayed.

In order to memorize the hierarchical structure of the menus being displayed, the dialog means 6 uses a menu level information guide to record the number of menus being displayed (see FIG. 4(a)), and the display position of each menu. Menu information (see FIG. 4(b)) is stored.

The value of the menu level information ML is set to "1" when only the main menu is displayed, and as shown in FIG. 2, the value of the menu level information ML is set to "1".

When 3M2 and 3M3 are displayed, the value is "
3”.

The menu information includes the X coordinate XLn of the lower left edge and the Y coordinate YLn of the lower left edge of each generated menu.
, the X coordinate XRn of the rightmost end, and the Y coordinate YRn of the rightmost end are stored in the order of menu generation.

In addition, for menus with fields for data input (menu MNa in Figure 3 (a)), the current field information CF (Figure 4 (C)) ), and
Field information for storing settings such as values for each field is formed.

The field information includes, for each field, the number of columns Wm of symbols/numeric data to be input, the field value Vm for which data is set in that field, and the result of evaluating the state of the field value Vm. The field value evaluation index Fm is stored. In the current field information CF,
In the field 1-information, information regarding Karen 1-field 1- is stored, and the order number is memorized.

Also, the display coordinates (X, Y) (lower left corner) of the child menu are:
It can be determined from the following formula (I).

X: XL-Xd-Xs, Y=YP-Ys
-(T) Here, XS, YS are the sizes of the menu to be displayed in the is the coordinate of the position, and the coordinate (
XL, YL) indicates the coordinates of the lower left corner of the parent menu (5th
(see figure).

In addition, submenu display means D8 for displaying a child menu
can obtain the coordinates of the lower left corner of the parent menu by referring to the menu level informant and selecting the menu information item.

Also, if the coordinates (X, Y) values are smaller than 0, the child menu will be displayed outside the display screen, so L
When the coordinates (x, y) determined based on the formula take a negative value, that value is forcibly set to O.

Note that if the value of the coordinate

FIG. 6 shows an example of processing when displaying menu MNa.

First, by using two consecutive methods, find the display position of the menu (process 101), display the menu, and set data ``1'' in Karen 1 to field information CF (process) 02). Set the item to the current field.

Next, the field value evaluation index F in the parent menu is "
If it is "normal", the default value is set as "Yes", the result of judgment 103 is YES), it is decomposed into the parameter display format in the own menu and set as field information, and the field value evaluation index F of all fields is set as ""normal" (processing 104).

Also, the field value evaluation index F in the parent menu is "
If it is abnormal, set the default value to “None” (
If the result of judgment 103 is NO), the field value V in the field information is initialized with a blank character, and the field value evaluation index F of all fields 1- is set to "abnormal".

Field 1 in the field information obtained in this way
The value ■ is displayed in a display color based on the field value evaluation index F (
For example, the color is yellow when normal, red when abnormal, etc.) and is displayed as a value in default 1.

At this time, write on the input means 5,
~Obtain the field value V and column number from the field information pointed to by the information CF, and make input requests with key input of more than the specified number of characters, return key, arrow key input, input, and coordinate data input as input termination conditions. The system waits for an event until it issues the key input data or coordinate input data (processing 106).

When the operator uses the input device 2 to input data that satisfies the input end condition, the input means 5 receives key input data or coordinate input data accompanying the data input.

Here, if the key input data is received (judgment 107
If the result of ``Yes''), the key person event processing for processing the inputted key person coordinate data is executed (process 108), and the process returns to process 106, and the coordinate input data is received (decision 1. If the result of step 07 is No), coordinate input event processing is executed to process the input coordinate input data (process 109).

In this coordinate input event processing, if it is determined as an operation outside the menu or an operation of the completion button (result of determination 110 is YES), it is a case of returning to the parent menu. here,
When the completion button is operated (the result of judgment 11.1 is No), the field value evaluation index [゛ is checked for all parameters in the field information, and if there is no abnormality in the data settings (the result of judgment 112 is NO), it is determined that "data setting exists" along with the set field value V (process 113), the dialog menu (submenu) displayed at that time is deleted (process 114), and the process returns to the parent menu.

In addition, in the case of an operation outside the menu (the result of the judgment in January is Y)
ES), irrespective of whether or not there is an abnormality in the data setting] 5 6 is set as "no data setting" (processing 115), the dialog menu is deleted, and the return is made to the parent menu (processing 1j4).

FIG. 7 shows an example of the coordinate process 1 to processing (process 109 in FIG. 6).

First, assuming that no key input was made, Karen]
- After redisplaying the field value V in the field information indicated by the field information CF in a normal color or abnormal color according to the contents of the field value evaluation index F and returning to the same contents (processing 20), input Based on the menu information, the display coordinates of each item, and the coordinates of the completion button, determine which area the coordinates correspond to using the following formula (11).
, (TIT), and (IV) for determination (processing 202).

XLj≦XP≦XRj or YLj≦YP≦vR”-(old
/VW≦m-(■)XP-Xl, j≧Xc?-J YP
-Y≧Yc = (IV) Here, j indicates the value of the old menu level information, Xu indicates the width of the menu item name (see Figure 3 (a)), and Vu indicates the value of one item on the menu. Indicates the height of the name, and nl indicates the number of fields.

That is, if the display position of the own menu set in the menu information is compared and the expression (n) does not hold, it can be determined that the operation is outside the target menu, such as an operation on the parent menu. In addition, if formula (m) holds true for the operation on the menu, the submenu calling operation, formula (
If the formula (IV) is established, the completion button is pressed and the formula (TI
), (III), and (TV), it is determined that the operation is thermal.

In addition, in the submenu calling operation, the term (m
- From the field number obtained from (YP-Ylj,)/Yw), the target field I can be identified d2 (result of judgment 203 is YES), so refer to the field value evaluation index F in the field information. If it is "normal" (the result of judgment 204 is YES), the default display is set along with the field value ■ (process 205), and if it is "abnormal" (the result of judgment 204 is No), there is no default display. (process 206), and calls the lower submenu dialogue means DS corresponding to the item (process 207).

If the status when returning from the lower submenu 1 interaction means DS is "data set" (result of judgment 208 is YES), the field value V is updated to field 1 information, and the field value is displayed on the display means 7. Output a display command to update the value V (process 209)
.

Also, data settings using the child menu are equivalent to data settings using the corresponding key input field, so the Karen 1-field should be placed in the field next to Field 1 where the data was set. If data has been set for the last field, the current field is set as the first field (determination 210, process 2], 1, 212).

Also, if the status when returning from the lower submenu-interaction means DS is "No data setting" (Judgment 20
If the result of step 8 is NO), it is assumed that an operation outside the menu has occurred, and the process returns to step 202 to re-evaluate whether the input coordinates are for the own menu.

An example of the key person process (process 108 in FIG. 6) is shown in FIG.

First, the validity of the key input data is evaluated by referring to the value of the field information CF and recognizing which item the data has been set to, and the field value ■ and The feel I/value evaluation index F is updated (process 301).

If the evaluation result is determined to be "normal" (result of judgment 302 is YES), display command 1 (for displaying the setting value of that item in normal color) is output to display means 7 (process 3o).
3).

Next, the content of the input end condition is determined, and if it is an input of an arrow key operation (result of determination 304 is YES).
), it is checked whether the key input cursor is located in the first field (decision 305), and when the result of determination 305 is YES, the current field information CF is checked.
Process 306) to update the current field to the final field by setting the value of the final field.
When the result of step 5 is NO, the value of the current field information CF is not decreased by one and the fields 1 to 1 are moved to the previous field (process 307).

In addition, if the input end condition is an operation other than the arrow key 90- input (the result of judgment 304 is No), check whether the key input cursor is located in the final field (judgment 308). When the result of judgment 308 is YES, the value of the first field is set in Karen 1 to field information CF, and the current field is updated to the first field (309). When the result of judgment 305 is No, the current field information is updated. The current field is moved to the next field by increasing the value of CF by one (processing 310).

On the other hand, if the evaluation result of the key input data is determined to be "abnormal" (the result of judgment 302 is NO), a display command for displaying the setting value of that item in an abnormal color is output to the display means 7. (Process 311). In this case, the key input cursor is not moved to Karen 1 where the key input cursor is located, but a key input to the same field is prompted.

FIG. 9 shows an example of processing when displaying menu MNb.

First, by the method described in 1-1, the display position of the menu is determined (process 401), and the menu is displayed (process 402).
).

Next, the field value evaluation index F in the parent menu is "
If the value is "normal", the default 1 value is judged as "present" (result of step 403 is YES), the parameter corresponding to the type included in the field value is extracted, and the current value is displayed as the default I value (processing 404). In addition, if the field value evaluation index F in the parent menu is "abnormal", the default I value is set to "absent" (judgment 403
If the result is NO), the default value will not be displayed.

Then, wait for the occurrence of a coordinate input event (process 405)
, when a coordinate input event occurs and coordinate data is input from the input means 5, it is determined whether or not the coordinates are in the area on the dialog menu currently being displayed, based on whether or not the following formula (V) is satisfied. .

1≦−(Yp−YLj)/Yen≦k (■) Here, k is the number of items described in Menu 2.

Furthermore, in the submenu calling operation, the selected item is determined based on the term (k-(Yp-YLi)) of the -Jz formula (V) (processing 406, judgment 407).

Next, if it is determined that the operation is invalid, the process returns to step 405 and waits for a valid operation to be input.

In addition, when it is determined that the submenu is ejected, it is determined whether the operated item matches the item displayed in the default display (judgment 408), and if the default 1 - term [1] is different, then (the result of judgment 408 is No), the field value given from the parent menu is
Therefore, if the operation item is the same as the default h display (processing 409), the result of judgment 408 is 'I'E.
S), in the same state, call the submenu-interaction means DS corresponding to "operation order 1" (process 410).

Then, if the status is "with data settings" or the status when returning from the submenu 1 dialogue method D8 (
After the result of judgment 411 (YFζS) is passed as the setting data for this menu to the dialogue lower stage of the parent menu (processing 4] 2), the dialogue menu is deleted (processing 413).

On the other hand, if the status is "1 data not set" (result of judgment 411 is No), it is assumed that an operation outside the menu has occurred, and the process moves to process 406 to re-evaluate whether the input coordinates are for the own menu.

In addition, in the case of operations outside the menu, "No data settings"
(process 414), returns to the parent menu, and proceeds to process 413.

FIG. 10 shows an example of processing when displaying menu MNc.

First, by using two consecutive methods, the display position of the menu is determined (processing 501), and the menu is displayed (processing 502).
).

Next, the field value evaluation index F in the parent menu is "
If the field value is "normal", the default value is set to "yes" (result of judgment 503 is YES), and the item corresponding to the field value is displayed as a default value (processing 504). Further, if the field value evaluation index F in the parent menu is "abnormal", the default value is set to "none" (the result of judgment 503 is NO), and the default 1-3 4 value is not displayed.

Then, wait for the occurrence of coordinate person Kaiben I- (process 505
), when a coordinate change occurs, the input position is checked (process 506) and it is determined whether the operation content is an invalid operation, a menu selection operation, or an off-menu operation. (Judgment 507).

At this time, if the formula (11) does not hold true, it can be determined that the operation is outside the menu, and if the formula (V) does not hold, it can be determined that the operation is invalid. Also, when selecting a menu,
- to formula (V) (71 terms (k-(YP-'VLj, ))
It is possible to determine which 11th item is the second tweet.

When it is determined that a menu selection has been made, the value is set as a field value, and the parent menu is returned to as "data setting" (process 508), and the dialog menu is deleted (process 509).

Further, when it is determined that the operation is outside the menu, the process 511) returns to the parent menu as "no data setting".
The process moves to process 509.

As described in 1- above, in this embodiment, if the operator sets data using the main menu MM by key input, the operator may not be able to understand the data setting format by key input, etc.
For example, if you do not understand the correspondence between the numerical values encoded in the main menu MMJ2 and their meanings, such as the display color red is ] and green is 2, by opening the submenu S Data settings can be made while maintaining the intention of what you want to do.

Here, the deeper the submenu SM becomes, the more limited the types of parameters that can be taken become, and in the end, only the item selection operation is required, but even beginners who are not familiar with the operation can understand what they want to do. If there is, you can configure data settings by opening the deepest submenu. Furthermore, as the user's level of proficiency in interactive operations increases, data settings can be made without having to open the lowest submenu, and flexible interactive operations can be performed depending on the user's level of proficiency.

Also, because the hierarchical submenus are not displayed in an overlapping manner, you may make the wrong selection or change your mind midway through the settings.
Even if you want to go back to setting other parameters, you can do so by directly selecting the second type of parent menu, which greatly improves usability.

``Effects of the Invention As explained above, according to the present invention, when an operator sets data, even if he or she does not know the correspondence between the encoded setting values and the meanings, By opening the iJ upper and lower menus, you can perform one operation, so your initial intention of ``what you want to do'' is not interrupted, and you can also directly set data. The effect is that optimal dialogue operations can be performed according to the user's proficiency level.

[Brief explanation of drawings]

Fig. 1 is a block diagram showing an interaction device according to an embodiment of the present invention, Fig. 2 is a schematic diagram showing an example of an interaction screen, and Figs. 3 (a) to (C) each show different types of menus. Schematic diagram, FIG. 4(a) is a schematic diagram showing an example of memory level information, FIG. 4(b) is a schematic diagram showing an example of menu information, and FIG. 4(c) is a schematic diagram showing an example of Karen 1 field information. FIG. 5 is a schematic diagram illustrating an example of field information; FIG. 5 is a schematic diagram illustrating the display position of a submenu; FIG. 6 is a flowchart 1-1 illustrating an example of menu display processing. , FIG. 7 is a flowchart 1-1 showing an example of the coordinate person Kaiben I process. FIG. 8 is a flowchart 1-1 showing an example of the key input event process, and FIG. 9 is another example of the menu display process. Flowchart 1, 10th
The figure shows flowcharts 1 to 3 showing still another example of the menu display process. 1...Display device, 2.Input device, 3.Screen instruction device, 4.Display control device, 5.Input means, 6.Interaction means,
7... Display means, DM... Main menu-interaction means, D
S...Submenu information.

Claims (1)

[Claims] In an interactive device that inputs various information in a dialog format with an operator, the device is equipped with a key input device, a screen display device, and a screen instruction device that can specify and input arbitrary coordinates on the display screen of the screen display device. In addition to displaying a menu for specifying the contents, each time one item of the menu is specified by the screen instruction means, lower menus for operating that item are displayed hierarchically. 1. An interaction device comprising an interaction processing means for inputting data using a key input means when a field in which data can be entered using the key input means is set.