JPH0342713A - User interface system - Google Patents

Abstract

PURPOSE:To improve the operability of the selection of a command by obtaining information related on directivity from coordinate information on a starting point and a terminating point, and permitting a processing function to correspond to information on directivity so as to start the function. CONSTITUTION:A pointer P on a display screen 51 is moved by using a pointing device and a starting point C1 and a terminating point C2 are designated. A processor recognizes a moving direction from the starting point C1 and the terminating point C2 and executes the functions which is previously allocated in correspondence with the moving direction, the deletion and shift of a character and a picture, and the selection of various modes, for example.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to a user interface method, and particularly to a user interface method for an information processing device that has a predetermined coordinate system and performs information processing according to input coordinate information. It is something.

[Prior Art] Personal computers, workstations, word processors, CAD. Various information processing systems such as CAM dedicated machines process text, images, and other information.

Currently, in this type of information processing system, a display such as a CRT, a keyboard, or a pointing device such as a mouse is used as a user interface means.

In the old days, character terminals such as teletypes were used as terminals for computer systems, so even in information processing systems that use displays, there was no way to simply input character strings from the keyboard to input commands or determine the processing mode. It was used.

However, at present, various functions can be selected by displaying a pop-up (or pull-down) menu or icon on the display and selecting it with a pointing device such as a mouse in order to select functions such as commands and processing modes. User interface methods are now being used.

FIG. 9 shows an example of a menu used in such a user interface method. The foul-mouthed menu M is
It pops up or pulls down on both sides of the display in response to the operation of keys on a keyboard or pointing device, etc., and multiple areas M1.
It is divided into M2-...Mn, and within these areas there are functions (commands (text, various data such as images, copying, deletion, and other editing of the file) that are selected by inputting characters etc. into the division). , Mo1-), etc. are displayed.

Area M1 of menu M. The spatial information + (li (coordinates, size, etc.) on the display screen of M2-...Mn is recognized by an interface control means such as a microprocessor, and if any When the pointer P is moved by the pointing device and a button on the pointing device is operated at that position, the interface control means selects the function (command, mode, etc.) and performs the corresponding process.

When selecting an icon, a display section representing a menu or information file is similarly set on the display, and by moving the pointer inside the section or operating a key, the icon or a command, mode, etc. corresponding to the icon is selected.

Note that to move the pointer, not only a mouse but also a track pole, keyboard cursor keys, joystick, digitizer, etc. are used.

[Problems to be Solved by the Invention] With the menu-driven or icon-driven user interface method described above, functions can be easily and quickly selected without requiring complicated character input.

On the other hand, in such a user interface method, a display occupies a large position.

That is, the operation of selecting a menu or icon is nothing but an operation of selecting the position of a pointer moved by a pointing device on a display screen at a lower processing level of the system.

Therefore, the user must constantly visually confirm the position of the pointer while pulling down or popping up the menu, and must also select an entry or icon within the menu, which results in overuse of the user's vision and fatigue. The problem is that the degree is large.

For example, in a one-sided menu system as shown in FIG.
．． Move the pointer P while checking the character display in M2,
You must confirm that the pointer is within the desired area before entering keys or operating buttons.

In addition, the menu is usually displayed extending downward from the pointer position where you selected the menu display.
Long menus require the pointing device to be moved a considerable distance before selecting the desired function. During this time, the visual confirmation described above must be performed, so selecting a menu with many entries can be quite troublesome.

In order to avoid the above-mentioned problems, a technique is known in which, for example, one of the menu functions corresponds to a predetermined key operation, so that the function can be selected by pressing that key. In this case, the operability will not be much different from the conventional method driven by string commands.

As described above, in the conventional menu-driven or icon-driven user interface system, the above-mentioned problems arise due to the principle of inputting information based on position information of a pointer on a display.

An object of the present invention is to provide a system that (ii) enables a more efficient user interface by considering the following problems and selecting functions using information other than position information on a display as a medium. It is in.

[Means for Solving the Problems] In order to solve the above problems, the present invention provides a 1111 report processing device that has a predetermined coordinate system and performs information processing according to input coordinate information. In the user interface method, means for inputting coordinate information of a start point and an end point in the predetermined coordinate system, means for forming information related to directionality in the coordinate system from the coordinate information of the start point and end point, and means for storing information relating to directionality in association with different information processing functions, and referring to said storage means in accordance with information relating to directionality formed by said information forming means, and associating said information with information relating to said directionality; The configuration includes a control means for executing predetermined information processing functions.

[Operation] According to the above configuration, the user is allowed to input the coordinates of the starting point and the ending point in the predetermined coordinate system, and the predetermined information section P1! is calculated from the coordinate information of the starting point and the ending point. Information related to directionality associated with a function can be input, and various information processing functions can be executed based on this directionality information.

[Example] Hereinafter, the present invention will be described in detail based on the example shown in the drawings.

FIG. 1(A) shows the configuration of an apparatus that employs the user interface system of the present invention. The configuration shown here is common to various information processing devices such as personal computers, CAD, CAM systems, and word processors.

In the figure, reference numeral 1 denotes a CPU composed of a microprocessor or the like, which is connected to various circuit members shown around it via an address bus, a data bus, or an interface circuit (not shown). Each component connected to the CPUI will be explained below.

First, the ROM2 is used to store control procedures for the CPU'1. Part or all of the control program described below may be stored in this R'OM 2, or the RO
M2 may be provided with only a program for loading a control program, which will be described later, or a program such as an operating system from an external storage device (not shown).

The RAM3 is used as a work area for the CPUI, and when a program to be described later is loaded from an external storage device, it is placed in the memory space of the RAM3.

The operation unit 4, display 5, and pointing device 6 are used as user interface means. The operation unit 4 is a keyboard with a JIS layout, etc., and the display 5 is a CRT display or L
It consists of CD panels, etc.

Further, the pointing device 6 is used to control a cursor or pointer displayed on the display 5, and is composed of a mouse, joystick, trackball, digitizer pad, or the like. Further, a cursor key, numeric keypad, etc. of the operation unit 4 may be used as the pointing device 6.

FIG. 1(B) shows the simplest model of the user interface system according to the present invention. In FIG. 1(B), reference numeral 51 indicates screen 0 of the display 5 (or a display area such as a window set on the screen).

In this embodiment, the pointing device 6 is used to select various functions of the apparatus, and this function selection is made by moving the pointer P displayed on the display screen 51 of the display 5 using the pointing device 6, and changing the direction of movement. Select the desired function.

Predetermined processing functions are assigned in advance to a plurality of moving directions of the pointer P. A plurality of moving directions and predetermined processing functions are stored in a predetermined storage area of the ROM 2 or RAM 3 in the form of a table or the like, and the function to be executed is selected by inputting the detected moving direction information into this table.

Usually, such a pointer P is used as a pointing device 6
In the method of moving the pointing device 6 and the moving direction of the pointer P, the moving direction of the pointing device 6 and the moving direction of the pointer P are controlled l:l, so the above function selection process is, in other words, a function selection based on the movement or operation direction of the pointing device 6. It's none other than 1.

Here, we will consider a comparison with the conventional technology.

For example, in the case of a conventional pop-up or pull-down menu, the pointer is moved to a predetermined position on the pop-up or pull-down menu to perform a predetermined input. Function selection is performed depending on the pointer position. In contrast, in this embodiment, function selection is performed depending on the direction of movement of the pointer on the screen. As mentioned above, in traditional pointer position-dependent feature selection,
While it is essential for the user to watch the screen, the function selection dependent on the direction of pointer movement in this embodiment does not necessarily require the user to watch the screen.

Hereinafter, the above user interface control will be explained in detail in order from the simplest control example.

FIG. 2 shows a flowchart 2 of a model of the simplest IQ CPU control procedure for selecting functions based on the direction of pointer movement as shown in FIG. 1(B).

The illustrated routines include image processing, character processing, and other CP
This is a subroutine that is executed at a predetermined timing while the UI is being controlled.

In step S21 in FIG. 2, the moving direction of the pointing device 6 is detected as a direction selection made by the user. This detection process is performed via an interface means not shown in FIG. 1(A). To obtain the operation information of the pointing device 6, a known system call prepared by a known operating system or the like is used.

At this time, the CPU 1 moves the pointer P on the display screen 51 of the display 5 by the same amount in the same direction at the same time as the pointing device 6 moves. This allows the user to monitor his or her selection direction via the display 5 if necessary.

In fact, the direction selection in step S21 is performed by inputting information regarding the start point and end point in the display coordinate system 3 and performing predetermined arithmetic processing on the coordinate information of the start point and end point, as will be explained from FIG. It is detected by doing.

Next, in step S22, the CPUI performs step S1.
Various functions, such as deleting and moving characters and images, selecting various modes, etc., are executed in accordance with the direction selected.

At this time, a table in the ROM 2 or RAM 3 that associates selection directions with processing functions is referred to, and the function to be executed is selected.

The control model shown in FIG. 2 is the simplest one, and does not specify when the user's selection process starts or ends. Furthermore, the possibility that the user interrupts the selection process or changes the selection direction is not considered. The control models shown in FIGS. 3 and 4 show these points in more detail.

First, in step S31 in FIG. 3, CI) U1 detects whether a selection operation has been performed by the user. The selection operation can be performed using the operating unit 4 or the pointing device 6, but is usually performed by pressing a button on the pointing device 6, as described later.

When the user performs a selection operation in step S31, a loop of steps 532 to S34 is entered, in which the selection direction is detected and the display operation set for the selected menu entry is performed, such as inverting the menu area.

It is checked whether the user is able to select the desired function by display control such as reverse display.

First, in step S32, the pointing device 6
Detection of the movement direction (and movement of pointer P) is performed. This detection is performed, for example, by determining the coordinate value (
Remember the coordinate values of the starting point (starting point) of the selection operation,
This can be done by comparing the coordinate values of the pointer P that is moved according to the amount of movement of the pointer P that is input from time to time. Furthermore, as will be described later, the direction may be detected by comparing the coordinate values at the end point (end point) of the selection operation.

In step 533, the operation set corresponding to the selected direction of movement (such as the above-mentioned inverted display of the menu area) is executed. At this time, a table in the ROM2 or RAMg that associates selection directions with processing functions is referred to, and the operation to be executed is selected.

In step S34, it is determined whether the function selection is completed. The determination in step S34 is made by detecting whether or not a predetermined button of the pointing device 6 is pressed or released.

According to such control, the process of step S31 allows the user to start the function selection process, or to interrupt or end the function selection process at a timing of his/her preference.

The actually selected function (editing of images, characters, etc.) is executed after the procedure shown in FIG. 3 is completed. At this time, ROM2
Alternatively, the daple in RAM3 is referenced.

More specifically, steps S31 and S33 in FIG.
It can be configured as shown in the figure. Further, in FIG. 4, step S35 is inserted between steps S32 and 533 in order to allow the selection direction to be changed midway.

Step S31 in FIG. 4 is constituted by a loop of step 531a and step 531b.

In step 531a, the start of the selection operation is detected by, for example, pressing a predetermined button on the pointing device 6, and in step 531b, the start of the selection operation
It is detected whether the user has actually started the function selection, such as by detecting the pressing of another release button. Then, if a valid selection start is performed, the process advances to step S32, and if a cancel button or the like is operated, step 531a
Return to

Further, in step 535a following step S32, first, the validity of the direction selection performed in step S32 is determined. This is done, for example, by determining whether or not the selection direction has been determined by the arithmetic operation.

Next, in step 535b, the pointing device 6
Detects the operation of the release button, etc., and determines whether a valid direction selection has been made. If no release has been made and a valid function selection has been made, the process proceeds to step S.
The process returns to step 532 and accepts the user's direction selection again (or the process may return to step 531a and completely cancel the selection process).

In step 533, step 533b is provided after step 533a, which is the same as step S33 in FIG.

This is done by the user, step 533
This is to check whether the user has selected the function he/she desires by controlling the inverted display or the like in step (a).

According to the process shown in FIG. 4, it is possible to start a selection operation and cancel the selection operation that has been started, and it is possible to change the selected function or change the selected function until the function selection is finally confirmed. You can cancel function selection.

Next, with reference to FIGS. 5 and 6, more detailed input control when a mouse is used as the pointing device 6 and details of screen control that were not described in detail in the above example will be described. Here, for convenience of explanation, 61 is used as a reference symbol for the mouse.

In FIG. 1 (+3) mentioned above, the menu displayed on the display 5 was not shown in order to show only the main points, but if the menu shown in FIG. 5 is displayed on the display 5, the user can easily select the direction You can easily confirm the desired function, change it, etc.

In FIG. 5, reference numeral 5I denotes a display screen (or window) of the display 5, and this display area is used for editing various data such as characters and images depending on the application. Note that here, an example is shown in which eight processing functions are selected according to the moving direction of the pointer P.

A menu M is displayed on the display screen 51 in response to pressing of a predetermined button of the mouse 61. Although the shape of the menu M may be any shape such as a circle or a diamond, a square shape is exemplified here.

The menu M is divided into eight sections M1 to M8 in a radial Q1 pattern in order to visually display the moving direction of the pointer P (and thus of the mouse 61) assigned to selectable functions. This screen division is performed by changing display colors, displaying straight lines, etc.

Here, horizontally, with the center O of menu M as the center point,
The menu M is divided into four by two vertical border lines, and this is further divided by two border lines having an inclination of 45 degrees with respect to the two horizontal and vertical border lines to form eight sections. Inside each of the sections M1 to M8, the selected processing function is displayed in letters or the like.

Here, an overview of the user interface using menu M in FIG. 5 will be explained.

When a predetermined button of the mouse 61 is pressed while the menu M is not displayed, the menu M is displayed with the position where the pointer P is located at that time as the center point O of the menu M.
Display. The coordinates of point O are stored in the RAM 3 by the CPU as coordinate information of the starting point of the selection operation. Also, at this time, the pointer P is displayed overlapping the menu M.

Next, the user moves the mouse 61 to move the pointer P in a desired direction. Sections Ml-M8 of menu M (
The user can identify the function he/she wants to select from the function display (or the function display with characters attached to it), so the user can move the pointer P inside any one of the sections M1 to M8 corresponding to the desired function.
move. Alternatively, even if it is outside the menu M, it may be inside an extension of two border lines that divide the desired section from other sections.

When a predetermined button on the mouse 61 is pressed or released, the coordinates of the pointer P at that time are taken in as the coordinate values of the end point of the selection operation. This operation is to confirm the user's function selection1.

As a result, the CPU uses the coordinates of the center point O (starting point) of the menu M stored in the RAM 3 and the mouse 6.
The selected movement direction is detected from the coordinates of the position (end point) of the pointer P at the time when a predetermined button 1 is pressed or released, and is assigned in a table in ROM 2 and RAMB accordingly. Perform processing functions.

FIG. 6 illustrates a control procedure of the CPU 1 for realizing the user interface of FIG. 5.

Here, an example is shown in which a cancellation operation is enabled during function selection.

In step S61 in FIG. 6, pressing of a predetermined mouse button to command the start of function selection is detected.

When a predetermined mouse button is pressed, step S
Proceed to 62, x of pointer P when pressing the mouse button,
RA with the y coordinate as the coordinate of the center O (starting point) of the menu M
In step S63, a menu M as shown in FIG. 5 is displayed on the display screen 251 of the display 5.

In step S64, while detecting the movement of the mouse 61 and controlling the corresponding movement of the pointer P, confirmation of selection by pressing or releasing the mouse button is detected. At this time, a release operation using another mouse button or the like is also detected, and if the release operation is detected, the menu being displayed is erased in step S70, and the process returns to step S61.

On the other hand, when the selection is confirmed by pressing or releasing the mouse button in step S64, the x and y coordinates of the position (end point) of the pointer P at the time the mouse button was pressed or released are input in step 365, and the values are is converted into coordinate system data whose origin is the coordinates of the center point O (starting point) of the menu M stored in the RAM 3 in step S66.

In step S67, the selected direction is detected by examining the x and y coordinates of the position (end point) of pointer P when the mouse button was pressed or released, which was converted in step 566. This process obtains data regarding directionality from the information on the starting point and ending point of the selection process. For example, as shown in FIG.
It is configured by the processing shown in FIG.

When the selection direction is detected in step S67, step S67
After the menu M is deleted from the display screen 51 in step S68, the function corresponding to the selected direction is executed in step S69. A table in ROM2 or RAMB is used for function selection.

In this way, the user can easily and reliably select a desired function by using the mouse 61 and the menu M display. Although the user can clearly distinguish the moving direction of the pointer P by displaying the menu, according to this embodiment, it is not necessary to keep an eye on the menu M.

In this example, the point where the selection operation is started (starting point:
Since the function is selected depending on the direction of movement from the center O) of the menu M to the last confirmed point (end point), once the user gets used to it, the display screen 51
4 You can select the desired function without having to look at it. In this respect, this embodiment is superior to conventional pop-up or pull-down menus. Furthermore, for the same reason, it goes without saying that the user's selection changes can be allowed until the final confirmation operation is performed.

In addition, when a friend actively uses the menu display, the following effects can be obtained.

In other words, when confirming a function selection by pressing or releasing a button, it may be outside the menu M as long as it is inside the extension of the two boundaries dividing the desired section from other sections. , M1-M8, the user can more clearly monitor the function he or she is trying to select while performing the operation. In this case, the usability of the menu is similar to that of conventional menus, so even if the user transitions from the conventional one-sided menu system, it can be operated without any discomfort.

The buttons on the mouse 61 can be assigned arbitrarily; for example, even if it is an l-button mouse, menu M is displayed when the first button is pressed, and then the pointer P is moved in the desired direction while holding down the button. Move to
The function can be confirmed by releasing the button. Alternatively, after the menu is displayed, the selection may be confirmed by pressing the mouse button again without pressing the mouse button while the pointer P is moving.

In addition, in the embodiment shown in FIG. 6, as in the case of FIGS. 3 and 4, constant direction determination (step 532) and corresponding menu area inversion display control may be combined. Of course.

Here, the details of the process of detecting directionality information from the coordinates of the starting point and ending point of the selection operation in FIG.
An example is shown in the figure. This control can be used even when using something other than a mouse as the pointing device 6.

FIG. 7(A) shows the assignment of detection directions used in the detection process of FIG. 7(B).

In FIG. 7(A), the symbol O is the center of the menu M displayed on the display 5, (1λ is not shown. Like a foul mouth, in FIG. 7(A), it is the same as in FIG. 5. The menu M is divided into 8 equal parts of 45 degrees each by the formula, and eight directions 1 to 8 can be selected as shown in the figure corresponding to each division.The symbols x and y have the origin at the center O of the menu. Shows Cartesian coordinate axes.

Here, the vertical y-axis is set so that the vertically downward side takes a positive value, as in the screen control of a normal computer. The boundary lines that separate the eight directions are straight line y=x, straight line y=-x, straight line x=0 (y axis),
Straight line y=0 (x axis).

FIG. 7(B) illustrates a direction detection routine when the direction to be detected is divided into eight parts as shown in FIG. 7(A).

In FIG. 7, the same step 366 as in FIG. 6 is illustrated, and here, the coordinate values when the input is finally performed by the pointing device 6 are the coordinate values in the coordinate system whose origin is the center O of the menu. (px, py), and then step S7! ~ In S77, this Rin PM + rf
The moving direction is detected by checking (px, py).

7 In steps 571-577, the coordinate values px, py are positive,
Which direction in FIG. 7(A) has been selected is determined by negative or large/small calculations. Here, the conditions for detecting each of directions 1 to 8 from the boundary straight line equation % formula % that defines each direction are as follows.

Direction 1: px>0 and p, y<0 and px>-py
...-(1) Direction 2: px>
O and py < o and p x < -py
...-(2) Direction 3: px<O and py<
0 and -pX<py...(3)
Direction 4: px<O and py<0 and -px>py
...-(4) Direction 5: px<O
and py>o and -px>py
−・−(5) Direction 6: px<0 and r,)
y > 0 and -p X < py
-... (6) 2゛8 Direction 7: px>0 and py>0 and p' x <
p y...-(7) Direction 8: px>O and py>o and px>py
...-(8) Step 5
71-877 are arranged to check each of these conditions (1) to (8) (the order does not match the above in the flowchart), and when each condition is satisfied, steps 578 to S85 are performed. Any one of directions 1 to 8 is detected as the user's selected direction.

When the selected direction is determined by the control shown in FIG. 7, the function corresponding to the selected direction is executed. A table in ROM2 or RAM5 is used for function selection.

In the case of FIGS. 5 and 7, the selectable directions are eight directions obtained by dividing the upper right, upper left, lower right, and lower left directions into halves, respectively.

Furthermore, the angles of division are equal. However, when we consider the case of operating a pointing device (especially a mouse, etc.) without looking at the screen, blind operation can be used fairly accurately in the vertical and horizontal directions; It seems that it cannot be managed accurately.

Therefore, FIG. 8 shows a different selection direction setting method. Here, eight directions can be selected: horizontal left/right direction, vertical up/down direction, and upper right, upper left, lower right, and lower left directions, and the accuracy of blind operation between vertical, horizontal, and diagonal directions. The angular width in each direction is set to a different value in consideration of the difference in .

FIG. 8(A) shows eight selectable directions 1-8 in a similar manner to FIG. 7(A).

The straight line of the boundary line dividing each direction 1 to 8 is y=a
x, y=x/a, y=-ax, y=-x/a.

The direction set in this way can be identified by the procedure shown in FIG. 8(B).

Steps S66, S71 to S77 in FIG. 8(B) are the seventh
Same as Figure (B), respectively, the above conditions (1) to (8)
). Then, step 378 in FIG. 7(B)
~Instead of S85, steps 591-598 are provided, and p
Direction is detected by comparing the quotient of x and py with threshold values a, -a, l/a, -1/a. The straight lines of the boundary lines dividing the threshold values in each direction 1 to 8 have slopes of y=ax, y''X/a, y=-ax, and y=-x/a, respectively.

For example, if step S75 is affirmative, the seventh
This means that the region in direction 1 in FIG. 8(A) has been detected, but in the case of FIG. 8(A), either direction 1 or direction 2 must be further detected from here.

In step S91, the direction l or 2 is determined by comparing the slope 1/a of the straight line y=-x/a and the quotient of the x and y coordinate values. In step 591, direction l is detected if p y / p x > −1/a is satisfied.

Similarly, in steps 392 to 59B, straight lines y==ax, y=x/a, y=ax, y=-x/a as threshold values
The selection direction is finally determined 1 by comparing the slope of the quotient of the x and y coordinate values. With such control, in the case of FIG. 8, one selection direction is determined in one of two steps.

For example, direction 2 is determined in either of the two steps 5100.5102.

As described above, according to the control shown in FIG. 8, it is possible to detect selections in the horizontal and vertical directions, as well as in eight directions sandwiched therebetween: upper right, lower right, upper left, and lower left, and to execute the corresponding functions.

In particular, according to the configuration of FIG. 8, steps 591-398
By changing the setting of the value a that determines the threshold value of , the range of selectable directions can be controlled as desired. As a result, it is possible to narrow the range in the directions considered to be vertical and horizontal, and to set the range in the diagonal direction to be large, taking into account the accuracy of the user's blind operation as described above.

Also, the four straight lines in Figure 8 y=ax, yx/a, y=
Although the slopes of -ax and y=-x/a are determined based on the same value a, these values may be determined separately. In this case, the threshold values in steps 591-398 of FIG. 8(B) are set separately.

For example, if the slope of the straight line y = x / a that divides the directions l, 8, and 4.5 in FIG. 8(A) is changed to m, the threshold value used in steps S93 and S95 becomes m. Become.

By setting the selection direction ranges separately in this way, it is possible to prevent user operation habits such as, for example, when performing horizontal direction input using the pointing device 6, the direction of movement of the pointing device 6 is always tilted. Can be corrected.

Furthermore, the straight lines dividing each direction may be considered as eight straight lines starting from the origin O, and the slopes of these lines may be made different. This makes it possible to set, for example, stricter detection conditions for direction (2) and less stringent detection conditions for direction (5).

Note that the threshold value that defines the selection direction may be set to a value of the user's preference. This setting can be performed by inputting numerical values using the operating section 4 and pointing device 6, or by making menu selections. Of course, during this setting, a menu related to the present invention may be used.

In FIGS. 7 and 8, data on the boundary line is not taken into account for ease of explanation, but the conditions (1) to (8) or the inequalities in steps S91 to 398 in FIG. It goes without saying that by appropriately arranging the symbols, the input of the boundary line 1 can be detected as one of the selection directions delimited by the boundary line.

In the above example, the corresponding function is executed in accordance with the selection of eight directions, but any number of selectable directions may be used.

In addition to the mouse, a track pole, digitizer pad, joystick, etc. can be used as a pointing device. Joysticks, etc.
Although the operating section is not "moved," in this case, similar control is possible by replacing "movement" in the above embodiment with "tilting" of the stick.

In addition, cursor keys, numeric keypads, etc. used on conventional keyboards (used as the operation unit 4 in Fig. 1) can be used as pointing devices in conjunction with menus as shown in Fig. 5, for example. I can do it.

In the case of cursor keys, each key with up, down, left and right arrows can be used in four directions, or two of each key, such as up and right.
By accepting the input of the two keys, it is possible to select four more directions, that is, a total of eight directions. When using cursor keys, use other keys to start and end directional selection. Detection of these keys is, for example, the fourth
In the control procedure shown in the figure, it is detected in steps 531a and S34, and in the case of FIG. 6, it is detected in S61.365.

That is, after pressing a predetermined key (such as the escape key) to start direction selection and displaying the menu described above at the current position of the pointer, move the pointer using the cursor keys and press the 5 (return) key. Press the escape key (same as the escape key) to select the direction. direction[? In the detection of 11, direction selection may also be started or ended by simultaneously pressing cursor keys having opposite directions, for example, both left and right keys. As in the previous embodiment, start selecting the direction,
It can be detected from the coordinates of the pointer at the point where it ended.

You can also use a numeric keypad. In this case, among the keys arranged like 89 56 23, the surrounding 7.8.9.4
．． 6.1.2.3 keys correspond to eight directions, and the direction is selected by pressing the key.

In the case of a numeric keypad, a key is required to start and end direction selection.For example, the 5 key in the center of the numeric keypad is not necessary for direction selection, so this key is used to start and end direction selection. It can be assigned to 6.

That is, by pressing the 5 key in the center of the numeric keypad, a menu is displayed at the current position of the pointer, and then the surrounding 7, 8, .
9. The pointer is moved in the corresponding direction in response to the pressing of the keys 4.6, 2, and 2.3, and the selected direction is determined by pressing the 5 key again or another confirmation key. Starting and ending direction selection, direction detection, etc. are performed in the same way as with the cursor keys.

By using a cursor key, numeric keypad, etc., even an apparatus without a pointing device can enjoy the advantages of the one-menu system of the present invention. When using cursor keys or numeric keys, it goes without saying that any key can be used to start and end direction selection.

In addition, conventional menu interfaces have a so-called hierarchical menu structure in which a menu item is selected in response to a predetermined input operation, a submenu with the lower functions of that menu is displayed, and the function selection is performed. It goes without saying that even in the menu of the present invention as shown in FIG. 5, for example, a configuration can be adopted in which a certain menu item is similarly designated by direction selection and its submenu is displayed. be.

[Effect 1 of the Invention As is clear from the above, according to the present invention, in a user interface system for an information processing device that has a predetermined coordinate system and performs information processing according to input coordinate information, the predetermined coordinate system means for inputting coordinate information of a starting point and an ending point in the system; and means for forming information related to directionality in the coordinate system from the coordinate information of the starting point and ending point;
a means for storing information relating to directionality in the coordinate system in association with different information processing functions, and a means for storing information relating to directionality in the coordinate system; The configuration includes a control means for executing a predetermined information processing function associated with information related to the information. Therefore, the user inputs the coordinates of the starting point and the ending point in a predetermined coordinate system, inputs the information related to the directionality that is associated with the predetermined information processing function from the coordinate information of the starting point and the ending point, and Various information processing functions can be executed based on the information.

Here, the coordinate information of the start point and end point can be input using a pointing device, etc. In that case, the direction information can be easily inputted without necessarily requiring a monitor display, so the user is not forced to look at the display screen. This has excellent effects such as blind operation, efficient function selection, and reduced user fatigue.

[Brief explanation of drawings]

FIG. 1(A) is a block diagram of an information processing device adopting the user interface method of the present invention, FIG. 1(B) is an explanatory diagram showing a basic model of function selection by direction in the present invention, and FIG. 9 A flowchart diagram showing a basic model of function selection control based on direction in the present invention, FIGS. 3 and 4 are flowchart diagrams showing a basic model of function selection control based on more complicated directions, and FIG. An explanatory diagram showing an example of a menu display, Figure 6 is a flowchart diagram showing user interface control using a mouse, and Figure 7 (A)
is an explanatory diagram showing an example of setting the direction to be selected, and FIG. 7 (I
3) is a flowchart of the selection direction detection control shown in FIG. 7(A), FIG. 8(A) is an explanatory diagram showing different setting examples of the selected direction, and FIG. 8(B) is a flowchart of the detection control of the selected direction. FIG. 9 is an explanatory diagram showing an example of a conventional menu display. 1...CPU 2...ROM3...R
AM 4-...Operation unit 5--Display 6--Pointing device 51--Display screen

Claims (1)

[Claims] 1) In a user interface method for an information processing device that has a predetermined coordinate system and performs information processing according to input coordinate information, means for inputting; means for forming information relating to directionality in the coordinate system from coordinate information of the starting point and end point; and means for storing information relating to directionality in the coordinate system in association with different information processing functions; , further comprising a control means that refers to the storage means according to the information related to the directionality formed by the information forming means and executes a predetermined information processing function associated with the information related to the directionality. User interface method. 2) The information processing device is provided with a display means, and when the coordinates of a starting point are inputted by the input means, the storage means sets a predetermined point in the display coordinate system of the display means corresponding to the starting point as the origin. displays on the display means a menu display consisting of a plurality of display areas that visually display directions each associated with a predetermined information processing function; 2. The user interface system according to claim 1, wherein an end point for forming directional information associated with an information processing function is inputted by the input means.