JPH07104915A - Graphic user interface device - Google Patents

Abstract

PURPOSE:To provide the graphic user interface device which can save operational labor, can prevent what a dragged operation target is from being unrecognized during move, further, can interrupt the operation without canceling it and can continue the operation from the state at the time of interruption again. CONSTITUTION:This device is composed of a judgement rule storage part 7 for storing operation targets 13 to be processed by respective processing functions 15 corresponding to the respective processing functions 15, identification part 9 for identifying the operation target 15 when that desired operation target is dragged by the instruction of an operator, and judgement part 11 for judging the processing function 15 to enable processing based on the judgement rule storage part 7 corresponding to the operation target identified by the identification part 9 and for displaying the judged result on a screen.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a graphic user interface device for operating an operation target displayed on a screen such as a display on the screen.

[0002]

2. Description of the Related Art Conventionally, in a graphic user interface device, as shown in FIG. 13, a plurality of files 101a, 101b, 10 displayed on a display are displayed.
A desired operation target object 101 is grasped and moved from the operation target object 101 composed of 1c using an input device such as a mouse (hereinafter referred to as drag), moved (hereinafter referred to as move), and displayed on the screen. Print function 1
03A, a conversion function 103B, and a display function 103C are often used for direct manipulation in which a desired operation is performed by releasing the processing function 103 (hereinafter referred to as a drop).

[0003]

However, the conventional graphic user interface device has the following problems. Since each operation target does not necessarily correspond to all the processing functions, the dragged operation target operates unless the dragged operation target is actually dropped on each processing function as shown in FIG. It is not possible to judge whether it is possible (acceptable). The operator must remember what was the dragged operation target, so when dragging multiple operation targets at once or when dragging multiple operation targets in succession, which operation target Sometimes you don't know what you dragged while moving. If another operation is required while moving the operation target, you must cancel the operation while moving, perform another operation, and then perform the operation of dragging the first operation target again. No, it takes time.

The present invention has been made in view of the above circumstances, and its purpose is to, when an operation target is dragged,
By notifying the operator of the processing function that allows the operation target to be dropped (acceptable), the operation can be saved, and it may be impossible to know what the dragged operation target was during the move. This can be prevented, and further, when the operation target is interrupted when the operation target is moved, the operation is interrupted without canceling the operation, and another operation is performed,
It is another object of the present invention to provide a graphic user interface device capable of continuing the original operation from the state at the time of the interruption.

[0005]

In order to achieve the above object, the present invention provides at least one operation object on the screen and a predetermined process for the operation object. A graphic that displays one or more processing functions, selects a desired operation object from the operation objects, and selects a processing function for processing the operation object from the processing functions on the screen. In the user interface device, a determination rule storage unit that stores the operation object that can be processed by each processing function in association with each processing function, and a state in which a desired operation object can be moved on the screen according to an operator's command. When it is turned on, the identification means for identifying the operation target and the processing function capable of processing the operation target identified by the identification means are determined based on the determination rule storage means. And it is characterized by comprising a determination unit for displaying the determination result on the screen.

Further, at least one operation object and at least one processing function for performing a predetermined process on the operation object are displayed on the screen, and the operation object is displayed. In a graphic user interface device that selects a desired operation target from the inside and performs a process function of selecting a processing function for processing it on the screen, a desired operation target is changed by an operator's command. Tracking means for extracting the coordinates of the original position of the operation target when the operation target is moved on the screen, and for tracking the operation target when the operation target is moving and extracting the coordinates. And tracking display means for displaying on the screen a line connecting the coordinates of the original position of the operation object extracted by the tracking means and the coordinates of the moving operation object. It is characterized in.

Furthermore, at least one or more operation objects and at least one or more processing functions for performing predetermined processing on the operation objects are displayed on the screen, and the operation objects are displayed. In a graphic user interface device that selects a desired operation target from the inside and performs a process function of selecting a processing function for processing it on the screen, a desired operation target is changed by an operator's command. When the movable object is made movable on the screen, the identification means for identifying the operation object, and when the desired operation object is made movable on the screen by the operator's command, the operation object Along with extracting the coordinates of the original position of the object, when the operation target is moving, tracking means for tracking the position and extracting the coordinates, and the desired operation target moves on the screen. When a command to suspend the operation is output by the operator in the active state, the operation object at that time based on the identification result of the identification means, and the coordinates at that time based on the extraction result of the tracking means And a suspending means for suspending the operation, and when the suspended state is released by the operator, the suspending command is output based on the operation object and the coordinates stored in the suspending means. Restarting means for returning to the same state as when the operation was performed and restarting the operation.

[0008]

According to the above construction, the identifying means identifies the operation target object when the desired operation target object is made movable on the screen by the instruction of the operator. And
The determination means determines the processing function capable of processing the operation target identified by the identification means based on the determination rule stored in the determination rule storage means, and displays the determination result on the screen. .

Further, the tracking means extracts the coordinates of the original position of the operation target object when the desired operation target object is made movable on the screen by the instruction of the operator, and the operation target object is also extracted. When is moving, it tracks it and extracts its coordinates. Then, the tracking unit display unit displays a line connecting the coordinates of the original position of the operation target extracted by the tracking unit and the coordinates of the moving operation target on the screen.

Further, when the operator outputs a command to suspend the operation while the desired operation target is movable on the screen, the operation target at that time is determined based on the identification result of the identification means. And storing the coordinates at that time based on the extraction result of the tracking means,
The operation is interrupted. Then, the resuming means, when the suspended state is released by the operator, returns to the same state as when the suspending instruction is output, based on the operation object and the coordinates stored in the suspending means. Restart the operation.

[0011]

1 is a functional block diagram showing a first embodiment of a graphic user interface device according to the present invention.

As shown in FIG. 1, the graphic user interface device 1 of the first embodiment has a display unit 3, an input unit 5, a determination rule storage unit 7, an identification unit 9, and a determination unit 1.
1 and.

The display unit 3 has three types of files 13a, 1 stored in the graphic user interface device 1.
As shown in FIG. 2, 3b and 13c are displayed as the operation target 13 on the screen as shown in FIG. The operation of displaying the desired operation target 13 on the screen and operating the desired processing function 15 is performed on the screen.

The input unit 5 is a mouse (not shown) for performing operations of dragging, moving, and dropping the operation target 13 on the screen, and a keyboard (for selecting a screen to be displayed on the display unit 3). (Not shown).

As shown in FIG. 3, the judgment rule storage unit 7 stores in advance the operation object 13 that can be processed by each processing function 15 in association with each processing function 15.

When the desired operation target 13 among the operation targets 13 displayed on the screen of the display unit 3 is dragged by the operator's command, the identification unit 9 determines which file the operation target 13 is. Is identified by the dragged position.

The determination unit 11 determines the processing function 15 capable of processing the operation target 13 identified by the identification unit 9 based on the determination rule storage unit 7, and displays the determination result on the screen of the display unit 3. Is displayed.

Next, the operation of the graphic user interface device 1 of the first embodiment will be described with reference to the flow chart shown in FIG. Note that, here, an operation when dragging the file 13a will be described as an example.

As shown in FIG. 2, the operator previously has three types of files 13a, 13b and 13c.
3, the print function 15A, the conversion function 15B, and the display function 15C, which are the processing functions 15 of the graphic user interface device 1, are set in the display unit 3 so that they can be displayed on the screen of the display unit 3, and as shown in FIG. As described above, the operation target 13 that can be processed by each processing function 15
It is stored in association with every 5 items.

In this state, the operator uses the input unit 5 to display a screen as shown in FIG. 2 on the display unit 3.

Then, the operator moves the mouse of the input section 5 to move the cursor 17 on the screen to the position of the file 13a, and drags the file 13a by moving the mouse while pushing a predetermined button.

When the file 13a is dragged, the identification unit 9 identifies that it is the file 13a based on the position when the file 13a is dragged (step ST
1).

When it is identified that the dragged file is the file 13a, the judgment unit 11 accepts the file 13a based on the judgment rule shown in FIG. The processing function 15 capable of performing the above is determined (step ST3). here,
It is determined that the print function 15A and the conversion function 15B can be accepted. Then, the determination unit 11 displays “OK” on the print function 15A and the conversion function 15B displayed on the screen of the display unit 3 as shown in FIG. 5 (step ST
5).

As described above, in the graphic user interface device of the first embodiment, the operator uses the file 1
Since the processing function 15 that can accept the file 13a can be grasped only by dragging the file 3a, the labor of the operation can be saved.

FIG. 6 is a functional block diagram showing a second embodiment of the graphic user interface device according to the present invention. The same members as those of the graphic user interface device 1 of the first embodiment shown in FIG. 1 are designated by the same reference numerals and the description thereof will be omitted.

As shown in FIG. 6, the graphic user interface device 21 of the second embodiment is the same as the first embodiment shown in FIG.
The graphic user interface device 1 of the embodiment has a configuration in which a display unit 3 and an input unit 5 are provided with a tracking unit 23 and a tracking display unit 25.

The tracking unit 23 extracts the coordinates of the original position of the operation target 13 when the operation target 13 is dragged on the screen, and also tracks the operation target 13 being moved and coordinates thereof. To extract.

The tracking display section 25 is based on the coordinates of the original position of the operation object 13 extracted by the tracking section 23 and the coordinates of the operation object 13 being moved, and the operation object 1
A line connecting the coordinates of the original position of 3 and the coordinates of the operation target 13 being moved is displayed on the screen of the display unit 3.

Next, the operation of the graphic user interface device 21 of the second embodiment will be described with reference to the flow chart shown in FIG. In this example, the file 13b
An operation of dragging, moving, and dropping on the print function 15A will be described as an example.

The operator previously has three types of files 13a, 13b and 13c as shown in FIG.
Then, the print function 15A, the conversion function 15B, and the display function 15C, which are the processing functions 15 of the graphic user interface device 1, are set in the display unit 3 so that they can be displayed on the screen of the display unit 3.

In this state, the operator uses the input unit 5 to display the screen as shown in FIG. 2 on the display unit 3.

Then, the operator moves the cursor to move the cursor 17 on the screen to the position of the file 13b, and moves the cursor while pushing a predetermined button of the mouse to drag the file 13b.

When the file 13b is dragged a, the tracking section 23 extracts the coordinates at the time of dragging (step ST11). When the file 13b is moved by the operator (step ST1
3YES), and the coordinates are extracted (step ST15).
The coordinates are obtained by converting the amount of movement of the mouse that moves the file 13b into coordinates on the screen.

When the tracking unit 23 extracts the coordinates of the original position of the file 13b and the coordinates of the file 13b being moved, the tracking display unit 25 displays the coordinates of the original position of the extracted file 13b and the moving position. The coordinates of the file 13b are connected by lines and displayed on the screen as shown in FIG. 8 (step ST17). This line is file 13b
Is tied following the movement of.

Then, the file 13 is set by the operator.
When b is dropped on the print function 15A (step ST
19YES), the tracking display unit 25 displays the file 13b
The line connecting the coordinates of the original position of and the coordinates of the file 13b being moved is deleted (step ST21).

As described above, in the graphic user interface device 21 of the second embodiment, the line connecting the original position of the dragged file 13b and the moving file 13b is displayed on the screen. This prevents you from wondering what the dragged file was during the move.

FIG. 9 is a functional block diagram showing a third embodiment of the graphic user interface device according to the present invention. The same members as those of the graphic user interface device 1 of the first embodiment shown in FIG. 1 and the graphic user interface device 21 of the second embodiment shown in FIG.

As shown in FIG. 9, the graphic user interface device 31 of the third embodiment is similar to the first embodiment shown in FIG.
The display unit 3, the input unit 5, the identification unit 9, and the second shown in FIG. 6 of the graphic user interface device 1 of the embodiment.
The tracing unit 23 of the graphic user interface device 21 of the embodiment is provided with an interruption unit 33 and a resumption unit 35.

The suspending unit 33 is moving based on the identification result of the identifying unit 9 when the operator outputs a suspending instruction of the operation while the desired operation target 13 is moving on the screen. The name of the operation target 13 and the coordinates of the operation target 13 when the interruption command is output based on the extraction result of the tracking unit 23 are stored, and
The operation is interrupted, and the fact that the operation is being interrupted is displayed on the screen.

When the operator releases the suspended state, the resuming section 35 displays the same screen state as when the suspending instruction is output based on the name of the operation target object 13 stored in the suspending section 33 and its coordinates. Restart the operation.

Next, the operation of the graphic user interface device 31 of the third embodiment will be described with reference to the flow chart shown in FIG. Here, as shown in FIG. 11, a case where multi-window processing is performed by the file display window 3a and the processing function display window 3b will be described as an example. At this time, when the file 13a is dragged, moved and then dropped onto the print function 15A, as shown in FIG. 11, the print function 15 of the processing function display window 3b is displayed by the file display window 3a.
It is assumed that A is hidden and cannot be dropped on the print function 15A, and the operation must be interrupted to switch the screen.

First, the operator moves the cursor 17 on the screen of the display unit 3 to the position of the file 13a by moving the mouse, and moves the cursor while pushing a predetermined button of the mouse to drag the file 13a.

When the file 13a is dragged, the tracking section 23 extracts the coordinates at the time of dragging (step ST41). Then, when the file 13a is moved by the operator (step ST4
3YES), track and extract the coordinates.

At this time, since the print function 15A of the processing function display window 3b is hidden by the file display window 3a and the file 13a cannot be dropped onto the print function 15A, the operator operates the file 1
Without dropping 3a (step ST47 NO),
An operation interruption command is output to the interruption unit 33 by pressing a predetermined key on the keyboard of the input unit 5 (step ST49 YES).

In the suspending unit 33, when the suspending command is output from the input unit 5, the coordinates of the file 13a at that time and the file 1 which is the file name identified by the identifying unit 9 are output.
3a and 3a are stored. Then, as shown in FIG. 11, "interrupt" is displayed in the file 13a on the screen, the operation is interrupted, and the cursor 17 is made free (step ST5).
1).

Then, the operator moves the cursor 17 on the screen to the screen switching portion by using the mouse of the input unit 5 and clicks a predetermined button to bring the processing function display window 3b onto the file display window 3a. To be displayed. After that, the operator outputs an operation restart command to the restart unit 35 by pressing a predetermined key on the keyboard of the input unit 5 (YES in step ST53).

When the operation restart command is output from the input unit 5, the restart unit 35 restores the same state as when the interrupt command was output based on the file name stored in the interrupt unit 33 and its coordinates, and The operation for dropping 13a on the print function 15A is restarted (step ST55).

As described above, in the graphic user interface device 31 of the third embodiment, the interruption command is issued by the interruption unit 3.
The file name and the coordinates of the file being dragged when it is output to 3 are stored in the interruption unit 33 to enable another operation. Then, when the operation restart command is output to the restart unit 35, the restart unit 35 returns to the same state as when the interrupt command was output based on the file name stored in the interrupt unit 33 and its coordinates, The operation for dropping the file 13a on the print function 15A is restarted. Therefore, without canceling the operation of dragging the file 13a, the operation can be interrupted, another operation can be performed, and the original operation can be resumed from the state in which it was interrupted.

In the graphic user interface device 31 of the third embodiment, the entire suspended screen is displayed. However, the present invention is not limited to this, and only a part of the suspended screen or a suspended operation may occur. It may be displayed in one corner of the screen.

FIG. 12 is a functional block diagram showing a fourth embodiment of the graphic user interface device according to the present invention. The same members as the graphic user interface device 1 of the first embodiment shown in FIG. 1, the graphic user interface device 21 of the second embodiment shown in FIG. 6 and the graphic user interface device 31 of the second embodiment shown in FIG. Are assigned the same numbers and explanations thereof are omitted.

As shown in FIG. 12, a graphic user interface device 41 of the fourth embodiment has a display unit 3, an input unit 5, a judgment rule unit 7, and a graphic user interface device 1 of the first embodiment shown in FIG. The identification unit 9, the determination unit 11, the tracking unit 23 of the graphic user interface device 21 of the second embodiment shown in FIG. 6, the tracking display unit 25,
Further, the graphic user interface device 31 of the third embodiment shown in FIG. 9 is provided with an interruption unit 33 and a resumption unit 35. That is, the graphic user interface device 1 of the first embodiment shown in FIG. 1, the graphic user interface device 21 of the second embodiment shown in FIG. 6 and the graphic user interface device 31 of the third embodiment shown in FIG. 9 are combined. It is composed.

Therefore, the graphic user interface device 41 of the fourth embodiment can accept the file 13a only by dragging the file 13a by the operator as in the graphic user interface device 1 of the first embodiment shown in FIG. It becomes possible to grasp the processing functions 15 which can be performed, and like the graphic user interface device 21 of the second embodiment shown in FIG. 6, it is possible to prevent the user from not knowing what the dragged operation target is during the move. Yes, and in addition,
As in the case of the graphic user interface device 31 of the third embodiment shown in FIG. 10, the operation of dragging the file 13a is canceled without canceling the operation, another operation is performed, and the original operation is interrupted again. You can continue from where you were.

In all the examples, the operation target 13
File 13a, file 13b, file 1
3c and the processing function 15 are described as an example of three print functions 15A, exchange functions 15B, and display functions 15C, but the types and the number are not limited to these.

[0054]

As described above, according to the present invention, when the operator makes the operation target movable, the processing function capable of accepting the operation target is judged and displayed. Therefore, the operator can grasp the processing function capable of accepting the operation target only by making the operation target movable.

Further, since the line connecting the original position of the movable operation object and the moving operation object is displayed on the screen, when the operation object is being moved. It can prevent you from forgetting what it was.

Further, if the operation is interrupted when the operation object is in a movable state, the operation state is stored without canceling the operation. It is possible to resume the original operation from the state at the time of the interruption again based on the stored state at the time of the interruption.

[Brief description of drawings]

FIG. 1 is a functional block diagram showing a first embodiment of a graphic user interface device according to the present invention.

FIG. 2 is an explanatory diagram showing an example of a display screen of a display unit.

FIG. 3 is a determination rule stored in a determination rule storage unit.

FIG. 4 is a flowchart showing the operation of the graphic user interface device of the first embodiment shown in FIG.

FIG. 5 is an explanatory diagram illustrating a display example of a determination result of a determination unit.

FIG. 6 is a functional block diagram showing a second embodiment of the graphic user interface device according to the present invention.

7 is a flowchart showing the operation of the graphic user interface device of the second embodiment shown in FIG.

FIG. 8 is an explanatory diagram showing an example of a line connecting the original position of the operation target and the operation target being moved.

FIG. 9 is a functional block diagram showing a third embodiment of the graphic user interface device according to the present invention.

10 is a flowchart showing the operation of the graphic user interface device of the third embodiment shown in FIG.

FIG. 11 is an explanatory diagram showing a display screen when performing multi-window processing.

FIG. 12 is a functional block diagram showing a fourth embodiment of the graphic user interface device according to the present invention.

FIG. 13 is an explanatory diagram showing a conventional operation on a screen.

[Explanation of symbols]

1, 21, 31, 41 Graphic user interface device 3 Display unit 5 Input unit 7 Judgment rule storage unit 9 Identification unit 11 Judgment unit 23 Tracking unit 25 Tracking display unit 33 Interruption unit 35 Resuming unit

Claims (3)

[Claims] 1. A display for displaying at least one or more operation target objects and at least one or more processing functions for performing a predetermined process on the operation target objects on a screen, In a graphic user interface device that selects a desired operation object from the inside and performs an operation of selecting a processing function for processing it from the processing functions, the operation target that can be processed by each of the processing functions. Determination rule storage means for storing an object in association with each processing function, identification means for identifying the operation object when a desired operation object is made movable on the screen by an operator's command, Judgment means for judging the processing function capable of processing the operation target object identified by the identification means based on the judgment rule storage means, and displaying the judgment result on the screen. A graphic user interface device comprising: 2. The screen displays at least one or more operation objects and at least one or more processing functions for performing a predetermined process on the operation objects, and the operation objects are displayed. In a graphic user interface device that selects a desired operation object from the screen and performs an operation of selecting a processing function for processing it from the processing functions on the screen, a desired operation object is displayed by an operator's command. Tracking means for extracting the coordinates of the original position of the operation target when the operation target is moved on the screen, and for tracking the operation target when the operation target is moving and extracting the coordinates. And tracking display means for displaying on the screen a line connecting the coordinates of the original position of the operation target extracted by the tracking means and the coordinates of the moving operation target. To Characteristic graphic user interface device. 3. An operation target object is displayed by displaying at least one operation target object and at least one processing function for performing a predetermined process on the operation target object on a screen. In a graphic user interface device that selects a desired operation object from the screen and performs an operation of selecting a processing function for processing it from the processing functions on the screen, a desired operation object is displayed by an operator's command. When the movable object is made movable on the screen, an identification means for identifying the operation object, and when the desired operation object is made movable on the screen by the instruction of the operator, the operation object A tracking means for extracting the coordinates of the original position of the object and tracing the coordinates when the operation object is moving, and a desired operation object can be moved on the screen. When the operator outputs a command to suspend the operation in the state, the operation target object at that time based on the identification result of the identification means and the coordinates at that time based on the extraction result of the tracking means are displayed. A suspending means for storing and suspending the operation, and when the suspended state is released by the operator, the suspending instruction is output based on the operation object and the coordinates stored in the suspending means. A graphic user interface device comprising: a resuming means for resuming the operation by returning to the same state as at the time.