JPH09160739A - Data processing system and input method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a graphic user interface(GUI) which is superior in operability and can effectively utilize a display screen by selectively displaying an arbitrary plane of a polyhedron and performing the corresponding process. SOLUTION: A memory 14 stores the coordinates of respective vertexes of an octahedral icon IC, selection items assigned to the respective planes, a flag indicating whether or not the octahedral icon is displayed, etc. A display memory 13 stores image data, defining a display image containing the octahedral icon IC, in bit map form, etc. A display device 12 displays the image defined by the image data stored in the display memory 13 under the control of a control part 11. Then, the specific selection items(process or function) are allocated to the respective planes of the octahedron displayed on the screen and an arbitrary plane is put in the front and clicked, so that the selection item allocated to the plane is selected. Consequently, the presence and feeling of operation are improved, and the operability and operation efficiency are also improved.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data processing system and an input method using a graphic user interface (GUI), and particularly to data using a GUI having excellent operability and capable of effectively using a display screen The present invention relates to a processing system and an input method.

[0002]

2. Description of the Related Art A GUI (Graphic User Interface) has attracted attention as a means for providing a user-friendly operating environment. In the conventional GUI, icons are displayed on the screen, and a corresponding command or the like is input by selecting these with a mouse or the like.

[0003]

However, the conventional GUI
In the case of, since the icon has a flat configuration and arrangement,
There is a problem that the impression given to the operator is low and the operability is low accordingly.

Further, there is a problem that it is necessary to display a large number of icons on the screen and the effective display area of the screen becomes narrow. If the number of icons is increased to increase the number of selectable items, the effective display area becomes narrower. Although it is possible to reduce the size of the icon in order to reduce the display area of the icon, it becomes difficult to see the icon and the operability is significantly reduced.

Furthermore, since the icons are dispersedly arranged on the screen, it is necessary to move the line of sight and the mouse in order to select the icon, which causes a problem that the thinking is interrupted and the processing efficiency is lowered.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a data processing system and an input method using a GUI having excellent operability. Another object of the present invention is to provide a data processing system and an input method using an icon that can effectively use a screen.

[0007]

In order to achieve the above object, a data processing system according to a first aspect of the present invention is a display means for displaying a polyhedron on a screen, and a predetermined processing on each surface of the polyhedron. Allocating means for allocating the polyhedron, instructing means for instructing the surface of the polyhedron, and executing means for executing the processing allocated by the allocating means on the surface instructed by the instructing means of the polyhedron. And

According to this structure, by selecting and designating an arbitrary face of the polyhedron, the corresponding process can be executed as in the conventional icon. Also,
Since the input is performed by operating the polyhedron, it is possible to input with a realistic feeling and excellent operability. Further, it is not necessary to display many icons on the screen, the screen can be effectively used, and the processing can be performed while paying attention to one part of the screen.

When the polyhedron is displayed on the screen, a part of the polyhedron is hidden. For this reason, it is desirable to rotate the polyhedron to change the displayed surface. Further, only the front surface of the displayed polyhedron may be made active, and only this surface may be selected by the instruction means. You may make it display the polyhedron for selecting the process located in the low order of the process allocated to the surface instruct | indicated by the instruction | indication means.

Further, in the data processing system according to the second aspect of the present invention, a display control means for displaying a solid body in which a menu item is assigned to each surface, and an arbitrary one of the solid bodies displayed by the display control means. It is characterized by comprising input means for selecting a surface and selection control means for selecting a menu item assigned to the surface selected by the input means.

With such a configuration, it is possible to select any menu item by selecting any surface of the solid. With such a configuration, it is possible to execute the corresponding processing by selecting and instructing an arbitrary surface of the solid. In addition, since the input is performed by operating the solid body, there is a sense of reality and it is possible to input with excellent operability. Further, it is not necessary to display many icons on the screen, the screen can be effectively used, and the processing can be performed while paying attention to one part of the screen.

When a solid is displayed, a part of the solid is hidden. Therefore, it is desirable to rotate the solid so that an arbitrary surface can be displayed. Further, only the front surface of the displayed three-dimensional body may be made active, and only this surface can be selected. A means for executing the process corresponding to the selected menu item may be arranged.

The input method according to the third aspect of the present invention displays a polyhedron having a plurality of faces to which predetermined items are assigned, and selects an arbitrary face of the displayed polyhedron. It is characterized in that processing corresponding to the item assigned to the selected surface is executed. It is also possible to rotate the polyhedron to display the surface to be selected and then select the corresponding surface.

According to this structure, by selecting any surface of the polyhedron, it is possible to select any item and execute the corresponding processing. Since the input is performed by operating the polyhedron, it is possible to input with a realistic feeling and excellent operability. Further, it is not necessary to display many icons on the screen, the screen can be effectively used, and the processing can be performed while paying attention to one part of the screen. It is characterized in that an arbitrary surface of the displayed polyhedron is displayed.

[0015]

BEST MODE FOR CARRYING OUT THE INVENTION A data processing system according to an embodiment of the present invention will be described below. (First Embodiment) FIG. 1 shows an example of a display screen of this data processing system. As shown in the figure, a polyhedron (octahedral) icon IC is displayed on the upper left side of the display screen. Predetermined selection items (menu items), such as arbitrary processing and commands, are assigned to each surface of the octahedron icon IC.

As shown in FIG. 2 (A), by right-clicking the surface (the surface shown with hatching) located in front of this octahedron icon IC with the mouse, the selection items assigned to that surface are selected. Can be selected and the corresponding process can be executed.

As shown in FIG. 2 (B), the mouse is moved left and right to rotate the octahedron icon IC horizontally, or as shown in FIG. 2 (C), the mouse is moved forward and backward. By rotating the octahedron icon IC in the vertical direction, the surface to which the desired selection item is assigned can be displayed. By left-clicking the mouse as shown in FIG. 2D, the octahedron icon IC can be erased (not displayed). In addition, the octahedron icon IC can be displayed again by left-clicking again.

As shown in FIG. 2 (E), the octahedron icon IC can be moved on the screen by moving the mouse (right-dragging) while pressing the right button. As shown in FIG. 2 (F), by holding down the Alt key on the keyboard and dragging the mouse to the right,
The size of the octahedron icon IC can be changed.
As shown in FIG. 2G, the Contro on the keyboard
By right-dragging the mouse while pressing the l key, the mouse can be moved while the octahedron icon IC is fixed (locked).

According to such an input method, a desired selection item can be selected and input by selecting an arbitrary surface of the octahedron icon IC displayed on the screen.
In addition, since the selection item is selected by actually rotating the three-dimensional figure, the feeling of operation and operability can be improved. Furthermore, since eight icons can be displayed substantially at one place, a limited display area can be effectively used. Further, the operation of the icon can be performed at almost one place on the screen, and the input process can be facilitated.

Next, the structure and operation of the data processing system which enables such an input operation will be described. As shown in FIG. 3, the data processing system includes a control unit 11
A display device 12, a display memory (VRAM) 13,
Memory 14 and mouse interface (I / F) 15
, Mouse 16, and keyboard interface (I /
F) 17, a keyboard 18, and a bus 19.

The memory 14 stores an application program (AP) including a function of displaying and controlling the octahedron icon IC together with an OS (operating system) and the like. The memory 14 also stores the coordinates of the vertices of the octahedron icon IC, the selection items assigned to each surface, a flag indicating whether or not the octahedron icon IC is displayed, and the like.

The control unit 11 is composed of an MPU (microprocessor unit) or the like, operates according to a program stored in the memory 14, and controls the entire system.
The display memory 13 stores image data defining a display image including the octahedron icon IC in a bitmap format or the like. The display device 12 displays the image defined by the image data stored in the display memory 13 under the control of the control unit 11.

The mouse 16 is provided with a right button and a left button, and inputs position information, selection information and the like. Mouse I / F1
5 notifies the control unit 11 of the information input from the mouse 16. The keyboard 18 inputs key operation information, and the keyboard I / F 17 notifies the control unit 11 of the information input from the keyboard 87. The bus 19 communicates data between the units.

FIG. 4 shows a logical configuration of this data processing system. As shown in the figure, an operating system (OS) 22 is located on hardware 21 including a mouse 16 and a keyboard 18, and an application program (AP) 23 is located above it.

In the data processing system having such a configuration, a process for enabling the above-described octahedron icon IC to be operated will be described with reference to the drawings. FIG. 5 shows the structure of AP23. As shown in the figure, the AP 23 includes a module that acquires a message from the OS 22, and processing modules such as a window creation process M1 and a right mouse click process M2 that are activated in response to this message.

(I) Creating a window / drawing an octahedron icon When a predetermined command is input on the OS22 or an icon is clicked, the OS22 activates the AP23. When the AP 23 is activated, it starts the routine shown in FIG. In this routine, the AP 23
It is further determined whether or not any message has been notified via a queue or the like (step S1). If it is determined that there is no notification, the flow returns to step S1 and the same processing is repeated until there is a notification. When some message is notified from the OS 22, the AP 23 performs step S
It is detected that there is a notification in 1, and in step S2, the notified message is acquired, and the process jumps to the module that executes the process corresponding to the acquired message.

When the OS 22 starts the AP 23, the OS 22 notifies the AP 23 of a message to open a new window. This notification is detected in step S1, and the flow proceeds to step S2. In step S2, a message from the OS 22 is acquired, and the window creation module M1 shown in FIG. 5 is activated according to this message.
The window creation processing module M1 opens a new window and writes the window image and the initial image of the octahedron icon IC shown in FIG. 6 on the display memory 13. As a result, the initial screen shown in FIG. 1 is displayed on the display device 12.

The window creation module M1 assigns the coordinates (x ₁ , y ₁ ) to (x ₃ , y ₃ ) of the vertices of the front surface (active surface) of the drawn octahedron icon IC and the active surface. The selected selection item (file) and the icon flag indicating that the octahedron icon IC is displayed are stored in the memory 14. After finishing these processes,
The flow returns to step S2 and waits for the next input.

(Ii) Selection processing When the mouse 16 is right-clicked, this fact is notified to the device driver of the OS 22 via the hardware 21. The OS 22 notifies the AP 23 that the mouse 16 has been right-clicked. This notification is detected in step S1, and the right click processing module M2 is activated in step S2.

The right-click processing module M2 acquires the current position of the mouse cursor from the OS 22, as shown in FIG. 7 (step S11). Then, it is determined whether or not the mouse cursor is located on the active surface of the octahedron icon IC, by the coordinates (x) of the vertex set in the memory 14.
_The determination is made based on ₁ , y ₁ ) to (x ₃ , y ₃ ) (step S12).

When it is determined that the mouse cursor is located on the active surface of the octahedron icon IC, the memory 1
The selection item (“process A” in the example of FIG. 6) assigned to the active surface stored in No. 4 is acquired (step S13). Subsequently, a message to the effect that the process corresponding to the acquired selection item should be executed is transmitted to the OS 22 (step S1).
4), end the process. When it is determined in step S12 that the mouse cursor is not located on the active surface of the octahedron icon IC, the processing ends.

The message issued in step S14 is supplied to the OS 22 via the queue, and the OS 22 notifies the AP 23 of the message to the effect that the process corresponding to the selected item should be performed. This notification is determined in step S1, and the module M1 for executing the corresponding process, that is, the process A is started from step S2 and the process A is executed.

When there is a specific process content to be selected as the content of the "process A", when the process A module M3 is activated, as shown in FIG. A plurality of sub-icons IC1 to IC3 for selecting corresponding processing and the like are drawn. At this time, the coordinates of the vertices of the front surface of each of the sub icons IC1 to IC3, the selection items assigned to the surface, and the sub icon display flag indicating that the sub icon is displayed are stored in the memory 14.
Is stored in By right-clicking on the front surface of each of the sub icons IC1 to IC3, the original octahedron icon I
As in the case of selecting C, the items assigned to the surface can be selected.

Similarly, for example, when the surface to which the selection item "process B" having no subordinate concept is assigned is right-clicked, the print B module M4 is activated and the corresponding process is executed.

(Iii) Rotation of Octahedron Icon IC The mouse I / F 15 generates an interrupt each time the mouse 16 moves, and notifies the device driver of the OS 22 of the position of the mouse 16. The OS 22 saves the current position of the mouse cursor supplied from the I / F 15 in the memory 14 and updates the position of the mouse cursor for drawing. Further, the OS 22 notifies the AP 23 of a message indicating that the mouse movement interrupt has occurred.

This message is detected in step S1, and the mouse movement interrupt processing module M5 is activated in step S2. In the mouse movement interrupt process, A
As shown in FIG. 9, P23 reads out the positions (coordinates) x _i-1 and y _i-1 of the mouse cursor saved when the mouse movement interrupt process was performed last time (step S21).
Then, the current mouse cursor positions x _i and y _i stored in the memory 14 are read (step S22).

Then, a line segment connecting the vertices is obtained from the coordinates of the vertices stored in the memory 14 (step S2).
3) It is determined whether or not the two coordinates are located on both sides of this line segment (step S24). When the two coordinates are not located on both sides of the boundary line, that is, when the mouse cursor does not cross the boundary line of the faces forming the octahedron, the process is terminated and the process returns to step S2. On the other hand, when the two coordinates are located on both sides of the boundary line, that is, when the mouse cursor crosses the boundary line of the surface forming the octahedron, the moving direction of the mouse cursor is obtained (step S25). .

Subsequently, the OS 22 is notified of a message requesting to issue an instruction to rotate the octahedron icon in the detected movement direction of the mouse cursor (step S26), and the process returns to step S2.

The OS 22 notified by the AP 23
The AP 23 is notified of an instruction to rotate the surface icon IC in the moving direction of the mouse cursor. This notification is detected in step S1, and the icon rotation processing module M6 is activated in step S2. In this icon rotation processing, the AP 23 rotates the octahedron icon in the designated direction. That is, the rotated icon is drawn. In addition, the coordinates of the vertex of the active surface after rotation and the selected selection item are saved in the memory 14. Then, the process returns to step S2. After that, when the active face of the displayed octahedron icon is right-clicked, the selection item assigned to that face is selected.

(Iv) Closing / Opening Icon When the mouse 16 is left-clicked, this fact is notified to the device driver of the OS 22 via the hardware (I / F), and the OS 22 causes the AP 23 to left-click the mouse 16. Notify that. This notification is detected in step S1, and the left click processing M7 is performed in step S2.
Is started. First, as shown in FIG. 10, it is determined whether or not the icon display flag is set in the memory 14 (step S31), and if it is set, is the sub icon display flag set in the memory 14? It is determined whether or not (step S32). When the sub icon display flag is set, the sub icon is erased and the sub icon display flag is reset (step S33).

If it is determined in step S32 that the sub-icon display flag is not set, the octahedron icon IC is erased and the icon display flag is reset (step S34). Step S31
If it is determined that the icon display flag is not set, the octahedron icon IC is drawn, the coordinates of the vertices of the active surface, the selection items assigned to that surface, etc. are saved, and the icon The display flag is set (step S35). When these processes are completed, the flow returns to step S2.

(V) Right drag of mouse When the operator right drags the mouse 16, the fact is notified from the hardware 21 to the OS 22, and the O
The AP is notified from S22. The AP 23 determines this notification in step S1, and activates the right drag processing module M8 in step S2. As shown in FIG. 11, in this process, the current mouse cursor positions x _i and y _i are read (step S41). continue,
It is determined whether or not the current mouse cursor is located on the octahedron icon or the sub icon (step S42).
If it is determined that the vehicle is not located, the process returns to step S2. When it is determined that the mouse cursor is positioned, the position (coordinates) of the mouse cursor of the immediately preceding mouse cursor x
_i-1 and y _i-1 are read (step S43).

Subsequently, the coordinates (x _i-1 , y _i-1 ) and (x _i ,
The moving direction and the moving amount of the mouse cursor are obtained from y _i ) (step S44). Then, AP2 is issued an instruction to move the octahedron icon where the mouse cursor is located in the moving direction of the mouse cursor by the moving amount of the mouse cursor.
The OS 22 is notified of a message requesting that it be issued to the OS 3 (step S45), and the process returns to step S2.

Upon receiving the notification, the OS 22 notifies the AP 23 of an instruction to move the octahedron icon IC in the moving direction of the mouse cursor by the moving amount of the mouse cursor.
This notification is detected in step S1, and the icon movement processing module M9 is activated in step S2.

In this icon moving process, AP23
Moves the octahedron icon in the designated direction by the designated amount. That is, the octahedron icon IC is drawn at the position moved by the instructed amount in the instructed direction. Further, the coordinates of the vertices of the active surface after the movement are saved in the memory 14. After that, the flow returns to step S2. While dragging the mouse 16 to the right, the hardware 21
Notifies the OS 22 of the right drag, and the above-described processing is repeated to move the octahedron icon IC. The sub-icon can be moved in the same manner.

(Vi) Change of icon of octahedron icon When the operator right-drags the mouse 16 while pressing the "Alt" key of the keyboard 18, this is notified from the hardware 21 to the OS 22, and further, OS22
To AP23. The AP 23 determines this notification in step S1, and in step S2, “Alt
++ drag ”processing module M10 is started. FIG.
As shown in 2, in this process, the mouse cursor positions (coordinates) x _i-1 and y _i-1 of the immediately preceding mouse cursor are read (step S51). Then, the current mouse cursor positions x _i and y _i are read (step S52).

Then, the coordinates (x _i-1 , y _i-1 ) and (x _i ,
The moving direction of the mouse cursor is obtained from y _i ) (step S53). The direction of movement is determined (step S54), and in the case of rightward, an instruction to shrink the octahedron icon A
OS22 sends a message requesting P23 to issue
(Step S55) and returns to step S2. When the moving direction is the left direction, the OS 22 is notified of a message requesting the AP 23 to issue an instruction to enlarge the octahedron icon (step S56), and the process returns to step S2.

Upon receiving the notification, the OS 22 notifies the AP 23 of an instruction to enlarge or reduce the octahedron icon IC. This notification is detected in step S1, and step S2
Then, the size change processing module M11 is activated. In the size changing process, the AP 23 draws the octahedron icon by enlarging or reducing it by one step. Further, the coordinates of the vertices of the active surface after the size change are saved in the memory 14.
After that, the flow returns to step S2. "Al
While the mouse 16 is right-draged while pressing the "t" key, the hardware 21 notifies the OS 22 of the right-drag, the above-described processing is repeated, and the size of the octahedron icon is changed to an arbitrary size. If the sub icon is displayed, the size of the sub icon is changed.

(Vii) Octahedral icon lock When the operator operates the mouse 16 while pressing the "Control" key of the keyboard 18, the hardware 21 (I / F) ignores this operation. Therefore, while maintaining the position and size of the octahedron icon, mouse 1
6 can be moved.

As described above, according to the present invention,
By assigning a predetermined selection item (processing or function) to each face of the octahedron displayed on the screen, making any face the front, and clicking the face, select the selection item assigned to that face. It was decided to. According to such a configuration, since the input processing is performed by operating the three-dimensional icon, the presence and the operation feeling are improved, and the operability is also improved. In addition, it is possible to effectively use the screen of the display device 12 having a limited size, and further, it is not necessary to disperse the consciousness during the screen operation, so that the work efficiency can be improved.

(Second Embodiment) In the first embodiment, it is necessary to position the mouse cursor on the octahedron icon in order to operate the octahedron icon. However, when the displayed selection target is only the octahedron icon, it is not necessary to position the mouse cursor on the icon. For example, regardless of the position of the mouse cursor, (i) when the mouse 16 is right-clicked, the item assigned to the front face (active face) of the octahedron icon is selected and executed, and (ii) the mouse 16 When the icon moves, rotate the octahedron icon, and (iii) Mouse 1
The octahedron icon may be moved when 6 is dragged to the right.

In this case, the operator does not need to be aware of the position of the mouse cursor and can perform input processing and icon operation with simple operations. Further, it is not necessary to determine whether or not the mouse cursor is located on the predetermined surface, and the processing is simplified.

(Third Embodiment) In the first embodiment, only the front surface of the octahedron icon is made active and only that surface can be selected. Any of these may be selectable. In this case, when the octahedron icon is drawn, the coordinates of the vertices of each face and the items assigned to each face are stored in the memory 14.
When the mouse 16 is right-clicked, the position of the mouse cursor is determined, the face on which the mouse cursor is located is determined from the coordinates of the vertices of each face stored in the memory 14, and the face is assigned to that face. The selection item is determined, and the process corresponding to the selection item is executed. With such a configuration, the number of operations for rotating the octahedron icon can be reduced.

Similarly, as shown in FIG. 8, even when a plurality of octahedron icons are displayed, any face of any icon may be selected.

As described above, according to the present invention,
By assigning an arbitrary item to each face of the polyhedron (solid), displaying and selecting the required face, the item assigned to that face can be selected and input, and the corresponding processing can be executed.

Note that the present invention is not limited to the above embodiment, and various modifications and applications are possible. For example, although the example of the octahedron icon is shown in the embodiment,
The number of surfaces and the shape are arbitrary. For example, a tetrahedron as shown in FIG. 13 may be used. In this case, only the front side is displayed. Further, the operation (mouse operation, keyboard operation) for operating the polyhedron icon can be arbitrarily changed.
Furthermore, selection items (menu items) assigned to each face of the polyhedron (three-dimensional) are arbitrary.

[0057]

As described above, according to the present invention, desired input can be performed with good operability and by effectively utilizing the screen.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of a screen of a data processing system according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating an operation of a polyhedron icon displayed on a screen.

FIG. 3 is a block diagram of a data processing system according to an embodiment of the present invention.

FIG. 4 is a diagram showing a logical configuration of the data processing device shown in FIG.

FIG. 5 is a diagram for explaining an application program that enables an icon operation.

FIG. 6 is a diagram showing an example of a displayed polyhedron icon.

FIG. 7 is a flowchart for explaining mouse right-click processing.

FIG. 8 is a diagram showing an example of a sub icon.

FIG. 9 is a flowchart illustrating a mouse movement interrupt process.

FIG. 10 is a flowchart illustrating a left click process.

FIG. 11 is a flowchart illustrating a right drag process.

FIG. 12 is a flowchart for explaining an “Alt + right drag” process.

FIG. 13 is a diagram showing another example of a polyhedron icon.

[Explanation of symbols]

 11 Control Unit 12 Display Device 13 Display Memory 14 Memory 15 Mouse Interface (I / F) 16 Mouse 17 Keyboard Interface (I / F) 18 Keyboard 19 Bus 21 Hardware 22 Operating System (OS) 23 Application Program (AP) IC Polyhedron icon

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Jiro Ishii 2-1-2 Kanda, Uchida, Chiyoda-ku, Tokyo Nikkei Video, Inc.

Claims (10)

[Claims] 1. A display means for displaying a polyhedron on a screen, an allocating means for allocating a predetermined process to each surface of the polyhedron, an instructing means for instructing a surface of the polyhedron, and an instruction by the instructing means of the polyhedron. A data processing system, comprising: an executing unit that executes the process assigned by the assigning unit. 2. The data processing system according to claim 1, further comprising means for rotating the polyhedron to change a displayed surface. 3. The data processing according to claim 1, wherein the instructing means includes means for selecting a surface displayed in front of a plurality of displayed surfaces of the polyhedron. system. 4. The executing means comprises means for displaying a polyhedron for selecting a process located below the process assigned to the plane designated by the designating means. 2. The data processing system according to 2 or 3. 5. A display control means for displaying a solid body to which a menu item is assigned to each surface, an input means for selecting an arbitrary surface of the solid body displayed by the display control means, and a selection by the input means. A data processing system, comprising: a selection control unit that selects a menu item assigned to the surface. 6. The data processing system according to claim 5, wherein the input means includes means for rotating the solid to change a surface being displayed. 7. The input means comprises means for selecting a surface displayed in front of a plurality of surfaces of the solid displayed by the display control means. The data processing system described in. 8. The apparatus further comprises means for executing processing corresponding to the menu item selected by the selection control means.
The data processing system according to claim 5, 6 or 7, characterized in that. 9. A process for displaying a polyhedron having a plurality of faces, each of which is assigned a predetermined item, selecting any face of the displayed polyhedron, and processing corresponding to the item assigned to the selected face. The input method is characterized by executing. 10. The input method according to claim 9, wherein the polyhedron is rotated to display a surface to be selected, and then the corresponding surface is selected.