JPH11272387A - Display indication device and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate various operations using graphical user interface even in a computer system whose display screen is small by executing an indication corresponding to a display element in selecting the display element which is enlarged/displayed by an enlargement display means. SOLUTION: A handwriting gesture 11 by a user is executed by using a pen 2 (A). When the user executes the handwriting gesture 20 (C) after a window maximizing key 12 which is enlarged/displayed is selected by using the pen 2 (B), it is judged to be not a gesture on enlargement. Then, it is judged whether an indication is on a restoration gesture or not. Since the handwriting gesture 20 which the user executes is considered to be matched with the restoration gesture (B) registered in a storage device, it is restored/displayed on a display screen as shown in a saved original picture (D). Then, indication key possible area information saved in an indication key table is restored.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display instruction device,
The present invention relates to a recording medium on which a program for causing a computer to perform a display instruction operation is recorded.

[0002]

2. Description of the Related Art For example, such as WINDOWS 95 (registered trademark) and X-WINDOW (registered trademark),
In a computer system having a graphical user interface (GUI), when a user selects a specific icon such as an instruction button on a display screen using a pointing device such as a mouse, a pen (handwriting input device), or an electronic tablet, the user can select the icon. Processing assigned to the selected icon is performed.

[0003]

However, when a graphical user interface is to be realized in a computer system having a small display screen such as a portable information terminal, the displayed icons are displayed in a reduced state. Therefore, there is a problem that it is difficult to issue a command or select an icon.

An object of the present invention is to make it possible to easily perform various operations using a graphical user interface even in a computer system having a small display screen.

[0005]

Means of the present invention are as follows. The enlargement display means enlarges at least the display element for which the instruction for enlargement display has been issued, when there is an instruction to enlarge the display element displayed on the display screen.

[0006] The execution means, when a display element enlarged and displayed by the enlargement display means is selected, executes an instruction corresponding to the display element. The means of the invention of claim 7 is as follows.

[0007] A computer-readable recording medium stores a program including instructions for causing the computer to execute the following processing. The first process is a process in which, when an instruction to enlarge a display element displayed on the display screen is issued, at least the display element for which the enlargement instruction is given is enlarged and displayed.

[0008] The second process is a process for executing an instruction corresponding to the display element when an enlarged display element is selected. The operation of the means of the first and seventh aspects of the present invention is as follows.

When an instruction to enlarge a display element (for example, an instruction button such as a window size maximizing button) displayed on the display screen is given, at least the display element for which the instruction for enlargement display is given is enlarged. When a displayed and enlarged display element is selected, an instruction corresponding to the display element (here, an instruction to maximize the window size) is executed.

[0010]

Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a diagram showing a configuration of a portable information terminal to which a display instruction device according to the present invention is applied, and reference numeral 1 in the figure denotes a CPU as a control unit for controlling the entire terminal. Reference numeral 2 denotes a (handwritten) input device such as a pen. 4 is a display device such as a liquid crystal display,
Various icons and characters including an instruction button can be displayed. Reference numeral 3 denotes a RAM in which a processing program executed by the CPU 1 and data are stored in advance. Reference numeral 6 denotes a storage device for storing an instruction button table described later in the present embodiment. Reference numeral 7 denotes a communication line through which various kinds of data can be exchanged with the outside via the communication line 7.

FIG. 2 is a diagram showing a configuration of an instruction button table in which information on each of a plurality of instruction buttons displayed on the display screen of the display device 4 is stored. As shown in FIG. 2, coordinate information on a corresponding instructable area, save information when the image displayed at that time is temporarily saved when an instruction button enlargement is instructed, and an instruction command include It is stored for each instruction button.

FIGS. 3A, 3B, and 3C are diagrams showing an example of a handwritten gesture for instructing to enlarge an instruction button displayed on a display screen. In the present embodiment, as shown in FIGS. 3A, 3B, and 3C,
Gestures of various types are registered in the storage device 6 in advance, the gesture shown in FIG. 3A is a gesture for enlarged display, the gesture shown in FIG. 3B is a restoration gesture, and FIG. Is another gesture. The same gesture may be used for the enlarged display gesture and the restoration gesture. Also, a desired number of gestures can be registered.

Hereinafter, the operation of the CPU 1 relating to the pointing instruction according to the first embodiment of the present invention will be described with reference to FIGS. It is determined whether or not the user has performed a pointing operation using the input device 2 such as a pen (step S2). If the user has performed any pointing operation, it is determined whether or not this is a gesture instruction (step S3). . In the case of NO here, the process proceeds to step S4 to execute an instruction command corresponding to the indicated instruction button, and returns to step S2.

On the other hand, if it is determined in step S3 that a gesture instruction has been issued, it is determined whether or not this is a gesture instruction relating to enlargement (step S3).
9). In this case, as shown in FIG. 5A, a handwritten gesture 11
Is registered in advance in the storage device 6 in FIG.
It is determined whether the gesture matches the gesture for enlarged display shown in FIG. As can be seen from the figure, since it is considered that they match, next, it is determined whether or not the enlargement gesture is the first time (step S10). Here, in the case of NO, the process proceeds to step S13. In the case of YES, the original image, that is, the image shown in FIG. 5A is evacuated to a predetermined position in the storage device 6 (step S11), and the instruction button (here, window maximization) in the instruction button table is saved. Button 12) Saves the save information of the original image at the corresponding save information position (step S12), and proceeds to step S13.

In step S13, as shown in FIG. 5B, a window maximization button 12 and an instructable area including an instructing button in the vicinity thereof are enlarged and displayed. Next, enlargement setting is performed on the instructionable area coordinate information position corresponding to the enlargedly displayed instruction button in the instruction button table according to the enlarged image position (step S14). Next, step S1
Proceeding to 5, the setting is made in the instruction button table to disable the instructable area coordinate information position corresponding to the instruction button that has not been enlargedly displayed (step S15), and the process returns. Next, when the user makes the same enlargement gesture again, the instruction button enlarged and displayed twice and the surrounding area are further enlarged and displayed twice.

After selecting the window maximized button 12 enlarged and displayed as described above using the pen 2 as shown in FIG. 5B, the user presses the handwritten gesture 20 as shown in FIG. 5C. If so, the determination in step S9 is NO, so the process moves to step S5 to determine whether the instruction is for a restoration gesture (step S5). Handwritten gesture 20 performed by user
Is considered to match the restoration gesture of FIG. 3B registered in the storage device 6, so that the determination in step S5 is YES, and the original image saved in step S11 is displayed as shown in FIG. 5D. The display is restored on the display screen (step S6). Next, the instruction button possible area information saved in the instruction button table is restored (step S7), and the process returns to step S2.

If the user has performed a gesture operation as shown in FIG. 3C, the determinations in steps S9 and S5 are both NO.
Proceed to step 8 to perform another gesture process, and execute step S
Return to 2.

According to the first embodiment, a desired instruction button is enlarged and displayed by a gesture operation, so that a pointing operation on the instruction button can be easily performed.

The present embodiment can be applied to a case where it is desired to enlarge characters and the like displayed on the screen instead of enlarging the instruction buttons. In this case, after performing the enlarged display, the original image is restored and displayed without performing the pointing operation.

Instead of performing the restoration display of the original image by the gesture, the restoration display may be automatically performed after a lapse of a predetermined time (here, several seconds) from the enlarged display, or the user may perform the pointing process. Immediately after the termination, the original image may be restored and displayed.

Next, a second embodiment of the present invention will be described with reference to FIG. Similarly, in the second embodiment, when a handwritten gesture 13 as shown in FIG. 6A is performed on the display screen of the display device 4 by the user, whether the gesture is an enlarged gesture, a restored gesture, or another gesture is performed. Then, if the gesture is an enlargement gesture, the icon (ellipse in the figure) 14 which the user wants to evacuate and operate the original image and an image nearby are enlarged and displayed as shown in FIG. 6B.

Here, the user operates the icon 14 with the pen 2.
Is selected and dragged in the direction of the arrow (→) and moved to the outer frame portion (screen size restoration area 15) of the instructable area as shown in FIG. 6C, the original image is automatically restored. Then, a screen as shown in FIG. 6D is displayed. At this time, the pen 2 keeps dragging the icon 14, and the user can drag the icon 14 to an arbitrary position from this state.

In the second embodiment, the icon 14
Is enlarged and then the icon 14 is selected by the pen 2 and the original image is restored while the icon 14 is selected. Therefore, even if the icon is difficult to select because the display is small, the icon 14 Can be easily obtained.

[0024]

According to the present invention, various operations using a graphical user interface can be easily performed even in a computer system having a small display screen.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a portable information terminal to which a display instruction device according to the present invention is applied.

FIG. 2 is a diagram showing a configuration of an instruction button table in which information about each of a plurality of instruction buttons displayed on a display screen of the display device shown in FIG. 1 is stored.

FIG. 3 is a diagram illustrating an example of a handwritten gesture for instructing to enlarge and display an instruction button displayed on a display screen.

FIG. 4 is a flowchart illustrating an operation of a CPU relating to a pointing instruction according to the first embodiment of the present invention.

FIG. 5 is a diagram for describing a pointing instruction according to the first embodiment of the present invention.

FIG. 6 is a diagram illustrating a pointing instruction according to a second embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... Input device (pen), 3 ... RAM, 4 ... Display device, 6 ... Storage device, 7 ... Communication line.

Claims (7)

[Claims] 1. An enlargement display means for enlarging and displaying at least a display element for which an instruction for enlargement display has been given when an instruction to enlarge a display element displayed on a display screen is given, Execution means for executing, when a display element enlarged and displayed by the means is selected, an instruction corresponding to the display element, the display instruction apparatus comprising: 2. A plurality of instruction buttons are displayed on the display screen as display elements.
The display instruction device according to claim 1, wherein the instruction button near the position is enlarged and displayed based on the position on the display screen designated by the pointing device. 3. The display instruction device according to claim 1, wherein the instruction for enlarging and displaying the display element is a handwriting gesture operation. 4. A restoration display means for restoring and displaying a display element enlarged and displayed on an original image, wherein restoration display by the restoration display means is performed after execution of an instruction by the execution means. The display instruction device according to claim 1, wherein 5. A restoration display means for restoring and displaying a display element enlarged and displayed on an original image, wherein the restoration display by the restoration display means elapses a predetermined time from the enlargement display by the enlargement display means. The display instruction device according to claim 1, wherein the display instruction device is automatically performed later. 6. A restoration display unit for restoring and displaying a display element enlarged and displayed on an original image, wherein restoration display by the restoration display unit is performed when a predetermined restoration area is designated by a pointing device. The display instruction device according to claim 1, wherein the display instruction device is displayed. 7. A process for enlarging and displaying at least a display element for which an instruction for enlarging display is given when an instruction for enlarging a display element displayed on a display screen is given, and displaying the enlarging display. A computer-readable recording medium storing a program including a process of executing an instruction corresponding to the display element when an element is selected, and a program for causing a computer to execute the following.