JP2005044026A - Instruction execution method, instruction execution program and instruction execution device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To support an operator to accurately and easily designate an object(button, icon or the like) on a screen at the time of designating various processing such as character input to equipment having a touch panel. <P>SOLUTION: When depressed positions on a screen stride over the display area of a plurality of objects, and those objects cannot be specified as one, the plurality of objects are emphasis-displayed(that is, enlarged) on the screen. Then, when an arbitrary position on the screen is depressed in that status, an instruction corresponding to the object where focus is positioned at that point of time is executed. Therefore, even when simultaneously touching a plurality of objects by mistake, an operator is able to obtain the same result as that when the operator accurately touches the target object from the beginning only by touching the arbitrary place on the screen in a timing when focus comes around to the emphasis-displayed target object. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an instruction execution method, an instruction execution program, and an instruction execution apparatus that specify an object designated by an operator from among a plurality of objects displayed on a screen and execute an instruction corresponding to the object.
[0002]
[Prior art]
A touch panel that can execute various commands (commands) such as character input and menu selection by touching an object (button, icon, etc.) on the screen with a finger is not familiar with the keyboard or is physically installed on the keyboard. As an input means when there is not enough space, it is widely used in personal computers, PDAs, ATMs, car navigation systems, and the like.
[0003]
And about this touch panel, conventionally, various devices for facilitating input have been proposed. For example, the key image corresponding to the key input on the touch panel is enlarged (for example, see Patent Document 1).
[0004]
In addition, since a plurality of keys are often pressed simultaneously on the touch panel, a plurality of pressed symbol areas are enlarged (see, for example, Patent Document 2), and the size of displayed image information is changed. Including a plurality of pressed keys (for example, see Patent Document 3), an enlarged display centered on a key pressed first, and returning to the original when the finger is released (for example, see Patent Document 4). A unit that displays a divided keyboard in an enlarged manner (see, for example, Patent Document 5), an item that can be easily input from a plurality of key arrangements, a region around a plurality of pressed keys, or a functional unit such as a calculator (For example, refer to Patent Document 6).
[0005]
Further, as a device for displaying an enlarged image according to an instruction from an operator, there is one that displays an enlarged image at a position that does not overlap the entire original image (see, for example, Patent Document 7).
[0006]
[Patent Document 1]
Japanese Patent No. 2595045 [Patent Document 2]
Japanese Patent No. 2531416 [Patent Document 3]
JP-A 63-004322 [Patent Document 4]
JP 2002-91677 A [Patent Document 5]
JP-A-8-234909 [Patent Document 6]
Japanese Patent No. 3235480 [Patent Document 7]
Japanese Patent Laid-Open No. 2000-250681
[Problems to be solved by the invention]
However, in the method of simply enlarging and displaying a plurality of pressed objects as in the above example, since the screen image changes significantly, necessary information that has been displayed until then may be hidden. Also, if the enlarged area is still difficult to input, it takes time to recognize which part of the enlarged image should be touched.
[0008]
Furthermore, in the method of displaying the enlarged image at a position that does not cover the original image, it is not possible to secure a sufficient area for displaying the enlarged image because the entire original image is displayed, and operability problems still remain. There was a problem.
[0009]
In order to solve the above-described problems caused by the prior art, the present invention provides an instruction execution method capable of assisting an operator so that an object on a screen can be specified accurately and easily in order to instruct various processes including character input. An object is to provide an instruction execution program and an instruction execution device.
[0010]
[Means for Solving the Problems]
In order to solve the above-described problems and achieve the object, an instruction execution method, an instruction execution program, or an instruction execution apparatus according to the present invention specifies a plurality of objects displayed on a screen that are designated by an operator. In the command execution method, command execution program, or command execution device that executes the command corresponding to the object, the object specified by the operator is identified from the coordinates of the pressed position on the screen, and the object is identified as one. When it is not possible, a highlighted image of a plurality of objects that are candidates for the above object is displayed, and when an arbitrary place on the screen is pressed in that state, the currently selected object (the focus is located) The instruction corresponding to the (object) is executed.
[0011]
According to the above invention, even when a plurality of objects are accidentally touched at the same time, the focus can be placed at any place on the screen at the timing when the focused object (specifically, enlarged) is focused. Just by touching, an instruction corresponding to the object can be executed in the same manner as when only the target object is touched.
[0012]
Note that the meaning of “press” in the present invention does not only refer to the case where pressure is actually applied to the touch panel or the like, but “sense” when a person's finger or the like is touched or approached to thereby select an object. Includes “contact” and “approach”.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Exemplary embodiments of an instruction execution method, an instruction execution program, and an instruction execution apparatus according to the present invention will be explained below in detail with reference to the accompanying drawings.
[0014]
FIG. 1 is an explanatory diagram functionally showing the configuration of the instruction execution device according to the embodiment of the present invention. The instruction execution apparatus according to the embodiment of the present invention is specifically a personal computer provided with a touch panel 100. The HD (hard disk) holds a program that displays a calculator function, that is, a virtual computer, and performs four arithmetic operations in real time according to an operator's instruction.
[0015]
Among the units shown in the figure, the storage unit 103 is realized by the HD, and the display control unit 102, the input coordinate calculation unit 104, the output coordinate calculation unit 105, and the instruction execution unit 106 are read by the CPU (processor) from the HD to the RAM. This is realized by executing the above program. In addition to HD, this program can be stored and distributed in various recording media such as FD, CD-RW, and MO, and can also be distributed via a network.
[0016]
FIG. 2 is a flowchart showing a procedure of command execution processing (processing for receiving various inputs from touch panel 100) in the command execution device according to the embodiment of the present invention. In the following, the function of each unit shown in FIG. 1 will be described in order according to the procedure shown in FIG.
[0017]
First, the apparatus reads out, for example, operation screen data as shown in FIG. 3 from the storage unit 103 by the image reading unit 102 a of the display control unit 102, and outputs it to the output coordinate calculation unit 105. The output coordinate calculation unit 105 calculates a position (output coordinates) at which the screen should be displayed on the display 101, and outputs (displays) the screen at the position (step S201).
[0018]
When the touch panel 100 on the front surface of the display 101 is pressed with a finger or the like in this state (step S202: Yes), a predetermined input signal is output from the touch panel 100 to the input coordinate calculation unit 104, and the input coordinate calculation unit 104 outputs the above signal. From this, the pressed screen position (input coordinates) is calculated (step S203).
[0019]
The input coordinates calculated here are output from the input coordinate calculation unit 104 to the object specifying unit 102b of the display control unit 102, and the object specifying unit 102b inputs the input coordinates and the coordinates of each object being displayed on the display 101 (the latter). The coordinates are managed by the output coordinate calculation unit 105).
[0020]
Then, when the pressed object cannot be identified as one object, for example, when the input coordinates extend over both the display area of the object A and the display area of the object B (step S204: No), the image is displayed. The reading unit 102a is instructed to read the emphasized image of each object from the storage unit 103 (step S205).
[0021]
For example, when the position touched with the finger on the operation screen shown in FIG. 3 extends over both the “9” button 300 and the “÷” button 301, the emphasized image taken out above is specifically shown in FIG. These are two images (enlarged images of the “9” button 300 and the “÷” button 301). In other words, each of the highlighted images of a plurality of candidates that cannot be specified as one but may be an object intended by the operator is read out.
[0022]
Although the specific form of emphasis is enlargement here, the form of emphasis is arbitrary, such as some deformation not limited to enlargement, change of color and brightness, blinking or blinking, or reading out the object name by automatic voice. In short, any form may be used as long as it is more conspicuous than the normal display form.
[0023]
In addition, here, the emphasis image of each object is prepared in advance in the storage unit 103, but each time a plurality of objects are pressed, each emphasis image may be created from a normal image.
[0024]
Each image is output from the image reading unit 102a to the output coordinate calculation unit 105, and the output coordinate calculation unit 105 calculates a position (output coordinate) at which the image should be displayed on the display 101 (step S206). The output coordinates are determined so that, for example, the emphasized images of the respective objects are arranged at equal intervals around the average value (center) of the input coordinates. Alternatively, it may be determined so that the center of the display area of each object (normal size) currently displayed matches the center of the display area of each object (enlarged size) after redisplay.
[0025]
However, at this time, when the display area of the object after re-displaying overlaps the area designated in advance (step S207: Yes), the output coordinate calculation unit 105 does not overlap the output coordinates calculated above. (Step S208).
[0026]
Here, it is assumed that this area is, for example, an input character area 302 (an area where characters input from the touch panel 100 are echoed). If the coordinates calculated in step S206 remain as they are, the upper end of the enlarged object falls on the input character area 302. In step S208, the output coordinates of the emphasized image are moved to a position where the input characters are not hidden behind them. Correct downward. Thereafter, each image is output (displayed) to the position calculated on the display 101 (corrected as necessary) (step S209).
[0027]
On the other hand, the focus control unit 102c of the display control unit 102 selects one of the highlighted objects as the object at the focus (step S210), and selects identification information of the object, that is, which object. The output coordinate calculation unit 105 is notified of whether it has been performed.
[0028]
Then, the output coordinate calculation unit 105 calculates, for example, the coordinates of the area corresponding to the outer edge or outer frame from the current display area of the selected object (highlighted) (step S211), and moves the cursor to the position on the display 101. Output (display) (step S212).
[0029]
FIG. 5 is an explanatory diagram showing an example of the operation screen immediately after step S212. As shown in the figure, the buttons 300 and 301 shown in FIG. 3 are enlarged to the buttons 500 and 501, respectively (note that the buttons 500 and 501 are displayed avoiding the input character area 502) and selected. A cursor 503 is displayed around the button 500.
[0030]
On the other hand, the time measuring unit 102d of the display control unit 102 starts measuring the elapsed time from the time of selection in step S210, and when a predetermined time (for example, 1 second) elapses without any input (step S213: No, step (S214: Yes), a signal to that effect is output to the focus control unit 102c.
[0031]
In response to this, the focus control unit 102c selects one object different from the previously selected object (step S210). As a result, for example, the cursor 503 located on the button 500 on the screen of FIG. Is redisplayed (moved) to the position (steps S211 and S212).
[0032]
The predetermined time measured by the time measuring unit 102d can be freely set in advance by the operator. In general, this time may be shorter in a personal computer, PDA, etc., but it is easier to use a longer setting in an apparatus such as a car navigation system where the operator cannot always concentrate on input.
[0033]
Here, unless there is any input during highlighting, the focus is cyclically circulated through each object. However, for example, there is no input even if steps S210 to S214 are repeated a preset number of times. In such a case, the highlighted image displayed in step S209 may be deleted and the operation screen of FIG. 3 may be returned.
[0034]
In addition, the order of the focus may be any order. In addition to Z-shaped movement such as upper left corner → upper right corner → lower left corner → lower right corner, an object that is more likely to be an object intended by the operator (For example, an object in which most of the input coordinates are included in the display area of the object) may be focused preferentially.
[0035]
On the other hand, when somewhere on the touch panel 100 (regardless of location) is pressed while the screen of FIG. 5 is displayed (step S213: Yes), the input coordinates calculated by the input coordinate calculation unit 104 are displayed. The data is output to the object specifying unit 102b of the unit 102.
[0036]
Then, the object specifying unit 102b inquires to the focus control unit 102c which object is currently focused, and controls the identification information of the object to be executed by the instruction execution unit 106 (execution of a command corresponding to the identification information). To the functional unit) (step S215).
[0037]
If the object can be uniquely identified in step S204 (step S204: Yes), steps S205 to S214 are omitted, and the identification information of the object is directly output in step S215.
[0038]
According to the embodiment described above, when a plurality of objects are accidentally touched at the same time, the plurality of objects are highlighted (for example, enlarged display) and the focus located in any one of them is constant. Move sequentially at time intervals. Then, while the focus is on a certain object, an input corresponding to the object can be performed only by touching an arbitrary place on the touch panel 100.
[0039]
As described above, since only the object such as the button is highlighted instead of the entire screen or the peripheral area of the input coordinates, the screen does not flicker and it is difficult to input. Further, any part of the touch panel 100 that is touched during highlighting is regarded as an input to the focused object, so that it is possible to input quickly and accurately without having to search again for a place to touch on the screen after highlighting. .
[0040]
Therefore, if you accidentally touch multiple objects at the same time, just touch anywhere on the screen when the highlighted object (specifically, enlargement) reaches the focus, Since it is possible to execute a command corresponding to the object as if only the target object was touched, it is possible to specify the object on the screen accurately and easily when instructing various processes including character input. It is possible to assist the operator so that it can be performed easily.
[0041]
In addition, since the input result and information essential for input are displayed and the object is enlarged so as to avoid an area that is not desirable to hide behind the object, specifically, for example, the input character area 502, The emphasis does not make it difficult to input.
[0042]
In addition, although embodiment mentioned above is an example with two pressed objects, this number may be any number. For example, FIG. 6 shows an example of the screen of the software keyboard, and FIG. 7 shows an example of highlighting when the input coordinates span four objects of “I”, “O”, “K”, and “L” in the screen of FIG. It is. Basically the same as FIG. 5 except that the expression of the focus located at “O” is slightly different from the above-described embodiment (the object itself is shaded in addition to the cursor on the outer edge). It is.
[0043]
In addition to the above, the focus can be expressed by blinking of an object. For example, FIG. 8 is an example of a window having a scroll bar, and FIG. 9 is an example of highlighting when the input coordinates extend over both the up scroll button 800 and the down scroll button 801 in the screen of FIG. The buttons 800 and 801 are enlarged to the buttons 900 and 901, respectively, and the focused button 900 is blinking.
[0044]
In the above example, the buttons 800 and 801 are enlarged toward the outside of the window so that the emphasized object does not hide the data in the window (data in the scrolled area).
[0045]
Although the above are examples of personal computer screens, the present invention can be applied to any device including the touch panel 100 and the display 101. For example, FIG. 10 shows an example of a mobile phone screen having a calendar display function, and FIG. 11 shows the screen of FIG. 10, which covers four objects whose input coordinates are “8”, “9”, “15”, and “16”. It is an example of the highlight display in a case. The screen of FIG. 11 is essentially the same as the screens of FIG. 5, FIG. 7, and FIG.
[0046]
In particular, a device such as a mobile phone with a small display 101 tends to accidentally press a plurality of objects at a time, but according to the present invention, it waits for the focus to go around the target object. Since it is only necessary to touch an appropriate place on the screen, erroneous operations can be easily corrected.
[0047]
The instruction execution method in the present embodiment may be a computer-readable program prepared in advance, and is realized by executing the program on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as HD (hard disk), FD (flexible disk), CD-ROM, MO, and DVD, and is executed by being read from the recording medium by the computer. Further, this program may be a transmission medium that can be distributed via a network such as the Internet.
[0048]
(Supplementary note 1) In an instruction execution method for specifying an object designated by an operator from among a plurality of objects displayed on a screen and executing an instruction corresponding to the object,
An input coordinate calculation step of calculating the coordinates of the pressed position on the screen;
An object specifying step for specifying an object specified by the operator from the coordinates calculated in the input coordinate calculating step;
An emphasized image display step of displaying, on the screen, an emphasized image of a plurality of objects that are candidates for the object specified by the operator, when an object cannot be specified as one in the object specifying step;
An object selection step of selecting one of a plurality of objects on which the emphasized image is displayed in the emphasized image display step;
A command execution step of executing a command corresponding to the object selected in the object selection step when an arbitrary place on the screen on which the highlight image is displayed in the highlight image display step is pressed;
An instruction execution method comprising:
[0049]
(Supplementary Note 2) When the object specified by the operator cannot be specified as one, the coordinates calculated in the input coordinate calculation step span the display areas of a plurality of objects displayed on the screen The instruction execution method according to appendix 1, wherein
[0050]
(Additional remark 3) In the said emphasized image display process, the said emphasized image is displayed avoiding the display area where the predetermined information is displayed on the said screen, The command execution of the said additional remark 1 or Additional remark 2 characterized by the above-mentioned Method.
[0051]
(Appendix 4) In the appendix 1 to appendix 3, the object selection step selects another object instead of the previously selected object among the plurality of objects when a predetermined time elapses from the previous selection. The instruction execution method according to any one of the above.
[0052]
(Additional remark 5) It is the command execution program used when identifying the thing designated by the operator among the some objects displayed on the screen, and executing the command corresponding to the said object,
An input coordinate calculation step of calculating the coordinates of the pressed position on the screen;
An object specifying step for specifying an object specified by the operator from the coordinates calculated in the input coordinate calculating step;
An emphasized image display step of displaying, on the screen, an emphasized image of a plurality of objects that are candidates for the object specified by the operator, when an object cannot be specified as one in the object specifying step;
An object selection step of selecting one of a plurality of objects on which the emphasized image is displayed in the emphasized image display step;
A command execution step of executing a command corresponding to the object selected in the object selection step when an arbitrary place on the screen on which the highlight image is displayed in the highlight image display step is pressed;
An instruction execution program for causing a processor to execute the program.
[0053]
(Additional remark 6) In the command execution apparatus which specifies what was specified by the operator among the several objects displayed on the screen, and performs the command corresponding to the said object,
Input coordinate calculation means for calculating the coordinates of the position pressed on the screen;
Object specifying means for specifying the object specified by the operator from the coordinates calculated by the input coordinate calculating means;
An emphasized image display means for displaying, on the screen, an emphasized image of a plurality of objects that are candidates for the object specified by the operator when the object specifying means cannot identify one object;
An object selecting means for selecting one of a plurality of objects on which the emphasized image is displayed by the emphasized image display means;
A command execution unit that executes a command corresponding to the object selected by the object selection unit when an arbitrary place on the screen on which the highlight image is displayed by the highlight image display unit is pressed;
An instruction execution device comprising:
[0054]
【The invention's effect】
As described above, according to the present invention, a command execution method and command capable of assisting an operator so that an object on a screen can be specified accurately and easily when instructing various processes including character input. There is an effect that an execution program and an instruction execution device can be obtained.
[Brief description of the drawings]
FIG. 1 is an explanatory diagram functionally showing the configuration of an instruction execution device according to an embodiment of the present invention.
FIG. 2 is a flowchart showing a procedure of instruction execution processing in the instruction execution apparatus according to the embodiment of the present invention.
FIG. 3 is an explanatory diagram showing an example of an operation screen (normal display screen) of the instruction execution device according to the embodiment of the present invention.
4 is an explanatory diagram illustrating an example of an emphasized image of objects 300 and 301 on the operation screen illustrated in FIG. 3;
FIG. 5 is an explanatory diagram showing an example of an operation screen (highlight display screen) of the instruction execution device according to the embodiment of the present invention.
FIG. 6 is an explanatory diagram showing another example of the operation screen (normal display screen).
FIG. 7 is an explanatory diagram illustrating another example of the operation screen (highlight display screen).
FIG. 8 is an explanatory diagram illustrating another example of the operation screen (normal display screen).
FIG. 9 is an explanatory diagram illustrating another example of the operation screen (highlight display screen).
FIG. 10 is an explanatory diagram illustrating another example of the operation screen (normal display screen).
FIG. 11 is an explanatory diagram illustrating another example of the operation screen (highlight display screen).
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 100 Touch panel 101 Display 102 Display control part 102a Image reading part 102b Object specific part 102c Focus control part 102d Time measurement part 103 Storage part 104 Input coordinate calculation part 105 Output coordinate calculation part 106 Instruction execution part

Claims (3)

In an instruction execution method for executing an instruction corresponding to an object specified by an operator among a plurality of objects displayed on the screen,
An input coordinate calculation step of calculating the coordinates of the pressed position on the screen;
An object specifying step for specifying an object specified by the operator from the coordinates calculated in the input coordinate calculating step;
An emphasized image display step of displaying, on the screen, an emphasized image of a plurality of objects that are candidates for the object specified by the operator, when an object cannot be specified as one in the object specifying step;
An object selection step of selecting one of a plurality of objects on which the emphasized image is displayed in the emphasized image display step;
A command execution step of executing a command corresponding to the object selected in the object selection step when an arbitrary place on the screen on which the highlight image is displayed in the highlight image display step is pressed;
An instruction execution method comprising: An instruction execution program used when executing an instruction corresponding to an object specified by an operator among a plurality of objects displayed on the screen,
An input coordinate calculation step of calculating the coordinates of the pressed position on the screen;
An object specifying step for specifying an object specified by the operator from the coordinates calculated in the input coordinate calculating step;
An emphasized image display step of displaying, on the screen, an emphasized image of a plurality of objects that are candidates for the object specified by the operator, when an object cannot be specified as one in the object specifying step;
An object selection step of selecting one of a plurality of objects on which the emphasized image is displayed in the emphasized image display step;
A command execution step of executing a command corresponding to the object selected in the object selection step when an arbitrary place on the screen on which the highlight image is displayed in the highlight image display step is pressed;
An instruction execution program for causing a processor to execute In an instruction execution device that identifies an object specified by an operator among a plurality of objects displayed on the screen and executes an instruction corresponding to the object,
Input coordinate calculation means for calculating the coordinates of the position pressed on the screen;
Object specifying means for specifying the object specified by the operator from the coordinates calculated by the input coordinate calculating means;
An emphasized image display means for displaying, on the screen, an emphasized image of a plurality of objects that are candidates for the object specified by the operator when the object specifying means cannot identify one object;
An object selecting means for selecting one of a plurality of objects on which the emphasized image is displayed by the emphasized image display means;
A command execution unit that executes a command corresponding to the object selected by the object selection unit when an arbitrary place on the screen on which the highlight image is displayed by the highlight image display unit is pressed;
An instruction execution device comprising:

Images