JP3256994B2 - Display target movement method by touch input - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for arranging a touch panel on a display and performing display control by a touch input operation, and relates to a display object moving method for moving a display position of a display object by a touch input operation.

In recent years, an environment for handling various media such as moving images, still images, and texts has been increasing. In such an environment, in the conventional method, a method of opening a window corresponding to each medium and displaying the window in the corresponding window has been adopted. Therefore, there is a problem that it is difficult to see since each window operation is required, and it is difficult to recognize an individual relation of each medium.
Since it has been required to display interrelated media in a manner that is easy to understand, a so-called paper-based multimedia document display service has been proposed.

In the paper-based multimedia document display service, an intuitive operation is required for the operation. For example, it is required to display an object by directly touching the object on paper. As a result, it became necessary to use a touch panel.

However, the conventional touch panel mainly operates as a button, and it is required to use such a touch panel to effectively move and display an object on a display.

[0005]

2. Description of the Related Art FIG. 11 is a diagram for explaining a conventional display object moving method. First, when moving an object displayed on the screen with the keyboard 1, it is necessary to input a specific command. When moving the display object with the mouse 2, the mouse 2 is operated and the display 2 is moved. An operation such as specifying a specific icon (not shown) was required.

[0006]

Therefore, in the above-described method using the keyboard 1 and the mouse 2, the operation is difficult unless a user who has specialized knowledge of the computer system or a user who has abundant use experience. There was a problem that is.

Therefore, focusing on the fact that the touch panel 3 can directly touch a display target, the problem of operability is solved as compared with the keyboard 1 and the mouse 2, but as described above, Originally, the touch panel 3
Is mainly used as a button for instructing an icon or the like.Therefore, when using the touch panel 3 to move an object displayed on the screen, the accuracy of touch input by a finger is limited, and For a system that provides input to move to a position, this is a major problem in human interface.

[0008] Further, as compared with the above-mentioned mouse, light pen and the like, the input is largely different from that of the finger touch input. It is difficult to do, and the system needs to help in some way to assist.

Further, the resolution of the touch panel 3 is lower than the resolution of the display screen of the display, and the touch input coordinates can only specify a position corresponding to the resolution of the touch panel 3. Since it cannot be performed, some processing must be performed in order to specify such a fine position.

The present invention has been made in view of the above-mentioned conventional drawbacks, and is directed to an apparatus for arranging a touch panel on a display and performing display control by a touch input operation. To provide a user interface capable of performing a series of operations from a rough movement to a fine movement only by a touch operation, being easy to use, and reducing a mistake in designation of a position of a movement destination, and performing a movement quickly. It is intended for.

[0011]

FIGS. 1 and 2 are diagrams for explaining the principle of the present invention. FIG. 1A shows a display example in a first movement mode, and FIG. 2 (c1) and (c2) show display examples in the second movement mode → third movement mode.
Shows the transition to the movement mode. The above problem is solved by a method of moving a display target by a touch input configured as described below.

(1) In a method in which a touch panel is arranged on a display and a display is controlled by a touch input operation, a display position of a display object is moved by the touch input operation. For touch-on and subsequent touch-off input
A method of instantaneously moving the display object by displaying the movement mode of the display object as a first display (reverse display) and displaying the display object at the input coordinate position by the next touch-on / touch-off input (processing steps 100 to 110); As a second movement mode, when a continuous touch-on is detected, the first touch-on input changes the display target to a first display (reversed display) indicating the movement mode, and the same movement mode is set at the position of the input coordinate for each successive touch-on input. The first display shown is sequentially performed, and the display object is displayed on the detected coordinates in the touch-off detection, indicating the movement mode.
Not the original display form methods to complete the movement by a (normal display) (processing step 100～104,111,112)
A second touch to specify a destination in the first travel mode
When the thion input is continuous touch-on, the second movement mode is used.
By applying the mode, the instantaneous movement and the instantaneous movement
Later, a method of performing movement following the movement of the touch input
And a second time for specifying a destination in the first travel mode
If the touch-on input is continuous touch-on, the destination
Movement for the touch input
The movement display following the touch is performed.
The amount of movement of the display object with respect to the amount of force movement is the second movement
By reducing the amount of movement of the mode by a certain percentage
Third movement mode that allows the destination to be specified in detail
(Processing steps 120-123,124,130-133)
In the second movement mode for a certain period of time in a certain area.
When a subsequent touch-on is detected (processing steps 124 and 12
5,126,127) includes the first display (counter
The second display mode (for example,
For example, change the color of the display target, make the border appear thicker)
Then, by switching to the third movement mode,
In the movement following the touch input,
And a method of specifying a destination position.

(2) In the moving method according to the item ( 1),
Specify a fine destination position by the third movement mode
The amount of movement of the touch input exceeds a certain threshold
(Processing steps 130, 150 to 154), the first
(Eg, reverse display), and the second movement mode is displayed.
Follow the touch input again by switching to
It is configured to perform the shifted movement.

(3) In the moving method according to the item ( 1),
The upper left coordinate value of the display target during movement in the third movement mode
Is configured to be displayed near the touch input position
I do.

[0015]

[0016]

[0017]

[0018]

That is, in the method of moving a display target by touch input according to the present invention, by touching on a display target on a display, the display target is displayed in reverse to indicate that the display target is selected as a target to be moved, When the next touch-off comes, it is regarded as the first movement mode and waits for the touch-on of the movement destination. When the next touch-on and the subsequent touch-off are performed, the previous movement selection display (reverse display) is erased, and the touch The instantaneous movement is completed by displaying the display target in the original display form (normal display) at the designated position. << Refer to FIG. 1 (a) >> After touch-on is performed on the above-mentioned display target and reverse display is performed, when touch-on subsequently comes on, the second movement mode is set as continuous touch, and the finger is held as it is in the reverse display. The display according to the movement of the touch is performed, and when the touch-off comes, the display target is changed to the original display form (normal display) at that time,
The movement in the second movement mode is completed by displaying the movement target at the coordinates. << Refer to FIG. 1 (b) >> As described above, the second movement mode is a movement display following the movement of a finger (see FIG. 2 (c1)). Making the movement of the movement object fine, that is, specifically, by making a value obtained by dividing a difference of the movement amount by a certain value as a true movement amount, performing a fine movement,
This is a movement in the third movement mode. << Refer to FIG. 2 (c2) >> Also, while moving the display target in the third movement mode, the upper left coordinate of the display target is displayed near the position where the user is touching, so that the user can specify a fine position. When the user is performing the operation, the position is notified to the user so that the position can be easily adjusted.

Then, the transition from the first movement mode to the second movement mode (when the touch of the movement destination is continuous) or the transition from the first movement mode to the third movement mode (movement) When the previous touch is continuous and fine movement is performed) or transition from the second movement mode to the third movement mode (constant for a certain period of time by looking at the amount of movement in the second movement) (When a continuous touch in the area is detected) or transition from the third movement mode to the second movement mode (when the movement amount of the continuous touch in the certain area for the certain time exceeds the threshold). It is something to do. Of course, the first movement mode, the second movement mode,
In the third movement mode, if there is a touch-off, the respective movement modes are completed, so that it is possible to return to the initial condition. Thereafter, the above-described movement method is repeated.

Therefore, in a device that performs processing by touching a display object, when the display object is moved, the user can be provided with a series of touch operations from rough movement to fine movement by a series of touch operations. The present invention can provide such effects that the moving can be performed quickly by reducing errors in the designated position of the moving destination.

[0021]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. FIGS. 1 and 2 are diagrams for explaining the principle of the present invention, FIGS. 3 to 7 are diagrams showing a flow chart of an embodiment of the present invention, and FIGS. It is an application example figure to a media document display service.

In the present invention, in a method in which the touch panel 3 is arranged on a display and a display is controlled by a touch input operation, a display position of a display target is moved by the touch input operation.
Touch-on for the first display target, and for the subsequent OFF input, display the display target in reverse mode etc. to indicate the movement mode,
Means for instantaneously moving by displaying a display object at the input coordinate position by the next touch-on / off input;
As a movement mode, when a continuous touch is detected, the display target is set to the display indicating the movement mode at the first touch-on input, and the display indicating the same movement mode is sequentially performed at the position of the input coordinate for each successive touch-on input, and the touch-off detection is performed. The movement is completed by performing the original display form on the detected coordinates, and in the second movement mode, when a continuous touch within a certain area for a certain time is detected, the movement amount of the finger is reduced at a certain rate. Means for setting a third movement mode for finer designation of a movement destination; and further, when it is detected in the third movement mode that a continuous touch in the fixed area for the fixed time exceeds a predetermined threshold. The means for transitioning to the second movement mode is the means necessary to carry out the present invention. Note that the same reference numerals indicate the same object throughout the drawings.

Hereinafter, referring to FIGS. 1 and 2, FIGS.
The method of moving the display target by touch input according to the present invention will be described with reference to FIGS. 7 and 8 to 10. An apparatus for implementing the display processing of the present invention is implemented by, for example, an apparatus as shown in FIG. That is, a CPU that performs display processing
And a display controller having a ROM for storing a display processing program, a RAM for temporarily storing data, a display memory, a display for displaying, a touch panel 3 provided on the display, and an interface thereof. , And a storage device for storing display images and the like.

First, two basic display object movement modes of the present invention (a first movement mode and a second movement mode).
Will be described. FIG. 1 is a diagram schematically showing these two movement modes.

In FIG. 1A, first, when the display object A is touched on, it indicates that the display object A is selected.
For example, reverse display is performed. Next, when a touch-off comes, it is regarded as a first movement mode and waits for a touch-on of a movement destination.

When the next touch-on and subsequent touch-off are performed, the previous display is erased, and the display target is displayed at the touched position in the original display form. Thus, the instantaneous movement is completed. << Refer to the processing steps 100 to 110 in FIGS. 3 and 4. >> In FIG. 1B, first, when the display target A is touched on,
The display target A is displayed in reverse, for example, to indicate that it is selected. Then, when touch-on comes, as continuous touch,
This is recognized as the second movement mode.

At this time, the display object is displayed at the position coordinates in a display form while the reverse display or the like is selected. When the user drags the finger sequentially, the touch-on coordinates come in, and this display is repeated each time. When the touch-off comes, the display target is displayed in the original display format (normal display) at that point and displayed at the coordinates To complete the move. This movement can be performed while confirming the display object to be displayed at the place where the user drags the finger.処理 Processing steps of Fig. 3 and Fig. 4
Next, in the case of the first movement mode, if the touch at the movement destination is not simply touch-on / off, but a continuous touch following the touch-on comes, the second movement mode starts from that point. Processing can be performed to enable movement following the movement of the finger until touch-off. This makes it possible to move at a stretch up to a certain point, and then to move finely thereafter.

The above processing can be performed by performing the processing of the embodiment shown in the flowcharts of FIGS. 3 and 4 as described above. に Corresponding to claim 1
In this embodiment, although this movement can be specified to some extent to move the display target, there are cases where more detailed movement is desired. In particular, when the resolution of the touch panel is rougher than the resolution of the screen, it is impossible to perform fine movement according to the resolution of the screen.

In order to enable fine movement in such a case, a third movement mode {see processing steps 131, 132, 133 in FIG. 5} is provided as shown in the processing of the flowchart shown as an embodiment in FIGS. This enables fine movement processing to be performed. Next, a processing method in this case will be described.

First, in the case of the first movement mode, if the destination touch is a continuous touch, it is necessary to specify a fine position.
The coordinates are stored as the third movement mode . At this time, a display indicating the third movement mode is displayed on the display object (changing the inverted color form, blinking, and the like). << Refer to processing steps 120, 121 to 123 in FIGS. 5 and 6. >> For the next touch-on input, the difference between the stored position coordinates and the input coordinates is divided by a certain value, and this is calculated from the original position coordinates. Is moved as the movement value of.
The constant value used here is generally a value obtained from the resolution of the touch panel and the resolution of the screen, but is a value determined by how finely the movement can be performed by the system.処理 Processing steps 120, 124, 130-13 in FIG.
3 Reference ① By repeating the above, it is possible to finely specify the destination position. FIG. 2 shows how the screen moves in the third movement mode.
<< Embodiment Corresponding to Claim 1 >> In the second movement mode in FIGS. 1 (b) and 2 (c1),
Since the object moves following the finger, the display target is located at the position of the finger. In FIG. 2 (c1), ● indicates the position of the finger, and
It is moving due to dragging. However, as can be seen from FIG. 2 (c2), in the third movement mode, the finger follows the finger, but the movement of the display object is slight with respect to the movement of the finger.
The circle indicates the position of the finger in the same manner, and the finger is moved from a to b and c by dragging. In this way, even if the finger is largely moved, the movement of the display target is small, so that it is possible to prevent the position from being blurred by the finger and to perform the fine position specification. Case {claim corresponding examples 1} This is likewise, for the movement following the movement of the finger is a second movement mode, the as shown in the flow chart shown FIG. 5, FIG. 6 Movement of 3 movement modes
Movements .

First, a movement following a finger is performed in the second movement mode described above by a continuous touch-on input, but at a certain interval (here, in the case of a continuous touch, the touch-on coordinates come at a constant interval. If the touch-on coordinates determined by the number of times (increment of a counter not shown) hardly move, this determination is made based on whether the size of a certain area on the top, bottom, left and right is determined from the initial coordinates. If it continues for a certain number of times, it is determined that it hardly moves. ｝ Is regarded as a fine position designation, is switched to the third movement mode, and is realized by performing a display such that the finger moves slightly even if the movement of the finger is increased by the above processing.処理 Processing steps 120 and 1 in FIGS. 5 and 6
24,125,126,127,121～123,120,124,130 to 133 reference} Furthermore, for the third movement mode also, the movement in order to be able to flexibly perform, also necessary processing that can move to switch back to the second movement mode Yes,
This processing can be realized by a flowchart in which a part of {(a) in FIG. 3 is replaced with FIGS. 5 and 6, and a part of {｛(b) in FIG. 5 is replaced with FIG. << Refer to processing steps 150 to 154 in FIG. 7 >><< Embodiment corresponding to Claim 2 >> In this case, a series of touch dragging instantaneously moves to a certain position in the first movement mode, and then follows the finger. It is also possible to move to a more detailed position by performing the movement, and finally to specify a finer position in the third movement mode.

If a movement exceeding a certain threshold value occurs while the movement destination is finely specified in the third movement mode, it is difficult to think that the position is finely specified, so that the movement of the finger is followed again. By switching the display in the second movement mode (that is, referring to the processing steps 150 and 151 in FIG. 7), various movements can be provided in a series of continuous touches, which is easy for the user to use. Can provide an interface.

When the user is performing fine movement in the third movement mode, it is difficult for the user to determine the position only by looking at the display, so that the upper left coordinate value of the display object is displayed. To make it easier to locate.
<< Embodiment Corresponding to Claim 3 >> As described above, a movement mode appropriate for the system may be adopted to provide a more convenient movement.

Next, a case where the display object moving method by touch input according to the present invention is applied to a multimedia document display service will be described with reference to FIGS. 8 and 9 show examples of the screen display. Various media such as moving images, still images, texts, etc. are managed as multimedia documents having a display form such as having multiple sheets of paper, and are displayed on the virtual desktop in FIG. 8 (a). , Page turning, which can be realized by, for example, turning the lower side of the multimedia document displayed on the desktop surface of FIG. 8A with a finger, allows the user to see the multimedia of the next page Further, when a related keyword displayed in the multimedia document is touched, a related page pops out sideways and can be displayed.

The multimedia document is usually managed in the form of a miniature due to the limitation of the size of the display screen, so that the user can view the contents only when he or she wants to see the contents. The icons on the virtual desktop are used to copy or delete the multimedia document.

This miniaturized multimedia document is usually managed by pasting it on a virtual wall in front of a virtual desktop, and when you want to see the contents, move it to your desk to enlarge it and view it. I do.

As described above, in the multimedia document display, it is necessary to move the miniature between the virtual wall and the virtual desktop, and the movement is performed using the above-described moving method according to the present invention.

In particular, when moving, collecting and storing documents that have a certain meaning and organizing them to make them easier to see are organized.
It is desirable to be able to specify a very fine position.

Since the movement amount between the virtual wall and the virtual desktop is large, the movement is first performed in the first movement mode, and then the fine movement is specified in the second or third movement mode. be able to.

For movement within the virtual wall, when the movement distance is short, the position is determined to some extent in the second movement mode, and fine position designation can be performed in the third movement mode. In addition, it can be moved accurately and its arrangement can be performed.

Similarly, it is conceivable that the user can place icons for performing processing at an easy-to-use position. However, by providing a similar moving method, the user can use an easy-to-use interface. Can be provided.

FIG. 8A shows a virtual desktop screen of this service, FIG. 8B shows a virtual wall screen which is the upper management environment of FIG. 8A, and FIG. , FIG.
(b) shows a display screen when miniature B on the virtual wall is moved to another location on the same virtual wall,
FIG. 9D shows a display screen when the miniature B on the virtual wall of FIG. 8B is moved to the virtual desktop, and FIG. 10E shows that the document movement in the virtual wall is the third. In the case of the movement mode, the screen shows the coordinates of the upper left corner of the miniature so that the user can easily determine the position, so that the user can easily specify the position.

As described above, according to the present invention, in the method in which the touch panel 3 is arranged on the display and the display is controlled by the touch input operation, the display position of the display target is moved by the touch input operation. As the mode, the movement mode is indicated by touching on the first display target and the display target is highlighted in response to the subsequent off input, and the display target is displayed at the input coordinate position by the next touch on / off input, so that it is instantaneous. In the second movement mode, when a continuous touch is detected, the first touch-on input causes the display target to display the movement mode, and the same movement mode is displayed at the position of the input coordinate for each successive touch-on input. The movement is completed by performing the original display form on the detected coordinates by the touch-off detection in sequence. In the moving mode, when a continuous touch within a certain area for a certain period of time is detected, the moving amount of the finger is reduced at a fixed rate, and a third moving mode for specifying a finer moving destination is set. In the third movement mode, when it is detected that the number of continuous touches in the certain area for the certain time exceeds the predetermined threshold value, a transition is made to the second movement mode.

[0044]

As described above in detail, the display object moving method by touch input according to the present invention is a device that arranges a touch panel on a display and controls display by touch input operation. In the method of moving the display position of the object, a touch mode for the first display object is displayed as a first movement mode, and a movement mode is displayed by inverting display of the display object in response to a subsequent OFF input, and the next touch-on / off input is performed. The display object is displayed at the input coordinate position, thereby performing instantaneous movement. As a second movement mode, at the time of continuous touch detection, the first touch-on input changes the display object to a display indicating the movement mode. The display showing the same movement mode is sequentially displayed at the position of the input coordinates for each touch-on input, and the original coordinates are displayed on the detected coordinates by touch-off detection. The movement is completed by performing the display mode, and in the second movement mode, when a continuous touch within a certain area for a certain period of time is detected, the moving amount of the finger is reduced at a certain rate, and the moving destination is finer. In a third movement mode for designating, and in the third movement mode, when it is detected that the continuous touch in the certain area for the certain time exceeds a predetermined threshold, the state transits to the second movement mode. The display object can be moved in an arbitrary movement mode as needed, so that when the display object is moved, the user is provided with a series of operations from rough movement to fine movement. Thus, there is an effect that a human interface that is easier to use can be provided, and that the movement can be performed quickly with less errors in specifying the position of the movement destination.

[Brief description of the drawings]

FIG. 1 illustrates the principle of the present invention (part 1).

FIG. 2 is a diagram illustrating the principle of the present invention (part 2).

FIG. 3 is a flowchart showing an embodiment of the present invention (part 1).

FIG. 4 is a flowchart showing an embodiment of the present invention (part 2).

FIG. 5 is a flowchart showing an embodiment of the present invention (part 3).

FIG. 6 is a flowchart showing an embodiment of the present invention (part 4).

FIG. 7 is a flowchart showing an embodiment of the present invention (part 5).

FIG. 8 is a diagram illustrating an example of application of the present invention to a multimedia document display service (part 1).

FIG. 9 is a diagram illustrating an example of application of the present invention to a multimedia document display service (part 2).

FIG. 10 is a diagram illustrating an example of application of the present invention to a multimedia document display service (part 3).

FIG. 11 is a view for explaining a conventional display target moving method.

[Explanation of symbols]

1 Keyboard 2 Mouse 3 Touch panel 100 to 109,111,112,120 to 125,131 to 133,140 to 143,15
0 to 154 processing steps ● Finger touch position

────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Hajime Kamada 1015 Kamiodanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture Inside Fujitsu Limited (56) References JP-A-2-166571 (JP, A) JP-A-3-218512 (JP, A) JP-A-62-1221 (JP, A) JP-A-62-278621 (JP, A) JP-A-4-98415 (JP, A) JP-A-2-259921 (JP, A) Kaihei 2-118962 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) G06F 3/14 G06F 3/00 G06F 3/033 G06T 11/80

Claims (3)

(57) [Claims] 1. A method of disposing a touch panel on a display and performing display control by a touch input operation, wherein a display position of a display target is moved by the touch input operation. In response to touch-on and subsequent touch-off input, the display object is set to the first display indicating the movement mode, and the next touch-on
A method of instantaneously moving the display target by displaying the display target at the input coordinate position by the touch-off input, and a second moving mode in which, when a continuous touch-on is detected, the display target is moved by the first touch-on input.
, And the first display showing the same movement mode at the position of the input coordinate is successively performed for each successive touch-on input,
A method of completing the movement by setting the display target on the detected coordinates in the touch-off detection to the original display form not indicating the movement mode, and a second touch for designating the movement destination in the first movement mode.
When the thion input is continuous touch-on, the second movement mode is used.
By applying the mode, the instantaneous movement and the instantaneous movement
Later, a method of performing movement following the movement of the touch input
And a movement amount of the touch input in the second movement mode.
The movement amount of the display object with respect to the second movement mode.
The moving destination by reducing it by a certain percentage.
To set the third movement mode in which the position can be specified in detail
And a continuous tap in a fixed area for a fixed time in the second movement mode.
When a touch-on is detected, the
The first display mode is further changed to the second display mode, and
By switching to the third movement mode, the touch
In the movement following the input
Display object moving method according to a touch input, characterized that you provided a method of performing location specified, the. 2. The moving method according to claim 1, wherein
To specify a fine destination position in the third movement mode.
When the touch input is moving, a certain threshold
When exceeding, the first display is performed again, and the second display is performed.
By switching to the movement mode, the touch
A method of moving a display target by touch input, wherein the display object moves by following an input. 3. The moving method according to claim 1, wherein
The upper left seat of the display object while moving in the third movement mode.
A method of moving a display target by touch input, wherein a target value is displayed near a position where the touch input is being performed .