JPH05119946A - Display object moving method by touch input - Google Patents

Abstract

PURPOSE:To perform movement from crude one to fine one with a series of touch input operations by a user. CONSTITUTION:In a device in which a touch panel is arranged on a display and by which display control can be performed with the touch input operation, a first moving mode in which the movement can be performed in a moment by displaying a moving mode in the reverse display, etc., of a display target for touch-on and following touch-off input for an initial display object, and displaying the display target at an input coordinate position by performing the next touch on/off input, a second moving mode in which the display object is displayed in a mode representing the moving mode by the initial touch-on input and the display representing the same moving mode is performed at the position of input coordinates at every continuous touch-on input, and a third moving mode in which the amount of travel of a finger can be reduced at a constant ratio and the designation of more fine moving destination can be performed when continuous touch in constant time and at a constant area is detected in the second moving mode.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display object moving method for moving a display position of a display object by a touch input operation in a device in which a touch panel is arranged on a display and a display is controlled by a touch input operation.

Recently, there have been many environments for handling various media such as moving images, still images and texts. In such an environment, the conventional method has adopted a method of opening a window corresponding to each medium and displaying the window in the corresponding window. Therefore, there is a problem that it is difficult to see because it requires a window operation one by one, and it is difficult to recognize an individual relation of each medium,
Since it has been required to display mutually related media in an easily understandable manner, so-called paper-based multimedia document display service has been proposed.

In the paper-based multimedia document display service, operations that are intuitive and easy to understand have been demanded. For example, it is required to directly display an object by touching it on paper. As a result, it has become necessary to use a touch panel.

However, the conventional touch panel is mainly operated as a button, and it is required to effectively move and display an object on the display by using such a touch panel.

[0005]

2. Description of the Related Art FIG. 11 is a diagram for explaining a conventional display object moving method. First, when moving the object displayed on the screen with the keyboard 1, it is necessary to input a specific command, and when moving the displayed object with the mouse 2, operate the mouse 2 to move the display 2 It is necessary to perform an operation such as designating a specific icon (not shown).

[0006]

Therefore, in the method of using the keyboard 1 and the mouse 2 described above, the operation is difficult unless the user has the expert knowledge of the computer system or the user who has a lot of experience. There was a problem that.

Therefore, focusing on the fact that the touch panel 3 can directly touch the display object, the operability problem is solved as compared with the keyboard 1 and the mouse 2, but as described above, Originally, the touch panel 3
Has a main function as a button for instructing an icon or the like. Therefore, when the touch panel 3 is used to move an object displayed on the screen, there is a limit to the accuracy of touch input by a finger, and there is a small amount of precision. For a system that provides an input for moving to a position, this is a serious problem in terms of human interface.

Further, as compared with the above-mentioned mouse or light pen, the point that the input is largely different is that the finger touch input specifies an accurate position by the parallax caused by the distance between the screen and the touch panel, the shape of the finger, and the like. Is difficult to do and the system must somehow help to assist with this.

Further, the resolution of the touch panel 3 is lower than the resolution of the display screen of the display, and the touch input coordinates can only specify the position according to the resolution of the touch panel 3, and the fine position cannot be specified up to the resolution of the display screen. Since it cannot be performed, it is necessary to perform some processing in order to perform such fine position designation.

In view of the above-mentioned conventional drawbacks, the present invention is a device for arranging a touch panel on a display and performing display control by a touch input operation. In a method of moving a display position of a display object by the touch input operation, To provide a user interface that performs a series of operations from rough movements to fine movements only by touch operation, is easy to use, and reduces the error in the position designation of the movement destination, and can move quickly. The purpose is.

[0011]

1 and 2 are explanatory views of the principle of the present invention. FIG. 1 (a) shows a display example in a first movement mode, and FIG. 1 (b) shows a first display mode. 2 (c1) and (c2) show the second movement mode → the third movement mode.
Shows the transition to the movement mode of. The above problems can be solved by the method of moving a display object by touch input configured as follows.

(1) In a method of arranging a touch panel on a display and performing display control by touch input operation, in the method of moving the display position of the display object by touch input operation, the first display object is set as the first movement mode. A method of instantaneously moving by displaying the movement target (reverse display) indicating the movement mode for the touch-on and off-inputs to and displaying the display object at the input coordinate position by the next touch-on / off input. (Processing step 1
00 to 110), and as the second movement mode, when continuous touch is detected, the display object indicating the movement mode is displayed (reverse display) at the first touch-on input, and the same movement is made to the position of the input coordinate for each continuous touch-on input. A method of completing the movement by sequentially displaying the modes and displaying the original display form (normal display) on the detected coordinates by touch-off detection.
(Processing steps 100 to 104,111,112).

(2) In the moving method described in the above item 1,
When the second touch input for designating the destination in the first movement mode is continuous touch, the second movement mode is applied to perform an instantaneous movement and a movement that follows the movement of the finger after the movement. To configure.

(3) In the moving method described in the above item 1,
In the case where the second touch input for designating the destination of the first movement mode is continuous touch, the movement display is performed in accordance with the movement of the finger, which is regarded as the movement for designating the fine position of the destination. At this time, the movement amount of the display target is reduced with respect to the movement amount of the finger at a constant rate from the movement amount of the second movement mode, whereby the position of the movement destination can be finely specified. 120 ~ 123,124,130 ~ 13
3) is provided.

(4) In the moving method described in the above item 1,
When continuous touch-on is detected within a certain area for a certain period of time in the second movement mode (processing steps 124, 125, 12).
6,127), the reverse display form of the display target is further changed and the mode is switched to the third movement mode described in the above item 3, so that a finer movement destination position is specified following the movement following the finger. To configure.

(5) In the moving method described in the above item 4,
When the movement amount of the finger exceeds a certain threshold value (processing steps 130, 150 to 154) while the fine movement destination position is designated by the third movement mode, the reverse display is performed again and the second movement is performed.
By switching to the movement mode of No. 2, the movement is made to follow the finger again.

(6) In the moving method described in the above items 3 and 4, it is configured to display the upper left coordinate of the display target near the touched position during the movement in the third movement mode in the previous term.

[0018]

That is, in the display object moving method by touch input of the present invention, by touching on the display object on the display, the display object is displayed in reverse, for example, to show that the display object is selected as the moving object. When the next touch-off comes, it is regarded as the first movement mode, waits for the touch-on of the movement destination, and when the next touch-on and the subsequent touch-off are performed, the previous movement selection display (reverse display) is erased and the touch is touched. By displaying the display target in the original display form (normal display) at the designated position, the instantaneous movement is completed. {Refer to FIG. 1 (a)} When the display target is touched on and highlighted, and then the touch-on is subsequently performed, the second movement mode is set as continuous touch, and the finger is displayed with the inverted display. The display is performed according to the movement of the touch, and when the touch-off comes, the display target is changed to the original display form (normal display) at that time,
By displaying the movement target at the coordinates, the movement in the second movement mode is completed. {See FIG. 1 (b)} The second movement mode is a movement display that follows the movement of the finger as described above (see FIG. 2 (c1)), but even if the finger is moved largely, The movement of the movement target is made fine, that is, specifically, the value obtained by dividing the difference of the movement amount by a constant value is set as the true movement amount, so that the fine movement can be performed.
This is movement in the third movement mode. {Refer to FIG. 2 (c2)} Also, while the display target is being moved in the third movement mode, the upper left coordinates of the display target are displayed near the touched position, so that the user can perform fine position designation. While doing, the user is notified of the position so that the position can be easily adjusted.

Then, the transition from the first movement mode to the second movement mode (when the touch of the movement destination is continuous) or the transition from the first movement mode to the third movement mode (movement) When the previous touch is continuous and fine movement is performed), or the transition from the second movement mode to the third movement mode (see the movement amount in the second movement, constant for a certain time) (When a continuous touch in the area is detected), or a transition from the third movement mode to the second movement mode (when the movement amount of the continuous touch in the certain area for the certain time exceeds the threshold value). It's something that you do. Of course, the first movement mode, the second movement mode,
If there is a touch-off in each of the third movement modes, the respective movement modes are in a completed state, so that the initial condition can be restored, and thereafter, the above-described movement method is repeated.

Therefore, in a device that performs processing by touching a display target, when moving the display target, the user can be provided with a series of touch operations from rough movement to fine movement, and a human interface that is easier to use is provided. It is possible to provide such an effect, and it is possible to obtain an effect that the error can be reduced in the designated position of the movement destination and the movement can be performed quickly.

[0021]

Embodiments of the present invention will now be described in detail with reference to the drawings. FIGS. 1 and 2 are explanatory views of the principle of the present invention, FIGS. 3 to 7 are flowcharts showing an embodiment of the present invention, and FIGS. It is an example of application to a media document display service.

In the present invention, the touch panel 3 is arranged on the display and the display is controlled by the touch input operation. In the method of moving the display position of the display object by the touch input operation, the first movement mode is as follows.
Indicate the movement mode by touching on the display object at the beginning and the display object for the following off input in reverse video,
A means for instantaneously moving by displaying the display target at the input coordinate position by the next touch-on / off input;
As the movement mode of, when the continuous touch is detected, the display object indicating the movement mode is displayed by the first touch-on input, and the display showing the same movement mode at the position of the input coordinate is sequentially performed for each continuous touch-on input. The movement is completed by performing the original display form on the detected coordinates, and when a continuous touch within a certain area is detected for a certain period of time in the second movement mode, the movement amount is less than the movement amount of the finger at a constant rate. And a means for setting a third movement mode for finer movement destination designation, and further, during the third movement mode, when it is detected that continuous touches within a certain area for a certain period of time have exceeded a predetermined threshold value. The means for transitioning to the second movement mode is the means necessary for implementing the present invention. The same reference numerals denote the same objects throughout the drawings.

Below, referring to FIG. 1 and FIG. 2, FIG.
The display object moving method by touch input according to the present invention will be described with reference to FIGS. 7 and 8 to 10. An apparatus for realizing the display processing of the present invention is realized by, for example, the apparatus shown in FIG. That is, a CPU that performs display processing
And a ROM in which a display processing program is stored, a RAM for temporarily storing data, a display control device including a display memory, a display for displaying, a touch panel 3 provided on the display, and an interface thereof. , And a storage device for storing display images and the like.

First, the two basic movement modes of the display object of the present invention (first movement mode and second movement mode)
Will be described. FIG. 1 is a diagram schematically showing these two movement modes.

In FIG. 1 (a), first, when the display object A is touched on, it indicates that the display object A is selected.
For example, reverse display or the like is performed. When touch-off comes next, it is regarded as the first movement mode, and waits for touch-on at the movement destination.

When the next touch-on and the subsequent touch-off are performed, the previous display is erased and the display target is displayed in the original display form at the touched position. This completes the instantaneous movement. {Refer to processing steps 100 to 110 in FIGS. 3 and 4} In FIG. 1 (b), first, when the display target A is touched on,
The display target A is displayed in reverse video to indicate that it has been selected. If touch-on comes next, it will be a continuous touch,
Recognize as the second movement mode.

At this time, the display target is displayed at the position coordinates in the display mode with the reverse display or the like still selected. When the user sequentially drags his / her finger, the touch-on coordinates come in, so this display is repeated each time, and at the time of touch-off, the display target is returned to the original display form (normal display) and displayed at that coordinate. This completes the move. In this movement, the display target is always displayed at the place where the user drags his / her finger, so that it is possible to perform the movement while checking. {Processing steps in FIGS. 3 and 4
100 to 104,111,112} Next, in the case of the first movement mode, when the destination touch is not simply touch-on / off, but continuous touch-on continues, then from that time point, the second movement mode is changed. It is possible to perform processing and enable movement that follows the movement of the finger until touch-off. This makes it possible to move all at once up to a certain point and then move finely.

The above processing can be realized by performing the processing of the embodiment shown in the flowcharts of FIGS. 3 and 4 as described above. {Examples corresponding to claims 1 and 2} This movement can be finely specified to move the display object to some extent, but there are cases where it is desired to perform finer movement. Especially when the resolution of the touch panel is rougher than the resolution of the screen, it is not possible to make fine movements according to the resolution of the screen.

In order to enable fine movement in such a case, a third movement mode (see processing steps 131, 132, 133 in FIG. 5) is provided as in the processing of the flowchart shown as an embodiment in FIGS. As a result, fine movement processing can be performed. Next, a processing method in this case will be described.

First, when the destination touch is continuous touch in the case of the first movement mode, the coordinates are stored as the third movement mode for fine position designation. At this time, a display indicating the third movement mode is displayed on the display target (changing the inversion color form, blinking, etc.).
{Refer to processing steps 120, 121 to 123 in FIG. 5 and FIG. 6} For the next touch-on input, the difference between the stored position coordinates and the input coordinates is divided by a certain fixed value, and this is calculated from the original position coordinates. Move as the movement value of.
The constant value used here is generally a value obtained from the resolution of the touch panel and the resolution of the screen, but it is a value determined by how finely the movement is possible by the system. {Processing steps 120, 124, 130 to 13 in FIG. 5
By referencing 3 above, it is possible to finely specify the destination position. FIG. 2 shows how the screen is moved in the third moving mode.
{Embodiment corresponding to claim 3} In the second movement mode of FIG. 1 (b) and FIG. 2 (c1), always,
Since it moves following the finger, the display target is at the position of the finger. In FIG. 2 (c1), ● indicates the position of the finger, and a to d
It is moving due to head dragging. However, as can be seen from FIG. 2 (c2), in the third movement mode, the movement of the display target is slight with respect to the movement of the finger, although it follows the finger.
Similarly, ● indicates the position of the finger, and the finger is moved from a to b and c by dragging. As described above, even if the finger is largely moved, the movement of the display target is small, so that the blurring of the position designation by the finger can be prevented and the fine position designation can be performed. (Embodiment corresponding to claim 4) In this case as well, regarding the movement following the movement of the finger which is the second movement mode, as shown in the flowcharts of FIGS. Allow 3 moves.

First, the finger is moved following the finger in the above-described second movement mode by continuous touch-on input, but at a certain interval {here, in the case of continuous touch, the touch-on coordinates come at a constant interval. If the touch-on coordinates of (determined by the number of times (increment of a counter not shown)) hardly move (this judgment is made by deciding the size of a certain area on the top, bottom, left, and right from the start coordinates and judging whether it is larger than that). When it continues for a certain number of times, it is determined that it hardly moves} is regarded as a fine position designation, the display is switched to the third movement mode, and even if the movement of the finger is increased by the above processing, the movement is little. It is realized by performing. {Processing steps 120, 1 in FIGS. 5 and 6
24,125,126,127,121 to 123,120,124,130 to 133} Further, also in this third movement mode, in order to be able to perform the movement flexibly, the second movement is performed again.
It is also necessary to perform processing that can be moved by switching to the movement mode of FIG. 5, and this processing is part of FIG. 3 {shown by (a)}.
7 and a part of FIG. 5 {shown by (b)} is replaced with FIG. {Refer to processing steps 150 to 154 in Fig. 7} {Example corresponding to claim 5} In this case, a series of touch dragging causes an instant movement to a certain position in the first movement mode, and then follows a finger. It is also possible to move to a more detailed position by this movement, and finally to specify a finer position in the third movement mode.

Then, when a movement exceeding a certain threshold occurs while the destination is being finely designated by the third movement mode, it is unlikely to be fine position designation, so the movement of the finger is followed again. By switching the display to the movement of the second movement mode (that is, refer to the processing steps 150 and 151 in FIG. 7 above), it is possible to provide various movements in a series of continuous touches, which is easy for the user to use. Can provide an interface.

When the user is making a fine movement in the third movement mode, it is difficult for the user to determine the position just by looking at the display, so the upper left coordinate of the display target is displayed. And make it easier to check the position. {Embodiment corresponding to claim 6} As described above, the movement mode according to the system may be adopted to provide easier movement.

Next, a case where the display object moving method by touch input according to the present invention is applied to a multimedia document display service will be described with reference to FIGS. 8 and 9. 8 and 9 show examples of the screen display. Manage various media such as videos, still images, texts, etc. as a multimedia document that has a display form such that there are multiple sheets of paper, and display this on the virtual desktop of Fig. 8 (a). It is also possible to see the multimedia of the next page by turning the page (for example, by turning the bottom side of the multimedia document displayed on the desktop surface of FIG. 8A with a finger). Further, by touching the related keyword displayed in the multimedia document, it is possible to display the related page by popping out horizontally.

The multimedia document is usually managed in the form of a miniature due to the problem of the limit of the size of the display screen, so that the contents can be enlarged and viewed only when the contents are desired. The icon on the virtual desktop is for copying or deleting this multimedia document.

This miniaturized multimedia document is usually managed by pasting it on a virtual wall in front of the virtual desktop, and when it is desired to see the contents, it is moved to the desk so that it is enlarged and viewed. To do.

As described above, in displaying a multimedia document, it is necessary to move the miniature between the virtual wall and the virtual desktop, and the movement is performed by using the above-described moving method according to the present invention.

In particular, regarding the arrangement in the case of making it easier to see by collecting and organizing some documents which have some meaning when moving.
It is desirable to be able to specify a fairly fine position.

Since the movement amount between the virtual wall and the virtual desktop is large, the movement is made in the first movement mode first, and then the fine movement is designated in the second or third movement mode. be able to.

Regarding movement within the virtual wall, when the movement distance is short, it is possible to decide the position to some extent in the second movement mode and to perform fine position designation in the third movement mode. In addition, it can be moved accurately and can be organized.

Similarly, the user may place the icon for processing to a position where it is easy to use, but also for these, by providing a similar moving method, an interface that is easy to use for the user is provided. Can be provided.

FIG. 8A shows a virtual desktop screen of this service, FIG. 8B shows a virtual wall screen which is the upper management environment of FIG. 8A, and FIG. 9C shows it. , Fig. 8
Show the display screen when moving the miniature B on the virtual wall of (b) to another place on the same virtual wall,
FIG. 9 (d) shows a display screen when the miniature B on the virtual wall of FIG. 8 (b) is moved to the virtual desktop, and FIG. 10 (e) shows that the document movement in the virtual wall is the third. In the movement mode, a screen is shown in which the coordinates of the upper left corner of the miniature are displayed so that the user can easily determine the position by finely specifying the position.

As described above, according to the present invention, the touch panel 3 is arranged on the display, and the display is controlled by the touch input operation. In the method of moving the display position of the display object by the touch input operation, the first movement is performed. As a mode, the moving mode is indicated by touching on the first display object and inversion for the subsequent off input, and displaying the display object at the input coordinate position by the next touch on / off input. As a second movement mode, when the continuous touch is detected, the display object indicating the movement mode is displayed by the first touch-on input, and the same movement mode is displayed at the position of the input coordinate for each continuous touch-on input. Display is sequentially performed, and the movement is completed by performing the original display form on the detected coordinates by touch-off detection, and the second movement is performed. In the moving mode, when a continuous touch within a certain area is detected for a certain period of time, the moving amount of the finger is reduced at a constant rate, and a third moving mode for specifying a finer moving destination is set. In the third movement mode, when it is detected that the number of continuous touches within a certain area for a certain period of time exceeds a predetermined threshold value, a transition to the second movement mode is made.

[0044]

As described above in detail, the method of moving a display object by touch input according to the present invention is a device for arranging a touch panel on a display and performing display control by touch input operation. In the method of moving the display position of the target, as the first movement mode, the movement mode is indicated by touch-on to the first display target and inversion display of the display target with respect to the subsequent OFF input, and the next touch-on / off input is displayed. The display target is displayed at the input coordinate position so as to move instantaneously. As the second movement mode, when the continuous touch is detected, the display object is displayed in the movement mode by the first touch-on input, and the continuous movement is performed. For each touch-on input, the same movement mode is sequentially displayed at the input coordinate position, and touch-off detection is performed to display the original position on the detected coordinate. The movement is completed by performing the display form, and when a continuous touch within a certain area is detected for a certain period of time in the second movement mode, the movement amount of the finger is reduced at a constant rate to make a finer movement destination. A third movement mode for designating is entered, and when it is detected during the third movement mode that the number of continuous touches within a certain area exceeds a predetermined threshold value, transition to the second movement mode. The display object can be moved in any movement mode as needed. Therefore, when the display object is moved, the user is provided with a series of operations from rough movement to fine movement. Therefore, it is possible to provide a human interface that is easier to use, and it is possible to reduce the number of errors in the position designation of the movement destination and to move quickly.

[Brief description of drawings]

FIG. 1 is an explanatory diagram of the principle of the present invention (No. 1)

FIG. 2 is an explanatory diagram of the principle of the present invention (No. 2)

FIG. 3 is a flowchart showing an embodiment of the present invention (No. 1)

FIG. 4 is a diagram showing a flow chart of an embodiment of the present invention (No. 2)

FIG. 5 is a flowchart showing the embodiment of the present invention (part 3).

FIG. 6 is a diagram showing a flow chart of an embodiment of the present invention (Part 4).

FIG. 7 is a flowchart showing an embodiment of the present invention (No. 5).

FIG. 8 is an application example diagram (1) of the present invention to a multimedia document display service.

FIG. 9 is an application example diagram (2) of the present invention to a multimedia document display service.

FIG. 10 is an application example diagram (3) of the present invention to a multimedia document display service.

FIG. 11 is a diagram illustrating a conventional display object moving method.

[Explanation of symbols]

1 Keyboard 2 Mouse 3 Touch panel 100 ~ 109,111,112,120 ~ 125,131 ~ 133,140 ~ 143,15
0 to 154 processing steps ● Finger touch position

 ─────────────────────────────────────────────────── ─── Continued Front Page (72) Inventor Hajime Kamata 1015 Kamiodanaka, Nakahara-ku, Kawasaki-shi, Kanagawa Fujitsu Limited

Claims (6)

[Claims] 1. A device for arranging a touch panel (3) on a display and performing display control by touch input operation, in a method of moving a display position of a display object by touch input operation, as a first movement mode, first, The touch-on for the display target of and the display target for the subsequent OFF input are displayed to show the movement mode (reverse display), and the next touch-on
A method of instantly moving by displaying the display target at the input coordinate position by off input (processing steps 100 to 110)
As a second movement mode, when continuous touch is detected, the display object indicating the movement mode is displayed (reverse display) at the first touch-on input, and the same movement mode is shown at the position of the input coordinate for each successive touch-on input. A method of completing the movement by sequentially displaying and displaying the original display form (normal display) on the detected coordinates by touch-off detection (processing step 1
0 to 104,111,112), a method of moving a display object by touch input. 2. The moving method according to claim 1,
When the second touch input for designating the destination in the first movement mode is continuous touch, the second movement mode is applied to perform an instantaneous movement and a movement that follows the movement of the finger after the movement. A method for moving a display target by touch input, which is characterized in that 3. The moving method according to claim 1,
In the case where the second touch input for designating the destination of the first movement mode is continuous touch, the movement display is performed in accordance with the movement of the finger, which is regarded as the movement for designating the fine position of the destination. At this time, the movement amount of the display target is reduced with respect to the movement amount of the finger at a constant rate from the movement amount of the second movement mode, whereby the position of the movement destination can be finely specified. 120 ~ 123,124,130 ~ 13
3) A method of moving a display target by touch input, which is provided with 4. The moving method according to claim 1, wherein:
When continuous touch-on is detected within a certain area for a certain period of time in the second movement mode (processing steps 124, 125, 12).
6,127), by further changing the inverted display form of the display target and switching to the third movement mode according to claim 3, further detailed movement destination position designation is performed following the movement following the finger. A method of moving a display target by touch input, which is characterized by performing. 5. The moving method according to claim 4,
When the movement amount of the finger exceeds a certain threshold value while the fine movement destination position is designated by the third movement mode (processing steps 130, 150 to 154), the reverse movement display is performed again to enter the second movement mode. A method for moving a display target by touch input, which is characterized in that the movement is performed again following the finger by switching. 6. The touch method according to claim 3, wherein the upper left coordinate of the display target is displayed near the touched position while moving in the third moving mode in the previous period. How to move the display target by input.