KR20220053522A - Recognition method of multi-touch of touch button on touch screen, text input method on touch screen and modifying method of object - Google Patents

Abstract

In a method for generating a work signal for any work comprising a text input or an object transformation through an operation after multi-touch in a device equipped with a touchscreen, the present invention, in a case where the text is inputted by a multi-multi tap method, provides the method wherein texts belonging to a target text group related to a target button are displayed while circulating according to the number of times for which a multi-on & off is continuously performed at least once or more. Therefore, the present invention is capable of improving a text input speed.

Description

Multi-touch recognition method of touch button on touch screen, text input method, and object transformation method

The present invention relates to an input method, and more particularly, to a method in which a user command is input in such a way that touch buttons displayed on a touch screen are manipulated after being touched.

Since small touch buttons in devices having small touch screens, including conventional mobile phones, are small, it is very difficult or impossible to accurately and quickly multi-touch with two or more fingers in the area of one small button. Accordingly, it is difficult to develop a multi-touch method that is more convenient for users.

On the other hand, representative methods of enlarging or reducing an object on a touch screen include "one-finger zoom" and a method in which an object is reduced or enlarged by pinching or extending the thumb and index finger.

According to "one-finger zoom", when you double-click or long-press an object (eg a photo), an upward arrow and a downward arrow are displayed on the object. At this time, if you drag upward, the object is enlarged, and if dragged downward, the object is reduced. The downside of this method is that you need to double-click or press and hold the object before dragging to zoom in or out.

On the other hand, the method of shrinking or enlarging an object by pinching or stretching the thumb and index finger has excellent intuition and speed of operation, but still needs improvement in operation speed, Since it is reduced, there is a problem in that the shape of the object including the 17 object change aspects, which is conventionally implemented through a mouse, to be described later, is deformed or the effect that the object is rotated cannot be implemented. In addition, there is a problem in that it is difficult to enlarge or reduce a very small object. This is because it is very difficult or virtually impossible to multi-touch very small objects with thumb and forefinger.

And, among the methods of enlarging or reducing an object in the prior art, it is the method that is generally used the most, and in general, a mouse is used. There is a method by the same steps.

Step 1: By a signal that activates the object, including placing the mouse pointer at any point on the object and clicking the left mouse button, the object is activated while the step

(On the boundary of the active area of the object, when the mouse pointer is moved, the shape of the mouse pointer changes to a double-headed arrow indicating the direction in which the object can be enlarged/reduced. The control point and the rotation arrow change the shape of the mouse pointer, and the rotation control point is displayed as shown in No. 9 of Fig. 39. The 8 zoom control points are the midpoint of the 4 sides of the boundary of the active area of the rectangular object and 4 Appears at the vertex, and the rotation control point appears above the boundary of the object's active area.)

Step 2: Hover the mouse pointer on each zoom control point to change the shape of the mouse pointer with a double-headed arrow indicating the direction in which it can be zoomed, or hover the mouse pointer over a rotation control point to change the mouse pointer to a rotation arrow Steps in which the shape of the pointer is changed (see FIGS. 40, 41, 42, 43)

(According to the position of each zoom control point, left and right double arrows, up and down arrows, left up, down right, diagonal double arrows, or right and left, down diagonal double arrows appear.)

Step 3: Click the left mouse button

This step generates a signal to start zooming or rotating the object soon.

Step 4: When dragging in the desired direction, the object is enlarged/reduced or rotated

In this 4th step, 16 types of object enlargement/reduction aspect by the adjustment point selected from the zoom adjustment points 1 to 8 of FIG. 39 and linear drag in 2 directions, and one by the rotation adjustment point of No. 9 of FIG. Examples of 17 object change aspects, including the rotation aspect of , are included.

An adjustment point selected from among the zoom adjustment points 1 to 8 of FIG. 39, which will be described later, and an object enlargement/reduction aspect of 16 aspects by linear drag in two directions are proportional to the rate of change in the horizontal/vertical length of the boundary of the active area of the object. The change rate of the horizontal/vertical length of the object is changed, and the position of the center point of the object is also changed.

According to the method of the present application, steps 1 to 3 are performed in the object shape transformation method that requires the activation of the conventional object only by multi-touch so that the object is recognized as a target button (= target object). While producing an effect, it is also possible to enable the four steps in the object shape transformation method, which requires the activation step of the conventional object in which 17 object change aspects are implemented, to be performed through manipulation after multi-touch.

For better understanding, the 17 types of object change aspects mentioned above will be described as examples.

Hereinafter, the upper horizontal side refers to a side connecting the first and second adjustment points among the adjustment points on the boundary of the active area of the object shown in FIG. Refers to the side connecting the 3rd and 4th control points, the left vertical side refers to the side connecting the 1st and 3rd control points among the control points on the boundary of the active area of the object, and the right vertical side refers to the active side of the object It refers to the side connecting the 2nd and 4th control points among the control points on the boundary of the region.

1) When dragged upward from the 5th adjustment point on the upper horizontal side of FIG. 39, the lengths of the upper and lower horizontal sides and the positions of the lower horizontal sides do not change, and only the lengths of the left vertical side and the right vertical side are enlarged. For example, it is the degree of change from FIG. 26 to FIG. 27 .

2) When dragged in the downward direction from the 5th adjustment point on the upper horizontal side of FIG. 39, the lengths of the upper and lower horizontal sides and the positions of the lower horizontal sides do not change, and only the lengths of the left vertical side and the right vertical side are reduced. For example, it is the degree of change from FIG. 27 to FIG. 26 .

3) When dragged in the upward direction from the 7th adjustment point on the lower horizontal side of FIG. 39, the lengths of the upper horizontal side and the lower horizontal side and the position of the upper horizontal side do not change, and only the lengths of the left vertical side and the right vertical side are reduced. For example, it is the degree of change from FIG. 26 to FIG. 28 .

4) When dragged from the 7th adjustment point on the lower horizontal side of FIG. 39 in the downward direction, the lengths of the upper horizontal side and the lower horizontal side and the position of the upper horizontal side do not change, only the lengths of the left vertical side and the right vertical side are enlarged. For example, it is the degree of change from FIG. 28 to FIG. 26 .

5) When dragged in the right direction from the 8th adjustment point on the left vertical side of FIG. 39, the lengths of the left and right sides and the positions of the right vertical sides do not change, and only the lengths of the upper horizontal side and the lower horizontal side are reduced. For example, it is the degree of change from FIG. 26 to FIG. 30 .

6) When dragged in the left direction from the 8th adjustment point on the left vertical side of FIG. 39 , the lengths of the left vertical side and the right vertical side and the position of the right vertical side do not change, only the lengths of the upper horizontal side and the lower horizontal side are enlarged. For example, the degree of change from FIG. 30 to FIG. 26 .

7) When dragged in the right direction from the 6th adjustment point on the right vertical side of FIG. 39 , the lengths of the left vertical side and the right vertical side and the position of the left vertical side do not change, only the lengths of the upper horizontal side and the lower horizontal side are enlarged. For example, it is the degree of change from FIG. 26 to FIG. 29 .

8) When dragged from the 6th adjustment point on the right vertical side of FIG. 39 in the left direction, the lengths of the left vertical side and the right vertical side and the position of the left vertical side do not change, and only the lengths of the upper horizontal side and the lower vertical side are reduced. For example, it is the degree of the change from FIG. 29 to FIG. 26 .

9) When dragged from the first adjustment point, which is the upper left vertex of FIG. 39, to the lower right direction, the position of the fourth vertex, which is the lower right vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which direction the drag is in the lower right direction within the range of 90 degrees in the lower right direction. For example, it is the degree of the change from FIG. 26 to FIG. 34 .

10) When dragged from the first adjustment point, which is the upper-left vertex of FIG. 39, to the upper-left direction, the position of the fourth vertex, which is the lower-right vertex, does not change, and the length of the four sides is enlarged. At this time, the magnification ratio of the horizontal and vertical lengths varies depending on which upper-left direction is dragged within the range of 90 degrees in the upper-left direction. For example, it is the degree of the change from FIG. 34 to FIG. 26 .

11) When dragged in the lower right direction from the fourth adjustment point, which is the lower right vertex of FIG. 39 , the position of the first vertex, the upper left vertex, does not change, and the length of the four sides is enlarged. At this time, the magnification ratio of the horizontal and vertical lengths varies depending on which direction the drag is drawn in the lower right direction within the range of 90 degrees in the lower right direction. For example, it is the degree of the change from FIG. 26 to FIG. 33 .

12) When dragged in the upper-left direction from the fourth adjustment point, which is the lower-right vertex of FIG. 39, the position of the first vertex, the upper-left vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which upper-left direction is dragged within the range of 90 degrees in the upper-left direction. For example, it is the degree of the change from FIG. 33 to FIG. 26 .

13) When dragged in the upper right direction from the second adjustment point, which is the upper right vertex of FIG. 39 , the position of the third vertex, the lower left vertex, does not change, and the length of the four sides is enlarged. At this time, the magnification ratios of the horizontal and vertical lengths vary depending on which direction is dragged in the right-right direction within the range of 90 degrees in the right-right direction. For example, the degree of change from FIG. 26 to FIG. 31 .

14) When dragged from the second adjustment point, which is the upper right vertex of FIG. 39, to the lower left, the position of the third vertex, the lower left vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which direction the drag is dragged in the lower left direction within the range of 90 degrees in the lower left direction. For example, it is the degree of change from FIG. 31 to FIG. 26 .

15) When dragged from the lower left vertex, the third adjustment point, to the upper right direction in FIG. 39, the position of the second vertex, which is the upper right vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which direction it is dragged in the right-right direction within the range of 90 degrees to the right-right direction. For example, it is the degree of change from FIG. 26 to FIG. 32 .

16) When dragged in the lower left direction from the third adjustment point, which is the lower left vertex of FIG. 39, the position of the second vertex, which is the upper right vertex, does not change, and the length of the four sides is enlarged. At this time, the magnification ratio of the horizontal length and the vertical length is different depending on which direction the drag is drawn in the lower left direction within the range of 90 degrees in the lower left direction. For example, it is the degree of change from FIG. 32 to FIG. 26 .

17) If you drag in any direction out of 360 degrees from the 9th adjustment point, which is the rotation adjustment point of FIG. 39, the object rotates in the drag direction.

In fact, the drag direction at adjustment points 1 to 8 in Fig. 39 can also be dragged in any direction of 360 degrees (especially with adjustment points 1 to 4 having a practical effect), but at each adjustment point, the most The drag direction is only given as an example in the above example. Also, the drag length is given as an example by assuming only the dragging length in general.

The present invention has been devised to solve the above problems, and an object of the present invention is to provide speed, accuracy, An object of the present invention is to provide a method for improving convenience.

[Claim 1]

In a method for recognizing a target button when the touch screen is multi-touched in a device having a touch screen,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 2]

The method according to claim 1,

The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 3]

3. The method according to claim 2,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 4]

3. The method according to claim 2,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 5]

3. The method according to claim 2,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 6]

3. The method according to claim 2,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value in a small order of Y-coordinate values among multi-touched touch points is recognized as a target button. how to do it with

[Claim 7]

The method according to claim 1,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 8]

8. The method according to any one of claims 1 to 7,

In a device having a touch screen, in a method of generating a work signal for any task including character input or object transformation by being operated after multi-touch,

Method characterized in that the operation after multi-touch is multi-on & off, multi-drag, and multi-touch operation by spread fingers.

[Claim 9]

9. The method of claim 8,

The multi-on & off method is a method, characterized in that any one or more of the following methods.

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

[Claim 10]

10. The method of claim 9,

The multi multi knock all on & off method is a method, characterized in that any one or more of the following methods.

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

[Claim 11]

9. The method of claim 8,

The multi-drag method is a method, characterized in that any one or more of the following methods.

1.5.2..8. multi all drag

1.5.2..9. Multi Scythe All Drag

[Claim 12]

12. The method of claim 11,

The multi-knot all drag method is a method, characterized in that any one or more of the following methods.

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

1.5.2..11. Finger drag based on multi-scythe and all sickles

[Claim 13]

9. The method of claim 8,

Method according to claim 1, wherein the method for post-multi-touch manipulation using spread fingers (= post-multi-touch manipulation using open touch points) is any one or more of the following methods.

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

1.5.2..13.9. Multi-scythe all-drag by spread fingers (=multi-scythe-all-drag by spread-out touch points)

1.5.2..13.10. Multi-scythe-all-based finger drag by spread fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

[Claim 14]

In a device having a touch screen, when the touch screen is multi-touched, the multi-touch method, which is a method for the multi-touch process, is one of the following methods.

1.4.2.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 15]

In a device having a touch screen, in a method of generating a work signal for any task including character input or object transformation by being operated after multi-touch,

Method characterized in that the operation after multi-touch is multi-on & off, multi-drag, and multi-touch operation by spread fingers.

[Claim 16]

16. The method of claim 15,

The multi-on & off method is a method, characterized in that any one or more of the following methods.

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

[Claim 17]

17. The method of claim 16,

The multi multi knock all on & off method is a method, characterized in that any one or more of the following methods.

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

[Claim 18]

16. The method of claim 15,

The multi-drag method is a method, characterized in that any one or more of the following methods.

1.5.2..8. multi all drag

1.5.2..9. Multi Scythe All Drag

[Claim 19]

19. The method of claim 18,

The multi-knot all drag method is a method, characterized in that any one or more of the following methods.

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

1.5.2..11. Finger drag based on multi-scythe and all sickles

[Claim 20]

16. The method of claim 15,

The method of manipulation after multi-touch using spread fingers (= manipulation after multi-touch using open touch points) is any one or more of the following methods.

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)

1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

[Claim 21]

In a device having a touch screen, in a method of generating a work signal for any task including character input or object transformation by being operated after multi-touch,

The operation method after the multi-touch is,

A method characterized in that it is a method in which multi-on&off is continuously performed at least once and a different operation is performed depending on the number of times, that is, a multi-multi-tap method.

[Claim 22]

The method according to claim 21, In the case of inputting characters in a multi-multi-tap method,

A method, characterized in that the multi-on&off is continuously performed at least one time or more, and characters belonging to the target character group related to the target button are displayed while circulating according to the number of times.

[Claim 23]

23. The method of claim 22,

After the characters are cycled and displayed, a single touch or multi-touch so that another button is recognized as a target button, the cursor is moved, or the displayed character is definitively input after a certain period of time (eg, 2 seconds).

[Claim 24]

23. The method of claim 22,

When multi-touch when multi-tap is expressed in more detail with n multi-touch,

According to the at least one value of n, that is, according to the situation before the final operation, a specific character group from among the at least one character group is matched, and while belonging to the matched character group, at least one of the at least one character related to the target button is selected. A method characterized in that text is input without changing the text mode.

[Claim 25]

25. The method of claim 24,

The "specific character group" means any one of the following character groups.

1) Any one of two or more different character groups classified into different series according to the spelling rules.

2) A character group corresponding to any one character mode among various character modes in a conventional general mobile phone including a character group in a special character mode.

3) A group of characters assigned to a specific row among characters assigned to the same button.

4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 26]

26. The method of claim 25,

The "specific character group" means a character group to which other characters according to the spelling rule belong, characterized in that it is a character group of characters input in another character mode according to the spelling rule corresponding to the currently set character mode.

[Claim 27]

25. The method of claim 24,

"A specific character group" means that it is any one character group among two or more different character groups classified into different series according to the spelling rules.

In English,

If the currently set character mode is uppercase mode, it is a group of characters that can be input in lowercase mode, or

If the currently set character mode is lowercase, it is a group of characters that can be input in uppercase mode, or

in Japanese

If the currently set character mode is hiragana character mode, it is a group of characters that can be input in katakana character mode,

If the currently set character mode is the katakana character mode, the method comprising: a character group that can be input in the hiragana character mode.

[Claim 28]

28. The method according to any one of claims 21 to 27,

In the method for recognizing the target button,

Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 29]

29. The method of claim 28,

The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 30]

30. The method of claim 29,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 31]

30. The method of claim 29,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 32]

30. The method of claim 29,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 33]

30. The method of claim 29,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it with

[Claim 34]

29. The method of claim 28,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 35]

35. The method of any one of claims 21 to 34,

The multi-touch,

A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points.

[Claim 36]

36. The method of claim 35,

The two fingers,

A method characterized in that the index and middle fingers.

[Claim 37]

37. The method of any one of claims 21 to 36,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by spread touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 38]

38. The method according to any one of claims 21 to 37,

The method according to claim 1, wherein the operation after multi-touch is at least one of the following operations.

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

[Claim 39]

39. The method of any one of claims 21 to 38,

Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters.

[Claim 40]

40. The method according to any one of claims 21 to 39,

The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters.

[Claim 41]

Step of multi-touch so that the object (or the active area of the object) is recognized as a target button

The input method comprising: a step of deforming an object (or an active region of an object) according to a manipulation after multi-touch.

[Claim 42]

42. The method of claim 41,

In the method for recognizing the target button,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 43]

43. The method of claim 42,

The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 44]

44. The method of claim 43,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 45]

44. The method of claim 43,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 46]

44. The method of claim 43,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 47]

44. The method of claim 43,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value in a small order of Y-coordinate values among multi-touched touch points is recognized as a target button. how to do it with

[Claim 48]

43. The method of claim 42,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 49]

49. The method of any one of claims 41 to 48,

An object transformation method, characterized in that the operation is a drag.

[Claim 50]

50. The method of claim 49

A method in which an object (or an active area of an object) is enlarged when it is dragged in at least one first specific direction, and an object (or an active area of an object) is reduced when it is dragged in at least one second specific direction.

[Claim 51]

51. The method of claim 50,

If dragged in the upward direction, it is enlarged,

A method, characterized in that when dragged in the downward direction, it is reduced.

[Claim 52]

51. The method of claim 50,

In the enlarged or reduced method, characterized in that the ratio of the horizontal length to the vertical length of the object is maintained.

[Claim 53]

51. The method of claim 50,

In the enlarged or reduced method, characterized in that the center point of the object is not moved.

[Claim 54]

50. The method of claim 49,

This is a method in which only the horizontal length or only the vertical length or both the horizontal length and the vertical length of the object (or the active area of the object) are enlarged or reduced by the drag direction determined by the device.

[Claim 55]

55. The method of claim 54,

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, the horizontal length is enlarged,

When dragged in the second specific direction of the horizontal direction, the vertical length does not change, the horizontal length is reduced,

When dragged in the first specific direction of the vertical direction, the horizontal length does not change, the vertical length is enlarged,

When dragged in the second specific direction of the vertical direction, the horizontal length does not change, the vertical length is reduced,

When dragged in at least one first specific direction among the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,

When dragged in at least one second specific direction among the diagonal directions, the horizontal length and the vertical length are reduced by the same ratio.

[Claim 56]

56. The method of claim 55,

When dragged in the right direction, the horizontal length is enlarged,

When dragged in the left direction, the horizontal length is reduced,

When dragged in the upward direction, the vertical length is enlarged,

When dragged in the downward direction, the vertical length is reduced,

If dragged in the upper left or right direction, the horizontal and vertical lengths are enlarged at the same ratio,

When dragged in the lower left or lower right direction, a method characterized in that the horizontal length and the vertical length are reduced at the same ratio.

[Claim 57]

55. The method of claim 54,

When dragged in the first specific direction of the horizontal direction, the vertical length does not change, the horizontal length is enlarged,

When dragged in the second specific direction of the horizontal direction, the vertical length does not change, the horizontal length is reduced,

When dragged in the first specific direction of the vertical direction, the horizontal length does not change, the vertical length is enlarged,

When dragged in the second specific direction of the vertical direction, the horizontal length does not change, the vertical length is reduced,

When it is dragged in at least one of the diagonal directions in the range of the first specific direction, the horizontal length and the vertical variation ratio are expanded differently according to each direction within the range,

When dragged in at least one second specific direction range from among the diagonal directions, the horizontal length and vertical variation ratio are reduced differently according to each direction within the range.

[Claim 58]

58. The method of claim 57,

When dragged in the right direction, the horizontal length is enlarged,

When dragged in the left direction, the horizontal length is reduced,

When dragged in the upward direction, the vertical length is enlarged,

When dragged in the downward direction, the vertical length is reduced,

When dragged in the upper-left or upper-right direction, the magnification ratio of the horizontal and vertical lengths is enlarged differently depending on which direction of the upper-left or upper-right range is dragged,

When dragged in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently depending on which direction of the lower left range or the lower right range is dragged.

[Claim 59]

55. The method of claim 54,

In the enlarged or reduced method, characterized in that the center point of the object is moved or not moved.

[Claim 60]

50. The method of claim 49,

Step 1: The object (or the active area of the object) is multi-touched so that it is recognized as a target button and it starts to be dragged, and the specific range inside the object (or the active area of the object) is the target range by the hitting point and the direction in which it starts to be dragged step to be recognized as

Step 2: As the horizontal or vertical length of the object (or the active area of the object) changes according to the recognized hitting point and the determined dragging direction, the direction in which the drag is started is closer to the center of the object (or the active area of the object) A method comprising the step of being reduced in a direction and enlarged in a distant direction.

[Claim 61]

61. The method of claim 60,

When it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper, lower, right, or left directions,

If the determined dragging direction is a direction closer to the center of the object (or the active area of the object),

The lengths of the two sides parallel to the determined drag direction among the two horizontal or two vertical sides of the object (or the active area of the object) are reduced, and the lengths of the two sides perpendicular to the determined drag direction do not change,

If the determined starting direction to be dragged is a direction away from the center of the object (or the active area of the object),

The lengths of the two sides parallel to the determined drag direction among the two horizontal or two vertical sides of the object (or the active area of the object) are enlarged, and the lengths of the two sides perpendicular to the determined drag direction do not change,

If it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper right, lower right, upper left, or lower left direction,

If the determined starting direction to be dragged is a direction closer to the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced. If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of the change in the horizontal and vertical lengths can be set to be different depending on which direction is dragged within the specific drag direction range determined by the device, and the specific drag direction range You can also set the horizontal and vertical lengths to be different at the same rate no matter which direction it is dragged in.

If the determined direction in which the drag is started is a direction away from the center of the object (or the active region of the object), the lengths of the horizontal and vertical sides are enlarged. At this time, too, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length. A method characterized in that it is possible to set the change ratio of the length and the vertical length to be different, and to set the horizontal and vertical length to be different at the same ratio no matter what direction is dragged within a specific drag direction range.

[Claim 62]

62. The method of claim 61,

When it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is right, lower right, upper left, lower left,

- If the determined drag start direction is a direction closer to the center of the object (or the active area of the object), the determined drag from among the three sides surrounding the recognized target range while the center of the object moves in the determined drag direction The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side is not changed,

- If the determined dragging start direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the determined drag direction from among three sides surrounding the recognized target range The position of the side perpendicular to and is moved for enlargement, and the position of the opposite side of the side is not changed,

If it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper right, lower right, upper left, or lower left direction,

- If the determined starting direction to be dragged is a direction closer to the center of the object (or the active area of the object), the center of the object moves in the determined drag direction and is parallel to the drag direction among vertices in the recognized target range. The vertex closest to the straight line is moved for reduction, and the position of the opposite vertex of the vertex may not be changed,

- If the determined starting direction to be dragged is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction and a straight line parallel to the drag direction among vertices in the recognized target range A method, characterized in that the vertex closest to is moved for enlargement, and the position of the vertex opposite to the vertex may not be changed.

[Claim 63]

63. The method of claim 62,

① Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest Y value in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). at the time,

At a point within the (object area or) object activation area (eg, area 5 in FIG. 45) having a Y value greater than or equal to the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), the index finger to be recognized as a reference finger Let the middle finger touch any point on the right side of the index finger and then 'multi-drag' upwards, so that only the vertical length of the object is enlarged without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the smallest Y value of the (object area or) object active area (eg, the lower horizontal side) does not change, and the coordinate(s) with the largest Y value of the (object or) object active area s) (eg, upper horizontal side) can be moved to the upper side, and only the vertical length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 27 is exemplified.

If a point within the (object area or) object activation area (eg, area 7 in FIG. 45) having a Y value less than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2) is to be recognized as a reference finger If the expected index finger is touched, and the middle finger is made to be touched at any point on the right side of the index finger, and then 'multi-drag' upward, only the vertical length can be reduced without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the largest Y value of the (object area or) object active area is not changed, and the coordinate(s) with the smallest Y value of the (object area or) object active area is more In the form of moving upward, only the vertical length of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 28 is exemplified.

② Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest Y value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest Y value is (X2, Y2). at the time,

Let the index finger to be recognized as a reference finger touch a point within the (object area or) object activation area having a Y value greater than or equal to the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), and the middle finger is to the right of the index finger If a part is touched at any point and then 'multi-drag' downward, only the vertical length of the object can be reduced without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the smallest Y value of the (object area or) object active area is not changed, and the coordinate(s) with the largest Y value of the (object or) object active area is moved further down Only the vertical length of the object can be reduced in the falling form. To briefly explain the above description with drawings, a change from Fig. 27 to Fig. 26 can be exemplified.

If the index finger, which is to be recognized as the reference finger, is touched at a point within the (object area or) object activation area having a Y value less than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), and the middle finger is the index finger If it is 'multi-draged' to the bottom after touching any point on the right side of the object, only the vertical length can be enlarged without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the largest Y value of the (object area or) object active area does not change, and the coordinate(s) with the smallest Y value of the (object area or) object active area becomes more In the form of moving downward, only the vertical length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 28 to Fig. 26 is exemplified.

③ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest X value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest X value is (X2, Y2). at the time,

At a point within the (object region or) object activation region (eg, region 6 in FIG. 45) having an X value greater than or equal to the intermediate value of X1 and X2 (=(X1+X2)/2), the index finger to be recognized as a reference finger After letting the middle finger touch any point on the right part of the index finger, if 'multi-drag' to the right is performed, only the horizontal length of the object can be enlarged without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinate(s) with the smallest X value of the (object area or) object active area (eg, the left vertical side) does not change, and the coordinates with the largest X value of the (object or) object active area (s) (eg right vertical side) can be moved to the right and only the horizontal length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 29 can be exemplified.

If the point within the (object area or) object activation area (eg, area 8 in FIG. 45) having an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2) is to be recognized as a reference finger If the expected index finger is touched, and the middle finger is made to be touched at any point on the right side of the index finger, and then 'multi-drag' to the right, only the horizontal length of the object can be reduced without changing the vertical length of the object. Even when only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object active area does not change, and the coordinate(s) with the smallest X value of the (object area or) object active area becomes more In the form of moving to the right, only the horizontal length of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 30 can be exemplified.

④ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest X value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest X value is (X2, Y2). at the time,

Let the index finger to be recognized as the reference finger touch a point within the (object area or) object activation area having an X value greater than or equal to the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is on the right side of the index finger If a part is touched at any point and then 'multi-drag' to the left, only the horizontal length of the object can be reduced without changing the vertical length of the object. Even when only the horizontal length is reduced, the coordinates with the smallest X value of the (object area or) object active area are not changed, and the coordinates with the largest X value of the (object or) object active area are moved further to the left. Only the horizontal length of can be reduced. To briefly explain the above description with drawings, a change from Fig. 29 to Fig. 26 can be exemplified.

If the index finger, which is to be recognized as the reference finger, is touched at a point within the (object area or) object activation area having an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is the index finger If it is 'multi-drag' to the left after touching any point on the right side of , only the horizontal length of the object can be enlarged without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinates with the largest X value of the (object area or) object active area are not changed, and the coordinates with the smallest X value of the (object area or) object active area are moved further to the left. Only the horizontal length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 30 to Fig. 26 can be exemplified.

⑤ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

An active area (object area or) with an X value greater than or equal to the median of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median of Y1, Y2 (=(Y1+Y2)/2) ( Example: Let the index finger, which is to be recognized as the reference finger, touch a point within the area that can be included in area 2 of FIG. 45), and let the middle finger touch any point on the right side of the index finger, and then 'multi-all drag' to the right ', the horizontal and vertical lengths of the object can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the smallest X and Y values of the (object area or) object activation area (eg, vertex 3 in Fig. 39) do not change, (object or) The horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, the second vertex of FIG. 39 ) having the largest X and Y values of the object activation region are moved to the right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 31 can be exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) The index finger to be recognized as the reference finger is touched at a point within the object activation area (eg, the area that can be included in area 3 in FIG. 45), and the middle finger is made to be touched at any point on the right side of the index finger, and then to the right If 'multi-all drag' is performed, the horizontal and vertical lengths of the object can be reduced at the same rate. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the largest X and Y values of the (object area or) object active area remain unchanged, and the X and Y values of the (object area or) object active area do not change. The horizontal and vertical lengths of the object can be reduced in such a way that the coordinates with the smallest value are moved to the right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 32 can be exemplified.

⑥ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

An X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2). Let the index finger, which is to be recognized as the reference finger, touch the point, and the middle finger touch any point on the right side of the index finger. can do. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the smallest X and Y values of the (object area or) object active area do not change, and the X and Y values of the (object or) object active area do not change. In a form in which the largest coordinate is moved to the lower left, the horizontal and vertical lengths of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 31 to Fig. 26 can be exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) Let the index finger, which is to be recognized as a reference finger, touch a point within the object activation area, and let the middle finger touch any point on the right side of the index finger. It can be enlarged in proportion. Even when the horizontal and vertical lengths of the object are expanded at the same rate, the coordinates with the largest X and Y values of the (object area or) object active area remain unchanged, and the X and Y values of the (object area or) object active area do not change. The horizontal and vertical lengths of the object can be enlarged in a form in which the coordinates with the smallest value are moved to the lower left. To briefly explain the above description with drawings, a change from Fig. 32 to Fig. 26 can be exemplified.

⑦ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

(object region or) object activation region with X values greater than or equal to the median of X1, X2 (=(X1+X2)/2) and Y values less than the median of Y1, Y2 (=(Y1+Y2)/2) Let the index finger, which is to be recognized as the reference finger, touch a point within (eg, the area that can be included in area 4 in FIG. 45), and let the middle finger touch any point on the right side of the index finger, then move to the lower right When dragged, the horizontal and vertical lengths of the object can be enlarged at the same ratio. Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the smallest X value and the largest Y value of the (object region or) object activation region (eg, vertex 1 in Fig. 39) do not change, (object region or) Alternatively, the horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, the 4th vertex of FIG. 39 ) having the largest X value and the smallest Y value of the object activation region are moved to the lower right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 33 can be exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) object The index finger to be recognized as the reference finger is touched at a point within the activation area (eg, the area that can be included in area 1 in FIG. 45), and the middle finger is made to touch any point on the right side of the index finger, and then ' When 'multi-all drag', the horizontal and vertical lengths of the object can be reduced at the same rate. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the largest X value and smallest Y value of the (object area or) active area of the object remain unchanged, and the X value of the (object area or) active area of the object does not change. The horizontal and vertical lengths of the object can be reduced in such a way that the smallest coordinates with the largest Y value are moved to the lower right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 34 can be exemplified.

⑧ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

(object region or) object activation region with X values greater than or equal to the median of X1, X2 (=(X1+X2)/2) and Y values less than the median of Y1, Y2 (=(Y1+Y2)/2) Let the index finger, which is to be recognized as the reference finger, touch a point within, and the middle finger touch any point on the right side of the index finger. can make it Even when the horizontal and vertical lengths of an object are reduced at the same rate, the coordinates with the smallest X value and largest Y value of the (object area or) active area do not change, and the X value of the (object or) object active area is the largest. The horizontal and vertical lengths of the object can be reduced in such a way that the coordinates with the largest and smallest Y values are moved to the upper left. To briefly explain the above description with drawings, a change from Fig. 33 to Fig. 26 is exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) object Let the index finger, which is to be recognized as a reference finger, touch a point within the activation area, and the middle finger to touch any point on the right side of the index finger, and then 'multi-drag' to the upper left, the horizontal and vertical lengths of the object are the same ratio can be enlarged to Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the largest X value and the smallest Y value of the (object area or) active area of the object remain unchanged, and the X value of the (object area or) active area of the object does not change. The horizontal and vertical lengths of the object can be enlarged in such a way that the smallest coordinate with the largest Y value is moved to the upper left. To briefly explain the above description with drawings, a change from Fig. 34 to Fig. 26 can be exemplified.

[Claim 64]

62. The method of claim 61,

In the enlarged or reduced method, characterized in that the center point of the object is moved.

[Claim 65]

65. The method of any one of claims 41 to 64,

The multi-touch,

A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points.

[Claim 66]

66. The method of claim 65,

The two fingers,

A method characterized in that the index and middle fingers.

[Claim 67]

67. The method of any one of claims 41 to 66,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 68]

68. The method of any one of claims 41 to 67,

A method, characterized in that the operation after multi-touch is at least one of the following operations

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..7. multi drag

1.5.2..8. multi all drag

1.5.2..9. Multi Scythe All Drag

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

1.5.2..11. Finger drag based on multi-scythe and all sickles

1.5.2..12. multi multi tab

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)

1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

[Claim 69]

In a device having a touch screen, a method for inputting characters,

Displaying a keyboard having a button to which a plurality of characters are assigned on a touch screen;

In the process of multi-on/off so that a specific button is recognized as a target button,

After the point of multi-touch, including after the point of multi-touch or after the point when the multi-touched finger is turned off (= multi-touch is released),

A character input method comprising: inputting a character of a specific order from among the characters assigned to the button recognized as the target button.

[Claim 70]

70. The method of claim 69,

When multi-touch is expressed in more detail with n multi-touch,

Character input method, characterized in that the specific order is determined according to the value of n.

[Claim 71]

71. The method of claim 70,

Character input method, characterized in that the n value and the numeric value corresponding to the specific sequence number is determined to be the same.

[Claim 72]

71. The method of claim 70,

If the value of n is 2, that is, if 2 multi-touch, the second character assigned to the button recognized as the target button is inputted.

[Claim 73]

71. The method of claim 70,

If the value of n is 3, that is, 3 multi-touch, the 3rd character assigned to the button recognized as the target button is input processed,

If the value of n is 4, that is, if 4 multi-touch, the fourth character assigned to the button recognized as the target button is inputted.

[Claim 74]

74. The method of claims 69-73,

In the method for recognizing the target button,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 75]

75. The method of claim 74,

The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 76]

76. The method of claim 75,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 77]

76. The method of claim 75,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 78]

76. The method of claim 75,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 79]

76. The method of claim 75,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value in a small order of Y-coordinate values among multi-touched touch points is recognized as a target button. how to do it with

[Claim 80]

75. The method of claim 74,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 81]

81. The method of claims 69-80,

The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or

The 3 multi-touch is a multi-touch recognized by the touch points of the index, middle, and ring fingers, or

The 4 multi-touch method, characterized in that the multi-touch recognized by the touch points of the index and middle fingers, ring and small fingers.

[Claim 82]

82. The method of any one of claims 69 to 81,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch with spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 83]

83. The method of any one of claims 69 to 82,

A method, characterized in that the operation after multi-touch is at least one of the following operations

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..12. multi multi tab

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

[Claim 84]

84. The method of any one of claims 69 to 83,

Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters.

[Claim 85]

85. The method of any one of claims 69 to 84,

The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters.

[Claim 86]

In a device having a touch screen, a method for inputting characters,

Displaying a keyboard having a button to which a plurality of characters are assigned on a touch screen;

When a specific button is operated after multi-touch so that it is recognized as a target button, after the time when operation starts after being multi-touched, or after the time when operation ends, after multi-touch and after the operation starts,

A character input method comprising: inputting a character of a specific order among characters assigned to a button recognized as a target button by a multi-touch operation.

[Claim 87]

87. The method of claim 86,

According to the operation after the multi-touch,

Character input method, characterized in that the specific sequence number of the input character is determined.

[Claim 88]

88. The method of claim 87,

Character input method, characterized in that when the drag direction is different, it is recognized that the type of manipulation is different after the multi-touch.

[Claim 89]

88. The method of claim 87,

According to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character of at least one character related to the target button is input without changing the character mode while belonging to the matched character group A method characterized in that.

[Claim 90]

89. The method of claim 89,

The "specific character group" means any one of the following character groups.

3) A group of characters assigned to a specific row among characters assigned to the same button.

4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 91]

91. The method of claim 86-90,

In the method for recognizing the target button,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 92]

92. The method of claim 91,

The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.

1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 93]

93. The method of claim 92,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 94]

93. The method of claim 92,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 95]

93. The method of claim 92,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 96]

93. The method of claim 92,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value in a small order of Y-coordinate values among multi-touched touch points is recognized as a target button. how to do it

[Claim 97]

92. The method of claim 91,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 98]

98. The method of any one of claims 86 to 97,

The multi-touch,

A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points.

[Claim 99]

99. The method of claim 98,

The two fingers,

A method characterized in that the index and middle fingers.

[Claim 100]

101. The method of any one of claims 86 to 99,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 101]

101. The method of any one of claims 86-100,

The method according to claim 1, wherein the operation after multi-touch is at least one of the following operations.

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..7. multi drag

1.5.2..8. multi all drag

1.5.2..9. Multi Scythe All Drag

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

1.5.2..11. Finger drag based on multi-scythe and all sickles

1.5.2..12. multi multi tab

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)

1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

[Claim 102]

102. The method of any one of claims 86-101,

Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters.

[Claim 103]

103. The method of any one of claims 86-102,

The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters.

[Claim 104]

In a device having a touch screen, a method for inputting characters,

After the keyboard is displayed on the touch screen,

In the case where a specific button is operated after multi-touch so that it is recognized as a target button,

The time when the final operation of at least one behavior among the final operations that can include 9 behaviors including dragging in 8 directions: off or up, down, left, right, upper left, lower left, upper right, lower right after or after the beginning of the last operation, including after the end of the last operation;

By multi-touch post manipulation including the final manipulation of at least one behavior among the final manipulations that can include 9 behaviors including off or multi-drag in 8 directions,

In the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group,

According to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character of at least one character related to the target button is input without changing the character mode while belonging to the matched character group A method characterized in that.

[Claim 105]

105. The method of claim 104,

The "specific character group" means any one of the following character groups.

1) Any one of two or more different character groups classified into different series according to the spelling rules.

2) A character group corresponding to any one character mode among various character modes in a conventional general mobile phone including a character group in a special character mode.

3) A group of characters assigned to a specific row among characters assigned to the same button.

4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 106]

107. The method of claim 105,

The "specific character group" means a character group to which other characters according to the spelling rule belong, characterized in that it is a character group of characters input in another character mode according to the spelling rule corresponding to the currently set character mode.

[Claim 107]

107. The method of claim 106,

"A specific character group" means that it is any one character group among two or more different character groups classified into different series according to the spelling rules.

In English,

If the currently set character mode is uppercase mode, it is a group of characters that can be input in lowercase mode, or

If the currently set character mode is lowercase, it is a group of characters that can be input in uppercase mode, or

in Japanese

If the currently set character mode is hiragana character mode, it is a group of characters that can be input in katakana character mode,

If the currently set character mode is the katakana character mode, the method comprising: a character group that can be input in the hiragana character mode.

[Claim 108]

108. The method of claim 104-107,

In the method for recognizing the target button,

Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 109]

109. The method of claim 108,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 110]

110. The method of claim 109,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 111]

110. The method of claim 109,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 112]

110. The method of claim 109,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 113]

110. The method of claim 109,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it with

[Claim 114]

109. The method of claim 108,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 115]

115. The method of any one of claims 104 to 114,

The multi-touch,

A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points.

[Claim 116]

116. The method of claim 115,

The two fingers,

A method characterized in that the index and middle fingers.

[Claim 117]

117. The method of any one of claims 104-116,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 118]

118. The method of any one of claims 104-117,

The method according to claim 1, wherein the operation after multi-touch is at least one of the following operations.

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..7. multi drag

1.5.2..8. multi all drag

1.5.2..9. Multi Scythe All Drag

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

1.5.2..11. Finger drag based on multi-scythe and all sickles

1.5.2..12. multi multi tab

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)

1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

[Claim 119]

119. The method of any one of claims 104-118,

Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters.

[Claim 120]

120. The method of any one of claims 104-119,

The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters.

[Claim 121]

In a device having a touch screen, a method for inputting characters,

After the keyboard is displayed on the touch screen,

In the case where a specific button is operated after multi-touch so that it is recognized as a target button,

At least among the final manipulations that can include 5 (9?) behaviors including drag in 4 (8?) directions off or up, down, left, right (, upper left, lower left, upper right, lower right) After the start of the last operation, including after the beginning of the last operation of a behavior or after the end of the final operation,

By multi-touch operation including the final operation of at least one of the final operations that can include 5 (9?) behaviors including multi-drag in the off or 4 (8?) directions,

A first character that belongs to a specific character group among at least one character group (delete?) and is a specific character among at least one character related to the target button (or assigned to the target button??);

A method characterized in that, regardless of the target button, a second character, which is at least one specific character promised for each final operation, is additionally input.

[Claim 122]

122. The method of claim 121,

In the method for recognizing the target button,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 123]

123. The method of claim 122,

The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 124]

124. The method of claim 123,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 125]

124. The method of claim 123,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 126]

124. The method of claim 123,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 127]

124. The method of claim 123,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value in a small order of Y-coordinate values among multi-touched touch points is recognized as a target button. how to do it with

[Claim 128]

123. The method of claim 122,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 129]

131. The method of any one of claims 121-128,

Character input method, characterized in that the character assigned to the target button is displayed to the left of the additionally input character.

[Claim 130]

130. The method of any one of claims 121-129,

The second character is a character input method, characterized in that any one of a vowel, a consonant, a semi-vowel, a semi-consonant, and a special character.

[Claim 131]

131. The method of claim 130,

The second character is a character input method, characterized in that it includes at least one of the characters corresponding to the pronunciation of [a], [e], [i], [o], [u], which are pronunciation symbols of English .

[Claim 132]

130. The method of claim 130,

The second character is a character input method, characterized in that it comprises at least one of A, E, I, O, and U.

[Claim 133]

130. The method of claim 130,

The second character comprises at least one of T, S, N, R, H, D, L, and C.

[Claim 134]

130. The method of claim 130,

The second character is at least one of a, ㅓ, ㅗ, TT, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ㅣ, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅟ, ㅝ or Character input method comprising a.

[Claim 135]

130. The method of any one of claims 121-129,

When dragged for a long time, the second character is a character input method, characterized in that two or more characters.

[Claim 136]

130. The method of any one of claims 121-129,

The text input method further comprising the step of continuously adding and inputting additionally input characters when dragged again in the same direction while the touch is maintained or when the dragging direction is changed and dragged.

[Claim 137]

131. The method of any one of claims 121-128,

According to the situation before the final operation, a specific character group among at least one character group is matched, so that at least one character among at least one character belonging to the matched character group is matched with the character assigned to the target button without changing the character mode A method characterized in that it is additionally input together.

[Claim 138]

140. The method of claim 137,

When any one of multi all on & on or multi all drag in four directions is performed, the second character is any one of A, E, I, O, U,

When any one of multi-knot-all reference finger on/off or multi-knot all reference finger drag is performed, the second character is any one of W and Y,

When any one of the four directions of single dragging is performed, the second character is any one of T, S, N, and R,

When any one of multi-all dragging is performed after single touch in four directions, the second character is any one of H, D, L, and C.

[Claim 139]

139. The method of any one of claims 121-138,

In the case where there are two or more letters assigned to the target button,

According to the situation before the final operation, the method characterized in that the first character is selected and input.

[Claim 140]

140. The method of any one of claims 121-139,

In the case where there are two or more letters assigned to the target button,

According to the situation before the final operation, the method characterized in that the first character is selected and input.

[Claim 141]

141. The method of claim 121 to 140,

The multi-touch,

A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points.

[Claim 142]

142. The method of claim 141,

The two fingers,

A method characterized in that the index and middle fingers.

[Claim 143]

143. The method of any one of claims 121-142,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 144]

145. The method of any one of claims 121-143,

The method according to claim 1, wherein the operation after multi-touch is at least one of the following operations.

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..7. multi drag

1.5.2..8. multi all drag

1.5.2..9. Multi Scythe All Drag

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

1.5.2..11. Finger drag based on multi-scythe and all sickles

1.5.2..12. multi multi tab

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)

1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

[Claim 145]

145. The method of any one of claims 121-144,

Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters.

[Claim 146]

145. The method of any one of claims 121-145,

The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters.

[Claim 147]

In a device having a touch screen, a method for inputting characters,

Displaying a keyboard having a button to which a plurality of characters are assigned on a touch screen;

In the process of multi-on/off so that a specific button is recognized as a target button,

After the point of multi-touch, including after the point of multi-touch or after the point when the multi-touched finger is turned off (= multi-touch is released),

According to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character of at least one character related to the target button is input without changing the character mode while belonging to the matched character group Character input method comprising the step.

[Claim 148]

147. The method of claim 147,

The "specific character group" means any one of the following character groups.

1) Any one of two or more different character groups classified into different series according to the spelling rules.

2) A character group corresponding to any one character mode among various character modes in a conventional general mobile phone including a character group in a special character mode.

Delete below?

3) A group of characters assigned to a specific row among characters assigned to the same button.

4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 149]

149. The method of claim 148,

The "specific character group" means a character group to which other characters according to the spelling rule belong, characterized in that it is a character group of characters input in another character mode according to the spelling rule corresponding to the currently set character mode.

[Claim 150]

150. The method of claim 149,

"A specific character group" means that it is any one character group among two or more different character groups classified into different series according to the spelling rules.

In English,

If the currently set character mode is uppercase mode, it is a group of characters that can be input in lowercase mode, or

If the currently set character mode is lowercase, it is a group of characters that can be input in uppercase mode, or

in Japanese

If the currently set character mode is hiragana character mode, it is a group of characters that can be input in katakana character mode,

If the currently set character mode is the katakana character mode, the method comprising: a character group that can be input in the hiragana character mode.

[Claim 151]

151. The method of claim 147 to 150,

In the method for recognizing the target button,

Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range.

[Claim 152]

152. The method of claim 151,

The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

[Claim 153]

153. The method of claim 152,

In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),

A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button.

[Claim 154]

153. The method of claim 152,

In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button.

[Claim 155]

153. The method of claim 152,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 156]

153. The method of claim 152,

The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it with

[Claim 157]

152. The method of claim 151,

A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

[Claim 158]

157. The method of claim 147 to 157,

The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or

The 3 multi-touch is a multi-touch recognized by the touch points of the index, middle, and ring fingers, or

The 4 multi-touch method, characterized in that the multi-touch recognized by the touch points of the index and middle fingers, ring and small fingers.

[Claim 159]

159. The method of any one of claims 147 to 158,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

[Claim 160]

160. The method of any one of claims 147 to 159,

A method, characterized in that the operation after multi-touch is at least one of the following operations

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..12. multi multi tab

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

[Claim 161]

160. The method of any one of claims 147 to 160,

Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters.

[Claim 162]

162. The method of any one of claims 147 to 161,

The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters.

As described above, according to the present invention, the buttons appearing on the touch screen are used to make the user's operation more convenient when the user inputs. In particular, the small touch button can be recognized as being multi-touched without actually multi-touching.

Further, by allowing specific characters to be additionally input in addition to the characters assigned to the target button through various multi-touch manipulation methods, the character input speed can be improved.

And, through various multi-touch manipulation methods, it can be assigned to the currently set character mode like characters in other character modes (including special characters), not the characters in the currently selected character mode, but only in late sequence (eg, 4th or higher sequence) Characters that cannot be assigned to the currently selected character mode because they can only be assigned outside the currently selected character mode, although not assigned to the currently selected character mode, can be easily entered in the currently selected character mode without changing the character mode. It can also be interpreted as that the character assigned to the mode is additionally assigned to the currently selected character mode, so that it can be easily entered in the currently selected character mode).

And, through various multi-touch operation methods, the size of each button of the conventional QWERTY keyboard is increased by 2-3 times, and typos are prevented through the improved QWERTY keyboard in which 2-3 characters are assigned to each button, By using the same copper wire, the input speed can be improved as a result.

In addition, in a state where objects including pictures, photos, browsers, and windows are being multi-touched with two or more fingers, the direction of movement of the touched finger is opposite, including enlarging or reducing the object by pinching or straightening two or more fingers. In this way, instead of changing the shape of the object, the shape of the object including enlarged or reduced object can be changed through a more convenient manipulation method including dragging two or more fingers in the same direction. Thereby, the operation speed is increased, the movement of the finger is small and comfortable, and even a very small object can be easily enlarged or reduced.

In addition, through the multi-touch manipulation method, the object activation step that must be performed before the shape of the object is deformed as in the prior art is not separately performed, and the object is multi-touched to become a target button and then dragged, so the shape of the object can be deformed.

In object transformation, it is possible to perform more precise work with a finger touched on the touchpad than with a mouse.

In the situation of moving the mouse pointer with the mouse, in normal cases, the mouse pointer movement distance is set to be 5 times larger than the mouse movement distance and used, so it is not suitable for precise work. If it is performed with a finger touched on the touchpad, it is suitable for precise work because it is possible to work under the concept that the movement distance of the finger and the movement distance of the mouse pointer are the same.

And, in producing the above effect, in the multi-touch process, the target button can be recognized even when multi-touch is performed, and among the target button recognition methods, in particular, the target button recognition method by the reference finger The convenience of operation is greatly improved, and among the operation methods after multi-touch, in particular, when the multi-all on & off method is combined, the number of possible operations and convenience are rapidly increased.

1 is a view showing a 5X4 keyboard on a touch screen including a 3X4 keyboard (even special characters are assigned);
2 is a view showing an electronic device showing special characters assigned together with general characters in relation to which physical buttons are mounted, with a portion of the display screen being dedicated;
3 is a view showing a 5X4 keyboard to which a target button recognition method using spread fingers is also applicable;
4 is a view showing a 4X4 keyboard to which a target button recognition method by a reference finger is applicable;
5 is a view showing an input keyboard in Japanese hiragana input mode of 3ㅧ4 type;
Figure 6 is a diagram showing a pop-up state of five characters of hiragana (refer to the upper drawing) and katakana (see the lower drawing) assigned to each button;
7 is a diagram illustrating a conventional English QWERTY keyboard (the method of the present invention is also applicable),
8 is a diagram illustrating an improved English QWERTY keyboard to which the present invention is applicable in which two characters are assigned to one button;
9 is a diagram illustrating a conventional Hangul QWERTY keyboard (the method of the present invention is also applicable),
10 is a diagram illustrating an improved Hangul QWERTY keyboard to which the present invention is applicable in which two characters are assigned to one button;
11 is a diagram illustrating an improved English QWERTY keyboard to which the present invention is applicable in which three characters are assigned to one button;
12 is a diagram illustrating the Cheonjiin keyboard, which is one of the 3X4 keyboards for inputting Hangul;
13 is a view showing a state in which five vowels, A, E, I, O, and U, which are additionally input together with S and S assigned to the target button, are pop-up (eg, after touch operation: 'Multi All On & Off ', 'Multi All Drag'),
14 is a diagram referenced for memorizing drag directions related to A, E, I, O, and U that are additionally input together with the S assigned to the target button;
15 is a view provided for explanation of a process in which the English word "SAME" is input;
16 is a view provided for explanation of a process in which the English word "BEAUTIFUL" is input;
17 is a view showing a state in which T, S, N, and R additionally input together with S and S assigned to the target button are pop-up (eg, after touch operation: 'single drag').
18 is a diagram referenced for memorizing drag directions related to T, S, N, and R that are additionally input together with the S assigned to the target button;
19 is a view showing a state in which H, D, L, and C, which are additionally input together with S and S assigned to the target button, are pop-up (Example of manipulation after touch: 'multi-all drag after single touch')
20 is a diagram referenced for memorizing drag directions related to H, D, L, and C that are additionally input together with the S assigned to the target button;
21 is a view showing a state in which ? (question mark), . (dot), , (comma), ! (exclamation mark) additionally input together with S and S assigned to the target button are pop-up (Example of operation after touch: 'Finger drag based on multi-scythe and all scythe'),
22 is a view showing a state in which W and Y, which are additionally input together with S and S assigned to the target button, are pop-up (eg, 'multi-nick-all reference finger drag');
23 is a diagram referenced for memorizing drag directions related to W and Y additionally input together with S assigned to the target button;
24 is a view provided for explanation of a method in which characters are continuously inputted continuously each time they are dragged two or more times in short succession in the same direction, or by changing the drag direction;
25 is a block diagram of an electronic device to which the present invention is applicable.
Fig. 26 is a view compared with Figs. 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37;
Figure 27 is a view in which only the vertical length is enlarged while the horizontal length is not changed and the center point of the object is moved upward, compared to Figure 26;
FIG. 28 is a view in which only the vertical length is reduced while the horizontal length is not changed and the center point of the object is moved upward, compared to FIG. 26;
Figure 29 is a view in which only the horizontal length is enlarged while the vertical length is not changed and the center point of the object is moved to the right compared to Figure 26;
30 is a view in which only the horizontal length is reduced while the vertical length is not changed and the center point of the object is moved to the right compared to FIG. 26;
31 is a view in which the horizontal and vertical lengths are enlarged while the center point of the object is moved to the right side compared to FIG. 26;
32 is a view in which the horizontal and vertical lengths are reduced while the center point of the object is moved to the right side compared to FIG. 26;
33 is a view in which the horizontal and vertical lengths are enlarged while the center point of the object is moved to the lower right side compared to FIG. 26;
34 is a view in which the horizontal and vertical lengths are reduced while the center point of the object is moved to the lower right side compared to FIG. 26;
35 is a view in which only the vertical length is enlarged without changing the horizontal length while the center point of the object is not moved, compared to FIG. 26;
36 is a view in which the center point of the object is not moved, the vertical length is not changed, and only the horizontal length is enlarged, compared to FIG. 26;
37 is an enlarged view in which the vertical and horizontal lengths are enlarged while the center point of the object is not moved compared to FIG. 26;
38 is an exemplary view before the object is activated
39 is an exemplary view showing a rectangular active area boundary line and 8 zoom control points and 1 rotation control point after the object is activated when an object is activated in a conventional method
40 is a diagram illustrating that when an object is activated in the conventional method, the mouse pointer is changed to a left and right arrow when the mouse pointer is moved to a zoom adjustment point in the middle of the right vertical side of the boundary of the active area of the object;
41 is a view illustrating that when an object is activated in the conventional method, the mouse pointer is changed to an up and down double arrow when the mouse pointer is moved to a zoom adjustment point in the middle of the lower horizontal side of the boundary of the active area of the object;
42 illustrates that the mouse pointer is changed to a diagonal double-headed arrow when the mouse pointer is moved to the zoom adjustment point of the vertex at the lower right of the active area boundary of the object when the object is activated in the conventional method. drawing,
43 is a view illustrating that the mouse pointer is changed to a rotation arrow when the mouse pointer is moved to the rotation adjustment point above the boundary of the active area of the object when the object is activated in the conventional method;
44 is a diagram illustrating a situation where the index finger is recognized as a reference finger, and the index finger and the middle finger are multi-touched so that the touched button S is recognized as a target button (the index finger touches the button S, the middle finger touches the index finger) Touching any point to the right of a point),
45 is a diagram illustrating the subdivision of the same object or an active area of an object into various target ranges;
46 shows top, bottom, left, and right. It is a diagram exemplifying ranges in the upper right, lower right, upper left, lower left, upper right, and lower right directions.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

And, unless otherwise stated, it is assumed that the right hand is used.

First, the table of contents to be discussed is introduced.

1. Definition of terms

1.1. Definitions of other terms

1.1.1. touch screen

1.1.2 Touch button

1.1.3. message

1.1.4. finger

1.1.5. QWERTY keyboard

1.1.6. ON

1.1.7. OFF

1.1.8. ON&OFF

1.1.9. drag

1.1.10. X coordinate

1.1.11. Y coordinate

1.1.12. target button

1.1.13. Reference finger (=reference touch point)

1.1.14. Finger based on the sickle (=touch point based on the sickle)

1.1.15. target range

1.1.16. target point

1.1.17. hitting point

1.1.18. Situation before final operation

1.1.19. final operation,

1.1.20. Operation after touch detail

1.2 Definition of terms for drag direction

1.2.1. straight drag

1.2.2. drag back

1.2.3 Dragging a shape

1.3. Definition of terms for drag length

1.3.1. short drag

1.3.2. drag and hold

1.4. Definition of terms for touch

1.4.1.. Definition of terms for single touch

1.4.1.1. single touch

1.4.2.. Definition of terms for multi-touch

1.4.2.1. multi-touch

1.4.2.2.2. nMulti-touch

1.4.2.3.3. multi all touch

1.4.2.4 Multi Scythe All Touch

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

1.4.2..6. Finger touch based on multi-scythe and all scythe

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

1.5. Definition of terms for post-touch operation

1.5. operation after touch

1.5.1.. Definition of terms for operation after single touch

1.5.1.1.1. Operation after single touch

1.5.1.2. single on & off

1.5.1.3. single drag

1.5.1.4. single multitap

1.5.2.. Definition of terms for operation after multi-touch

1.5.2.1.1. Operation after multi-touch

1.5.2.2.2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Knot All On & Off

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

1.5.2..6. Finger on & off based on multi-scythe all-kick

1.5.2..7. multi drag

1.5.2..8. multi all drag

1.5.2..9. Multi Scythe All Drag

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

1.5.2..11. Finger drag based on multi-scythe and all sickles

1.5.2..12. multi multi tab

1.5.2..13. Definition of terms for operation after multi-touch with spread fingers

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)

1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

1.5.2..14. Most recommended multi-touch post operation

1.5.2..14.1. Most recommended multi-on & off

1.5.2..14.2. Most recommended multi-drag

1.5.3... After single touch, after multi-touch operation

1.6. Definition of term for target button recognition method

1.6.1.. Target button recognition method by reference finger (=target button recognition method by reference touch point)

1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)

1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)

1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)

1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches)

1.6.2.. Recognition of target button using open fingers (= Recognition of target button using open touch points)

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

1.6.3.. Target button recognition method by range including two or more touch points

1.6.4.. Mixed

2. Comprehensive

3. How to input text on the touch screen

4. How to manipulate objects

5. Electronic devices to which the present invention is applicable

Now let's get to the point.

1. Definition of terms

1.1. Definitions of other terms

1.1.1. touch screen

It is a concept of all screens that can recognize touch, including a laser pad and a hologram pad, as well as a general touch screen, as a virtual graphic button is displayed and selectable rather than a keypad equipped with a physical button.

1.1.2 Touch button

It is a concept that includes not only virtual graphic buttons that appear on the touch screen, but also all objects that appear on the touch screen including photos, pictures, browsers, and windows and can be touched by the user. When the object becomes a target button, the target button may also be referred to as a target object.

1 shows a touch screen on which touch buttons are arranged, and FIG. 2 shows an electronic device on which a touch screen and physical buttons are arranged together. The technical idea of the present invention is applicable to a case in which only touch buttons are implemented as shown in FIG. 1, as well as a case in which touch buttons and physical buttons are implemented together.

1.1.3. message

It is a comprehensive concept that refers to everything that can be input, including not only characters expressing general language, but also symbols including punctuation marks, special characters, and special characters including pictograms.

1.1.4. finger

It is a concept that includes not only the finger of a person performing a touch on the touch screen, but also a tool used to touch the touch screen, such as a stylus pen.

And, throughout the entire content of the present application, the word "finger" is a concept that can include even a touch point where a finger is touched from the point of view of a device.

therefore. In the context of the entire application, the word 'finger', which is mainly used from the user's point of view, may be replaced with 'touch point where a finger is touched' or 'touch point by a finger' or 'touch point' from the point of view of the device. many. For example, the word 'index finger' can be interpreted only as the meaning of the word 'index finger' itself, but can be replaced with 'touch point where the index finger is touched' or 'touch point by the index finger' or 'touch point'. Often times. In particular, the word finger in the term defined in the definition of the term is often the same term even if it is replaced with the word touch point.

That is, throughout the present application including the claims, mainly, from the user's point of view, words of the concept of a finger or a finger including the index finger or middle finger are mainly used and described and claimed, but the contents of the device are described as in the above and below description. It should be regarded as being explained or claimed even if it is changed into a phrase from a position. (Actually, there are parts that have been explained or claimed in a different way, but there are far more parts that cannot be explained or claimed by changing because it is so natural. , any part that cannot be explained or otherwise claimed shall be regarded as above.)

Therefore, as a phrase including the word finger is changed to a phrase including the word touch point, which is a phrase from the point of view of the device, even words used before or after the word finger may be changed according to the situation, and the changed content should also be considered as being explained or claimed.

It's also because the device doesn't know which finger was touched by a human's finger.

for example,

The phrase 'multi-touch with index and middle fingers' can be changed to the phrase 'multi-touch by a certain touch and another touch point' or 'multi-touch with two touch points' or a phrase with the same meaning. there is,

The phrase 'a finger touched first is recognized as a reference finger, and a finger touched later is recognized as a sickle reference finger' It can be changed to the phrase 'recognized' or a phrase with the same meaning,

The phrase 'when the index finger, which is the reference finger, is touched first, and then the middle finger, which is the sickle reference finger, is touched later'. can be changed to

The phrase 'touched finger' can be changed to the phrase '(touched) touch point' or a phrase with the same meaning,

The phrase 'points where fingers were touched' can be replaced with the phrase '(touched) touch points' or a phrase with the same meaning.

1.1.5. QWERTY keyboard

Originally, it refers to the standard English computer keyboard keyboard in which the character assignments in the order of Q, W, E, R, T, Y exist in the English keyboard, but in this case, any character in the world is the standard keyboard layout for each country. Refers to a keyboard that includes the character assignment order in And, it is a concept including an improved QWERTY keyboard as shown in FIGS. 8, 10, and 11 .

7 is an example of an English QWERTY keyboard, and FIG. 9 is an example of a Korean QWERTY keyboard.

1.1.6. ON

It refers to being touched (the touch screen), that is, when the finger touches the touch screen.

1.1.7. OFF

Refers to the release of touch (at the touch point), i.e. the release of the finger from the touch screen.

1.1.8. ON&OFF

It refers to an operation in which the touch point is turned off immediately after being turned on, without being dragged.

1.1.9. drag

Refers to an operation in which the touch point is moved to another point while maintaining the 'on' state. The drag includes various drags including 'straight drag', 'return drag', and 'shape drag', which will be described in detail later.

1.1.10. X coordinate

Coordinates on the horizontal axis representing a specific point on the touch screen.

1.1.11. Y coordinate

Coordinates on the vertical axis representing a specific point on the touch screen.

1.1.12. target button

When the user intends to perform a specific operation by 'manipulation after touch', which will be described later, it refers to a button directly related to the specific operation. That is, it refers to a specific button targeted by the user.

1.1.13. Reference finger (=reference touch point)

It refers to a finger that is a standard for the device to recognize the target button among the multi-touched fingers. In a normal case, the finger touched on the target button is the reference finger.

From the device's point of view, it refers to a touch point that is a reference for the device to recognize a target button among multi-touched touch points.

1.1.14. Finger based on the sickle (=touch point based on the sickle)

It refers to at least one finger other than the reference finger among the multi-touched fingers.

From the point of view of the device, it refers to at least one touch point excluding the reference touch point among the multi-touched touch points.

1.1.15. target range

As a concept mainly needed when operations related to objects such as photos, drawings, and browsers are performed,

When the user tries to perform a specific operation by 'post-touch manipulation', which will be described later, a specific range within the object (or object activation area boundary) directly related to the specific operation, that is, a specific range targeted by the user refers to

For example, in a single touch, a range including a point actually touched is recognized as a target range, and in a target button recognition method using a reference finger, a range including a point actually touched by a proximal finger is recognized as a target range.

As another example, while the center point of the object is moved, the length of the left vertical side, the length of the right vertical side, and the position of the left vertical side of the object are not changed, and the position of the right vertical side of the object is changed while the upper horizontal side of the object In order to ensure that the length of the horizontal and lower horizontal sides are equally enlarged to the right, the range to the right of the vertical line passing through the center point of the object (or the boundary of the object activation area) among the points inside the object (or the boundary of the object activation area) is recognized as the target range. It can also be multi-touched and dragged to the right as much as possible.

1.1.16. target point

When the user tries to perform a specific operation with 'post-touch operation' to be described later, a specific point inside the button or object (or the boundary of the object activation area) directly related to the specific operation, that is, the user refers to a specific point in which

For example, in the case of single touch, it refers to the point where the user intends to touch, and in the target button recognition method by the reference finger, it refers to the point where the base finger is intended to be touched.

For another example, while the center point of the object is moved, the position of the lower left vertex of the object is not changed, and the lengths of the upper and lower horizontal sides of the object, the left vertical side, and the right vertical side of the object are enlarged. , may be multi-touched and dragged in the upper right direction so that the upper right vertex of the object (or object active area boundary) among internal points of the object (or object active area boundary line) is recognized as a target point.

1.1.17. hitting point

It is also a specific point required for the device to recognize the target button or target range, is a specific point calculated by at least one touch point actually touched, and the range including the hitting point is recognized as the target range or target button. can

For example, in single touch, the point where the single-touched finger is actually touched is the hitting point, and in the target button recognition method using the reference finger, the point where the base finger is actually touched is the hitting point.

1.1.18. Situation before final operation,

1.1.19. final operation,

1.1.20. Operation after touch detail

The situation before the final operation, the final operation, and the operation after the detailed touch are closely related to each other, so I will explain them all at once.

The situation before the final operation refers to the situation right before the final operation starts in the process of performing the manipulation after (detail) touch.

The final operation is a process that follows the situation before the final operation, and is the last operation to complete the operation after (detail) touch. For example, off or drag in various directions including up, down, left, back, top left, bottom left, top right, or bottom right direction, two or more consecutive drags (drag direction may change), long drag, short drag there is

The operation after detailed touch is the sum of the situation before the final operation and the final operation. In other words, as the details of the post-touch manipulation related to the target button, if the manipulation behavior related to the target button is not the same, the detailed post-touch manipulation is different. The manipulation after detailed touch may be simply expressed as detailed manipulation or manipulation.

To give a comprehensive example of the situation before the final operation, the final operation, and the operation after the detailed touch,

In the five detailed touch-after manipulations, starting with single touch, single on&off and single drag in each of the four directions of up, down, left, and right, five final manipulations of off or dragging in four directions start Since the situation immediately before the event is the same for all five detailed touch manipulations, all of the five detailed post-touch manipulations are the same before the final manipulation,

2In the five detailed post-touch manipulations, starting with multi-touch, multi-all on & off, and multi-all drag in each of the four directions, up, down, left, and right, there are five final actions: off or drag in four directions. Since the situation right before the operation starts is the same for all 5 types of post-touch operations, the situation before the final operation is the same for all 5 types of post-touch operations,

2In the five detailed post-touch operations, starting with multi-touch, multi-knot-all standard finger on & off and up, down, left, right 4 directions of multi-knot-all standard finger drag, off or 4 directions Since the situation just before the start of the 5 final manipulations of dragging is the same for all 5 types of post-touch manipulation, all 5 types of post-touch manipulations are the same before the final manipulation,

After single touch, after 2 multi-touch, multi-all on & off and after each single touch in the four directions up, down, left and right, after 2 multi-touch and then multi-all drag Since the situation right before the start of the five final manipulations of dragging is the same for all the five detailed post-touch manipulations, all of the five sub-touch manipulations have the same situation before the final manipulation.

However, since Multi All On & Off that starts with 2 multi-touch and Multi All On & Off that starts with 3 Multi-touch do not have the same situation right before the final operation of Off, the situation before the final operation is different. It is an operation after touch, and as a result, operation after three touches is different,

The situation before the final operation of upward drag is not the same for the upward multi-all drag starting with 2 multi-touch and the upward multi-all drag starting with 3 multi-touch, so the situation before the final operation is different. It is a manipulation after another detailed touch, and as a result, the manipulation after the third touch is different.

And, even if multi all on & off starts with 2 multi touch, the process of 2 multi touch is multi all on & off with multi all touch and multi all on & off with multi not all touch is the final operation Since the situation right before the start of this is not the same, the situation before the final operation is a different detailed touch operation, and as a result, the operation after the third touch is different,

And, the final operation here means the last operation that is turned off or dragged (first) in the first full-scale operation after being touched. It's not meant to be a last resort on how to change direction, so that each time it's dragged, additional characters are entered in a row.

1.2 Definition of terms for drag direction

1.2.1. straight drag

Refers to drag in one straight line including left (west), right (east), up (north), down (south), right down (southeast), left down (southwest), right (northeast), and left up (northwest) directions. do.

1.2.2. drag back

A straight line refers to a drag that returns while being dragged back to the original position without being turned off after being dragged in a straight line in either direction.

1.2.3 Dragging a shape

It refers to a drag made in multiple directions, not just a straight line, such as a circle, a semicircle, a triangle, a rectangle, etc.

1.3. Definition of terms for drag length

1.3.1. short drag

It refers to dragging under a certain (coordinate) length. Here, the predetermined (coordinate) length can be determined by the horizontal or vertical length of one touch button, but it is also possible to set it differently.

1.3.2. drag and hold

It refers to being dragged beyond a certain (coordinate) length. It should be noted that 'drag', which is not specifically indicated as 'long drag' in this specification, means 'short drag'.

1.4. Definition of terms for touch

1.4.1.. Definition of terms for single touch

1.4.1.1. single touch

It refers to touch so that there is a state in which only one finger is touched. In general, single touch is implemented by touching the target button with the index finger among the five fingers.

From the point of view of the device, it refers to touch so that a state in which only one touch point is touched exists.

1.4.2.. Definition of terms for multi-touch

1.4.2.1. multi-touch

It refers to being touched so that there is a state in which two or more fingers are touched.

From the point of view of the device, it refers to a touch such that two or more touch points exist in a touched state.

Regarding the point at which one (unit) touch including one (unit) single touch or multi-touch from the device's point of view starts to be judged, when there is no touched touch point, the touched touch point is newly When the newly generated touch point is turned off without additional touch occurring after the point in time when the touch point is touched, it can be determined that the post-touch manipulation has been made only with a single touch, In a state where none of the touched touch points are turned off, that is, whenever a new touch occurs at least once while the touch state of all touch points touched so far is maintained, any of the various multi-touch methods described later It is possible to determine whether multi-touch is recognized.

1.4.2.2.2. nMulti-touch

It refers to multi-touch so that a state in which n fingers are touched exists. (From the point of view of a device, it refers to multi-touch so that a state in which n touch points are touched exists.)

for example,

1) 2 multi-touch means multi-touch so that there is a state in which two fingers are touched,

2) 3 multi-touch means multi-touch so that there is a state in which three fingers are touched;

3) 4 multi-touch refers to multi-touch so that there is a state in which four fingers are touched.

Herein, n multi-touch or multi-touch means multi-touch in a multi-all-touch state, which will be described later, unless there is a specific mention or suggestion of which multi-touch method among various multi-touch methods to be described later.

1.4.2.3.3. multi all touch

As a type of multi-touch, in the case of multi-touch, the time difference between the time when the first-touched finger turns on and the last-touched finger turns on is less than a certain period of time (eg 0.1 seconds), and multi-touch is performed almost simultaneously. It refers to multi-touch in cases.

(From the device's point of view, it is a type of multi-touch, and in the case of multi-touch, the time difference between the time when the first touch point is turned on and the time when the last touch point is turned on is less than a certain amount of time (eg 0.1 seconds) or less refers to multi-touch when multi-touch is performed almost simultaneously.)

For example, in performing two multi-touch with the index and middle fingers, the middle and index fingers are simultaneously touched on the touch screen. At this time, even if the middle finger is touched on the touch screen before the index finger, if the time difference between the touch time of the middle finger and the time that the index finger is touched is 0.1 seconds or less, the case where the middle finger and the index finger is recognized as a multi-all touch is included here .

1.4.2.4 Multi Scythe All Touch

As a type of multi-touch, in case of multi-touch, it refers to multi-touch in which the time difference between the time when the first-touched finger turns on and the last-touched finger turns on exceeds a certain amount of time (eg 0.1 second). .(From the device's point of view, it is a type of multi-touch. In case of multi-touch, the time difference between the time when the first touch point is turned on and the time when the last touch point is turned on is a certain amount of time (e.g. 0.1 seconds) Refers to multi-touch exceeding .)

This includes 'finger touch based on multi-knot-all', 'finger touch based on multi-knot-all', and 'finger touch based on multi-kick-all', which will be described later.

For example, in the case of two multi-touch with the index and middle fingers, the middle finger touches the touch screen before the index finger, and the time at which the middle finger is turned on is ahead of the time at which the index finger is turned on by a certain time (eg 0.1 second). is included here.

Since multi-knot all-touch is not recommended, it is not recommended to separately apply multi-knot all-touch and multi-knot all-touch when applying the method of the present invention to an actual device.

1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)

As a type of multi-scythe all touch, it refers to a case in which the reference finger is touched first and then the sickle reference finger is touched later. That is, it refers to a case in which a finger touched first is recognized as a reference finger and a finger touched later is recognized as a sickle reference finger.

(From the device's point of view, it is a type of multi-scythe all touch, and refers to a case in which the reference touch point is touched first and then the sickle reference touch point is touched later. That is, the first touched touch point is recognized as the reference touch point, This refers to a case in which a touch point touched later is recognized as a sickle reference touch point.)

For example, when the index finger and the middle finger are multi-touched so that the index finger is recognized as the reference finger and the middle finger is recognized as the sickle reference finger, when the index finger that is the reference finger is touched and the middle finger that is the sickle reference finger is touched, This includes a case in which the time difference between the time when is touched on and the time when the middle finger is touched on exceeds a predetermined time (eg, 0.1 second).

1.4.2..6. Finger touch based on multi-scythe and all scythe

As a type of multi-scythe all-touch, it refers to a case in which the sickle reference finger is touched first and then the reference finger is touched later. That is, it refers to a case in which a finger touched first is recognized as a sickle reference finger and a finger touched later is recognized as a reference finger.

(From the point of view of the device, it is a type of multi-scythe all touch, and refers to a case in which the sickle reference touch point is touched first and then the reference touch point is touched later. That is, the first touched touch point is recognized as the sickle reference touch point, and , refers to a case in which a touch point touched later is recognized as a reference touch point.)

For example, when the index finger and the middle finger are multi-touched so that the index finger is recognized as the reference finger and the middle finger is recognized as the sickle reference finger, after the middle finger that is the sickle reference finger is touched, the index finger that is the reference finger is touched later. , a case in which the time difference between the touch-on time of the middle finger and the touch-on time of the index finger exceeds a predetermined time (eg, 0.1 second) is included here. Even if the index finger, which is the reference finger, is touched later, the button including the touch point where the index finger was touched maintains its status as the target button.

1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)

As a type of multi-knot-all touch, it refers to a touch when a finger touched in a predetermined sequence is recognized as a reference finger. It is a concept that includes 'multi-scythe-all-nick-based finger touch'.

(From the device's point of view, it is a type of multi-knot all touch, and refers to a touch when a touch point touched in a predetermined sequence is recognized as a reference touch point. It is a concept that includes 'touch point touch based on multi-knot-all' and 'touch-point touch based on multi-knot all sickle'.)

for example,

1) The first-touched finger is designated to be recognized as the reference finger, or

2) The second-touched finger is designated to be recognized as the reference finger, or

3) The third-touched finger is designated to be recognized as the reference finger, or

4) The fourth touched finger may be designated to be recognized as the reference finger.

If the index finger is touched before the middle finger in 2 multi-touch by index and middle fingers,

1) If the first-touched finger is designated as the reference finger, the first-touched index finger becomes the reference finger,

2) If the second-touched finger is designated to be the reference finger, the second-touched middle finger becomes the reference finger.

1.4.2..8. Definition of terms for multi-touch by spread fingers

1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)

As a concept almost identical to the definition of the term 'multi-touch',

However, when the definition of the term 'multi-touch' is understood, a 'target button recognition method using an open finger' to be described later is only a concept applied as a target button recognition method.

1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)

As a concept almost identical to the definition of the term 'n multi-touch',

However, when the definition of the term 'n multi-touch' is understood, a 'target button recognition method using an open finger' to be described later is only a concept applied as a target button recognition method.

1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)

As a concept almost identical to the definition of the term 'multi-all touch',

However, when the definition of the term 'multi-all touch' is understood, the 'target button recognition method using an open finger' to be described later is only a concept applied as a target button recognition method.

1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)

As a concept almost identical to the definition of the term 'multi-not all touch',

However, when the definition of the term 'multi-not all touch' is understood, the 'target button recognition method using an open finger' to be described later is only a concept applied as a target button recognition method.

Since the multi-knot-all touch by spread fingers is not recommended, it is not recommended to apply the multi-knot all touch by the spread fingers and the multi-knot all touch by the spread fingers separately when applying the method of the present invention to an actual device.

1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)

As a concept almost identical to the definition of the term 'multi-knot-all reference finger touch',

However, when the definition of the term 'multi-knot-all reference finger touch' is understood, the 'target button recognition method using an open finger' to be described later is applied as the target button recognition method, and the In the definition of the term, the phrase reference finger (=reference touch point) is replaced with the leftmost touched finger (=touch point), and the phrase sickle reference finger (=sickle reference touch point) is the rightmost touched finger It is just a concept replaced with (= touch point).

1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers

As a concept almost identical to the definition of the term 'multi-nick all-nick reference finger touch',

However, when the definition of the term 'multi-knot-all reference finger touch' is understood, the 'target button recognition method using an open finger' to be described later is applied as the target button recognition method, and the In the definition of the term, the phrase reference finger (=reference touch point) is replaced with the leftmost touched finger (=touch point), and the phrase sickle reference finger (=sickle reference touch point) is the rightmost touched finger It is just a concept replaced with (= touch point).

1.5. Definition of terms for post-touch operation

1.5. operation after touch

It is a term that includes 'operation after single touch' and 'operation after multi-touch', which will be described later.

1.5.1.. Definition of terms for operation after single touch

1.5.1.1.1. Operation after single touch

'Single on & off', 'single drag' and 'single multi-tap', which will be described later, are included in the post-single-touch operation.

Post-single-touch operation sometimes refers only to operations in which subsequent movements are additionally performed after a single touch (which is rarely the case). It is a term that can

So, it can be misunderstood as being single-touched and then manipulated as single-touch again, including the description of single-touch and single-on/off after single-touch or single-drag after single-touch. Since it is described in a way that may be misunderstood as if it occurs twice or the content claimed in the claims is only mentioned as such to help understanding, single touch should be interpreted as occurring only once.

for example,

The expression “single on & off after single touch with the index finger” refers to single touch with the index finger and then turning off the index finger without being dragged, that is, single on/off with single touch or starting with single touch. to be single on & off,

When the index finger is single-touched and then dragged upward, the expression means that the index finger is not turned off after a single touch with the index finger, and the index finger is dragged upward while the index finger is being touched. That is, it refers to single dragging upward with a single touch or single dragging upward starting with a single touch.

In other words, the word "operated after single touch after single touch" is the same as saying "operated after single touch". it is expressed

This is because, unless it is related to 'single multi-tap', there is no need to perform a single touch operation twice.

1.5.1.2. single on & off

It refers to an operation that does not drag after a single touch, but turns off immediately.

1.5.1.3. single drag

Refers to an operation in which the finger is dragged while maintaining the touched state after a single touch. (From the point of view of the device, it refers to an operation in which the touch point is dragged while maintaining the touched state after a single touch.)

1.5.1.4. single multitap

In general, it is a method called a multi-tap method, and refers to an operation in which the same button is continuously pressed with one finger. (From the point of view of a device, it is generally called a multi-tap method. Refers to a losing operation.)

1.5.2.. Definition of terms for operation after multi-touch

1.5.2.1.1. Operation after multi-touch

'Multi-drag', 'multi on & off' and 'multi multi-tap', which will be described later, are included in the operation after multi-touch.

Operation after multi-touch sometimes refers only to operations in which subsequent movements are additionally performed after multi-touch (which is rarely the case), but it is also meant to include the moment of multi-touch before any operation after multi-touch. It is a term that can be used.

So, it can be misunderstood as being manipulated as multi-touch is multi-touched again after multi-touch, including described as multi-all on/off after multi-touch or multi- all drag after multi-touch, that is, multi-touch. The multi-touch should be construed as occurring only once, as it may be misunderstood as if the touch occurs twice, or because the content claimed in the claims is only mentioned as such to help understanding.

for example,

The words “multi-all on & off” after 2 multi-touch with the index and middle fingers mean that after 2 multi-touch with the index and middle fingers, without being dragged, both the index and middle fingers are turned off at the same time, that is, the index and middle fingers It refers to multi-all on & off with 2 multi-touch or multi-all on & off starting with 2 multi-touch by index and middle finger,

The expression of multi-all dragging upward after 2 multi-touch with the index and middle fingers means that after 2 multi-touch with the index and middle fingers, the index, middle and middle fingers are not turned off, that is, both the index and middle fingers are in touch. It means that both the index and middle fingers are dragged upwards. In other words, it refers to multi-all dragging with two multi-touches with the index and middle fingers, or multi-all-draging starting with two multi-touches with the index and middle fingers.

In other words, the phrase “manipulated after multi-touch after multi-touch” is just the same as saying “manipulate after multi-touch”. it is expressed

This is because, unless it is related to 'multi-multi-tap', an operation that requires multi-touch twice is not necessary.

1.5.2.2.2. Multi on & off

One of the multi-touched fingers is not dragged and all are turned off in place. 'Multi-All On & Off' and 'Multi Not All On & Off', which will be described later, are included here. From the standpoint of the multi-touch point, even one of the multi-touch points is not dragged, and it is an operation that turns them all off in place. 'Multi All On & Off' and 'Multi Not All On & Off', which will be described later, are included here. do.)

For example, when the index and middle fingers are manipulated after two multi-touches, the manipulation of turning off both of the multi-touched middle and index fingers in place without being dragged is included here.

1.5.2..3. Multi All On & Off

When multi-touched fingers are multi-on/off, the multi-on that sets the time difference between the time when the first-off finger is turned off and the last-off finger turns off is less than a certain time (eg 0.1 seconds) &off refers to &off. It refers to multi-on & off to be less than a certain period of time (eg 0.1 seconds).

For example, in operation after 2 multi-touch with the index and middle fingers, when the middle finger and the index finger are turned off from the touch screen at the same time, even if the middle finger is turned off on the touch screen before the index finger, the time at which the middle finger is turned off and the index finger If the time difference from the off time is less than a certain amount of time (eg 0.1 second), it is included here.

1.5.2..4. Multi Knot All On & Off

When the multi-touched fingers are 'multi-on & off', the time difference between the time when the first-off finger is turned off and the last-off finger is off exceeds a certain time (eg 0.1 second). It refers to on and off. 'Multi-knot-all-based finger on & off' and 'multi-kick-all-nick-based finger on & off', which will be described later, are included here.

(From the device's point of view, when the multi-touch points are 'multi-on & off', the time difference between the time when the first-off touch point is turned off and the last-off touch point is turned off is a certain amount of time (e.g. :0.1 second) refers to multi-on & off exceeding 'multi-knot all-knot standard touch point on&off' and 'multi-knot all knock standard touch point on & off', which will be described later, are included here.)

For example, in operation after 2 multi-touch with the index and middle fingers, one of the middle and index fingers is first turned off on the touch screen and the other is turned off later. If the time difference from the time when the finger is off exceeds a certain amount of time (eg, 0.1 second), it is included.

1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)

When the multi-scythe is all on and off, it refers to an operation in which the sickle reference finger is turned off first and then the reference finger is turned off later. After being turned off, it refers to an operation in which the reference touch point is turned off later.)

For example, when the index finger is recognized as the reference finger and the middle finger is operated after 2 multi-touches so that the middle finger is recognized as the sickle reference finger, the middle finger, which is the sickle reference finger, is turned off first on the touch screen before the index finger, which is the reference finger. Later, when the index finger is turned off, if the time difference between the time when the middle finger is turned off and the time when the index finger is turned off exceeds a predetermined time (eg, 0.1 second), it is included in this case.

1.5.2..6. Finger on & off based on multi-scythe all-kick

This refers to an operation in which the reference finger is turned off first and then the sickle reference finger is turned off later when the multi-knot all is turned on and off. refers to an operation in which the sickle reference touch point is turned off after

For example, the index finger is recognized as the reference finger and the middle finger is operated after 2 multi-touches so that the middle finger is recognized as the sickle reference finger. , when the stop is turned off later, if the time difference between the time when the index finger is turned on and off and the time when the middle finger is turned on and off exceeds a certain time (eg 0.1 second), it is included in this case .

Even if the index finger, which is the reference finger, is first turned off, the button including the touch point touched by the index finger is maintained as the target button.

1.5.2..7. multi drag

This is a drag that proceeds while one or more fingers among the multi-touched fingers remain on, and 'multi-all drag' and 'multi-not all drag', which will be described later, are included here.

(From the device's point of view, one or more of the multi-touched touch points is a drag that proceeds while the on state is maintained, and 'multi-all drag' and 'multi-not all drag', which will be described later, are included here.)

1.5.2..8. multi all drag

None of the multi-touched fingers are turned off, but the whole starts to be dragged and is dragged. It refers to being dragged.)

The multi-all drag is established when the point in time when all the fingers to be multi-all dragged are moving together begins to be dragged. Dragging started from the edge of the touch screen (upper, lower, left, right, or corner area), and since it was dragged in the direction of the edge, even if one or more of the multi-draged fingers were first turned off, all of the first multi-touch If there is a point in time when the fingers are moving together, it is recognized as a multi-all drag.

For example, when the index finger is recognized as the reference finger and the middle finger is operated after 2 multi-touches with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, both the middle finger, which is the sickle reference finger, and the index finger, which is the reference finger, are not turned off. If they are dragged so that there is a viewpoint that starts to be dragged together, they are included here.

1.5.2..9. Multi Scythe All Drag

A drag manipulated so that a point in time at which at least one of the multi-touched fingers starts to be dragged exists when at least one of the multi-touched fingers is turned off and only the remaining fingers that are still on exist. Finger drag based on sickle all sickle is included here. (From the device's point of view, when at least one of the multi-touched touch points is off, only at least one of the remaining touch points that are still on starts to be dragged. As a drag that is manipulated to have a viewpoint, 'multi-knot-all-based touch point drag' and 'multi-knot-all-knot reference touch point drag', which will be described later, are included here.)

The multi-scythe all-drag is established when a point in time when at least one remaining finger that is still on except a finger that is dragged off with a multi-scythe all starts to be dragged in a state where a point in time exists. Dragging started from the edge of the touch screen (upper, lower, left, right, or corner area), and at least one of the fingers that were still on until the multi-kick all drag started was first turned off because of dragging in the direction of the edge. Even so, if there is a point in time when at least one of the remaining fingers, which started to be multi-scythe all-drag, is moving together, it is recognized as a multi-scythe all-drag.

For example, when the index finger is recognized as the reference finger and the middle finger is operated after 2 multi-touches with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, any one of the middle finger, which is the sickle reference finger, and the index finger, which is the reference finger is first turned off In , a case where the remaining fingers start to be dragged and are dragged is included here.

1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)

Refers to multi-scythe all drag in which the reference finger starts to be dragged after at least one sickle reference finger is turned off. It refers to sickle all drag.)

For example, when the index finger is recognized as the reference finger and the middle finger is multi-touched with the index and middle fingers so that the middle finger is recognized as the sickle reference finger, the middle finger, which is the sickle reference finger, of the middle finger that is the sickle reference finger and the index finger that is the reference finger is operated first. This includes a case where the index finger, which is the reference finger, starts to be dragged later after being turned off and is dragged.

1.5.2..11. Finger drag based on multi-scythe and all sickles

Refers to multi-scythe all drag in which at least one sickle reference finger starts to be dragged after the reference finger is turned off. It refers to sickle all drag.)

For example, when the index finger is recognized as the reference finger and the middle finger is multi-touched with the index and middle fingers so that the middle finger is recognized as the sickle reference finger, the index finger, which is the reference finger, of the middle finger, which is the sickle reference finger, and the index finger, which is the reference finger, is first turned off. This includes the case where the middle finger, which is the scythe reference finger, starts to be dragged and then drags after it is made.

Even if the index finger, which is the reference finger, is first turned off, the button including the touch point touched by the index finger is maintained as the target button.

1.5.2..12. multi multi tab

In general, a multi-tap refers to a manipulation of pressing a touch button several times with one finger. In comparison with the present application, it can be said that it is a single multi-tap method.

For example, a touch button to which A, B, and C are assigned among the touch buttons shown in FIG. 1 ,

1) Press 1 to input A, or

2) Press 2 times to input B, or

3) Press 3 times to input C.

In contrast, multi-tap refers to a multi-tap operation in a multi-touch manner.

To be specific, the multi-multi-tap method is,

In a device having a touch screen, in the method of generating a work signal for any task, including text input or object transformation, by being operated after multi-touch,

The operation method after the multi-touch is,

Multi-on & off may be a method in which different operations are performed depending on the number of times that is performed consecutively at least once or more,

In the case where characters are input by the multi-multi-tap method,

According to the number of times that multi-on & off is continuously performed at least once, the characters belonging to the target character group related to the target button are displayed while circulating, and then single-touch or multi-touch so that another button is recognized as the target button, or This may be a method in which the displayed character is definitively input after the cursor is moved or a certain period of time (eg, 2 seconds) has elapsed. It is recommended to follow any one or more of methods in which characters are definitively inputted in the conventional (single) multi-tap method as a method for definitively inputting characters.

As an example of using this, even in the normal character mode, the following 1) to 3) processes can be performed without changing the character mode,

After multi-touch so that the touch buttons A, B, C and !, ◆, / are assigned among the touch buttons shown in FIG. 1 become the target button,

1) Multi All On & Off is done once so that “!”, the first character among the characters assigned under A, B, and C (!, ◆, /), not A, can be entered,

2) Multi All On & Off is performed twice so that the 2nd character "◆" among the characters (!, ◆, /) assigned under A, B, C instead of B is input;

3) Multi All On & Off is performed 3 times so that the 3rd character "/" among the characters (!, ◆, /) assigned under A, B, and C instead of C is input.

Simply put,

Among the touch buttons shown in Figure 1, A, B, C and !, ◆, / with the index finger and middle finger so that the assigned touch button becomes the target button,

1) Multi-touch (more precisely, multi-all on & off) is performed once so that the first character “!” among the characters (!, ◆, /) assigned under A, B, and C instead of A can be entered. there is,

2) Multi-touch (to be more precise, multi-all on & off) is performed twice so that the second character “◆” among the characters (!, ◆, /) assigned under A, B, and C instead of B is input. there is,

3) Multi-touch (to be precise, multi all on & off) is performed 3 times so that the 3rd character "/" among the characters (!, ◆, /) assigned under A, B, and C instead of C is input. there is.

When the multi-multi-tap method is used, in the case of inputting a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group, depending on the situation before the final operation, at least This is a method in which a specific character group is matched from one character group, and at least one character among at least one character related to the target button is input without changing the character mode while belonging to the matched character group. (It can also be applied to the QWERTY keyboard.)

In short, at least one character belonging to a specific character group and related to the target button can be input without changing the character mode. Here, the specific character group may be any one or more of the following.

1) Any one of two or more different character groups classified into different series according to the spelling rules.

2) A character group corresponding to any one character mode among various character modes in a conventional general mobile phone including a character group in a special character mode.

3) A group of characters assigned to a specific row among characters assigned to the same button.

4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

Matters concerning (here 1) to 5) are also dealt with in various places in the present application including "3. Text input method on a touch screen" and the claims, which will be described later. Detailed description including all descriptions will be omitted.)

For example, which can be one character group among two or more different character groups classified into different series according to the spelling rule of “1)” above,

For example, if the current character mode is English uppercase mode, the character mode to which a specific character group belongs is English/lowercase mode, and if the current character mode is Japanese hiragana character mode, for example, the character mode to which a specific character group belongs is katakana According to the spelling rules in the same character system including the character mode, each character belonging to the current character mode may be a character mode to which a character group consisting of other characters corresponding to each other belongs. That is, it may be a character group consisting of characters input in another character mode on the spelling rule corresponding to the currently set character mode.

For example, if a touch button assigned to A, B, C is recognized as a target button in uppercase English character mode, multi-tap is multi-tapted, any one of lowercase a, b, or c can be input even in uppercase character mode .

Specifically, when multi-tap is multi-tap so that the touch buttons assigned with A, B, C and !, ◆, / are recognized as target buttons, !, ◆, or / in an embodiment in which any one of !, Since it is a format in which a, b, or c is substituted for ◆, or /, specific detailed embodiments will be omitted.

For example, among the characters assigned to the same button in "3)", as an example that can be a character group assigned to a specific row, in the case of FIG. 1, A, B, C and !, ◆, / "!" assigned to line 2 It may be a character group assigned to the second row of each button including , "◆", and "/". As shown in FIG. 1 , although the characters assigned to the second row of the touch button are special characters, these may be implemented as characters other than the special characters.

For example, among the characters assigned to the same button of number "4)", in the case of FIG. 1, A, B, C and "!" assigned to the 4th~6th of the touch buttons assigned with !, ◆, and / It may be a character assigned to the 4th to 6th of each button including , "◆", and "/".

And, when multi-touch at the time of multi-multi-tap is expressed in detail as n multi-touch, different character groups are matched according to different n values, so that the characters of the character group are input without changing the character mode You may.

1.5.2..13. Definition of terms for operation after multi-touch with spread fingers

1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)

As a concept almost identical to the definition of the term 'manipulation after multi-touch',

However, when the definition of the term 'manipulation after multi-touch' is understood, the 'target button recognition method using an open finger', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)

As a concept almost identical to the definition of the term 'multi on & off',

However, when the definition of the term 'multi-on & off' is understood, the 'target button recognition method using an open finger', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)

As a concept almost identical to the definition of the term 'multi all on & off',

However, when the definition of the term 'multi all on & off' is understood, the 'target button recognition method using an open finger' to be described later is only a concept applied as a target button recognition method.

1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)

As a concept almost identical to the definition of the term 'multi-not all on & off',

However, when the definition of the term 'multi-not all on & off' is understood, the 'target button recognition method using an open finger', which will be described later, is only a concept applied as a target button recognition method.

1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)

As a concept almost identical to the definition of the term 'multi-knot all reference finger on & off',

However, when the definition of the term 'multi-knot-all reference finger on & off' is understood, the 'target button recognition method using open fingers', which will be described later, is applied as the target button recognition method, and 'multi-knot all reference finger on' is applied. In the definition of &off', the phrase reference finger (= reference touch point) is replaced with the leftmost touched finger (= touch point), and the phrase sickle reference finger (= sickle reference touch point) is the rightmost It is just a concept replaced by a finger (= touch point) touched on .

1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off

As a concept almost identical to the definition of the term 'multi-knot all-knot standard finger on & off',

However, when the definition of the term 'multi-knot all-nick standard finger on & off' is understood, the 'target button recognition method using an open finger' to be described later is applied as the target button recognition method, and the 'multi-knot all sickle criterion' In the definition of the term 'finger on & off', the phrase reference finger (= reference touch point) is replaced with the leftmost touched finger (= touch point), and the phrase "sickle reference finger (= sickle reference touch point)" is It is just a concept replaced with the rightmost finger (= touch point).

1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)

As a concept almost identical to the definition of the term 'multi-drag',

However, when the definition of the term 'multi-drag' is understood, the 'target button recognition method using an open finger', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)

As a concept almost identical to the definition of the term 'multi all drag',

However, when the definition of the term 'multi-all drag' is understood, the 'target button recognition method using an open finger', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)

As a concept almost identical to the definition of the term 'multi-not all drag',

However, when the definition of the term 'multi-not all drag' is understood, the 'target button recognition method using an open finger' to be described later is only a concept applied as a target button recognition method.

1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)

As a concept almost identical to the definition of the term 'multi-knot-all reference finger drag',

However, when the definition of the term 'multi-knot-all-based finger drag' is understood, the 'target button recognition method using an open finger', which will be described later, is applied as a target button recognition method, and the In the definition of the term, the phrase reference finger (=reference touch point) is replaced with the leftmost touched finger (=touch point), and the phrase sickle reference finger (=sickle reference touch point) is the rightmost touched finger It is just a concept replaced by (= touch point).

1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)

As a concept almost identical to the definition of the term 'multi-nick-all-nick-based finger drag',

However, when the definition of the term 'multi-nick-all-sickle-based finger drag' is understood, the 'target button recognition method using an open finger' to be described later is applied as a target button recognition method, and 'multi-nick all sickle-based finger dragging' is applied as a target button recognition method. In the definition of ', the phrase reference finger (= reference touch point) is replaced with the leftmost touched finger (= touch point), and the phrase sickle reference finger (= sickle reference touch point) touches the rightmost It is just a concept replaced with a finger (= touch point).

1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points)

As a concept almost identical to the definition of the term 'multi-multi-tap',

However, when the definition of the term 'multi-multi-tap' is understood, a 'target button recognition method using an open finger' to be described later is only a concept applied as a target button recognition method.

1.5.2..14. Most recommended multi-touch post operation

1.5.2..14.1. Most recommended multi-on & off

As the most convenient multi-on & off operation for users, it refers to ‘multi all on & off’ implemented with the index and middle fingers, which is the method exemplified in the definition of ‘multi all on & off’ above, and the index finger is recognized as the reference finger. , when the middle finger and middle finger are operated after 2 multi-touch so that the middle finger is recognized as the sickle reference finger, when the middle finger and the index finger are operated to be turned off from the touch screen at the same time, even if the middle finger is turned off from the touch screen before the index finger, the middle finger is It refers to a multi-on/off operation such that the time difference between the off time and the index finger off time is less than a predetermined time (eg, 0.1 second).

1.5.2..14.2. Most recommended multi-drag

It is the most convenient multi-drag operation for the user, and refers to 'multi-all drag' performed with the index and middle fingers, which is the method exemplified in the definition of multi-all drag above. The index finger is recognized as the reference finger, and the middle finger is recognized as the sickle reference finger. It refers to an operation in which both the middle finger, which is the sickle reference finger, and the index finger, which is the reference finger, are dragged so that there is a point in time when they start to be dragged together (without being turned off) in the manipulation after 2 multi-touches with the index and middle fingers as much as possible.

1.5.3... After single-touch operation, after multi-touch operation

After the target button is single-touched, the single-touch state is maintained for a certain period of time (e.g., 0.1 second), and then at least one finger is additionally touched to enter the multi-touch state (after multi-touch). refers to (From the device's point of view, after the target button is single-touched, the single-touch state is maintained for a certain period of time (eg 0.1 seconds) or more, and then at least one touch point is additionally touched to enter the multi-touch state (multi-touch) After touch) refers to the operation in which the operation is performed.)

'Single-touch and then multi-touch operation' includes 'single-touch multi-all on & off' and 'single-touch and multi-all drag'.

For an example of 'multi all on & off after single touch',

After the index finger is single-touched on the target button, the middle finger is additionally touched while the touch state of the index finger is maintained for a certain period of time (e.g. 0.1 seconds), and the index finger and middle finger are multi-touched, and then the index finger and middle finger are dragged. This includes the case where it is not turned on and turned off at the same time. To put the above example simply, it refers to a case where a single touch is first performed with the index finger, and then the middle finger is additionally touched to enter a multi-touch state, and then multi-all on & off.

As an example of 'multi-all drag after single touch',

After the index finger is single-touched on the target button, the middle finger is additionally touched while the touch state of the index finger is maintained for a certain period of time (eg 0.1 seconds), and two multi-touches are made between the index finger and the middle finger, and then the index finger and the middle finger are simultaneously touched. This includes dragging cases. To put the above example simply, it refers to a case where a single touch is first performed with the index finger, and then the middle finger is additionally touched to enter a multi-touch state, and then multi-all drag is performed.

In addition to 'single-touch multi-all on & off' and 'single-touch multi-all drag', various 'single-touch, multi-touch and then operation' can be created by substituting various multi-touch operations after single touch.

1.6. Definition of term for target button recognition method

Before entering the definition of the term, to mention the point at which the target button is judged from the device's point of view, within the time when one (unit) multi-touch is recognized, at least the touch points in the single-touch state have been touched so far. In a state in which any one of the touch points is not turned off or starts to be dragged, the target button may be determined (updated) whenever a new touch occurs.

1.6.1.. How to recognize target button by reference finger

(=Recognition method of target button by reference touch point)

The target button recognition method by the reference finger is a method in which one finger among multi-touched fingers is recognized as a reference finger, and a touch button including a point where the reference finger is touched is recognized as a target button. (From the device's point of view, in the method of recognizing the target button by the reference touch point, any one of the multi-touched touch points is recognized as the reference touch point, and the touch button including the reference touch point is recognized as the target button. way to be.)

1.6.1.1.1 How to recognize the target button by the reference finger according to the X-coordinate value sequence

(=Recognition method of target button by reference touch point according to X-coordinate value order)

This is a method in which a touch button including a point having a value in a specific order among the X coordinate values among points touched by the multi-touched fingers is recognized as a target button.

That is, among the multi-touched touch points, a touch button including a point having a value in a specific order among the X coordinate values is recognized as a target button.

For example, there is a method in which a touch button including a leftmost point among points touched by multi-touched fingers, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button.

For a more detailed example, in the keyboard of the arrangement shown in FIGS. 1, 3, and 4 , the index finger is touched to button 5, and the middle finger is touched by the index finger including button 3 or button 6 (or even button 9 or button #). When touched at any point among the right points of a point, the index finger touching the leftmost point on the touch screen is recognized as a reference finger, and a button that is a button including the point touched by the index finger recognized as the reference finger 5 is recognized as the target button.

Even when the index finger touches the left part inside button 5 and the middle finger touches the right part inside button 5, the index finger being touched at the leftmost point on the touch screen is recognized as the reference finger, and button 5 is the target. recognized as a button.

In this case, when the reference finger is recognized, only the X coordinates of the multi-touched fingers are considered, and the Y coordinates of the multi-touched fingers are not considered.

Therefore, from the user's point of view, to double-touch with the index finger and middle finger so that button 5 is recognized as a target button, button 5 is touched with the index finger, and buttons including a point having a larger X-coordinate value than button 5 or button 5 with the middle finger (Example: Button 3, Button 6, Button 9, or Button #) is to be touched.

Since a touch button including a point in a specific order among the X coordinate values among points touched by multi-touched fingers is recognized as a target button, unlike the above example, a reference finger is recognized in the following way, It is also possible that the touch button including the point where the base finger is touched is recognized as the target button.

for example,

1) The finger touched at the second point from the left may be set to be recognized as the reference finger,

2) The finger touched at the third point from the left may be set to be recognized as the reference finger,

3) The finger touched at the fourth point from the left may be set to be recognized as the reference finger.

1.6.1.2 How to recognize the target button by the reference finger according to the Y-coordinate value sequence

(=Recognition method of target button by reference touch point according to Y coordinate value order)

This is a method in which a touch button including a point having a value in a specific order among the Y coordinate values among points touched by the multi-touched fingers is recognized as a target button.

That is, among the multi-touched touch points, a touch button including a point having a value in a specific order among the Y coordinate values is recognized as a target button.

This is a feasible method because the lengths of the fingers are different. Usually, the middle finger is longer than the index finger, so the following example is assumed and given. So, when multi-touching with the index and middle fingers of the right hand, if the index finger touches button 5, the middle finger does not touch the button 6 which is the right button of button 5, but rather touches the button 3 above button 6. is holding Even if the index finger is longer than the middle finger, the example to be described later can be applied by bending the index finger and straightening the middle finger so that the middle finger is longer than the index finger.

For example, the touch button including the lowest point among the points touched by the multi-touched fingers, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is recognized as the target button.

For a more detailed example, on the keyboard of the arrangement shown in FIGS. 1, 3, and 4, the index finger is touched to button 5, and the middle finger is above the point where the index finger including button 3 (or even button 1 or button 2) is touched. When a touch is made at any point among the points, the index finger touching the lowest point on the touch screen is recognized as the reference finger, and button 5, which is a button including the point touched by the index finger recognized as the reference finger, is the target button is recognized as

Even when the index finger touches the lower part inside button 5 and the middle finger touches the upper part inside button 5, the index finger being touched at the lowest point on the touch screen is recognized as the reference finger, and button 5 is the target. recognized as a button.

In this case, when the reference finger is recognized, only the Y coordinates of the multi-touched fingers are considered, and the X coordinates of the multi-touched fingers are not considered.

Therefore, from the user's point of view, to double-touch with the index finger and middle finger so that button 5 is recognized as a target button, button 5 is touched with the index finger, and buttons including a point with a higher Y-coordinate value than button 5 or button 5 with the middle finger (eg: Button 1, Button 2, or Button 3)

Since a touch button including a point in a specific order among the points in which the multi-touched fingers are touched is recognized as a target button, the reference finger is recognized in the following way, unlike the above example, It is also possible that the touch button including the point where the base finger is touched is recognized as the target button.

for example,

1) The finger touched at the second point from the bottom may be set to be recognized as the reference finger,

2) The finger touched at the third point from the bottom may be set to be recognized as the reference finger,

3) It may be set so that the finger touched at the fourth point from the bottom is recognized as the reference finger.

On the other hand, if the reference finger recognition method here is applied, multi-teach in which both hands are used while the right and left hands are alternated is also possible. This is because the same rule can be applied to both left and right hands. To explain a little more specifically with an example, the touch button including the lowest point among the points touched by the multi-touched fingers, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is the target button. In case the recognition method is applied, if two multi-touches are made in which the index and middle fingers are alternately used with the right and left hands, the index finger of both hands touched at the lower touch point among the multi-touched touch points, whether on the right or left hand, is the reference finger This is because the button including the point where the index finger of both hands recognized as the reference finger and the index finger of both hands recognized as the reference finger is recognized as the target button.

However, multi-teach in which both hands are alternately used is virtually impossible by the method of recognizing the target button by the reference finger according to the order of the X-coordinate values. Because the same rule cannot be applied to both left and right hands.

To explain a little more specifically with an example, the leftmost point among the points touched by the multi-touched fingers, that is, the touch button including the point having the first X-coordinate value in the small order of X-coordinate values is the target button. The recognition method is applied, and when two multi-touches are performed with the index and middle fingers of both hands alternately, the middle finger will be recognized as the reference finger, and the middle finger will be recognized as the reference finger when the index and middle fingers of the left hand are multi-touched. This is because the index finger will be recognized as the reference finger in the case of multi-touch with 2 .

1.6.1.3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touches

(=Recognition method of target button by reference touch point according to the X coordinate value order according to the number of multi-touches)

This is a method in which a specific order to be set in the order of the X coordinate values in which the reference finger is recognized in the 'target button recognition method by the reference finger according to the X coordinate value order' is determined according to the n value in the n multi-touch situation. (Device From the point of view of n, the specific order to be set in the order of the X coordinate values in which the reference touch points are recognized in the 'target button recognition method by the reference touch points according to the X coordinate value order' is determined according to the n values in the n multi-touch situation. the way it is.)

For example, to explain

1) 2 When multi-touch is performed, the finger touched at the 1st point from the left is recognized as the reference finger,

2) 3 When multi-touch is performed, the finger touched at the 2nd point from the left is recognized as the reference finger,

3) 4 When multi-touch is performed, the finger touched at the third point from the left can be set to be recognized as the reference finger.

To give a more specific example, in the keyboard of FIG. 3 or 4 and the arrangement,

1) When button 2 is single-touched with the index finger, the first character assigned to button 2 is input,

2) When Button 2 is touched with the index finger, and Button 3, which is the right button of the button touched with the index finger, is multi-touched, the index finger, which is the finger touched at the 1st point from the left, is recognized as the reference finger, Button 2 touched with the index finger, which is the reference finger, is recognized as the target button, and the second character assigned to button 2, which is the target button, is input;

3) When Button 1 is touched with the index finger, Button 2, which is the right button of the button touched with the index finger, is touched with the middle finger, and Button 3, which is the right button of the button touched with the middle finger, is touched with the ring finger. The middle finger, which is the finger touched at the second point in , is recognized as the reference finger, and button 2 touched by the middle finger, which is the reference finger, is recognized as the target button, so that the third character assigned to button 2, which is the target button, is input. there is.

1.6.1.4 How to recognize the target button by the reference finger according to the Y coordinate value order according to the number of multi-touches

(=Recognition method of target button by reference touch point according to Y coordinate value order according to the number of multi-touches)

This is a method in which specific orders to be set in the order of Y coordinate values in which the reference finger is recognized in the 'target button recognition method by the reference finger according to the Y coordinate value order' are determined according to the n value in the n multi-touch situation. (Device From the standpoint of , the specific order to be set in the Y coordinate value order in which the reference touch point is recognized in the 'target button recognition method by the reference touch point according to the Y coordinate value order' is determined according to the n value in the n multi-touch situation. the way it is.)

For example, to explain

1) 2 When multi-touch is performed, the finger touched at the 1st point from the bottom is recognized as the reference finger,

2) 3 When multi-touch occurs, the finger touched at the 2nd point from the bottom is recognized as the reference finger, or

3) 4 When multi-touch is performed, the finger touched at the third point from the bottom can be set to be recognized as the reference finger.

To give a more specific example, in the keyboard of FIG. 3 or 4 and the arrangement,

1) When button 5 is single-touched with the index finger, the first character assigned to button 5 is input,

2) When button 5 is touched with the index finger, and button 2, which is the upper button of the button touched with the index finger, is touched with the middle finger, when multi-touch becomes 2, the index finger, which is the finger touched at the first point from the bottom, is recognized as the reference finger, Button 5 touched with the index finger, which is the reference finger, is recognized as the target button, and the second character assigned to button 5, which is the target button, is input;

3) When button 8 is touched with the index finger, button 5, which is the upper button of the button touched with the index finger, is touched with the middle finger, and button 2, which is the upper button of the button touched with the middle finger, is touched with 3 multi-touch, The middle finger, which is the finger touched at the second point in , is recognized as the reference finger, and the button 5 touched by the middle finger, which is the reference finger, is recognized as the target button, so that the third character assigned to the target button, button 5, is input. there is.

1.6.2.. How to recognize target button by spread fingers

(= Recognition of target button by open touch points)

The 'target button recognition method using spread fingers' is a method in which a touch button including a new point determined based on points touched by multi-touched fingers is recognized as a target button. The following five methods are included here. (From the device's point of view, the 'target button recognition method using open touch points' is This is how the button is recognized as a target button.)

1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)

A touch button including a point comprising a new X coordinate determined based on the X coordinates of points touched by the multi-touched fingers, and a new Y coordinate determined based on the Y coordinates of the points touched by the multi-touched fingers A method of recognition as a target button is also possible. (From the device's point of view, a new X-coordinate determined based on the X-coordinates of the multi-touched touch points, and a new X-coordinate determined based on the Y-coordinates of the multi-touched touch points. A method in which a touch button including a point made of Y coordinates is recognized as a target button is also possible.)

For example, a touch button including a point consisting of a new X coordinate that is the center of the X coordinates of points touched by the multi-touched fingers, and a new Y coordinate that is the center of the Y coordinates of the points touched by the multi-touched fingers. It can also be recognized as a target button.

For a specific example, when the index and middle fingers are multi-touched, the touch point of the index finger is (X1, Y1), and the touch point of the middle finger is (X2, Y2), X3 (= (X1) A touch button including a point (X3, Y3) consisting of +X2)/2) and Y3(=(Y1+Y2)/2), which is an intermediate coordinate between Y1 and Y2, is recognized as a target button.

As a more specific example, in the keyboard of the arrangement shown in FIG. 3 or FIG. 4, when the index and middle fingers are used to multi-touch,

When the index finger touches button 4 and the middle finger touches button 6, button 5 is recognized as the target button, and even when the index finger touches button 7 and the middle finger touches button 3, button 5 is recognized as the target button .

1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)

A new X-coordinate determined based on the X-coordinates of the points touched by the multi-touched fingers, and a Y-coordinate paired with the X-coordinate of a specific order among the X-coordinate values of the points touched by the multi-touched fingers. A method in which a touch button including a is recognized as a target button is also possible. A method in which a touch button including a point made of a Y coordinate paired with an X coordinate of a specific order among size orders is recognized as a target button is also possible.)

For example, a new X-coordinate that becomes the center of the X-coordinates of points touched by the multi-touched fingers, Y paired with the X-coordinate of the first order among the small orders of the X-coordinate values of points touched by the multi-touched fingers It is also possible that a touch button including a point consisting of coordinates, that is, the smallest X-coordinate and the paired Y-coordinate, is recognized as the target button.

For a specific example, when the index and middle fingers are multi-touched, the touch point of the index finger is (X1, Y1), and the touch point of the middle finger is (X2, Y2), X3 (= (X1) The touch button including the (X3, Y1) point consisting of +X2)/2) and Y1 is recognized as the target button. Since the point with a smaller value will be touched, the X coordinate of the first order among the smaller X coordinate values is X1, which is the X coordinate of the point where the index finger is touched, and the Y coordinate paired with the X1 is Y1.)

As a more specific example, in the keyboard of the arrangement shown in FIG. 3 or FIG. 4, when the index and middle fingers are used to multi-touch,

When the index finger touches button 4 and the middle finger touches button 6, button 5 is recognized as the target button, and even when the index finger touches button 4 and the middle finger touches button 3, button 5 is recognized as the target button .

1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)

A touch button including a new X-coordinate determined based on the X-coordinates of the points touched by the multi-touched fingers, and a point consisting of a Y-coordinate of a specific order among the Y-coordinate values of the points touched by the multi-touched fingers A method of recognition as a target button is also possible. (From the device's point of view, a specific order among the new X coordinates determined based on the X coordinates of the multi-touch points and the Y coordinate values of the multi-touch points A method in which a touch button including a point made of Y coordinates is recognized as a target button is also possible.)

For example, a new X-coordinate that becomes the center of the X-coordinates of points touched by the multi-touched fingers, and a point consisting of the Y-coordinate of the first order among the small orders of the Y-coordinate values of points touched by the multi-touched fingers. It is also possible that the touch button to be recognized as the target button.

For a specific example, when the index and middle fingers are multi-touched, the touch point of the index finger is (X1, Y1), and the touch point of the middle finger is (X2, Y2), X3 (= (X1) A touch button including a point (X3, Y1) consisting of +X2)/2) and Y1 is recognized as a target button. (In general, since the index finger is shorter than the middle finger, the point below the middle finger, that is, Since a point with a smaller Y coordinate value will be touched, the Y coordinate of the first order among the small Y coordinate values is Y1, which is the Y coordinate of the point where the index finger is touched.)

As a more specific example, in the keyboard of the arrangement shown in FIG. 3 or FIG. 4, when the index and middle fingers are used to multi-touch,

When the index finger touches button 4 and the middle finger touches button 3, button 5 is recognized as the target button, and even when the index finger touches button 4 and the middle finger touches button 6, button 5 is recognized as the target button .

1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)

A point consisting of a new Y coordinate determined based on the Y coordinates of points touched by the multi-touched fingers, and an X coordinate paired with a Y coordinate of a specific order among the Y coordinate value size order of the points touched by the multi-touched fingers A method in which a touch button including a touch button is recognized as a target button is also possible. A method in which a touch button including a point consisting of an X coordinate paired with a Y coordinate of a specific order among size orders is recognized as a target button is also possible.)

For example, a new Y coordinate that becomes the center of the Y coordinates of points touched by the multi-touched fingers, and an X paired with the Y coordinate of the first order among the small orders of the Y coordinate values of the points touched by the multi-touched fingers It is also possible that a touch button including a point consisting of coordinates, that is, the smallest Y coordinate and the paired X coordinate, is recognized as the target button.

For a specific example, if the index and middle fingers are multi-touched, the touch point of the index finger is (X1, Y1), and the touch point of the middle finger is (X2, Y2), Y3 (= (Y1) The touch button including the point (X1, Y3) consisting of +Y2)/2) and X1 is recognized as the target button. (In general, regardless of whether the index finger is shorter than the middle finger, if the right hand In the state rotated 90 degrees in the direction, the index finger will be touched at a point lower than the middle finger, that is, a point with a smaller Y coordinate value. The coordinate is Y1, and the X coordinate paired with that Y1 is X1.)

As a more specific example, in the keyboard of the arrangement shown in FIG. 3 or FIG. 4, when the index and middle fingers are used to multi-touch,

When the right hand is turned 90 degrees counterclockwise, when the index finger touches button 8 and the middle finger touches button 1, button 5 is recognized as the target button, and even, the index finger touches button 8 and the middle finger touches button 2 Even when touched, button 5 is recognized as a target button.

1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point)

A touch button including a new Y coordinate determined based on the Y coordinates of the points touched by the multi-touched fingers, and a point consisting of an X coordinate in a specific order among the X coordinate value size order of the points touched by the multi-touched fingers A method of recognition as a target button is also possible. (From the device's point of view, a new Y coordinate determined based on the Y coordinates of the multi-touch points, and the X coordinate value of the multi-touch points in a specific order A method in which a touch button including a point made of X coordinates is recognized as a target button is also possible.)

For example, a new Y coordinate that becomes the center of the Y coordinates of points touched by the multi-touched fingers, and a point consisting of the X coordinate of the first order among the X coordinate values of the points touched by the multi-touched fingers. It is also possible that the touch button to be recognized as the target button.

For a specific example, if the index and middle fingers are multi-touched, the touch point of the index finger is (X1, Y1), and the touch point of the middle finger is (X2, Y2), Y3 (= (Y1) A touch button including a point (X1, Y3) consisting of +Y2)/2) and X1 is recognized as a target button. (In general, the index finger is shorter than the middle finger, so if the right hand In the rotated state, the index finger will touch the point to the right (albeit down) than the middle finger, anyway, the point with a larger X-coordinate value. is X1, which is the X-coordinate of

As a more specific example, in the keyboard of the arrangement shown in FIG. 3 or FIG. 4, when the index and middle fingers are used to multi-touch,

When the right hand is rotated 90 degrees counterclockwise, when the index finger touches button 8 and the middle finger touches button 1, button 5 is recognized as the target button, and even, the index finger touches button 8 and the middle finger touches button 2 Even when touched, button 5 is recognized as a target button.

1.6.3.. Target button recognition method by range including two or more touch points

The most traditional method of recognizing a target button when a device is multi-touched is a method of recognizing a range including two or more touch points as a target button or target range. In this method, the target range or target button must be quite wide. Since the size of the button to which characters are assigned for character input is small, it is very difficult for two fingers to touch the same button. In fact, it can be said that it is very difficult to recognize, and since most objects, including drawings or photos, are large enough to accommodate two fingers, in this way, most of the target buttons can be recognized. However, if the object is too small, it can be said that it is actually very difficult to recognize the target button in this way. Since there are cases where the object is too small, the target button recognition method using the reference finger is most recommended.

Here, when the target button recognition method by the range including two or more touch points is applied as the target button recognition method, the method for recognizing the hitting point by the device may be set in various ways. For example, it is possible to select and set any one of the hitting point recognition methods for the various target button recognition methods shown in "1.6 Definition of Terms for the Target Button Recognition Method" above.

1.6.4. Mixed

It is also possible to recognize the target button by mixing the above-described 'target button recognition method using spread fingers' and the 'target button recognition method using a reference finger'. For example, when the distance between the fingers to be multi-touched is greater than or equal to a certain distance, it is possible to distinguishly and mix a time when the distance is less than a certain distance.

Specifically, in the keyboard of the arrangement as shown in Fig. 1 or Fig. 3 or Fig. 4,

When you want to input any one of A, B, or C from the button assigned to the touch button to which ABC is assigned,

1) The first character, A, is entered when the button is 'operated after single touch' once,

2) When the multi-touch is performed so that the distance between the multi-touched fingers is less than a certain distance, the 'target button recognition method by reference finger' is set to be applied among various methods for recognizing the target button. If it is operated after 2 multi-touch with the index and middle fingers so that the button assigned ABC becomes the target button so that the interval between touch points is less than a certain distance, the second character B is input,

3) When the multi-touch is performed so that the distance between the multi-touched fingers is more than a certain distance, the 'target button recognition method using open fingers' is set to be applied among various methods of recognizing the target button. If it is operated after 2 multi-touch with the index and middle fingers so that the button assigned ABC becomes the target button so that the interval between the touch points is more than a certain distance, the third letter, C, can be moved.

2. Comprehensive

explained in the next section,

I will explain the general situation in the process where multi-touch post manipulation is used, character input and shape transformation of an object are performed.

In operation after multi-touch,

The most used hand is the right hand.

The n-multi-touch that is mainly used is 2 multi-touch that uses the index and middle fingers,

The method for recognizing the target button, which is mainly used, is the leftmost point among the points touched by the multi-touched fingers, that is, among the target button recognition methods by the reference finger according to the X coordinate value order among the target button recognition methods by the reference finger. This is a method in which a touch button including a point having the smallest X-coordinate value in the first order of coordinate values, that is, an X-coordinate value, is recognized as a target button.

And, the multi-touch that is mainly used is multi-all touch among various multi-touch methods mentioned in the definition of the term for multi-touch. Simply put, it is a touch method in which multi-touched fingers are simultaneously touched.

In addition, the mainly used post-touch manipulation methods are multi-all on & off and multi- all-drag methods.

Simply put, the right index finger and middle finger make 2 multi-touch, and in 2 multi-touch, the index finger touches the target button and the middle finger touches anywhere on the right side of the index finger, so that the index finger and middle finger are turned off at the same time. This means that both the index and middle fingers are manipulated to be dragged while the touch state of the index and middle fingers is maintained. At this time, the index finger is recognized as the reference finger, and the middle finger is recognized as the sickle reference finger.

And, in the context of the entire application, including examples to be described later,

If there is no particular mention of the hand used in the multi-touch operation, the multi-touch method, the target button recognition method, and the post-touch operation method, the above-mentioned mainly used methods may be regarded as an applied embodiment.

In addition, the description that a certain button is operated after multi-touch may be regarded as being operated while being multi-touched so that any button can be recognized as a target button, unless otherwise specified.

And, in operation after a single touch, unless otherwise specified, the mainly used finger is the index finger, the target button is touched with the index finger, and then the method of being turned off or dragged may be considered as an embodiment.

However, it should be kept in mind that this is an example for convenience of explanation, and the hand used, the n multi-touch method, the reference finger setting and the target button recognition method, and the after-touch operation method are different from the frequently used methods and embodiments mentioned above. It should be noted that the implementation is also included in the technical spirit of the present invention.

For example, the left hand may be used, and as a method of recognizing a reference finger, a method in which a finger touched a point having the smallest Y coordinate value of a touched point among multi-touched fingers may be applied. Of course, the target button recognition method by fingers can be applied.

And, if the technique introduced in a specific part of the present application is also a technique that can be applied to other parts, it is natural that it can be applied to other parts as well.

In addition, the keyboard to which the method of the present application is applicable is not limited to the type described herein, for example, but is also applicable to various keyboards developed in the prior art or any type of keyboard of a newly developed type.

In the following embodiments, the target button recognition method by the reference finger is mainly assumed as the target button recognition method because this method is convenient for the user. The target button recognition method by the reference finger is,

1) Unlike the target button recognition method using spread fingers, the user does not need to spread their fingers on purpose,

2) In order to use the 'target button recognition method with open fingers' when all of the buttons of the 3ㅧ4 type keyboard are multi-touched so that they can become target buttons, as shown in FIG. 3, there is one row on the left of the first row. As a result, a 5X4 keyboard is required because one more column must be added and one more column to the right of the third column. The leftmost point among the points touched by multi-touched fingers, that is, the first among the small order of the X coordinate values, that is, the X coordinate value has the smallest X coordinate value If a method in which a touch button including a point is recognized as a target button is used, and two multi-touch using the index and middle fingers of the right hand is used, as shown in FIG. Since only a 4X4 keyboard is required, the buttons for entering characters take up less space on the touchpad,

3) In order to single-touch with the index finger, the middle, ring, and small fingers must be closed, whereas in the case of multi-touch with the index and middle fingers, only the ring and small fingers need to be closed.

On the other hand, in the process of manipulation after multi-touch, the difference between the spatial location relationship (= relative distance) at the moment of multi-touch and the spatial location relationship (= relative distance) of the fingers where the touch is maintained should be maintained below a certain standard value. Good is self-evident.

For example, it means that it is difficult if the fingers, which are being touched, are more closed or spread out more than a certain reference value in the process of being manipulated compared to the moment of multi-touch.

3. How to input text on the touch screen

Hereinafter, a method in which characters are input on a touch screen by applying the various manipulations described above will be described in detail.

First, in a device having a touch screen, in a method for inputting characters,

A keyboard with buttons assigned a plurality of characters is displayed on the touch screen,

When a specific button is operated after multi-touch so that it is recognized as a target button, after the time when operation starts after being multi-touched, or after the time when operation ends, after multi-touch and after the operation starts,

Let's look at a method that can be a method in which characters of a specific sequence are input among characters assigned to buttons recognized as target buttons by manipulation after multi-touch.

additionally,

According to the operation after the multi-touch, a specific sequence number of the input characters may be determined,

In the above, if the drag direction is different, it can be recognized that the type of manipulation after the multi-touch is different,

When a specific character among at least one character related to a button recognized as a target button belonging to a specific character group from among the at least one character group is input, a specific character from the at least one character group is input according to the situation before the final operation The character group is matched and, while belonging to the matched character group, at least one character among at least one character related to the target button may be input without changing the character mode.

So, the type of situation before the final manipulation and a specific character group different from the character group input by the single touch manipulation method are matched, and the characters of the matched character group are matched. It may be input without changing the text mode.

And, the "specific character group" may be any one of the following character groups.

1) A group of characters assigned to a specific row among characters assigned to the same button.

2) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence from among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

3) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

If it is expanded further, it can be extended even to the following 4) and 5).

4) Any one of two or more different character groups classified into different series according to the spelling rules.

5) A character group corresponding to any one of the various character modes in the conventional general mobile phone, including the character group of the special character mode.

4 is a view showing a pad including a conventional 3X4 keyboard. In the pad shown in FIG. 4 , the buttons in the fourth row from the right may be omitted. In the pad shown in FIG. 4, English characters are assigned as follows.

1) Button 2 is assigned ABC,

2) Button 3 is assigned DEF,

3) Button 4 is assigned GHI,

4) Button 5 is assigned JKL,

5) MNO is assigned to button 6,

6) Button 7 is assigned PQRS,

7) TUV is assigned to button 8,

8) Button 9 is assigned WXYZ,

9) No English characters are assigned to buttons 1, *, 0, and #.

Among the buttons provided on the phone button pad shown in FIG. 1 , four (W, X, Y, Z) buttons are assigned to the button 9 to which the most letters are assigned.

In this embodiment, 10 to 6 lowercase letters and special characters are additionally assigned to the buttons, and if it is assumed that 10 characters are assigned to each of the buttons, the 1st to 5th characters are 'manipulate after single touch' ', and the 6th to 10th characters may be input as 'manipulate after multi-touch'.

for example,

1) The first character assigned to each button can be input with each button being single on & off with the index finger,

2) The second character assigned to each button can be entered by single-touching each button with the index finger and then dragging it in the upward (= north) direction,

3) The third character assigned to each button can be entered by single-touching each button with the index finger and then dragging it in the right (= east) direction,

4) The 4th character assigned to each button can be entered by dragging it in the downward (=south) direction after single-touching each button with the index finger,

5) The 5th character assigned to each button can be entered by single-touching each button with the index finger and then dragging it in the left (=west) direction,

6) The 6th character assigned to each button can be multi-touched with the index and middle fingers so that each button is recognized as a target button, and then 'multi-all on & off' can be input,

7) The 7th character assigned to each button can be multi-touched with the index and middle fingers so that each button is recognized as a target button, and then 'multi-drag' in the upper (= north) direction to be input,

8) The 8th character assigned to each button can be entered by multi-touching with the index and middle fingers so that each button is recognized as a target button, and then 'multi-all-drag' in the right (=east) direction,

9) The ninth character assigned to each button can be entered by multi-touching with the index and middle fingers so that each button is recognized as a target button, and then 'multi-all-drag' in the downward (= south) direction,

10) The tenth character assigned to each button can be input by 'multi-all-drag' in the left (=west) direction after multi-touch with the index and middle fingers so that each button is recognized as a target button.

If the 6th character assigned to button 5 is a question mark "?",

a) When button 5 is touched with the index finger, any point on the right side of the index finger (that is, the point having a larger X-coordinate value than the index finger, and the Y-coordinate is an irrelevant point, for example, button 6 or button 3) or when touched with the middle finger , the index finger becomes the reference finger, and button 5 is recognized as the target button,

b) In this state, if 'multi all on & off' (that is, when the index and middle fingers are released at the same time (= off)), a question mark "?" is input.

And, assuming that the 7th character assigned to button 5 is a heart "♥",

a) Button 5 is touched with the index finger and any point on the right side of the index finger is touched with the middle finger, so that button 5 is recognized as a target button,

b) In this state, if multi-drag is performed in the upward (= north) direction (that is, if the index and middle fingers are dragged while being touched on the touch screen as they are), a heart “♥” is input.

On the other hand, when the 6th character is input, it is also possible to use 'multi-knot all-on&off' instead of 'multi-knot-all on&off', and more specifically, it is preferable that 'multi-knot-all reference finger on & off' is used. It is possible.

For example, in order to input the question mark "?", which is the 6th character assigned to button 5, after multi-touch is performed so that button 5 is recognized as a target button, the middle finger, which is the 'sickle reference finger', is first turned off and then for a certain period of time ( Example: After 0.1 second) is exceeded, the index finger, which is the reference finger, is turned off.

Also, when inputting the 7th to 10th characters, 'multi not all drag' may be used instead of 'multi not all drag', and more specifically, 'multi not all reference finger drag' may be used.

For example, to input the heart "♥", which is the 7th character assigned to button 5, after multi-touch is performed so that button 5 is recognized as the target button, only the index finger, which is the reference finger, is pressed while the middle finger, which is the sickle reference finger, is off. While it is attached to the touch screen, the finger is dragged in the upper (= north) direction based on the multi-scythe.

On the other hand, as a target button recognition method, 'target button recognition method by a reference finger according to the X-coordinate value order' among 'target button recognition method using a reference finger', aside from the 'target button recognition method using spread fingers' One of the embodiments of the touch button including the leftmost point among the points touched by the multi-touched fingers, that is, the first point among the small orders of the X coordinate values, that is, the point having the smallest X coordinate value. Even if only the method recognized as the target button is used, and only 2 multi-touch using the right index finger and middle finger is used, even if only the following 3 operation methods are applied as an operation method, 15 characters including special characters are displayed on one button. Even when they are assigned, characters can be easily and quickly input without changing the character mode, and characters assigned to different character modes on the same button can be easily and quickly input without changing the character mode.

1) 'Single On & Off', 'Single Drag' in 4 directions,

2) 'Multi All On & Off', 'Multi All Drag' in 4 directions,

3) 'Finger on & off based on multi-kick-all', 'Finger drag based on multi-kick-all' in 4 directions

Now, in a method for inputting characters in a device having a touch screen, after a keyboard is displayed on the touch screen, in the case where a specific button is multi-touched to be recognized as a target button,

Off or up, down, left, right (upper left, lower left, lower right, lower right) The final manipulation of one of the final manipulations that can include 9 behaviors including drag in each direction starts after the beginning of the last operation, including after the point in time or after the end of the last operation;

By multi-touch post manipulation including the final manipulation of at least one behavior among the final manipulations that can include 9 behaviors including off or multi-drag in 8 directions,

In the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group,

According to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character of at least one character related to the target button is input without changing the character mode while belonging to the matched character group Let's see how it could be a way.

Additionally, the "specific character group" may be any one of the following character groups.

1) Any one of two or more different character groups classified into different series according to the spelling rules.

2) A character group corresponding to any one character mode among various character modes in a conventional general mobile phone including a character group in a special character mode.

To expand further, it can be extended to the following cases 3), 4), and 5).

3) A group of characters assigned to a specific row among characters assigned to the same button.

4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

When the above method is applied, Japanese input will be described as an example in which characters assigned to different character modes to the same button can be easily and quickly input without changing the character mode.

Although Japanese has the same pronunciation as uppercase and lowercase letters in English, it is divided into different types of characters called 'hiragana' and 'katakana'.

Therefore, in the hiragana character mode, without changing the character mode

1) 'Single on & off' and 'single drag' in 4 directions are used to input 5 hiragana characters,

2) 'Multi All On & Off' and 'Multi All Drag' in 4 directions are used to input 5 katakana characters,

3) 'Finger on & off based on multi-knot-all' and 'finger drag based on multi-knot-all' in 4 directions are used, so that 5 special characters can be input.

Of course, even in the katakana mode, hiragana characters and special characters may be input without changing the character mode.

The above embodiment will be described in more detail.

5 shows a Japanese input keyboard of 3ㅧ4 type. In the input keyboard as shown in FIG. 5 , five Japanese characters are assigned to each button, and only one representative character is displayed among the five assigned characters.

5 is a Japanese input keyboard in the hiragana character mode.

First, to explain how hiragana is input in hiragana mode as an example,

When a certain button is 'single-touched' (in the following method, the condition of turning off after single-touch is also possible), as shown in the upper drawing of FIG. 6 , five hiragana characters assigned to the single-touched button are displayed. All pop up, at this time,

1. Desired hiragana may be input in such a way that one of the pop-up hiragana characters is touched (eg, single-touched) after the single-touched finger is turned off. As a result, it is a method that requires two touches to input a desired character.

2. The single-touched finger is not turned off, but a desired hiragana character can be input by single dragging in the direction in which the desired hiragana character is located. If the desired hiragana character is located in the center, the hiragana character located in the center may be input by turning the finger off without dragging. That is, five hiragana characters can be input by single on&off and single drag in four directions.

Now, to explain how katakana characters are input without changing the character mode in hiragana mode, for example,

When a certain button is 'multi-touched' so that it is recognized as a target button (in the following method, the condition of turning off after multi-touch is also possible), as shown in the lower drawing of FIG. , all five katakana characters assigned to the 'multi-touch' button to be recognized as the target button are popped up, at this time,

1. Desired katakana characters may be input in such a way that one of the pop-up katakana characters is touched (eg, single touch) after the multi-touched fingers are simultaneously turned off. As a result, it is a method that requires two touches to input a desired character.

2. The multi-touched finger is not turned off, and all fingers are multi-draged in the direction in which the desired katakana character is located, so that the desired katakana character can be input. If a desired katakana character is located in the center, the katakana character located in the center may be input by turning off the multi-touched fingers at the same time without dragging. That is, five katakana characters can be input by multi all on & off and multi all drag in 4 directions.

In addition, the above method can be applied to a conventional QWERTY plate as shown in FIG. 7 . For example, if the current character mode is lowercase English,

1) Single on & off is used so that lowercase English letters are entered,

2) Since multi-on & off is used, uppercase English letters are input without changing the text mode even though the current text mode is lowercase English mode. That is, it is possible to input characters in another character mode corresponding to the current character mode without changing the character mode.

For example, if the current character mode is lowercase English,

When button S is single on&off, lowercase s is input, and when button S is multi-on/off so that it is recognized as a target button, uppercase S can be input even though the current character mode is English lowercase mode.

Now, in a method for inputting characters in a device having a touch screen, in the process of multi-on/off so that a specific button is recognized as a target button,

After the point of multi-touch, including after the point of multi-touch or after the point when the multi-touched finger is turned off (= multi-touch is released),

Let's take a look at a method that can be a method in which a character of a specific order among characters assigned to a button recognized as a target button is input.

Additionally, when the multi-touch is expressed in more detail as n multi-touch, the specific sequence number may be determined according to the n value, or the n value and the numeric value corresponding to the sequence number of the specific sequence number may be determined to be the same. there is.

In particular, like the QWERTY keyboard in the standing state of the smartphone, the size of the button is small, so that the target button cannot be pressed accurately and the surrounding buttons are frequently pressed incorrectly. After making the size of the button larger than that of the buttons shown in FIG. 7 , two or more characters are assigned to one button, and then input can be made without typos according to the following exemplary method.

1) When 'Single On & Off' is used, the first character of each button is input,

2) If 'multi on & off' is used, the second character of each button recognized as a target button can be input.

Taking the button to which 'QW' of FIG. 8 is assigned as an example, in more detail,

1) When the button to which 'QW' is assigned is single-touched and then 'single on & off', that is, single on & off starting with single touch, for example, the button assigned 'QW' is touched with the index finger When it turns off immediately, 'Q', the first character of the button to which 'QW' is assigned, is input,

2) If the button to which 'QW' is assigned is 2 multi-touched so that it is recognized as a target button, then 'multi-all on & off', that is, multi-all on & off starting with multi-touch, for example, 'QW' When the button assigned to is touched with the index finger and the middle finger is touched at any point on the right side of the index finger, and both the index and middle fingers are turned off at the same time, it is implemented so that 'W', the second character of the button to which 'QW' is assigned, is input.

According to this, even the second character assigned to each button can be directly input with one touch action. Even in the case of 2 multi-touch, the wrist or elbow is used only once, so it can be said to be a single touch action. However, since the buttons of FIG. 8 have a larger size than the buttons of FIG. 7 , errors rarely occur.

On the other hand, the principle of the above-described input method can be applied even to the case of the Hangul keyboard shown in FIG. 10, which is an improved Korean QWERTY keyboard shown in FIG. It will be fully understood without detailed explanation.

In addition, the above-described input method can be applied even when three characters are assigned to one button as shown in FIG. 11 . Specifically,

1) The first character assigned to each button is input as single on & off after a single touch,

2) The second character assigned to each button is input as multi all on & off after 2 multi-touch so that each button is recognized as a target button,

3) The third character assigned to each button can be input as multi-all on & off after 3 multi-touch so that each button is recognized as a target button.

To explain with a more specific example,

1) When the button to which 'QWE' is assigned is single-touched and then single-on/off, that is, single-on/off starting with single-touch, for example, the button assigned 'QWE' is touched with the index finger and immediately When off, 'Q', the first character of the button to which 'QWE' is assigned, is input,

2) If the button to which 'QWE' is assigned is multi-touched so that it is recognized as a target button and then multi-all on & off, that is, when multi-all on & off starting with 2 multi-touch, for example, 'QWE' When the assigned button is touched with the index finger, and the middle finger is touched at any point on the right side of the index finger, when both the index and middle fingers are turned off at the same time, 'W', the second character of the button to which 'QWE' is assigned, is input,

3) If the button to which 'QWE' is assigned is multi-touched to be recognized as a target button and then multi-all on & off, that is, multi-all on & off starting with 3 multi-touch, for example, 'QWE' When the assigned button is touched with the index finger, and the middle and ring fingers touch any point on the right side of the index finger to multi-touch for 3 times, when the index finger, middle finger, and ring finger are all off at the same time, 'QWE' is the 3rd character of the assigned button It may be implemented so that 'E' is input.

According to this, even the third character assigned to each button can be directly input with one touch action. 3 Even in multi-touch, the wrist or elbow is used only once, so it can be said to be a one-touch action. However, since the buttons of FIG. 11 have a larger size than the buttons of FIGS. 7 and 8 , errors do not further occur.

In the method of inputting the third character in FIG. 11, a special character including a punctuation mark is additionally assigned one by one to at least one button of the keyboard as shown in FIG. 8 in which two characters are assigned per button. It can also be applied to a keyboard (not shown) having a button to which three characters are assigned, to easily and quickly input the third special character assigned to each button without changing the character mode. Doing this is likely to be much more useful than FIG. 11 .

On the other hand, in order to input 'Z' in the keyboard arrangement as shown in FIG. 4, 4 multi-touch so that the button to which 'WXYZ' is assigned is recognized as a target button, and then multi-all on & off, that is, 4 multi-touch When multi-all starts on & off, for example, button 9 to which 'WXYZ' is assigned together is always touched with the index finger, and with the middle finger, ring finger, and little finger, any point on the right side of the index finger is touched to become 4 multi-touch, and the index finger , the middle finger, the ring finger, and the small finger are all turned off at the same time, the fourth character of the button 9 'Z' may be input. In this way, even the fourth character assigned to each button can be directly input with one touch action.

In addition, the above method can be applied to a conventional QWERTY plate as shown in FIG. 7 .

If the multi-touch is expressed in detail as n multi-touch, the specific sequence is not determined according to the n value as described above, but according to the n value, that is, according to the situation before the final operation, among at least one character group. A specific character group may be matched and, while belonging to the matched character group, at least one character among at least one character related to the target button may be input without changing the character mode.

For example, if the current character mode is lowercase English,

1) Single on & off is used so that lowercase English letters are entered,

2) Since multi-on & off is used, uppercase English letters are input without changing the text mode even though the current text mode is lowercase English mode. That is, it is possible to input characters in another character mode corresponding to the current character mode without changing the character mode.

For example, if the current character mode is lowercase English,

When button S is single on&off, lowercase s is input, and when button S is multi-on/off so that it is recognized as a target button, uppercase S can be input even though the current character mode is English lowercase mode.

And, the "specific character group" may be any one of the following character groups.

1) Any one of two or more different character groups classified into different series according to the spelling rules.

2) A character group corresponding to any one character mode among various character modes in a conventional general mobile phone including a character group in a special character mode.

To expand further, it can also be extended to the following cases.

3) A group of characters assigned to a specific row among characters assigned to the same button.

4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).

5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

Hereinafter, as a method in which predetermined characters are additionally input in addition to the characters assigned to the target button by manipulation after touch, a method in which two or more characters are input by manipulation after one touch will be described.

In a device having a touch screen, a method for inputting characters,

After the keyboard is displayed on the touch screen, in the case where a specific button is operated after multi-touch so that it is recognized as a target button,

The final operation of at least one behavior among the final operations that can include 9 behaviors including off or drag in each direction such as up, down, left, right (upper left, lower left, upper right, lower right) starts after the time the last operation begins, including after the time the last operation ends, or after the time the last operation ends;

By multi-touch post manipulation including the final manipulation of at least one behavior among the final manipulations that can include 9 behaviors including off or multi-drag in 8 directions,

belonging to a specific character group among at least one character group,

A first character that is a specific character among at least one character related to (or assigned to) the target button;

This is a method in which a second character, which is at least one specific character promised for each final operation, is additionally input regardless of the target button.

Additionally, according to the situation before the final operation, a specific character group is matched from among at least one character group, so that at least one character among at least one character belonging to the matched character group is assigned to the target button without changing the character mode It may be additionally input with text. And, in the case where there are two or more letters assigned to the target button,

According to the situation before the final operation, the first character may also be selected.

First, the case of application to an English keyboard will be described as an example. 7 exemplifies the English QWERTY keyboard, it can be seen that only one character per button is indicated.

On the English QWERTY keyboard shown in FIG. 7 , a manipulation after touch is used, so that two or more characters may be simultaneously input by one manipulation.

More specifically, in addition to the character assigned to the target button, one character including a specific vowel or half vowel (or half consonant) or consonant is additionally input, or 2 including the suffix ING in the present continuous tense and ED suffix in the past tense More than one character can be implemented to be additionally input together with the character assigned to the target button.

Hereinafter, in English character input, it is assumed that the target button is button S, and after touching (single-touch or multi-touch) so that button S is recognized as a target button, dragging or off in 4 directions (up, down, left, right) It will be described that specific characters are additionally input together with the character assigned to the target button by taking as an example that other characters are additionally input together with S through the operation.

First, when multi-on/off or multi-all drag in four directions, A, E, I, O, and U are additionally input in addition to the letters assigned to the target button.

(When this method is applied to characters other than English, it corresponds to the pronunciation of [a], [e], [i], [o], [u] in English phonetic symbols instead of A, E, I, O, and U It is recommended to be replaced with

When button S is multi-touched, as shown in the left figure of FIG. 13, all five 'S+ vowels' pop up, and SA, SI, SE, SU, or One of the SOs can be entered.

To explain a little more, in a state where all five 'S+ vowels' are popped up by multi-touch, a desired 'S+ vowel' can be input by multi-draging in the direction where the desired 'S+ vowel' is located. If the desired 'S+ vowel' is located in the center, all fingers are turned off without dragging, and as a result, the 'S+ vowel' located in the center can be input by turning multi-all on/off.

In this case, as shown in the right drawing of FIG. 13 instead of SE, SI, SO, and SU as shown in the right drawing of FIG. 13 , it may be implemented to indicate only E, I, O, and U.

To explain with a specific example, as shown in Fig. 13, after 2 multi-touches with the index and middle fingers so that the button S is recognized as the target button,

1) When 'Multi All On & Off', A is additionally input along with the S assigned to the target button, that is, SA is input,

2) When 'multi-all drag' upwards, I is additionally input along with the S assigned to the target button, that is, SI is input,

3) When 'multi-all drag' to the right, E is additionally input with the S assigned to the target button, that is, SE is input,

4) When 'multi-all drag' downward, U is additionally input along with S assigned to the target button, that is, SU is input,

5) When 'multi-all drag' to the left, O can be additionally input together with S assigned to the target button, that is, SO can be input.

On the other hand, it can be input in a way that requires two touches, but as a method that is not recommended, when the button S is multi-touched, as shown in the left figure of FIG. 13, all five 'S + vowels' are popped up, First, all fingers are turned off, and in that state, a desired 'S+ vowel' is selected by a touch (eg, single touch), so that one of SA, SI, SE, SU, or SO is input. At this time, it is also possible to implement such that only E, I, O, and U are marked as shown in the right drawing of FIG. 13 instead of SE, SI, SO, and SU as shown in the right drawing of FIG. 13 .

Of course, a method other than the pop-up method shown in FIG. 13 is also possible as a method of notifying which characters are additionally input according to the on/off and drag directions, and the user does not know what additionally input characters are. You can rely only on the memorization of

In the method in which specific characters are additionally input together with the characters assigned to the target button in the present application including the above embodiment, the point that the additionally input characters are not assigned to the target button is mainly described. It can also be described from the perspective of being assigned. However, this is only a matter of perspective and has nothing to do with understanding the principles of the present application. For example, A, E, I, O, U that are additionally input together with S assigned to button S, which is the target button in the above, are one It can also be said that one of the 2nd to 6th characters is additionally input along with the 1st character assigned to each button by manipulation after one touch. The same applies to an embodiment in which specific characters are additionally input together with the characters assigned to the target button, which will be described later.

On the other hand, it is a method that is not recommended because the method used in almost all QWERTY keyboards in the past, which is a method in which only the characters assigned to the target button are input with single on & off, is not applied,

An example of allowing A, E, I, O, and U to be additionally input in addition to the letters assigned to the target button in the case of single on/off or single dragging in four directions will be described.

In a state in which all five 'S+ vowels' are popped up by a single touch, a desired 'S+ vowel' can be input by dragging in the direction in which the desired 'S+ vowel' is located. If the desired 'S+ vowel' is located in the center, the finger is turned off without dragging and the 'S+ vowel' located in the center may be input.

To explain with a specific example, after button S is single-touched with the index finger (to be recognized as a target button),

1) When single on & off, A is additionally input together with the S assigned to the target button, that is, SA is input, that is, SA is input,

2) When 'single drag' upwards, I is additionally input along with the S assigned to the target button, that is, SI is input,

3) When 'single drag' to the right, E is additionally input along with S assigned to the target button, that is, SE is input,

4) When 'single drag' downward, U is additionally input together with S assigned to the target button, that is, SU is input,

5) When 'single drag' to the left, O can be additionally input together with S assigned to the target button, that is, SO can be input.

On the other hand, it is not recommended because the number of multi-touched fingers in the on&off method and the drag method does not match, so it is a method that can confuse users. As an embodiment to which multi-on & off is applied,

1) With all four 'S+ vowels' popped up by a single touch, the desired 'S+ vowel' is inputted by dragging in the direction where the desired 'S+ vowel' is located,

2) If the desired 'S+ vowel' is located in the center, it can be input as multi all on & off.

To explain with a specific example,

1) If button S is multi-touched with the index and middle fingers so that it is recognized as a target button and then multi-all is turned on/off, A is additionally input with the S assigned to the target button, that is, SA is input,

2) When button S is single-touched with the index finger and then 'single-drag' upward, I is additionally input together with the S assigned to the target button, that is, SI is input,

3) If button S is single-touched with the index finger and then 'single-drag' to the right, E is additionally input together with the S assigned to the target button, that is, SE is input,

4) If button S is single-touched with the index finger and then 'single dragged' downward, U is additionally input with S assigned to the target button, that is, SU is input,

5) If button S is single-touched with the index finger and then 'single dragged' to the left, O may be additionally input together with S assigned to the target button, that is, SO may be input.

For reference, I will introduce three methods of assigning the assignment positions for A, E, I, O, and U, which are additionally input with S, so that it is easy to memorize. Other methods are possible.

As a first method, a method with reference to FIG. 14 will be described.

This method is the most recommended memorization method and is also the method applied to the above-described embodiments.

1) A is the most used vowel, so it is assigned to the center,

2) Since I is a vertical standing shape, it is assigned to the top,

3) E is assigned to the right because the right side of the letter is open,

4) Assigning U to the bottom (or assigning U with two vertical lines to the bottom, as U is the first spelling of the word Under, because I has one vertical line at the top),

5) O is the shape of a human mouth, so it can be assigned to the left.

However, since this is only an example, the positions of A, E, I, O, and U that are additionally input together with S may be assigned differently from the above. The same applies to the following method.

For example, since O is a shape that seems to be in the middle, it is possible to assign it to the bottom, and it is also possible to assign U to the left.

In the second method, as another example, according to the order of pronunciation during vocal practice, in the order of A, E, I, O, U 1) Once A is assigned to the center, 2) clockwise from the top, E at the top, and E at the right I can be assigned to , O to the bottom, and U to the left.

As a third method, which is not highly recommended,

1) Since O is a shape that seems to be in the middle, it is assigned to the center,

2) I is assigned to the top for the same reason as in method 1,

3) E is also assigned to the right for the same reason as in method 1,

4) U is also assigned to the lower side for the same reason as the first method,

5) The remaining A can be assigned to the left.

As a fourth method, which is not highly recommended,

1) Since O is a shape that seems to be in the middle, it is assigned to the center,

2) I is assigned to the top for the same reason as in method 1,

3) E is also assigned to the right for the same reason as in method 1,

4) A, which has a shape like a pedestal or a pointed tower that can balance the left and right, is assigned to the bottom,

5) The remaining U can be assigned to the left.

Hereinafter, actual words will be used as an example, and processes of input will be described in detail.

15 is a diagram provided to explain a process in which the English word “SAME” is input. The input of the English word "SAME" is possible through the process of sequentially inputting "SA" and "ME".

For example, to explain

1) If button S is multi-touched with the index and middle fingers so that it is recognized as a target button and then 'multi-all on & off', A is additionally input with the S assigned to the target button, that is, SA is input,

2) If the button M is multi-touched with the index and middle fingers to be recognized as the target button and then 'multi-drag' to the right, E can be additionally input along with the M assigned to the target button, that is, ME can be input.

16 is a diagram provided to explain a process in which the English word “BEAUTIFUL” is input. Input of the English word "BEAUTIFUL" is possible by sequentially inputting "BE", "AU", "TI", "FU", and "L".

For example, to explain

1) If button B is multi-touched with the index and middle fingers to be recognized as a target button and then 'multi-drag' to the right, E is additionally input with B assigned to the target button, that is, BE is input,

2) When button A is multi-touched with the index and middle fingers so that it is recognized as a target button and 'multi-all drag' downwards, U is additionally input together with A assigned to the target button, that is, AU is input,

3) If the button T is multi-touched with the index and middle fingers to be recognized as the target button and then 'multi-drag' upward, I is additionally input with the T assigned to the target button, that is, TI is input,

4) When button F is multi-touched with the index and middle fingers so that it is recognized as a target button and then 'multi-all drag' downwards, U is additionally input together with F assigned to the target button, that is, FU is input,

5) Button L is single on & off so that L can be input.

15 and 16 , according to the character input method according to the present embodiment in which representative vowels A, E, I, O, and U can be simultaneously input together with the character assigned to the target button, the input speed is It can be assumed that it can be significantly faster.

And, in the above, it has been described that A, E, I, O, and U are additionally input together with the letters assigned to the target button, but since this is only an example for the convenience of description, it is possible to be implemented differently .

That is, in addition to vowels, it is possible to implement such that characters other than A, E, I, O, and U, including semi-vowels, semi-consonants, and consonants, are additionally input together with the letters assigned to the target button.

If the number of buttons is less than all the alphabetic numbers used like a 3X4 type, 4X4 type or 5X4 type keyboard, the frequently used letters are displayed on the touch buttons, and the letters with low usage frequency are operated after touch. They can also be entered together.

On the other hand, it is possible to realize that a vowel is additionally input together with the character assigned to the target button by the multi-touch operation, and consonants are used together with the character assigned to the target button by the single-touch operation. It is preferable that other consonants input together by manipulation after a single touch are composed of consonants with high frequency of use.

T, S, N, R, H, D, L, and C are consonants that are frequently used together with other English letters in order of frequency.

And, for example, as in the above-described embodiment

In the case of 'Multi All On & Off' and 'Multi All Drag', A, E, I, O, U are entered together with the character assigned to the target button,

In case of 'single drag', T, S, N, R should be entered together with the letter assigned to the target button,

In the case of multi-all dragging after single touch, H, D, L, and C are inputted along with the letter assigned to the target button,

When a finger is dragged based on the multi-kick all, W and Y are inputted along with the letter assigned to the target button,

Multi-scythe When a finger is dragged based on all sickles, ? (question mark), . (dot), , (comma), and ! (exclamation mark) can be entered without changing the device settings in addition to the character assigned to the target button. .

That is, after the touch operation method is changed, the character group to be input together with the character assigned to the target button can be changed without changing the setting of the device.

In other words, it can be said that a specific character group additionally input is matched according to the situation before the final operation without changing the character mode.

That is, according to the situation before the final operation, a specific character group among at least one character group is matched, and the character of the matched character group is obtained. It can be said that it is an input method without changing the text mode.

First, in the case of 'single drag', an example of allowing T, S, N, and R to be additionally input in addition to the letters assigned to the target button will be described.

For example, as shown in Fig. 17, after the button S is 'single-touched' with the index finger,

1) When the index finger is 'single dragged' to the left, T is additionally input along with the S assigned to the target button, that is, ST is input,

2) When the index finger is 'single dragged' downward, S is additionally input together with the S assigned to the target button, that is, SS is input,

3) When the index finger is 'single-drag' upward, N is additionally input along with the S assigned to the target button, that is, the SN is input,

4) When the index finger is 'single dragged' to the right, R can be additionally input together with the S assigned to the target button, that is, SR can be input.

Recalling the contents shown in FIG. 18 , it is possible to easily memorize how additionally input characters change depending on the drag direction along with the characters assigned to the target button.

Now, when multi-all dragging is performed after a single touch, H, D, L, and C are additionally input in addition to the letters assigned to the target button.

For example, as shown in FIG. 19, after 'single-touch' with the index finger so that button S becomes the target button, the touch state of the index finger is maintained for a certain period of time (eg, 0.1 second) or more After 2 multi-touch so that the button S is recognized as the target button by making the middle finger touch anywhere on the right side of the touched part,

1) When the index and middle fingers are multi-draged upward, H is additionally input with the S assigned to the target button, that is, SH is input,

2) When the index and middle fingers are multi-draged to the right, D is additionally input with S assigned to the target button, that is, SD is input,

3) If the index and middle fingers are multi-draged downward, L is additionally input with the S assigned to the target button, that is, SL is input,

4) When the index and middle fingers are multi-draged to the left, C can be additionally input together with the S assigned to the target button, that is, SC can be input.

Recalling the contents shown in FIG. 20 , it is possible to easily memorize how additionally input characters change depending on the drag direction along with the characters assigned to the target button.

Now, when a finger is dragged on the basis of the multi-knot-all, W and Y are input together with the letters assigned to the target button as an example.

For example, if two multi-touches are made with the index and middle fingers of the right hand, assuming that the index finger is recognized as the reference finger and the middle finger becomes the sickle reference finger,

As shown in Fig. 22, after two multi-touch with the index and middle fingers so that the button S is recognized as a target button, only the middle finger, which is the sickle reference finger, is turned off, and the touch state of the index finger is maintained,

1) When the index finger is dragged to the right, Y is additionally input together with the S assigned to the target button, that is, SY is input,

2) When the index finger is dragged to the left, W may be additionally input together with the S assigned to the target button, that is, SW may be input.

23 , it is possible to easily memorize how additionally input characters along with the characters assigned to the target button change depending on the drag direction.

Now, when a finger is dragged based on the multi-scythe, all scythes, in addition to the character assigned to the target button, frequently used special characters "? (question mark), . (dot), , (comma), ! (exclamation point)" are input Let me explain with an example.

For example, if two multi-touches are made with the index and middle fingers of the right hand, assuming that the index finger is recognized as the reference finger and the middle finger becomes the sickle reference finger,

As shown in Fig. 21, after two multi-touch with the index and middle fingers so that the button S is recognized as the target button, only the index finger, which is the reference finger, is turned off, and the touch state of the middle finger, which is the sickle reference finger, is maintained.

1) When the middle finger is dragged upward, ? (question mark) is additionally input with the S assigned to the target button, that is, S? is input,

2) When the middle finger is dragged to the right, a . (dot) is additionally input together with the S assigned to the target button, that is, S. is input,

3) When the middle finger is dragged to the left, , (comma) is additionally input with the S assigned to the target button, that is, S, is input,

4) When the index finger is dragged downward, ! (exclamation point) may be additionally input together with the S assigned to the target button, that is, S! may be input.

On the other hand, after multi-touch operation including 'single-touch and drag' or 'multi-touch and then drag' is used, the number of additionally inputted characters along with the characters assigned to the target button in the 'target button' is 2 instead of 1. It is also possible to implement more than one.

For example, it may be implemented so that the number of additionally inputted characters together with the characters assigned to the target button is determined according to whether the touch before dragging is single or multi-touch.

For a more specific example, in the case of 'single touch and drag', the number of additionally inputted characters along with the characters assigned to the target button is one, and in the case of 'multi-touch and drag', the characters assigned to the target button and The number of characters that are additionally input together is two or more, each of which can be implemented.

On the other hand, in the case of being dragged briefly after touch, the number of characters input together with the character assigned to the target button is one, and in the case of being dragged after touching and long, the number of characters input with the character assigned to the target button is set to two, It is also possible to implement each.

For example, after 2 multi-touch with index and middle fingers so that button S is recognized as a target button,

1-1) When multi-all dragged upwards briefly, 'I' is additionally input together with the S assigned to the target button, that is, SI is input,

1-2) If multi-all dragged upward for a long time, 'II' (or 'ING') is additionally input together with the S assigned to the target button, that is, SII (or SING) is input,

2-1) When multi-all dragged to the right briefly, 'E' is additionally input together with the S assigned to the target button, that is, SE is input,

2-2) When multi-all dragged to the right for a long time, 'EE' or 'ED' (past tense suffix) is additionally input along with the S assigned to the target button, that is, SEE (or SED) is input,

3-1) If multi-all dragged to the left briefly, 'O' is additionally input along with the S assigned to the target button, that is, SO is input,

3-2) When multi-all dragged to the left for a long time, 'OO' (or 'ON') is additionally input together with the S assigned to the target button, that is, SOO (or SON) is input,

4-1) When multi-all dragged downwards briefly, 'U' is additionally input together with the S assigned to the target button, that is, SU is input,

4-2) When multi-all dragged downward for a long time, 'UU' (or 'US') can be additionally input together with the S assigned to the target button, that is, SUU (or SUS) can be input.

On the other hand, characters may be continuously inputted continuously each time they are dragged in the same direction twice or more briefly in a row or the drag direction is changed.

For example, in the case where characters additionally input along with the characters assigned to the target button according to the drag direction are the same as in FIG. 13 , as shown in FIG. 24 ,

1) After multi-touching with the index and middle fingers so that button S is recognized as a target button, if the index and middle fingers are multi-draged to the right, 'SE' is input as shown in [1] of FIG.

2) Even after 'SE' is input, if the index and middle fingers are not turned off and multi-drag once more to the right, 'E' is additionally inputted, and as a result, 'SEE' is input as shown in [3] of FIG. becomes,

3) After 'SE' is input, if the index and middle fingers are not turned off and multi-drag to the left, 'O' is additionally input, and as a result, 'SEO' is input as shown in [4] of FIG.

4) After 'SE' is input, if the index and middle fingers are not turned off and multi-all dragged downwards and then multi-draged to the left, 'U' and 'O' are additionally inputted as shown in [2] in FIG. It can be implemented so that 'SEUO' is input as well.

On the other hand, when a plurality of characters are assigned to the same button, as in a keyboard including a 3X4 keyboard arrangement as in FIG. 3 or FIG. 4, other characters (eg, A, E, I) along with the characters assigned to the target button , O, U) are additionally input,

Depending on the operation method, the character assigned to the target button input together with other characters (eg, A, E, I, O, U) may be determined.

For example, in the case of a button to which 'J, K, L' is assigned to button 5 of FIG. 4,

So that button 5 to which 'J, K, L' is assigned can be recognized as a target button

1) A, E, I, O, U can be additionally input together with the first assigned J to the target button in a principle similar to the above embodiments with single on & off and single drag in four directions,

2) Multi-all on & off and 4-way multi-all drag so that A, E, I, O, U can be additionally input together with K assigned second to the target button in a principle similar to the above embodiments do,

3) A, E, I, O, U together with L assigned as the third to the target button in a similar way to the above embodiments with multi-scythe-all base finger on & off and 4-direction multi-scythe-all standard finger dragging It can also be entered additionally.

Here too, according to the situation before the final operation, a specific character group from among at least one character group is matched, and the character of the matched character group is obtained. It can be said that it is an input method without changing the text mode.

On the other hand, it is also possible to implement a button that induces a combination with other buttons, such as a shift button, a control button, and an alt button, to exert an effect combined with such a button without being used.

For example, after 2 multi-touch with the index and middle fingers so that Button S is recognized as the target button,

1) When the index and middle fingers are 'multi-drag' upwards, 'Control + S' is input, that is, the effect of pressing button S while holding down the control button is exerted,

2) When the index and middle fingers are 'multi-drag' to the right, 'Alt+S' is input, that is, the effect of pressing button S while holding down the alt button is exerted,

3) When the index and middle fingers are 'multi-drag' to the lower side, 'shift + S' is input, that is, the effect of pressing button S while holding down the shift button can be exhibited.

It is possible to implement a single-touch operation or multi-touch operation to be recognized as any target button in Korean, so that other characters (eg, vowels) are additionally input along with the characters (eg, consonants) assigned to the target button.

For example, in a keyboard in which one character is assigned to each button in each same character mode including the conventional Hangul QWERTY keyboard as shown in FIG. 9, after single-touching with the index finger so that button 'j' is recognized as the target button,

1) When a single drag is performed upward, 'ㅗ' is additionally input with 'j' assigned to the target button, resulting in 'Joe' being input,

2) When a single drag is performed to the right, 'a' is additionally input with 'c' assigned to the target button, resulting in a 'character' input,

3) When single dragged downward, 'ㅜ' is additionally input along with 'j' assigned to the target button, and as a result, 'week' is input,

4) When a single drag is performed to the left, 'ㅓ' is additionally input together with 'c' assigned to the target button, so that 'low' is inputted as a result.

And, for example, in the conventional Hangul QWERTY keyboard as shown in FIG. 9, after 2 multi-touches with the index and middle fingers so that button 'j' is recognized as the target button,

5) When multi-draged upwards, 'ㅛ' is additionally input with 'j' assigned to the target button, resulting in 'Jo' being input,

6) When multi-drag to the right, 'ㅑ' is additionally input along with 'j' assigned to the target button, and as a result, 'ja' is input,

7) When multi-drag down to the bottom, 'ㅠ' is additionally input with 'j' assigned to the target button, and as a result, 'ju' is input,

8) When multi-all dragged to the left, 'ㅕ' is additionally input along with 'j' assigned to the target button, resulting in the input of 'jewer'.

Here too, according to the situation before the final operation, a specific character group from among at least one character group is matched, and the character of the matched character group is obtained. It can be said that it is an input method without changing the text mode.

On the other hand, as in the Cheonjiin keyboard as shown in Fig. 12, which is a type of the conventional Hangul 3X4 keyboard, even when a plurality of characters are assigned to the same button, the number of fingers at the time of touch and the type of operation after touch are different, so that the above button 'ㅗ, ah, TT, ㅓ, ㅛ, ㅑ, ㅠ , ㅕ' can be additionally input together with each consonant assigned to .

That is, when multiple characters are assigned to the same button, other characters (eg, 'ㅗ, A, TT, ㅓ, ㅛ, ㅑ, ㅠ , ㅕ') are additionally added with the characters assigned to the target button. In input,

Depending on the number of fingers at the time of touch and the operation method, the character assigned to the target button input together with other characters (eg, 'ㅗ,a, TT,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ') is determined. You may.

For example, in the case of a keyboard to which the Cheonjiin Hangul input method as shown in FIG. 12 is applied, only ' , ' is indicated on button 9, but ' ', ' ', ' has been In the case of a button to which 'c, ch, and t' are assigned together, make sure that the button to which 'c, ch, t' is assigned can be recognized as a target button.

1) With single drag in 4 directions and multi-old drag in 4 directions, as in the above embodiment, 8 vowels are additionally input: make it possible,

2) After finger drag in 4 directions multi-sickle all standard and single touch in 4 directions, finger drag in multi-scythe all standard finger drags 'ㅗ, A, TT, ㅓ, ㅛ, ㅑ, ㅠ, ㅕ' vowels are additionally entered,

2) Finger drag based on multi-sickle all sickle in 4 directions and single touch in 4 directions. It is also possible to additionally input 8 vowels called .

Here too, according to the situation before the final operation, a specific character group from among at least one character group is matched, and the character of the matched character group is obtained. It can be said that it is an input method without changing the text mode.

In addition, it is possible to implement other manipulation methods including long dragging of other vowels except for the above 8 vowels among 21 Korean vowels so that the consonant assigned to the target button and another vowel are input together.

For example, when 'long dragged' is performed, a double vowel with additional 'ㅣ' added to the vowel that is additionally input when 'draged short' may be input. Specifically,

1) When a short single drag to the right, 'a' is added, and when a long single drag to the right, 'ㅐ' is additionally input together with the consonant assigned to the target button,

2) In case of single dragging to the left, 'ㅓ' is additionally input, and when single dragging is long to the left, 'ㅔ' is additionally input together with the consonant assigned to the target button,

3) 'ㅗ' is added when a single drag is short upwards, and 'ㅚ' is additionally inputted with the consonant assigned to the target button when a single drag is long upwards,

4) When a single drag is short downward, 'TT' is added, and when a single drag is long downward, 'ㅟ' is additionally input together with the consonant assigned to the target button,

5) 'ㅑ' is added when multi-all dragging is short to the right, and 'ㅒ' is additionally inputted with the consonant assigned to the target button when multi-all dragging is long to the right,

6) When multi-all dragging is short to the left, 'ㅕ' can be additionally inputted along with the consonants assigned to the target button, when multi-all dragging is long to the left.

In addition, in the previous embodiment of inputting English, the method of continuously inputting characters continuously each time they are dragged two or more times in a row in the same direction or the drag direction is changed and dragged can be applied to Korean.

For example, after a consonant button is recognized as a target button, two manipulations are combined so that two vowels are inputted together.

For a more specific example, after single-touching with the index finger or 2 multi-touching with the index and middle fingers so that button 'j' is recognized as a target button (in the case of single dragging in can be regarded as multi-touch),

1) After being 'single-drag' upward and 'ㅗ' is selected, the finger does not turn off and continues on the spot and then 'single-drag' to the right is selected as 'a', so that the vowel 'ㅘ' along with 'j' is selected. is additionally input, resulting in 'left' being input,

2) After being 'single dragged' downward and 'TT' is selected, the finger does not turn off and continues on the spot and then 'single drag' to the left and 'ㅓ' is selected, so that the vowel 'ㅝ' along with 'j' is It is additionally input, and as a result, 'Give' is input,

3) After being 'single-drag' upward and 'ㅗ' is selected, the finger does not turn off and continues on the spot and then 'single-drag' to the right is long and 'single-drag' and 'ㅐ' is selected, so that the vowel 'ㅙ' with 'j' is additionally input, resulting in 'Zoo' being input,

4) After being 'single dragged' downward and 'TT' is selected, the finger does not turn off and continues on the spot and 'single drag' to the left is long and 'single drag' and 'ㅔ' is selected. may be additionally input, resulting in 'j' being input.

There are 10 basic vowels (a ㅑ ㅓ ㅕ ㅗ ㅛ ㅜㅜ ㅠ ㅡ ㅣ) and 11 double vowels (ㅐ ㅒ ㅔ ㅖ ㅚ ㅟ ㅘ ㅝ ㅢ ㅙ ㅞ), a total of 21 vowels.

In the previous embodiments, it was investigated that among a total of 21 vowels, vowels other than 'ㅡ', 'ㅣ', and 'ㅢ' were input together with the consonant assigned to the target button.

In case 'ㅡ', 'ㅣ', and 'ㅢ' are input, a dedicated button for 'ㅡ' and 'ㅣ' is provided, and a combination of 'ㅡ', 'ㅣ' and ('ㅡ', 'ㅣ') In) It is possible to input 'ㅢ', but it is also possible to allocate a separate operation method for inputting 'ㅡ', 'ㅣ', and 'ㅢ'.

For example, in the Hangul input examples so far, only drag is used, and on & off is not used, so now we are going to use on & off,

For example, after 2 multi-touch with the index and middle fingers so that the consonant button 'j' is recognized as the target button,

1) In the case of 'Multi All On & Off', the vowel 'ㅡ' is additionally input along with 'j' assigned to the target button, resulting in 'z' being input,

2) In the case of 'multi-knot all standard finger on & off', the vowel 'ㅣ' is additionally input along with 'j' assigned to the target button, resulting in 'ji' being input,

3) In the case of 'multi-nick all sickle-based finger on & off', the vowel 'ㅢ' is additionally input together with 'j' assigned to the target button, so that '??' may be inputted as a result.

The text input method described so far is applicable to languages other than the mentioned languages. For example, it is applicable to Greek/Roman script, Cyrillic script, Arabic script, Southeast Asian script, Indian script, Thai script mode, Vietnamese script mode, and detailed languages English, French, German, Spanish, etc.

In the above embodiments, in the drag direction, only the drag in four directions, up, down, left, and right, has been described. However, when the directions are subdivided, more operations are possible. For example, when adding drag in the lower right (southeast), lower left (southwest), upper right (northeast), and upper left (northwest) directions, more characters may be assigned to one button and input or various operations may be performed.

As well as,

According to the drag length, the drag is subdivided into short drag and long drag,

Depending on the drag direction, drag is subdivided into straight drag, return drag, and shape drag,

If a variety of manipulation methods are used, including finger on/off based on multi-scythe, all-scythe, and finger dragging based on multi-scythe, more work becomes possible.

4. How to manipulate objects

Up to now, it has been described that characters are input by manipulation after touch. Hereinafter, the method used in the text input method is used to describe in detail how objects such as photos, pictures, browsers, windows, etc. are manipulated.

Also in this embodiment, among the various manipulation methods after multi-touch, the target button recognition method by the reference finger is used, but the leftmost finger (= 1st from the left) among the multi-touched fingers is the 'reference finger' We will use the method determined by More specifically, it is assumed that multi-touch is performed using the index and middle fingers, and a method in which the index finger is recognized as a 'reference finger'.

According to the method to be described later, it is difficult to predict the exact position of the active area boundary of the object when the object is activated, such as a star, not when the active area boundary is formed in the same range as the shape, such as a rectangle. Even if it is difficult for a finger to multi-touch only inside the object area because is too small, after the object (or the active area of the object) is multi-touched to become the target button, object shape transformation including zoom in/out is possible without the need for object activation step Do.

Conventionally, after the thumb and index finger are multi-touched on the object, if the thumb and forefinger move in the retracting direction, the object becomes smaller, and when the thumb and index finger move in the direction in which the thumb and index finger are spread apart, there is a method in which the object becomes larger. This method is a method commonly used in smartphones including Apple's iPhone, but has a disadvantage in that the size of the object is enlarged or reduced only while the ratio of the horizontal length to the vertical length of the object is maintained.

If you want to change only the horizontal or vertical length without maintaining the ratio of the object's horizontal and vertical length, the object is clicked with the mouse and the object is activated as a preparation step for shape transformation. .

However, according to the present application, after the object (or the activation area of the object) is multi-touched to become a target button, the shape of the object can be changed by 'manipulating after multi-touch', so there is no need for a step of activating the object, and the touch screen Multi-touch can be used to change the shape of an object.

The phrase "active region of an object" is used herein.

According to the method of the present application, even though there is no need for an object to be activated, such a phrase is used. The meaning of the phrase “active region of an object” herein does not mean a region within the boundary of an active region of an object in a state in which the object is actually activated, but reminds of a method in which the shape of an object is transformed after the object is activated as in the prior art. It means the area within the boundary of the area where the object is activated when it is done, that is, the area within the boundary of the active area of the object when it is assumed that the object will be activated.

In addition, the term "object area" refers to an area occupied by an object. The size of the object area will be less than or equal to the size of the active area of the object, unless there is an abnormality. Referring to FIG. 39 , it can be said that the object area exists in the active area of the object.

And, in many cases, it is safe to say that the object area is abbreviated as an object.

So, even if the point outside the object area but still inside the active area of the object is multi-touched, in order to transform the shape of the object without the need for the activation step of the object, even when the object is not activated, the expected active area of the object is The object is set to be activated even when it is multi-touched to be recognized as a target button, and the device recognizes that the shape of the object has been changed by the user as multi-touched, and the shape of the object must be transformed by subsequent manipulation. . When the object area is multi-touched so as to be recognized as a target button, of course, the device recognizes that the shape of the object is multi-touched by the user to be changed, and the shape of the object needs to be changed by subsequent manipulation.

Since the multi-touch signal required to implement the method of the present application is different from the conventional method, it may be used in parallel with the conventional method. In addition, since the size of the object is too small, the object cannot actually be multi-touched, so even an object that cannot be enlarged or reduced with the conventional multi-touch method cannot be multi-touched. , such an object can be enlarged or reduced by making it multi-touch so that the object can be recognized as a target button. And, since the size of the object is too small, by the conventional method of enlarging an object after it is activated by a mouse, it cannot be immediately enlarged in a diagonal direction, and only after it is enlarged in a horizontal or vertical direction can be enlarged in a diagonal direction. Objects that could have been magnified in a diagonal direction can also be made by the method of the present application.

Hereinafter, some concepts of directions will be described. It can be selected and applied.)

Referring to the vertical direction including the upper side and the lower side, which are the words used in the following description, even if the user tries to drag in the perfect vertical direction including the perfect upper side and the perfect lower side, there is no user capable of such dragging, From the device's point of view, when the user's intended drag direction is recognized, the trajectory actually dragged by the user is close to a straight line within a set curvature range, and is perfectly parallel or perfectly parallel to a vertical line (= a straight line parallel to the Y axis). If it does not, but it is parallel within a set range, it is judged by the device that the user tried to drag in a perfect vertical direction including perfect top and perfect bottom It means the vertical direction including the top and bottom when it is judged.

Referring to the horizontal direction including the left and right words used in the following description, even if the user tries to drag in the perfect horizontal direction including the perfect left and perfect right, there is no user capable of such dragging, From the device's point of view, when the user's intended drag direction is recognized, the trajectory actually dragged by the user is close to a straight line within a set curvature range, and is not perfectly parallel or perfectly parallel to the horizontal line (= a straight line parallel to the X axis). However, if they are parallel within a set range, it is judged by the device that the user attempted to drag in the perfect horizontal direction including perfect left and perfect right, and the drag performed by the user is judged to be in perfect vertical direction including perfect top and perfect bottom. It means the vertical direction including the upper and lower sides judged at the time.

Referring to the diagonal directions including upper left, lower left, upper right, and lower right, which are words used in the following description, when recognizing the user's intended drag direction from the device's point of view, the determined direction is upper and lower , indicating a direction other than left or right. So, the diagonal direction does not mean only one exact direction, such as up, down, left, or right, but a range that is a set of directions other than up, down, left, and right. For example, even in the right-hand side, the direction is the right-right direction of various angles within 0 to 90 degrees, including 10 degrees, 30 degrees, 45 degrees, 60 degrees, and 80 degrees, with respect to the X axis. is judged So, there cannot be a perfect upper left, a perfect lower left, a perfect right, and a perfect lower right.

However, depending on the setting, the diagonal direction can also be set to mean only one exact direction, such as upper, lower, left, or right. For example, the right-right direction determined by the device may be set to mean only the direction in which the angle with the X-axis is 45 degrees. That is, even if the direction dragged by the user is any right-right direction among the upper-right directions within a certain range, the device may be set to determine the angle with the X-axis as the right-right direction of 45 degrees. In this case, there may be a perfect upper left, a perfect lower left, a perfect right, and a perfect lower right. However, even if the user tries to drag in a perfect diagonal direction including perfect upper left, perfect lower left, perfect right, and perfect lower right, no user has the ability to drag. When recognizing the drag direction, the trajectory actually dragged by the user is close to a straight line within a set curvature range, and the angle with the horizontal line (= a straight line parallel to the X axis) is either a perfect 45 degree angle, or a perfect 45 degree angle direction. However, if it is a 45 degree angle within a set range, it is judged by the device that the user attempted to drag in a perfect master line direction including perfect upper left, perfect lower left, perfect right, and perfect lower right. When the drag is judged to be a perfect diagonal direction including perfect upper left, perfect lower left, perfect right, and perfect lower right, it means the diagonal direction including upper left, lower left, upper right and lower right.

In the above, the predetermined range when determined as upper, lower, right, left, upper left, lower left, upper right, lower right may be considerably small or quite large depending on the currently set number of determined directions.

Among the descriptions of the "1)"th method to be described later, a method that only needs to be determined separately from the upper and lower directions is exemplified. , as shown in (c) of FIG. 46, a certain range determined to the upper side is 180 degrees upward based on the hitting point, and a certain range determined to the lower side is set to a 180 degree range downward based on the hitting point. .

Among the descriptions of the "2)" and "3)" methods to be described later, there are examples of methods in which the upper, lower, left, right, upper left, lower left, upper right, and lower right sides are determined. In this case, when the diagonal direction does not mean only one exact direction such as up, down, left, or right, but is set to mean a range that is an aggregate of directions other than up, down, left, and right, ) As shown in the figure, it is recommended that the angle range be set small (eg, by 10 degrees) for a certain range in the upper, lower, left, and right directions, and diagonally including upper left, lower left, right and lower right. For a certain range, it is recommended that the angle be set large (eg, 80 degrees each). If the diagonal direction is set to mean only one exact direction, such as up, down, left, or right, for example, even if the direction dragged by the user is any right-right direction among the right-to-right directions within a certain range, the device will display the X-axis When the angle of the ray is set to be determined in the right-right direction of 45 degrees, as shown in FIG. It is recommended that it be set to divide the 360-degree direction by making it a 45-degree angle range.

(For reference, in the "2)"th method, which will be described later, the upper, lower, left, right and diagonal directions need only be determined separately, but in the diagonal direction, the upper left, lower left, right, lower right There are cases where it is not necessary, but since the upper, lower, left, and right sides must be divided, as a result, the diagonal direction must also be divided into upper left, lower left, right and lower right),

If only the upper, lower, left, and right directions need to be determined separately, but the diagonal directions including upper left, lower left, right, and lower right do not need to be differentiated in some cases. If the determined direction is set to mean only one exact direction, such as up, down, left, or right, for example, even if the direction dragged by the user is an upper direction among the upper directions within a certain range, the device is parallel to the Y axis. When it is set to be determined in the upward direction, it is recommended that the upper, lower, left, and right constant ranges are all set to be 90 degree angle ranges, so that the 360 degree direction is divided as shown in FIG. 46(d).

With respect to the method of transforming various objects by the method of the present application, the following three methods 1), 2), and 3) will be described as examples.

1) After the (object or) object activation area is multi-touched so that it becomes a target button (= target object or target activation area), if it is dragged in at least one first specific direction, it is enlarged, and in at least one second specific direction A method of zooming out when dragged.

For example, after the index finger is recognized as a reference finger and the (object or) object activation area becomes the target button (= target object or target activation area), the index finger and middle finger are used to multi-touch,

When the index and middle fingers are multi-draged in the upward direction, as in the change from Figs. 26 to 37, the object is enlarged while maintaining the ratio of the horizontal and vertical lengths, and when the index and middle fingers are multi-draged in the downward direction , like the aspect changed from FIG. 37 to FIG. 26, it may be implemented so that the ratio of the horizontal length to the vertical length of the object is reduced while being maintained. (Of course, in the above embodiment, the upper side is replaced with the right side, and the lower side is It may be implemented to be replaced with the left side, and the upper side may be mixed to give the same result as the right side, and the lower side may be implemented to show the same result as the left side.)

And, it is a method that can be enlarged or reduced while the position of the center point of the object is not changed.

2) While the object (or the active area of the object) is multi-touched so that it is recognized as a target button and then dragged, only the horizontal length or only the vertical length or the horizontal length of the object (or the active area of the object) according to the drag direction determined by the device It is a method in which the length and the vertical length are enlarged or reduced together.

To be a little more specific,

When the object (or the active area of the object) that you want to change shape starts to be multi-touched and dragged so that it is recognized as a target button, the dragging direction (determined by the device), that is, the dragging direction intended by the user, is up and down. , in the case where it is determined to be any one of the right and left directions,

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, the horizontal length is enlarged,

When dragged in the second specific direction of the horizontal direction, the vertical length does not change, the horizontal length is reduced,

When dragged in the first specific direction of the vertical direction, the horizontal length does not change, the vertical length is enlarged,

When dragged in the second specific direction of the vertical direction, the horizontal length does not change, the vertical length is reduced,

When the object (or the active area of the object) that you want to change shape starts to be multi-touched and dragged so that it is recognized as the target button, the dragging direction (determined by the device), that is, the dragging direction intended by the user, is on the right , if it is determined that one of the diagonal directions including the lower right, the upper left, and the lower left is,

In the first way,

When dragged in at least one first specific direction among the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,

When dragged in at least one second specific direction among the diagonal directions, there is a method in which the horizontal length and the vertical length are reduced at the same ratio,

In the second way,

When it is dragged in at least one first specific direction range among the diagonal directions, the variation ratio of the horizontal length and the vertical length is differently expanded according to each direction within the range,

When dragged in at least one second specific direction range from among the diagonal directions, there is a method in which the variation ratio of the horizontal length and the vertical length is reduced differently according to each direction within the range.

And, it is a method that can be enlarged or reduced while the position of the center point of the object is not changed.

Taking the method described above as an example,

After the index finger is recognized as the reference finger, and the active area of the (object or) object becomes the target button, the index and middle fingers are used to multi-touch,

When the index and middle fingers are multi-draged in the upper direction in the vertical direction, the shape of the object is transformed so that only the vertical length is increased without changing the horizontal length of the object, as shown in the changes from FIGS. 26 to 35, and the index and middle fingers are vertically When multi-drag in the middle and lower direction, like the aspect changed from Fig. 35 to Fig. 26, the object shape is transformed so that only the vertical length becomes smaller without changing the horizontal length of the object,

When the index and middle fingers are multi-draged in the right direction in the horizontal direction, the shape of the object is transformed so that only the horizontal length of the object is increased without changing the vertical length of the object, as shown in the change from FIGS. 26 to 36, and the index and middle fingers are moved in the horizontal direction When multi-all dragging is performed in the left direction, the shape of the object is transformed so that only the horizontal length of the object becomes smaller without changing the vertical length of the object, like the aspect changed from FIG. 36 to FIG.

When the determined drag direction is a diagonal direction,

As an embodiment of the first method,

Even if the index and middle fingers are multi-draged in any of the various right-right directions or in any of the various upper-left directions in the diagonal direction, as in the change from Figure 26 to Figure 37, the ratio of the horizontal length to the vertical length of the object It is enlarged while being maintained, and even if the index and middle fingers are multi-draged in any of the various lower-right directions among the diagonal directions or in any of the various lower-left directions, as in the aspect changing from FIG. 37 to FIG. 26, the horizontal length of the object It can also be implemented so that the ratio of length and length is maintained and reduced.

As an embodiment of the second method,

Depending on whether the index and middle fingers are multi-draged in any of the various right-right directions or various upper-left directions among the diagonal directions, the ratio of the horizontal and vertical lengths of the object is enlarged differently, and the index finger It can be implemented so that the ratio of the horizontal length to the vertical length of the object is reduced differently depending on whether the middle and middle fingers are multi-draged in any of the various lower right or lower left directions or in which lower left direction among various diagonal directions. You may.

3) In the background art section, "According to the method of this application, steps 1 to 3 in the object shape transformation method that requires the activation of the conventional object only by multi-touch so that the object is recognized as a target button (= target object) While producing the same effect as the steps performed, it is also possible to enable the 4 steps in the object shape transformation method that requires the activation step of the conventional object in which 17 object change aspects are implemented to be performed through multi-touch post manipulation. It is a method including the mentioned method.

And, it is a method that can be enlarged or reduced while the position of the center point of the object is changed.

To put it in a little more detail, it can be said that it is a method that consists of the following steps.

Step 1: The object (or the active area of the object) is multi-touched so that it is recognized as a target button and starts to be dragged, and a specific range inside the object (or the active area of the object) is determined by the hitting point and the dragging direction. step to be recognized as

Step 2: As the horizontal or vertical length of the object (or the active area of the object) changes depending on the recognized target range and the determined dragging direction, the direction in which the drag is started is closer to the center of the object (or the active area of the object) A step in which it is reduced in the falling direction and enlarged in the farther direction. (The center of the object may be moved in the determined drag direction.)

Depending on the implementation method, the target scope itself may be the entire object or the active area of the object. Mainly this will be in such a way that the center point of the object does not move. In the method in which the center point moves, it is recommended that the object or some range of the active area of the object be recognized as the target range.

That is, enlargement or reduction is determined according to the recognized target range or hitting point as well as the direction in which the drag is started determined by the device, and optionally, if the center point is moved, the direction of movement of the center point can also be determined. way.

(Above, the center of the object (or the active area of the object) is a straight line passing through the center of the object (or the active area of the object) perpendicular to the determined drag direction, or the object (or object) perpendicular to the determined drag direction The result may be the same even if it is replaced with the concept of a straight line that bisects the object (or the object activation area) while passing through the center of the active area of

From the user's point of view, the target range is determined first, and any point within the target range is selected as the target point, and multi-touch so that the target point becomes the hitting point and then starts dragging, whereas from the device's point of view, the Likewise, it is possible to determine which range the user considers as the target range by two factors: the hitting point and the direction in which the drag is started.

In the above, there is a part that is not referred to as the drag direction, but is expressed as the direction in which the drag is started. To explain why it is expressed as such, for example, when dragging downward in the range 5 of FIG. 45 , when dragging starts, the center of the object However, if it is dragged downward beyond the horizontal line passing through the center of the object, from then on it becomes the direction away from the center of the object. From the moment it crosses the horizontal line after being reduced, the direction away from the center of the object is not dragged downward as much as the length of the vertical side of the object. This is because the object should not be enlarged immediately. This is because the object must continue to be reduced until it is dragged downward as much as the length of the vertical side of the object.

Adding some techniques to the above method is as follows.

① The object (or the active area of the object) that you want to change shape starts to be multi-touched and dragged so that it is recognized as the target button, and a specific range inside the object (or active area of the object) is determined by the hitting point and the direction in which the drag is started. to be recognized as the target range,

When it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper, lower, right, or left directions,

If the determined starting direction to be dragged is a direction closer to the center of the object (or the active area of the object), 2 parallel to the determined drag direction among the two horizontal or two vertical sides of the object (or the active area of the object) The lengths of the two sides are reduced, and the lengths of the two sides perpendicular to the determined drag direction do not change (additionally, while the center of the object moves in the determined drag direction, the determined drag among the three sides surrounding the recognized target range) The position of the side perpendicular to the direction may be moved for reduction, and the position of the opposite side of the side may not be changed),

If the determined starting direction to be dragged is a direction away from the center of the object (or the active area of the object), two horizontal sides or two vertical sides of the object (or the active area of the object) parallel to the determined drag direction The length of the side is enlarged, and the length of the two sides perpendicular to the determined drag direction does not change (additionally, the drag direction determined from among the three sides surrounding the recognized target range while the center of the object moves in the determined drag direction) The position of the side perpendicular to and may be moved for enlargement, and the position of the opposite side of the side may not be changed).

The contents of the method "①" here refer to the aspects 1) to 8) among the 17 object change aspects in the fourth step in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section. A method that may be implemented as a method of

② The object (or the active area of the object) that you want to change shape is multi-touched and started to be dragged so that it is recognized as the target button, and a specific range inside the object (or the active area of the object) is determined by the hitting point and the direction in which the drag is started. to be recognized as the target range,

If it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper right, lower right, upper left, or lower left direction,

If the determined starting direction to be dragged is a direction closer to the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced. If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of the change in the horizontal and vertical lengths can be set to be different depending on which direction is dragged within the specific drag direction range determined by the device, and the specific drag direction range You can also set the horizontal and vertical lengths to be different at the same rate no matter which direction the interior is dragged. (And additionally, while the center of the object moves in the determined drag direction, the vertex closest to the straight line parallel to the drag direction among the vertices in the recognized target range is moved for reduction, and the position of the vertex opposite the vertex may remain unchanged.)

If the determined direction in which the drag is started is a direction away from the center of the object (or the active region of the object), the lengths of the horizontal and vertical sides are enlarged. At this time, too, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length. It is possible to set the change ratio of the length and the vertical length to be different, or it can be set to change the horizontal and vertical lengths at the same ratio no matter what direction it is dragged within a specific drag direction range. (And additionally, while the center of the object moves in the determined drag direction, the vertex closest to the straight line parallel to the drag direction among the vertices in the recognized target range is moved for enlargement, and the position of the vertex opposite the vertex may remain unchanged.)

The content of method "②" here is that aspects 9) to 16) out of 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section are the methods of the present application A method that may be implemented as .

To explain with a more specific example,

The object (or the active area of the object) that you want to change shape starts to be multi-touched and dragged so that it is recognized as the target button. In order to be recognized as a range, the index finger is multi-touched with the index finger and the middle finger so that it is recognized as the reference finger,

1) In Fig. 45 (a), in the multi-all dragging process, the range 5 in the drawing is multi-touched so that the range 5 is touched with the index finger, which is the reference finger, so that it is recognized as the target range. Aspect "1)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

2) In Fig. 45 (a), in the multi-all dragging process, when the 5th range is multi-touched so that the 5th range is touched with the index finger, which is the reference finger, so that the 5th range is recognized as the target range, the downward drag is started and completed, Aspect "2)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

3) In Fig. 45 (a), in the multi-all dragging after 2 multi-touch so that the 7 range is touched with the index finger, which is the reference finger, so that the 7 range is recognized as the target range, the upward drag is started and completed, Aspect "3)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

4) In Fig. 45 (a), in the multi-all dragging after 2 multi-touch so that the 7th range is touched with the index finger, which is the reference finger, so that the 7th range is recognized as the target range, the downward drag is started and completed, Aspect "4)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

5) 2 multi-touch so that the 8th range is touched with the index finger, which is the reference finger, so that the 8th range is recognized as the target range in FIG. 45(b) Aspect "5)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

6) In Fig. 45 (b), in multi-all dragging after 2 multi-touch so that the 8th range is touched with the index finger, which is the reference finger, so that the 8th range is recognized as the target range, dragging to the left is started and completed, Aspect "6)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

7) In FIG. 45 (b), in the multi-all dragging process after 2 multi-touch so that the 6 range is touched with the index finger, which is the reference finger, so that the 6 range is recognized as the target range, dragging to the right is started and completed, Aspect "7)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

8) 2 multi-touch so that the 6th range is touched with the index finger, which is the reference finger, so that the 6th range in the drawing (b) of FIG. 45(b) is recognized as the target range. Aspect "8)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

9) In Fig. 45 (b), in the multi-all dragging process, the range 1 is multi-touched so that the range 1 is touched with the index finger, which is the reference finger, so that the range 1 is recognized as the target range. Aspect "9)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

10) In FIG. 45 (b), in the multi-all dragging process, the first range is multi-touched so that the first range is touched with the index finger, which is the reference finger, so that the first range is recognized as the target range. Aspect "10)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

11) In FIG. 45 (b), the range 4 in the drawing is multi-touched so that the range 4 is touched with the index finger, which is the reference finger, so that the range 4 is recognized as the target range. Aspect "11)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

12) In FIG. 45 (b), in the multi-all dragging process, the dragging starts to the upper left side and is completed after 2 multi-touch so that the 4 range is touched with the index finger, which is the reference finger, so that the 4 range is recognized as the target range. Aspect "12)" is implemented out of 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

13) In FIG. 45 (b), in the multi-all dragging process, the second range is multi-touched so that the second range is touched with the index finger, which is the reference finger, so that the second range is recognized as the target range. Aspect "13)" is implemented out of 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

14) In Fig. 45 (b), in the multi-all dragging process, when the second range is multi-touched so that the second range is touched with the index finger, which is the reference finger, so that the second range is recognized as the target range, dragging to the lower left side is completed, Aspect "14)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

15) In Fig. 45 (b), in the multi-all dragging process, the range 3 is multi-touched so that the range 3 is touched with the index finger, which is the reference finger, so that the range 3 in the drawing is recognized as the target range. Aspect "15)" is implemented among 17 object change aspects in step 4 in the object shape transformation method that requires an activation step of the conventional object mentioned in the background section.

16) In Fig. 45 (b), in the multi-all dragging process, the third range is multi-touched so that the third range is touched with the index finger, which is the reference finger, so that it is recognized as the target range. Aspect "16)" is implemented out of 17 object change aspects in step 4 in the object shape transformation method that requires the activation step of the conventional object mentioned in the background section.

17) Regardless of any of the drawings (a), (b), (c), (d) of FIG. 45 , any range of an object (or an active area of an object) is recognized as a target range, that is, any point In the multi-all dragging after 2 multi-touch so as to be touched with the index finger, which is the reference finger, if the drag trajectory is a curved trajectory rather than a linear trajectory within a certain curvature range, the object (or the active area of the object) is rotated.

If expressed in technical language as above, it seems a bit complicated. From the user's point of view, according to intuition, if the target button recognition method by the reference finger is used as the target button recognition method, the reference finger determines the touch point to be touched, touches it, and drags it in the desired direction to reduce or make it enlarged.

In the conventional object shape transformation method that requires an object activation step, place the mouse pointer on only the zoom control point at the edge or vertex where the enlargement or reduction starts, and then drag the object in the desired direction while holding down the left mouse button. was enlarged or reduced,

In the multi-touch method of the present application, referring to the point at which the reference finger should be touched, the method of the present application does not require the activation of the object, but as in the prior art, the object activation area boundary line when it is assumed that the object activation area boundary line appears. It may be extended to a zoom control point on or around it or to an inside point of an object close to it. And, the drag direction is the same as in the conventional method.

Let me explain with a more specific example.

In the following examples (a), (b), (c), (d),

The concept of the activation region of the object does not require activation of the object in the method of the present application, but it is assumed that the object is activated as in the prior art, and the object activation region is assumed when only imagining in the head that the boundary of the object activation region appears. Please keep in mind that

The same is true of the concept of the boundary of the active area of an object.

And, the target point is not only the zoom adjustment point on the boundary of the object activation area in the conventional method, but also a point within the boundary line adjacent to the adjustment point and extended to an external point of the object or a point within the object adjacent to the adjustment point. , it is recommended to do so. Of course, in order for an object to be recognized as a target object, in order to recognize it as a target object, not only the zoom control point on the boundary of the object activation area, but also a point within the boundary line adjacent to the control point and an external point of the object is multi-touched with the reference finger. should be set to be

(a) For example, by multi-touching so that the reference finger touches the zoom control point on the left / right active area boundary of the object or the inner point of the object close to or around it, for example, the index finger is the reference After 2 multi-touch with the index and middle fingers to be recognized as a finger, the touch state of the index and middle fingers is maintained and dragged left/right, so that the vertical length of the object is not changed and the horizontal length of the object can be enlarged or reduced.

The contents of this disclosure are of the method in which aspects 5) to 8) among 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section are implemented by the method of the present application. example is mentioned.

(In the case where it is difficult to predict the location of the boundary line of the area to be activated, such as in a star shape, not when the boundary line of the active area is formed in the same range as the shape, such as a rectangle, activate the object with a single touch, etc., and then use the same method as above. After multi-touch with , it can be enlarged or reduced by dragging. The same applies to the examples of 2) or 3) below.)

(b) For example, multi-touch so that the reference finger touches the zoom control point on the upper/lower active area boundary of the object or the inner point of the object close to or around it, for example, the index finger After 2 multi-touch with the index and middle fingers to be recognized as a finger, the touch state of the index and middle fingers is maintained and dragged up/down, so that the horizontal length of the object is not changed and the vertical length of the object can be enlarged or reduced.

The contents here are of the method in which aspects 1) to 4) among 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section are implemented by the method of the present application. example is mentioned.

(c) For example, by multi-touching so that the reference finger is touched to the zoom control point at the vertex of the object activation area boundary or the inner point of the object close to or around it, for example, the index finger moves to the reference finger. After 2 multi-touch with the index and middle fingers to be recognized, the touch state of the index and middle fingers is maintained and dragged in the diagonal direction, so that the horizontal and vertical lengths of the object can be enlarged or reduced. Of course, the ratio of the horizontal length to the vertical length to be enlarged/reduced may vary depending on the dragging direction.

The contents of this disclosure are of the method in which aspects 9) to 16) among 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section are implemented by the method of the present application. example is mentioned.

(d) For example, multi-touch so that the reference finger touches the inner point of the object inside the object activation area boundary, for example, after 2 multi-touch with the index finger and middle finger so that the index finger is recognized as the reference finger, While the touch state is maintained, the object may be rotated by being dragged in a curved line with a predetermined curvature or more.

The content of this disclosure refers to an example of a method in which aspect 17) among 17 object change aspects in step 4 in the object shape transformation method that requires an activation step of the conventional object mentioned in the background section is implemented by the method of the present application did it

It will be easier to understand if you go through the following examples ①~⑧.

The following examples ① to ⑧ are included in the above concept, and when dragging proceeds in a direction approaching a straight line passing through the center of the object perpendicular to the drag direction, it is reduced, and the center of the object perpendicular to the drag direction is reduced. It can be said that it was described in such a way that if the drag proceeds in the direction away from the passing straight line, it will be enlarged.

In the following examples ① to ⑧, when dragged in the diagonal direction, only the case where the horizontal and vertical lengths are enlarged or reduced at the same ratio is given.

① Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest Y value in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). at the time,

At a point within the (object area or) object activation area (eg, area 5 in FIG. 45) having a Y value greater than or equal to the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), the index finger to be recognized as a reference finger Let the middle finger touch any point on the right side of the index finger and then 'multi-drag' upwards, so that only the vertical length of the object is enlarged without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the smallest Y value of the (object area or) object active area (eg, the lower horizontal side) does not change, and the coordinate(s) with the largest Y value of the (object or) object active area s) (eg, upper horizontal side) can be moved to the upper side, and only the vertical length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 27 is exemplified.

If a point within the (object area or) object activation area (eg, area 7 in FIG. 45) having a Y value less than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2) is to be recognized as a reference finger If the expected index finger is touched, and the middle finger is made to be touched at any point on the right side of the index finger, and then 'multi-drag' upward, only the vertical length can be reduced without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the largest Y value of the (object area or) object active area is not changed, and the coordinate(s) with the smallest Y value of the (object area or) object active area is more In the form of moving upward, only the vertical length of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 28 is exemplified.

② Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest Y value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest Y value is (X2, Y2). at the time,

Let the index finger to be recognized as a reference finger touch a point within the (object area or) object activation area having a Y value greater than or equal to the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), and the middle finger is to the right of the index finger If a part is touched at any point and then 'multi-drag' downward, only the vertical length of the object can be reduced without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the smallest Y value of the (object area or) object active area is not changed, and the coordinate(s) with the largest Y value of the (object or) object active area is moved further down Only the vertical length of the object can be reduced in the falling form. To briefly explain the above description with drawings, a change from Fig. 27 to Fig. 26 can be exemplified.

If the index finger, which is to be recognized as the reference finger, is touched at a point within the (object area or) object activation area having a Y value less than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), and the middle finger is the index finger If it is 'multi-draged' to the bottom after touching any point on the right side of the object, only the vertical length can be enlarged without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the largest Y value of the (object area or) object active area does not change, and the coordinate(s) with the smallest Y value of the (object area or) object active area becomes more In the form of moving downward, only the vertical length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 28 to Fig. 26 can be exemplified.

③ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest X value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest X value is (X2, Y2). at the time,

At a point within the (object region or) object activation region (eg, region 6 in FIG. 45) having an X value greater than or equal to the intermediate value of X1 and X2 (=(X1+X2)/2), the index finger to be recognized as a reference finger After letting the middle finger touch any point on the right part of the index finger, if 'multi-drag' to the right is performed, only the horizontal length of the object can be enlarged without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinate(s) with the smallest X value of the (object area or) object active area (eg, the left vertical side) does not change, and the coordinates with the largest X value of the (object or) object active area (s) (eg right vertical side) can be moved to the right and only the horizontal length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 29 can be exemplified.

If the point within the (object area or) object activation area (eg, area 8 in FIG. 45) having an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2) is to be recognized as a reference finger If the expected index finger is touched, and the middle finger is made to be touched at any point on the right side of the index finger, and then 'multi-drag' to the right, only the horizontal length of the object can be reduced without changing the vertical length of the object. Even when only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object active area does not change, and the coordinate(s) with the smallest X value of the (object area or) object active area becomes more In the form of moving to the right, only the horizontal length of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 30 can be exemplified.

④ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest X value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest X value is (X2, Y2). at the time,

Let the index finger to be recognized as the reference finger touch a point within the (object area or) object activation area having an X value greater than or equal to the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is on the right side of the index finger If a part is touched at any point and then 'multi-drag' to the left, only the horizontal length of the object can be reduced without changing the vertical length of the object. Even when only the horizontal length is reduced, the coordinates with the smallest X value of the (object area or) object active area are not changed, and the coordinates with the largest X value of the (object or) object active area are moved further to the left. Only the horizontal length of can be reduced. To briefly explain the above description with drawings, a change from Fig. 29 to Fig. 26 can be exemplified.

If the index finger, which is to be recognized as the reference finger, is touched at a point within the (object area or) object activation area having an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is the index finger If it is 'multi-drag' to the left after touching any point on the right side of , only the horizontal length of the object can be enlarged without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinates with the largest X value of the (object area or) object active area are not changed, and the coordinates with the smallest X value of the (object area or) object active area are moved to the left. Only the horizontal length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 30 to Fig. 26 can be exemplified.

⑤ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

An object active region (or an object region) with an X value greater than or equal to the median of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median of Y1, Y2 (=(Y1+Y2)/2). Example: Let the index finger, which is to be recognized as the reference finger, touch a point within the area that can be included in area 2 of FIG. 45), and let the middle finger touch any point on the right side of the index finger, and then 'multi-all drag' to the right ', the horizontal and vertical lengths of the object can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the smallest X and Y values of the (object area or) object activation area (eg, vertex 3 in Fig. 39) do not change, (object or) The horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, the second vertex of FIG. 39 ) having the largest X and Y values of the object activation region are moved to the right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 31 can be exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) The index finger, which is to be recognized as the reference finger, is touched at a point within the object activation area (eg, the area that can be included in area 3 in FIG. 45), and the middle finger is made to be touched at any point on the right side of the index finger, then to the right If 'multi-all drag' is performed, the horizontal and vertical lengths of the object can be reduced by the same ratio. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the largest X and Y values of the (object area or) object active area remain unchanged, and the X and Y values of the (object area or) object active area do not change. The horizontal and vertical lengths of the object can be reduced in such a way that the coordinates with the smallest value are moved to the right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 32 is exemplified.

⑥ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

An X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2) within the (object region or) object activation region Let the index finger, which is to be recognized as the reference finger, touch the point, and the middle finger touch any point on the right side of the index finger. can do. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the smallest X and Y values of the (object area or) object active area do not change, and the X and Y values of the (object or) object active area do not change. In a form in which the largest coordinate is moved to the lower left, the horizontal and vertical lengths of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 31 to Fig. 26 can be exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) Let the index finger, which is to be recognized as a reference finger, touch a point within the object activation area, and let the middle finger touch any point on the right side of the index finger. It can be enlarged in proportion. Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the largest X and Y values of the (object area or) object active area remain unchanged, and the X and Y values of the (object area or) object active area do not change. The horizontal and vertical lengths of the object can be enlarged in a form in which the coordinates with the smallest value are moved to the lower left. To briefly explain the above description with drawings, a change from Fig. 32 to Fig. 26 can be exemplified.

⑦ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

(object region or) object activation region with X values greater than or equal to the median of X1, X2 (=(X1+X2)/2) and Y values less than the median of Y1, Y2 (=(Y1+Y2)/2) Let the index finger, which is to be recognized as a reference finger, touch a point within (eg, an area that can be included in area 4 in FIG. 45), and let the middle finger touch any point on the right side of the index finger, and then move to the lower right When dragged, the horizontal and vertical lengths of the object can be enlarged at the same ratio. Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the smallest X value and the largest Y value of the (object region or) object activation region (eg, vertex 1 in Fig. 39) do not change, (object region or) Alternatively, the horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, the 4th vertex of FIG. 39 ) having the largest X value and the smallest Y value of the object activation region are moved to the lower right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 33 can be exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) object The index finger, which is to be recognized as the reference finger, is touched at a point within the activation area (eg, the area that can be included in area 1 in FIG. 45), and the middle finger is made to be touched at any point on the right side of the index finger, and then ' When 'multi-all drag', the horizontal and vertical lengths of the object can be reduced at the same rate. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the largest X value and smallest Y value of the (object area or) active area remain unchanged, and the X value of the (object area or) object active area does not change. The horizontal and vertical lengths of the object can be reduced in such a way that the smallest coordinates with the largest Y value are moved to the lower right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 34 can be exemplified.

⑧ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),

(object region or) object activation region with X values greater than or equal to the median of X1, X2 (=(X1+X2)/2) and Y values less than the median of Y1, Y2 (=(Y1+Y2)/2) Let the index finger, which is to be recognized as the reference finger, touch a point within, and the middle finger touch any point on the right side of the index finger. can make it Even when the horizontal and vertical lengths of an object are reduced at the same rate, the coordinates with the smallest X value and the largest Y value of the (object area or) active area do not change, and the X value of the (object or) active area of the object is the largest. The horizontal and vertical lengths of the object can be reduced in such a way that the coordinates with the largest and smallest Y values are moved to the upper left. To briefly explain the above description with drawings, the change from Fig. 33 to Fig. 26 is exemplified.

If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) object Let the index finger, which is to be recognized as a reference finger, touch a point within the activation area, and the middle finger to touch any point on the right side of the index finger, and then 'multi-drag' to the upper left, the horizontal and vertical lengths of the object are the same ratio can be enlarged to Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the largest X value and the smallest Y value of the (object area or) active area do not change, and the X value of the (object area or) object active area does not change. The horizontal and vertical lengths of the object can be enlarged in such a way that the smallest coordinate with the largest Y value is moved to the upper left. To briefly explain the above description with drawings, a change from Fig. 34 to Fig. 26 can be exemplified.

For reference, in the case of a device such as a mobile phone or smartphone equipped with a small display device, in a situation where an object including a change in the shape of an object including a picture, a picture, a browser, and a window is to be manipulated, not a button to which a character is assigned, In most cases, since only one object is displayed and used in many cases, it is not important which finger among the multi-touched fingers is determined as the 'reference finger'.

That is, when one or more fingers of any finger touch the object, the object is recognized by the device as the target button, and in that state, the object including the reduction or enlargement of the object through various manipulations including multi-all drag as described above. The form may be changed.

Even on a dedicated screen where the shape of an object is changed, even if none of the multi-touched fingers touch the object, the object is recognized as a target button just by being multi-touched on the screen. Through various manipulations including multi-all drag, the shape of the object may be changed, including reducing or enlarging the object.

And, when a specific button is touched with a finger, the desired button is also touched, but there may be cases where the finger is thick and even the unwanted button is touched. Even in such a case, only the button belonging to the center of the touched range is touched. It may be recognized as being

5. Electronic devices to which the present invention is applicable

25 is a block diagram of an electronic device to which the present invention is applicable. As shown in FIG. 25 , an electronic device to which the present invention is applicable includes a touch screen 110 , a function block 120 , a control unit 130 , a storage unit 140 , and a communication unit 150 .

The touch screen 110 displays the above-described touch buttons, and is a means used to touch a desired touch button with a user's finger.

The function block 120 performs the original function of the electronic device. If 1) the electronic device is a mobile phone, the function block 120 performs a mobile phone function, 2) if the electronic device is a mobile computer, the function block 120 performs a computing function, 3) the electronic device In the case of a mobile multimedia player, the function block 120 performs a multimedia playback function, and 4) if the electronic device is a general notebook or PC, the function block 120 performs a computing function.

The storage unit 140 provides a storage space in which programs and data used to perform functions of an electronic device and to generate a GUI screen composed of the aforementioned touch buttons are stored, and multimedia files are stored.

The control unit 130 executes the program stored in the storage unit 140 , controls the function execution by the function block 120 , and displays a GUI composed of touch buttons on the touch screen 110 . In addition, the control unit 130 performs character input, object adjustment, and function execution according to a user's manipulation input using touch buttons displayed through the touch screen 110 .

The communication unit 150 is connected to communicate with other electronic devices to perform data communication.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

110: touch screen
120: function block
130: control unit
140: storage
150: communication department

Claims (162)

In a method for recognizing a target button when the touch screen is multi-touched in a device having a touch screen,
Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. The method according to claim 1,
A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.
1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 3. The method according to claim 2,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 3. The method according to claim 2,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y-coordinate value order (=target button recognition method by a reference touch point according to the Y-coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 3. The method according to claim 2,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button. 3. The method according to claim 2,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it The method according to claim 1,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing target button by second spread finger (=target button recognition method by second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 8. The method according to any one of claims 1 to 7,
In a device having a touch screen, in a method of generating a work signal for any task, including text input or object transformation, by being operated after multi-touch,
Method characterized in that the operation after multi-touch is multi-on & off, multi-drag, and multi-touch operation by spread fingers. 9. The method of claim 8,
The multi-on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off 10. The method of claim 9,
The multi multi knock all on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick 9. The method of claim 8,
The multi-drag method is a method, characterized in that any one or more of the following methods.
1.5.2..8. multi all drag
1.5.2..9. Multi Scythe All Drag 12. The method of claim 11,
The multi-knot all drag method is a method, characterized in that any one or more of the following methods.
1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)
1.5.2..11. Finger drag based on multi-sickle and all scythe (=Drag the touch point based on multi-scythe and all scythe) 9. The method of claim 8,
Method according to claim 1, wherein the method for post-multi-touch manipulation using spread fingers (= post-multi-touch manipulation using open touch points) is any one or more of the following methods.
1.5.2..13.2. Multi on & off by spread fingers (= multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle
1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread touch points)
1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)
1.5.2..13.9. Multi-scythe all-drag by spread fingers (=multi-scythe-all-drag by spread-out touch points)
1.5.2..13.10. Multi-scythe-all-based finger drag by spread fingers (=multi-scythe-all-based touch point drag by spread-out touch points)
1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)
1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points) In a device having a touch screen, when the touch screen is multi-touched, the multi-touch method, which is a method for the multi-touch process, is one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all-sick
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch with spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= Multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by spread touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers In a device having a touch screen, in a method of generating a work signal for any task, including text input or object transformation, by being operated after multi-touch,
Method characterized in that the operation after multi-touch is multi-on & off, multi-drag, and multi-touch operation by spread fingers. 16. The method of claim 15,
The multi-on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off 17. The method of claim 16,
The multi multi knock all on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick 16. The method of claim 15,
The multi-drag method is a method, characterized in that any one or more of the following methods.
1.5.2..8. multi all drag
1.5.2..9. Multi Scythe All Drag 19. The method of claim 18,
The multi-knot all drag method is a method, characterized in that any one or more of the following methods.
1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)
1.5.2..11. Finger drag based on multi-scythe and all scythe (=Drag the touch point based on multi-scythe and all scythe) 16. The method of claim 15,
The method of manipulation after multi-touch using spread fingers (= manipulation after multi-touch using open touch points) is any one or more of the following methods.
1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off
1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)
1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)
1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)
1.5.2..13.10. Multi-scythe-all-based finger drag by spread-out fingers (=multi-scythe-all-based touch point drag by spread-out touch points)
1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)
1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points) In a device having a touch screen, in a method of generating a work signal for any task, including text input or object transformation, by being operated after multi-touch,
The operation method after the multi-touch is,
A method characterized in that it is a method in which multi-on&off is continuously performed at least once and a different operation is performed depending on the number of times, that is, a multi-multi-tap method. The method according to claim 21, In the case where characters are input by the multi-multi-tap method,
A method, characterized in that the multi-on&off is continuously performed at least one time or more, and characters belonging to the target character group related to the target button are displayed while cyclically according to the number of times that is performed. 23. The method of claim 22,
After the characters are displayed in a cycle, a single touch or multi-touch so that another button is recognized as a target button, the cursor is moved, or the displayed character is definitively input after a certain period of time (eg, 2 seconds). 23. The method of claim 22,
When multi-touch when multi-tap is expressed in more detail with n multi-touch,
According to the at least one value of n, that is, according to the situation before the final operation, a specific character group from among the at least one character group is matched, and at least one of the at least one character related to the target button while belonging to the matched character group A method characterized in that text is input without changing the text mode. 25. The method of claim 24,
The "specific character group" means any one of the following character groups.
1) Any one of two or more different character groups classified into different series according to the spelling rules.
2) A character group corresponding to any one of the various character modes in the conventional general mobile phone, including the character group of the special character mode.
3) A group of characters assigned to a specific row among characters assigned to the same button.
4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence from among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).
5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. 26. The method of claim 25,
The "specific character group" means a character group to which other characters according to the spelling rule belong, characterized in that it is a character group of characters input in another character mode according to the spelling rule corresponding to the currently set character mode. 25. The method of claim 24,
"A specific character group" means that it is any one character group among two or more different character groups classified into different series according to the spelling rules.
In English,
If the currently set character mode is uppercase mode, it is a character group that can be input in lowercase mode, or
If the currently set character mode is lowercase, it is a character group that can be input in uppercase mode, or
in Japanese
If the currently set character mode is hiragana character mode, it is a character group that can be input in katakana character mode,
If the currently set character mode is the katakana character mode, the method comprising: a character group that can be input in the hiragana character mode. 28. The method according to any one of claims 21 to 27,
In the method for recognizing the target button,
Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. 29. The method of claim 28,
A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.
1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 30. The method of claim 29,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 30. The method of claim 29,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y-coordinate value order (=target button recognition method by a reference touch point according to the Y-coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 30. The method of claim 29,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button. 30. The method of claim 29,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it 29. The method of claim 28,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing target button by second spread finger (=target button recognition method by second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 35. The method according to any one of claims 21 to 34,
The multi-touch,
A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points. 36. The method of claim 35,
The two fingers,
A method characterized in that the index and middle fingers. 37. The method of any one of claims 21 to 36,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all-sick
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch with spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= Multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by spread touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers 38. The method of any one of claims 21 to 37,
The method according to claim 1, wherein the operation after the multi-touch is at least one of the following operations.
1.5.2.2.2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick
1.5.2..13.2. Multi on & off by spread fingers (= multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle 39. The method of any one of claims 21 to 38,
Characters that can be applied are general characters expressing a language, water, and a method, characterized in that it includes numbers or special characters. 40. The method of any one of claims 21 to 39,
The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. how to input text. A step in which an object (or an active area of an object) is multi-touched so that it is recognized as a target button
The input method comprising: a step of deforming an object (or an active region of an object) according to a manipulation after multi-touch. 42. The method of claim 41,
In the method for recognizing the target button,
Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. 43. The method of claim 42,
A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.
1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 44. The method of claim 43,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 44. The method of claim 43,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 44. The method of claim 43,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button. 44. The method of claim 43,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it 43. The method of claim 42,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing target button by second spread finger (=target button recognition method by second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 49. The method of any one of claims 41 to 48,
An object transformation method, characterized in that the operation is a drag. 50. The method of claim 49
A method in which an object (or an active area of an object) is enlarged when it is dragged in at least one first specific direction, and an object (or an active area of an object) is reduced when it is dragged in at least one second specific direction. 51. The method of claim 50,
If dragged in the upward direction, it is enlarged,
A method, characterized in that when dragged in the downward direction, it is reduced. 51. The method of claim 50,
In enlargement or reduction, a method characterized in that the ratio of the horizontal length to the vertical length of the object is maintained. 51. The method of claim 50,
In the enlarged or reduced method, characterized in that the center point of the object is not moved. 50. The method of claim 49,
A method characterized in that only the horizontal length or only the vertical length or both the horizontal length and the vertical length of the object (or the active area of the object) are enlarged or reduced by the drag direction determined by the device. 55. The method of claim 54,
When dragged in the first specific direction of the horizontal direction, the vertical length does not change, the horizontal length is enlarged,
When dragged in the second specific direction in the horizontal direction, the vertical length does not change, the horizontal length is reduced,
When dragged in the first specific direction of the vertical direction, the horizontal length does not change, the vertical length is enlarged,
When dragged in the second specific direction of the vertical direction, the horizontal length does not change, the vertical length is reduced,
When dragged in at least one first specific direction among the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,
When dragged in at least one second specific direction among the diagonal directions, the horizontal length and the vertical length are reduced at the same rate. 56. The method of claim 55,
When dragged in the right direction, the horizontal length is enlarged,
When dragged in the left direction, the horizontal length is reduced,
When dragged in the upward direction, the vertical length is enlarged,
When dragged in the downward direction, the vertical length is reduced,
If dragged in the upper left or right direction, the horizontal and vertical lengths are enlarged at the same ratio,
When dragged in the lower left or lower right direction, a method characterized in that the horizontal length and the vertical length are reduced at the same ratio. 55. The method of claim 54,
When dragged in the first specific direction of the horizontal direction, the vertical length does not change, the horizontal length is enlarged,
When dragged in the second specific direction in the horizontal direction, the vertical length does not change, the horizontal length is reduced,
When dragged in the first specific direction of the vertical direction, the horizontal length does not change, the vertical length is enlarged,
When dragged in the second specific direction of the vertical direction, the horizontal length does not change, the vertical length is reduced,
When it is dragged in at least one first specific direction range from among the diagonal directions, the horizontal length and vertical variation ratio are expanded differently according to each direction within the range,
When dragged in at least one second specific direction range from among the diagonal directions, the horizontal length and vertical variation ratio are reduced differently according to each direction within the range. 58. The method of claim 57,
When dragged in the right direction, the horizontal length is enlarged,
When dragged in the left direction, the horizontal length is reduced,
When dragged in the upward direction, the vertical length is enlarged,
When dragged in the downward direction, the vertical length is reduced,
When dragged in the upper-left or upper-right direction, the magnification ratio of the horizontal and vertical lengths is enlarged differently depending on which direction of the upper-left range or the upper-right range is dragged,
When dragged in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently depending on which direction of the lower left range or the lower right range is dragged. 55. The method of claim 54,
In the enlarged or reduced method, characterized in that the center point of the object is moved or not moved. 50. The method of claim 49,
Step 1: The object (or the active area of the object) is multi-touched so that it is recognized as a target button and it starts to be dragged, and the specific range inside the object (or the active area of the object) is the target range by the hitting point and the direction in which it starts to be dragged Step to make it recognized as (delete??).
Step 2: As the horizontal or vertical length of the object (or the active area of the object) changes according to the recognized hitting point and the determined dragging direction, the direction in which the drag is started is closer to the center of the object (or the active area of the object) A method comprising the step of being reduced in a direction and enlarged in a distant direction. 61. The method of claim 60,
When it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper, lower, right, or left directions,
If the determined dragging direction is a direction closer to the center of the object (or the active area of the object),
The lengths of the two sides parallel to the determined drag direction among the two horizontal or two vertical sides of the object (or the active area of the object) are reduced, and the lengths of the two sides perpendicular to the determined drag direction do not change,
If the determined starting direction to be dragged is a direction away from the center of the object (or the active area of the object),
The lengths of the two sides parallel to the determined drag direction among the two horizontal or two vertical sides of the object (or the active area of the object) are enlarged, and the lengths of the two sides perpendicular to the determined drag direction do not change,
If it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper right, lower right, upper left, or lower left direction,
If the determined starting direction to be dragged is a direction closer to the center of the object (or the active region of the object), the lengths of the horizontal and vertical sides are reduced. In this case, if the horizontal sides are reduced, both horizontal sides are reduced to the same length, and If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of change in horizontal and vertical lengths can be set differently depending on which direction is dragged within a specific drag direction range determined by the device, and a specific drag direction range You can also set the horizontal and vertical lengths to be different at the same rate no matter which direction it is dragged in.
If the determined direction in which the drag is started is a direction away from the center of the object (or the active region of the object), the lengths of the horizontal and vertical sides are enlarged. At this time too, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length. A method characterized in that it is possible to set the change ratio of the length and the vertical length to be different, and to set the horizontal and vertical lengths to be changed at the same ratio regardless of which direction is dragged within a specific drag direction range. 62. The method of claim 61,
When it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is right, lower right, upper left, lower left,
- If the determined drag start direction is a direction closer to the center of the object (or the active area of the object), the determined drag from among the three sides surrounding the recognized target range while the center of the object moves in the determined drag direction The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side is not changed,
- If the determined dragging start direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the determined drag direction from among three sides surrounding the recognized target range The position of the side perpendicular to and is moved for enlargement, and the position of the opposite side of the side is not changed,
If it is determined that the dragging direction (determined by the device) is started, that is, the user's intended drag direction is any one of the upper right, lower right, upper left, or lower left direction,
- If the determined starting direction to be dragged is a direction closer to the center of the object (or the active area of the object), the center of the object moves in the determined drag direction and is parallel to the drag direction among vertices in the recognized target range. The vertex closest to the straight line is moved for reduction, and the position of the opposite vertex of the vertex may not be changed,
- If the determined starting direction to be dragged is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction and a straight line parallel to the drag direction among vertices in the recognized target range A method, characterized in that the vertex closest to is moved for enlargement, and the position of the vertex opposite to the vertex may not be changed. 63. The method of claim 62,
① Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest Y value in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). at the time,
At a point within the (object area or) object activation area (eg, area 5 in FIG. 45) having a Y value greater than or equal to the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), the index finger to be recognized as a reference finger Let the middle finger touch any point on the right side of the index finger and then 'multi-drag' upwards, so that only the vertical length of the object is enlarged without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the smallest Y value of the (object area or) object active area (eg, the lower horizontal side) does not change, and the coordinate(s) with the largest Y value of the (object or) object active area s) (eg, upper horizontal side) can be moved to the upper side, and only the vertical length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 27 is exemplified.
If a point within the (object area or) object activation area (eg, area 7 in FIG. 45) having a Y value less than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2) is to be recognized as a reference finger If the expected index finger is touched, and the middle finger is made to be touched at any point on the right side of the index finger, and then 'multi-drag' upward, only the vertical length can be reduced without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the largest Y value of the (object area or) object active area is not changed, and the coordinate(s) with the smallest Y value of the (object area or) object active area is more In the form of moving upward, only the vertical length of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 28 is exemplified.
② Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest Y value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest Y value is (X2, Y2). at the time,
Let the index finger to be recognized as a reference finger touch a point within the (object area or) object activation area having a Y value greater than or equal to the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), and the middle finger is to the right of the index finger If a part is touched at any point and then 'multi-drag' downward, only the vertical length of the object can be reduced without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the smallest Y value of the (object area or) object active area is not changed, and the coordinate(s) with the largest Y value of the (object or) object active area is moved further down Only the vertical length of the object can be reduced in the falling form. To briefly explain the above description with drawings, a change from Fig. 27 to Fig. 26 can be exemplified.
If the index finger, which is to be recognized as the reference finger, is touched at a point within the (object area or) object activation area having a Y value less than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2), and the middle finger is the index finger If it is 'multi-draged' to the bottom after touching any point on the right side of the object, only the vertical length can be enlarged without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the largest Y value of the (object area or) object active area does not change, and the coordinate(s) with the smallest Y value of the (object area or) object active area becomes more In the form of moving downward, only the vertical length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 28 to Fig. 26 is exemplified.
③ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest X value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest X value is (X2, Y2). at the time,
At a point within the (object region or) object activation region (eg, region 6 in FIG. 45) having an X value greater than or equal to the intermediate value of X1 and X2 (=(X1+X2)/2), the index finger to be recognized as a reference finger After letting the middle finger touch any point on the right part of the index finger, if 'multi-drag' to the right is performed, only the horizontal length of the object can be enlarged without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinate(s) with the smallest X value of the (object area or) object active area (eg, the left vertical side) does not change, and the coordinates with the largest X value of the (object or) object active area (s) (eg right vertical side) can be moved to the right and only the horizontal length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 29 can be exemplified.
If the point within the (object area or) object activation area (eg, area 8 in FIG. 45) having an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2) is to be recognized as a reference finger If the expected index finger is touched, and the middle finger is made to be touched at any point on the right side of the index finger, and then 'multi-drag' to the right, only the horizontal length of the object can be reduced without changing the vertical length of the object. Even when only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object active area does not change, and the coordinate(s) with the smallest X value of the (object area or) object active area becomes more In the form of moving to the right, only the horizontal length of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 30 can be exemplified.
④ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinate with the largest X value in the (object area or) active area of the object before shape transformation is (X1, Y1), and the coordinate with the smallest X value is (X2, Y2). at the time,
Let the index finger to be recognized as the reference finger touch a point within the (object area or) object activation area having an X value greater than or equal to the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is on the right side of the index finger If a part is touched at any point and then 'multi-drag' to the left, only the horizontal length of the object can be reduced without changing the vertical length of the object. Even when only the horizontal length is reduced, the coordinates with the smallest X value of the (object area or) object active area are not changed, and the coordinates with the largest X value of the (object or) object active area are moved further to the left. Only the horizontal length of can be reduced. To briefly explain the above description with drawings, a change from Fig. 29 to Fig. 26 can be exemplified.
If the index finger, which is to be recognized as the reference finger, is touched at a point within the (object area or) object activation area having an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is the index finger If it is 'multi-drag' to the left after touching any point on the right side of , only the horizontal length of the object can be enlarged without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinates with the largest X value of the (object area or) object active area are not changed, and the coordinates with the smallest X value of the (object area or) object active area are moved to the left. Only the horizontal length of the object can be enlarged. To briefly explain the above description with drawings, a change from Fig. 30 to Fig. 26 can be exemplified.
⑤ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),
An active area (object area or) with an X value greater than or equal to the median of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median of Y1, Y2 (=(Y1+Y2)/2) ( Example: Let the index finger, which is to be recognized as the reference finger, touch a point within the area that can be included in area 2 of FIG. 45), and let the middle finger touch any point on the right side of the index finger, and then 'multi-all drag' to the right ', the horizontal and vertical lengths of the object can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the smallest X and Y values of the (object area or) object activation area (eg, vertex 3 in Fig. 39) do not change, (object or) The horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, the second vertex of FIG. 39 ) having the largest X and Y values of the object activation region are moved to the right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 31 can be exemplified.
If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) The index finger, which is to be recognized as the reference finger, is touched at a point within the object activation area (eg, the area that can be included in area 3 in FIG. 45), and the middle finger is made to be touched at any point on the right side of the index finger, then to the right If 'multi-all drag' is performed, the horizontal and vertical lengths of the object can be reduced at the same rate. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the largest X and Y values of the (object area or) object active area remain unchanged, and the X and Y values of the (object area or) object active area do not change. The horizontal and vertical lengths of the object can be reduced in such a way that the coordinates with the smallest value are moved to the right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 32 can be exemplified.
⑥ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),
An X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2). Let the index finger, which is to be recognized as the reference finger, touch the point, and the middle finger touch any point on the right side of the index finger. can do. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the smallest X and Y values of the (object area or) object active area do not change, and the X and Y values of the (object or) object active area do not change. In a form in which the largest coordinate is moved to the lower left, the horizontal and vertical lengths of the object can be reduced. To briefly explain the above description with drawings, a change from Fig. 31 to Fig. 26 can be exemplified.
If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) Let the index finger, which is to be recognized as the reference finger, touch a point within the object activation area, and let the middle finger touch any point on the right side of the index finger. It can be enlarged in proportion. Even when the horizontal and vertical lengths of the object are expanded at the same rate, the coordinates with the largest X and Y values of the (object area or) object active area remain unchanged, and the X and Y values of the (object area or) object active area do not change. The horizontal and vertical lengths of the object can be enlarged in a form in which the coordinates with the smallest value are moved to the lower left. To briefly explain the above description with drawings, a change from Fig. 32 to Fig. 26 can be exemplified.
⑦ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),
(object region or) object activation region with X values greater than or equal to the median of X1, X2 (=(X1+X2)/2) and Y values less than the median of Y1, Y2 (=(Y1+Y2)/2) Let the index finger, which is to be recognized as the reference finger, touch a point within (eg, the area that can be included in area 4 in FIG. 45), and let the middle finger touch any point on the right side of the index finger, then move to the lower right When dragged, the horizontal and vertical lengths of the object can be enlarged at the same ratio. Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the smallest X value and the largest Y value of the (object region or) object activation region (eg, vertex 1 in Fig. 39) do not change, (object region or) Alternatively, the horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, the 4th vertex of FIG. 39 ) having the largest X value and the smallest Y value of the object activation region are moved to the lower right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 33 can be exemplified.
If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) object The index finger to be recognized as the reference finger is touched at a point within the activation area (eg, the area that can be included in area 1 in FIG. 45), and the middle finger is made to touch any point on the right side of the index finger, and then ' When 'multi-all drag', the horizontal and vertical lengths of the object can be reduced at the same rate. Even when the horizontal and vertical lengths of the object are reduced at the same rate, the coordinates with the largest X value and smallest Y value of the (object area or) active area of the object remain unchanged, and the X value of the (object area or) active area of the object does not change. The horizontal and vertical lengths of the object can be reduced in such a way that the smallest coordinates with the largest Y value are moved to the lower right. To briefly explain the above description with drawings, a change from Fig. 26 to Fig. 34 can be exemplified.
⑧ Multi-touch with index and middle fingers so that the (object or) object activation area becomes the target button. 2In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation are (X1, Y1), and the coordinates with the smallest X and Y values ( When we say X2, Y2),
(object region or) object active region with X values greater than or equal to the median of X1, X2 (=(X1+X2)/2) and Y values less than the median of Y1, Y2 (=(Y1+Y2)/2) Let the index finger, which is to be recognized as the reference finger, touch a point within, and the middle finger to touch any point on the right side of the index finger, and then 'multi-drag' to the upper left side, the horizontal and vertical lengths of the object are reduced at the same rate can make it Even when the horizontal and vertical lengths of an object are reduced at the same rate, the coordinates with the smallest X value and the largest Y value of the (object area or) active area do not change, and the X value of the (object or) active area of the object is the largest. The horizontal and vertical lengths of the object can be reduced in such a way that the coordinates with the largest and smallest Y values are moved to the upper left. To briefly explain the above description with drawings, the change from Fig. 33 to Fig. 26 is exemplified.
If an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) object Let the index finger, which is to be recognized as a reference finger, touch a point within the activation area, and let the middle finger touch any point on the right side of the index finger. can be enlarged to Even when the horizontal and vertical lengths of the object are enlarged at the same rate, the coordinates with the largest X value and the smallest Y value of the (object area or) active area do not change, and the X value of the (object area or) object active area does not change. The horizontal and vertical lengths of the object can be enlarged in such a way that the smallest coordinates with the largest Y value are moved to the upper left. To briefly explain the above description with drawings, a change from Fig. 34 to Fig. 26 can be exemplified. 62. The method of claim 61,
In the enlarged or reduced method, characterized in that the center point of the object is moved. 65. The method of any one of claims 41 to 64,
The multi-touch,
A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points. 66. The method of claim 65,
The two fingers,
A method characterized in that the index and middle fingers. 67. The method of any one of claims 41 to 66,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all-sick
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch with spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= Multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by spread touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers 68. The method of any one of claims 41 to 67,
The method according to claim 1, wherein the operation after multi-touch is at least one of the following operations.
1.5.2.2.2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick
1.5.2..7. multi drag
1.5.2..8. multi all drag
1.5.2..9. Multi Scythe All Drag
1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)
1.5.2..11. Finger drag based on multi-scythe and all sickles
1.5.2..12. multi multi tab
1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle
1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)
1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)
1.5.2..13.9. Multi-scythe all-drag with spread fingers (=multi-scythe-all-drag by spread-out touch points)
1.5.2..13.10. Multi-scythe-all-based finger drag by spread fingers (=multi-scythe-all-based touch point drag by spread-out touch points)
1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)
1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points) In a device having a touch screen, a method for inputting characters,
Displaying a keyboard having a button to which a plurality of characters are assigned on a touch screen;
In the process of multi-on/off so that a specific button is recognized as a target button,
After the point of multi-touch, including after the point of multi-touch or after the point when the multi-touched finger is turned off (= multi-touch is released),
A character input method comprising: inputting a character of a specific order from among the characters assigned to the button recognized as the target button. 70. The method of claim 69,
When multi-touch is expressed in more detail with n multi-touch,
Character input method, characterized in that the specific order is determined according to the value of n. 71. The method of claim 70,
Character input method, characterized in that the n value and the numerical value corresponding to the sequence of the specific sequence is determined to be the same. 71. The method of claim 70,
If the value of n is 2, that is, if 2 multi-touch, the second character assigned to the button recognized as the target button is inputted. 71. The method of claim 70,
If the value of n is 3, that is, 3 multi-touch, the third character assigned to the button recognized as the target button is input processed,
If the value of n is 4, that is, if 4 multi-touch, the fourth character assigned to the button recognized as the target button is inputted. 74. The method of claims 69-73,
In the method for recognizing the target button,
Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. 75. The method of claim 74,
A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.
1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 76. The method of claim 75,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 76. The method of claim 75,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y-coordinate value order (=target button recognition method by a reference touch point according to the Y-coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 76. The method of claim 75,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button. 76. The method of claim 75,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it 75. The method of claim 74,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing target button by second spread finger (=target button recognition method by second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 81. The method of claims 69-80,
The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or
The 3 multi-touch is a multi-touch recognized by the touch points of the index, middle, and ring fingers, or
The 4 multi-touch method, characterized in that the multi-touch recognized by the touch points of the index and middle fingers, ring and small fingers. 82. The method of any one of claims 69 to 81,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all-sick
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch by spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers 83. The method of any one of claims 69 to 82,
The method according to claim 1, wherein the operation after the multi-touch is at least one of the following operations.
1.5.2.2.2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick
1.5.2..12. multi multi tab
1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by spread fingers (= multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle 84. The method of any one of claims 69 to 83,
Characters that can be applied are general characters expressing a language, water, and a method, characterized in that it includes numbers or special characters. 85. The method of any one of claims 69 to 84,
The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters. In a device having a touch screen, a method for inputting characters,
Displaying a keyboard having a button to which a plurality of characters are assigned on a touch screen;
When a specific button is operated after multi-touch so that it is recognized as a target button, after the time when the operation starts after being multi-touched, or after the time when the operation ends, after the time when the operation starts after being multi-touched,
A character input method comprising: inputting a character of a specific order among characters assigned to a button recognized as a target button by a multi-touch operation. 87. The method of claim 86,
According to the operation after multi-touch,
Character input method, characterized in that the specific sequence number of the input character is determined. 88. The method of claim 87,
Character input method, characterized in that when the drag direction is different, it is recognized that the manipulation type is different after the multi-touch. 88. The method of claim 87,
According to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character of at least one character related to the target button is input without changing the character mode while belonging to the matched character group A method characterized in that. 89. The method of claim 89,
The "specific character group" means any one of the following character groups.
3) A group of characters assigned to a specific row among characters assigned to the same button.
4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence from among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).
5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. 91. The method of claim 86-90,
In the method for recognizing the target button,
Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. 92. The method of claim 91,
A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.
1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 93. The method of claim 92,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 93. The method of claim 92,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y-coordinate value order (=target button recognition method by a reference touch point according to the Y-coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 93. The method of claim 92,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button. 93. The method of claim 92,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it 92. The method of claim 91,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing target button by second spread finger (=target button recognition method by second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 98. The method of any one of claims 86 to 97,
The multi-touch,
A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points. 99. The method of claim 98,
The two fingers,
A method characterized in that the index and middle fingers. 101. The method of any one of claims 86 to 99,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all scythe
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch by spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers 101. The method of any one of claims 86-100,
The method according to claim 1, wherein the operation after the multi-touch is at least one of the following operations.
1.5.2.2.2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick
1.5.2..7. multi drag
1.5.2..8. multi all drag
1.5.2..9. Multi Scythe All Drag
1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)
1.5.2..11. Finger drag based on multi-scythe and all sickles
1.5.2..12. multi multi tab
1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle
1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)
1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)
1.5.2..13.9. Multi-scythe all-drag by spread fingers (=multi-scythe-all-drag by spread-out touch points)
1.5.2..13.10. Multi-scythe-all-based finger drag by spread fingers (=multi-scythe-all-based touch point drag by spread-out touch points)
1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)
1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points) 102. The method of any one of claims 86-101,
Characters that can be applied are general characters expressing a language, water, and a method, characterized in that it includes numbers or special characters. 103. The method of any one of claims 86-102,
The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. how to input text. In a device having a touch screen, a method for inputting characters,
After the keyboard is displayed on the touch screen,
In the case where a specific button is operated after multi-touch so that it is recognized as a target button,
The time when the final operation of at least one behavior among the final operations that can include 9 behaviors including dragging in 8 directions: off or up, down, left, right, upper left, lower left, upper right, lower right after or after the beginning of the last operation, including after the end of the last operation;
By multi-touch post manipulation including the final manipulation of at least one behavior among the final manipulations that can include 9 behaviors including off or multi-drag in 8 directions,
In the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group,
According to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character of at least one character related to the target button is input without changing the character mode while belonging to the matched character group A method characterized in that. 105. The method of claim 104,
The "specific character group" means any one of the following character groups.
1) Any one of two or more different character groups classified into different series according to the spelling rules.
2) A character group corresponding to any one of the various character modes in the conventional general mobile phone, including the character group of the special character mode.
3) A group of characters assigned to a specific row among characters assigned to the same button.
4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence from among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).
5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. 107. The method of claim 105,
The "specific character group" means a character group to which other characters according to the spelling rule belong, characterized in that it is a character group of characters input in another character mode according to the spelling rule corresponding to the currently set character mode. 107. The method of claim 106,
"A specific character group" means that it is any one character group among two or more different character groups classified into different series according to the spelling rules.
In English,
If the currently set character mode is uppercase mode, it is a character group that can be input in lowercase mode, or
If the currently set character mode is lowercase, it is a character group that can be input in uppercase mode, or
in Japanese
If the currently set character mode is hiragana character mode, it is a character group that can be input in katakana character mode,
If the currently set character mode is the katakana character mode, the method comprising: a character group that can be input in the hiragana character mode. 108. The method of claim 104-107,
In the method for recognizing the target button,
Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. 109. The method of claim 108,
A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.
1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 110. The method of claim 109,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 110. The method of claim 109,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y-coordinate value order (=target button recognition method by a reference touch point according to the Y-coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 110. The method of claim 109,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button. 110. The method of claim 109,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value among the multi-touched touch points in a small order of Y-coordinate values is recognized as a target button. how to do it 109. The method of claim 108,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing target button by second spread finger (=target button recognition method by second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 115. The method of claims 104 to 114,
The multi-touch,
A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points. 116. The method of claim 115,
The two fingers,
A method characterized in that the index and middle fingers. 117. The method of any one of claims 104-116,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all-sick
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch with spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= Multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by spread touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers 118. The method of any one of claims 104-117,
A method, characterized in that the operation after multi-touch is at least one of the following operations
1.5.2.2.2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick
1.5.2..7. multi drag
1.5.2..8. multi all drag
1.5.2..9. Multi Scythe All Drag
1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)
1.5.2..11. Finger drag based on multi-scythe and all sickles
1.5.2..12. multi multi tab
1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle
1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)
1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)
1.5.2..13.9. Multi-scythe all-drag by spread fingers (=multi-scythe-all-drag by spread-out touch points)
1.5.2..13.10. Multi-scythe-all-based finger drag by spread fingers (=multi-scythe-all-based touch point drag by spread-out touch points)
1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (= multi-scythes with spread-out touch points, dragging with touch points based on all scythes)
1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points) 119. The method of any one of claims 104-118,
Characters that can be applied are general characters expressing a language, water, and a method, characterized in that it includes numbers or special characters. 120. The method of any one of claims 104-119,
The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters. In a device having a touch screen, a method for inputting characters,
After the keyboard is displayed on the touch screen (deleted??),
In the case where a specific button is operated after multi-touch so that it is recognized as a target button,
At least among the final manipulations that can include 5 (9?) behaviors including drag in 4 (8?) directions off or up, down, left, right (, upper left, lower left, upper right, lower right) After the beginning of the last operation, including after the beginning of the last operation of a behavior or after the end of the final operation,
By multi-touch operation including the final operation of at least one behavior among the final operations that can include 5 (9?) behaviors including multi-drag in the off or 4 (8?) directions,
A first character that belongs to a specific character group among at least one character group (delete?) and is a specific character among at least one character related to the target button (or assigned to the target button??);
A method characterized in that, regardless of the target button, a second character, which is at least one specific character promised for each final operation, is additionally input. 122. The method of claim 121,
In the method for recognizing the target button,
Target button recognition method using a reference finger (= target button recognition method using reference touch points) or target button recognition method using open touch points (= target button recognition method using open fingers) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. 123. The method of claim 122,
A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one or more methods among the following methods.
1.6.1.1.1 Recognition method of target button by reference finger according to X-coordinate value sequence (=target button recognition method by reference touch point according to X-coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 124. The method of claim 123,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 124. The method of claim 123,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y-coordinate value order (=target button recognition method by a reference touch point according to the Y-coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 124. The method of claim 123,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (= target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value among small orders of X-coordinate values among multi-touched touch points is recognized as a target button. 124. The method of claim 123,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value in a small order of Y-coordinate values among multi-touched touch points is recognized as a target button. how to do it with 123. The method of claim 122,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 131. The method of any one of claims 121-128,
Character input method, characterized in that the character assigned to the target button is displayed to the left of the additionally input character. 130. The method of any one of claims 121-129,
The second character is a character input method, characterized in that any one of a vowel, a consonant, a semi-vowel, a semi-consonant, and a special character. 131. The method of claim 130,
The second character is a character input method, characterized in that it includes at least one of the characters corresponding to the pronunciation of [a], [e], [i], [o], [u], which are pronunciation symbols of English . 130. The method of claim 130,
The second character is a character input method, characterized in that it comprises at least one of A, E, I, O, and U. 130. The method of claim 130,
The second character comprises at least one of T, S, N, R, H, D, L, and C. 130. The method of claim 130,
The second character is at least one of a, ㅓ, ㅗ, TT, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ㅣ, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅟ, ㅝ or Character input method comprising a. 130. The method of any one of claims 121-129,
When dragged for a long time, the second character is a character input method, characterized in that two or more characters. 130. The method of any one of claims 121-129,
The text input method further comprising the step of continuously adding and inputting additionally input characters when dragged again in the same direction while the touch is maintained or when the dragging direction is changed and dragged. 131. The method of any one of claims 121-128,
According to the situation before the final operation, a specific character group among at least one character group is matched, so that at least one character among at least one character belonging to the matched character group is matched with the character assigned to the target button without changing the character mode A method characterized in that it is additionally input together. 140. The method of claim 137,
When any one of multi all on & on or multi all drag in four directions is performed, the second character is any one of A, E, I, O, U,
When any one of multi-knot-all reference finger on/off or multi-knot all reference finger drag is performed, the second character is any one of W and Y,
When any one of the four directions of single dragging is performed, the second character is any one of T, S, N, and R,
If any one of multi-all dragging is performed after single touch in four directions, the second character is any one of H, D, L, and C. 139. The method of any one of claims 121-138,
In the case where there are two or more letters assigned to the target button,
According to the situation before the final operation, the method characterized in that the first character is selected and input. 140. The method of any one of claims 121-139,
In the case where there are two or more letters assigned to the target button,
According to the situation before the final operation, the method characterized in that the first character is selected and input. 141. The method of claim 121 to 140,
The multi-touch,
A method, characterized in that two fingers are used and it is two multi-touch recognized by two touch points. 142. The method of claim 141,
The two fingers,
A method characterized in that the index and middle fingers. 143. The method of any one of claims 121-142,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all scythe
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch with spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers 145. The method of any one of claims 121-143,
The method according to claim 1, wherein the operation after multi-touch is at least one of the following operations.
1.5.2.2.2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick
1.5.2..7. multi drag
1.5.2..8. multi all drag
1.5.2..9. Multi Scythe All Drag
1.5.2..10. Finger drag based on multi-scythe (=Drag touch point based on multi-scythe)
1.5.2..11. Finger drag based on multi-scythe and all sickles
1.5.2..12. multi multi tab
1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers on/off finger based on all sickle
1.5.2..13.7. Multi-drag by spread fingers (= multi-drag by spread-out touch points)
1.5.2..13.8. Multi-all drag by spread fingers (= multi-all drag by spread touch points)
1.5.2..13.9. Multi-scythe all-drag by spread fingers (=multi-scythe-all-drag by spread-out touch points)
1.5.2..13.10. Multi-scythe-all-based finger drag by spread fingers (=multi-scythe-all-based touch point drag by spread-out touch points)
1.5.2..13.11. Multi-scythe with spread fingers dragging fingers based on all scythes (=Draging multi-scythes with all scythes with open touch points)
1.5.2..13.12. Multi-multi-tap with spread fingers (= Multi-multi-tap with open touch points) 145. The method of any one of claims 121-144,
Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters. 145. The method of any one of claims 121-145,
The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters. In a device having a touch screen, a method for inputting characters,
Displaying a keyboard having a button to which a plurality of characters are assigned on a touch screen;
In the process of multi-on/off so that a specific button is recognized as a target button,
After the point of multi-touch, including after the point of multi-touch or after the point when the multi-touched finger is turned off (= multi-touch is released),
According to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character of at least one character related to the target button is input without changing the character mode while belonging to the matched character group Character input method comprising the step. 147. The method of claim 147,
The "specific character group" means any one of the following character groups.
1) Any one of two or more different character groups classified into different series according to the spelling rules.
2) A character group corresponding to any one character mode among various character modes in a conventional general mobile phone including a character group in a special character mode.
3) A group of characters assigned to a specific row among characters assigned to the same button.
4) A group of characters assigned to a second specific sequence greater than or equal to the first specific sequence in the first specific sequence among the characters assigned to the same button (if the first specific sequence and the second specific sequence are the same, it means one sequence).
5) A character group consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. 149. The method of claim 148,
The "specific character group" means a character group to which other characters according to the spelling rule belong, characterized in that it is a character group of characters input in another character mode according to the spelling rule corresponding to the currently set character mode. 150. The method of claim 149,
"A specific character group" means that it is any one character group among two or more different character groups classified into different series according to the spelling rules.
In English,
If the currently set character mode is uppercase mode, it is a group of characters that can be input in lowercase mode, or
If the currently set character mode is lowercase, it is a group of characters that can be input in uppercase mode, or
in Japanese
If the currently set character mode is hiragana character mode, it is a group of characters that can be input in katakana character mode,
If the currently set character mode is the katakana character mode, the method comprising: a character group that can be input in the hiragana character mode. 151. The method of claim 147 to 150,
In the method for recognizing the target button,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points A method characterized in that the target button is recognized by the target button recognition method according to the range. 152. The method of claim 151,
The method for recognizing the target button by the reference finger (= the method for recognizing the target button by the reference touch point) is any one or more of the following methods.
1.6.1.1.1 Target button recognition method by reference finger according to X coordinate value order (=target button recognition method by reference touch point according to X coordinate value sequence)
1.6.1.2 Method of recognizing target button by reference finger according to Y-coordinate value order (= Recognizing target button by reference touch point according to Y-coordinate value order)
1.6.1.3.3 Target button recognition method by reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by reference touch point according to the X coordinate value sequence according to the number of multi-touches)
1.6.1.4 Method of recognizing target button by reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by the reference touch point according to the Y coordinate value sequence according to the number of multi-touches) 153. The method of claim 152,
In the case where the target button recognition method is a target button recognition method by a reference finger according to an X-coordinate value sequence (= a target button recognition method by a reference touch point according to an X-coordinate value sequence),
A method characterized in that the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button. 153. The method of claim 152,
In the case where the target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence (=target button recognition method by a reference touch point according to the Y coordinate value sequence),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small Y coordinate values, is recognized as the target button. 153. The method of claim 152,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the X coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the leftmost point among the multi-touched touch points, that is, the point having the first X-coordinate value in the small order of X-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second X-coordinate value in a small order of X-coordinate values among multi-touched touch points is recognized as a target button. 153. The method of claim 152,
The target button recognition method is a target button recognition method by a reference finger according to the Y coordinate value sequence according to the number of multi-touches (=target button recognition method by a reference touch point according to the Y coordinate value sequence according to the number of multi-touches) In case,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y-coordinate value in the small order of Y-coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that a touch button including a point having a second Y-coordinate value in a small order of Y-coordinate values among multi-touched touch points is recognized as a target button. how to do it with 152. The method of claim 151,
A method of recognizing a target button using an open finger (= a method of recognizing a target button using an open touch point) is any one or more of the following methods.
1.6.2.1 Recognition method of target button by first open finger (=target button recognition method by first open touch point)
1.6.2.2 Method of recognizing the target button using the second spread finger (=target button recognition method using the second open touch point)
1.6.2.3 Method of recognizing target button using the third spread finger (=target button recognition method using the third open touch point)
1.6.2.4 Method of recognizing target button using the fourth spread finger (=target button recognition method using the fourth open touch point)
1.6.2.5 Method of recognizing target button using the 5th spread finger (=target button recognition method using the 5th open touch point) 157. The method of claim 147 to 157,
The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or
The 3 multi-touch is a multi-touch recognized by the touch points of the index, middle, and ring fingers, or
The 4 multi-touch method, characterized in that the multi-touch recognized by the touch points of the index and middle fingers, ring and small fingers. 159. The method of any one of claims 147 to 158,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2.2.2. nMulti-touch
1.4.2.3.3. multi all touch
1.4.2.4 Multi Scythe All Touch
1.4.2..5. Finger touch based on multi-kick all (= touch point based on multi-knot all)
1.4.2..6. Finger touch based on multi-scythe and all scythe
1.4.2..7. Finger variable touch based on multi-knot all (= touch point variable touch based on multi-knot all)
1.4.2..8. Definition of terms for multi-touch by spread fingers
1.4.2..8.1. Multi-touch by spread fingers (= multi-touch by spread-out touch points)
1.4.2..8.2. n multi-touch by spread fingers (= n multi-touch by open touch points)
1.4.2..8.3. Multi-all touch by spread fingers (= multi-all touch by spread touch points)
1.4.2..8.4. Multi-scythe all-touch by spread fingers (=multi-scythe-all-touch by spread-out touch points)
1.4.2..8.5. Multi-scythe-all-based finger touch by spread fingers (= Multi-scythe-all-based touch point touch by spread-out touch points)
1.4.2..8.6. Finger touch based on the multi-scythe with spread fingers 160. The method of any one of claims 147 to 159,
The method according to claim 1, wherein the operation after multi-touch is at least one of the following operations.
1.5.2.2.2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Knot All On & Off
1.5.2..5. Finger on & off based on multi-knot all (=touch point on & off based on multi-knot all)
1.5.2..6. Finger on & off based on multi-scythe all-kick
1.5.2..12. multi multi tab
1.5.2..13.1. Operation after multi-touch with spread fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by spread fingers (= Multi on & off by spread touch points)
1.5.2..13.3. Multi-all on & off by spread fingers (= Multi-all on & off by spread out touch points)
1.5.2..13.4. Multi-nick all on & off by spread fingers (= Multi-kick all on & off by spread out touch points)
1.5.2.113.5. Multi-scythe-all-based finger on & off by spread fingers (= Multi-scythe-all-based touch point on & off by spread-out touch points)
1.5.2..13.6. Multi-scythe by spread fingers All-sick standard finger on & off 160. The method of any one of claims 147 to 160,
Characters that can be applied are general characters expressing the language, water, and a method, characterized in that it also includes numbers or special characters. 167. The method of any one of claims 147 to 161,
The characters include at least one of Greek and Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English characters, global languages including Japanese characters and special characters. How to input characters.

Images