KR20120061038A - Recognition method of multi-touch of touch button on touch screen, text input method on touch screen and modifying method of object - Google Patents

Abstract

PURPOSE: A multi-touch recognition method of a touch button on a touch screen, a character input method, and an object transforming method are provided to increase character input speed by inputting a specific character and a character which is arranged on a target button. CONSTITUTION: A keyboard having a button on which characters are arranged is displayed on a touch screen. When a specific button is operated to be recognized as a target button, a character is inputted after an operation starting point. A specific sequence of the inputted character is determined according to an operation after multi-touch.

Description

Recognition method, character input method and object transformation method of touch button on touch screen

The present invention relates to an input method, and more particularly, to a method of inputting a user command in a manner in which touch buttons displayed on a touch screen are manipulated after a touch.

When entering a character into the QWERTY keyboard on the touch screen of a conventional smartphone, there is a problem that you need to be careful while typing because the size of the button to which the character is assigned is small or a large number of typos occur.

When entering characters with a 12-keypad keypad on a touch screen of a conventional smartphone, a plurality of characters are assigned to the same button as in the physical 12-keypad of a conventional feature phone. The problem is that you need a lot of strokes. However, to solve the above problems through the present application.

Conventional tablet PC QWERTY keyboard when entering the character is a large size assigned to the character is not a problem such as typo, such as above, but through this application to input two letters by one touch to improve the character input speed do.

Because of the small size of the small touch buttons in a device having a small touch screen including a conventional mobile phone, it is very difficult or impossible to multi-touch accurately and quickly with two or more fingers in one small button area. Therefore, development of a multi-touch method that is more convenient for the user is distant.

On the other hand, the representative method of the object is enlarged or reduced on the touch screen, the "one finger zoom" and the thumb and index finger by pinching or spreading the object is reduced or enlarged.

According to "one finger zoom", double-clicking or long-pressing an object (eg a photo) displays an upward arrow and a downward arrow on the object. In this case, dragging upwards enlarges the object, and dragging downwards reduces the object. The disadvantage of this method is that you need to double-click or press and hold before dragging to zoom in or out on an object.

On the other hand, the way in which the object is reduced or enlarged by pinching or spreading the thumb and index finger is excellent in intuition, and the operation speed is fast, but the operation speed still needs to be improved, and the object is enlarged or maintained only while maintaining the aspect ratio of the object. Since it is reduced, there is a problem in that the shape of an object including 17 kinds of object change patterns, which are conventionally implemented through a mouse, may be deformed or the object may not be rotated. And, there is a problem that it is difficult to enlarge or reduce very small objects. This is because multi-touching very small objects with the thumb and forefinger is very difficult or virtually impossible.

In addition, among the methods of expanding or contracting conventional objects, a method that is generally used most commonly is a method of using a mouse, which may be referred to as an object shape deformation method requiring an activation step of an object. There is a method by the same steps.

Step 1: The object is activated with a rectangular activation area boundary (see Fig. 39) around the object by a signal that activates the object, including a mouse pointer at any point of the object and clicking the left mouse button. step

(When the mouse pointer is placed on the active area boundary of the object, eight zooms such as 1 to 8 in FIG. 39 are changed by a double-headed arrow indicating the direction in which the object can be enlarged / reduced. An adjustment point and a rotation arrow change the shape of the mouse pointer, such as the rotation control point 9 of Fig. 39. The eight zoom adjustment points are the midpoints of the four sides of the active area boundary line of the rectangular object and the four points. Appear at the vertex, and the rotation control point appears above the boundary of the object's active area.)

Step 2: Hover the mouse pointer on each zoom control point to change the mouse pointer's shape to a two-way arrow that indicates the direction in which it can be zoomed in, or hover the mouse pointer on the rotation control point to rotate the mouse. Step of changing the pointer shape (see FIGS. 40, 41, 42, and 43)

(Depending on the position of each zoom control point, left and right double arrows, up and down double arrows, left and right up and down diagonal double arrow or right, left and right diagonal double arrow appear.)

Step 3: press the left mouse button

This step generates a signal that the zooming or rotating of an object will start soon.

Step 4: drag the object in the desired direction to zoom or rotate the object

In this step 4, the 16 points of the object zoom in / out and the rotation adjustment points in Fig. 39 are selected by the adjustment points selected from the zoom adjustment points 1 to 8 of FIG. 39 and the linear drag in two directions for each adjustment point. Examples of 17 object change aspects are included, including one rotational aspect.

The object zoom in 16 aspects by the drag point selected from the zoom adjustment points 1 to 8 of FIG. 39 and the two-way linear drag will be described in proportion to the horizontal / vertical length change rate of the boundary of the active area of the object. The rate of change of the length and width of the object is changed, and the position of the center point of the object is also changed.

According to the method of the present application, steps 1 to 3 in the object shape deformation method requiring the activation step of the above-described conventional object are merely performed by multi-touching the object to be recognized as the target button (= target object). In effect, four steps in the object shape deformation method requiring activation of a conventional object in which 17 object change aspects are implemented may be performed through post-touch manipulation.

For the sake of clarity, the 17 object changes described above as an example will be described as an example.

Hereinafter, the upper horizontal side refers to the side connecting the control points 1 and 2 of the control point in the active area boundary of the object shown in Figure 39, the lower horizontal side of the control point in the active area boundary of the object The left vertical side refers to the side connecting control points 1 and 3 among the control points on the object's active area boundary, and the right vertical side refers to the side of the object. Refers to the side connecting control points 2 and 4 among the control points on the region boundary.

1) When dragged upward from the 5th adjustment point on the upper horizontal side of FIG. 39, the lengths of the upper and lower horizontal sides and the positions of the lower horizontal sides remain unchanged, and only the lengths of the left and right vertical sides are enlarged. For example, it is the aspect which changes from FIG. 26 to FIG.

2) When dragged downward from the 5th adjustment point on the upper horizontal side of FIG. 39, the lengths of the upper and lower horizontal sides and the positions of the lower horizontal sides remain unchanged, and only the lengths of the left and right vertical sides are reduced. For example, it is the aspect which changes from FIG. 27 to FIG.

3) When dragged upward from the adjustment point 7 on the lower side of FIG. 39, the length of the upper side and the lower side and the position of the upper side are unchanged, and only the length of the left side and the right side is reduced. For example, it is the aspect which changes from FIG. 26 to FIG.

4) When dragged from the adjustment point 7 on the lower side of FIG. 39 to the lower side, the length of the upper side and the lower side and the position of the upper side are unchanged, and only the length of the left side and the right side is enlarged. For example, it is the aspect which changes from FIG. 28 to FIG.

5) When dragged from the eighth adjustment point on the left vertical side of FIG. 39 to the right direction, the lengths of the left and right vertical sides and the positions of the right vertical sides are unchanged, and only the lengths of the upper and lower horizontal sides are reduced. For example, it is the aspect which changes from FIG. 26 to FIG.

6) When dragged from the eighth adjustment point on the left vertical side of FIG. 39 to the left direction, the lengths of the left and right vertical sides and the positions of the right vertical sides remain unchanged, and only the lengths of the upper and lower horizontal sides are enlarged. For example, it is the aspect which changes from FIG. 30 to FIG.

7) When dragged from the sixth adjustment point on the right vertical side of FIG. 39 to the right direction, the length of the left and right vertical sides and the position of the left vertical side are unchanged, and only the lengths of the upper and lower horizontal sides are enlarged. For example, it is the aspect which changes from FIG. 26 to FIG.

8) When dragged from the sixth adjustment point on the right vertical side of FIG. 39 to the left direction, the lengths of the left and right vertical sides and the positions of the left and right vertical sides remain unchanged, and only the lengths of the upper and lower vertical sides are reduced. For example, it is the aspect which changes from FIG. 29 to FIG.

9) When dragged from the first adjustment point, which is the upper left vertex of FIG. 39, to the right lower direction, the position of the fourth vertex, which is the lower right corner, is unchanged, and the length of the four sides is reduced. At this time, within the range of 90 degrees in the lower right direction, the reduction ratio of the horizontal length and the vertical length varies depending on which right direction is dragged. For example, it is the aspect which changes from FIG. 26 to FIG.

10) When dragging from the control point 1, which is the upper left corner of FIG. 39, to the upper left, the position of the vertex 4, which is the lower right corner, is unchanged and the length of the four sides is enlarged. At this time, within the range of 90 degrees in the upper left direction, the enlargement ratio of the horizontal length and the vertical length is different depending on which left direction is dragged. For example, it is the aspect which changes from FIG. 34 to FIG.

11) When dragging from the 4th adjustment point of the lower right side vertex of FIG. 39 to the lower right direction, the position of the 1st vertex of the upper left side vertex remains unchanged, and the length of the 4 sides is enlarged. At this time, within the range of 90 degrees in the lower right direction, the enlargement ratio of the horizontal length and the vertical length is different depending on which right direction is dragged. For example, it is the aspect which changes from FIG. 26 to FIG.

12) When dragging from the 4th adjustment point of the lower right corner of FIG. 39 to the upper left direction, the position of the 1st vertex of the upper left corner is unchanged and the length of the 4 sides is reduced. At this time, within the range of 90 degrees in the upper left direction, the reduction ratio of the horizontal length and the vertical length is different depending on which drag direction is used in the upper left direction. For example, it is the aspect which changes from FIG. 33 to FIG.

13) When dragged from the second adjustment point, which is the upper right side vertex of FIG. 39, to the upper right direction, the position of the third vertex, which is the lower left corner, is unchanged, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length varies depending on which right-side direction is dragged within the range of 90 degrees in the upper right direction. For example, it is the aspect which changes from FIG. 26 to FIG.

14) When dragging from the control point 2, which is the upper right side vertex of FIG. 39, to the lower left, the position of the third vertex, which is the lower left vertex, remains unchanged, and the length of the four sides is reduced. At this time, within the range of 90 degrees in the lower left direction, the reduction ratio of the horizontal length and the vertical length is different depending on which drag direction is left. For example, it is the aspect which changes from FIG. 31 to FIG.

15) When dragged from the control point 3, which is the lower left vertex of FIG. 39, to the upper right direction, the position of the vertex 2, the upper right side vertex, remains unchanged, and the length of the four sides is reduced. At this time, within the range of 90 degrees in the upper right direction, the reduction ratio of the horizontal length and the vertical length varies depending on which right direction is dragged. For example, it is the aspect which changes from FIG. 26 to FIG.

16) When dragging from the adjustment point 3, which is the lower left vertex of FIG. 39, to the lower left, the position of the vertex 2 that is the upper right side is unchanged and the length of the four sides is enlarged. At this time, within the range of 90 degrees in the lower left direction, the enlargement ratio of the horizontal length and the vertical length varies depending on which drag direction is left. For example, it is the aspect which changes from FIG. 32 to FIG.

17) When dragging in any direction in the 360 degree direction from the 9th adjustment point of the rotation adjustment point of Figure 39, the object is rotated in the drag direction.

In fact, the drag direction at control points 1-8 of FIG. 39 can also be dragged in any of the 360 degree directions (especially effective at control points 1-4), but most at each control point. The dragging direction is merely taken as an example in the above example. In addition, the drag length is an example assuming that the drag length is generally about the length of the drag.

The present invention has been made to solve the above problems, the object of the present invention, the button or the objects appearing on the touch screen is touched, the speed, accuracy, The present invention provides a method for improving convenience.

In the following, the word 'finger' in the user's point of view may be replaced by the word 'touch point' in most devices.

[Claim 1]

In a device having a touch screen, when the touch screen is multi-touch, the target button is recognized in the method,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 2]

The method according to claim 1,

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 3]

The method according to claim 2,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 4]

The method according to claim 2,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 5]

The method according to claim 2,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 6]

The method according to claim 2,

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 7]

The method according to claim 1,

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 8]

The method according to any one of claims 1 to 7,

In a device equipped with a touch screen, after the multi-touch operation, a method for generating a work signal for any operation, including character input or object deformation,

And the method to be operated after the multi-touch is multi-on & off, multi-drag and post-multi-touch operation by the open fingers.

[Claim 9]

The method according to claim 8,

The multi on & off method is any one or more of the following methods.

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

[Claim 10]

The method of claim 9,

The multi multi-not all on & off method is any one or more of the following methods.

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

[Claim 11]

The method according to claim 8,

The multi-drag method is any one or more of the following methods.

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle up drag

[Claim 12]

The method of claim 11,

The multi-not all drag method is any one or more of the following methods.

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

[Claim 13]

The method according to claim 8,

The post-multi-touch operation by the open fingers (= post-multi-touch operation by the open touch point) is a method according to any one or more of the following methods.

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

[Claim 14]

In a device having a touch screen, when the touch screen is multi-touch, the multi-touch method which is a method for the multi-touch process is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 15]

In a device equipped with a touch screen, after the multi-touch operation, a method for generating a work signal for any operation, including character input or object deformation,

And the method to be operated after the multi-touch is multi-on & off, multi-drag and post-multi-touch operation by the open fingers.

[Claim 16]

16. The method of claim 15,

The multi on & off method is any one or more of the following methods.

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

[Claim 17]

18. The method of claim 16,

The multi multi-not all on & off method is any one or more of the following methods.

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

[Claim 18]

16. The method of claim 15,

The multi-drag method is any one or more of the following methods.

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle up drag

[Claim 19]

19. The method of claim 18,

The multi-not all drag method is any one or more of the following methods.

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

[Claim 20]

16. The method of claim 15,

The post-multi-touch operation by the open fingers (= post-multi-touch operation by the open touch point) is a method according to any one or more of the following methods.

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

[Claim 21]

In a device equipped with a touch screen, after the multi-touch operation, a method for generating a work signal for any operation, including character input or object deformation,

The operation method after the multi-touch,

And a method for performing different operations depending on the number of times the multi-on & off is performed at least once in succession, i.e., the multi-tap method.

[Claim 22]

The method according to claim 21, wherein when characters are input by the multi-tap method,

And the characters belonging to the target character group related to the target button are displayed in a cycle according to the number of times the multi on & off is performed at least once in succession.

[Claim 23]

23. The method of claim 22,

After the characters are displayed in a circular manner, the displayed characters are deterministically input after a single touch, multi-touch, cursor movement, or a certain time (for example, 2 seconds) so that another button is recognized as a target button.

[Claim 24]

23. The method of claim 22,

When multi-touch when multi-tap is expressed in more detail with n multi-touch,

According to at least one value of n, i.e., according to the situation before the last operation, a specific character group is matched among the at least one character group, and belongs to the matched character group and at least one of the at least one character associated with the target button. Characters are input without changing the character mode.

[Claim 25]

27. The method of claim 24,

The "specific character group" is any one of the following character groups.

1) Any character group from two or more different character groups classified under different spelling rules.

2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button.

5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 26]

26. The method of claim 25,

"Specific character group" means that a character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode in the spelling rule corresponding to the currently set character mode.

[Claim 27]

27. The method of claim 24,

"Specific character groups" means that any one of two or more different character groups classified under different spellings.

In English,

If the current text mode is set to uppercase mode, the group of characters that can be entered in lowercase mode or

If the currently set text mode is a lowercase mode, the group of characters that can be entered in uppercase mode, or

In Japanese

If the currently set text mode is Hiragana text mode, the text group that can be input in Katakana text mode,

If the currently set character mode is Katakana character mode, characterized in that it comprises a character group that can be input in the hiragana character mode.

[Claim 28]

The method according to any one of claims 21 to 27,

In the way the target button is recognized,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 29]

The method according to claim 28,

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 30]

The method of claim 29,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 31]

The method of claim 29,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 32]

The method of claim 29,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 33]

The method of claim 29,

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 34]

The method according to claim 28,

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 35]

The method according to any one of claims 21 to 34, wherein

The multi-touch,

And two fingers used by two fingers to be recognized by two touch points.

[Claim 36]

The method of claim 35, wherein

The two fingers,

Index finger and middle finger.

[Claim 37]

The method according to any one of claims 21 to 36,

The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 38]

The method according to any one of claims 21 to 37,

The post-multi-touch operation is at least one of the following operations.

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

[Claim 39]

The method according to any one of claims 21 to 38,

Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters.

[Claim 40]

The method of claim 21, wherein

The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method.

[Claim 41]

Multi-touching the object (or the active area of the object) to be recognized as the target button

And deforming the object (or the activation area of the object) according to the operation after the multi-touch.

[Claim 42]

The method of claim 41,

In the way the target button is recognized,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 43]

The method of claim 42,

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 44]

The method of claim 43,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 45]

The method of claim 43,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 46]

The method of claim 43,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 47]

The method of claim 43,

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 48]

The method of claim 42,

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 49]

The method of claim 41, wherein

Operation is a method of deformation of an object, characterized in that the drag.

[Claim 50]

The method of claim 49

When the object is dragged in at least one first specific direction, the object (or active area of the object) is enlarged, and when the object is dragged in at least one second specific direction, the object (or active area of the object) is reduced.

[Claim 51]

The method of claim 50,

When dragging upwards, it zooms in,

If the drag in the downward direction, characterized in that the reduction.

[Claim 52]

The method of claim 50,

The method of expanding or contracting, wherein the ratio of the length of the object to the length of the object is maintained.

[Claim 53]

The method of claim 50,

When zooming in or out, the center point of the object is not moved.

[Claim 54]

The method of claim 49,

According to the drag direction determined by the device, only the horizontal length or the vertical length of the object (or the active area of the object) or the horizontal length and the vertical length are enlarged or reduced together.

[Claim 55]

The method of claim 54, wherein

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is expanded,

When dragged in the second specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is reduced,

When dragged in the first specific direction in the vertical direction, the horizontal length does not change, and the vertical length is expanded,

When dragged in the second specific direction in the longitudinal direction, the horizontal length does not change, and the vertical length is reduced,

When dragging in at least one first specific direction of the diagonal direction, the horizontal length and the vertical length are enlarged at the same ratio,

When the drag in the at least one second specific direction of the diagonal direction, characterized in that the horizontal length and the vertical length is reduced by the same ratio.

[Claim 56]

The method of claim 55,

When dragged to the right, the width is enlarged,

When dragged to the left, the width is reduced,

When dragged upwards, the vertical length is enlarged,

When dragging downwards, the vertical length is reduced,

When dragged in the upper left or upper right direction, the width and length are enlarged at the same ratio,

When dragging in the lower left or lower right direction, the horizontal length and the vertical length is reduced in the same ratio.

[Claim 57]

The method of claim 54, wherein

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is expanded,

When dragged in the second specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is reduced,

When dragged in the first specific direction in the vertical direction, the horizontal length does not change, and the vertical length is expanded,

When dragged in the second specific direction in the longitudinal direction, the horizontal length does not change, and the vertical length is reduced,

When dragged in at least one first specific direction range in a diagonal direction, the horizontal length and vertical variation ratio are enlarged differently according to each direction within the range,

When the drag in the at least one second specific direction range of the diagonal direction, the horizontal length and the vertical variation ratio is reduced according to each direction in the range differently.

[Claim 58]

The method of claim 57, wherein

When dragged to the right, the width is enlarged,

When dragged to the left, the width is reduced,

When dragged upwards, the vertical length is enlarged,

When dragging downwards, the vertical length is reduced,

When dragging in the upper left or right upper direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently according to which direction of the upper left range or the upper right range,

When dragging in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently according to which direction of the lower left range or the lower right range.

[Claim 59]

The method of claim 54, wherein

The method of expanding or contracting, characterized in that the center point of the object is moved or not moved.

[Claim 60]

The method of claim 49,

Step 1: The object (or the active area of the object) is multi-touched and started to be dragged to be recognized as the target button, and the specific range within the object (or the active area of the object) is determined by the hitting point and the direction of dragging. To be recognized.

Step 2: The width or length of the object (or the active area of the object) varies depending on the recognized hit point and the determined drag direction, and the direction from which the drag is started is closer to the center of the object (or the active area of the object). And reducing in the direction, and expanding in the direction away.

[Claim 61]

The method of claim 60,

If the direction in which the drag starts (determined by the device), that is, the drag direction intended by the user is determined to be one of the upper side, the lower side, the right side, or the left side,

If the determined drag-starting direction is closer to the center of the object (or the active area of the object),

The length of the two sides parallel to the determined drag direction among the two horizontal sides or the two longitudinal sides of the object (or the active area of the object) is reduced, and the length of the two sides perpendicular to the determined drag direction is unchanged,

If the determined drag start direction is a direction away from the center of the object (or the active area of the object),

The length of two sides parallel to the determined drag direction among the two horizontal sides or the two longitudinal sides of the object (or the active area of the object) is enlarged, and the length of the two sides perpendicular to the determined drag direction is unchanged,

If the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is determined to be one of the upper right, lower right, upper left, or lower left directions,

If the determined dragging direction is closer to the center of the object (or the active area of the object), the length of the horizontal side and the vertical side is reduced, and if the horizontal side is reduced, both horizontal sides are reduced to the same length, If the side is reduced, both vertical sides are reduced to the same length, and the ratio of change in width and length can be set differently according to which direction is dragged in the specific drag direction range determined by the device. You can set the width and length to be the same ratio no matter what direction you drag in,

If the determined dragged direction is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. In this case, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length, depending on which direction within the specific drag direction range determined by the device. A method of changing the length and the vertical length may be set differently or the horizontal and vertical lengths may be set to be different in the same ratio no matter which direction is dragged in a specific drag direction range.

[Claim 62]

The method of claim 61,

 If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is the upper right side, lower right side, upper left side, lower left side,

If the determined dragging direction is closer to the center of the object (or the active area of the object), the drag determined from three sides surrounding the recognized target range while the center of the object moves in the determined dragging direction. The position of the side perpendicular to the direction is moved for the reduction, and the position of the opposite side of the side does not change,

If the determined dragging direction is a direction away from the center of the object (or the active area of the object), the drag direction determined from three sides surrounding the recognized target range while the center of the object moves in the determined drag direction. The position of the side perpendicular to the side is moved for enlargement, and the position of the opposite side of the side does not change,

If the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is determined to be one of the upper right, lower right, upper left, or lower left directions,

-If the determined dragging direction is close to the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, and is parallel to the dragging direction among the vertices in the recognized target range. The vertex closest to the straight line is moved for reduction, and the position of the vertex facing the vertex may not be changed,

If the determined dragging direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, and a straight line parallel to the dragging direction among the vertices in the recognized target range. And the vertex closest to is moved for enlargement, and the position of the opposite vertex of the vertex may not be changed.

[Claim 63]

The method of claim 62, wherein

① It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest Y-values in the active area of the object (object or object) before the shape deformation of the object are (X1, Y1), and the coordinates with the smallest Y-values are (X2, Y2). time,

The index finger is expected to be recognized as a reference finger at a point within the (object area or) object activation area (eg area 5 in FIG. 45) having a Y value equal to or greater than Y1, Y2's median value (= (Y1 + Y2) / 2). When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' upward, the horizontal length of the object may be enlarged without changing the horizontal length. Even when only the vertical length is enlarged, the coordinate (s) with the smallest Y value of the (object area or) object activation area (for example, the lower horizontal side) is unchanged, and the coordinate with the largest Y value of the (object or) object activation area ( (E.g., the top horizontal side) can be extended only to the vertical length of the object, moving upward. To briefly describe the above description in the drawings, an example of changing from Fig. 26 to Fig. 27 is exemplified.

If it is to be recognized as a reference finger at a point in the (object area or) object activation area (eg area 7 in FIG. 45) having a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) If the index finger is to be touched and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' upward, the horizontal length of the object can be reduced by only the vertical length without changing. Even if only the vertical length is reduced, the coordinate (s) with the largest Y value of the (object area or) object activation area is unchanged, and the coordinate (s) with the smallest Y value of the (object area) or object activation area is further changed. Only the vertical length of the object can be reduced by moving upwards. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

② It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest Y-values in the active area of the object (or the object region) before the shape deformation of the object are (X1, Y1), and the coordinates with the smallest Y-values are (X2, Y2). time,

The index finger to be recognized as the reference finger is touched at a point within the (object area or) object activation area with a Y value equal to or greater than Y1, Y2 (= (Y1 + Y2) / 2), and the stop is to the right of the index finger. After being touched anywhere on the part, if you 'multi-drag' the lower side, you can reduce the vertical length of the object without changing the horizontal length of the object. Even if only the vertical length is reduced, the coordinate (s) with the smallest Y value of the (object area) or the object activation area is moved to the lower side without changing the coordinate (s) with the largest Y value of the (object or) object activation area. In the form of losing, only the length of the object can be reduced. To briefly describe the above description in the drawings, an example of changing from FIG. 27 to FIG.

If the index finger to be recognized as a reference finger is touched at a point in the (object area or) object activation area having a Y value less than the median value of Y1 and Y2 (= (Y1 + Y2) / 2), the middle finger is detected. If you touch any part of the right side of, then 'multi-drag' to the bottom, you can enlarge the vertical length without changing the object's width. Even if only the vertical length is enlarged, the coordinate (s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate (s) having the smallest Y value of the (object area) or object activation area is further changed. Only the vertical length of the object can be enlarged by moving downward. To briefly describe the above description in the drawings, an example of changing from FIG. 28 to FIG.

③ Two (2) touches are detected and stopped so that the (object or) object activation area becomes the target button. In multi-touch, the coordinate where the X value is the largest in the object area or the active area of the object before the shape deformation of the object is (X1, Y1), and the coordinate where the X value is the smallest is (X2, Y2). time,

The index finger is expected to be recognized as a reference finger at a point within the (object region or) object activation region (eg region 6 in FIG. 45) having an X value equal to or greater than X1, X2 (= (X1 + X2) / 2). When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' to the right, the vertical length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate (s) with the smallest X value of the (object area or) object activation area (for example, the left vertical side) is unchanged, and the coordinate with the largest X value of the (object or) object activation area is unchanged. (S) (e.g., right vertical side) can be extended to the right of the object's width in such a way that it is shifted to the right. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

If a reference finger is to be recognized as a reference finger at a point in an object activation area (eg, area 8 of FIG. 45) having an X value less than an intermediate value of X1 and X2 (= (X1 + X2) / 2) If the index finger is to be touched and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' to the right, the vertical length of the object may be reduced only without changing the width. Even if only the horizontal length is reduced, the coordinate (s) having the largest X value of the (object area or) object activation area is unchanged, and the coordinate (s) having the smallest X value of the (object area) or object activation area is further changed. Only the width of the object can be reduced by moving it to the right. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

④ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinate where the X value is the largest in the object area or the active area of the object before the shape deformation of the object is (X1, Y1), and the coordinate where the X value is the smallest is (X2, Y2). time,

The index finger to be recognized as the reference finger is touched at a point within the (object area or) object activation area having an X value equal to or greater than X1, X2 (= (X1 + X2) / 2), and the stop is to the right of the index finger. After being touched at any point of the part, if the user multi-drags to the left, the vertical length of the object can be reduced without changing the vertical length. Even though only the horizontal length is reduced, the coordinates having the smallest X value of the (object area) or the object activation area are shifted to the left without changing the coordinates having the largest X value of the (object or) object activation area. Only the horizontal length of can be reduced. To briefly describe the above description in the drawings, an example may be changed from FIG. 29 to FIG.

If the index finger to be recognized as a reference finger is touched at a point in the (object area or) object activation area having an X value of less than an intermediate value (= (X1 + X2) / 2) of X1 and X2, the middle finger is detected. If you touch any part of the right side of the `` multi-all drag '' to the left, you can enlarge the width of the object without changing its height. Even though only the horizontal length is enlarged, the coordinates having the largest X value of the (object area) or the object activation area are shifted to the left without changing the coordinates having the smallest X value of the (object area) or the object activation area. Only the width of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 30 to FIG.

⑤ It is multi-touched by detecting and stopping so that the object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

(Object region or) object activation region (with an X value equal to or greater than X1, X2 (= (X1 + X2) / 2) and a Y value equal to or greater than Y1, Y2 (= (Y1 + Y2) / 2) For example, the index finger to be recognized as a reference finger is touched at a point within the area (which may be included in region 2 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag to the upper right side'. ', The width and height of the object can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the smallest X value and the Y value of the object activation area (or vertex 3 in FIG. 39) without change (object or) Coordinates with the largest X and Y values (eg vertex 2 in FIG. 39) of the object activation area may be shifted to the upper right side to enlarge the length of the object. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

(Object region or) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) The index finger to be recognized as a reference finger is touched at a point within the object activation area (e.g., an area that can be included in area 3 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, then to the upper right side. If you 'multi-drag', the object's width and height can be reduced by the same ratio. Even though the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates having the largest X and Y values of the (object area or) object activation area are not changed, and the X and Y values of the (object area or) object activation area are unchanged. The smallest of these values is shifted to the upper right side so that the length of the object can be reduced. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

⑥ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

Within an object activation area (object region or object) having an X value greater than or equal to X1, X2 (= (X1 + X2) / 2) and a Y value greater than or equal to Y1, Y2 (= (Y1 + Y2) / 2) Touch the index finger to be recognized as the reference finger at the point, and stop the middle finger at any point on the right side of the index finger, and then 'multi-drag' all the way to the left and bottom to reduce the horizontal and vertical lengths of the object. can do. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates of the smallest X and Y values of the (object area) or the object activation area are not changed, and the X and Y values of the (object or) object activation area are not changed. The largest and the smallest coordinates are shifted to the lower left side so that the length of the object can be reduced. The above description will be briefly explained with reference to FIG. 31, for example.

(Object region or) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) When the index finger to be recognized as a reference finger is touched at a point within the object activation area, the middle finger is touched at any point on the right side of the index finger, and then 'multi-all dragged' to the lower left side, the object has the same horizontal and vertical length. Can be enlarged in proportion. Even if the width and height of the object are enlarged at the same ratio, the coordinates with the largest X and Y values of the (object area or) object activation area are not changed, and the X and Y values of the (object area) or object activation area are unchanged. The coordinates with the smallest value are shifted further to the lower left, so that the length of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 32 to FIG.

⑦ It is multi-touched by detecting and stopping so that the object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

(Object area or) object activation area with an X value greater than or equal to X1 and X2 (= (X1 + X2) / 2) and a Y value less than or equal to Y1 and Y2 (= (Y1 + Y2) / 2) For example, the index finger to be recognized as a reference finger is touched at a point within the area that can be included in area 4 of FIG. 45, and the middle finger is touched at any point on the right side of the index finger. When dragged, the object's width and height can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the smallest X value and the largest Y value (e.g., vertex 1 in FIG. 39) of the (object area or) of the object activation area remain unchanged. Alternatively, the horizontal and vertical lengths of the object may be enlarged in such a manner that the coordinates of the object activation area having the largest X value and the smallest Y value (for example, vertex 4 of FIG. 39) are moved to the lower right side. The above description will be briefly explained with reference to FIG. 26, for example.

(Object region or) object having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value greater than the median value of Y1, Y2 (= (Y1 + Y2) / 2) The index finger to be recognized as a reference finger is touched at a point within the active area (e.g., an area that can be included in area 1 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, When multi-all dragged, the object's width and height can be reduced by the same ratio. Even though the horizontal and vertical lengths of the object are reduced by the same ratio, the X value of the (object region) or the object activation region is unchanged without changing the coordinates having the largest X value and the smallest Y value of the (object region) or the object activation region. The smallest and largest Y coordinates are shifted to the lower right side so that the length of the object can be reduced. The above description will be briefly explained with reference to FIG. 26, for example.

⑧ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

(Object area or) object activation area with an X value greater than or equal to X1 and X2 (= (X1 + X2) / 2) and a Y value less than or equal to Y1 and Y2 (= (Y1 + Y2) / 2) When the index finger is to be touched at the point within the finger, the middle finger is touched at any point on the right side of the index finger, and then 'multi-draged' to the upper left side, the horizontal and vertical lengths of the object are reduced by the same ratio. It can be done. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates of the smallest X value and the largest Y value of the (object area) or the object activation area are unchanged, and the X value of the (object or) object activation area is the highest. The horizontal and vertical lengths of objects can be reduced by shifting the coordinates with the largest and smallest Y value to the upper left side. To briefly describe the above description in the drawings, an example of changing from FIG. 33 to FIG.

(Object region or) object having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value greater than the median value of Y1, Y2 (= (Y1 + Y2) / 2) When the index finger to be recognized as a reference finger is touched at a point in the active area, the middle finger is touched at any point on the right side of the index finger, and then 'multi-draged' to the upper left side, the horizontal and vertical lengths of the object are the same. Can be enlarged to Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the largest X value and the smallest Y value of the (object area or object activation area) are unchanged, and the X value of the object activation area (or object area) is unchanged. The smallest and largest Y-coordinates are shifted to the upper left side so that the length of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 34 to FIG.

[Claim 64]

The method of claim 61,

In zooming in or out, the center point of the object is moved.

[Claim 65]

The method according to any one of claims 41 to 64,

The multi-touch,

And two fingers used by two fingers to be recognized by two touch points.

[Claim 66]

The method of claim 65,

The two fingers,

Index finger and middle finger.

[Claim 67]

The method of any one of claims 41-66, wherein

The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 68]

The method according to any one of claims 41 to 67,

The method after the multi-touch is at least one of the following operations

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle up drag

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

1.5.2..12. Multi power strip

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

[Claim 69]

In a device having a touch screen, a method of inputting characters,

Displaying a keyboard on which a button on which a plurality of characters are assigned is displayed on a touch screen;

In the process of multi on and off so that a specific button is recognized as a target button,

After the point of multi-touch or after the point of multi-touch, including after the point at which the multi-touched finger is off (= multi-touch is released),

Character character input method comprising the step of inputting a character of a specific sequence among the characters assigned to the button recognized as the target button.

[Claim 70]

The method of claim 69,

When multi-touch is expressed in more detail with n multi-touch,

and said specific order is determined according to the value of n.

[Claim 71]

The method of claim 70,

Character input method characterized in that it is determined so that the value of n and the numerical value corresponding to the order of the specific order.

[Claim 72]

The method of claim 70,

If n is 2, i.e., two multi-touch, the second character assigned to the button recognized as the target button is inputted.

[Claim 73]

The method of claim 70,

If n is 3, i.e., 3 multi-touch, the third character assigned to the button recognized as the target button is inputted, or

If n is 4, i.e., 4 multi-touch, the 4th character assigned to the button recognized as the target button is input-processed.

[Claim 74]

The method of claim 69, wherein

In the way the target button is recognized,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 75]

The method of claim 74, wherein

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 76]

The system of claim 75, wherein

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 77]

The system of claim 75, wherein

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 78]

The system of claim 75, wherein

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 79]

The system of claim 75, wherein

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 80]

The method of claim 74, wherein

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 81]

The method of claim 69, wherein

The two multi-touch is a multi-touch recognized by the touch points of the detection and middle finger,

The three multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger,

And the four multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger.

[Claim 82]

82. The method of any of claims 69-81,

The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 83]

The method of any one of claims 69-82, wherein

The method after the multi-touch is at least one of the following operations

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..12. Multi power strip

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

[Claim 84]

84. The method of any of claims 69-83,

Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters.

[Claim 85]

85. The method of any of claims 69-84,

The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method.

[Claim 86]

In a device having a touch screen, a method of inputting characters,

Displaying a keyboard on which a button on which a plurality of characters are assigned is displayed on a touch screen;

When a button is operated after multi-touch so that a specific button is recognized as a target button, after the time when the operation starts after the multi-touch including after the start of the operation after the multi-touch or after the end of the operation,

Character input method comprising the; step of inputting a character of a specific sequence among the characters assigned to the button recognized as the target button by the multi-touch operation.

[Claim 87]

The method of claim 86,

According to the operation after the multi-touch,

Character input method characterized in that the specific order of the characters to be input is determined.

[Claim 88]

The method of claim 87,

If the drag direction is different, the character input method characterized in that it is recognized that the operation type is different after the multi-touch.

[Claim 89]

The method of claim 87,

According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character associated with the target button is input without belonging to the character mode while belonging to the matched character group. Characterized in that the method.

[Claim 90]

The method of claim 89,

The "specific character group" is any one of the following character groups.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button.

5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 91]

The method of claim 86, wherein

In the way the target button is recognized,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 92]

The system of claim 91, wherein

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 93]

The system of claim 92, wherein

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 94]

The system of claim 92, wherein

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 95]

The system of claim 92, wherein

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 96]

The system of claim 92, wherein

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 97]

The system of claim 91, wherein

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 98]

97. The method of any of claims 86-97,

The multi-touch,

And two fingers used by two fingers to be recognized by two touch points.

[Claim 99]

The method of claim 98,

The two fingers,

Index finger and middle finger.

[Claim 100]

The method of claim 86, wherein

The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 101]

The method according to any one of claims 86 to 100,

The post-multi-touch operation is at least one of the following operations.

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle up drag

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

1.5.2..12. Multi power strip

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

[Claim 102]

101. The method of any of claims 86-101,

Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters.

[Claim 103]

103. The method of any of claims 86-102,

The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method.

[Claim 104]

In a device having a touch screen, a method of inputting characters,

After the keyboard displays on the touch screen,

In the case where the specific button is operated after multi-touch so that it is recognized as the target button,

The starting point of the final operation of at least one of the final operations, which may include nine behaviors including eight directions of dragging off or on the top, bottom, left, right, top left, bottom left, top right, and bottom right. After or after the start of the last operation, including after the end of the last operation,

By a multi-touch post operation including a final manipulation of at least one of the final manipulations which may include nine behaviors including off or eight dragging,

In the specific character group of the at least one character group, belonging to a specific character group of at least one character associated with the button recognized as the target button is input,

According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character associated with the target button is input without belonging to the character mode while belonging to the matched character group. Characterized in that the method.

[Claim 105]

107. The method of claim 104,

The "specific character group" is any one of the following character groups.

1) Any character group from two or more different character groups classified under different spelling rules.

2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button.

5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 106]

107. The method of claim 105,

"Specific character group" means that a character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode in the spelling rule corresponding to the currently set character mode.

[Claim 107]

107. The method of claim 106,

"Specific character groups" means that any one of two or more different character groups classified under different spellings.

In English,

If the current text mode is set to uppercase mode, the group of characters that can be entered in lowercase mode or

If the currently set text mode is a lowercase mode, the group of characters that can be entered in uppercase mode, or

In Japanese

If the currently set text mode is Hiragana text mode, the text group that can be input in Katakana text mode,

If the currently set character mode is Katakana character mode, characterized in that it comprises a character group that can be input in the hiragana character mode.

[Claim 108]

107. The method of claim 104 to 107,

In the way the target button is recognized,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 109]

The system of claim 108, wherein

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 110]

109. The method of claim 109,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 111]

109. The method of claim 109,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 112]

109. The method of claim 109,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 113]

109. The method of claim 109,

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 114]

The system of claim 108, wherein

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 115]

The method of claim 104, further comprising

The multi-touch,

And two fingers used by two fingers to be recognized by two touch points.

[Claim 116]

116. The method of claim 115,

The two fingers,

Index finger and middle finger.

[Claim 117]

117. The method of any of claims 104-116,

The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 118]

117. The method of any of claims 104-117,

The post-multi-touch operation is at least one of the following operations.

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle up drag

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

1.5.2..12. Multi power strip

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

[Claim 119]

118. The method of any of claims 104-118,

Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters.

[Claim 120]

The method of any one of claims 104 to 119,

The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method.

[Claim 121]

In a device having a touch screen, a method of inputting characters,

After the keyboard displays on the touch screen,

In the case where the specific button is operated after multi-touch so that it is recognized as the target button,

At least one of the final operations that may include 5 (9?) Behaviors, including dragging in the 4 (8?) Direction of off or up, down, left, right (upper left, lower left, upper right, lower right) After the start of the last operation, including after the start of the last operation of a behavior or after the end of the last operation,

By a post-multitouch operation comprising a final operation of at least one of the final operations that may include 5 (9?) Behaviors including off or multi-drag in the 4 (8?) Direction,

A first character belonging to a specific character group among the at least one character group (delete?), The first character being a specific character among at least one character associated with the target button (or assigned to the target button);

Regardless of the target button, a second character, which is at least one specific character promised for each final operation, is additionally input.

[Claim 122]

The method of claim 121, wherein

In the way the target button is recognized,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 123]

131. The method of claim 122,

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 124]

123. The system of claim 123,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 125]

123. The system of claim 123,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 126]

123. The system of claim 123,

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 127]

123. The system of claim 123,

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 128]

131. The method of claim 122,

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 129]

128. The method of any of claims 121-128,

Character input method characterized in that the character assigned to the target button is displayed to the left of the additionally input character.

[Claim 130]

The method of any one of claims 121-129,

The second character is any one of a vowel, a consonant, a half vowel, a half consonant or a special character.

[Claim 131]

According to claim 130,

The second character is a character input method comprising at least one of the letters corresponding to the pronunciation of the pronunciation symbols [a], [e], [i], [o], [u] in English .

[Claim 132]

133. The method of claim 130,

And the second character comprises at least one of A, E, I, O or U.

[Claim 133]

133. The method of claim 130,

And the second character comprises at least one of T, S, N, R, H, D, L or C.

[Claim 134]

133. The method of claim 130,

The second character is at least one of ㅏ, ㅓ, ㅗ,, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ,, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅟ, ㅝ or ㅞ. Character input method comprising a.

[Claim 135]

The method of any one of claims 121-129,

When the drag is long, the second character is two or more characters.

[Claim 136]

The method of any one of claims 121-129,

If the drag is maintained in the same direction, or dragged again in the same direction or the drag direction is changed, dragging, further input characters are continuously added and input; Character input method further comprising.

[Claim 137]

128. The method of any of claims 121-128,

According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character belonging to the matched character group is compared with the character assigned to the target button without changing the character mode. And further input together.

[Claim 138]

141. The method of claim 137

When any one of multi-all on & on or 4-direction multi-all drag is performed, the second character is any one of A, E, I, O, and U,

When an operation of either the multi-not all reference finger on & off or the multi-notch reference finger drag in 4 directions is performed, the second letter is either W or Y,

When any one of four directions of single drag is performed, the second letter is any one of T, S, N, and R,

And the second character is any one of H, D, L, and C when an operation of one of the multi-all drags is performed after a single touch in four directions.

[Claim 139]

The method of any one of claims 121-138, wherein

If there are two or more letters assigned to the target button,

The first character is selected and input according to the situation before the final operation.

[Claim 140]

The method of any one of claims 121-139, wherein

If there are two or more letters assigned to the target button,

The first character is selected and input according to the situation before the final operation.

[Claim 141]

140. The method of claims 121 to 140 wherein

The multi-touch,

And two fingers used by two fingers to be recognized by two touch points.

[Claim 142]

The method of claim 141, wherein

The two fingers,

Index finger and middle finger.

[Claim 143]

The method of any one of claims 121-142, wherein

The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 144]

The method of any one of claims 121-143, wherein

The post-multi-touch operation is at least one of the following operations.

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle up drag

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

1.5.2..12. Multi power strip

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

[Claim 145]

141. The method of any of claims 121-144,

Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters.

[Claim 146]

The method of claim 121, wherein

The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method.

[Claim 147]

In a device having a touch screen, a method of inputting characters,

Displaying a keyboard on which a button on which a plurality of characters are assigned is displayed on a touch screen;

In the process of multi on and off so that a specific button is recognized as a target button,

After the point of multi-touch or after the point of multi-touch, including after the point at which the multi-touched finger is off (= multi-touch is released),

According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character associated with the target button is input without belonging to the character mode while belonging to the matched character group. Character input method comprising the step of.

[Claim 148]

149. The method of claim 147,

The "specific character group" is any one of the following character groups.

1) Any character group from two or more different character groups classified under different spelling rules.

2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.

Delete below?

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button.

5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 149]

The method of claim 148, wherein

"Specific character group" means that a character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode in the spelling rule corresponding to the currently set character mode.

[Claim 150]

The system of claim 149, wherein

"Specific character groups" means that any one of two or more different character groups classified under different spellings.

In English,

If the current text mode is set to uppercase mode, the group of characters that can be entered in lowercase mode or

If the currently set text mode is a lowercase mode, the group of characters that can be entered in uppercase mode, or

In Japanese

If the currently set text mode is Hiragana text mode, the text group that can be input in Katakana text mode,

If the currently set character mode is Katakana character mode, characterized in that it comprises a character group that can be input in the hiragana character mode.

[Claim 151]

The method of claim 147 to 150, wherein

In the way the target button is recognized,

A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range.

[Claim 152]

151. The method of claim 151,

A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

[Claim 153]

153. The apparatus of claim 152

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),

And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button.

[Claim 154]

153. The apparatus of claim 152

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),

And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button.

[Claim 155]

153. The apparatus of claim 152

The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.

3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button.

[Claim 156]

153. The apparatus of claim 152

The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,

In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.

3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to.

[Claim 157]

151. The method of claim 151,

A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

[Claim 158]

The method of claim 147 to 157, wherein

The two multi-touch is a multi-touch recognized by the touch points of the detection and middle finger,

The three multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger,

And the four multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger.

[Claim 159]

The method of any one of claims 147-158, wherein

The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

[Claim 160]

The method of any one of claims 147-159, wherein

The method after the multi-touch is at least one of the following operations

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..12. Multi power strip

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

[Claim 161]

The method of any one of claims 147-160,

Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters.

[Claim 162]

The method of any one of claims 147-161,

The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method.

In the following, the word 'finger' in the user's point of view may be replaced by the word 'touch point' in most devices.

[Sudan Port 1A]

In the device having a touch screen, a method for recognizing a target button of the buttons displayed on the touch screen,

A recognition method using any one of a group including a method for recognizing a target button by a reference finger, a method for recognizing a target button by an open finger, and a method for recognizing a target button by two or more multi-touched fingers.

[Sudan Port 2A]

The method of claim 1A,

And the reference finger is a finger having an n (n> 2) th X coordinate value among the small orders of X coordinate values among the multi-touch fingers.

[Sudan Port 3A]

The method of claim 1A,

And the reference finger is a finger having an n (n> 2) th Y coordinate value among the order in which the Y coordinate value is small among the multi-touch fingers.

[Sudan Port 4A]

The method of claim 2A,

The target button recognition method by the reference finger,

Recognizing method of the touch point of the multi-touch point that has the X coordinate value touched by the reference finger as a target button.

[Sudan Port 5A]

The method of claim 3A,

The target button recognition method by the reference finger,

And a point having a Y coordinate value touched by the reference finger among the multi-touch points.

[Sudan Port 6A]

The method of claim 1A,

The target button recognition method by the open fingers,

A method for recognizing a target button by a first open finger, a method for recognizing a target button by a second open finger, a method for recognizing a target button by a third open finger, a method for recognizing a target button by a fourth open finger and a fifth open finger Recognizing method using at least one method of the group including the target button recognition method.

[Sudan Port 7A]

The method of claim 6A,

The target button recognition method by the first open finger,

A button comprising a new X coordinate corresponding to the average value of the X coordinates of the touched points of the multi-touched fingers and a new Y coordinate corresponding to the average value of the Y coordinates of the touched points to the target button. Recognition method, characterized in that the recognition.

Sudan Port 8A

The method of claim 6A,

The target button recognition method by the second open finger,

A new X coordinate corresponding to the average value of the X coordinates of the touched points of the multi-touched fingers and a Y coordinate paired with the X coordinate of a specific order of the X coordinate value size order of the touched points. Recognizing a touch button comprising a recognition button characterized in that the target button.

Sudan Port 9A

The method of claim 6A,

The target button recognition method by the third open finger,

The touch button includes a new X coordinate corresponding to the average value of the X coordinates of the touched points of the multi-touched fingers and a point consisting of the Y coordinates in a specific order among the Y coordinate value sizes of the touched points of the multi-touched fingers. Recognition method characterized in that the recognition with a button.

Sudan Port 10A

The method of claim 6A,

The target button recognition method by the fourth open finger,

The new Y coordinate corresponding to the average value of the Y coordinates of the touched points of the multi-touched fingers and the X coordinate paired with the Y coordinates in a specific order of the Y coordinate value size order of the touched points. Recognizing a touch button comprising a recognition button characterized in that the target button.

Sudan Port 11A

The method of claim 6A,

The target button recognition method by the fifth open finger,

The touch button includes a new Y coordinate corresponding to an average value of the Y coordinates of the touched points of the multi-touched fingers and a point consisting of the X coordinates in a specific order among the X coordinate value sizes of the touched points of the multi-touched fingers. Recognition method characterized in that the recognition with a button.

[Sudan Port 12A]

The method of claim 1A,

The target button recognition method by the two or more multi-touch fingers,

A recognition method comprising recognizing a range including two or more touch points as a target button.

[Sudan Port 13A]

The method of claim 1A,

The multi-touch is n multi-touch (n is a natural number), multi-all touch, multi-not all touch, multi-not all reference finger touch, multi-not all-not finger reference, multi-not all reference finger change touch, multi by open fingers Touch, n multi-touch with open fingers, multi-all touch with open fingers, multi-notle all-touch with open fingers, multi-notch all-reference finger touch with open fingers, and multi-not-all-notch reference finger touch with open fingers Recognition method, characterized in that any one of the group containing.

[Sudan Port 1B]

Displaying buttons with a plurality of characters assigned to the touch screen in a device having a touch screen;

If a target button of the buttons is operated after a single touch, inputting a first character of a plurality of characters assigned to the target button; And

Inputting other characters except for the first character among a plurality of characters assigned to the target button when the target button is operated after the multi-touch.

[Sudan Port 2B]

The method of claim 1B, wherein

Input processing other than the first character,

If the target button is operated after two-multi touch, inputting a second character among a plurality of characters assigned to the target button;

If the target button is operated after 3-multi touch, inputting a third character among a plurality of characters assigned to the target button; And

And if the target button is operated after 4-multi touch, inputting a fourth character among a plurality of characters assigned to the specific button.

[Sudan Port 3B]

The method of claim 2B,

The operation after the multi-touch is multi on and off, and the characters assigned to the target button are displayed in a circular manner according to the number of times the multi on and off is continuously performed one or more times.

[Sudan Port 4B]

The method of claim 2B,

After the multi-touch operation is a multi-tap,

The target button is assigned a plurality of character groups consisting of at least one or more characters, and after the specific character group is selected by the multi-touch, at least one character included in the specific character group is input by the multi-tap; Character input method characterized in that it further comprises.

[Sudan Port 5B]

The method of claim 4B,

The character group is a character group consisting of at least one character group that is classified into different series in the spelling notation for the same character, a character group consisting of special characters, and a character group consisting of at least one character assigned to be sequentially input to a button. And a group including a character group consisting of at least one character assigned to be displayed at a specific position of the button.

[Sudan Port 6B]

The method of claim 5B,

A letter group consisting of at least one letter classified into different series in the spelling of the same letter is a letter group consisting of uppercase letters, a letter group consisting of lowercase letters, and a letter group consisting of hiragana. And a character group including a character group consisting of katakana.

[Sudan Port 7B]

The method of claim 6B,

The specific character group,

If the character mode of the target button is a capital letter mode of the English letter, the character group consisting of lowercase letters, if the character mode of the target button is a letter group of letter case, the lowercase mode of the English letter,

And a character group consisting of katakana if the character mode of the target button is a hiragana character mode of one character, and a character group consisting of hiragana if the character mode of the target button is a katakana character mode of one character.

Sudan Port 8B

The method of claim 1B, wherein

The target button is determined by any one of a group including a target button recognition method by a reference finger, a target button recognition method by an open touch point, and a target button recognition method by a range including two or more touch points. Character input method characterized in that.

Sudan Port 9B

The method of claim 8B,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having an n-th coordinate value among multi-touched fingers.

Sudan Port 10B

The method of claim 8B,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having a n-th coordinate value among multi-touched fingers.

Sudan Port 11B

The method of claim 8B,

The method for recognizing a target button by an open finger may include an X coordinate value having a specific order of magnitude among X coordinate values of points touched by multi-touched fingers and a Y coordinate value having a specific order among Y coordinate values. Character input method characterized in that the button is recognized as a target button.

Sudan Port 12B

The method of claim 11B,

The method for recognizing the target button by the open fingers may include a new X coordinate value determined as an average value of X coordinate values of touched points of the multi-touched fingers and an average value of Y coordinate values of points touched by the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of a new Y coordinate value as a target button.

Sudan Port 13B

The method of claim 11B,

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and an X coordinate value size order of the touched points of the multi-touched fingers. And a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

Sudan Port 14B

The method of claim 11B,

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and a Y order of magnitude values of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the Y coordinate as the target button.

Sudan Port 15B

The method of claim 11B,

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and a Y order value of the touched points of the multi-touched fingers. And a button including a point consisting of a X coordinate paired with a Y coordinate as a target button.

Sudan Port 16B

The method of claim 11B,

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and an X coordinate value of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the X coordinate as a target button.

Sudan Port 17B

The method of claim 8B,

The target button recognition method by the two or more multi-touch fingers,

A method comprising recognizing a range including two or more touch points as a target button.

Sudan Port 18B

The method of claim 1B, wherein

The character includes at least one of a group including Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Korean, English mode, world language characters including Japanese, numbers and special characters. Character input method characterized in that.

[Sudan Port 1C]

Displaying buttons having a plurality of characters assigned to the touch screen, respectively, in a device having a touch screen;

If a target button of the buttons is manipulated after a single touch, inputting any one of a plurality of characters assigned to the target button; And

And inputting another character among a plurality of characters assigned to the target button when the target button is operated after the multi-touch.

[Sudan Port 2C]

According to claim 1C,

And the post-single touch operation is single on and off, and the post-multitouch operation is multi on and off.

[Sudan Port 3C]

The method of claim 2C,

After the multi-touch operation, multi-all on and off, multi-not all-on and off, multi-not all-reference finger on and off, multi-not-all sick reference finger on and off, multi-on and off by the open finger, open finger Any of the groups including multi-all on & off by, multi-nots on & off by open fingers, multi-nots on reference by open fingers and multi-nots on sick by open fingers Character input method characterized in that one.

[Sudan Port 4C]

The method of claim 2C,

The input processing of the character may further include input processing of another character among a plurality of characters assigned to the target button through dragging after single touch or dragging after multitouch, respectively. Character input method.

[Sudan Port 5C]

According to claim 4C,

The multi-touch drag, multi-drag, multi-all drag, multi-not-all-drag, multi-not-all-based finger drag, multi-not-all-sick reference finger drag, multi-drag by open fingers, multi-all drag by open fingers, open A character input method comprising any one of a group including a multi-notch all-reference finger drag by a finger, a multi-notchall-based finger drag by an open finger, and a multi-notch-all-notch finger drag by an open finger.

[Sudan Port 6C]

The method of claim 5C,

The drag direction may include at least one of a group including up, down, left, right, top left, bottom left, top right and bottom right.

[Sudan Port 7C]

According to claim 6C,

In the input processing of the character, different characters are input according to the direction of the drag.

Sudan Port 8C

According to claim 1C,

The target button is determined by any one of a group including a target button recognition method by a reference finger, a target button recognition method by an open touch point, and a target button recognition method by a range including two or more touch points. Character input method characterized in that.

Sudan Port 9C

The method of claim 8C,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having an n-th coordinate value among multi-touched fingers.

[Sudan Port 10C]

The method of claim 8C,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having a n-th coordinate value among multi-touched fingers.

Sudan Port 11C

The method of claim 8C,

The method for recognizing a target button by an open finger may include an X coordinate value having a specific order of magnitude among X coordinate values of points touched by multi-touched fingers and a Y coordinate value having a specific order among Y coordinate values. Character input method characterized in that the button is recognized as a target button.

[Sudan Port 12C]

The compound of claim 11C, wherein

The method for recognizing the target button by the open fingers may include a new X coordinate value determined as an average value of X coordinate values of touched points of the multi-touched fingers and an average value of Y coordinate values of points touched by the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of a new Y coordinate value as a target button.

Sudan Port 13C

The compound of claim 11C, wherein

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and an X coordinate value size order of the touched points of the multi-touched fingers. And a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

Sudan Port 14C

The compound of claim 11C, wherein

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and a Y order of magnitude values of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the Y coordinate as the target button.

[Sudan Port 15C]

The compound of claim 11C, wherein

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and a Y order value of the touched points of the multi-touched fingers. And a button including a point consisting of a X coordinate paired with a Y coordinate as a target button.

[Sudan Port 16C]

The compound of claim 11C, wherein

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and an X coordinate value of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the X coordinate as a target button.

[Sudan Port 17C]

The method of claim 8C,

The target button recognition method by the two or more multi-touch fingers,

A character input method comprising recognizing a range including two or more touch points as a target button.

[Sudan Port 18C]

According to claim 1C,

The multi-touch, n multi-touch, multi-all touch, multi-not all-touch, multi-not all reference finger touch, multi-not-all-not finger reference finger touch, multi-not-all reference finger fluctuation touch, n multi-touch by open fingers, open A multi-all touch by a finger, a multi-not all-touch by an open finger, a multi-not-all-reference finger touch by an open finger, and a multi-not-all-not-reference finger touch by an open finger Character input method.

[Sudan Port 19C]

According to claim 1C,

The character includes at least one of a group including Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Korean, English mode, world language characters including Japanese, numbers and special characters. Character input method characterized in that.

[Sudan Port 1D]

Recognizing a target button among buttons assigned with a plurality of characters displayed on the touch screen in a device having a touch screen; And

And determining a text mode according to a post-touch operation on the target button.

[Sudan Port 2D]

The method of claim 1D,

The determining step, characterized in that the character input method characterized in that the different character mode is determined according to the type of the touch on the target button.

[Sudan Port 3D]

The method of claim 2D,

In the determining step, if the operation after the single touch on the target button is input to the first character mode, and if the operation after the multi-touch on the target button is input to the second character mode Way.

[Sudan Port 4D]

The method of claim 1D,

The determining step may further include the step of inputting a character in a character mode different from the character mode of the character assigned to the target button according to the operation type after the touch on the target button.

[Sudan Port 5D]

The method of claim 1D,

And after the touch on the target button, inputting a character of another character mode together with the character assigned to the target button according to an operation type.

[Sudan Port 6D]

The method of claim 1D,

The character mode is any one of a group including Greek Roman mode, Cyrillic mode, Indian character mode, Arabic character mode, Thai character mode, Vietnamese character mode, English character mode, Korean character mode, Japanese character mode, and special character mode. Character input method characterized by the above-mentioned.

[Sudan Port 7D]

The method of claim 6D,

The character mode includes an uppercase letter mode and a lowercase mode for an English letter mode, and a hiragana letter mode and a katakana letter mode for a single letter mode.

[Sudan Port 8D]

The method of claim 1D,

The touch is a character input method, characterized in that the single touch or multi-touch.

Sudan Port 9D

The method of claim 8D,

The multi-touch is a character input method, characterized in that the touch using two or more fingers.

Sudan Port 10D

The method of claim 8D,

The multi-touch, n multi-touch, multi-all touch, multi-not all-touch, multi-not all reference finger touch, multi-not-all-not finger reference finger touch, multi-not-all reference finger fluctuation touch, n multi-touch by open fingers, open A character comprising any one of a group comprising a multi-all touch by a finger, a multi-not-all touch by an open finger, a multi-not-all-reference finger touch by an open finger and a multi-not-all-not finger reference finger by an open finger Input method.

Sudan Port 11D

The method of claim 10D,

The multi-touch is multi on and off, multi all on and off, multi sickle all on and off, multi sickle reference finger on and off, multi sickle and sickle reference finger on and off, multi fingers on and off by the open fingers, Groups including multi-all on and off by open fingers, multi-nots on and off by open fingers, multi-nots by standard on open fingers and multi-nots by sick on open fingers Character input method, characterized in that any one of.

[Sudan Port 12D]

The method of claim 8D,

The target button is determined by any one of a group including a target button recognition method by a reference finger, a target button recognition method by an open touch point, and a target button recognition method by a range including two or more touch points. Character input method characterized in that.

Sudan Port 13D

The method of claim 12D,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having an n-th coordinate value among multi-touched fingers.

Sudan Port 14D

The method of claim 12D,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having a n-th coordinate value among multi-touched fingers.

[Sudan Port 15D]

The method of claim 12D,

The method for recognizing a target button by an open finger may include an X coordinate value having a specific order of magnitude among X coordinate values of points touched by multi-touched fingers and a Y coordinate value having a specific order among Y coordinate values. Character input method characterized in that the button is recognized as a target button.

[Sudan Port 16D]

The method of claim 15D,

The method for recognizing the target button by the open fingers may include a new X coordinate value determined as an average value of X coordinate values of touched points of the multi-touched fingers and an average value of Y coordinate values of points touched by the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of a new Y coordinate value as a target button.

[Sudan Port 17D]

The method of claim 15D,

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and an X coordinate value size order of the touched points of the multi-touched fingers. And a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

[Sudan Port 18D]

The method of claim 15D,

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and a Y order of magnitude values of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the Y coordinate as the target button.

Sudan Port 19D

The method of claim 15D,

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and a Y order value of the touched points of the multi-touched fingers. And a button including a point consisting of a X coordinate paired with a Y coordinate as a target button.

Sudan Port 20D

The method of claim 15D,

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and an X coordinate value of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the X coordinate as a target button.

Sudan Port 21D

The method of claim 12D,

The target button recognition method by the two or more multi-touch fingers,

A character input method comprising recognizing a range including two or more touch points as a target button.

[Sudan Port 1E]

Recognizing a target button among buttons assigned with a plurality of characters displayed on the touch screen in a device having a touch screen; And

And inputting and processing the first character assigned to the recognized target button and the second character matched according to the type of operation after touching the target button.

[Sudan Port 2E]

The method of claim 1E,

The target button is determined by a single touch,

And the second character is determined by an operation after single touch.

[Sudan Port 3E]

The method of claim 2E,

And the single touch operation is dragging after single touch.

[Sudan Port 4E]

The method of claim 3E,

The direction of dragging is at least one of a group including up, down, left, right, top left, bottom left, top right and bottom right.

[Sudan Port 5E]

The method of claim 1E,

The target button is determined by the multi-touch,

And the second character is determined by an operation after multi-touch.

[Sudan Port 6E]

The method of claim 5E,

And the post-multi-touch operation is dragging after multi-touch.

[Sudan Port 7E]

The method of claim 6E,

The direction of dragging is at least one of a group including up, down, left, right, top left, bottom left, top right and bottom right.

[Sudan Port 8E]

The method of claim 1E,

The second character is determined by an operation after a touch, and different characters are determined according to the type of the touch.

[Sudan Port 9E]

The method of claim 8E,

The type of touch may include a single touch and a multi-touch.

Sudan Port 10E

The method of claim 9E,

And the multi-touch uses at least two fingers.

Sudan Port 11E

The method of claim 1E,

The target button may be determined by any one of a group including a target button recognition method using a reference finger, a target button recognition method using an open touch point, and a target button recognition method based on a range including two or more touch points. Character input method characterized in that.

[Sudan Port 12E]

The method of claim 11E,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having an n-th coordinate value among multi-touched fingers.

[Sudan Port 13E]

The method of claim 11E,

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button touched by a finger having a n-th coordinate value among multi-touched fingers.

Sudan Port 14E

The method of claim 11E,

The method for recognizing a target button by an open finger may include an X coordinate value having a specific order of magnitude among X coordinate values of points touched by multi-touched fingers and a Y coordinate value having a specific order among Y coordinate values. Character input method characterized in that the button is recognized as a target button.

[Sudan Port 15E]

The method of claim 14E,

The method for recognizing the target button by the open fingers may include a new X coordinate value determined as an average value of X coordinate values of touched points of the multi-touched fingers and an average value of Y coordinate values of points touched by the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of a new Y coordinate value as a target button.

[Sudan Port 16E]

The method of claim 14E,

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and an X coordinate value size order of the touched points of the multi-touched fingers. And a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

[Sudan Port 17E]

The method of claim 14E,

The method for recognizing the target button by the open fingers may include a new order of X coordinates determined as an average value of X coordinate values of the touched points of the multi-touched fingers and a Y order of magnitude values of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the Y coordinate as the target button.

[Sudan Port 18E]

The method of claim 14E,

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and a Y order value of the touched points of the multi-touched fingers. And a button including a point consisting of a X coordinate paired with a Y coordinate as a target button.

Sudan Port 19E

The method of claim 14E,

The method for recognizing the target button by the open fingers may include a new Y coordinate determined by an average value of the Y coordinate values of the touched points of the multi-touched fingers and an X coordinate value of the touched points of the multi-touched fingers. Character input method comprising recognizing a button including a point consisting of the X coordinate as a target button.

[Sudan Port 20E]

The method of claim 11E,

The target button recognition method by the two or more multi-touch fingers,

A character input method comprising recognizing a range including two or more touch points as a target button.

Sudan Port 21E

The method of claim 1E,

The first character is any one of a group including language characters, numbers and special characters, and the second character is any one of a group including language characters, numbers and special characters.

[Sudan Port 22E]

The method of claim 21E,

The first letter is a consonant,

The second character is any one of a group including a vowel, a half vowel, a half consonant and a consonant.

Sudan Port 23E

The method of claim 22E,

The first letter is a consonant,

The second character is 'ㅏ', 'ㅓ', 'ㅗ', 'TT', 'ㅑ', 'ㅕ', 'ㅛ', 'ㅠ', 'ㅡ', 'ㅣ', 'ㅢ', At least one of the letters corresponding to the pronunciation of 'ㅐ', 'ㅔ', 'ㅒ', 'ㅖ', 'ㅚ', 'ㅘ', 'ㅙ', 'ㅟ', 'ㅝ' and 'ㅞ' Character input method characterized in that.

Sudan Port 24E

The method of claim 22E,

The second character is a character input method, characterized in that at least one of the letters corresponding to the pronunciation of 'ㅏ', 'ㅔ', 'ㅣ', 'ㅗ' and 'TT'.

Sudan Port 25E

The method of claim 21E,

The first letter is an English letter,

And the second character is at least one of a group including 'A', 'E', 'I', 'O', and 'U'.

Sudan Port 26E

The method of claim 21E,

The first letter is an English letter,

The second character is at least one of a group including 'T', 'S', 'N', 'R', 'H', 'D', 'L' and 'C'. Way.

Sudan Port 27E

The method of claim 21E,

The first letter is an English letter,

And wherein the second letter is 'W' or 'Y'.

Sudan Port 28E

The method of claim 1E,

The target button is determined by the touch,

When the target button is touched and dragged for a predetermined time or more, the step of inputting two characters together with the two characters together with the first character; Character input method further comprising.

[Sudan Port 29E]

The method of claim 1E,

The target button is determined by the touch,

When the target button is dragged two or more times after the touch or the drag direction is changed, when the drag button is dragged two or more times together with the first letter or when the drag direction is changed, two letters are input together with the first letter; Character input method characterized in that it further comprises.

Sudan Port 30E

The method of claim 28E or 29E,

The two characters are at least one of ING and ED.

[Sudan Port 31E]

The method of claim 1E,

The character includes at least one of a group including Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Korean, English mode, world language characters including Japanese, numbers and special characters. Character input method characterized in that.

[Sudan Port 1F]

Recognizing a target button by a touch of a plurality of buttons assigned with at least one character group displayed on the touch screen in a device having a touch screen;

Selecting a specific character group assigned to a target button according to the touch; And

And inputting at least one character included in the specific character group according to the manipulation after the touch.

[Sudan Port 2F]

According to claim 1F,

The selection of the specific character group is made before the final operation,

The touch is a character input method, characterized in that the single touch or multi-touch.

[Sudan Port 3F]

The method of claim 2F,

And the operation and the final operation are off or dragging.

[Sudan Port 4F]

According to claim 3F,

The drag direction is a character input method, characterized in that the direction of any one of the group including the upper side, lower side, left side, right side, upper left side, lower left side, upper right side and lower right side.

[Sudan Port 5F]

The method of claim 2F,

The multi-touch is based on n multi-touch (n> 1), multi-all touch, multi-not all-touch, multi-not all-reference finger touch, multi-not-all-not finger reference finger, multi-not-all reference finger floating touch, open finger n Any one of the groups including multi-touch, multi-all touch with open fingers, multi-not all-touch with open fingers, multi-not all-reference finger touch with open fingers, and multi-not-all-not finger reference finger with open fingers Character input method including being.

[Sudan Port 6F]

The method according to claim 5F,

After the multi-touch operation, multi on & off, multi all on & off, multi notch on and off, multi notch all reference finger on & off, multi notch all sick reference finger on & off, multi drag, multi all drag , Multi-Nick All Drag, Multi-Nick All Standard Finger Drag, Multi-Nick All Scythe Standard Finger Drag, Multi-tap, Multi-On & Off by Open Finger, Multi-All On & Off by Open Finger, Multi-Nick All by Open Finger On and off, multi-notch by reference with open fingers Finger on / off, multi-not by reference with open fingers On-off finger and on-off reference by multi-nots, multi-drag by open fingers, multi-all drag by open fingers, by open fingers Multi Sickle All Drag, Multi Scythe by Standard Finger Drag, Multi Sickle All Scythe by Finger, Drag, and Multi Muller by Wide Finger Text input method according to claim any one of a group that includes the tab.

[Sudan Port 7F]

According to claim 1F,

The character group is a character group consisting of at least one character group that is classified into different series in the spelling notation for the same character, a character group consisting of special characters, and a character group consisting of at least one character assigned to be sequentially input to a button. And a group including a character group consisting of at least one character assigned to be displayed at a specific position of the button.

[Sudan Port 8F]

The method of claim 7F,

A letter group consisting of at least one letter classified into different series in the spelling of the same letter is a letter group consisting of uppercase letters, a letter group consisting of lowercase letters, and a letter group consisting of hiragana. And a character group including a character group consisting of katakana.

[Sudan Port 9F]

The method according to claim 8F,

The specific character group,

If the character mode of the target button is a capital letter mode of the English letter, the character group consisting of lowercase letters, if the character mode of the target button is a letter group of letter case, the lowercase mode of the English letter,

And a character group consisting of katakana if the character mode of the target button is a hiragana character mode of one character, and a character group consisting of hiragana if the character mode of the target button is a katakana character mode of one character.

[Sudan Port 10F]

According to claim 1F,

The character is any one of a group including Greek, Roman, English, Cyrillic, Indian, Arabic, Thai, Vietnamese, Korean, Japanese, Japanese, Japanese and Korean. Character input method.

[Sudan Port 11F]

According to claim 1F,

The detecting of the target button may include any one of a group including a target button recognition method by a reference finger, a target button recognition method by a spread finger, and a target button recognition method by a range including two or more touch points. Character input method characterized in that.

[Sudan Port 12F]

The compound according to claim 11F, wherein

The method of recognizing a target button by the reference finger may include recognizing, as a target button, a button including a touch point corresponding to the nth finger of an X coordinate value sequence of multi-touched fingers.

[Sudan Port 13F]

The compound according to claim 11F, wherein

The method for recognizing a target button by the reference finger may include recognizing, as a target button, a button including a touch point corresponding to the nth finger of the Y coordinate value order of the multi-touched fingers.

[Sudan Port 14F]

The compound according to claim 11F, wherein

The method for recognizing a target button by the open fingers includes an X coordinate value having a specific order of X coordinate values among points touched by multi-touched fingers, and a Y coordinate value having a specific order of Y coordinate values. Character input method characterized in that the button to recognize the target button.

[Sudan Port 15F]

The method of claim 14F, wherein

The target button is a point consisting of a new X coordinate value determined as an average value of X coordinate values of points at which the multi-touched fingers are touched and a new Y coordinate value determined as an average value of Y coordinate values of the points at which the multi-touched fingers are touched. Character input method characterized in that the button comprising a.

[Sudan Port 16F]

The method of claim 14F, wherein

The target button is paired with a new X coordinate value determined as an average value of X coordinate values of the touched points of the multi-touched fingers and an X coordinate value of a specific order among the X coordinate value sizes of the touched points of the multi-touched fingers. Character input method comprising a button comprising a point consisting of the Y coordinate value.

[Sudan Port 17F]

The method of claim 14F, wherein

The target button is a point consisting of a new X coordinate value determined as an average value of X coordinate values of the points at which the multi-touched fingers are touched and a Y coordinate value in a specific order of the Y coordinate value order of the points at which the multi-touched fingers are touched. Character input method characterized in that the button comprising a.

[Sudan Port 18F]

The method of claim 14F, wherein

The target button is paired with a Y coordinate value in a specific order of the new Y coordinate value determined as the average value of the Y coordinate values of the touched points of the multi-touched fingers and the Y coordinate value size order of the touched points of the multi-touched fingers. Character input method comprising a button comprising a point consisting of the X coordinate value.

[Sudan Port 19F]

The method of claim 13F,

The target button is a point consisting of a new Y coordinate value determined as an average value of the Y coordinate values of the points at which the multi-touched fingers are touched, and an X coordinate value in a specific order among the X coordinate value orders of the points at which the multi-touched fingers are touched. Character input method characterized in that the button comprising a.

[Sudan Port 1G]

Recognizing a target object through a touch among objects displayed on the touch screen in a device having a touch screen; And

And deforming the target object according to the post-touch manipulation.

[Sudan Port 2G]

The method of claim 1G,

Recognition of the target object,

And a group including a target object recognition method using a reference finger, a target object recognition method using an open finger, and a target object recognition method using a range including two or more touch points.

[Sudan Port 3G]

The method of claim 2G,

In the method for recognizing the target object by the reference finger, an object including a touch point by the reference finger corresponding to a coordinate value according to a specific order of an X coordinate value or a Y coordinate value is recognized as a target object. Way.

[Sudan Port 4G]

The method of claim 3G,

In the method of recognizing the target object by the reference finger, an object including a touch point having the first X coordinate value among the small order of the X coordinate values among the multi-touch touch points when the multi-touch is used as the target object. Object deformation method characterized in that it is recognized.

[Sudan Port 5G]

The method of claim 4G,

In the method of recognizing the target object by the reference finger, an object including a touch point having a second X coordinate value among the small order of the X coordinate values among the multi-touch touch points when the multi-touch is used as the target object. Object deformation method characterized in that it is recognized.

[Sudan Port 6G]

The method of claim 3G,

In the method of recognizing the target object by the reference finger, an object including a touch point having the first Y coordinate value among the small orders of the Y coordinate value among the multi-touch touch points when the multi-touch is used as the target object. Object deformation method characterized in that it is recognized.

[Sudan Port 7G]

The method of claim 6G,

In the method of recognizing the target object by the reference finger, an object including a touch point having a second Y-coordinate value among small orders of the Y-coordinate value among the multi-touched touch points is recognized as the target object when 3-multi-touched. Object deformation method characterized in that.

Sudan Port 8G

The method of claim 2G,

The target object recognition method using the open touch point is determined as a new X coordinate value determined as an average value of X coordinate values of touched points of the multi-touched fingers and an average value of Y coordinate values of touched points of the multi-touched fingers. And an object including a point formed of a new Y coordinate value to be recognized as the target object.

[Sudan Port 9G]

The method of claim 2G,

The target object recognition method using the open touch point may include a new X coordinate value determined as an average value of X coordinate values of the touched points of the multi-touched fingers and an X coordinate value size order of the touched points of the multi-touched fingers. And an object including a point composed of a Y coordinate value paired with an X coordinate value of a sequence as the target object.

[Sudan Port 10G]

The method of claim 2G,

The target object recognition method using the open touch point may include a new X coordinate value determined as an average value of the X coordinate values of the touched points of the multi-touched fingers and a Y coordinate value size order of the touched points of the multi-touched fingers. An object transformation method comprising recognizing an object including a point consisting of a Y coordinate value of a sequence as a target object.

Sudan Port 11G

The method of claim 2G,

The target object recognition method according to the open touch point includes a new Y coordinate value determined as an average value of the Y coordinate values of the touched points of the multi-touched fingers and a Y coordinate value size order of the touched points of the multi-touched fingers. A method of transforming an object, comprising: recognizing, as a target object, an object including a point consisting of X coordinate values paired with Y coordinate values in a specific order.

[Sudan Port 12G]

The method of claim 2G,

The target object recognition method according to the open touch point includes a new Y coordinate value determined as an average value of the Y coordinate values of the touched points of the multi-touched fingers and an X coordinate value size order of the touched points of the multi-touched fingers. An object transformation method comprising recognizing an object including a point consisting of X coordinate values in a specific order as a target object.

[Sudan Port 13G]

The method of claim 1G,

The post-touch operation is drag after multi-touch, and the target object is enlarged or reduced by dragging after the multi-touch,

The drag direction is any one of the group including the upper, lower, left, right, left upper side, left and right, upper right side and lower right side.

Sudan Port 14G

The method of claim 13G,

The deformation of the target object may include a smallest Y coordinate of the target object when the reference finger is dragged upwards after touching the point including a Y coordinate value that is greater than or equal to an average value of the Y coordinate values of the target object in the case of 2-multi touch. A method of transforming an object, wherein a value is moved to a point where the largest Y coordinate value becomes larger without change.

[Sudan Port 15G]

The method of claim 13G,

The deformation of the target object is, in the case of 2-multi touch, if the reference finger is dragged downward after touching the point including the Y coordinate less than the average value of the Y coordinate values of the target object, the largest Y coordinate of the target object. A method of transforming an object, wherein a value is moved to a point where the smallest Y coordinate value becomes smaller without change.

[Sudan Port 16G]

The method of claim 13G,

The deformation of the target object is, in the case of 2-multi touch, when the reference finger is dragged to the right direction after touching the point including the X coordinate of the average value of the X coordinate values of the target object, the smallest X of the X coordinate values The method of transforming an object, wherein the largest X coordinate value is increased without changing the coordinate value.

[Sudan Port 17G]

The method of claim 13G,

The deformation of the target object is, in the case of 2-multi touch, when the reference finger is dragged to the left after touching the point including the X coordinate or more than the average value of the X coordinate values of the target object, the smallest X of the X coordinate values The method of transforming an object, characterized in that the largest X coordinate value is reduced without changing the coordinate value.

[Sudan Port 18G]

The method of claim 13G,

The deformation of the target object is, in the case of 2-multi touch, when the reference finger is dragged to the left after touching the point including the X coordinate less than the average value of the X coordinate values of the target object, the largest of the X coordinate values. A method of transforming an object, wherein the X coordinate value is shifted to a point where the smallest X coordinate value becomes small without change.

[Sudan Port 19G]

The method of claim 13G,

In the deformation of the target object, in the case of 2-multi touch, the reference finger touches a point including an X coordinate value that is greater than or equal to the average value of the X coordinate values of the target object and a Y coordinate value that is greater than or equal to the average value of the Y coordinate values. When dragged, the smallest X and Y coordinate values of the target object are moved without change, and the largest X and Y coordinate values are shifted to the upper right side so that the horizontal and vertical lengths are enlarged at the same ratio.

[Sudan Port 20G]

The method of claim 13G,

The deformation of the target object is, in the case of 2-multi touch, the upper right side after the reference finger touches a point including an X coordinate value less than the average value of the X coordinate values of the target object and a Y coordinate value less than the average value of the Y coordinate values. When dragging in the direction, the largest X coordinate value and Y coordinate value of the target object are transformed without changing the smallest X coordinate value and Y coordinate value to the upper right side so that the horizontal and vertical lengths are reduced in the same ratio. Way.

[Sudan Port 21G]

The method of claim 13G,

In the deformation of the target object, in the case of 2-multi touch, the reference finger touches a point including an X coordinate value of more than the average value of the X coordinate values of the target object and a Y coordinate value of more than the average value of the Y coordinate values in the lower left direction. When dragged, the smallest X coordinate value and Y coordinate value of the target object are moved without changing the largest X coordinate value and Y coordinate value to the lower left side, and the object deformation method characterized in that the horizontal and vertical length is reduced to the same ratio.

[Sudan Port 22G]

The method of claim 13G,

In the deformation of the target object, in the case of 2-multi touch, the reference finger touches a point including an X coordinate value less than the average value of the X coordinate values of the target object and a Y value less than the average value of the Y coordinate values. When dragged to the object, the largest X coordinate value and Y coordinate value of the target object is changed without the smallest X coordinate value and Y coordinate value is moved to the lower left side, the object deformation method characterized in that the horizontal and vertical length is enlarged at the same ratio .

[Sudan Port 23G]

The method of claim 13G,

In the deformation of the target object, in the case of 2-multi touch, the reference finger touches a point including an X coordinate value greater than the average value of the X coordinate values of the target object and a Y coordinate value less than the average value of the Y coordinate values. When dragged to, the smallest X coordinate value and the largest Y coordinate value of the target object are moved without changing the largest X coordinate value and the smallest Y coordinate value to the lower right side, and the horizontal and vertical lengths are enlarged at the same ratio. How to transform objects.

[Sudan Port 24G]

The method of claim 13G,

In the deformation of the target object, in the case of 2-multi touch, the reference finger touches a point including an X coordinate value that is less than the average value of the X coordinate values of the target object and a Y coordinate value that is greater than the average value of the Y coordinate values. When dragged to, the largest X coordinate value and the smallest Y coordinate value of the target object are moved without changing the smallest X coordinate value and the largest Y coordinate value to the lower right side, and the horizontal and vertical lengths are reduced in the same ratio. How to transform objects.

[Sudan Port 25G]

The method of claim 13G,

In the deformation of the target object, in the case of 2-multi touch, the reference finger touches a point including an X coordinate value that is greater than or equal to the average value of the X coordinate values of the target object and less than the average value of the Y coordinate values. When dragged to, the smallest X coordinate value and the largest Y coordinate value of the target object are moved to the upper left side without changing the largest X coordinate value and the smallest Y coordinate value, so that the horizontal and vertical lengths are reduced in the same ratio. How to transform objects.

Sudan Port 26G

The method of claim 13G,

In the deformation of the target object, in the case of 2-multi touch, the reference finger touches a point including an X coordinate value less than the average value of the X coordinate values of the target object and a Y coordinate value that is greater than the average value of the Y coordinate values. When dragged to, the largest X coordinate value and the smallest Y coordinate value of the target object are moved without changing the smallest X coordinate value and the largest Y coordinate value to the upper left side, and the horizontal and vertical lengths are enlarged at the same ratio. How to transform objects.

[Sudan Port 27G]

The method of claim 13G,

And at least one of a horizontal length and a vertical length is deformed when the target object is enlarged or reduced.

[Sudan Port 28G]

The method of claim 27G,

The object deformation method of the object, characterized in that the ratio of the horizontal length and the vertical length is maintained when zooming in or out.

[Sudan Port 29G]

The method of claim 28G,

When dragging in the right direction, the width is enlarged; when dragging in the left direction, the width is reduced,

When dragged upwards, the vertical length is enlarged; when dragged downwards, the vertical length is reduced,

When dragged in the upper left or upper right direction, the width and length are enlarged at the same ratio,

When dragging in the lower left or lower right direction, the object deformation method characterized in that the reduction in the same ratio as the horizontal length and vertical length.

[Sudan Port 30G]

The method of claim 27G,

The object deformation method of the object, characterized in that the ratio of the horizontal length and the vertical length is different when enlarged or reduced.

[Sudan Port 31G]

The method of claim 30G,

When dragging in the right direction, the width is enlarged; when dragging in the left direction, the width is reduced,

When dragged upwards, the vertical length is enlarged; when dragged downwards, the vertical length is reduced,

When dragging in the upper left or right upper direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently according to which direction of the upper left range or the upper right range,

When dragging in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently according to which direction of the lower left range or the lower right range.

[Sudan Port 32G]

The method of claim 13G,

And the target object is reduced if the drag direction is close to the center of the target object, and is enlarged if it is away from the target object.

[Sudan Port 33G]

The method of claim 32G,

When the drag direction is one of a group including up, down, left and right, the target object is

If the drag direction is closer to the center of the target object, the length of two sides parallel to the drag direction is reduced, and the length of the two vertical sides is unchanged.

If the drag direction is a direction away from the center of the target object, the length of the two sides parallel to the drag direction is enlarged, the length of the two vertical sides is unchanged, characterized in that the change.

[Sudan Port 34G]

The method of claim 32G,

When the drag direction is one of a group including an upper right side, a lower right side, an upper left side, and a lower left side direction, the target object may include:

If the drag direction is a direction closer to the center of the target object, the length of both the horizontal and vertical sides is reduced,

If the drag direction is a direction away from the center of the target object, object length, characterized in that both the length of the horizontal side and the vertical side is enlarged.

[Sudan Port 35G]

The method of claim 32G,

When the drag direction is one of a group including an upper right side, a lower right side, an upper left side, and a lower left side direction, the target object may include:

If the drag direction is closer to the center of the target object, the center of the object moves in the determined drag direction, and the position of the side perpendicular to the determined drag direction among the three sides surrounding the recognized target range is moved for reduction. The position of the opposite side of the side does not change,

If the drag direction is a direction away from the center of the target object, the center of the object is moved in the determined drag direction, and the position of the side perpendicular to the determined drag direction among the three sides surrounding the recognized target range is moved for enlargement. And the position of the opposite side of the side does not change.

[Sudan Port 36G]

The method of claim 32G,

When the drag direction is one of a group including an upper right side, a lower right side, an upper left side, and a lower left side direction, the target object may include:

If the drag direction is closer to the center of the target object, the center of the object moves in the determined drag direction, and among the vertices in the recognized target range, the vertex closest to the straight line parallel to the drag direction is moved for reduction. , The position of the vertex facing the vertex does not change,

If the drag direction is a direction away from the center of the target object, while the center of the object is moved in the determined drag direction, the vertex closest to the straight line parallel to the drag direction among the vertices in the recognized target range is moved for enlargement, A method of transforming an object, characterized in that the position of the opposite vertex of the vertex does not change.

[Sudan Port 37G]

The method according to any one of claims 3G to 13G,

The multi-touch, n multi-touch, multi-all touch, multi-not all-touch, multi-not all reference finger touch, multi-not-all-not finger reference finger touch, multi-not-all reference finger fluctuation touch, n multi-touch by open fingers, open A multi-all touch by a finger, a multi-not all-touch by an open finger, a multi-not-all-reference finger touch by an open finger, and a multi-not-all-not-reference finger touch by an open finger How to transform an object.

[Sudan Port 1H]

In a method for inputting a character in a device having a touch screen,

When two or more touch points are touched within a certain time, that is, when they are touched substantially simultaneously,

Recognizing, by the device, as a target button or target object a virtual button or object including a point calculated by a function in which two or more touch points are variables;

And a step of performing a task including letter input or function display or object change related to the target button or the target object according to the change of the touch state.

[Sudan Port 2H]

The method according to claim 1H,

And a point calculated by a function in which two or more touch points become a variable is any one of the touch points touched.

[Sudan Port 3H]

The compound of claim 2H,

3. The method of claim 2,

Coordinates with a specific sequence number of the x coordinates (order) of two or more touch points

The point calculated by the function of two or more touch points being a variable is any one of the touch points touched.

[Sudan Port 4H]

The method of claim 3H,

A particular order of the x-coordinate magnitude order of two or more touch points is characterized by being first or last (or largest or smallest).

[Sudan Port 5H]

The compound of claim 2H,

Coordinates in a particular sequence among the y coordinate sizes (order) of two or more touch points

And a point calculated by a function in which two or more touch points become a variable is any one of the touch points touched.

[Sudan Port 6H]

The method of claim 3H,

A particular order of the y-coordinate magnitude order of two or more touch points is characterized by being first or last (or largest or smallest).

When entering a character into the QWERTY keyboard on the touch screen of a conventional smartphone, there is a problem that you need to be careful while typing because the size of the button to which the character is assigned is small or a large number of typos occur.

When entering characters with a 12-keypad keypad on a touch screen of a conventional smartphone, a plurality of characters are assigned to the same button as in the physical 12-keypad of a conventional feature phone. The problem is that you need a lot of strokes. However, to solve the above problems through the present application.

Conventional tablet PC QWERTY keyboard when entering the character is a large size assigned to the character is not a problem such as typo, such as above, but through this application to input two letters by one touch to improve the character input speed do.

As described above, according to the present invention, the buttons appearing on the touch screen may be used to make the user's operation more convenient. In particular, even though the touch points to be multi-touched are not to be touched only inside a specific small touch button, that is, the touch points can be recognized as multi-touched without actually multi-touching the small touch button.

In addition, the character input speed may be improved by allowing specific characters to be input in addition to the character assigned to the target button through various multi-touch manipulation methods.

In addition, various multi-touch controls may be assigned to the currently set text mode, such as characters of other text modes (including special characters), but not in the currently selected text mode. Characters that could not be assigned to the currently selected text mode could only be easily entered in the currently selected text mode without changing the text mode, although they could not be assigned to the currently selected text mode. A character assigned to a mode may be interpreted as being additionally assigned to the currently selected text mode in such a way that it can be easily input in the currently selected text mode.)

In addition, the size of each button of the conventional QWERTY keyboard is increased by 2 to 3 times through various multi-touch operations, and a typo is prevented through the improved QWERTY keyboard in which 2 to 3 letters are assigned to each button. The same copper wire is required so that the input speed can be improved as a result.

In addition, when an object including a picture, a photo, a browser, and a window is multi-touched with two or more fingers, the moving direction of the touched finger, including pinching or spreading two or more fingers to enlarge or reduce the object, is reversed. Instead of changing the shape of the object in a manner, it is possible to modify the shape of the object including the enlargement or reduction of the object through a more convenient operation method including dragging two or more fingers in the same direction. As a result, the operation speed is increased, the fingers are smaller and easier to move, and even small objects can be easily enlarged or reduced.

In addition, through the multi-touch manipulation method, the object activation step, which should be performed before the shape of the object is deformed as in the prior art, is not performed separately, but is dragged after being multi-touched so that the object becomes the target button, so that the shape of the object may be deformed.

In object deformation, it is possible to perform a more precise operation with a finger touched on a touch pad than a mouse.

In a situation in which the mouse pointer is moved by a mouse, in general, the mouse pointer movement distance is set to be 5 times larger than the mouse movement distance, which is not suitable for precise work. If you do it with the finger touched on the touchpad, you can work with the concept that the finger movement distance and the mouse pointer movement distance are the same, so it is suitable for precise work.

In order to achieve the above effect, in the multi-touching process, the target button can be recognized even when the multi-touch is performed, and among the target button recognition methods, in particular, the user can select the target button by the reference finger. The convenience is greatly improved, and among the post-multi-operation methods, in particular, the multi-all on and off method is combined, the number of possible operations and convenience are rapidly increased.

1 is a view showing a 5X4 keyboard on a touch screen including a 3X4 keyboard (assigned to special characters),
FIG. 2 is a diagram illustrating an electronic device for showing a portion of a display screen of a special character assigned with a general character because physical buttons are mounted;
3 is a view showing a 5X4 keyboard applicable to the target button recognition method by the open fingers,
4 is a view showing a 4X4 keyboard to which a target button recognition method by a reference finger is applicable;
FIG. 5 is a diagram showing an input keyboard in a 3 × 4 type Japanese Hiragana input mode; FIG.
FIG. 6 is a view showing a state in which five characters of hiragana (see top view) and katakana (see bottom view) assigned to each button are popped up;
Figure 7 illustrates a conventional English QWERTY keyboard (the method of the present invention is also applicable),
8 is a diagram illustrating an improved English QWERTY keyboard to which the present invention is applied in which two letters are assigned to one button.
9 is a diagram illustrating a conventional Hangul QWERTY keyboard (the method of the present invention is also applicable),
10 is a diagram illustrating an improved Hangul QWERTY keyboard to which the present invention in which two letters are assigned to one button is applicable.
11 is a diagram illustrating an improved English QWERTY keyboard to which the present invention in which three letters are assigned to one button is applicable.
12 is a diagram illustrating a keyboard in Cheonjiin, which is one of the 3X4 keyboards for Hangul input;
FIG. 13 is a diagram showing a state in which five vowels A, E, I, O, and U which are additionally input together with S and S assigned to the target button are popped up (Example of post-touch operation: 'Multi all on &off'"," Multi-all drag "),
14 is a view referred to memorize drag directions related to A, E, I, O, and U which are additionally input together with S assigned to a target button;
15 is a view provided for explaining a process of inputting the English word “SAME”;
16 is a view provided to explain the process of inputting the English word "BEAUTIFUL",
17 is a diagram showing a state in which T, S, N, and R additionally inputted together with S and S assigned to a target button are popped up (operation example after touch: 'single drag').
18 is a view referred to memorizing drag directions related to T, S, N, and R additionally inputted with S assigned to a target button;
19 is a view showing a state in which H, D, L, and C additionally inputted together with S and S assigned to the target button (post-operation example: 'multi-all drag after single touch').
20 is a reference for memorizing drag directions related to H, D, L, and C additionally inputted with S assigned to a target button;
21 is a view showing a pop-up state of? (Question mark),. (Dot),, (comma), and! (Exclamation point) that are additionally input together with S and S assigned to the target button (post-touch operation example: 'Finger drag based on multi sickle to sickle'),
FIG. 22 is a view illustrating a state in which W and Y additionally inputted together with S and S assigned to a target button are popped up (example: post-touch manipulation: dragging a finger).
FIG. 23 is a diagram referred to for memorizing drag directions related to W and Y which are additionally input together with S assigned to a target button;
24 is a view provided to explain how a character is dragged two or more times consecutively in the same direction, or the drag direction is changed so that additional characters are continuously input each time dragged;
25 is a block diagram of an electronic device to which the present invention is applicable.
FIG. 26 is a view compared with FIG. 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37;
FIG. 27 is a view in which only the vertical length is enlarged while the center point of the object is moved upward, without changing the horizontal length,
FIG. 28 is a view in which the horizontal length is not changed and the vertical length is reduced while only the center point of the object is moved upward, compared to FIG. 26;
FIG. 29 is a view in which the vertical length is not changed and only the horizontal length is enlarged while the center point of the object is moved to the right as compared to FIG. 26;
FIG. 30 is a view in which the vertical length is not changed and the horizontal length is reduced only while the center point of the object is moved to the right as compared to FIG. 26;
FIG. 31 is a view in which the center and the vertical length of the object are enlarged while the center point of the object is moved to the upper right side as compared to FIG. 26;
FIG. 32 is a view in which the horizontal and vertical lengths are reduced while the center point of the object is moved to the upper right side as compared to FIG. 26;
FIG. 33 is a view in which the horizontal and vertical lengths of the object are enlarged while the center point of the object is moved to the lower right side as compared to FIG. 26;
FIG. 34 is a view in which horizontal and vertical lengths are reduced while the center point of an object is moved to the lower right side as compared to FIG. 26;
FIG. 35 is a view in which the horizontal length is not changed and only the vertical length is enlarged while the center point of the object is not moved compared to FIG. 26;
36 is a view in which the vertical length is not changed and only the horizontal length is enlarged while the center point of the object is not moved compared to FIG. 26;
FIG. 37 is a view in which the vertical length and the horizontal length are enlarged while the center point of the object is not moved compared to FIG. 26;
38 shows an example before an object is activated
39 is an exemplary view showing rectangular activation area boundaries and eight zoom adjustment points and one rotation adjustment point after the object is activated when the object is activated by a conventional method;
40 is a view illustrating that when the object is activated by a conventional method, the mouse pointer changes to a left and right double-sided arrow when the mouse pointer is placed on a zoom control point in the middle of the right vertical side of the active area boundary of the object;
41 is a view showing that when the object is activated by a conventional method, when the mouse pointer is moved to the zoom control point in the middle of the lower horizontal side of the active area boundary line of the object, the mouse pointer is changed to an up-down double-headed arrow,
42 illustrates that when the object is activated by a conventional method, the mouse pointer is changed to a diagonal double arrow when the mouse pointer is positioned on a zoom control point of the lower right corner of the object's active area boundary line. drawing,
43 is a view showing that when an object is activated by a conventional method, the mouse pointer is changed to a rotation arrow when the mouse pointer is placed on a rotation control point above the active area boundary of the object of the object;
44 illustrates a situation in which the index finger is recognized as the reference finger (= the point where the index finger is touched is recognized as the reference touch point), and the touch S is multi-touched by the index finger and the middle finger so as to be recognized as the target button. The drawing (the index finger touches button S, the middle finger is touching any point to the right of the point the index finger touches),
45 is a view illustrating subdividing an active area of an object or an object into various target ranges;
46 shows the top, bottom, left and right sides. It is a figure which illustrated the range of the upper right, lower right, upper left, lower left, upper right, and lower right directions.
47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 63, 64, 65, and 66 from the following drawings. 67 is another type of keyboard drawing different from the above drawing to which the method of the present application is applicable.
54, 55, 56, 57, 58, 63, and 64 are used together when FIGS. 47, 48, 49, 50, 51, 52, and 53 are actually applied to the device. We added a function button that can be used.
Fig. 47 is a view illustrating a Japanese keyboard to which the method of the present application can be applied. (The function buttons are omitted to make the gist of the present invention stand out.)
48 is a view illustrating an English keyboard 1 to which the method of the present application can be applied. (The function buttons are omitted to make the gist of the present invention stand out.)
Fig. 49 is a view illustrating the English keyboard 2 to which the method of the present application can be applied. (The function buttons are omitted to make the gist of the present invention stand out.)
Fig. 50 is a diagram illustrating an English keyboard 3 to which the method of the present application can be applied. (The function buttons are omitted to make the gist visible).
Fig. 51 is a view illustrating an English keyboard 4 to which the method of the present application can be applied. (The function buttons are omitted to make the gist of the present invention stand out.)
Fig. 52 is a diagram illustrating a Hangul keyboard 1 to which the method of the present application can be applied. (The function buttons are omitted to make the gist visible).
Fig. 53 is a view illustrating a Hangul keyboard 2 to which the method of the present application can be applied. (The function buttons are omitted to make the gist of the present invention stand out.)
54 is a diagram illustrating the addition of function buttons that can be used together when FIG. 47 (Japanese) is actually applied to a device.
FIG. 55 is a diagram illustrating that function buttons that can be used together when FIG. 48 (English) 1 is actually applied to a device are added.
FIG. 56 is a diagram illustrating that function buttons that can be used together when FIG. 49 (2) is actually applied to a device are added.
FIG. 57 is a view illustrating that function buttons that can be used together when FIG. 52 (Hangul 1) is actually applied to a device are added.
FIG. 58 is a diagram illustrating that function buttons that can be used together when FIG. 53 (Hangul 2) is actually applied to a device are added.
1, 3, 4, 8, 10, 11 and 12, the blank button to which the rightmost letters are not assigned is not a button that must be touched during multi-touch, but a multi-touch. If there is enough space (not necessarily a button, which can be treated as a space), only the button shape is drawn, but it is enough space. FIG. 54, 55, 56, 57, 58, 63, 64, 65, 67, and 68 may be replaced with the function buttons, and 54, 55, 56, 57, 58, 63, 64, 65, 67, When the functions of the function buttons in FIG. 68 are applied to an actual device, new functions may be added and some functions may be deleted.)
FIG. 59 is a diagram showing the index finger of the improved English QWERTY keyboard shown in FIG. 8 so that the index finger is recognized as the reference finger (= the touch point is recognized as the reference touch point), and the button QW touched by the index finger is recognized as the target button. It is a figure which exemplifies the situation of two touches with the middle finger (the index finger touches the button QW, and the middle finger touches any point to the right of the point where the index finger touches).
60 is a diagram illustrating an English QWERTY keyboard in a conventional tablet PC.
61 is a diagram illustrating a Korean QWERTY keyboard in a conventional tablet PC.
FIG. 62 is a diagram illustrating a state in which multi-touch is completed in the state of FIG. 44 and dragging to the right (multi-all) is completed.
FIG. 63 is a diagram illustrating another type of Korean keyboard (Hangul 3) slightly different from FIG. 57 or 58.
64 is a diagram illustrating another type of Korean keyboard (Hangul 4) slightly different from FIG. 57 or 58. FIG.
In the following FIGS. 65, 66, 67 and 47-64, other points except for the QWERTY keyboard will be described.
47 to 64 except for the QWERTY keyboard in Japanese, English, and Korean, the phoneme is assigned in the order of memorizing phonemes in the order of memorizing the phoneme. It is difficult to know in advance whether the character to be assigned is assigned to the first or second of each button, so whether it is input by single touch or multi-touch.
In FIGS. 65, 66, and 67, phonemes in the first half of the standard enumeration order are assigned to the first of each button, while those in the second half are assigned to the second of each button, even if the keyboard cannot be memorized. There may be an effect that it is easier to know in advance whether the phoneme is input by single touch or multi-touch .
A little more detail is as follows.
FIG. 65 illustrates that the letters A to M (13) of the English alphabets A to Z (13) are assigned to the first letter of each button, and N to Z (13) are assigned to the second letter of each button. (Compare with FIG. 55. The effect is described in the above description section for FIGS. 65, 66, 67 after FIG. 64).
66 is 10 representing letters of Japanese 50 the notes (あかさたなはまやらわ) and five four letters of the first half representing letters over each representative character (あかさたな) and four letters over each representative character is one of the buttons The second letter is assigned to the second letter, and the latter five letters (Hamayarawa) and the four letters attached to each letter are examples illustrating the second letter of each button. (Compared to FIG. 47. Refer to the above description of FIGS. 65, 66, 67 after FIG. 64).
FIG. 67 shows that ah ~ s (7) of the basic Korean consonants a ~ h (14) are assigned to the first letter of each button, and ㅇ ~ ㅎ (7) are assigned to the second letter of each button. (Compared with FIG. 57. The effect is described in the above description section for FIGS. 65, 66, 67 after FIG. 64).
8, 10, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 63, 64, 65 In a state where a plurality of characters are assigned to the same button including FIG. 66 and FIG. 67, letters assigned in a different order such as displaying a certain sequence of letters including the second letter in different colors including red or thick letters It is also possible to more easily determine the input method, including whether to input the character to be input by the operation after single-touch or multi-touch after the order of the prominent immediately.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

And unless otherwise stated, it would be good to assume that the right hand is used.

First, the contents of the contents to be described later are introduced.

1. Definition of terms

1.1. Definition of other terms

1.1.1. touch screen

1.1.2 Touch Button

1.1.3. text

1.1.4. finger

1.1.5. Qwerty keyboard

1.1.6. ON

1.1.7. OFF

1.1.8. ON & OFF

1.1.9. drag

1.1.10. X coordinate

1.1.11. Y coordinate

1.1.12. Goal Button

1.1.13. Reference finger (= reference touch point)

1.1.14. NOT-based finger (= NOT-based touch point)

1.1.15. Target range

1.1.16. Target point

1.1.17. Hitting point

1.1.18. Situation before final operation

1.1.19. Final operation,

1.1.20. Details touch after operation

1.2 Definition of Terms for Drag Direction

1.2.1. Straight drag

1.2.2. Drag back into place

1.2.3 Drag Shape

1.3. Definition of terms for drag length

1.3.1. Short drag

1.3.2. Long drag

1.4. Definition of terms for touch

1.4.1 .. Definition of term for single touch

1.4.1..1. Single touch

1.4.2 .. Definition of terms for multi-touch

1.4.2..1. Multi-touch

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

1.5. Definition of terms for post-touch operation

1.5. Operation after touch

1.5.1 .. Definition of terms for single touch operation

1.5.1..1. Operation after single touch

1.5.1..2. Single On & Off

1.5.1..3. Single drag

1.5.1..4. Single power strip

1.5.2 .. Definition of term for multi-touch operation

1.5.2..1. Operation after multi-touch

1.5.2..2. Multi On & Off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi Sickle All On & Off

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle up drag

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

1.5.2..12. Multi power strip

1.5.2..13. Definition of terms for multi-touch operation with open fingers

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

1.5.2..14. Most recommended post-touch operation

1.5.2..14.1. Most recommended multi on & off

1.5.2..14.2. Most recommended multi drag

1.5.3 ... After single-touch After multi-touch

1.6. Definition of terms about how to recognize the target button

1.6.1 .. Target button recognition method by reference finger (= Target button recognition method by reference touch point)

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number)

1.6.2 .. Target button recognition method by open fingers (= Target button recognition method by open touch points)

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

1.6.3 .. Target button recognition method by range including 2 or more touch points

1.6.4 .. Mixed

2. Synthesis

3. Character input method on touch screen

4. How to manipulate objects

5. Electronic device to which the present invention is applicable

Now let's get to the point.

1. Definition of terms

1.1. Definition of other terms

1.1.1. touch screen

A virtual graphic button can be displayed and selected instead of a keypad equipped with physical buttons, and is a concept of all screens capable of recognizing touches including a laser pad and a hologram pad as well as a general touch screen.

1.1.2 Touch Button

In addition to the virtual graphic buttons that appear on the touch screen, the concept includes all objects that users can touch and appear on the touch screen including pictures, pictures, browsers, and windows. When an object becomes a target button, the target button may also be referred to as a target object.

1 illustrates a touch screen in which touch buttons are arranged, and FIG. 2 illustrates an electronic device in which the touch screen and physical buttons are arranged together. The technical idea of the present invention can be applied to the case where the touch buttons and the physical buttons are implemented together as well as the touch buttons as shown in FIG. 1.

1.1.3. text

It is a comprehensive concept that means not only characters that represent common languages, but also anything that can be entered, including punctuation symbols or special characters, and special characters including pictograms.

In addition, the concept of 'character' throughout the present application not only has the concept of the general character as described above, but also functions for executing any command other than a character for character input assigned to any button (or icon), for example. listen,

Character deletion function, line break function, space function, Hangul / English switching function and various setting function in non-letter input mode in the text input mode, application execution functions in various application icons on the desktop of the smartphone are included By any button (or icon) assigned to a particular function. So, inputting characters with such a feature in mind is equivalent to executing a function, so you should understand that.

1.1.4. finger

The concept includes not only the finger of a person performing a touch on the touch screen but also a tool used to touch the touch screen such as a stylus pen.

In addition, the word finger is a concept that may include a touch point where a finger is touched from the perspective of the device.

so. In the context of the present application, the word 'finger', which is mainly used from the user's point of view, may be replaced by the touch point where the finger is touched, the touch point by the finger, or the touch point. many. For example, the word 'index' may be interpreted only as the word 'index' itself, but may be replaced with 'touch point where the index finger is touched' or 'touch point by index finger' or 'touch point'. There are many cases. In particular, the word finger in the term defined in the definition of the term often becomes the same term even if it is replaced by the word touch point.

That is, throughout the present application including the claims, the words of the finger concept including the finger or the index finger or middle finger are mainly used and explained in the user's position, and the claims are claimed. However, the contents of the device are as described above and in the following description. It should be regarded as being explained or asserted even if it is changed from the point of view. (There are some parts that are explained or claimed in reality, but it is so natural that there are many parts that cannot be explained or changed by claim. In this regard, the part which cannot be explained in a different way or claims by a change should be regarded as above.)

Thus, as the phrase containing the word finger is changed to the phrase containing the word touch point, which is a phrase from the device's point of view, the words used before or after the word finger can be changed accordingly. It should also be regarded as being explained or asserted.

It's also because the device doesn't know which finger was touched.

for example,

The phrase 'multi-touch with detection and stop' can be replaced with the phrase 'multi-touch with one touch load and another touch point' or 'multi-touch with two touch points' or the same meaning. There is,

The phrase 'the first touched finger is recognized as the reference finger, and the touched finger later is recognized as the reference finger' means that the first touched point is recognized as the reference touch point, and the touched point later becomes the sickle reference touch point. Be recognized, or in the same sense.

The phrase "When the index finger, which is the reference finger, is touched first, and then the middle finger, which is the sickness reference finger, is touched later" Can be changed to

The phrase 'touched finger' can be replaced with the phrase '(touched) touch point' or the same meaning.

The phrase 'points where fingers are touched' may be replaced with the phrase 'touched touch points' or the same phrase.

1.1.5. Qwerty keyboard

Originally, it means an English computer keyboard standard keyboard in which Q, W, E, R, T, Y sequence of letters is present in English keyboard. A keyboard that includes the sequence of letter assignments in. In conventional QWERTY keyboards, one character is assigned to each button. In addition, the concept includes the improved QWERTY keyboard as shown in FIGS. 8, 10, and 11.

7, 8, 11, and 60 are examples of English QWERTY keyboards, and FIGS. 9, 10, and 61 are examples of Korean QWERTY keyboards.

1.1.6. ON

(Touch screen) refers to being touched, that is, touching a finger with the touch screen.

1.1.7. OFF

The touch is released (at the touch point), that is, the finger falls off the touch screen.

1.1.8. ON & OFF

The touch point refers to an operation that is not dragged after being turned 'on', but immediately turned off.

1.1.9. drag

The touch point refers to an operation of moving to another point while maintaining the 'on' state. The drag includes various drags including a 'straight drag', a 'return drag' and a 'shaped drag', which will be described later.

In addition, in the present application, the term 'drag' or 'drag' includes not only the drag action itself but also 'drag off'.

1.1.10. X coordinate

Coordinates on the horizontal axis indicating a specific point on the touch screen.

1.1.11. Y coordinate

Coordinates on the vertical axis indicating a specific point on the touch screen.

1.1.12. Goal Button

When a user intends to perform a specific task with a 'post touch operation' to be described later, it refers to a button directly related to the specific task. That is, it refers to a specific button targeted by the user.

1.1.13. Reference finger (= reference touch point)

Among the multi-touch fingers, it refers to a finger which is a reference for the device to recognize the target button. In normal cases, the finger touched on the target button is the reference finger.

From the point of view of the device, it refers to a touch point that is a reference point for the device to recognize the target button among the multi-touch points, that is, a touch point touched on the target button.

1.1.14. NOT-based finger (= NOT-based touch point)

It refers to at least one finger of the multi-touch fingers except the reference finger.

From the point of view of the device, it refers to at least one touch point except for the reference touch point among the multi-touch points.

1.1.15. Target range

This concept is often needed when performing tasks involving objects such as photos, pictures, or browsers.

When a user attempts to perform a specific task with a 'post-touch operation', which will be described later, a specific range within an object (or object activation area boundary) directly related to the specific task, that is, the specific range that the user targets Refers to.

For example, in a single touch, a range including a point actually touched is recognized as the target range, and in the method of recognizing a target button by the reference finger, a range including a point where the reference finger is actually touched is recognized as the target range.

As another example, as the center point of the object is moved, the length of the left vertical side of the object, the length of the right vertical side, and the position of the left vertical side of the object are not changed, but the position of the upper vertical side of the object is changed, In order to ensure that the lengths of the horizontal and lower horizontal sides are equally enlarged to the right, the right range of the vertical line passing through the center point of the object (or the object activation area boundary) among the points inside the object (or object activation area boundary) is recognized as the target range. It can also be multitouched and dragged to the right.

1.1.16. Target point

When a user attempts to perform a particular task with a 'post-touch operation', which will be described later, a specific point within a button or object (or object activation area boundary) directly related to the specific task, that is, the user aims It refers to a specific point.

For example, in a single touch, a point that a user intends to touch is referred to, and in a method of recognizing a target button by a reference finger, a point where the reference finger is intended to be touched.

In another example, as the center point of the object is moved, the position of the lower left corner of the object is not changed, and the operation of expanding the length of the upper and lower horizontal sides, the left vertical side, and the right vertical side of the object is performed. In addition, among the points inside the object (or object activation region boundary line), the upper right side vertex of the object (or object activation region boundary line) may be multi-touched and dragged in the upper right direction to be recognized as the target point.

1.1.17. Hitting point

It is also a specific point necessary for the device to recognize the target button or the target range, and is a specific point calculated by at least one touch point actually touched, and the range including the hitting point is recognized as the target range or the target button. Can be.

For example, in the single touch, the point where the single touched finger is actually touched is the hitting point, and in the method of recognizing the target button by the reference finger, the point where the reference finger is actually touched is the hitting point.

1.1.18. Situation before final operation,

1.1.19. Final operation,

1.1.20. Details touch after operation

The situation before the final operation, the final operation, and the operation after the detailed touches are closely related to each other, and thus will be described at once.

The situation before the final operation refers to the situation up to immediately before the final operation is started in the process of performing the operation after (detail) touch.

The final operation is a process that follows the situation before the final operation, and is the last stage of operation to complete the operation after (detail) touch. For example, drag in various directions, including off or up, down, left, back, left, top, bottom, right, or bottom, two or more consecutive drags (drag direction may change), long drag, short drag There is.

The operation after detailed touch is the sum of the situation before the final operation and the final operation. In other words, as the details of the post-touch operation associated with the target button, if the operation behavior associated with the target button is not the same, the post-touch operation is different. The operation after the detailed touch may be simply referred to as the detailed operation or the operation (or the operation after the multi-touch).

For a comprehensive example of the situation before the final operation, the final operation and the operation after detailed touch,

Five final operations of dragging in the off or four directions in the five post-touch operations of single on & off and single drag in the four directions of up, down, left and right, starting with single touch. Since the situation up to before is the same in all five sub-touch operations, all of the five post-touch operations are the same operations before the final operation,

Five final touches: five all touch on and off, two multi-touch up, down, left, and right four multi-touch drag operations. Since the situation until the beginning of the operation is the same in all of the operations after the five detailed touches, all the operations after the five detailed touches are the same operation before the final operation,

Multi-not all reference finger on & off, starting with 2 multi-touch and each multi-notch reference finger dragging in four directions: up, down, left, right Since the situation just before the five final operations of dragging are the same in all of the five detailed touch operations, the operations after the five detailed touches are the same operations before the final operation.

After single touch, two multi-touch, multi-all on & off, and up, down, left, and right respectively, after each single touch, two multi-touch, then multi-all drag. Since the situation just before the five final operations, such as dragging, is the same in all of the operations after the five detailed touches, the operations after the five detailed touches are the same operations before the final operation.

However, the multi-all on and off starts with 2 multi-touch and the multi-all on and off starts with 3 multi-touch are different from each other until the final operation starts. Operation after the touch, and as a result, the operation is different after 3

Since the multi-all drag in the upward direction starting with 2 multi-touch and the multi-all drag in the upward direction starting with 3 multi-touch are not identical to each other until the final operation of dragging upwards, the situation before the final operation is mutually different. It is another post-touch operation, and as a result, the post-start operation is different.

And even if it is multi-all on and off starting with 2 multi-touch, the multi-all on and off process with 2 multi-touch is multi-all touch and multi-all on and off with multi-not all-touch is the final operation of off. Since the situation until just before this is not the same, the situation before the final operation is the operation after the different detailed touches, and as a result, the operation after the start of the operation is different,

And, the final operation here means the last operation that is turned off or dragged in the first full-fledged operation after being touched, and dragged two or more short times consecutively in the same direction in the following description, or dragging. It doesn't mean the last change to the way the orientation is changed, so that additional characters are continuously entered each time it is dragged.

1.2 Definition of Terms for Drag Direction

1.2.1. Straight drag

Refers to dragging in a straight line including left (west), right (east), top (north), bottom (south), right (bottom), left bottom (southwest), top right (northeast), and top left (northwest) directions do.

1.2.2. Drag back into place

A straight line refers to a drag that is linearly dragged in one direction and then returned while being dragged back into place without being turned off.

1.2.3 Drag Shape

Refers to a drag consisting of several directions, not just one straight line, such as a circle, semicircle, triangle, or rectangle.

1.3. Definition of terms for drag length

1.3.1. Short drag

Dragging below a certain (coordinate) length. Here, the length of the schedule (coordinate) may be determined by the horizontal or vertical length of the two touch buttons, but may be determined differently.

1.3.2. Long drag

Refers to dragging beyond a certain (coordinate) length. In the present specification, 'drag' that is not specifically marked as 'long drag' may be considered as 'short drag'.

1.4. Definition of terms for touch

1.4.1 .. Definition of term for single touch

1.4.1..1. Single touch

It refers to being touched so that only one finger is in a touched state. In general, the single touch is implemented by touching the target button with the index finger among the five fingers.

From the point of view of the device, it refers to being touched so that there is a state where only one touch point is touched.

1.4.2 .. Definition of terms for multi-touch

1.4.2..1. Multi-touch

It refers to being touched so that two or more fingers are in a touched state.

From the point of view of the device, it refers to being touched so that two or more touch points are in a touched state.

As for the point of time when the device starts to judge one (unit) touch including one (unit) single touch or multi-touch, the touch point newly touched when no touch point is touched After the touch point is generated, if the touch point is newly turned off after the touch point is not generated, it can be judged that the operation is performed after the touch with only a single touch. Any of the various multi-touch methods described below each time at least one new touch is generated while none of the touch points touched is off, i.e., the touch state of all touch points touched so far is maintained. It can be determined whether the multi-touch.

For reference, in the embodiments of the present application, if it is not specified whether the hand to be used is a right hand or left hand, it may be regarded as a right hand.

1.4.2..2. n Multi-touch

This refers to multitouch such that n fingers are in a touched state. (From a device's point of view, it refers to multitouch such that n touch points are in a touched state.)

E.g,

1) 2 multi-touch is multi-touch so that two fingers (= touch point) is in contact with the state,

2) 3 multi-touch is multi-touch so that the state that the three fingers (= touch point) is touched,

3) Four multi-touch refers to being multi-touched so that the state where the four fingers (= touch point) are touched.

In the present application, n multitouch or multi-touch is regarded as, or as an embodiment of, a multi-touch in a multi-all touch state to be described later, unless there is a special mention or suggestion of which multi-touch method among the various multi-touch methods described below. It is recommended to consider as, but it is not necessarily limited to interpreting it.

1.4.2..3. Multi all touch

As a kind of multi-touch, when the multi-touch is performed, the time difference between the time when the first touched finger is turned on and the time when the last touched finger is turned on is almost simultaneously at a predetermined time (for example, 0.1 second) or less. Refers to multi-touch of the case.

(From the point of view of the device, as a kind of multi-touch, the time difference between the time when the first touch point is turned on and the time when the touch point last touched when the multi-touch is turned on is less than a predetermined time (for example, 0.1 second). This refers to multi-touch when multi-touch is performed at about the same time.)

For example, in multi-touching, for example, with the index finger and middle finger, the middle finger and the index finger are actually touched by the touch screen at the same time. In this case, even if the middle finger is touched on the touch screen before the index finger, if the time difference between the time when the middle finger is touched and the index finger touch time is less than 0.1 second, this includes the case where the middle finger is recognized as the multi-all touch of the middle finger and the index finger. (For two touches with the index finger and middle finger, the middle finger and the middle finger will be operated at the same time with the intention of touching the touch screen.)

1.4.2..4 multi sickle all touch

One kind of multi-touch refers to a multi-touch in which the time difference between the time when the first touched finger is turned on and the time when the last touched finger is turned on when it is multi-touched exceeds a predetermined time (for example, 0.1 second). (From the point of view of the device, a type of multi-touch, in which the time difference between the time when the first touch point is turned on and the time when the touch point last touched is turned on for a certain time (for example, 0.1 second) Refers to multi-touch exceeding.)

This includes 'multiple not all reference finger touch', 'multi not all better reference finger touch' and 'multiple not all reference finger fluctuation touch' to be described later.

For example, in the case of two touches with the index finger and the middle finger, the middle finger touches the touch screen before the middle finger is detected, and the time when the middle finger is turned on exceeds the time when the middle finger is detected for a predetermined time (for example, 0.1 second). This is included here.

Since the multi-not all touch is not recommended unless it is a special case, it is not recommended to separately apply the multi-all touch and the multi-not all touch when applying the present method to an actual device.

1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)

As a kind of multi-not all touch, it refers to a case in which the reference finger is first touched and then the sickle reference finger is touched later. That is, the first touched finger is recognized as a reference finger, and the touched finger later is referred to as a sickle reference finger.

(From the point of view of the device, it is a kind of multi-not all touch, and refers to a case in which the reference touch point is first touched and then the sickle reference touch point is touched later. That is, the first touch point is recognized as the reference touch point, It refers to a case in which the touch point touched later is recognized as a better reference touch point.)

For example, when the index finger is recognized as the reference finger and the middle finger is multi-touched with the index finger and the middle finger so that the middle finger is recognized as the sick finger, the middle finger, which is the reference finger, is touched after the index finger is touched. This includes a case where the time difference between the time at which the touch is touched and the time at which the stop is touched exceeds a predetermined time (eg, 0.1 second).

1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Touch Point Touch)

A kind of multi-not all touch refers to a case in which a sickle reference finger is first touched and then the reference finger is touched later. That is, the first touched finger is recognized as a sickle reference finger, and the touched finger later is referred to as a reference finger.

(From the point of view of the device, it is a kind of multi-not all-touch, and refers to a case in which a sickle reference touch point is first touched and then a reference touch point is touched later. , Refers to a case in which the touch point touched later is recognized as a reference touch point.)

For example, when the index finger is recognized as the reference finger and the middle finger is multi-touched by the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, the middle finger which is the sickle reference finger is touched, and the index finger which is the reference finger is touched later. This includes the case where the time difference between the time when the middle finger is touched and the time when the index finger is touched exceeds a predetermined time (for example, 0.1 second). Even if the index finger, which is the reference finger, is touched later, the status of the button as the target button is maintained.

1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)

A kind of multi-not all touch, which refers to a touch when a finger touched in a predetermined sequence is recognized as a reference finger, and is actually included in the 'multi-not all touch' and is a 'multi-not all reference finger touch' or It also has the concept of 'multiple sickle-all sickle-based finger touch'.

(From the point of view of the device, it is a kind of multi-not all touch, and refers to a touch when a touch point touched in a predetermined sequence is recognized as a reference touch point, and is actually included in the multi-not all touch, It is a concept that has some concepts of 'multi-not all-based touch point touch' or 'multi-not all-not touch point touch'.)

E.g,

1) The first touched finger (= touch point) is designated to be recognized as the reference finger (= reference touch point),

2) the second touched finger (= touch point) is designated to be recognized as the reference finger (= reference touch point),

3) The third touched finger (= touch point) is designated to be recognized as the reference finger (= reference touch point),

4) The fourth touched finger (= touch point) may be designated to be recognized as the reference finger (= reference touch point).

If the index finger is touched before the middle finger in multi-touch by the index finger and middle finger,

1) If the first touched finger is designated to be the reference finger, the first touched index finger becomes the reference finger,

2) If the second touched finger is designated to be the reference finger, the second touched stop is the reference finger.

1.4.2..8. Definition of terms for multi-touch by open fingers

1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)

As a concept almost identical to the definition of the term 'multi-touch',

However, when the definition of the term 'multi-touch' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)

As a concept almost identical to the definition of the term 'n multi-touch',

However, when the definition of the term 'n multi-touch' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)

As a concept almost identical to the definition of the term 'multi-all touch',

However, when the definition of the term 'multi-all touch' is understood, the 'target button recognition method using the open fingers', which will be described later, is merely a concept applied to the target button recognition method.

1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)

As a concept almost identical to the definition of the term 'multi-not all touch',

However, when the definition of the term 'multi-not all touch' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

Multi-not all-touch by open fingers is not recommended unless it is a special case. Therefore, when applying the present method to a real device, it is necessary to distinguish between multi-all touch by open fingers and multi-not all touch by open fingers. Not recommended

1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)

As a concept almost identical to the definition of the term 'multi-not all reference finger touch',

However, when the definition of the term 'multi-not all reference finger touch' is understood, the 'target button recognition method using the open fingers' to be described later is applied as the target button recognition method, In the definition of the term, the phrase reference finger (= reference touch point) is replaced with the finger touched on the leftmost (= touch point), and the phrase sickle reference finger (= notice reference touch point) is touched on the rightmost It is just a concept replaced by (= touch point).

1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point)

As a concept almost identical to the definition of the term 'multi-not all-Night reference finger touch',

However, when the definition of the term 'multi-not all reference finger touch' is understood, the 'target button recognition method using the open fingers' to be described later is applied as the target button recognition method, In the definition of the term, the phrase reference finger (= reference touch point) is replaced with the finger touched on the leftmost (= touch point), and the phrase sickle reference finger (= notice reference touch point) is touched on the rightmost It is just a concept replaced by (= touch point).

1.5. Definition of terms for post-touch operation

1.5. Operation after touch

The term includes 'post-touch operation' and 'post-touch operation' to be described later.

1.5.1 .. Definition of terms for single touch operation

1.5.1..1. Operation after single touch

Single on & off, single drag, and single power tap, which will be described later, are included in the single touch operation.

Post-single operation refers to any operation in which subsequent movements are additionally performed after single-touch, i.e., only the final operation, but (in rare cases) also includes the moment of single-touch before any operation after single-touch. The term can be used to mean.

Thus, it can be misunderstood as being manipulated while being single touched again after being single touched, including being described as being single on & off after being single touched or being single dragged after being single touched, that is, like single touch. May be misunderstood as if it occurs twice, or the claims claimed in the claims are only so mentioned for clarity, so a single touch should be interpreted as occurring only once.

E.g,

Single on and off after single touch with the index means that the index is off without being dragged after being single touched with the index finger, ie single on and off with single touch or starting with single touch To become single on & off,

The expression of single dragging upwards after the index finger is single-touched means that the index finger is dragged upwards while the index finger is touched after being single-touched by the index finger. That is, single dragging upwards while being single touched or single dragging upwards starting with single touch.

In other words, after single touch operation after single touch, it is the same as just operating after single touch, and it is expressed because the situation where the word is used requires such words.

This is because the operation that requires single touch twice is not necessary except for the contents related to 'single multi-tap'.

1.5.1..2. Single On & Off

Refers to an operation that is not dragged after a single touch but is immediately turned off.

1.5.1..3. Single drag

Refers to an operation in which a finger is touched and dragged after a single touch. (From a device's perspective, this refers to an operation in which a touch point is touched and dragged after a single touch.)

1.5.1..4. Single power strip

In general, a method called a multi-tap method refers to an operation in which the same button is continuously pressed by one finger. (From a device's point of view, a method generally called a multi-tap method. The same button continuously touches one touch point. Loss refers to manipulation.)

1.5.2 .. Definition of term for multi-touch operation

1.5.2..1. Operation after multi-touch

The 'multi drag', 'multi on & off' and 'multi tap' to be described later are included in the post-touch operation.

Post-touch operation refers to any operation in which subsequent movement is additionally performed after multi-touch, but (in rare cases) also includes the point of multi-touch after multi-touch but before any operation. It is a term that can be used.

Thus, it can be misunderstood as being manipulated while being multi-touched again after being multi-touched, including being described as being multi-all on & off after multi-touch or multi-all dragging after multi-touch. Multi-touch should be construed as occurring only once, as the touch may be misunderstood as if it occurred twice, or as claimed so far in the claims for the sake of understanding.

E.g,

The term multi-all on and off after two touches with the index finger and the middle finger means that both the index finger and the middle finger are turned off at the same time without being dragged. Multi-all on & off with 2 multi-touch, or multi-all on & off starting with 2 multi-touch by detection and stop,

The word “multi-drag up” after two touches with the index finger and the middle finger is touched two times with the index finger and the middle finger, and then the index finger and middle finger are not turned off, i.e., both the index finger and middle finger are touched. And stop both are dragged upwards. In other words, the multi-all dragged by two multi-touch by the detection and the middle finger or the multi-all dragged by two multi-touch by the detection and the middle finger.

In other words, the term “manipulating after multi-touch” is the same as “manipulating after multi-touch”, but the situation in which the term is used requires such a word.

This is because the operation that requires multi-touch twice is not necessary except for the contents related to 'multi-tap'.

1.5.2..2. Multi On & Off

Among the multi-touch fingers, one finger is not dragged, and all of them are turned off in place, and 'multi all on & off' and 'multiple not all on & off' will be described later. From the point of view, one touch point among the multi-touch points is not dragged, but all are turned off in place, and the 'multi all on & off' and 'multi not all on & off' will be described later. do.)

For example, in operation after two multi-touch operations with the detection and the middle finger, the operation includes causing the multi-touched middle finger and the index finger not to be dragged but all turned off in place.

1.5.2..3. Multi All On & Off

When the multi-touched fingers are multi-on & off, the multi-on causes the time difference between the time when the first off finger is turned off and the time when the last off finger is turned off to be less than a predetermined time (for example, 0.1 second). (From the perspective of the device, when the multi-touch points are multi on and off, the time difference between the time when the first touch point is turned off and the time when the touch point is turned off last is turned off. Refers to multi on & off for less than a certain time (eg 0.1 seconds).)

For example, in two-touch operation with index finger and middle finger,

When the middle finger and forefinger are operated with the intention of turning off the touch screen at the same time, the time when the first finger is turned off and the second finger is turned off, even if one of the middle finger and the index finger is turned off first and the other off later When the time difference from the time when the finger is turned off is less than a certain time (for example, 0.1 second),

For a more detailed example, when the middle finger and the index finger are operated with the intention of turning off the touch screen at the same time, even if the middle finger is off the touch screen before the index finger, the stop time and the time the index finger is off If the time difference is less than a certain time (eg 0.1 second), it is included here.

1.5.2..4. Multi Sickle All On & Off

When the multi-touched fingers are 'multi on & off', the multi-time difference between the time when the first off finger is off and the time when the last off finger is off exceeds a certain time (e.g. 0.1 second). Refers to ON & OFF. This includes 'multiple all-all reference finger on & off' and 'multiple all-all reference finger on & off' to be described later.

(From the point of view of the device, when the multi-touch points are 'multi on & off', the time difference between the time at which the first touch point is turned off and the time at which the last touch point is turned off is a fixed time (e.g., (Multiple on all off reference touch point on & off) and 'multiple not all better reference touch point on & off' which are described later are included.)

For example, after two touches with the index finger and middle finger, one of the middle finger and the middle finger is first turned off on the touch screen and the other side is turned off later. If the time difference from the time when the finger is off exceeds a predetermined time (for example, 0.1 second), it is included here.

1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)

When the multi-not all on and off, the sickle reference finger is first turned off, and later the reference finger is turned off. (From the perspective of the device, when the multi-not all on and off, the sickle reference touch point first. After the off, it refers to the operation of turning off the reference touch point later.)

For example, the index finger is recognized as the reference finger, and the middle finger is manipulated after two multi-touch operations such as the index finger and the middle finger so that the middle finger is recognized as the reference finger. In this case, when the index is turned off later, the time difference between the off time when the middle finger is turned off and the off time when the index finger is turned off is included here.

1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)

Refers to an operation in which, when the multi-not all on and off, the reference finger is first turned off, and later, the sickle reference finger is turned off. Later, refers to an operation in which the sickle reference touch point is turned off.)

For example, the index finger is recognized as the reference finger, and the middle finger is manipulated after two touches with the index finger and the middle finger so that the middle finger is better than the middle finger. This is included if the time difference between the time when the index finger is turned off and on is off and the time difference between the time off when the stop is on and off exceeds a certain time (eg 0.1 seconds). .

Even if the index finger, which is the reference finger, is turned off first, the status of the button as the target button is maintained.

1.5.2..7. Multi drag

At least one of the multi-touch fingers is a drag proceeding while the on state is maintained, and 'multi-all drag' and 'multi-not all drag', which will be described later, are included here.

(From the point of view of the device, one or more touch points among the multi-touch points are dragged while being kept on, and the following will include 'multi-all drag' and 'multi-not all drag'.

1.5.2..8. Multi All Drag

None of the multi-touched fingers is turned off, and the whole starts to be dragged and dragged. (From the point of view of the device, none of the multi-touched touch points is turned off and the whole starts to be dragged. Refers to being dragged.)

The multi-all drag is established when all the fingers to be multi-all dragged start dragging with a point in time at which they move together. All of the first multitouches started dragging at the edges of the touch screen (top, bottom, left, right, or edge areas), even if one or more of the multi-drag fingers were turned off first because they were dragged in the edge direction. If there was a time when the fingers were moving together, it is recognized as multi all drag.

For example, the index finger is recognized as the reference finger and the middle finger is operated after two touches with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger. Dragging together is included here if it is dragged so that the point of view exists.

1.5.2..9. Multi sickle up drag

In a state in which at least one of the multi-touched fingers is turned off, the drag is manipulated so that at least one remaining finger, which is still on, starts to be dragged. It is included here as in the device's point of view. (From the perspective of the device, at least one remaining touch point that is still on is started to be dragged while at least one of the multi-touch points is off.) As a drag manipulated so that a viewpoint exists, 'multi-not all-reference touch point drag' and 'multi-not-all-reference touch point drag' to be described later are included.)

The multi-not all-drag is established when the drag starts with a state in which at least one remaining finger, which is still on except for the off-finger that is multi-not all dragged, moves together. Dragging started at the edge of the touch screen (upper, lower, left, right, or corner area) and at least one of the fingers that were still on until the multi-null drag began because the dragged in the edge direction is off first. However, if there was a time point in which the remaining at least one finger which was started to be multi-not all dragged together, it is recognized as a multi-not all drag.

For example, when the index finger is recognized as the reference finger and the middle finger is operated after two multi-touch operations with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, one of the middle finger and the index finger which is the sickle reference finger is turned off first. In this case, the remaining fingers start to be dragged and this is included.

1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)

Refers to a multi-not all-drag that the reference finger begins to drag after the at least one sickle reference finger is turned off. (From the perspective of the device, the multi-referenced drag point starts to be dragged after the at least one sickle reference touch point is off. Refers to a better all drag.)

For example, the index finger is recognized as the reference finger, and the middle finger is manipulated after two multi-touch operations with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger. This includes the case where the index finger, which is the reference finger, is later dragged after being turned off and then dragged.

1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)

Refers to a multi-notch all drag, in which at least one sickle reference finger begins to drag after the reference finger is off. Refers to a better all drag.)

For example, the index finger is recognized as the reference finger, and the middle finger is operated after two multi-touch operations such as the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger. This includes cases where the middle finger, which is a sickness-based finger, begins to be dragged and then later dragged.

Even if the index finger, which is the reference finger, is turned off first, the status of the button as the target button is maintained.

1.5.2..12. Multi power strip

In general, a multi-tap refers to an operation of pressing a touch button several times with one finger. In keeping with the present application, it can be said to be a single multi-tap method.

For example, among the touch buttons shown in FIG. 1, touch buttons assigned with A, B, and C are assigned.

1) Press A once to enter A, or

2) Press twice to enter B,

3) Press 3 times to indicate C input operation.

In contrast, a multi-tap means a multi-tap operation in a multi-touch manner.

Specifically, the multi-tap method,

In a device equipped with a touch screen, after the multi-touch operation, a method for generating a work signal for any operation, including character input or object deformation,

The operation method after the multi-touch,

The method may be a method in which different operations are performed according to the number of times the multi on & off is performed by performing at least one consecutive time,

When a character is input by the multi-tap method,

The characters belonging to the target character group related to the target button are displayed in a cycle according to the number of times the multi-on & off is performed at least once in succession, and then single touch or multi-touch is performed so that other buttons are recognized as the target button. If the cursor is moved or a predetermined time (for example, 2 seconds) has elapsed, the displayed character may be input in a definite manner. It is recommended that the method of inputting the characters deterministically follow any one or more of the methods in which the characters of the conventional (single) multi-tap method are inputted deterministically.

For example, in the general text mode, the following steps 1) to 3) can be performed without changing the text mode.

Among the touch buttons shown in FIG. 1, after A, B, C and touch buttons assigned with!, ◆, / are multi-touched to become target buttons,

1) Multi All On & Off is set once so that the first character “!” Among the letters (!, ◆, /) assigned under A, B, and C can be entered.

2) Multi All On & Off can be entered twice so that the second character “◆” among the letters (!, ◆, /) assigned under A, B, and C is not entered.

3) Multi All On & Off can be performed 3 times so that the third character (!, ◆, /) assigned under A, B, C, not C, can be entered.

In plain words,

Among the touch buttons shown in Figure 1 A, B, C and!, ◆, / is assigned to the detection and stop so that the touch button assigned to the target button,

1) Multi-touch (exactly Multi All On & Off) is made once so that the first character of the characters (!, ◆, /) assigned below A, B, C can be entered instead of A. There is,

2) Multi-touch (exactly Multi All On & Off) is done twice so that “◆”, which is the second character among the letters (!, ◆, /) assigned under A, B, and C, can be entered. There is,

3) Multi-touch (exactly Multi All On & Off) is performed three times so that the third character "/" of characters assigned to A, B, and C (!, ◆, /), not C, can be entered. have.

When the multi-tap method is used, at least one character from among at least one character associated with the button recognized as the target button while belonging to the specific character group among the at least one character group is input, at least depending on the situation before the final operation. The method may be a method in which a specific character group is matched among one character group and belongs to the matched character group, and at least one of the at least one character associated with the target button is input without changing the character mode. (Can also apply to QWERTY keyboards.)

In short, at least one character belonging to a specific character group and associated with the target button can be input without changing the character mode. Here, the specific character group may be any one or more of the following.

1) Any character group from two or more different character groups classified under different spelling rules.

2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button.

5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

(Here 1) to 5) are also dealt with in various places of the present application including "3. Character input method on touch screen" and claims, which will be described later. Omit detailed descriptions, including any instructions.)

For example, the letter group may be one of two or more different character groups classified into different series under the spelling rule of “1)”.

For example, if the current character mode is an uppercase English letter, the character mode to which a specific character group belongs is English and lowercase mode. For example, if the current character mode is Japanese hiragana character mode, the character mode to which a specific character group belongs is Katakana. According to the spelling rules in the same character system including the character mode, the character mode may be a character group to which a character group consisting of different characters corresponding to each character belonging to the current character mode belongs. That is, it may be a character group consisting of characters input in another character mode on the spelling rule corresponding to the currently set character mode.

For example, when the touch buttons assigned with A, B, and C are recognized as target buttons in the English uppercase letter mode, one of the lowercase letters a, b, or c may be input even in the uppercase letter mode. .

In detail, when the touch buttons assigned to A, B, C and!, ◆, / are multi-tap so that they are recognized as the target buttons, one of!, ◆, or / is input in the embodiment. ◆, or instead of / to replace a, b, or c, so detailed embodiments will be omitted.

For example, a character group assigned to a specific row among the characters assigned to the same button of the "3)", in the case of Figure 1 A, B, C and!, ◆, / of the touch button is assigned The "!" Assigned to line 2 , May be a group of characters assigned to the second line of each button including "◆" and "/". As shown in FIG. 1, the characters assigned to the second line of the touch button are special characters, but they may be implemented as characters other than special characters.

For example, in the case of FIG. 1, the character group assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button of "4)" may be used. And!, ◆, / are assigned to the 4th to 6th touch buttons with "!" , "◆", "/" may be the letters assigned to the fourth to sixth of each button.

When the multi-touch when multi-tap is expressed in detail by n multi-touch, different character groups are matched according to different n values so that characters of the character group can be input without changing the character mode. You may.

1.5.2..13. Definition of terms for multi-touch operation with open fingers

1.5.2..13.1. Operation after multi-touch by open fingers (operation after multi-touch by open touch points)

As a concept almost identical to the definition of the term 'post-touch operation',

However, when the definition of the term 'after multi-touch operation' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)

As a concept almost identical to the definition of the term 'multi on & off',

However, when the definition of the term 'multi on &off' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)

As a concept almost identical to the definition of the term 'multi all on & off',

However, when the definition of the term 'multi all on &off' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)

As a concept almost identical to the definition of the term 'multi-not all on and off',

However, when the definition of the term 'multi-not all on &off' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)

As a concept almost identical to the definition of the term 'multi-not all reference finger on & off',

However, when the definition of the term 'multi-not all reference finger on &off' is understood, 'target button recognition method using the open fingers' to be described later is applied as the target button recognition method,' multi-not all reference finger on In the definition of & off ', the phrase reference finger (= reference touch point) is replaced with the finger touched on the leftmost (= touch point), and the phrase sickle reference finger (= notice reference touch point) is rightmost. It is just a concept that is replaced by a finger touched (= touch point).

1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger

As a concept almost identical to the definition of the term 'multi-not all-not reference finger on & off',

However, when the definition of the term 'multi-not all-knot reference finger on &off' is understood, the 'target button recognition method by the open fingers' to be described later is applied as the target button recognition method, In the definition of the term finger on & off, the phrase reference finger (= reference touch point) is replaced with the finger touched to the left (= touch point), and the phrase sickle reference finger (= sick reference touch point) It is just a concept that is replaced by the finger touched on the far right (= touch point).

1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)

As a concept almost identical to the definition of the term 'multi drag',

However, when the definition of the term 'multi drag' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)

As a concept almost identical to the definition of the term 'multi-all drag',

However, when the definition of the term 'multi-all drag' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)

As a concept almost identical to the definition of the term 'multiple not all drag',

However, when the definition of the term 'multi-not all drag' is understood, the 'target button recognition method using the open fingers', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)

As a concept almost identical to the definition of the term 'multi-not all reference finger drag',

However, when the definition of the term 'multi-not all reference finger drag' is understood, the 'target button recognition method by the open fingers' to be described later is applied as the target button recognition method, In the definition of the term, the phrase reference finger (= reference touch point) is replaced with the finger touched on the leftmost (= touch point), and the phrase sickle reference finger (= notice reference touch point) is touched on the rightmost It is just a concept replaced by (= touch point).

1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)

As a concept almost identical to the definition of the term 'multiple sickle all sickle reference finger drag',

However, when the definition of the term 'multiple-all-noc reference finger drag' is understood, 'target button recognition method by the open fingers', which will be described later, is applied as a target button recognition method, and the 'multi-not-all-reference finger drag' is applied. In the definition of ', the phrase reference finger (= reference touch point) is replaced by the finger touched on the leftmost (= touch point), and the phrase sickle reference finger (= sickle touch point) touches the rightmost It is just a concept replaced by a broken finger (= touch point).

1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point)

As a concept almost identical to the definition of the term 'multi-tap',

However, when the definition of the term 'multi-tap' is understood, the 'target button recognition method using an open finger', which will be described later, is merely a concept applied to the target button recognition method.

1.5.2..14. Most recommended post-touch operation

1.5.2..14.1. Most recommended multi on & off

With the most convenient multi on and off operation for the user, it refers to the 'multi all on and off' implemented by the detection and the stop, which is an example of the definition of the 'multi all on and off',

The index finger is recognized as the reference finger, and the middle finger is manipulated after two multi-touch operations with the index finger and the middle finger so as to be recognized as the reference finger.

When the middle finger and forefinger are operated with the intention of turning off the touch screen at the same time, the time when the first finger is turned off and the second finger is turned off, even if one of the middle finger and the index finger is turned off first and the other off later When the time difference from the time when the finger is turned off is less than a certain time (for example, 0.1 second),

For a more detailed example, when the middle finger and the index finger are operated with the intention of turning off the touch screen at the same time, even if the middle finger is off the touch screen before the index finger, the stop time and the time the index finger is off This refers to an operation in which the all-on on / off is performed such that the time difference is less than a predetermined time (eg 0.1 second).

1.5.2..14.2. Most recommended multi drag

It is the simplest multi-drag operation for the user, and refers to the 'multi-all drag' performed by the index and the middle finger, which are the examples of the definition of the multi-all drag, and the index finger is recognized as the reference finger and the middle finger is better. In two-touch operation, the index finger and the index finger, which are both the sickle reference finger and the index finger (not off), start to be dragged together.

1.5.3 ... After single-touch After multi-touch

After the target button has been single-touched, after the single-touch state has been maintained for a certain time (for example, 0.1 second) or more, another at least one finger is additionally touched to become a multi-touch state (after multi-touch). Refers to. (From the point of view of the device, after the target button is single touched, after the single touch state is maintained for a predetermined time (e.g. 0.1 second), another at least one touch point is additionally touched to become a multi-touch state (multi After touch) refers to the operation to be performed.)

'After single touch multi touch operation' includes 'single touch after multi all on & off' and 'single touch after multi all drag'.

For example, “Single Touch After Multi All On & Off”,

After the index finger is single-touched on the target button, the middle finger is additionally touched while the touch state of the index finger is held for a certain time (for example, 0.1 second), and the index finger is stopped by two touches. This includes the case where they are turned off at the same time. In the above example, it is a case where the multi-all on and off is made after the single touch is first detected with the index finger and then the middle touch is further touched to become the multi-touch state.

As an example of 'Single Touch After Multi All Drag',

After the index finger is single-touched on the target button, the middle finger is additionally touched while the touch state of the index finger is held for a certain time (for example, 0.1 second). This includes the case of dragging. In the above example, it is a case where the multi-all drag is made after the single touch is first touched by the index finger and then the touch is further touched to become the multi-touch state.

In addition to 'multi-all on & off after single touch' and 'multi-all drag after single touch', you can also create various 'post-touch after multi-touch operations' by assigning various post-touch operations after single touch.

1.6. Definition of terms about how to recognize the target button

Before entering the definition of the term, referring to the point of time of determining the target button from the point of view of the device, at least one touched so far, including the touch point in the single touch state, within the time that one (multi) touch is recognized In the state in which any one of the touch points is not turned off or started to be dragged, the target button may be updated (updated) every time a new touch occurs.

1.6.1..How to recognize target button by reference finger

(= Target button recognition method by reference touch point)

The target button recognition method by the reference finger is a method in which a finger of one of the multi-touch fingers is recognized as the reference finger, and a touch button including a point where the reference finger is touched is recognized as the target button. (From the point of view of the device, in the method of recognizing the target button by the reference touch point, any one of the multi-touch points is recognized as the reference touch point, and the touch button including the reference touch point is recognized as the target button. It is a way.)

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order

(Method of recognizing target button by reference touch point according to order of = X coordinate)

The touch button including a point having a specific order value among the order of the X coordinate value among the points where the multi-touched fingers are touched is recognized as the target button.

That is, a touch button including a point having a specific order value among the order of X coordinate values among the multi-touch points is recognized as a target button.

For example, a touch button including a leftmost point among the points touched by the multi-touch fingers, that is, a point having the first X coordinate value among the small orders of the X coordinate values is recognized as the target button.

For a more detailed example, the index finger touches button 5, and the middle finger touches the button 5, or the index finger including button 6 (or even button 9 or button #) in the keyboard layout of FIGS. 1, 3, and 4 When touched at any point on the right side of a point, the index finger touching the leftmost point on the touch screen is recognized as the reference finger, and the button is a button that includes the point where the index finger detected as the reference finger touches. 5 is recognized as the target button.

Even when the index finger is touched on the left part inside the button 5 and the middle finger is touched on the right part inside the button 5, the index finger touching the leftmost point on the touch screen is recognized as the reference finger, and the button 5 is the target. It is recognized as a button.

In this case, in the process of recognizing the reference finger, only the X coordinates of the multi-touched fingers are considered, and the Y coordinates of the multi-touched fingers are not considered.

Therefore, from the user's point of view, to multi-touch with the index finger and the middle finger so that the button 5 is recognized as the target button, the button 5 is touched with the index finger and the button including the point where the X coordinate value is larger than the button 5 or the button 5 with the middle finger. (E.g., button 3, button 6, button 9, or button #), or touch the borders of the buttons, resulting in two or more buttons 3, 6, 9, and # at the same time. Touch it.

Since the touch buttons including the points of a specific order among the order of the X coordinate values among the touched points of the multi-touched fingers are recognized as the target buttons, unlike the above example, the reference fingers are recognized as follows. The touch button including the point where the reference finger is touched may be recognized as the target button.

E.g,

1) The finger touched at the second point from the left (= touch point) may be set to be recognized as the reference finger (= reference touch point),

2) the finger touched at the third point from the left (= touch point) may be set to be recognized as the reference finger (= touch point),

3) The finger touched at the fourth point from the left (= touch point) may be set to be recognized as the reference finger (= touch point).

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order

(Recognition of target button by reference touch point in order of = Y coordinate value)

A touch button including a point having a specific order value among the order of the Y coordinate value among the points where the multi-touched fingers are touched is recognized as the target button.

That is, a touch button including a point having a specific order value among the order of the Y coordinate value among the multi-touch points is recognized as the target button.

This is possible because the lengths of the fingers are different. In most cases, the pause is longer than the index finger, so the following is assumed and given. So, when the index finger is touched on the button 5 when two-touch is detected with the right hand index and the middle finger, the middle finger is touched by the button 3, which is the upper side of the button 6, rather than the button 6, which is the button immediately to the right of the button 5. Is holding. If the index finger is longer than the middle finger, the index finger is bent and the middle finger is extended so that the middle finger is shaped as long as the middle finger.

For example, the touch button including the lowest point among the points touched by the multi-touch fingers, that is, the point having the first Y coordinate value among the small order of the Y coordinate values is recognized as the target button.

For a more detailed example, in the keyboard arrangement of Figs. 1, 3, and 4, the index finger touches button 5, and the middle finger is located above the point where the index finger touches, including button 3 (or even button 1 or button 2). When touched at any of the points, the index finger which is touched at the lowest point on the touch screen is recognized as the reference finger, and button 5 which is a button including the point where the index finger detected by the reference finger touches is the target button. Is recognized.

Even when the index finger touches the lower part inside the button 5 and the middle finger touches the upper part inside the button 5, the index finger touching the lowest point on the touch screen is recognized as the reference finger, and the button 5 is the target finger. It is recognized as a button.

In this case, when the reference finger is recognized, only the Y coordinates of the multitouch fingers are considered, and the X coordinates of the multitouch fingers are not considered.

Therefore, from the user's point of view, to multi-touch with the index finger and the middle finger so that the button 5 is recognized as the target button, the button 5 is touched with the index finger and the button includes a point having a larger Y coordinate value than the button 5 or the button 5 with the middle finger. (E.g., button 1, button 2, or button 3), or one or more of the buttons are touched, and as a result, two or more of buttons 1, 2, and 3 can be touched simultaneously.

Since the touch buttons including points of a specific order among the order of the Y coordinate value among the points where the multi-touched fingers are touched are recognized as the target buttons, unlike the above example, the reference finger is recognized in the following manner, The touch button including the point where the reference finger is touched may be recognized as the target button.

E.g,

1) The finger touched at the second point from the bottom (= touch point) may be set to be recognized as the reference finger (= reference touch point),

2) the finger touched at the third point from the bottom (= touch point) may be set to be recognized as the reference finger (= touch point),

3) The finger touched at the fourth point from the bottom (= touch point) may be set to be recognized as the reference finger (= touch point).

On the other hand, when the reference finger recognition method is applied, the multi-teach using both hands is possible while the right hand and the left hand are alternated. This is because the same rule can be applied to both left and right hands. More specifically, for example, the touch button including the lowest point among the points touched by the multi-touch fingers, that is, the point having the first Y coordinate value among the smallest values of the Y coordinate value, is used as the target button. When the recognition method is applied, when the multi-touch using the index finger and the middle finger alternates between the right hand and the left hand, the index finger of both hands touched the lower touch point among the multi-touch touch points, whether the right hand or the left hand is used. This is because a button including the touched point, which is recognized as a reference finger, and a point where the index finger of both hands is touched is recognized as the target button.

However, according to the target button recognition method by the reference finger according to the X-coordinate value order, multi-teach alternately used is practically impossible. For the same rule cannot be applied to both left and right hands.

In more detail, for example, a touch button including a leftmost point among the points touched by the multi-touched fingers, that is, a point having the first X coordinate value in a small order of the X coordinate values is used as the target button. If the recognized method is applied and both hands are alternately touched by both the index finger and middle finger, the middle finger will be recognized as the reference finger when the left hand indexes and middle finger. This is because the index finger will be recognized as the reference finger in the case of two touches.

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touch number

(= Recognition method of target button by reference touch point according to X coordinate value order according to multi-touched number)

According to the n value in the multi-touch situation, a specific order to be set in the order of the X coordinate values in which the reference finger is recognized is determined in the method of recognizing the target button by the reference finger according to the X coordinate value order. From the point of view, according to the n value in the multi-touch situation, a specific order to be set in the order of the X coordinate values at which the reference touch points are recognized is determined in the method of recognizing the target button by the reference touch points according to the X coordinate value order. That's how it works.)

For example,

1) When 2 touches, the finger touched on the first point from the left (= touch point) is recognized as the reference finger (= reference touch point),

2) When 3 multi-touch, the finger touched on the second point from the left (= touch point) is recognized as the reference finger (= reference touch point),

3) When 4 multi-touch, the finger touched at the third point from the left (= touch point) can be set to be recognized as the reference finger (= reference touch point).

For example, in the keyboard of FIG. 3 or 4 and the arrangement,

1) When Button 2 is single-touched by the index finger, the first character assigned to Button 2 is entered.

2) When the button 2 is touched by the index finger and the button 3, which is the right button of the button touched by the index finger, becomes 2 multi-touch touched by the middle finger, the index finger, which is the finger touched at the first point from the left, is recognized as the reference finger. The button 2 touched by the index finger, which is the reference finger, is recognized as the target button, and the second character assigned to the target button 2 is input.

3) When button 1 is touched by the index finger, button 2, the right button of the button touched by the index finger, is touched by middle finger, and button 3, the right button of the button touched by the middle finger is 3 multi-touched by finger ringing, left The middle finger, which is the finger touched at the second point, is recognized as the reference finger and the touched button 2 by the middle finger, which is the reference finger, is recognized as the target button, so that the third character assigned to the target button 2 is input. have.

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number

(= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

According to the n value in the multi-touch situation, specific orders to be set in the order of the Y coordinate values in which the reference finger is recognized in the method of recognizing the target button by the reference finger according to the Y coordinate value order are determined. From the point of view, according to the n value in the multi-touch situation, the specific order to be set in the order of the Y coordinate value at which the reference touch point is recognized is determined in the method of recognizing the target button by the reference touch point according to the Y coordinate value order. That's how it works.)

For example,

1) When 2 touches, the finger touched on the first point from the bottom (= touch point) is recognized as the reference finger (= reference touch point),

2) When 3 multi-touch, the finger touched at the second point from the bottom (= touch point) is recognized as the reference finger (= reference touch point),

3) When 4 multi-touch, the finger (= touch point) touched at the third point from the bottom can be set to be recognized as the reference finger (= reference touch point).

For a more specific example, in the keyboard of Figure 3 or 4 and the arrangement,

1) When button 5 is single-touched by the index finger, the first character assigned to button 5 is entered.

2) When the button 5 is touched by the index finger and the button 2, which is the upper button of the button touched by the index finger, becomes 2 multi-touch touched by the middle finger, the index finger, which is the finger touched at the first point from the bottom, is recognized as the reference finger. The button 5 touched by the index finger, which is the reference finger, is recognized as the target button so that the second character assigned to the target button 5 is input.

3) When the button 8 is touched by the index finger, the button 5 which is the upper button of the button touched by the index finger is touched by the middle finger, and the button 2 which is the upper button of the button touched by the middle finger is 3 multi-touched by the ring finger. The middle finger, which is the finger touched at the second point, is recognized as the reference finger, and the button 5 touched by the middle finger, which is the reference finger, is recognized as the target button so that the third character assigned to the target button 5 is input. have.

1.6.2 .. Target button recognition method with open fingers

(= Recognition of target button by open touch point)

The method for recognizing the target button by the open fingers is a method in which a touch button including a new point determined based on the points at which the multi-touched fingers are touched is recognized as the target button. The following five methods are included. (From the point of view of the device, the method of recognizing the target button by the open touch points) includes a touch including a new point determined based on the multi-touch points. The button is recognized as the target button.)

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

The touch button includes a new X coordinate determined based on the X coordinates of the touched points of the multi-touched fingers, and a new Y coordinate determined based on the Y coordinates of the touched points of the multi-touched fingers. A method of recognizing a target button is also possible. (From the point of view of the device, a new X coordinate determined based on the X coordinates of the multi-touch points and a new coordinate determined based on the Y coordinates of the multi-touch points. A touch button including a point consisting of a Y coordinate may be recognized as a target button.)

For example, a touch button includes a new X coordinate that is the center of the X coordinates of the touched points of the multi-touched fingers, and a new Y coordinate that is the center of the Y coordinates of the touched points of the multi-touched fingers. It is also possible to recognize the target button.

For example, if the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the touch point of the index finger is X3 (= (X1). A touch button including a point (X3, Y3) consisting of + X2) / 2) and Y3 (= (Y1 + Y2) / 2), which is an intermediate coordinate between Y1 and Y2, is recognized as a target button.

More specifically, for example, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the index finger and the middle finger are used to multi-touch,

When the index finger touches the button 4 and the stop touches the button 6, the button 5 is recognized as the target button, even if the index finger touches the button 7 and the stop touches the button 3, the button 5 is recognized as the target button. .

1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)

A new X coordinate determined based on the X coordinates of the touched points of the multi-touched fingers, and a point consisting of the Y coordinates paired with the X coordinates in a specific order of the X coordinate value order of the touched points of the multi-touched fingers. It is also possible to recognize a touch button including a target button as a target button. (From the point of view of the device, a new X coordinate determined based on the X coordinates of the multi-touch points and the X coordinate value of the multi-touch points. A touch button including a point consisting of a Y coordinate paired with an X coordinate in a specific order among the size order may be recognized as a target button.)

For example, a new X coordinate that is the center of the X coordinates of the touched points of the multi-touched fingers, and Y paired with the X coordinate of the first order of the small order of the X coordinate values of the touched points of the multi-touched fingers. It is also possible to recognize a touch button including a coordinate, that is, a point consisting of a Y coordinate paired with the smallest X coordinate as a target button.

For example, if the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the touch point of the index finger is X3 (= (X1). The touch button including the point (X3, Y1) consisting of + X2) / 2) and Y1 is recognized as the target button. (Usually, since the right hand is touched, the index finger is located to the left of the middle of the middle finger, that is, the X coordinate. Since the value will be touched at a smaller point, the X coordinate of the first order of the smaller value of the X coordinate value is X1, which is the X coordinate of the point where the index finger is touched, and the Y coordinate paired with the X1 is Y1.)

More specifically, for example, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the index finger and the middle finger are used to multi-touch,

When the index finger touches the button 4 and the stop touches the button 6, the button 5 is recognized as the target button, even if the index finger touches the button 4 and the stop touches the button 3, the button 5 is recognized as the target button. .

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

The touch button includes a new X coordinate determined based on the X coordinates of the touched points of the multi-touched fingers and a Y coordinate in a specific order among the Y coordinate value sizes of the touched points of the multi-touched fingers. A method of recognizing a target button is also possible. (From a device's point of view, a new X coordinate determined based on the X coordinates of the multi-touch points and a Y-value value of the multi-touch points. A touch button including a point consisting of a Y coordinate may be recognized as a target button.)

For example, a new X coordinate that is the center of the X coordinates of the touched points of the multi-touched fingers, and a point consisting of the Y coordinate of the first order of the smaller order of the Y coordinate values of the touched points of the multi-touched fingers are included. The touch button may be recognized as the target button.

For example, if the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the touch point of the index finger is X3 (= (X1). The touch button including the point (X3, Y1) consisting of + X2) / 2) and Y1 is recognized as the target button. (Usually, since the index finger is shorter than the middle finger, the index finger is lower than the middle finger, that is, Since the Y coordinate value will be touched at a smaller point, the first Y coordinate of the smaller order of the Y coordinate value is Y1, which is the Y coordinate of the point where the index finger is touched.)

More specifically, for example, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the index finger and the middle finger are used to multi-touch,

When the index finger touches the button 4 and the stop touches the button 3, the button 5 is recognized as the target button, even if the index finger touches the button 4 and the stop touches the button 6, the button 5 is recognized as the target button. .

1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)

The new Y coordinate determined based on the Y coordinates of the touched points of the multi-touched fingers, and the X coordinate paired with the Y coordinates in a specific order among the Y coordinate value sizes of the touched points of the multi-touched fingers. It is also possible to recognize a touch button including a target button as a target button. (From the point of view of the device, a new Y coordinate determined based on the Y coordinates of the multi-touch points and the Y-coordinate value of the multi-touch points. A touch button including a point consisting of X coordinates paired with Y coordinates in a specific order of the size order may be recognized as a target button.)

For example, a new Y coordinate that is the center of the Y coordinates of the touched points of the multi-touched fingers, and X paired with the Y coordinate of the first order of the smaller order of the Y coordinate values of the touched points of the multi-touched fingers. It is also possible to recognize a touch button including a coordinate, that is, a point composed of X coordinates paired with the smallest Y coordinate as a target button.

For example, in the case where the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), it is Y3 (= (Y1) which is the intermediate coordinate between Y1 and Y2. The touch button, which includes the point (X1, Y3) consisting of + Y2) / 2) and X1, is recognized as the target button. (Normally, regardless of whether the index finger is shorter than the stop, In the 90-degree turn, the index finger will touch the point below the stop, that is, the point where the Y coordinate value is smaller, so that the Y coordinate of the first order of the smaller order of the Y coordinate value is the Y of the point where the index finger is touched. The coordinate is Y1, and the X coordinate paired with the Y1 is X1.)

More specifically, for example, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the index finger and the middle finger are used to multi-touch,

With the right hand turned 90 degrees counterclockwise, if the index finger touches button 8 and the stop touches button 1, button 5 is recognized as the target button, and even the index finger touches button 8 and the stop button 2 Even if it is touched, the button 5 is recognized as the target button.

1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point)

The touch button includes a new Y coordinate determined based on the Y coordinates of the touched points of the multi-touched fingers, and a point consisting of the X coordinates in a specific order among the X coordinate value sizes of the touched points of the multi-touched fingers. A method of recognizing a target button is also possible. (From the standpoint of the device, a new Y coordinate determined based on the Y coordinates of the multi-touch points, and an X coordinate value size order of the multi-touch points. A touch button including a point consisting of X coordinates may be recognized as a target button.)

For example, a new Y coordinate that is the center of the Y coordinates of the touched points of the multi-touched fingers, and a point consisting of the X coordinate of the first order of the larger order of the X coordinate values of the touched points of the multi-touched fingers are included. The touch button may be recognized as the target button.

For example, in the case where the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), it is Y3 (= (Y1) which is the intermediate coordinate between Y1 and Y2. The touch button including the point (X1, Y3) consisting of + Y2) / 2) and X1 is recognized as the target button. (In general, since the index finger is shorter than the stop, the right hand is turned 90 degrees counterclockwise. In the rotated state, the index finger will be touched at the right point (although down), but at a point where the X coordinate value is larger than the stop, so the X coordinate of the first order of the larger X coordinate value is the point where the index finger is touched. Is the X coordinate of X1.)

More specifically, for example, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the index finger and the middle finger are used to multi-touch,

With your right hand turned 90 degrees counterclockwise, if your index finger touches button 8 and your stop touches button 1, button 5 is recognized as the target button, and even your index finger touches button 8 and your stop Even if it is touched, the button 5 is recognized as the target button.

1.6.3 .. Target button recognition method by range including 2 or more touch points

As a method of recognizing a target button when a multi-touch is made, the device recognizes a range including two or more touch points as a target button or a target range. In this method, the target range or the target button should be considerably wide. Since the button assigned the character for character input is small in size, it is very difficult for two fingers to touch the same button. It can be said that the recognition is actually very difficult, and the object including the picture or the picture is large enough to accommodate two fingers, so in this way, the target button can be recognized in most cases. However, if the object is too small, it is also very difficult to recognize the target button in this way. Since the object is too small, the method of recognizing the target button by the reference finger is most recommended.

When the target button recognition method based on the range including two or more touch points is applied as the target button recognition method, the device recognizes the hitting point in various ways. For example, it is possible to select and set any one of the hitting point recognition methods for the various target button recognition methods described in "1.6 Definition of the term for the target button recognition method".

1.6.4 .. Mixed

The above-described 'target button recognition method by the open fingers' and 'target button recognition method by the reference finger' may be mixed and the target button may be recognized. For example, when the distance between the fingers to be multi-touch is greater than or equal to a certain distance and when less than a certain distance can be distinguished and used.

Specifically, in the keyboard of the arrangement as shown in FIG. 1 or 3 or 4,

When you want to enter one of the letters A, B, or C on the button assigned to the touch button assigned ABC,

1) The first letter A is input when the button is operated once after 'Single Touch'.

2) When the multi-touch fingers are multi-touched so that the distance is less than a certain distance, when the target button recognition method by the reference finger is set to be applied among the various methods of recognizing the target button, the detection and stop by If the buttons assigned to ABC are touched so that the distance between the touch points is less than a certain distance, and the buttons are operated after detecting and stopping two touches so as to be the target button, the second letter B is input.

3) When the multi-touch finger is multi-touched so that the distance is more than a certain distance, when the 'target button recognition method by the open finger' is set to be applied among the various methods for recognizing the target button, the detection and stop by If the buttons assigned to ABC are more than a predetermined distance apart from the touch points and are operated after two multi-touch operations with the detection and the middle so that the buttons assigned to the target buttons become the target buttons, the third letter C can be made.

2. Synthesis

As explained in the next section,

After the multi-touch operation is used, a general situation in the process of inputting text and changing the shape of an object is performed.

In operation after multi-touch,

The mainly used hand is the right hand,

Mainly used n multi-touch is two multi-touch is used for detection and middle finger,

The method of recognizing the target button mainly used is the leftmost point of the touched points of the multi-touch fingers among the target button recognition methods by the reference finger according to the X coordinate value order among the target button recognition methods by the reference finger, that is, X The touch button including a point having the smallest X coordinate value among the small order of the coordinate values, that is, the X coordinate value is recognized as the target button.

In addition, a multi-touch mainly used is a multi-all touch among various multi-touch methods mentioned in the definition of the term for multi-touch. In other words, multi-touch fingers are touched at the same time.

In addition, the post-touch operation methods which are mainly used are a multi all on & off and a multi all drag method.

In other words, the right index finger and middle finger are 2 multi-touch, and in 2 multi-touch, the index finger is touched on the target button, and the middle finger is touched anywhere on the right side of the index finger, so that the index finger and middle finger are turned off at the same time. This means that the index finger and the middle finger are operated to be dragged while the touch and middle finger state is maintained. At this time, the index finger is recognized as the reference finger, and the middle finger is recognized as the sickle reference finger.

In addition, in the content of the whole application including the Example mentioned later,

Unless otherwise mentioned about the hand used in the multi-touch operation, the multi-touch method, the target button recognition method, and the post-touch operation method, the above-mentioned mainly used methods may be regarded as an embodiment to which it is applied.

In addition, what has been described as being operated after the multi-touch may be regarded as being operated while being multi-touched so that any button can be recognized as the target button unless otherwise specified.

In addition, in the operation after the single touch, unless otherwise specified, a mainly used finger is an index finger, and a target button may be touched by an index finger, and it may be considered as an embodiment in which a method of turning off or dragging afterwards is applied.

However, it should be borne in mind that this is an example for convenience of explanation, and the used hand, n-multi-touch method, reference finger setting and target button recognition method, and post-touch operation method are different from the frequently used methods and embodiments mentioned above. It should be noted that the implementation is included in the technical spirit of the present invention.

For example, the left hand may be used, and the recognition method using the reference finger may be a touched finger on a point where the Y coordinate value of the touched point is the smallest among the multi-touched fingers. Of course, the target button recognition method by the fingers can be applied.

And, if the technique introduced in a specific part of the present application can also be applied to other parts, it can be applied to other parts as well.

In addition, the keyboard to which the method of the present application is applicable is not limited to the type described for example herein but may be applied to various types of keyboards developed in the related art or to any type of keyboard newly developed.

In the following embodiments, the target button recognition method by the reference finger is mainly assumed as the target button recognition method because this method is convenient for the user. The target button recognition method by the reference finger,

1) Unlike the method of detecting the target button by the fingers, the user does not have to open the finger on purpose.

2) When each of the buttons of the 3X4 type keyboard is multi-touched to become the target button, if a 'target button recognition method using an open finger' is used, as shown in FIG. 3, one column is added to the left of the first column. Since one column should be added to the right of the third column, and as a result, a 5X4 keyboard is required. Button recognition method, which is one of the embodiments of the button recognition method, is the leftmost point among the touched points, that is, the first point among the small order of the X coordinate values, that is, the point where the X coordinate value has the smallest X coordinate value. If a touch button including a touch button is used as a target button and 2 multi-touch using right hand detection and middle finger is used, as shown in FIG. As a result, only 4x4 keyboards are needed, so the buttons for entering characters take up less space on the touchpad,

3) In order to be single touched by the index finger, the middle finger, the ring finger, and the possession must be held. On the other hand, when the index finger and middle finger are touched, only the finger and the finger can be pinched.

On the other hand, the spatial positional relationship (= relative distance) of the fingers (= touch point) at the moment of the multi-touch in the process after the multi-touch operation and the spatial positional relationship of the fingers (= touch point) that the touch is maintained (= Obviously, the difference in relative distances should be kept below a certain threshold.

For example, it is difficult for the fingers that are held in touch in the process of being manipulated as compared to the moment when they are multi-touched to be pinched or stretched more than a predetermined reference value.

For reference, when the multi-touch is implemented, the fingers of both hands may be implemented. For example, two multi-touch may be implemented using one thumb of both hands.

3. Character input method on touch screen

Hereinafter, a method of inputting a character on a touch screen by applying the aforementioned various operations will be described in detail.

First, in a device having a touch screen, a method of inputting a character,

On the touch screen, a keyboard with a button assigned with a plurality of characters is displayed.

When a button is operated after multi-touch so that a specific button is recognized as a target button, after the time when the operation starts after the multi-touch including after the start of the operation after the multi-touch or after the end of the operation,

The method may be a method of inputting a specific sequence of characters among the characters assigned to the button recognized as the target button by the multi-touch operation.

Additionally,

According to the operation after the multi-touch, a specific sequence number of the input character may be determined,

In the above, if the drag direction is different, it can be recognized that the operation type is different after the multi-touch,

In certain characters from among at least one character belonging to a specific character group among the at least one character group and associated with the button recognized as the target button, the specific character is selected from the at least one character group according to the situation before the final operation. The character group may be matched and belong to the matched character group, and at least one of the at least one character associated with the target button may be input without changing the character mode.

Thus, the type of the situation before the final operation and the specific character group different from the character group input by the operation method after the single touch are matched, and the characters of the matched character group are matched. It can also be entered without changing the text mode.

The "specific character group" may be any one of the following character groups.

1) A group of characters assigned to a specific line among the characters assigned to the same button.

2) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button (If the first specific order and the second specific order are the same, it means one order.)

3) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

If it is expanded further, it can be extended up to 4) and 5) below.

4) A character group of any two or more different character groups classified into different series according to the spelling rules.

5) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.

4 is a view showing a pad including a conventional 3X4 keyboard.

(In the pad shown in FIG. 4, the blank buttons in the rightmost fourth row are drawn to add function buttons as well as free space for multi-touch, rather than buttons having any function.)

The pads shown in FIG. 4 are assigned English characters as follows.

1) Button 2 is assigned ABC,

2) DEF is assigned to button 3,

3) Button 4 is assigned GHI,

4) JKL is assigned to button 5,

5) MNO is assigned to button 6,

6) Button 7 is assigned PQRS,

7) Button 8 is assigned a TUV,

8) Button 9 is assigned WXYZ,

9) Button 1, *, 0, # does not have alphabetic characters.

Among the buttons provided in the phone button pad shown in FIG. 1, four buttons (W, X, Y, and Z) are assigned to the buttons having the most letters assigned thereto.

In the present embodiment, 10 to 6 lowercase letters and special characters are additionally assigned to the buttons, and if the buttons are assigned to each of 10 characters, the first to fifth characters are operated after single touch. ', And the sixth to tenth characters may be input as' manipulating after multi-touch'.

for example,

1) The first letter assigned to each button can be entered with each button single on & off with the index finger,

2) The second letter assigned to each button can be entered by dragging the button upwards (= north) after each button is single-touched by the index finger,

3) The third letter assigned to each button can be entered by dragging the button to the right (= east) direction after each button is single-touched by the index finger.

4) The fourth character assigned to each button can be input by dragging downwards (= south) after each button has a single touch with the index finger.

5) The fifth character assigned to each button can be entered by dragging the button to the left (= west) direction after each button is single-touched by the index finger.

6) The sixth character assigned to each button can be input by 'multi all on & off' after each touch is multi-touched by the detection and the middle so that each button is recognized as a target button.

7) The seventh character assigned to each button may be input by 'multi-all dragging' upwards (= north) direction after the multi-touch of each button is detected and stopped so that each button is recognized as a target button.

8) The eighth character assigned to each button may be input by 'multi-all dragging' to the right (= east) direction after multi-touching the index and middle finger so that each button is recognized as a target button.

9) The ninth character assigned to each button may be input by 'multi-all dragging' toward the bottom (= south) direction after multi-touching the index and middle finger so that each button is recognized as the target button.

10) The tenth character assigned to each button may be input by 'multi-all dragging' to the left (= west) direction after the multi-touch is detected and stopped so that each button is recognized as the target button.

If the sixth character assigned to button 5 is assumed to be a question mark "?"

a) When button 5 is touched by the index finger, and at any point on the right side of the index finger (i.e., the point where the X coordinate value is larger than the index finger, the Y coordinate is irrelevant point, for example, button 6 or button 3) or by middle finger, , The index finger becomes the reference finger and button 5 is recognized as the target button.

b) In this state, when the 'multi-all on &off' (ie, the detection and stop are released at the same time (= off)), the question mark "?" is entered.

And, assuming the seventh character assigned to button 5 as the heart "♥",

a) Button 5 is touched with the index finger and with the middle finger to the right of the index finger, button 5 is recognized as the target button,

b) In this state, when all-drag in the upward direction (= north) (that is, when the index finger and middle finger are dragged while being touched on the touch screen), the heart "♥" is input.

Meanwhile, when the sixth character is input, it is also possible to use 'Multi Not All On & Off' instead of 'Multi All On & Off', and more specifically, 'Multi Not All Reference Finger On & Off' is used. It is possible.

For example, in order to input the question mark "?" Which is the sixth character assigned to the button 5, after the button 5 is multi-touched to be recognized as the target button, the stop of the sickle reference finger is first turned off and then a certain time ( (For example, 0.1 second), the index finger, which is the reference finger, is turned off.

In addition, when the seventh to tenth characters are input, 'multi not all drag' may be used instead of 'multi all drag', and more specifically, 'multi not all reference finger drag' may be used.

For example, in order to enter the seventh letter "♥" assigned to button 5, after the button 5 is multi-touched to be recognized as the target button, only the reference finger, the index finger, is turned off with the sickle reference finger off. While attaching to the touch screen, the finger drags upward to the multi (north) direction.

On the other hand, as a method of recognizing a target button in the case of using multi-touch, the method of recognizing a target button using open fingers is set apart from the reference finger according to the order of X coordinate values among the target button recognition methods using a reference finger. Target button recognition method, which is one of the embodiments of the multi-touch fingers, that is, the first of the smallest points of the X coordinate values, that is, the X coordinate value has the smallest X coordinate value. Only the method in which the touch button including the point is recognized as the target button is used, and even if only two multi-touchs in which the right hand detection and the middle finger are used are used, as a method of operation, only the following three operation methods are applied, Even if 15 characters are included, characters can be entered quickly and easily without changing the character mode, or they can be assigned to different character modes on the same button. These are characters that can be entered quickly and easily without changing text mode.

1) 'Single On & Off', 'Single Drag' in 4 directions,

2) 'Multi All On & Off', 'Multi All Drag' in 4 directions,

3) 'Multi Not All Reference Finger On &Off', 4-way 'Multi Not All Reference Finger Drag'

Now, in a device having a touch screen, in a method of inputting a character, after a keyboard is displayed on the touch screen, a particular button is operated after multi-touch so that a specific button is recognized as a target button.

The final operation of one of the final operations may be started, which may include nine behaviors including dragging in each direction of off or up, down, left, right (, top left, bottom left, top right, bottom right). After the start of the final operation, including after the point in time or after the end of the last operation,

By a multi-touch post operation including a final manipulation of at least one of the final manipulations which may include nine behaviors including off or eight dragging,

In the specific character group of the at least one character group, belonging to a specific character group of at least one character associated with the button recognized as the target button is input,

According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character associated with the target button is input without belonging to the character group while belonging to the matched character group. Let's see how it can be done.

In addition, the "specific character group" may be any one of the following character groups.

1) Any character group from two or more different character groups classified under different spelling rules.

2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.

To expand further, it can be extended to the following cases 3), 4) and 5).

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button.

5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

When the above method is applied, Japanese input will be described as an example in which characters assigned to different text modes on the same button can be easily and quickly inputted without changing the text mode.

Japanese is divided into different types of letters such as hiragana and katakana, even though the letters have the same pronunciation as the upper and lower case letters of English.

Therefore, in hiragana character mode, without changing the character mode

1) 5 characters of hiragana are inputted using 'Single On & Off' and 'Single Drag' in 4 directions.

2) 5 katakana characters are inputted using 'Multi All On &Off' and 'Multi All Drag' in 4 directions.

3) Five special characters can be input by using 'Multi Not All Reference Finger On & Off' and 4-way 'Multi Not All Reference Finger Drag'.

Naturally, even in katakana mode, hiragana characters and special characters may be input without changing the character mode.

The above embodiment will be described in more detail.

5 shows a Japanese input keyboard of the 3X4 type. In the input keyboard as shown in Fig. 5, five Japanese characters are assigned to each button, and only one representative character is displayed among the five assigned characters.

5 is a Japanese input keyboard in hiragana character mode.

First, to explain how hiragana is input in hiragana mode,

When a button is 'single touched' (the following method, it is also possible to turn off after single touch). As shown in the upper drawing of FIG. 6, the five hiragana characters assigned to the single touched button are displayed. All of them pop up. Here are two examples of how to enter the characters you want.

1. The desired hiragana may be input in such a manner that one of the pop-up hiragana characters is touched (eg, single touched) after the single-touch finger is turned off. As a result, two touches are required to input a desired character.

2. The single touched finger is not turned off, and the desired hiragana character can be input by single dragging in the direction of the desired hiragana character. If the desired hiragana character is located in the center, the hiragana character located in the center may be input by turning off the finger without dragging. That is, five hiragana characters may be input by single on & off and single drag in four directions.

Now, let's explain how to input Katakana characters without changing the character mode in Hiragana mode.

 When a button is 'multi-touch' to be recognized as a target button (a condition of turning off after multi-touch in the following method 1 is possible), as shown in the lower figure of FIG. In addition, all five katakana characters assigned to a button 'multi-touch' to be recognized as a target button pop up. In this case, there are two examples of a method of inputting a desired character.

1. The desired katakana characters may be input in such a manner that one of the pop-up katakana characters is touched (for example, single touch) after the multi-touched fingers are turned off at the same time. As a result, two touches are required to input a desired character.

2. The multi-touch fingers are not turned off, and all the fingers are multi-drag in the direction in which the desired katakana character is located so that the desired katakana character can be input. If the desired katakana character is located at the center, the multi-touch fingers may be simultaneously turned off without dragging so that the katakana character located at the center may be input. That is, five katakana characters may be input by multi-all on & off and multi-all drag in four directions.

In addition, the above method may be applied to a conventional QWERTY keyboard as shown in FIG. 7 or 60. For example, if the current text mode is lowercase letters,

1) Single on & off is used to enter lowercase letters in English,

2) Multi on & off is used, even though the current text mode is lowercase letters, English capital letters are input without changing the text mode. That is, without changing the character mode, it is possible to input a character of another character mode corresponding to the current character mode.

For example, if the current text mode is lowercase letters,

When the button S is single on and off, a lowercase letter s is input. When the button S is multi-all on and off so that the button S is recognized as a target button, the uppercase letter S may be input even though the current letter mode is an English lowercase mode.

(To make button P and button L, which are the rightmost buttons in Fig. 7, recognized as target buttons during multi-touch, in most cases, there is enough free space in which no characters are allocated at the far right as in Fig. 8 or 60. It would be better if you had.

In addition, the button V is displayed immediately to the right of the button T of FIGS. 7, 44, and 62. In reality, the button V is displayed incorrectly as shown in FIG. The text of the present application may be understood by replacing button V with button Y just to the right of button T. Even if you don't think about it, it doesn't matter if you understand the application.)

Now, in a device having a touch screen, in a method of inputting characters, in a process of multi-on & off so that a specific button is recognized as a target button,

After the point of multi-touch or after the point of multi-touch, including after the point at which the multi-touched finger is off (= multi-touch is released),

A method of inputting a specific sequence number of characters among the characters assigned to the button recognized as the target button will be described.

In addition, when the multi-touch is represented in more detail with n multi-touch, the specific sequence may be determined according to the n value, and the n value and the numerical value corresponding to the sequence of the specific sequence may be determined to be the same. have.

In particular, as in the QWERTY keyboard with the smartphone upright, in order to compensate for the problem that a large number of typos occur due to a case where a button is small and a user incorrectly presses a target button incorrectly, as shown in FIG. 8. Compared to the buttons shown in FIG. 7, after the size of the button is larger, two or more characters may be assigned to one button, and then inputted without a typo by the following exemplary method.

1) If 'Single On & Off' is used, the first letter of each button is entered.

2) If 'multi on &off' is used, the second character of each button recognized as the target button can be input.

Referring to the button assigned to the 'QW' of FIG. 8 as an example,

1) When the button assigned with 'QW' is 'Single On & Off' after single touch, that is, single on & off starting with single touch, for example, the button assigned with 'QW' is touched by the index finger. And immediately turned off, the first letter 'Q' of the button assigned to 'QW' is inputted,

2) If the button assigned to 'QW' is 'multi all on & off' after being multi-touched so as to be recognized as the target button, that is, the multi-all on & off starting with multi-touch, for example, as shown in FIG. When the button assigned to 'QW' is touched by the index finger and the middle finger is touched at any point on the right side of the index finger, when both the index finger and the middle finger are turned off at the same time, 'W', which is the second letter of the button assigned to 'QW', is entered. Will be.

According to this, the second character assigned to each button can be directly input by one touch action. Even if it is 2 multi-touch, the wrist or elbow is used only once, so it can be called as one touch. Still, since the buttons of FIG. 8 are larger in size than the buttons of FIG. 7, few typos occur.

On the other hand, in the case of the Hangul keyboard as shown in FIG. 10 in which the conventional Hangul QWERTY keyboard as shown in FIG. 9 is improved, the principles of the above-described input method may be applied. It can be fully understood without detailed explanation.

In addition, the input method described above may be applied to the case where three characters are assigned to one button as shown in FIG. 11. Specifically,

1) The first letter assigned to each button is single touched and then input single on & off,

2) The second letter assigned to each button is inputted as multi all on & off after two multi-touches so that each button is recognized as a target button.

3) The third character assigned to each button may be input as multi-all on & off after three multi-touches so that each button is recognized as a target button.

To give a more specific example,

1) When a button assigned with 'QWE' is single on and off after being single touched, that is, single on and off starting with single touch, for example, the button assigned with 'QWE' is touched with an index finger. When it is off, the first letter 'Q' of the button assigned 'QWE' is inputted.

2) If the button assigned to 'QWE' is multi-all on and off after 2 multi-touching so as to be recognized as the target button, that is, if the multi-all on and off starts with 2 multi-touch, for example, 'QWE' If the assigned button is touched by the index finger, the middle finger is touched at any point on the right side of the index finger, and both the index finger and the middle finger are turned off at the same time, the second letter of the button assigned with 'QWE' is entered, 'W',

3) When the button assigned with 'QWE' is multi-all on and off after 3 multi-touching so as to be recognized as the target button, that is, when the multi-all on and off starts with 3 multi-touch, for example, 'QWE' If the assigned button is touched by the index finger and the middle finger and any finger on the right side of the index finger are multi-touched, and the index, stop, and ring finger are all turned off at the same time, the third letter of the button assigned with 'QWE' is assigned. It may be implemented to input 'E'.

According to this, the third character assigned to each button can be directly input by one touch action. Even in the case of 3 multi-touch, the wrist or elbow is used only once. Still, since the buttons of FIG. 11 are larger in size than the buttons of FIG. 7 or 8, no typos occur more.

In the method of inputting the third letter in FIG. 11, the special character including a punctuation mark is additionally assigned to at least one button of the keyboard as shown in FIG. 8 in which two letters are assigned to one button. By applying to the type of keyboard (not shown) with a button assigned to three characters, it is possible to apply the third special character assigned to each button quickly and easily without changing the text mode. It would be much more useful to do this than in FIG.

Meanwhile, in order to input 'S' in the keyboard layout as shown in FIG. 4, if the button assigned with 'PQRS' is multi-touched to be recognized as the target button and then multi-all on and off, that is, 4 multi-touch When starting multi All On & Off, for example, button 7 assigned with 'PQRS' must be touched by the index finger, and touched by any point on the right side of the index finger with the middle finger, middle finger, and multi-touch. When all of the middle finger, middle finger, ring finger, and possession are turned off at the same time, the fourth letter 'S' of the button 7 may be input. In this case, the fourth character assigned to each button can be directly input by one touch action.

The input principle related to FIG. 8, 10, 11, or 4 is 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, and FIG. 57, 58, 63, 64, 65, 66, 67 of course, two or three letters per button can be equally applicable to the form is assigned. (Refer to the section “Short Description of Drawings” for additional description of the drawings.)

In particular, Japanese is composed of 50 digits. To implement a QWERTY keyboard, 50 buttons are required. In the past, only 26 buttons are required. It is expected that too many typos will occur because it is expected to implement and use 50 keyboards in a standing state, but it is virtually impossible to implement and use a QWERTY keyboard in Japanese, but as shown in FIG. 47, two characters are assigned to each button. By implementing only 25 buttons, Japanese can also be used as a QWERTY keyboard.

In Indian, like Japanese, a mobile phone keyboard having 12 keypads of physical buttons is often assigned five characters per button. Therefore, in a device equipped with a touch screen including a smartphone, it is almost the same as Japanese. You will be able to enter characters in any way.

In addition, a method of inputting double consonants in the Hangul input associated with FIGS. 52, 53, 57, 58, 63, 64, and 67 will be described. FIG. 57 will be described as a representative drawing. However, it will be easily understood that the same or almost the same method may be applied to the remaining drawings, and thus will not be described separately.

In FIG. 57, different phonemes are paired and assigned to each button as follows.

'ㄱ' and 'ㄴ', 'ㄷ' and 'ㄹ', 'ㅁ' and 'ㅂ', 'ㅅ' and 'ㅇ', 'ㅈ' and 'ㅊ', 'ㅋ' and 'ㅌ', ' ',' ㅎ ',' ㅏ 'and' ㅑ ',' ㅓ 'and' ㅕ ',' ㅗ 'and' ㅛ ',' TT 'and' ㅠ ',' ㅡ 'and' ㅣ '

(For reference, 40 Hangul phonemes are as follows.

14 basic consonants: ㄱ ㄴ ㄹ ㅁ ㅁ ㅎ ㅎ ㅋ ㅋ ㅋ ㅋ

5 horns: ㄲ ㄸ ㅃ ㅆ ㅉ

10 basic collections: ㅏ ㅑ ㅓ ㅕ ㅗ ㅛ ㅜ ㅠ ㅡ ㅣ

11 vowels: ㅐ ㅒ ㅔ ㅖ ㅚ ㅟ ㅘ ㅝ ㅢ ㅙ ㅞ)

Referring to the method of inputting 14 basic consonants and 10 basic vowels, as shown in FIG. 57, the first phonemes assigned to each button are single on and off after being single touched (= single touch). Can be entered using the Single On & Off method, and the second phonemes assigned to each button can be entered using the Multi All On & Off method (= 2 Multi Touch On and Off). You can already type, but you already know

As you can see how to enter 11 vowels, you already know that you can enter a combination of basic vowels.

There are two ways to input double consonants. (The first method is not recommended. The second method is highly recommended.)

To explain the first method,

Like most methods of inputting consonants in a conventional Korean smart phone QWERTY keyboard as shown in FIG. 9, when the shift button (= up arrow) is pressed, the consonants are formed in place of the consonants among the basic consonants. When is displayed, the displayed double consonants are single-touched and input after being single-touched.

As in the conventional smartphone qwerty keyboard, when the shift button is pressed (the shift button is not displayed in FIG. 57, a shift button may be added when applied to an actual device, or the upward arrow in the bottom row of FIG. 57 is called a shift button). May be considered),

If 'ㄲ' is displayed in the place where 'ㄱ' is assigned, 'ㄲ' is single touched and then single on & off and 'ㄲ' is inputted.

If 'ㄸ' is displayed in the place where 'ㄷ' is assigned, 'ㄸ' is single touched and then single on & off and 'ㄸ' is inputted.

If 'ㅃ' is displayed in the place where 'ㅂ' is assigned, 'ㅃ' is single touched and then single on & off and 'ㅃ' is inputted.

If 'ㅅ' is displayed in the place where 'ㅅ' is assigned, 'ㅆ' is single touched and then single on & off and 'ㅆ' is entered.

If 'ㅈ' is displayed in the place where 'ㅈ' is assigned, 'ㅉ' is single touched, and then 'ON' can be input by single on & off.

To explain the second method,

Like the Korean input method in the conventional Samsung Electronics or Pantech 12-keypad format,

Assuming that the consonants from which the consonants from which the basic consonants can be derived are already assigned in the third order, but the consonants are not displayed, the multi-all on & off (= 3 multi-touch starts) As a method of inputting twin consonants in multi all on & off),

Since 'ㄲ' is assigned to the third position of the button to which 'ㄱ' is assigned, the button to which 'ㄱ' is assigned is multi-touched, and then multi-all on and off, and 'ㄲ' is inputted.

Assuming that '치' is assigned to the third digit of the button to which 'ㄷ' is assigned, 'ㄸ' is entered as multi-all on and off after the button '3' has been multi-touched.

Assuming that '멀티' is assigned to the third digit of the button to which 'ㅂ' is assigned, 'ㅃ' is input for multi all on & off after the button to which 'ㅂ' is assigned is multi-touched.

Assuming that '치' is assigned to the third digit of the button to which 'ㅅ' is assigned, '이' is entered as multi-all on & off after the button assigned to 'ㅅ' is multi-touched.

It is considered that 'ㅉ' is assigned to the third digit of the button to which 'ㅈ' is assigned, and 'ㅉ' can be input by multi All On & Off after the button assigned with 'ㅈ' is multi-touched. .

When the Korean language is input in the second method, in the case of FIG. 63 or 64, particularly, as shown in FIG. 63, the probability can be deeply input as follows.

1. It can be called as the more basic consonant among basic consonants, and the most frequently used a, b, c, d, d, ㅁ ㅂ, ㅅ, ㅇ, ㅈ are assigned to the first order of each button, Hue Single On & off  Is entered,

2. Among the basic consonants, the more consonant, the consonant plus stroke, ㅋ, ㅋ, ㅌ,, ㅎ are assigned to the second order of each button, 2 multi-touched  Hue Multi All On & Is off  Input,

3. A consonant  ㄲ, ㄸ, ㅃ, ㅆ, ㅉ are assigned to the third order of each button, 3 Mer Multi All On & After Touched Is off  Can be entered.

(If, as in the button '버튼' of FIG. 63, a consonant is assigned to a button to which a consonant from which a basic consonant can be derived, the consonant is assigned alone, and a character is assigned to a blank state in the second order. If the twin consonants can be assigned in the second order, including the case of no case, assuming that the twin consonants are assigned in the second order, such twin consonants may be input as multi-all on & off after two multi-touches.)

In the previous section, you can enter the vowel vowels by combining the basic vowels. Another way to enter the Korean vowel vowels is to introduce the vowel vowels, as the default vowel is assigned to each button. The method of assigning the second or third or fourth order to completion and then performing multi-all on & off or three-touch after multi-touch and multi-all on & off or multi-touch after multi-touch It may be input by a multi all on & off method after multi touch. Anyone can understand the above description, so detailed description and drawings will be omitted.

8, 10, 11, or 4, the input principle is not limited to character input, but may also be applied to a function implementation of a function button. Conventional function buttons are often designed to exert only one function per button, and after assigning and displaying two or more such functions per one button, the above-described FIGS. 8, 10, 11, Alternatively, it may be implemented by the input principle related to FIG. 4.

For example, like a function button directly below the button TUV of FIG. 56, a function of deleting a letter (= backspace function) is assigned to the first function of the function button, and the shift button function (up arrow) is assigned to a function button. Is assigned to the second function of the function button, that is, when two functions are assigned to the same button, single on / off (after single touch) is implemented to delete the character, and the function button becomes the target button. Multi-all on and off (after multi-touch) allows the shift button to be implemented.

Doing so allows more functionality to be implemented on buttons that occupy the same space. In conventional smartphones, the space is so small that even if only the character input mode is considered, the computer keyboard including the DEL button and the INSERT button could not be disposed, but it is solved to some extent as described above.

In addition, the two or more functions assigned to one virtual button are not only functions required in the text input mode, but also functions of an execution icon on a touch screen screen of a smartphone, a tablet PC, a notebook, and a desktop PC. The detailed description thereof will be omitted since it can be sufficiently inferred from the above description.

Of course, the general characters representing the functions and languages exemplified above may be assigned to the same button and implemented as described above. For example, the one-character deletion function (= backspace function) in the example in which the one-character deletion function (= backspace function) and the shift button function (up arrow) are simultaneously assigned to any button described above is alphabetized. By replacing S with a single on and off (after single touch), the alphabet S is input, and the multi-all on and off shift button function can be implemented so that the function button becomes a target button (after multi-touch).

For reference, regardless of the target button recognition method, depending on how the touch is made and how the operation is performed later, any of the functions described above may be implemented.

For example, one of the most commonly used spaces in the text input mode is a space (= space). When entering a space, do not use any specific button as the target button, but just anywhere on the input keypad (or in a specific designated area). 4) After multi-touch, you can input multi-on & on. Of course, it is possible to implement general character input or function without using the multi all-on & on signal after 4 multi-touch.

In addition, the above method may be applied to a conventional QWERTY keyboard as shown in FIG. 7 or 60.

If the multi-touch is expressed in detail as n multi-touch, the specific sequence number is not determined as described above according to the n value, but according to the n value, that is, depending on the situation before the final operation, among at least one character group. A specific character group may be matched to allow at least one of the at least one character associated with the target button to be input without changing the character mode while belonging to the matched character group.

For example, if the current text mode is lowercase letters,

1) Single on & off is used to enter lowercase letters in English,

2) Multi on & off is used, even though the current text mode is lowercase letters, English capital letters are input without changing the text mode. That is, without changing the character mode, it is possible to input a character of another character mode corresponding to the current character mode.

For example, if the current text mode is lowercase letters,

When the button S is single on and off, a lowercase letter s is input. When the button S is multi-all on and off so that the button S is recognized as a target button, the uppercase letter S may be input even though the current letter mode is an English lowercase mode.

The "specific character group" may be any one of the following character groups.

1) Any character group from two or more different character groups classified under different spelling rules.

2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.

To expand further, it can also be extended to:

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button.

5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

Hereinafter, a method in which predetermined characters are additionally input in addition to the character assigned to the target button by a touch operation, and a method in which two or more characters are input by one touch operation will be described.

In a device having a touch screen, a method of inputting characters,

In the case where after a keyboard is displayed on the touch screen, a particular button is operated after multi-touch so that a specific button is recognized as a target button,

The final operation of at least one of the final operations, which may include nine behaviors including dragging in each direction of off or up, down, left, right (, top left, bottom left, top right, bottom right) starts. After the last operation started, including after the end of the operation or after the end of the last operation,

By a multi-touch post operation including a final manipulation of at least one of the final manipulations which may include nine behaviors including off or eight dragging,

Belonging to a specific character group from at least one character group,

A first character which is a specific character among at least one character associated with (or assigned to) the target button;

Regardless of the target button, the method may be a method in which a second character, which is at least one specific character promised for each final operation, is additionally input.

In addition, according to a situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character belonging to the matched character group is assigned to the target button without changing the character mode. It can be entered in addition to the characters. And, if there are two or more letters assigned to the target button,

Depending on the situation before the final operation, the first character can also be selected.

First, an example of application to an English keyboard will be described. In FIG. 7 (or FIG. 60), the English QWERTY keyboard is illustrated, but it can be seen that only one character is displayed per button.

After the touch operation is performed on the English QWERTY keyboard illustrated in FIG. 7 (or 60), two or more characters may be simultaneously input in one operation.

To be more specific, in addition to the character assigned to the target button, one character including a specific vowel or a half vowel (or a half consonant) or a consonant is additionally inputted, or the suffix ING of the present progressive type and the ED including the old suffix ED 2 More than one letter can be implemented to be added in addition to the letter assigned to the target button.

Hereinafter, assuming that the target button is the button S in the English character input, drag or off in four directions (up, down, left, right) after being touched (single touch or multi-touch) so that the button S is recognized as the target button. An example in which another character is additionally inputted along with S through the manipulation to be described will be described in which specific characters are additionally input together with the letter assigned to the target button.

First, in the case of multi-on & off or multi-all dragging in four directions, an example in which A, E, I, O, and U are additionally input in addition to the letter assigned to the target button will be described.

(When our method is applied to non-English letters, it corresponds to the pronunciation of [a], [e], [i], [o], [u] on the English phonetic symbols instead of A, E, I, O, U. Is recommended.

For example, when the button S is multi-touched (eg, FIG. 44), as shown in the left figure of FIG. 13, all five 'S + collections' are popped up, and the multi-all on-off or four-direction multi-all dragging is performed. In this case, one of SA, SI, SE, SU, or SO may be input. (Of course, pop-ups may be implemented as omitted. All pop-ups may be omitted in the entire application.)

In more detail, while all five 'S + collections' are popped up by the multi-touch, the desired 'S + collection' may be input by multi-all dragging in the direction where the desired 'S + collection' is located. If the desired 'S + collection' is located at the center, the fingers are all turned off without dragging, and as a result, the 'S + collection' located at the center may be input by turning on and off.

In this case, instead of SE, SI, SO, and SU as shown in the right figure of FIG. 13, only E, I, O, and U may be represented as shown in the right figure of FIG. 13.

For example, as illustrated in FIG. 13, after the button S is multi-touched by the detection and the middle so as to be recognized as the target button (eg, FIG. 44),

1) 'Multi All On & Off' is additionally input A together with S assigned to the target button, that is, SA is input,

2) When the 'multi all drag' upwards, I is additionally inputted with S assigned to the target button, that is, SI is inputted,

3) When the 'multi all drag' to the right (e.g., Fig. 62), E is additionally inputted with S assigned to the target button, that is, SE is inputted,

4) When the 'multi all drag' to the lower side, U is additionally input with the S assigned to the target button, that is, SU is input,

5) When the 'multi-all drag' to the left, O can be additionally input, that is, SO can be input together with S assigned to the target button.

Meanwhile, two touches may be input in a required manner. As a method not recommended, when the button S is multi-touched, all five 'S + collections' are popped up as shown in the left figure of FIG. Once all fingers are off, the desired 'S + collection' can be selected as a touch (e.g. single touch), allowing one of SA, SI, SE, SU, or SO to be input. In this case, instead of SE, SI, SO, and SU as illustrated in the right diagram of FIG. 13, only E, I, O, and U may be represented as illustrated in the right diagram of FIG. 13.

Of course, the method of notifying the additionally input characters according to the on & off and drag directions may be other than the popup method of FIG. 13, and the user may not know what additional characters are input. You can only rely on memorization.

In a method in which specific characters are additionally input together with the character assigned to the target button in the present application including the above embodiment, the main character is described in that the additional character is not assigned to the target button. It can also be described in terms of assignment. However, this is only a matter of perspective, and has nothing to do with understanding the principles herein. For example, A, E, I, O, and U, which are additionally input together with S assigned to the button S as the target button, may be regarded as the second to sixth letters assigned to the button S. It can also be said to be a method in which one of the second to sixth characters is additionally input together with the first character assigned to each button by the touch after a single touch. The same applies to an embodiment in which specific characters are additionally input together with the character assigned to the target button, which will be described later.

On the other hand, the method used in almost all QWERTY keyboards, which is a method of inputting only the characters assigned to the target buttons by single on & off, is not recommended.

An example will be described in which A, E, I, O, and U are additionally input in addition to the letter assigned to the target button when single on & off or single drag in four directions.

While all five 'S + collections' are popped up by a single touch, the desired 'S + collections' may be input by dragging in a direction where the desired 'S + collections' are located. If the desired 'S + collection' is located in the center, the finger is turned off without dragging and the 'S + collection' located in the center may be input.

As a specific example, after the button S is single-touched by the index finger (to be recognized as the target button),

1) When the single on and off, A is additionally input with the S assigned to the target button, that is, SA is input,

2) When the 'single drag' upwards, I is additionally input along with S assigned to the target button, that is, SI is inputted.

3) If the 'single drag' to the right, E is additionally input along with S assigned to the target button, that is, SE is input,

4) When the 'single drag' downwards, U is additionally input with S assigned to the target button, that is, SU is input,

5) If a single drag to the left, O can be additionally input, that is, SO, along with S assigned to the target button.

On the other hand, it is not recommended because the user can be confused because the number of multi-touched fingers in the on & off method and the drag method are not identical, but dragging is applied by single drag, and on & off As an embodiment to which the multi on & off is applied,

1) In the state where all four 'S + collections' are popped up by a single touch, the desired 'S + collection' is input by dragging in the direction where the desired 'S + collections' is located,

2) If the desired 'S + collection' is located at the center, it can be entered as multi all on & off.

To give a concrete example,

1) When the button S is multi-touched (eg, FIG. 44) by the detection and the stop so that the button S is recognized as the target button, and multi-all on and off, A is additionally input with the S assigned to the target button, that is, SA is Input,

2) After the button S has been single-touched by the index finger, and 'single dragged' upwards, I is additionally inputted with S assigned to the target button, i.e., SI is inputted,

3) If the button S is single-touched by the index finger, then 'single drag' to the right, an additional E is input together with the S assigned to the target button, that is, an SE is inputted,

4) After the button S has been single-touched by the index finger, when 'single dragged' downwards, U is further input together with S assigned to the target button, that is, SU is inputted,

5) If the button S is single-touched by the index finger, and then 'single dragged' to the left side, O may be additionally inputted with S assigned to the target button, that is, SO may be input.

For reference, I will introduce three ways to make it easy to memorize the assignment position for A, E, I, O, U which is additionally input with S. Other methods are possible.

As a first method, a method in which FIG. 14 is referred to will be described.

This method is the most recommended memorization method, which was also applied to the above-described embodiments.

1) A is the most used vowel, so it is assigned to the center,

2) Since I is a vertically standing shape, it is assigned to the upper side,

3) E is assigned to the right because the right side of the letter is open,

4) U is the first spelling of the word Under, so U is assigned to the bottom (or U, with two vertical lines, to the bottom because I has one vertical line at the top),

5) Since O is the shape of a human mouth, it may be assigned to the left side.

However, since this is only an example, the positions of A, E, I, O, and U additionally inputted with S may be allocated differently from the above. The same applies to the following method.

For example, since O is likely to be in the middle, it may be assigned to the bottom and U to the left.

In the second method, in another example, according to the pronunciation order in the practice of phonation, A) E, I, O, U in the order of 1) A is assigned to the center once, 2) Clockwise from top to top, E to the right I can be assigned to I, O to the bottom, and U to the left.

The third method is not recommended,

1) O is in the center, so it is assigned to the center,

2) I is assigned to the top for the same reason as the first method,

3) E is assigned to the right for the same reason as in the first method,

4) U is also assigned to the bottom for the same reason as the first method,

5) The remaining A may be assigned to the left.

Fourth method, not recommended,

1) O is in the center, so it is assigned to the center,

2) I is assigned to the top for the same reason as the first method,

3) E is assigned to the right for the same reason as in the first method,

4) A with a pedestal or pointed tower-like shape that can be well balanced left and right,

5) The remaining U may be assigned to the left.

Hereinafter, the process of inputting the actual words, for example, will be described in detail.

15 is a diagram for explaining a process of inputting the English word “SAME”. The English word "SAME" can be entered by entering "SA" and "ME" sequentially.

For example,

1) When the button S is multi-touched by the detection and the stop so as to be recognized as the target button and then 'multi all on & off', A is additionally input with the S assigned to the target button, that is, SA is input.

2) If the button M is multi-touched by the detection and the stop so as to be recognized as the target button, and then 'multi-drag to the right', the E may be additionally input, that is, the ME may be input together with the M assigned to the target button.

FIG. 16 is a diagram provided to explain a process in which the English word “BEAUTIFUL” is input. The English word "BEAUTIFUL" can be entered by entering "BE", "AU", "TI", "FU", and "L" sequentially.

For example,

1) When the button B is multi-touched by the detection and the stop so as to be recognized as the target button, and then 'multi-drag' to the right, E is additionally input with the B assigned to the target button, that is, BE is input.

2) When the button A is multi-touched by the detection and the stop so as to be recognized as the target button, and then 'multi-drag' to the lower side, U is additionally input with the A assigned to the target button, that is, the AU is input,

3) When the button T is multi-touched by the detection and the stop so as to be recognized as the target button, and then 'multi-drag' upwards, I is additionally inputted with the T assigned to the target button, that is, TI is input.

4) When the button F is multi-touched by the detection and the stop so as to be recognized as the target button, and then 'multi-drag' to the lower side, U is additionally input together with the F assigned to the target button, that is, FU is inputted.

5) Button L is single on & off so that L can be input.

Referring to FIG. 15 and FIG. 16, according to the character input method according to the present embodiment, the representative vowels A, E, I, O, and U may be simultaneously input together with the letter assigned to the target button. You can guess that it can be significantly faster.

It may be more useful in the tablet PC QWERTY keyboard as shown in FIG. 60, where the button is large and there are few typos.

And, in the above, A, E, I, O, U has been described as being additionally input with the letter assigned to the target button, but this is only an example for convenience of description, it can be implemented differently .

That is, in addition to the vowel, the letters other than A, E, I, O, and U, including a half vowel, a half consonant, and a consonant, may be implemented to be additionally input together with the letter assigned to the target button.

If the number of buttons is smaller than all the alphanumeric characters used like 3X4 type, 4X4 type or 5X4 type keyboard, high frequency letters are displayed on touch buttons, and low frequency letters can be touched by touch operation. It can also be entered together.

On the other hand, the vowel is additionally input together with the character assigned to the target button by the multi-touch operation, and the consonant is used together with the character assigned to the target button by the single touch operation. It is preferable that the other consonants input together by the operation after the single touch are composed of the high frequency consonants used.

T, S, N, R, H, D, L, and C are the most frequent consonants used in conjunction with other alphabets.

And, for example, as described above

In the case of 'Multi All On & Off' and 'Multi All Drag', A, E, I, O, and U are entered together with the letter assigned to the target button.

In case of 'Single Drag', T, S, N, and R are inputted together with the letter assigned to the target button.

In case of multi-all dragging after single touch, H, D, L, and C are input as well as the letter assigned to the target button.

When the finger is dragged by multi-not all criteria, W and Y are input as well as the letter assigned to the target button.

Multi-Nick All-Night When a finger is dragged, it is possible to enter? (Question mark),. (Dot),, (comma), and! (Exclamation point) in addition to the character assigned to the target button without changing the settings of the device. .

That is, after the touch, the operation method is changed to change the character group input together with the character assigned to the target button without changing the setting of the device.

In other words, it can be said that a specific character group additionally input is matched according to the situation before the final operation without changing the character mode.

That is, according to the situation before the final operation, it can be said that a specific character group is matched among at least one character group so that the characters of the matched character group are input without changing the character mode.

First, in the case of 'single drag' will be described with an example that the T, S, N, R in addition to the character assigned to the target button to be input.

For example, as shown in FIG. 17, after the button S is 'single touched' by the index finger,

1) When the index finger is 'single drag' to the left, T is additionally input together with S assigned to the target button, that is, ST is input,

2) When the index finger is 'single dragged' downward, S is additionally input together with S assigned to the target button, that is, SS is input,

3) When the index finger is 'single dragged' upwards, N is additionally input together with S assigned to the target button, that is, SN is input,

4) When the index finger is 'single dragged' to the right side, R can be additionally input, that is, SR is input together with S assigned to the target button.

Reminiscent of the contents shown in FIG. 18, it is easy to memorize how the characters additionally input together with the characters assigned to the target button vary depending on the drag direction.

Now, in the case of multi-all dragging after single touch, an example in which H, D, L, and C are additionally input in addition to the character assigned to the target button will be described.

For example, as shown in FIG. 19, after the button S is 'single-touched' by the index finger so as to become the target button, the index finger is held in a state where the touch state of the index finger is maintained for a predetermined time (for example, 0.1 second). After touching the right side of the touched part with the middle finger so that the button S is recognized as the target button 2,

1) When the index finger and middle finger are multi-draged upward, H is additionally input together with S assigned to the target button, that is, SH is input,

2) When the index finger and the middle finger are dragged all the way to the right, D is additionally input together with S assigned to the target button, that is, SD is inputted.

3) When the index finger and the middle finger are dragged all the way downward, L is additionally input together with S assigned to the target button, that is, SL is inputted.

4) When the index finger and the middle finger are multi-draged to the left, C may be additionally input, that is, the SC may be input together with the S assigned to the target button.

Reminiscent of the contents shown in FIG. 20, it is easy to memorize how the characters additionally input together with the characters assigned to the target button vary depending on the drag direction.

(S should be marked in the center of FIG. 20, but it is incorrectly marked as I, so please change your mind.)

Now, when the multi-null reference finger is dragged, an example will be described in which W and Y are input together with the letter assigned to the target button.

For example, suppose that the index finger is recognized as the reference finger when two multi-touches are performed with the right index finger and middle finger, and the middle finger is better than the middle finger.

As shown in Fig. 22, after the button S is multi-touched by the index finger and the middle finger so as to be recognized as the target button, only the middle finger, which is the sickle reference finger, is turned off, and the touch state of the index finger is maintained.

1) When the index finger is dragged to the right, Y is additionally input together with S assigned to the target button, that is, SY is inputted.

2) When the index finger is dragged to the left, W may be additionally input, that is, SW is input together with S assigned to the target button.

Reminiscent of the contents shown in FIG. 23, it is easy to memorize how the characters additionally input together with the characters assigned to the target button vary depending on the drag direction.

Now, when the finger is dragged by the multi-notle, the sickle is entered, along with the characters assigned to the target buttons, the frequently used special characters "? (Question mark),. (Dot),, (comma), and! (Exclamation point)" are entered. I will explain with an example.

For example, suppose that the index finger is recognized as the reference finger when two multi-touches are performed with the right index finger and middle finger, and the middle finger is better than the middle finger.

As shown in Fig. 21, after the button S is multi-touched by the index finger and the middle finger so as to be recognized as the target button, only the index finger which is the reference finger is turned off and the touch state of the middle finger which is the sickle reference finger is maintained.

1) When the middle finger is dragged upwards,? (Question mark) is additionally inputted with S assigned to the target button, that is, S? Is inputted.

2) If the middle finger is dragged to the right, an additional. (Dot) is entered along with the S assigned to the target button, i.e., S. is entered,

3) When the middle finger is dragged to the left, a comma is additionally input, that is, an S, with S assigned to the target button.

4) When the index finger is dragged downward, the! (Exclamation mark) is additionally input, that is, the S! Is input together with the S assigned to the target button.

On the other hand, after the multi-touch operation including 'single touch and drag' or 'multi-touch and drag' is used, the number of characters additionally input to the 'target button' together with the character assigned to the target button is not 2 It is also possible to implement more than one.

For example, depending on whether the touch before dragging is single or multi, it is possible to be implemented to determine the number of characters additionally input together with the character assigned to the target button.

For example, in the case of 'single touch after single touch', the number of characters additionally input with the character assigned to the target button is one, and in case of 'drag after multi touch', The number of characters which are additionally input together is two or more, respectively.

On the other hand, if the drag is short after touch, the number of characters input with the target button is set to 1; if the drag is long after touching, the number of characters input with the character assigned to the target button is 2; It is also possible to implement each.

For example, after the button S is multi-touched by the index finger and the middle finger to be recognized as the target button,

1-1) When the short multi-drag upwards, 'I' is additionally input along with S assigned to the target button, that is, SI is input,

1-2) When multi-drag all the way upward, 'II' (or 'ING') is additionally input along with S assigned to the target button, that is, SII (or SING) is inputted.

2-1) When the short multi-drag to the right, 'E' is additionally input along with the S assigned to the target button, that is, SE is input.

2-2) When the multi-all drag to the right long, 'EE' or 'ED' (past suffix) is additionally input along with S assigned to the target button, that is, SEE (or SED) is inputted.

3-1) When the short multi-drag to the left, 'O' is additionally input along with S assigned to the target button, that is, SO is input.

3-2) When multi-drag all the way to the left, 'OO' (or 'ON') is additionally input along with S assigned to the target button, that is, SOO (or SON) is inputted.

4-1) When the multi-drag shortly to the lower side, 'U' is additionally input along with S assigned to the target button, that is, SU is input,

4-2) When the multi-drag all the way downward, 'UU' (or 'US') is additionally input together with S assigned to the target button, that is, SUU (or SUS) may be input.

Meanwhile, two or more short drags are continuously performed in the same direction, or the drag direction is changed to allow additional characters to be continuously input whenever dragged.

For example, in the case where a character additionally inputted along with a character assigned to the target button according to the drag direction is as shown in FIG. 13, as shown in FIG. 24,

1) After the button S is multi-touched by the index finger and the middle finger so as to be recognized as the target button, when the index finger and the middle finger are multi-draged to the right, 'SE' is input as shown in [1] of FIG. 24.

2) Even after 'SE' is input, if multi-drag to the right once more without detecting and stopping off, 'E' is additionally inputted. As a result, 'SEE' is inputted as shown in [3] of FIG. ,

3) After the input of 'SE', if the detection and the stop are not turned off and the multi-drag to the left, 'O' is additionally inputted, and as a result, 'SEO' is inputted as shown in [4] of FIG.

4) After the 'SE' is input, if the multi-drag to the left after the multi-drag to the lower side without the detection and the stop, the additional 'U' and 'O' are further inputted. Likewise, it can be implemented to input 'SEUO'.

Meanwhile, when a plurality of characters are assigned to the same button as in a keyboard including a 3 × 4 keyboard layout as shown in FIG. 3 or 4, other characters (eg, A, E, I together with the letters assigned to the target button) , O, U) are additionally input,

Depending on the operation method, it is possible to determine what character is assigned to the target button input together with other characters (eg, A, E, I, O, U).

For example, in the case of a button in which 'J, K, L' is assigned to button 5 of FIG. 4,

 So that button 5 with 'J, K, L' assigned together can be recognized as the target button

1) Single on & off and single drag in four directions so that A, E, I, O, U can be additionally input with the first assigned J to the target button in a similar principle to the above embodiments,

2) A, E, I, O, U can be additionally input with K allocated second to the target button in the same principle as the above embodiments by multi all on & off and multi all drag in four directions. and,

3) A, E, I, O, U with the 3rd assigned L to the target button in the same principle as the above embodiments by multi-notch all reference finger on & off and finger drag in four directions You can also make additional inputs.

Here, according to the situation before the final operation, a specific character group is matched among at least one character group, and the characters of the matched character group are matched. It can be said to be input method without changing the character mode.

On the other hand, it is also possible to implement the effect of combining with such a button without using a button which induces a combination with other buttons such as a shift button, a control button, an alt button.

For example, after the button S of FIG. 7 (or FIG. 60) is multi-touched by the detection and the stop so as to be recognized as the target button (for example, FIG. 44),

1) When the index finger and middle finger are 'multi-drag' upward, 'Control + S' is input, that is, the effect of pressing the button S while pressing the control button is exerted.

2) When the index finger and middle finger are 'multi-drag' to the right, 'alt + S' is input, that is, the effect of pressing the button S while pressing the alt button is exerted.

3) When the index finger and middle finger are 'multi-all dragged' down, 'Shift + S' is input. That is, the effect of pressing the button S while the shift button is pressed can be exerted.

It is possible to operate after single touch or multi-touch operation so that any target button is recognized in Korean, so that other characters (eg, vowels) may be input in addition to the characters (eg, consonants) assigned to the target button.

For example, in a keyboard in which most letters are assigned to each button in the same character mode including the conventional Hangul QWERTY keyboard as shown in FIG. 9 (or 61), the index finger may be recognized as the target button. After single touch

1) When single dragging upwards, 'ㅗ' is additionally input along with 'ㅈ' assigned to the target button, and 'Joe' is input as a result.

2) When single dragging to the right, 'ㅏ' is additionally input along with 'ㅈ' assigned to the target button.

3) When single dragging downwards, 'TT' is additionally input along with 'ㅈ' assigned to the target button, and as a result, '주' is inputted.

4) When single dragging to the left, 'ㅓ' is additionally input along with 'ㅈ' assigned to the target button so that 'low' can be input as a result.

(To make the buttons 'ㅔ' and buttons 'ㅣ', which are the rightmost buttons in FIG. 9, recognized as target buttons during multi-touch, in most cases, no characters are assigned to the far right as in FIG. 10 or 61. It would be better if you had enough free space.)

For example, in the conventional Korean QWERTY keyboard as shown in FIG. 9 (or FIG. 61), after the button 'ㅈ' is multi-touched by the detection and the middle so as to be recognized as the target button,

5) When multi-all dragging upward, 'ㅛ' is additionally input along with 'ㅈ' assigned to the target button, and 'Jo' is input as a result.

6) When multi-drag to the right, 'ㅑ' is additionally input along with 'ㅈ' assigned to the target button, and 'Ja' is input as a result.

7) When multi-drag to the lower side, 'ㅠ' is additionally input along with 'ㅈ' assigned to the target button, and 'Ju' is input as a result.

8) When multi-all dragging to the left, 'ㅕ' is additionally input along with 'ㅈ' assigned to the target button, so that 'Jer' can be input as a result.

Here, too, it can be said that a specific character group is matched among at least one character group according to the situation before the final operation, and the characters of the matched character group are input without changing the character mode.

On the other hand, as in the conventional keyboard shown in Fig. 12, which is a type of the conventional Hangul 3X4 keyboard, even when a plurality of characters are assigned to the same button, the number of the fingers at the time of touch and the type of the post-touch operation are different. 'ㅗ, ㅏ, TT, ㅗ, ㅛ, ㅑ, ㅠ, ㅕ' can be added with each consonant assigned to.

That is, when a plurality of characters are assigned to the same button, other characters (eg, 'ㅗ, ㅏ, TT, ㅓ, ㅛ, ㅑ, ㅠ, ㅕ') are additionally added with the letters assigned to the target button. In input,

Depending on the number of fingers and the operation method at the time of touch, the character assigned to the target button input together with other characters (e.g. 'ㅗ, ㅏ, TT, ㅓ, ㅛ, ㅑ, ㅠ, ㅕ') is determined. You may.

For example, in the case of the keyboard to which the Korean input method is applied, as shown in FIG. 12, the button 9 is marked with only 'ㅈ, ㅁ'. It is. In the case of a button assigned with 'ㅈ, ,, ㅉ', the button assigned with 'ㅈ, ,, ㅉ' will be recognized as the target button.

1) With 4 single drag and 4 direction multi-old lag, 8 additional vowels, ㅗ, ㅏ, TT, ㅓ, ㅠ, ㅑ, ㅠ, 입력, are added together with ㅈ as in the above embodiment. To be able to

2) Drag the multi-notch reference finger in 4 directions and drag the multi-notch reference finger in 4 directions after single touch. Then, you can use 'ㅊ', 'ㅏ', 'ㅏ', 'ㅓ', 'ㅛ', 'ㅑ', 'ㅕ' Additional collections are entered,

2) Multi-Nick All-Night Reference Finger Drag in 4 Directions and Multi-Night All-Night Reference Finger Drag after 4-Touch Single Touch with 'ㅉ' and 'ㅗ, ㅏ, TT, ㅓ, ㅛ, ㅑ, ㅠ, ㅕ' You can also have eight additional vowels.

Here, too, it can be said that a specific character group is matched among at least one character group according to the situation before the final operation, and the characters of the matched character group are input without changing the character mode.

In addition, other vowels other than the eight vowels of the 21 Korean vowels may be implemented such that the consonant assigned to the target button and another vowel are input together using another operation method including a long dragging operation.

For example, 'long drag' may cause a double vowel added with 'ㅣ' to be added to a collection that is added when 'short drag' is input. Specifically,

1) If single short drag to the right, 'ㅏ' is input, if single long drag to the right, 'ㅐ' is additionally input with the consonant assigned to the target button.

2) If single short drag to the left, 'ㅓ' is input, if single long drag to the left, 'ㅔ' is additionally input with the consonant assigned to the target button.

3) When single dragging upwards, 'ㅗ' is input. When single dragging upwards, 'ㅚ' is additionally inputted with the consonant assigned to the target button.

4) 'TT' is shortly inputted to the lower side, and '가' is inputted to the target button together with the consonant assigned to the target button.

5) In case of short multi-all dragging to the right, 'ㅑ' is inputted in the case of multi-all long dragging to the right, and 'ㅒ' is additionally inputted with the consonant assigned to the target button.

6) In the case of multi-all dragging shortly to the left, 'ㅕ' may be additionally input along with the consonants assigned to the target button in case of multi-all dragging to the left.

In addition, in the above-described English input embodiment, a method of dragging two or more short times consecutively in the same direction or changing the drag direction may be additionally inputted continuously in Hangul.

For example, after the consonant button is recognized as the target button, it is possible to implement the two operations by combining the two vowels together.

More specifically, for example, when the button 'ㅈ' is single-touched by the index finger or 2 multi-touched by the index finger and the middle finger to be recognized as the target button (if single dragged from the next, it is regarded as single-touched and multi-draged). Can be considered multi-touch).

1) After 'single dragging' upwards and 'ㅗ' is selected, the finger is not turned off but continues on the spot, 'single dragging' to the right, and 'ㅏ' is selected. Additional input, resulting in 'left' being entered,

2) After the 'single drag' to the lower side and 'TT' is selected, the finger is not turned off and continues on the spot, 'single drag' to the left, and 'ㅓ' is selected. Additional input, resulting in 'giving',

3) After 'single dragging' upwards and 'ㅗ' is selected, the finger is not turned off and continues on the spot, then 'single dragged' to the right and 'ㅐ' is selected. Is entered in addition, resulting in '좨'

4) After the 'single drag' to the lower side and 'TT' is selected, the finger is not turned off and continues on the spot, and then the 'single' is selected by 'long dragging' to the left. May be further input, resulting in '줴' being entered.

Hangul vowels consist of 10 basic vowels (ㅏ ㅑ ㅓ ㅕ ㅛ ㅠ ㅡ ㅣ ㅣ) and 11 vowels (ㅐ ㅔ ㅖ ㅚ ㅟ ㅝ ㅢ ㅙ ㅙ ㅞ).

In the above embodiments, among the total of 21 vowels, the rest of the vowels except for ㅡ, ㅣ, and ㅢ are inputted with the consonants assigned to the target buttons.

In order to input 'ㅡ', 'ㅣ', 'ㅢ', a separate 'ㅡ' and 'ㅣ' button is provided, and a combination of 'ㅡ', 'ㅣ' and ('ㅡ', 'ㅣ' It is also possible to input 'ㅢ', but it is also possible to assign a separate operation method for inputting 'ㅡ', 'ㅣ', 'ㅢ'.

For example, until now, Hangul input embodiments have been used for dragging only and not for on / off, so now, I want to use on & off.

For example, after the consonant button 'ㅈ' is multi-touched by the index finger and the middle finger to be recognized as the target button,

1) In the case of 'multi all on & off', the vowel 'ㅡ' is additionally input together with the 'ㅈ' assigned to the target button, and as a result, 'zu' is inputted.

2) In the case of 'multi-null reference finger on & off', the vowel 'ㅣ' is additionally input together with the 'ㅈ' assigned to the target button, resulting in the input of '지',

3) In the case of 'multi-not all-knot reference finger on &off', the vowel 'ㅢ' is additionally input together with 'ㅈ' assigned to the target button, so that 'z' can be input as a result.

The character input method described so far is applicable to other kinds of languages other than the languages mentioned. For example, it is applicable to Greek / Roman, Cyrillic, Arabic, Southeast Asian, Indic, Thai, Vietnamese, and language specific languages such as English, French, German, Spanish and so on.

In the above embodiments in the drag direction, only four directions of dragging up, down, left, and right have been described. However, when the direction is subdivided, more operations are possible. For example, when adding a drag in a direction of right bottom (south east), bottom left (south west), top right (north east), and top left (north west), more characters may be assigned to one button and input or various tasks may be performed.

As well as,

Depending on the length of the drag, drag the drag shortly, break it down into long drags,

Depending on the drag direction, you can subdivide the drag into a straight drag, an in-place drag, a shape drag,

If a variety of manipulations are used, including multi-notle-all-notch finger on & off and multi-notch-all-notch finger dragging, more work is possible.

4. How to manipulate objects

Up to now, description has been made on inputting characters by touch and touch operations. Hereinafter, the method used in the text input method is used, and a method of operating an object such as a photo, a picture, a browser, a window, or the like will be described in detail.

In this embodiment, among the various multi-touch operation methods, the target button recognition method by the reference finger is used, but the finger located at the leftmost (= first from left) of the multi-touch fingers is the 'reference finger'. I will use the method determined by. More specifically, the multi-touch allows the index finger and the middle finger to be used and assumes a method in which the index finger is recognized as a 'reference finger'.

According to the method to be described later, it is difficult to predict the exact position of the active area boundary of the object when the object is activated, such as a star, but not when the active area boundary is formed in the same range as the shape such as a rectangle. Is so small that it is difficult to multi-touch fingers only inside the object area, after the object (or the active area of the object) is multi-touched to become the target button, object shape including zooming is possible without the need for an object activation step. Do.

Conventionally, after the thumb and index finger are multi-touched on the object, the object becomes smaller when the thumb and index finger move in the direction of thumb and index finger movement, and the object becomes larger when the thumb and index finger move in the direction where the thumb and index finger open. This method is generally used in smartphones including Apple's iPhone, which has the disadvantage that the size of the object is enlarged or reduced only while the ratio of the object's width to height is maintained.

If we wanted to change only the horizontal length or the vertical length without maintaining the ratio of the object's width to height, it was necessary to activate the object as a preparatory step to change the shape of the object by clicking on it with the mouse. .

However, according to the present application, since the object (or the active area of the object) is multi-touched to become the target button, the shape of the object may be modified by 'manipulating after multi-touch', so that the object does not need to be activated, the touch screen Multi-touch can be used to modify the shape of an object.

The phrase “activating region of an object” is used herein.

According to the method herein, such phrases are used even though the process does not require the object to be activated. The phrase "active area of an object" herein does not actually mean an area within the active area boundary of the object when the object is activated, but reminds how the shape of the object is deformed after the object is activated as in the prior art. When the object is activated, it means the area within the active area boundary, that is, the area within the object's active area boundary when the object is assumed to be activated.

The term "object region" refers to an area occupied by an object. The size of the object area will be less than or equal to the size of the active area of the object, unless otherwise noted. Referring to FIG. 39, the object area may be present in the active area of the object.

In addition, the object area may be shortened to an object in many cases.

Thus, even if a point that is outside the object area but still inside the object's active area is multi-touched, and the shape of the object is deformed without requiring the object's activation step, even if the object is not activated, the expected active area of the object Even if it is multi-touched to be recognized as a target button, the object is set to be activated, the device is recognized as multi-touched to change the shape of the object by the user, and the shape of the object should be deformed by a subsequent operation. . In the case where the object area is multi-touched to be recognized as the target button, it is naturally recognized by the device as being multi-touched to change the shape of the object by the user, and the shape of the object should be modified by subsequent operations.

Since the multi-touch signal required for implementing the method of the present invention is different from the conventional method, it may be parallel to the conventional method. In addition, since the size of the object is too small, the object cannot actually be multi-touched, and thus an object that cannot be enlarged or reduced by the conventional multi-touch zooming method cannot be multi-touched. For example, the object may be enlarged or reduced by allowing the object to be multi-touched so that the object can be recognized as the target button. In addition, since the size of the object is too small, by the method of enlarging the object after the object is activated by a conventional mouse, the object cannot be enlarged in a diagonal direction, but only enlarged in a diagonal direction only after it is enlarged in a horizontal or vertical direction. Objects that have been able to be enlarged can also be directly enlarged in the diagonal direction by the method of the present application.

Some concepts of the direction mentioned below will be described. (Herein, the conceptual description of the direction is referred to in the section "3. Character input method on the touch screen" and the field to which the present application is applied. May be applied.)

When referring to the vertical direction including the upper and lower sides used in the following description, even if the user tries to drag in the perfect vertical direction including the perfect upper side and the perfect lower side, there is no user capable of dragging such that From the device's point of view, when the user perceives the intended drag direction, the trajectory actually dragged by the user is close to a straight line within the set constant curvature range and is perfectly parallel to or perpendicular to the vertical line (= straight line parallel to the Y axis). If it is not parallel but within the set range, it is judged by the device that the user attempted to drag in the perfect vertical direction including the perfect upper side, the perfect lower side, and judged that the drag performed by the user is the perfect longitudinal direction including the perfect upper side and the perfect lower side. Three, including the upper and lower sides judged when It means the direction of road.

Referring to the horizontal direction including the left and right words used in the following description, even if the user tries to drag in the perfect horizontal direction including the perfect left and perfect right, there is no user capable of dragging such that From the device's point of view, when the user perceives the intended drag direction, the trajectory actually dragged by the user is close to a straight line within the set curvature range, and is either perfectly parallel to the horizontal line (a straight line parallel to the X axis) or not perfectly parallel. However, if it is parallel within a set range, it is judged by the device that the user has tried to drag in the perfect transverse direction, including the perfect left and perfect right, so that the drag performed by the user is determined to be the perfect longitudinal direction including the perfect upper and perfect lower sides. Three including the upper side, the lower side judged at the time It means the direction.

Referring to the diagonal directions including the upper left, lower left, upper right, and lower right words used in the following description, when the user recognizes the drag direction intended by the user, the determined direction is the upper and lower sides. , Means not to the left or to the right. Thus, the diagonal direction does not mean any precise one direction, such as the upper side, the lower side, the left side, or the right side, but rather the range that is a collection of directions other than the upper side, the lower side, the left side, and the right side. For example, even if the upper right side is used, the direction of the upper right side of various angles within 0 to 90 degrees, including 10 degrees, 30 degrees, 45 degrees, 60 degrees, and 80 degrees with the X axis, Judging. So there can be no perfect upper left, perfect lower left, perfect upper right, perfect lower right.

However, depending on the setting, the diagonal direction may be set to mean only one exact direction such as upper side, lower side, left side, and right side. For example, the right upper direction determined by the device may be set so that the angle with the X axis means only the 45 degree direction. In other words, even if the direction dragged by the user is any right upper direction among a range of upper right sides, the device may set the angle of the X axis to be determined as the upper right direction of 45 degrees. In this case, there may be a perfect upper left side, a perfect lower left side, a perfect upper right side, and a perfect lower right side. However, from the user's point of view, even if you try to drag in the perfect diagonal direction, including the perfect upper left, the perfect lower left, the perfect upper right, and the perfect lower right side, there is no user capable of dragging that way. When recognizing the drag direction, the trajectory actually dragged by the user is close to a straight line within the set curvature range, and the angle to the horizontal line (= a straight line parallel to the X axis) is 45 degrees or completely 45 degrees. If it is not a 45 degree angle within the set range, but it is judged by the device that the user has tried to drag in the perfect frame direction including perfect upper left, perfect lower left, perfect upper right and perfect lower right Dragged to the perfect upper left, perfect lower left, perfect upper right, perfect lower right It means the diagonal direction including the upper left side, lower left side, upper right side, and lower right side when judged to be perfect diagonal direction.

The predetermined range when it is determined as the upper side, the lower side, the right side, the left side, the upper left side, the lower left side, the upper right side, and the lower side may be considerably small or considerably large depending on the currently determined number of directions.

In the description of the " 1) " method described below, a method in which only the upper side and the lower direction are distinguished and judged is given as an example. In this embodiment, the upper left side, the upper right side, as well as the left side and the right side need not be covered. As shown in (c) of FIG. 46, the predetermined range determined as the upper side may be set to the upper side by 180 degrees based on the hitting point, and the predetermined range determined as the lower side may be set to the lower side 180 degrees based on the hitting point. .

Among the descriptions of the "2)" and "3)" methods described later, a method divided into an upper side, a lower side, a left side, a right side, an upper left side, a lower left side, an upper side, and a lower side is determined as an example. In the case, when the diagonal direction is set to mean a range that is not an exact one direction like the upper side, the lower side, the left side, the right side, but is an aggregate of directions other than the upper side, the lower side, the left side, and the right side, (a) As in the drawing, it is recommended that a certain range of the upper, lower, left, and right directions be set to a smaller angle range (e.g., by 10 degrees), and the diagonal direction including the upper left, lower left, upper right, and lower right sides. For certain ranges, it is recommended that the angle be set large (eg by 80 degrees). If the diagonal direction is set to mean only one precise direction such as upper side, lower side, left side, right side, for example, even if the direction dragged by the user is any upper right side of a certain range of upper right side, In the case where the angle is set to be judged in the right upper direction of 45 degrees, as shown in Fig. 46 (b), the predetermined ranges of the upper side, the lower side, the left side, the right side, the upper left side, the lower left side, the upper right side, and the lower right side are all present. It is recommended to set the camera to be in a 45-degree angle range to divide the 360-degree direction.

(For reference, in the "2)" method described above, the upper, lower, left, right and diagonal directions need only be distinguished and judged to be divided into upper left, lower left, upper right and lower right sides in the diagonal direction. Although it is not necessary, the upper side, the lower side, the left side, and the right side should be distinguished, and as a result, the diagonal direction should also be divided into the upper left side, lower left side, upper right side, and lower right side.),

Since only the upper, lower, left, and right directions need to be distinguished and judged, the diagonal directions including the upper left, lower left, upper right and lower right sides do not need to be distinguished. If the direction determined by the user is set to mean only one precise direction such as upper side, lower side, left side, or right side, for example, even if the direction dragged by the user is the upper direction among a range of upper directions, the device is parallel to the Y axis. When it is set to judge in the upward direction, it is recommended that the predetermined range of the upper, lower, left, and right sides be set to be divided into the 90 degree angle ranges as shown in (d) of FIG. 46 so as to divide the 360 degree direction.

The method of deforming the various objects by the method of the present application will be described with the following three examples of methods 1), 2), 3).

 1) After the multi-touch activation area of the (object or) object becomes a target button (= target object or target activation area), it is enlarged when dragged in at least one first specific direction and enlarged in at least one second specific direction. How to zoom out when dragged.

For example, the index finger is recognized as a reference finger, and the index finger and the middle finger are used to multi-touch so that the active area of the (object or) object becomes the target button (= target object or target active area),

When the index finger and middle finger are multi-all dragged upwards, as shown in FIG. 26 to FIG. 37, when the index and middle finger are multi-all dragged downward while the ratio of the horizontal and vertical lengths of the object is maintained. As shown in FIG. 37 to FIG. 26, the object may be embodied to be reduced while maintaining the ratio of the horizontal length to the vertical length of the object. It may be implemented to be replaced by the left side, the upper side may be mixed to have the same result as the right side, and the lower side may be mixed to have the same result as the left side.)

And, it is a method that can be enlarged or reduced in the state that the position of the center point of the object is not changed.

2) The object (or the active area of the object) is multi-touched to be recognized as the target button and then dragged, only the horizontal length or the vertical length of the object (or the active area of the object) by the drag direction determined by the device This is how the length and height are enlarged or reduced together.

To define this more specifically,

When the object (or the active area of the object) desired to change shape is multi-touched and started to be dragged so as to be recognized as the target button, the dragging direction (determined by the device), that is, the dragging direction intended by the user is up and down. In the case where it is judged to be one of right, left directions,

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is expanded,

When dragged in the second specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is reduced,

When dragged in the first specific direction in the vertical direction, the horizontal length does not change, and the vertical length is expanded,

When dragged in the second specific direction in the longitudinal direction, the horizontal length does not change, and the vertical length is reduced,

When the object (or the active area of the object) desired to change shape is multi-touched and started to be dragged to be recognized as the target button, the dragging direction (determined by the device), that is, the dragging direction intended by the user is the upper right side. , If it is determined that one of the diagonal directions including the lower right side, the upper left side, and the lower left side,

In the first way,

When dragging in at least one first specific direction of the diagonal direction, the horizontal length and the vertical length are enlarged at the same ratio,

When dragging in at least one second specific direction of the diagonal direction, there is a method in which the horizontal length and the vertical length are reduced at the same ratio,

In the second way,

When the drag in the at least one first specific direction range of the diagonal direction, the variation ratio of the horizontal length and the vertical length is enlarged differently according to each direction within the range,

When dragging in at least one second specific direction range in the diagonal direction, there is a method in which the variation ratio between the horizontal length and the vertical length is reduced according to each direction within the range.

And, it is a method that can be enlarged or reduced in the state that the position of the center point of the object is not changed.

To explain the method described above with an example,

After the index finger is recognized as the reference finger, the index finger and the middle finger are used to multi-touch so that the active area of the (object or) object becomes the target button.

When the index finger and middle finger are multi-draged upward in the vertical direction, the shape of the object is deformed so that the horizontal length of the object becomes larger without changing, as shown in FIG. 26 to FIG. 35. When the multi-all drag in the lower direction, as shown in Figure 35 to Figure 26, the shape of the object is deformed so that only the vertical length without changing the horizontal length of the object,

When the index finger and middle finger are multi-drag to the right of the horizontal direction, the shape of the object is deformed so that the vertical length of the object becomes larger without changing, as shown in FIG. 26 to FIG. 36. When the multi-all drag in the left direction, the shape of the object is deformed so that the vertical length of the object is reduced only the horizontal length without changing, as shown in Figure 36 to Figure 26,

When the determined drag direction is diagonal,

As an embodiment of the first method,

Even if the index finger and middle finger are multi-all dragged in any of the various upper right directions in the diagonal direction or in any of the various upper left directions, as shown in FIG. 26 to FIG. The length of the object is enlarged while being held, and the index finger and middle finger are multi-all dragged in any of various lower and lower directions in the diagonal direction or in any of various lower and lower directions, as shown in FIG. 37 to FIG. 26. It can also be implemented to be reduced while maintaining the ratio of the vertical length to the vertical length.

As an embodiment of the second method,

The ratio of the length of the object to the length of the object is enlarged to vary depending on whether the detection and the middle finger are multi-draged in the right upper direction or the upper left direction among the various upper right directions or the various upper left directions in the diagonal direction. Depending on whether the right and left middle multi-drag is dragged in various lower right direction or various lower left direction in the diagonal direction, or in the lower left direction or the lower left direction, the ratio of the length of the object to the length of the object may be reduced. You may.

3) In the background section, "Steps 1 to 3 in the object shape transformation method which requires the activation step of the conventional object only by multi-touching so that the object is recognized as a target button (= target object) according to the method of the present invention. While having the same effect as the step is performed, the four steps in the object shape deformation method that requires the activation step of the conventional object in which the 17 object change aspects are implemented can be performed through the multi-touch operation. It is a method including the method mentioned.

In addition, the position of the center point of the object may be changed or enlarged or reduced.

In more detail, the method consists of the following steps.

Step 1: The object (or the active area of the object) is multi-touched and started to be dragged to be recognized as the target button, and the specific range within the object (or the active area of the object) is determined by the hitting point and the direction of dragging. To be recognized.

Step 2: The width or length of the object (or the active area of the object) varies depending on the recognized target range and the determined drag direction, and the direction from which the drag is started is closer to the center of the object (or the active area of the object). If the direction of the losing is reduced, if the direction of distance is enlarged. (The center of the object may be moved in the determined drag direction.)

Depending on the implementation method, the target scope itself may be the object or the entire activation area of the object. This is mainly the way the center point of the object does not move. In the way that the center point moves, it is recommended that some range of the object or the active area of the object be recognized as the target range.

That is, the zooming in or out is determined according to the recognized target range or the hitting point as well as the dragged direction determined by the device, and optionally, if the centering point is moved, the moving direction of the centering point may also be determined. It is a way.

The center of the object (or the active area of the object) is a straight line passing through the center of the object (or the active area of the object) perpendicular to the determined drag direction, or the object (or the object perpendicular to the determined drag direction). The result may be the same even if it is replaced by the concept of a straight line that divides the object (or object activation area) into two parts while passing through the center of the activation area.

From the user's point of view, the target range is determined first, and any point within the target range is selected as the target point, and the user starts to drag after multi-touching the target point to the hitting point. Likewise, the user may determine which range the user thinks as the target range based on two factors, a hitting point and a drag start direction.

In the above, there is a part expressed as a direction in which dragging is started, not a dragging direction. To explain the reason, for example, when dragging downward in the range 5 of FIG. However, if it is dragged downwards beyond the horizontal line passing through the center of the object, it becomes a direction away from the center of the object from then on. However, since the object is closer to the center of the object until it reaches the horizontal line, the object is From the moment it collapses and goes beyond the horizon, the direction away from the center of the object is not dragged downwards by the length of the object's vertical side, because the object should not be enlarged immediately. This is because it should continue to shrink until it is dragged downwards by the length of the object's vertical side.

Adding a little technique to the method is as follows.

① The object (or the active area of the object) that you want to change shape is multi-touched and dragged to be recognized as the target button, and the specific range inside the object (or the active area of the object) is changed by the hitting point and the direction of dragging. To be recognized as the target range,

If the direction in which the drag starts (determined by the device), that is, the drag direction intended by the user is determined to be one of the upper side, the lower side, the right side, or the left side,

If the determined drag-starting direction is closer to the center of the object (or the active area of the object), 2 parallel to the drag direction determined from the two horizontal sides or the two vertical sides of the object (or the active area of the object). The lengths of the two sides are reduced, and the lengths of the two sides perpendicular to the determined drag direction are unchanged (in addition, the drag determined among the three sides surrounding the recognized target range while the center of the object moves in the determined drag direction). The position of the side perpendicular to the direction is moved for the reduction, and the position of the opposite side of the side may not be changed.),

If the determined starting drag direction is a direction away from the center of the object (or the active area of the object), two parallel or parallel to the determined drag direction among the two horizontal sides or two vertical sides of the object (or the active area of the object) The length of the side is enlarged and the length of the two sides perpendicular to the determined drag direction is unchanged (in addition, the drag direction determined from the three sides surrounding the recognized target range while the center of the object moves in the determined drag direction). The position of the side perpendicular to the side may be moved for enlargement, and the position of the opposite side of the side may not be changed).

The contents of the method "①" here are the contents of 1) to 8) among the 17 object changes in 4 steps in the object shape deformation method that requires the activation step of the conventional object mentioned in the Background section. It will be described a method that may be implemented in the way.

② The object (or the active area of the object) that you want to change shape is multi-touched and dragged so as to be recognized as the target button. To be recognized as the target range,

If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is any of the upper right side, lower right side, upper left side, or lower left side,

If the determined dragging direction is closer to the center of the object (or the active area of the object), the length of the horizontal side and the vertical side is reduced, and if the horizontal side is reduced, both horizontal sides are reduced to the same length, If the side is reduced, both vertical sides are reduced to the same length, and the ratio of change in width and length can be set differently according to which direction is dragged in the specific drag direction range determined by the device. You can also set the width and length to be the same ratio no matter what direction you drag. (In addition, as the center of the object moves in the determined dragging direction, the vertex closest to the straight line parallel to the dragging direction among the vertices in the recognized target range is moved to reduce the position of the opposite vertex of the vertex. May be unchanged.)

If the determined dragged direction is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. In this case, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length, depending on which direction within the specific drag direction range determined by the device. You can set the rate of change of the length and length to be different, or set the width and length to be the same rate no matter what direction you drag within the specific drag direction range. (In addition, as the center of the object moves in the determined dragging direction, the vertex closest to the straight line parallel to the dragging direction among the vertices in the recognized target range is moved for the enlargement, and the position of the opposite vertex of the vertex May be unchanged.)

The method of method "②" herein refers to the method of the present invention 9) to 16) of the 17 object changes in step 4 in the object shape deformation method that requires the activation step of the conventional object mentioned in the background section It describes how it can be implemented.

To give a more specific example,

The object (or the active area of the object) that you want to change shape is multi-touched and dragged so that it is recognized as the target button, and the specific point within the object (or the active area of the object) is targeted by the hitting point and the direction of dragging. In the multi-touch with the index finger and middle finger so that the index finger is recognized as the reference finger,

1) In the multi-all dragging after the 5th range is touched with the index finger as the reference finger so that the 5th range of FIG. 45 (a) is recognized as the target range, the dragging starts upward and is completed. The aspect "1)" of the 17 object change aspects in the four steps in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

2) In the multi-all dragging after the 5th range is touched with the index finger as the reference finger so that the 5th range of FIG. 45 (a) is recognized as the target range, the dragging starts to the bottom and is completed. The aspect "2)" of the fourteen object change aspects in the four step in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

3) In the multi-all drag after the 7th range is touched with the index finger as the reference finger so that the 7th range of FIG. 45 (a) is recognized as the target range, the dragging starts upward and is completed. The aspect "3)" of the fourteen object changes in four steps in the object shape deformation method requiring the activation of the conventional object mentioned in the background section is implemented.

4) In the multi-all drag after the 7th range is touched with the index finger as the reference finger so that the 7th range of FIG. 45 (a) is recognized as the target range, the dragging starts to the bottom and is completed. Among the 17 object change aspects in step 4 in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section, the "4)" phase is implemented.

5) In the multi-all drag after the 8th range is touched with the index finger as the reference finger so that the 8th range of FIG. 45 (b) is recognized as the target range, the dragging starts to the right and is completed. The aspect "5)" of the fourteen object changes in four steps in the object shape deformation method requiring the activation of the conventional object mentioned in the background section is implemented.

6) Multi-drag after 2 touches so that the 8th range is touched with the index finger as the reference finger so that the 8th range of FIG. 45 (b) is recognized as the target range. Among the seventeen object changes in four steps in the object shape deformation method requiring the activation of the conventional object mentioned in the background section, the "6)" phase is implemented.

7) FIG. 45 (b) is multi-all dragged after 2 multi-touch so that the 6th range is touched by the index finger as the reference finger so that the 6th range of the drawing is recognized as the target range. The aspect "7)" of the fourteen object changes in four steps in the object shape deformation method requiring the activation of the conventional object mentioned in the background section is implemented.

8) In the multi-all dragging after the 6th range is touched with the index finger as the reference finger so that the 6th range of FIG. 45 (b) is recognized as the target range, the dragging starts to the left and is completed. The aspect "8)" of the fourteen object change aspects in the four step in the object shape deformation method requiring the activation of the conventional object mentioned in the background section is implemented.

9) In the multi-all dragging after the first touch is touched by the index finger as the reference finger so that the first range of the drawing is recognized as the target range in FIG. The aspect "9)" of the 17 object change aspects in the four steps in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

10) In multi-all dragging after the first touch is touched by the index finger as the reference finger so that the first range of FIG. 45 (b) is recognized as the target range, the dragging starts to the upper left and is completed. The aspect "10)" of the 17 object change aspects in the four steps in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

11) FIG. 45 (b) is multi-all dragged after 2 multi-touch so that the 4th range is touched by the index finger as the reference finger so that the 4th range of the drawing is recognized as the target range, and when dragging starts to the right lower side and is completed, Among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section, the "11)" aspect is implemented.

12) In the multi-all dragging after the multi-touch is performed so that the fourth range is touched by the index finger as the reference finger so that the fourth range of FIG. 45 (b) is recognized as the target range, the dragging starts to the upper left and is completed. The aspect "12)" of the 17 object change aspects in the fourth step in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

13) FIG. 45 (b) is multi-all dragged after 2 touches so that the 2nd range is touched by the index finger as the reference finger so that the 2nd range of the drawing is recognized as the target range, the dragging starts to the upper right side and is completed. Among the 17 object change aspects in step 4 in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section, the "13)" aspect is implemented.

14) In the multi-all dragging after the second range is touched by the index finger, which is the reference finger, so that the second range of the drawing is recognized as the target range, the second range of FIG. The aspect "14)" of the fourteen object change aspects in the four step in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

15) In the multi-all dragging after the second range is touched with the index finger as the reference finger, the third range of FIG. 45 (b) is recognized as the target range. Among the 17 object change aspects in step 4 in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section, the "15)" aspect is implemented.

16) In the multi-all dragging after the second range is touched with the index finger as the reference finger, the third range of FIG. 45 (b) is recognized as the target range. The aspect "16)" of the fourteen object change aspects in the four steps in the object shape deformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

17) Regardless of any of the drawings (a), (b), (c), and (d) of FIG. 45, any range of an object (or an active area of the object) is recognized as a target range, that is, at any point In multi-all dragging after being touched by the index finger, which is a reference finger, the object (or the active area of the object) rotates when the drag trajectory is a trajectory of a curve rather than a straight line within a predetermined curvature range.

If it is expressed in technical language as above, it seems to be a little complicated. From the user's point of view, according to the intuition, if the target button recognition method by the reference finger is used as the target button recognition method, the touch point is determined by touching the touch point to which the reference finger should be touched, and dragged in the desired direction to reduce or reduce it. You just need to zoom in.

In the object shape deformation method that requires the activation step of a conventional object, the mouse pointer is placed only on the zoom control point at the side or vertex of which the zooming or contraction starts, and then the object is dragged in the desired direction while pressing the left mouse button. Zoomed in or out,

In the multi-touch method of the present application, when referring to the point where the reference finger should be touched, the method of the present application does not require the activation of the object, but the object activation area boundary when the object activation area boundary is assumed to appear as in the prior art. It may extend to a zoom control point that exists, or to an interior point of an object near or near it. The drag direction is the same as the conventional method.

A more specific example will be explained.

In the following examples of (a), (b), (c) and (d),

The object activation area concept of the object does not require the activation of the object in the method of the present invention, but the object activation area when assuming that the object activation area boundary appears in the head assuming that the object is activated as in the prior art. Keep in mind that

The same applies to the concept of the active area boundary of an object.

In addition, the target point may be extended and applied not only to a zoom control point on the object activation area boundary line in the conventional manner but also to a point within a boundary line close to the control point, and to an outside point of the object or a point within the object close to the control point. It is recommended to do so. Of course, in order to recognize an object as a target object even if a zoom control point on the object activation area boundary as well as a point within a boundary line close to the control point and an external point of the object are multi-touched by the reference finger, the object is recognized in advance in such a manner. Should be set to

(a) For example, multi-touch such that the reference finger touches the zoom control point on the object left / right activation area boundary or an internal point of the object around or near the object, for example, the index finger After two touches with the index finger and the middle finger so as to be recognized by a finger, the touch and the middle of the index finger and middle finger are held and dragged left and right, so that the vertical length of the object is not changed, and the horizontal length of the object can be enlarged or reduced.

Herein, among the 17 object changes in 4 steps in the object shape deformation method that requires the activation step of the conventional object mentioned in the Background section, the method of 5) to 8) is implemented by the method of the present application. An example is mentioned.

(If the activation area boundary is not formed in the same range as the shape like a rectangle, but if it is difficult to predict the position of the area boundary to be activated, such as a star shape, the above method is performed after activating the object by single touch or the like. After the multi-touch, you can drag it to zoom in or out, even in the example 2) or 3) below.)

(b) Multi-touch, for example, so that the reference finger touches the zoom control point on the object up / down active area boundary, or an inner point of the object near or near the object, for example, the index finger After two touches with the index finger and the middle finger so as to be recognized by the finger, the index finger is dragged up and down while maintaining the touch state of the middle finger and the middle finger, so that the horizontal length of the object is not changed, and the vertical length of the object can be enlarged or reduced.

Herein, the method of 1) to 4) of the 17 object changes in 4 steps in the object shape deformation method that requires the activation step of the conventional object mentioned in the background section of the method is implemented by the method of the present application. An example is mentioned.

(c) multi-touch, for example, so that the reference finger touches the zoom control point at the vertex of the object activation area, or an interior point of the object near, or near, the index finger, for example, After two touches with the index finger and the middle finger to be recognized, the touch and the middle of the index finger can be dragged in a diagonal direction while maintaining the touch state of the index finger and the middle finger to enlarge or reduce the horizontal and vertical lengths of the object. Of course, the ratio of the horizontal length to the vertical length to be enlarged / reduced may vary depending on the dragging direction.

Herein, among the 17 object changes in 4 steps in the object shape deformation method requiring the activation step of the conventional object mentioned in the Background section, aspects 9) to 16) of the method are implemented by the present method. An example is mentioned.

(d) For example, multi-touch so that the reference finger touches an internal point of the object inside the object activation area boundary, for example, after two multi-touchs with the index finger and the middle finger so that the index finger is recognized as the reference finger. While the touch state is maintained, the object may be rotated by dragging the curve above a predetermined curvature.

Herein, reference is made to an example of how the method of step 17) is implemented in the method of the present application among the 17 object changes in 4 steps in the object shape deformation method requiring the activation step of the conventional object mentioned in the Background section. It is.

You can understand it more easily through the following ① ~ ⑧ examples.

The following examples (1) to (8) are included in the above concept. When the drag proceeds in a direction close to the straight line passing through the center of the object perpendicular to the drag direction, it is reduced and the center of the object perpendicular to the drag direction is reduced. It may be said that the drag is enlarged when the drag proceeds in a direction away from the straight line.

When dragging diagonally in the following ① ~ ⑧ examples, only the case in which the horizontal length and the vertical length are enlarged or reduced at the same ratio is given. However, it can be set to enlarge at a different ratio according to the drag direction.

① It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest Y-values in the active area of the object (object or object) before the shape deformation of the object are (X1, Y1), and the coordinates with the smallest Y-values are (X2, Y2). time,

The index finger is expected to be recognized as a reference finger at a point within the (object area or) object activation area (eg area 5 in FIG. 45) having a Y value equal to or greater than Y1, Y2's median value (= (Y1 + Y2) / 2). When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' upward, the horizontal length of the object may be enlarged without changing the horizontal length. Even when only the vertical length is enlarged, the coordinate (s) with the smallest Y value of the (object area or) object activation area (for example, the lower horizontal side) is unchanged, and the coordinate with the largest Y value of the (object or) object activation area ( (E.g., the top horizontal side) can be extended only to the vertical length of the object, moving upward. To briefly describe the above description in the drawings, an example of changing from Fig. 26 to Fig. 27 is exemplified.

If it is to be recognized as a reference finger at a point in the (object area or) object activation area (eg area 7 in FIG. 45) having a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) If the index finger is to be touched and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' upward, the horizontal length of the object can be reduced by only the vertical length without changing. Even if only the vertical length is reduced, the coordinate (s) with the largest Y value of the (object area or) object activation area is unchanged, and the coordinate (s) with the smallest Y value of the (object area) or object activation area is further changed. Only the vertical length of the object can be reduced by moving upwards. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

② It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest Y-values in the active area of the object (or the object region) before the shape deformation of the object are (X1, Y1), and the coordinates with the smallest Y-values are (X2, Y2). time,

The index finger to be recognized as the reference finger is touched at a point within the (object area or) object activation area with a Y value equal to or greater than Y1, Y2 (= (Y1 + Y2) / 2), and the stop is to the right of the index finger. After being touched anywhere on the part, if you 'multi-drag' the lower side, you can reduce the vertical length of the object without changing the horizontal length of the object. Even if only the vertical length is reduced, the coordinate (s) with the smallest Y value of the (object area) or the object activation area is moved to the lower side without changing the coordinate (s) with the largest Y value of the (object or) object activation area. In the form of losing, only the length of the object can be reduced. To briefly describe the above description in the drawings, an example of changing from FIG. 27 to FIG.

If the index finger to be recognized as a reference finger is touched at a point in the (object area or) object activation area having a Y value less than the median value of Y1 and Y2 (= (Y1 + Y2) / 2), the middle finger is detected. If you touch any part of the right side of, then 'multi-drag' to the bottom, you can enlarge the vertical length without changing the object's width. Even if only the vertical length is enlarged, the coordinate (s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate (s) having the smallest Y value of the (object area) or object activation area is further changed. Only the vertical length of the object can be enlarged by moving downward. To briefly describe the above description in the drawings, an example of changing from FIG. 28 to FIG.

③ Two (2) touches are detected and stopped so that the (object or) object activation area becomes the target button. In multi-touch, the coordinate where the X value is the largest in the object area or the active area of the object before the shape deformation of the object is (X1, Y1), and the coordinate where the X value is the smallest is (X2, Y2). time,

The index finger is expected to be recognized as a reference finger at a point within the (object region or) object activation region (eg region 6 in FIG. 45) having an X value equal to or greater than X1, X2 (= (X1 + X2) / 2). When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' to the right, the vertical length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate (s) with the smallest X value of the (object area or) object activation area (for example, the left vertical side) is unchanged, and the coordinate with the largest X value of the (object or) object activation area is unchanged. (S) (e.g., right vertical side) can be extended to the right of the object's width in such a way that it is shifted to the right. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

If a reference finger is to be recognized as a reference finger at a point in an object activation area (eg, area 8 of FIG. 45) having an X value less than an intermediate value of X1 and X2 (= (X1 + X2) / 2) If the index finger is to be touched and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' to the right, the vertical length of the object may be reduced only without changing the width. Even if only the horizontal length is reduced, the coordinate (s) having the largest X value of the (object area or) object activation area is unchanged, and the coordinate (s) having the smallest X value of the (object area) or object activation area is further changed. Only the width of the object can be reduced by moving it to the right. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

④ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinate where the X value is the largest in the object area or the active area of the object before the shape deformation of the object is (X1, Y1), and the coordinate where the X value is the smallest is (X2, Y2). time,

The index finger to be recognized as the reference finger is touched at a point within the (object area or) object activation area having an X value equal to or greater than X1, X2 (= (X1 + X2) / 2), and the stop is to the right of the index finger. After being touched at any point of the part, if the user multi-drags to the left, the vertical length of the object can be reduced without changing the vertical length. Even though only the horizontal length is reduced, the coordinates having the smallest X value of the (object area) or the object activation area are shifted to the left without changing the coordinates having the largest X value of the (object or) object activation area. Only the horizontal length of can be reduced. To briefly describe the above description in the drawings, an example may be changed from FIG. 29 to FIG.

If the index finger to be recognized as a reference finger is touched at a point in the (object area or) object activation area having an X value of less than an intermediate value (= (X1 + X2) / 2) of X1 and X2, the middle finger is detected. If you touch any part of the right side of the `` multi-all drag '' to the left, you can enlarge the width of the object without changing its height. Even though only the horizontal length is enlarged, the coordinates having the largest X value of the (object area) or the object activation area are shifted to the left without changing the coordinates having the smallest X value of the (object area) or the object activation area. Only the width of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 30 to FIG.

⑤ It is multi-touched by detecting and stopping so that the object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

(Object region or) object activation region (with an X value equal to or greater than X1, X2 (= (X1 + X2) / 2) and a Y value equal to or greater than Y1, Y2 (= (Y1 + Y2) / 2) For example, the index finger to be recognized as a reference finger is touched at a point within the area (which may be included in region 2 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag to the upper right side'. ', The width and height of the object can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the smallest X value and the Y value of the object activation area (or vertex 3 in FIG. 39) without change (object or) Coordinates with the largest X and Y values (eg vertex 2 in FIG. 39) of the object activation area may be shifted to the upper right side to enlarge the length of the object. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

(Object region or) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) The index finger to be recognized as a reference finger is touched at a point within the object activation area (e.g., an area that can be included in area 3 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, then to the upper right side. If you 'multi-drag', the object's width and height can be reduced by the same ratio. Even though the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates having the largest X and Y values of the (object area or) object activation area are not changed, and the X and Y values of the (object area or) object activation area are unchanged. The smallest of these values is shifted to the upper right side so that the length of the object can be reduced. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.

⑥ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

Within an object activation area (object region or object) having an X value greater than or equal to X1, X2 (= (X1 + X2) / 2) and a Y value greater than or equal to Y1, Y2 (= (Y1 + Y2) / 2) Touch the index finger to be recognized as the reference finger at the point, and stop the middle finger at any point on the right side of the index finger, and then 'multi-drag' all the way to the left and bottom to reduce the horizontal and vertical lengths of the object. can do. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates of the smallest X and Y values of the (object area) or the object activation area are not changed, and the X and Y values of the (object or) object activation area are not changed. The largest and the smallest coordinates are shifted to the lower left side so that the length of the object can be reduced. The above description will be briefly explained with reference to FIG. 31, for example.

(Object region or) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) When the index finger to be recognized as a reference finger is touched at a point within the object activation area, the middle finger is touched at any point on the right side of the index finger, and then 'multi-all dragged' to the lower left side, the object has the same horizontal and vertical length. Can be enlarged in proportion. Even if the width and height of the object are enlarged at the same ratio, the coordinates with the largest X and Y values of the (object area or) object activation area are not changed, and the X and Y values of the (object area) or object activation area are unchanged. The coordinates with the smallest value are shifted further to the lower left, so that the length of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 32 to FIG.

⑦ It is multi-touched by detecting and stopping so that the object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

(Object area or) object activation area with an X value greater than or equal to X1 and X2 (= (X1 + X2) / 2) and a Y value less than or equal to Y1 and Y2 (= (Y1 + Y2) / 2) For example, the index finger to be recognized as a reference finger is touched at a point within the area that can be included in area 4 of FIG. 45, and the middle finger is touched at any point on the right side of the index finger. When dragged, the object's width and height can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the smallest X value and the largest Y value (e.g., vertex 1 in FIG. 39) of the (object area or) of the object activation area remain unchanged. Alternatively, the horizontal and vertical lengths of the object may be enlarged in such a manner that the coordinates of the object activation area having the largest X value and the smallest Y value (for example, vertex 4 of FIG. 39) are moved to the lower right side. The above description will be briefly explained with reference to FIG. 26, for example.

(Object region or) object having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value greater than the median value of Y1, Y2 (= (Y1 + Y2) / 2) The index finger to be recognized as a reference finger is touched at a point within the active area (e.g., an area that can be included in area 1 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, When multi-all dragged, the object's width and height can be reduced by the same ratio. Even though the horizontal and vertical lengths of the object are reduced by the same ratio, the X value of the (object region) or the object activation region is unchanged without changing the coordinates having the largest X value and the smallest Y value of the (object region) or the object activation region. The smallest and largest Y coordinates are shifted to the lower right side so that the length of the object can be reduced. The above description will be briefly explained with reference to FIG. 26, for example.

⑧ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

(Object area or) object activation area with an X value greater than or equal to X1 and X2 (= (X1 + X2) / 2) and a Y value less than or equal to Y1 and Y2 (= (Y1 + Y2) / 2) When the index finger is to be touched at the point within the finger, the middle finger is touched at any point on the right side of the index finger, and then 'multi-draged' to the upper left side, the horizontal and vertical lengths of the object are reduced by the same ratio. It can be done. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates of the smallest X value and the largest Y value of the (object area) or the object activation area are unchanged, and the X value of the (object or) object activation area is the highest. The horizontal and vertical lengths of objects can be reduced by shifting the coordinates with the largest and smallest Y value to the upper left side. To briefly describe the above description in the drawings, an example of changing from FIG. 33 to FIG.

(Object region or) object having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value greater than the median value of Y1, Y2 (= (Y1 + Y2) / 2) When the index finger to be recognized as a reference finger is touched at a point in the active area, the middle finger is touched at any point on the right side of the index finger, and then 'multi-draged' to the upper left side, the horizontal and vertical lengths of the object are the same. Can be enlarged to Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the largest X value and the smallest Y value of the (object area or object activation area) are unchanged, and the X value of the object activation area (or object area) is unchanged. The smallest and largest Y-coordinates are shifted to the upper left side so that the length of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 34 to FIG.

For reference, in a situation where an object including a picture, a picture, a browser, a window, or an object including a change in the shape of an object is changed instead of a button to which a character is assigned, in the case of a device such as a mobile phone or a smartphone equipped with a small display device, In most cases, since only one object is often displayed and used, it is not important which of the multi-touched fingers is determined as the 'reference finger'.

That is, when one or more fingers are touched by an object, any object may be recognized by the device as a target button. In that state, the object may be reduced or enlarged through various operations including multi-all dragging as described above. The shape may be changed.

Even in a dedicated screen in which the shape of the object is changed, even if no one touches the object among the multi-touch fingers, the device is recognized as the target button only by the screen being multi-touched. Through various manipulations including multi-all dragging, the shape of the object may be changed, including that the object is reduced or enlarged.

In addition, when a specific button is touched by a finger, a button desired to be touched is also touched, but the finger may be thick and touched to an undesired button. In such a case, only the button belonging to the center of the touched range may be touched. It can also be perceived as being done.

5. Electronic device to which the present invention is applicable

Devices to which the present invention is applicable are all devices capable of recognizing touch.

For example, there are mobile phones, smartphones, feature phones, PDAs, tablet PCs, general PCs, laptops, and the like.

25 is a block diagram of an electronic device to which the present invention is applicable. As illustrated in FIG. 25, an electronic device to which the present invention is applicable includes a touch screen 110, a function block 120, a controller 130, a storage 140, and a communicator 150.

The touch screen 110 displays the above-described touch buttons and is a means used to touch a touch button desired by a user with a finger.

The function block 120 performs an inherent function of the electronic device. If 1) the electronic device is a mobile phone, the function block 120 performs a mobile phone function, 2) if the electronic device is a mobile computer, the function block 120 performs a computing function, and 3) the electronic device If the mobile multimedia player, the function block 120 performs a multimedia playback function, 4) If the electronic device is a general notebook or PC, the function block 120 performs a computing function.

The storage unit 140 stores a program and data used to perform a function of an electronic device and generate a GUI screen composed of the above-described touch buttons, and provides a storage space for storing a multimedia file.

The controller 130 executes a program stored in the storage 140 to control the performance of the function by the function block 120 and displays a GUI composed of touch buttons on the touch screen 110. In addition, the controller 130 performs character input, object adjustment, and function execution according to a user's manipulation input using the touch buttons displayed through the touch screen 110.

The communication unit 150 is connected to communicate with other electronic devices to perform data communication.

In addition, while the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

110: touch screen
120: function block
130: control unit
140:
150:

Claims (162)

In a device having a touch screen, when the touch screen is multi-touch, the target button is recognized in the method,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. The method according to claim 1,
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) The method according to claim 2,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. The method according to claim 2,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. The method according to claim 2,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. The method according to claim 2,
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. The method according to claim 1,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) The method according to any one of claims 1 to 7,
In a device equipped with a touch screen, after the multi-touch operation, a method for generating a work signal for any operation, including character input or object deformation,
And the method to be operated after the multi-touch is multi-on & off, multi-drag and post-multi-touch operation by the open fingers. The method according to claim 8,
The multi on & off method is any one or more of the following methods.
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off The method according to claim 9,
The multi multi-not all on & off method is any one or more of the following methods.
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off) The method according to claim 8,
The multi-drag method is any one or more of the following methods.
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle up drag The method of claim 11,
The multi-not all drag method is any one or more of the following methods.
1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)
1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle) The method according to claim 8,
The post-multi-touch operation by the open fingers (= post-multi-touch operation by the open touch point) is a method according to any one or more of the following methods.
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger
1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)
1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)
1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)
1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)
1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)
1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point) In a device having a touch screen, when the touch screen is multi-touch, the multi-touch method which is a method for the multi-touch process is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) In a device equipped with a touch screen, after the multi-touch operation, a method for generating a work signal for any operation, including character input or object deformation,
And the method to be operated after the multi-touch is multi-on & off, multi-drag and post-multi-touch operation by the open fingers. The method according to claim 15,
The multi on & off method is any one or more of the following methods.
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off The method according to claim 16,
The multi multi-not all on & off method is any one or more of the following methods.
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off) The method according to claim 15,
The multi-drag method is any one or more of the following methods.
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle up drag The method according to claim 18,
The multi-not all drag method is any one or more of the following methods.
1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)
1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle) The method according to claim 15,
The post-multi-touch operation by the open fingers (= post-multi-touch operation by the open touch point) is a method according to any one or more of the following methods.
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger
1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)
1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)
1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)
1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)
1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)
1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point) In a device equipped with a touch screen, after the multi-touch operation, a method for generating a work signal for any operation, including character input or object deformation,
The operation method after the multi-touch,
And a method for performing different operations depending on the number of times the multi-on & off is performed at least once in succession, i.e., the multi-tap method. The method according to claim 21, wherein when a character is input by a multi-tap method,
And the characters belonging to the target character group related to the target button are displayed in a cycle according to the number of times the multi on & off is performed at least once in succession. 23. The method of claim 22,
After the characters are displayed in a circular manner, the displayed characters are deterministically input after a single touch, multi-touch, cursor movement, or a certain time (for example, 2 seconds) so that another button is recognized as a target button. 23. The method of claim 22,
When multi-touch when multi-tap is expressed in more detail with n multi-touch,
According to at least one value of n, i.e., according to the situation before the last operation, a specific character group is matched among the at least one character group, and belongs to the matched character group and at least one of the at least one character associated with the target button. Characters are input without changing the character mode. The method of claim 24,
The "specific character group" is any one of the following character groups.
1) Any character group from two or more different character groups classified under different spelling rules.
2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button (If the first specific order and the second specific order are the same, it means one order.)
5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method according to claim 25,
"Specific character group" means that a character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode in the spelling rule corresponding to the currently set character mode. The method of claim 24,
"Specific character groups" means that any one of two or more different character groups classified under different spellings.
In English,
If the current text mode is set to uppercase mode, the group of characters that can be entered in lowercase mode or
If the currently set text mode is a lowercase mode, the group of characters that can be entered in uppercase mode, or
In Japanese
If the currently set text mode is Hiragana text mode, the text group that can be input in Katakana text mode,
If the currently set character mode is Katakana character mode, characterized in that it comprises a character group that can be input in the hiragana character mode. The method according to any one of claims 21 to 27,
In the way the target button is recognized,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. 29. The method of claim 28,
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) The method of claim 29,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. The method of claim 29,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. The method of claim 29,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. The method of claim 29,
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. 29. The method of claim 28,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) The method according to any one of claims 21 to 34, wherein
The multi-touch,
And two fingers used to recognize the two touches recognized by the two touch points. 36. The method of claim 35,
The two fingers,
Index finger and middle finger. The method according to any one of claims 21 to 36,
The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) The method according to any one of claims 21 to 37,
The post-multi-touch operation is at least one of the following operations.
1.5.2..2. Multi On & Off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger The method according to any one of claims 21 to 38,
Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters. The method of claim 21, wherein
The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method. Multi-touching the object (or the active area of the object) to be recognized as the target button
And deforming the object (or an active area of the object) according to the operation after the multi-touch. The method of claim 41,
In the way the target button is recognized,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. The method of claim 42,
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) The method of claim 43,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. The method of claim 43,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. The method of claim 43,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. The method of claim 43,
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. The method of claim 42,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) The method of claim 41, wherein
Operation is a method of deformation of an object, characterized in that the drag. The method of claim 49
And dragging in at least one first specific direction enlarges the object (or active area of the object), and dragging in at least one second specific direction reduces the object (or active area of the object). The method of claim 50,
When dragging upwards, it zooms in,
If the drag in the downward direction, characterized in that the reduction. The method of claim 50,
The method of expanding or contracting, wherein the ratio of the length of the object to the length of the object is maintained. The method of claim 50,
When zooming in or out, the center point of the object is not moved. The method of claim 49,
And the width of the object (or the active area of the object) only or the length of the object or the length and length of the object are enlarged or reduced together by the drag direction determined by the device. The method of claim 54, wherein
When dragged in the first specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is expanded,
When dragged in the second specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is reduced,
When dragged in the first specific direction in the vertical direction, the horizontal length does not change, and the vertical length is expanded,
When dragged in the second specific direction in the longitudinal direction, the horizontal length does not change, and the vertical length is reduced,
When dragging in at least one first specific direction of the diagonal direction, the horizontal length and the vertical length are enlarged at the same ratio,
When the drag in the at least one second specific direction of the diagonal direction, characterized in that the horizontal length and vertical length is reduced by the same ratio. The method of claim 55,
When dragged to the right, the width is enlarged,
When dragged to the left, the width is reduced,
When dragged upwards, the vertical length is enlarged,
When dragging downwards, the vertical length is reduced,
When dragged in the upper left or upper right direction, the width and length are enlarged at the same ratio,
When dragging in the lower left or lower right direction, the horizontal length and the vertical length is reduced in the same ratio. The method of claim 54, wherein
When dragged in the first specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is expanded,
When dragged in the second specific direction in the horizontal direction, the vertical length does not change, and the horizontal length is reduced,
When dragged in the first specific direction in the vertical direction, the horizontal length does not change, and the vertical length is expanded,
When dragged in the second specific direction in the longitudinal direction, the horizontal length does not change, and the vertical length is reduced,
When dragged in at least one first specific direction range in a diagonal direction, the horizontal length and vertical variation ratio are enlarged differently according to each direction within the range,
When the drag in the at least one second specific direction range of the diagonal direction, the horizontal length and the vertical variation ratio is reduced according to each direction in the range differently. The method of claim 57, wherein
When dragged to the right, the width is enlarged,
When dragged to the left, the width is reduced,
When dragged upwards, the vertical length is enlarged,
When dragging downwards, the vertical length is reduced,
When dragging in the upper left or right upper direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently according to which direction of the upper left range or the upper right range,
When dragging in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently according to which direction of the lower left range or the lower right range. The method of claim 54, wherein
Wherein the center point of the object does or does not move in enlarging or reducing. The method of claim 49,
Step 1: The object (or the active area of the object) is multi-touched and started to be dragged to be recognized as the target button, and the specific range within the object (or the active area of the object) is determined by the hitting point and the direction of dragging. To be recognized as a step.
Step 2: The width or length of the object (or the active area of the object) varies depending on the recognized hit point and the determined drag direction, and the direction from which the drag is started is closer to the center of the object (or the active area of the object). And reducing in the direction, and expanding in the direction away. The method of claim 60,
If the direction in which the drag starts (determined by the device), that is, the drag direction intended by the user is determined to be one of the upper side, the lower side, the right side, or the left side,
If the determined drag-starting direction is closer to the center of the object (or the active area of the object),
The length of the two sides parallel to the determined drag direction among the two horizontal sides or the two longitudinal sides of the object (or the active area of the object) is reduced, and the length of the two sides perpendicular to the determined drag direction is unchanged,
If the determined drag start direction is a direction away from the center of the object (or the active area of the object),
The length of two sides parallel to the determined drag direction among the two horizontal sides or the two longitudinal sides of the object (or the active area of the object) is enlarged, and the length of the two sides perpendicular to the determined drag direction is unchanged,
If the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is determined to be one of the upper right, lower right, upper left, or lower left directions,
If the determined dragging direction is closer to the center of the object (or the active area of the object), the length of the horizontal side and the vertical side is reduced, and if the horizontal side is reduced, both horizontal sides are reduced to the same length, If the side is reduced, both vertical sides are reduced to the same length, and the ratio of change in width and length can be set differently according to which direction is dragged in the specific drag direction range determined by the device. You can set the width and length to be the same ratio no matter what direction you drag in,
If the determined dragged direction is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. In this case, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length, depending on which direction within the specific drag direction range determined by the device. A method of changing the length and the vertical length may be set differently or the horizontal and vertical lengths may be set to be different in the same ratio no matter which direction is dragged in a specific drag direction range. The method of claim 61,
If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is the upper right side, lower right side, upper left side, lower left side,
If the determined dragging direction is closer to the center of the object (or the active area of the object), the drag determined from three sides surrounding the recognized target range while the center of the object moves in the determined dragging direction. The position of the side perpendicular to the direction is moved for the reduction, and the position of the opposite side of the side does not change,
If the determined dragging direction is a direction away from the center of the object (or the active area of the object), the drag direction determined from three sides surrounding the recognized target range while the center of the object moves in the determined drag direction. The position of the side perpendicular to the side is moved for enlargement, and the position of the opposite side of the side does not change,
If the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is determined to be one of the upper right, lower right, upper left, or lower left directions,
-If the determined dragging direction is close to the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, and is parallel to the dragging direction among the vertices in the recognized target range. The vertex closest to the straight line is moved for reduction, and the position of the vertex facing the vertex may not be changed,
If the determined dragging direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, and a straight line parallel to the dragging direction among the vertices in the recognized target range. And the vertex closest to is moved for enlargement, and the position of the opposite vertex of the vertex may not be changed. The method of claim 62, wherein
① It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest Y-values in the active area of the object (object or object) before the shape deformation of the object are (X1, Y1), and the coordinates with the smallest Y-values are (X2, Y2). time,
The index finger is expected to be recognized as a reference finger at a point within the (object area or) object activation area (eg area 5 in FIG. 45) having a Y value equal to or greater than Y1, Y2's median value (= (Y1 + Y2) / 2). When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' upward, the horizontal length of the object may be enlarged without changing the horizontal length. Even when only the vertical length is enlarged, the coordinate (s) with the smallest Y value of the (object area or) object activation area (for example, the lower horizontal side) is unchanged, and the coordinate with the largest Y value of the (object or) object activation area ( (E.g., the top horizontal side) can be extended only to the vertical length of the object, moving upward. To briefly describe the above description in the drawings, an example of changing from Fig. 26 to Fig. 27 is exemplified.
If it is to be recognized as a reference finger at a point in the (object area or) object activation area (eg area 7 in FIG. 45) having a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) If the index finger is to be touched and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' upward, the horizontal length of the object can be reduced by only the vertical length without changing. Even if only the vertical length is reduced, the coordinate (s) with the largest Y value of the (object area or) object activation area is unchanged, and the coordinate (s) with the smallest Y value of the (object area) or object activation area is further changed. Only the vertical length of the object can be reduced by moving upwards. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.
② It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest Y-values in the active area of the object (or the object region) before the shape deformation of the object are (X1, Y1), and the coordinates with the smallest Y-values are (X2, Y2). time,
The index finger to be recognized as the reference finger is touched at a point within the (object area or) object activation area with a Y value equal to or greater than Y1, Y2 (= (Y1 + Y2) / 2), and the stop is to the right of the index finger. After being touched anywhere on the part, if you 'multi-drag' the lower side, you can reduce the vertical length of the object without changing the horizontal length of the object. Even if only the vertical length is reduced, the coordinate (s) with the smallest Y value of the (object area) or the object activation area is moved to the lower side without changing the coordinate (s) with the largest Y value of the (object or) object activation area. In the form of losing, only the length of the object can be reduced. To briefly describe the above description in the drawings, an example of changing from FIG. 27 to FIG.
If the index finger to be recognized as a reference finger is touched at a point in the (object area or) object activation area having a Y value less than the median value of Y1 and Y2 (= (Y1 + Y2) / 2), the middle finger is detected. If you touch any part of the right side of, then 'multi-drag' to the bottom, you can enlarge the vertical length without changing the object's width. Even if only the vertical length is enlarged, the coordinate (s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate (s) having the smallest Y value of the (object area) or object activation area is further changed. Only the vertical length of the object can be enlarged by moving downward. To briefly describe the above description in the drawings, an example of changing from FIG. 28 to FIG.
③ Two (2) touches are detected and stopped so that the (object or) object activation area becomes the target button. In multi-touch, the coordinate where the X value is the largest in the object area or the active area of the object before the shape deformation of the object is (X1, Y1), and the coordinate where the X value is the smallest is (X2, Y2). time,
The index finger is expected to be recognized as a reference finger at a point within the (object region or) object activation region (eg region 6 in FIG. 45) having an X value equal to or greater than X1, X2 (= (X1 + X2) / 2). When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' to the right, the vertical length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate (s) with the smallest X value of the (object area or) object activation area (for example, the left vertical side) is unchanged, and the coordinate with the largest X value of the (object or) object activation area is unchanged. (S) (e.g., right vertical side) can be extended to the right of the object's width in such a way that it is shifted to the right. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.
If a reference finger is to be recognized as a reference finger at a point in an object activation area (eg, area 8 of FIG. 45) having an X value less than an intermediate value of X1 and X2 (= (X1 + X2) / 2) If the index finger is to be touched and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag' to the right, the vertical length of the object may be reduced only without changing the width. Even if only the horizontal length is reduced, the coordinate (s) having the largest X value of the (object area or) object activation area is unchanged, and the coordinate (s) having the smallest X value of the (object area) or object activation area is further changed. Only the width of the object can be reduced by moving it to the right. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.
④ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinate where the X value is the largest in the object area or the active area of the object before the shape deformation of the object is (X1, Y1), and the coordinate where the X value is the smallest is (X2, Y2). time,
The index finger to be recognized as the reference finger is touched at a point within the (object area or) object activation area having an X value equal to or greater than X1, X2 (= (X1 + X2) / 2), and the stop is to the right of the index finger. After being touched at any point of the part, if the user multi-drags to the left, the vertical length of the object can be reduced without changing the vertical length. Even though only the horizontal length is reduced, the coordinates having the smallest X value of the (object area) or the object activation area are shifted to the left without changing the coordinates having the largest X value of the (object or) object activation area. Only the horizontal length of can be reduced. To briefly describe the above description in the drawings, an example may be changed from FIG. 29 to FIG.
If the index finger to be recognized as a reference finger is touched at a point in the (object area or) object activation area having an X value of less than an intermediate value (= (X1 + X2) / 2) of X1 and X2, the middle finger is detected. If you touch any part of the right side of the `` multi-all drag '' to the left, you can enlarge the width of the object without changing its height. Even though only the horizontal length is enlarged, the coordinates having the largest X value of the (object area) or the object activation area are shifted to the left without changing the coordinates having the smallest X value of the (object area) or the object activation area. Only the width of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 30 to FIG.
⑤ It is multi-touched by detecting and stopping so that the object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
(Object region or) object activation region (with an X value equal to or greater than X1, X2 (= (X1 + X2) / 2) and a Y value equal to or greater than Y1, Y2 (= (Y1 + Y2) / 2) For example, the index finger to be recognized as a reference finger is touched at a point within the area (which may be included in region 2 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, and then 'multi-drag to the upper right side'. ', The width and height of the object can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the smallest X value and the Y value of the object activation area (or vertex 3 in FIG. 39) without change (object or) Coordinates with the largest X and Y values (eg vertex 2 in FIG. 39) of the object activation area may be shifted to the upper right side to enlarge the length of the object. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.
(Object region or) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) The index finger to be recognized as a reference finger is touched at a point within the object activation area (e.g., an area that can be included in area 3 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, then to the upper right side. If you 'multi-drag', the object's width and height can be reduced by the same ratio. Even though the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates having the largest X and Y values of the (object area or) object activation area are not changed, and the X and Y values of the (object area or) object activation area are unchanged. The smallest of these values is shifted to the upper right side so that the length of the object can be reduced. To briefly describe the above description in the drawings, an example of changing from FIG. 26 to FIG.
⑥ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
Within an object activation area (object region or object) having an X value greater than or equal to X1, X2 (= (X1 + X2) / 2) and a Y value greater than or equal to Y1, Y2 (= (Y1 + Y2) / 2) Touch the index finger to be recognized as the reference finger at the point, and stop the middle finger at any point on the right side of the index finger, and then 'multi-drag' all the way to the left and bottom to reduce the horizontal and vertical lengths of the object. can do. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates of the smallest X and Y values of the (object area) or the object activation area are not changed, and the X and Y values of the (object or) object activation area are not changed. The largest and the smallest coordinates are shifted to the lower left side so that the length of the object can be reduced. The above description will be briefly explained with reference to FIG. 31, for example.
(Object region or) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value less than the median value of Y1, Y2 (= (Y1 + Y2) / 2) When the index finger to be recognized as a reference finger is touched at a point within the object activation area, the middle finger is touched at any point on the right side of the index finger, and then 'multi-all dragged' to the lower left side, the object has the same horizontal and vertical length. Can be enlarged in proportion. Even if the width and height of the object are enlarged at the same ratio, the coordinates with the largest X and Y values of the (object area or) object activation area are not changed, and the X and Y values of the (object area) or object activation area are unchanged. The coordinates with the smallest value are shifted further to the lower left, so that the length of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 32 to FIG.
⑦ It is multi-touched by detecting and stopping so that the object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
(Object area or) object activation area with an X value greater than or equal to X1 and X2 (= (X1 + X2) / 2) and a Y value less than or equal to Y1 and Y2 (= (Y1 + Y2) / 2) For example, the index finger to be recognized as a reference finger is touched at a point within the area that can be included in area 4 of FIG. 45, and the middle finger is touched at any point on the right side of the index finger. When dragged, the object's width and height can be enlarged at the same rate. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the smallest X value and the largest Y value (e.g., vertex 1 in FIG. 39) of the (object area or) of the object activation area remain unchanged. Alternatively, the horizontal and vertical lengths of the object may be enlarged in such a manner that the coordinates of the object activation area having the largest X value and the smallest Y value (for example, vertex 4 of FIG. 39) are moved to the lower right side. The above description will be briefly explained with reference to FIG. 26, for example.
(Object region or) object having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value greater than the median value of Y1, Y2 (= (Y1 + Y2) / 2) The index finger to be recognized as a reference finger is touched at a point within the active area (e.g., an area that can be included in area 1 of FIG. 45), and the middle finger is touched at any point on the right side of the index finger, When multi-all dragged, the object's width and height can be reduced by the same ratio. Even though the horizontal and vertical lengths of the object are reduced by the same ratio, the X value of the (object region) or the object activation region is unchanged without changing the coordinates having the largest X value and the smallest Y value of the (object region) or the object activation region. The smallest and largest Y coordinates are shifted to the lower right side so that the length of the object can be reduced. The above description will be briefly explained with reference to FIG. 26, for example.
⑧ It is multi-touched by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values in the object's active area (or in the object area or before the shape deformation of the object) are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
(Object area or) object activation area with an X value greater than or equal to X1 and X2 (= (X1 + X2) / 2) and a Y value less than or equal to Y1 and Y2 (= (Y1 + Y2) / 2) When the index finger is to be touched at the point within the finger, the middle finger is touched at any point on the right side of the index finger, and then 'multi-draged' to the upper left side, the horizontal and vertical lengths of the object are reduced by the same ratio. It can be done. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the coordinates of the smallest X value and the largest Y value of the (object area) or the object activation area are unchanged, and the X value of the (object or) object activation area is the highest. The horizontal and vertical lengths of objects can be reduced by shifting the coordinates with the largest and smallest Y value to the upper left side. To briefly describe the above description in the drawings, an example of changing from FIG. 33 to FIG.
(Object region or) object having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) and a Y value greater than the median value of Y1, Y2 (= (Y1 + Y2) / 2) When the index finger to be recognized as a reference finger is touched at a point in the active area, the middle finger is touched at any point on the right side of the index finger, and then 'multi-draged' to the upper left side, the horizontal and vertical lengths of the object are the same. Can be enlarged to Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates of the largest X value and the smallest Y value of the (object area or object activation area) are unchanged, and the X value of the object activation area (or object area) is unchanged. The smallest and largest Y-coordinates are shifted to the upper left side so that the length of the object can be enlarged. To briefly describe the above description in the drawings, an example of changing from FIG. 34 to FIG. The method of claim 61,
In zooming in or out, the center point of the object is moved. The method according to any one of claims 41 to 64,
The multi-touch,
And two fingers used to recognize the two touches recognized by the two touch points. The method of claim 65,
The two fingers,
Index finger and middle finger. The method according to any one of claims 41 to 66,
The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) The method according to any one of claims 41 to 67,
The post-multi-touch operation is at least one of the following operations.
1.5.2..2. Multi On & Off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle up drag
1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)
1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)
1.5.2..12. Multi power strip
1.5.2..13.1. Operation after multi-touch with open fingers (operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger
1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)
1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)
1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)
1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)
1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)
1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point) In a device having a touch screen, a method of inputting characters,
Displaying a keyboard on which a button in which a plurality of characters are assigned is displayed on a touch screen;
In the process of multi on and off so that a specific button is recognized as a target button,
After the point of multi-touch or after the point of multi-touch, including after the point at which the multi-touched finger is off (= multi-touch is released),
Character character input method comprising the step of inputting a character of a specific sequence among the characters assigned to the button recognized as the target button. The method of claim 69,
When multi-touch is expressed in more detail with n multi-touch,
and said specific order is determined according to the value of n. The method of claim 70,
Character value input method characterized in that it is determined so that the value of n and the numerical value corresponding to the order of the specific order. The method of claim 70,
If n is 2, i.e., two multi-touch, the second character assigned to the button recognized as the target button is inputted. The method of claim 70,
If n is 3, i.e., 3 multi-touch, the third character assigned to the button recognized as the target button is inputted, or
If n is 4, i.e., 4 multi-touch, the 4th character assigned to the button recognized as the target button is input-processed. The method of claim 69, wherein
In the way the target button is recognized,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. The method of claim 74, wherein
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) The method of claim 75, wherein
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. The method of claim 75, wherein
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. The method of claim 75, wherein
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. The method of claim 75, wherein
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. The method of claim 74, wherein
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) The method of claim 69, wherein
The two multi-touch is a multi-touch recognized by the touch points of the detection and middle finger,
The three multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger,
And the four multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger. 82. The method of any of claims 69-81,
The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) The method of any one of claims 69-82, wherein
The post-multi-touch operation is at least one of the following operations.
1.5.2..2. Multi On & Off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)
1.5.2..12. Multi power strip
1.5.2..13.1. Operation after multi-touch with open fingers (operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger 84. The method of any of claims 69-83,
Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters. 85. The method of any of claims 69-84,
The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method. In a device having a touch screen, a method of inputting characters,
Displaying a keyboard on which a button in which a plurality of characters are assigned is displayed on a touch screen;
When a button is operated after multi-touch so that a specific button is recognized as a target button, after the time when the operation starts after the multi-touch including after the start of the operation after the multi-touch or after the end of the operation,
Character input method comprising the; step of inputting a character of a specific sequence among the characters assigned to the button recognized as the target button by the multi-touch operation. The method of claim 86,
According to the operation after the multi-touch,
Character input method characterized in that the specific order of the characters to be input is determined. The method of claim 87,
If the drag direction is different, the character input method characterized in that it is recognized that the operation type is different after the multi-touch. The method of claim 87,
According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character associated with the target button is input without belonging to the character group while belonging to the matched character group. Characterized in that the method. The method of claim 89,
The "specific character group" is any one of the following character groups.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button (If the first specific order and the second specific order are the same, it means one order.)
5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method of claim 86, wherein
In the way the target button is recognized,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. The system of claim 91, wherein
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) The system of claim 92, wherein
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. The system of claim 92, wherein
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. The system of claim 92, wherein
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. The system of claim 92, wherein
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. The system of claim 91, wherein
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) 97. The method of any of claims 86-97,
The multi-touch,
And two fingers used to recognize the two touches recognized by the two touch points. The method of claim 98,
The two fingers,
Index finger and middle finger. The method of claim 86, wherein
The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) The method according to any one of claims 86 to 100,
The post-multi-touch operation is at least one of the following operations.
1.5.2..2. Multi On & Off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle up drag
1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)
1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)
1.5.2..12. Multi power strip
1.5.2..13.1. Operation after multi-touch with open fingers (operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger
1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)
1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)
1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)
1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)
1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)
1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point) 101. The method of any of claims 86-101,
Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters. 103. The method of any of claims 86-102,
The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method. In a device having a touch screen, a method of inputting characters,
After the keyboard displays on the touch screen,
In the case where the specific button is operated after multi-touch so that it is recognized as the target button,
The starting point of the final operation of at least one of the final operations, which may include nine behaviors including eight directions of dragging off or up, down, left, right, top left, bottom left, top right, and bottom right. After or after the start of the last operation, including after the end of the last operation,
By a multi-touch post operation including a final manipulation of at least one of the final manipulations which may include nine behaviors including off or eight dragging,
In the specific character group of the at least one character group, belonging to a specific character group of at least one character associated with the button recognized as the target button is input,
According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character associated with the target button is input without belonging to the character group while belonging to the matched character group. Characterized in that the method. The system of claim 104, wherein
The "specific character group" is any one of the following character groups.
1) Any character group from two or more different character groups classified under different spelling rules.
2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button (If the first specific order and the second specific order are the same, it means one order.)
5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button. 107. The method of claim 105,
"Specific character group" means that a character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode in the spelling rule corresponding to the currently set character mode. 107. The method of claim 106,
"Specific character groups" means that any one of two or more different character groups classified under different spellings.
In English,
If the current text mode is set to uppercase mode, the group of characters that can be entered in lowercase mode or
If the currently set text mode is a lowercase mode, the group of characters that can be entered in uppercase mode, or
In Japanese
If the currently set text mode is Hiragana text mode, the text group that can be input in Katakana text mode,
If the currently set character mode is Katakana character mode, characterized in that it comprises a character group that can be input in the hiragana character mode. 107. The method of claim 104 to 107,
In the way the target button is recognized,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. The system of claim 108, wherein
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) 109. The method of claim 109,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. 109. The method of claim 109,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. 109. The method of claim 109,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. 109. The method of claim 109,
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. The system of claim 108, wherein
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) The method of claim 104, further comprising
The multi-touch,
And two fingers used to recognize the two touches recognized by the two touch points. 116. The method of claim 115,
The two fingers,
Index finger and middle finger. The method of any one of claims 104 to 116, wherein
The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) 117. The method of any of claims 104-117,
The method after the multi-touch is at least one of the following operations
1.5.2..2. Multi On & Off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle up drag
1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)
1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)
1.5.2..12. Multi power strip
1.5.2..13.1. Operation after multi-touch with open fingers (operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger
1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)
1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)
1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)
1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)
1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)
1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point) 118. The method of any of claims 104-118,
Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters. The method of any one of claims 104 to 119,
The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method. In a device having a touch screen, a method of inputting characters,
After the keyboard displays (delete ??) on the touchscreen,
In the case where the specific button is operated after multi-touch so that it is recognized as the target button,
At least one of the final operations that may include 5 (9?) Behaviors, including dragging in the 4 (8?) Direction: off or up, down, left, right (upper left, lower left, upper right, lower right) After the start of the last operation, including after the start of the last operation of a behavior or after the end of the last operation,
By a post-multitouch operation comprising a final operation of at least one of the final operations that may include 5 (9?) Behaviors including off or multi-drag in the 4 (8?) Direction,
A first character belonging to a specific character group among the at least one character group (delete?), The first character being a specific character among at least one character associated with the target button (or assigned to the target button);
Regardless of the target button, a second character, which is at least one specific character promised for each final operation, is additionally input. The method of claim 121, wherein
In the way the target button is recognized,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. 131. The method of claim 122,
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) 123. The system of claim 123,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. 123. The system of claim 123,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. 123. The system of claim 123,
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. 123. The system of claim 123,
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. 131. The method of claim 122,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) 128. The method of any of claims 121-128,
Character input method characterized in that the character assigned to the target button is displayed to the left of the additionally input character. The method of any one of claims 121-129,
And the second character is any one of a vowel, a consonant, a half vowel, a half consonant, or a special character. According to claim 130,
The second character is a character input method comprising at least one of the letters corresponding to the pronunciation of the pronunciation symbols [a], [e], [i], [o], [u] in English . 133. The method of claim 130,
And the second character comprises at least one of A, E, I, O or U. 133. The method of claim 130,
And the second character comprises at least one of T, S, N, R, H, D, L or C. 133. The method of claim 130,
The second character is at least one of ㅏ, ㅓ, ㅗ,, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ,, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅟ, ㅝ or ㅞ. Character input method comprising a. The method of any one of claims 121-129,
When the drag is long, the second character is two or more characters. The method of any one of claims 121-129,
If the drag is held in the same direction again or the drag direction is changed and dragged while the touch is maintained, the additionally input characters are continuously added and input; Character input method further comprising. 128. The method of any of claims 121-128,
According to the situation before the last operation, a specific character group is matched among at least one character group, and at least one character among at least one character belonging to the matched character group is compared with the character assigned to the target button without changing the character mode. And further input together. 138. The method of claim 137
When any one of multi-all on & on or 4-direction multi-all drag is performed, the second character is any one of A, E, I, O, and U,
When an operation of either the multi-not all reference finger on & off or the multi-notch reference finger drag in 4 directions is performed, the second letter is either W or Y,
When any one of four directions of single drag is performed, the second letter is any one of T, S, N, and R,
And the second character is any one of H, D, L, and C when an operation of one of the multi-all drags is performed after a single touch in four directions. The method of any one of claims 121-138, wherein
If there are two or more letters assigned to the target button,
The first character is selected and input according to the situation before the final operation. The method of any one of claims 121-139, wherein
If there are two or more letters assigned to the target button,
The first character is selected and input according to the situation before the final operation. 140. The method of claims 121 to 140 wherein
The multi-touch,
And two fingers used to recognize the two touches recognized by the two touch points. The method of claim 141, wherein
The two fingers,
Index finger and middle finger. The method of any one of claims 121-142, wherein
The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) The method of any one of claims 121-143, wherein
The post-multi-touch operation is at least one of the following operations.
1.5.2..2. Multi On & Off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle up drag
1.5.2..10. Finger dragging based on multi-nots all (= Drag point touching on multi-not all)
1.5.2..11. Drag finger by multi-notle sickle (= drag point by multi-notle sickle)
1.5.2..12. Multi power strip
1.5.2..13.1. Operation after multi-touch with open fingers (operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger
1.5.2..13.7. Multi drag with open fingers (= multi drag with open touch points)
1.5.2..13.8. Multi-all drag with open fingers (multi-all drag with open touch points)
1.5.2..13.9. Multi-notle dragging with open fingers (= Multi-notle dragging with open touch points)
1.5.2..13.10. Multi-notch reference finger drag with open fingers (= Multi-notch reference touch point with open touch points)
1.5.2..13.11. Multi-notle sickle reference finger drag by open fingers (= Multi-notle sickle reference touch point by open touch points)
1.5.2..13.12. Multi-tap with open fingers (multi-tap with = open touch point) 141. The method of any of claims 121-144,
Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters. The method of claim 121, wherein
The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method. In a device having a touch screen, a method of inputting characters,
Displaying a keyboard on which a button in which a plurality of characters are assigned is displayed on a touch screen;
In the process of multi on and off so that a specific button is recognized as a target button,
After the point of multi-touch or after the point of multi-touch, including after the point at which the multi-touched finger is off (= multi-touch is released),
According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character associated with the target button is input without belonging to the character mode while belonging to the matched character group. Character input method comprising the step of. 149. The method of claim 147,
The "specific character group" is any one of the following character groups.
1) Any character group from two or more different character groups classified under different spelling rules.
2) A character group corresponding to any one of various character modes in a conventional general mobile phone including a character group of a special character mode.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) A group of characters assigned to the second specific order more than the first specific order from the first specific order among the letters assigned to the same button (If the first specific order and the second specific order are the same, it means one order.)
5) A group of characters composed of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method of claim 148, wherein
"Specific character group" means that a character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode in the spelling rule corresponding to the currently set character mode. The system of claim 149, wherein
"Specific character groups" means that any one of two or more different character groups classified under different spellings.
In English,
If the current text mode is set to uppercase mode, the group of characters that can be entered in lowercase mode or
If the currently set text mode is a lowercase mode, the group of characters that can be entered in uppercase mode, or
In Japanese
If the currently set text mode is Hiragana text mode, the text group that can be input in Katakana text mode,
If the currently set character mode is Katakana character mode, characterized in that it comprises a character group that can be input in the hiragana character mode. The method of claim 147 to 150, wherein
In the way the target button is recognized,
A target button recognition method using a reference finger (= target button recognition method using a reference touch point) or a target button recognition method using an open touch point (= target button recognition method using an open finger) or two or more touch points The method characterized in that the target button is recognized by the target button recognition method by the range. 151. The method of claim 151,
A method for recognizing a target button by a reference finger (= target button recognizing method by a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order by multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order by multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touch number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touch number) 153. The apparatus of claim 152
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order),
And a touch button including the leftmost point of the multi-touch points, that is, the point having the first X coordinate value among the smallest values of the X coordinate values, as the target button. 153. The apparatus of claim 152
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (the target button recognition method by the reference touch point according to the Y coordinate value order),
And a touch button including a lowermost point among the multi-touch points, that is, a point having a first Y coordinate value among the smallest values of the Y coordinate values, is recognized as a target button. 153. The apparatus of claim 152
The target button recognition method is a target button recognition method by a reference finger according to the X coordinate value order according to the multi-touched number (= target button recognition method by a reference touch point according to the X coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the leftmost point of the multi-touch points, that is, the point having the first X-coordinate value among the small orders of the X-coordinate value is recognized as the target button.
3. In the case of 3 multi-touch, the touch button including a point having a second X coordinate value among the small order of X coordinate values among the multi-touch points is a method of recognizing the target button. 153. The apparatus of claim 152
The target button recognition method is a target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touched number). In the case,
In the case of 2 multi-touch, the touch button including the lowest point among the multi-touch points, that is, the point having the first Y coordinate value among the small sequences of the Y coordinate values is recognized as the target button.
3. In the case of 3 multi-touch, the touch button comprising a point having the second Y coordinate value among the small order of the Y coordinate value among the multi-touch points is a method of recognizing the target button. How to. 151. The method of claim 151,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method by second open finger (= Target button recognition method by second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= Target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by fifth open finger (= Target button recognition method by fifth open touch point) The method of claim 147 to 157, wherein
The two multi-touch is a multi-touch recognized by the touch points of the detection and middle finger,
The three multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger,
And the four multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger and ring finger. The method of any one of claims 147-158, wherein
The multi-touch method, which is a method for the multi-touch process, is characterized in that any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-not all-based finger touch (= multi-not all touch point touch)
1.4.2..6. Multi Sickles All Sickles Based Finger Touch (= Multi Sickles All Sickles Based Touch Point Touch)
1.4.2..7. Multi-null-based finger shift touch (= Multi-not-all touch point shift touch)
1.4.2..8. Definition of terms for multi-touch by open fingers
1.4.2..8.1. Multi-touch with open fingers (multi-touch with = open touch points)
1.4.2..8.2. N multi-touch with open fingers (n multi-touch with = open touch point)
1.4.2..8.3. Multi-all touch by open finger (multi-all touch by = open touch point)
1.4.2..8.4. Multi-not all-touch by open fingers (multi-not all-touch by = open touch point)
1.4.2..8.5. Multi-null all reference finger touch by open finger (= Multi-not all reference touch point by open touch point)
1.4.2..8.6. Multi-notle sickle reference finger touch by open finger (= Multi-notle sickle reference touch point by open touch point) The method of any one of claims 147-159, wherein
The post-multi-touch operation is at least one of the following operations.
1.5.2..2. Multi On & Off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi Sickle All On & Off
1.5.2..5. Multi-not-all reference finger on & off (= multi-not-all touch point on & off)
1.5.2..6. Multi sickle up sickle reference finger on & off (= multi sickle up sickle reference touch point on & off)
1.5.2..12. Multi power strip
1.5.2..13.1. Operation after multi-touch with open fingers (operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open finger (multi on & off by = open touch point)
1.5.2..13.3. Multi-all on & off with open finger (multi-all on & off by = open touch point)
1.5.2..13.4. Multi sickle all on & off by open finger (multiple sick all on & off by = open touch point)
1.5.2..13.5. Multi sickle reference finger on & off by open finger (multiple sickle reference touch point on & off by = open touch point)
1.5.2..13.6. Multi- sickle all-scythe reference finger on & off by spreading finger The method of any one of claims 147-160,
Applicable character is a general character representing the language is a water, characterized in that it also includes numbers or special characters. The method of any one of claims 147-161,
The letter may include at least one of Greek and Roman letters, Japanese letters, Cyrillic letters, Indian letters, Arabic letters, Thai modes, Vietnamese letters, Korean letters, English letters, and other global languages including Japanese letters. Character input method.

Images