KR20210039342A - Recognition method of multi-touch of touch button on touch screen, text input method on touch screen and modifying method of object - Google Patents

Abstract

The present invention relates to a method for generating a work signal for any task including character input or object transformation through manipulation after multi-touch in a device having a touch screen. When characters are input by a multi-multitap method, characters belonging to a target character group related to a target button are displayed while circulating according to the number of times that multi-on & off is continuously performed at least once or more.

Description

Multi-touch recognition method of touch button on touch screen, text input method, and object transformation method {RECOGNITION METHOD OF TOUCH BUTTON ON TOUCH SCREEN, TEXT INPUT METHOD ON TOUCH SCREEN AND MODIFYING METHOD OF OBJECT}

The present invention relates to an input method, and more particularly, to a method for inputting a user command in a manner in which touch buttons displayed on a touch screen are operated after being touched.

When entering a character with the QWERTY keyboard on the touch screen of a conventional smartphone, there is a problem that a lot of typos occur due to the small size of the button assigned to the character, or it is necessary to input with great care to prevent typos.

When entering characters with a 12-key pad on the touch screen of a conventional smartphone, multiple characters are assigned to the same button as when entering characters on the physical 12-key pad of a conventional feature phone. There is a problem that you need a lot of at-bats. However, to solve the above problems through the present application.

When entering characters with the QWERTY keyboard of a conventional tablet PC, the size assigned to the characters is quite large, so there is no problem as described above such as typos, but through the present application, we want to improve the character input speed by entering 2 characters at a time with a single touch. do.

Since small touch buttons in devices having small touch screens including conventional mobile phones have a small size, it is very difficult or impossible to accurately and quickly multi-touch with two or more fingers within one small button area. Therefore, it is necessary to develop a multi-touch method that is more convenient for users.

Meanwhile, representative methods of expanding or reducing an object on a touch screen include a "one finger zoom" and a method in which the object is reduced or enlarged by pinching or opening the thumb and forefinger.

According to "One Finger Zoom", if you double-click or long-press an object (eg, a photo), an upward arrow and a downward arrow are displayed on the object. At this time, if you drag upward, the object is enlarged, and if you drag downward, the object is reduced. The downside of this method is that you need to double-click or long press before dragging to enlarge or reduce the object.

On the other hand, the method of reducing or expanding the object by pinching or stretching the thumb and index finger is excellent in intuitiveness, and the operation speed is fast, but the operation speed still needs to be improved, and only enlarged or expanded while maintaining the ratio of the width and height of the object Because of the reduction, there is a problem in that it is impossible to implement the effect of deforming or rotating the object, including 17 types of object change aspects, which have been implemented through a mouse from the prior art, and will be described later. In addition, there is a problem that it is difficult to enlarge or reduce a very small object. This is because it is very difficult or virtually impossible to multi-touch very small objects with the thumb and index finger.

And, among the conventional methods for expanding or reducing an object, it is a method that is most commonly used, and in general, a method using a mouse. The following can be referred to as an object shape transformation method requiring an activation step of the object. There is a method by the same steps.

Step 1: The object is activated by placing the mouse pointer at any point on the object and activating the object by clicking the left mouse button. The boundary line of the active area of the object in the form of a rectangle (see Fig. 39) appears around the object. step

(At the boundary line of the active area of the object, when the mouse pointer is placed on it, the shape of the mouse pointer is changed to a double-headed arrow indicating the direction in which the object can be enlarged/reduced, as shown in Nos. 1 to 8 of FIG. 39 A rotation control point as shown in No. 9 of Fig. 39, in which the shape of the mouse pointer is changed by the control point and the rotation arrow, is displayed. The eight enlargement/reduction control points are the midpoint of the four sides of the boundary line of the active area of the rectangular object and the four Appears at the vertex, and the rotation control point appears above the boundary of the object's active area.)

Step 2: Hovering the mouse pointer at each zoom control point changes the shape of the mouse pointer to a double-headed arrow indicating the direction that can be zoomed in or out, or if you place the mouse pointer on the rotation control point, the mouse turns into a rotation arrow. Step of changing the shape of the pointer (see Figs. 40, 41, 42, and 43)

(Depending on the position of each zoom control point, left and right double arrows, up and down double arrows, left up and down diagonal arrows, or right up and down diagonal arrows appear.)

Step 3: Click the left mouse button

This is the step of generating a signal that the object is about to start zooming or rotating.

Step 4: The step in which the object is enlarged/reduced or rotated by dragging it in the desired direction.

In this step 4, the adjustment points selected from among the 1 to 8 expansion/reduction adjustment points in FIG. 39, the 16 types of object expansion/reduction by linear drag in 2 directions for each adjustment point, and the rotation adjustment point of FIG. 39 An example of 17 different object change modalities, including one rotational modality, is included.

The expansion/reduction of 16 aspects of the object selected from among the 1 to 8 expansion/reduction adjustment points of FIG. 39 to be described later and the linear drag in 2 directions is proportional to the rate of change in the horizontal/vertical length of the boundary line of the active area of the object. The rate of change in the horizontal/vertical length of the object is changed, and the center point of the object is also changed.

According to the method of the present application, the object is multi-touched to be recognized as a target button (= target object), which is the same as steps 1 to 3 in the object shape transformation method requiring the activation step of the conventional object. While producing an effect, it may be possible to perform 4 steps in the object shape transformation method, which requires a conventional object activation step in which 17 different object change aspects are implemented, through manipulation after multi-touch.

For better understanding, the 17 types of object change mentioned above will be described as an example.

Hereinafter, the upper horizontal side refers to the side connecting the 1st and 2nd control points among the control points on the boundary of the active area of the object shown in FIG. 39, and the lower horizontal side is among the control points on the boundary of the active area of the object. The left vertical side refers to the side connecting the 3rd and 4th control points, the left vertical side refers to the side connecting the 1st and 3rd control points among the control points on the boundary of the object's active area, and the right vertical side is the activation of the object. It refers to the side connecting the 2nd and 4th control points among the control points on the boundary of the area.

1) When dragging upward from adjustment point 5 on the upper horizontal side of FIG. 39, the lengths of the upper and lower horizontal sides and the positions of the lower horizontal sides remain unchanged, and only the lengths of the left and right vertical sides are enlarged. For example, it is the degree of change from FIG. 26 to FIG. 27.

2) When dragging downward from adjustment point 5 on the upper side of Fig. 39, the lengths of the upper and lower side and the position of the lower side are not changed, and only the lengths of the left and right sides are reduced. For example, it is the degree of change from FIG. 27 to FIG. 26.

3) When dragging upward from the 7th adjustment point on the lower horizontal side of FIG. 39, the lengths of the upper and lower horizontal sides and the position of the upper horizontal are not changed, and only the lengths of the left and right vertical sides are reduced. For example, it is the degree of change from Fig. 26 to Fig. 28.

4) When dragging downward from adjustment point 7 on the lower horizontal side of FIG. 39, the lengths of the upper and lower horizontal sides and the position of the upper horizontal are not changed, and only the lengths of the left and right vertical sides are enlarged. For example, it is the degree of change from Fig. 28 to Fig. 26.

5) When dragging in the right direction from adjustment point 8 on the left vertical side in FIG. 39, the lengths of the left and right vertical sides and the positions of the right vertical sides do not change, and only the upper and lower horizontal sides are reduced. For example, it is the degree of change from Fig. 26 to Fig. 30.

6) When dragging in the left direction from adjustment point 8 on the left vertical side of FIG. 39, the lengths of the left and right vertical sides and the positions of the right vertical sides are not changed, and only the upper and lower horizontal sides are enlarged. For example, it is the degree of change from Fig. 30 to Fig. 26.

7) When dragging in the right direction from adjustment point 6 on the right vertical side of FIG. 39, the lengths of the left and right vertical sides and the positions of the left vertical sides are not changed, and only the upper and lower horizontal sides are enlarged. For example, it is the degree of change from Fig. 26 to Fig. 29.

8) When dragging in the left direction from the 6th adjustment point on the right vertical side in FIG. 39, the lengths of the left and right vertical sides and the positions of the left vertical sides remain unchanged, and only the lengths of the upper horizontal and lower vertical sides are reduced. For example, it is the degree of change from Fig. 29 to Fig. 26.

9) When dragging from the control point 1, which is the upper left vertex of Fig. 39, to the lower right direction, the position of the vertex 4, which is the lower right vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which direction the drag is dragged in the lower right direction within the range of 90 degrees in the lower right direction. For example, it is the degree of change from Fig. 26 to Fig. 34.

10) When dragging from the first control point, which is the upper left vertex of FIG. 39, to the upper left direction, the position of the fourth vertex, which is the lower right vertex, does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length is different depending on which direction the drag is dragged in the upper left direction within the range of 90 degrees in the upper left direction. For example, it is the degree of change from Fig. 34 to Fig. 26.

11) When dragging from the control point 4, which is the lower right vertex of FIG. 39, to the lower right direction, the position of the vertex 1, which is the upper left vertex, does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length varies depending on which direction the drag is dragged in the lower right direction within the range of 90 degrees in the lower right direction. For example, it is the degree of change from Fig. 26 to Fig. 33.

12) When dragging from the control point 4, which is the lower right vertex of Fig. 39, to the upper left direction, the position of the vertex 1, which is the upper left vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which direction the drag is dragged in the upper left direction within the range of 90 degrees in the upper left direction. For example, it is the degree of change from Fig. 33 to Fig. 26.

13) When dragging from the control point 2, which is the upper right vertex of Fig. 39, to the upper right direction, the position of the vertex 3, which is the lower left vertex, does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length is different depending on which direction the drag is dragged in the upper right direction within the range of 90 degrees in the upper right direction. For example, it is the degree of change from Fig. 26 to Fig. 31.

14) When dragging from the control point 2, which is the upper right vertex of Fig. 39, to the lower left direction, the position of the vertex 3, which is the lower left vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length varies depending on which direction the drag is dragged in the lower left direction within the range of 90 degrees in the lower left direction. For example, it is the degree of change from Fig. 31 to Fig. 26.

15) When dragging from the lower left vertex of Fig. 3 to the upper right direction from the lower left vertex of FIG. 39, the position of the second vertex, which is the upper right vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which direction the drag is dragged in the upper right direction within the range of 90 degrees in the upper right direction. For example, it is the degree of change from FIG. 26 to FIG. 32.

16) When dragging from the lower left vertex of FIG. 3 to the lower left direction from the lower left vertex of FIG. 39, the position of the second vertex, which is the upper right vertex, does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length is different depending on which direction the drag is dragged in the lower left direction within the range of 90 degrees in the lower left direction. For example, it is the degree of change from Fig. 32 to Fig. 26.

17) If you drag in any direction from the rotation control point 9, which is the rotation control point of FIG. 39, in any of the 360-degree directions, the object rotates in the dragging direction.

In fact, although it is possible to drag the drag direction at control points 1 to 8 in FIG. 39 in any of the 360-degree directions (especially, there is a substantial effect at control points 1 to 4), the most common at each control point The dragging direction is just exemplified in the above example. And, the drag length is also an example by assuming only the length of the dragging in general.

The present invention has been conceived to solve the above problems, and an object of the present invention is to provide speed, accuracy, and speed of various operations including text input operations or object shape modification operations by touching buttons or objects appearing on a touch screen. It is to provide a way to improve convenience.

In the following, the word “finger” from the user's point of view can be replaced with the word “touch point” from the viewpoint of most devices.

[Claim 1]

In a device having a touch screen, in the method of recognizing a target button when the touch screen is multi-touched,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method, characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 2]

The method according to claim 1,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 3]

The method according to claim 2,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 4]

The method according to claim 2,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 5]

The method according to claim 2,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 6]

The method according to claim 2,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 7]

The method according to claim 1,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 8]

The method according to any one of claims 1 to 7,

In a device equipped with a touch screen, in a method for generating a work signal for a certain task including character input or object transformation by being manipulated after multi-touch,

A method characterized in that the method of operation after the multi-touch is multi-on & off, multi-drag, and post-multi-touch operation with an open finger.

[Claim 9]

The method of claim 8,

The multi on & off method is a method, characterized in that any one or more of the following methods.

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

[Claim 10]

The method of claim 9,

The multi multi-not all on & off method is a method characterized in that any one or more of the following methods.

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

[Claim 11]

The method of claim 8,

A method, characterized in that the multi-drag method is any one or more of the following methods.

1.5.2..8. Multi All Drag

1.5.2..9. Multi Not All Drag

[Claim 12]

The method of claim 11,

The multi-not all-drag method is a method, characterized in that any one or more of the following methods.

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

[Claim 13]

The method of claim 8,

A method characterized in that the method of multi-touch post-multi-touch operation by an open finger (= post multi-touch operation by open touch point) is any one or more of the following methods.

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

[Claim 14]

In a device equipped with a touch screen, when the touch screen is multi-touched, a multi-touch method, which is a method for a multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 15]

In a device equipped with a touch screen, in a method for generating a work signal for a certain task including character input or object transformation by being manipulated after multi-touch,

A method characterized in that the method of operation after the multi-touch is multi-on & off, multi-drag, and post-multi-touch operation with an open finger.

[Claim 16]

The method of claim 15,

The multi on & off method is a method, characterized in that any one or more of the following methods.

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

[Claim 17]

The method of claim 16,

The multi multi-not all on & off method is a method characterized in that any one or more of the following methods.

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

[Claim 18]

The method of claim 15,

A method, characterized in that the multi-drag method is any one or more of the following methods.

1.5.2..8. Multi All Drag

1.5.2..9. Multi Not All Drag

[Claim 19]

The method of claim 18,

The multi-not all-drag method is a method, characterized in that any one or more of the following methods.

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

[Claim 20]

The method of claim 15,

A method characterized in that the method of multi-touch post-multi-touch operation by an open finger (= post multi-touch operation by open touch point) is any one or more of the following methods.

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

[Claim 21]

In a device equipped with a touch screen, in a method for generating a work signal for a certain task including character input or object transformation by being manipulated after multi-touch,

The operation method after the multi-touch is:

A method characterized in that it is a method in which different operations are performed according to the number of times that multi-on and off is performed continuously at least one or more times, that is, a multi-tap method.

[Claim 22]

The method according to claim 21, in the case of inputting a character by a multi-tap method,

A method, characterized in that, according to the number of times the multi-on and off is performed at least one time in succession, the characters belonging to the target character group related to the target button are circulated and displayed.

[Claim 23]

The method of claim 22,

After the characters are displayed in circulation, the displayed character is inputted definitively after a single touch or multi-touch so that another button is recognized as a target button, the cursor is moved, or a certain period of time (e.g., 2 seconds) elapses.

[Claim 24]

The method of claim 22,

When multi-touch when multi-tap is expressed in more detail with n multi-touch,

According to at least one n value, that is, according to the situation before the final operation, a specific character group is matched from among at least one character group, belongs to the matched character group, and at least one of at least one character related to the target button is matched. A method, characterized in that the text is input without changing the text mode.

[Claim 25]

The method of claim 24,

The "specific character group" is any one of the following character groups.

1) Any one character group among two or more different character groups classified into different groups according to the spelling rules.

2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 26]

The method of claim 25,

The "specific character group" is a character group to which other characters belong according to the spelling rule, which is a character group of characters input in another character mode under the spelling rule corresponding to the currently set character mode.

[Claim 27]

The method of claim 24,

"A specific character group" means any one character group among two or more different character groups classified into different groups according to the spelling rules.

In English,

If the currently set text mode is upper case mode, it is a character group that can be input in lower case mode, or

If the currently set text mode is a lowercase mode, it is a character group that can be input in uppercase mode, or

In Japanese

If the currently set text mode is hiragana text mode, it is a character group that can be input in katakana text mode,

And if the currently set character mode is a katakana character mode, a character group that can be input in the hiragana character mode.

[Claim 28]

The method according to any one of claims 21 to 27,

In the way the target button is recognized,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method, characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 29]

The method of claim 28,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 30]

The method of claim 29,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 31]

The method of claim 29,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 32]

The method of claim 29,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 33]

The method of claim 29,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 34]

The method of claim 28,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 35]

The method according to any one of claims 21 to 34,

The multi-touch,

A method, characterized in that two multi-touch is recognized by two touch points by using two fingers.

[Claim 36]

The method of claim 35,

The two fingers,

The method characterized in that the index finger and middle finger.

[Claim 37]

The method according to any one of claims 21 to 36,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 38]

The method according to any one of claims 21 to 37,

The operation after the multi-touch is at least one of the following operations.

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

[Claim 39]

The method according to any one of claims 21 to 38,

A method, characterized in that the applicable character is water, and a number or special character is also included.

[Claim 40]

The method according to any one of claims 21 to 39,

The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method.

[Claim 41]

Step of multi-touching the object (or the active area of the object) to be recognized as a target button

The input method comprising: transforming the object (or the active area of the object) according to the manipulation after the multi-touch.

[Claim 42]

The method of claim 41,

In the way the target button is recognized,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method, characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 43]

The method of claim 42,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 44]

The method of claim 43,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 45]

The method of claim 43,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 46]

The method of claim 43,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 47]

The method of claim 43,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 48]

The method of claim 42,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 49]

The method of any one of claims 41 to 48,

The object transformation method, characterized in that the manipulation is drag.

[Claim 50]

The method of claim 49

A method in which an object (or an active area of an object) is enlarged when dragged in at least one first specific direction, and an object (or an active area of an object) is reduced when dragged in at least one second specific direction.

[Claim 51]

The method of claim 50,

If you drag in the upward direction, it will be enlarged,

A method, characterized in that it is reduced when dragged in the downward direction.

[Claim 52]

The method of claim 50,

In the expansion or reduction, the method characterized in that the ratio of the horizontal length and the vertical length of the object is maintained.

[Claim 53]

The method of claim 50,

The method according to claim 1, wherein the center point of the object is not moved during enlargement or reduction.

[Claim 54]

The method of claim 49,

This is a method in which only the horizontal length or the vertical length of the object (or the active area of the object) or the horizontal length and the vertical length are both enlarged or reduced according to the drag direction determined by the device.

[Claim 55]

The method of claim 54,

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, the horizontal length is enlarged,

When dragging in the second specific direction in the horizontal direction, the vertical length does not change, the horizontal length is reduced,

When dragging in the first specific direction in the vertical direction, the horizontal length does not change, the vertical length is enlarged,

When dragging in the second specific direction in the vertical direction, the horizontal length does not change, the vertical length is reduced,

When dragged in at least one of the diagonal directions in the first specific direction, the horizontal length and the vertical length are enlarged at the same ratio,

When dragging in at least one second specific direction among diagonal directions, the horizontal length and the vertical length are reduced by the same ratio.

[Claim 56]

The method of claim 55,

When dragged to the right, the horizontal length is enlarged,

When dragging to the left, the horizontal length is reduced,

When dragging in the upward direction, the vertical length is enlarged,

When dragging in the downward direction, the vertical length is reduced,

When dragged in the upper left or upper right direction, the horizontal and vertical lengths are enlarged at the same ratio,

When dragging in the lower left or lower right direction, the method characterized in that the reduction in a ratio equal to the horizontal length and the vertical length.

[Claim 57]

The method of claim 54,

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, the horizontal length is enlarged,

When dragging in the second specific direction in the horizontal direction, the vertical length does not change, the horizontal length is reduced,

When dragging in the first specific direction in the vertical direction, the horizontal length does not change, the vertical length is enlarged,

When dragging in the second specific direction in the vertical direction, the horizontal length does not change, the vertical length is reduced,

When dragging in at least one of the diagonal directions in the range of the first specific direction, the horizontal length and the vertical variation ratio are expanded differently according to each direction within the range,

When dragging in at least one second specific direction range among diagonal directions, the horizontal length and the vertical variation ratio are reduced differently according to each direction within the range.

[Claim 58]

The method of claim 57,

When dragged to the right, the horizontal length is enlarged,

When dragging to the left, the horizontal length is reduced,

When dragged upward, the vertical length is enlarged,

When dragging in the downward direction, the vertical length is reduced,

When dragged in the upper left or upper right direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently depending on which direction of the upper left or upper right range,

A method, characterized in that when dragging in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently depending on which direction of the lower left range or the lower right range.

[Claim 59]

The method of claim 54,

In the enlargement or reduction, the method characterized in that the center point of the object is moved or not moved.

[Claim 60]

The method of claim 49,

Step 1: The object (or the active area of the object) is multi-touched and dragged to be recognized as the target button, and a specific range inside the object (or the active area of the object) is the target range by the hitting point and the dragging direction. To be recognized as.

Step 2: As the horizontal or vertical length of the object (or the active area of the object) is changed according to the recognized hit point and the determined drag direction, the direction in which the drag is started becomes closer to the center of the object (or the active area of the object). The method comprising the step of reducing if the direction is, and expanding if the direction is farther away.

[Claim 61]

The method of claim 60,

If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper, lower, right, or left directions,

If the determined drag start direction is the direction that approaches the center of the object (or the active area of the object),

Of the two horizontal sides or two vertical sides of the object (or the active area of the object), the lengths of the two sides parallel to the determined drag direction are reduced, and the lengths of the two sides perpendicular to the determined drag direction do not change,

If the determined drag start direction is the direction away from the center of the object (or the active area of the object),

Of the two horizontal sides or two vertical sides of the object (or the active area of the object), the lengths of the two sides parallel to the determined drag direction are enlarged, and the lengths of the two sides perpendicular to the determined drag direction are unchanged,

If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper right, lower right, upper left, or lower left directions,

If the determined drag start direction is a direction that approaches the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced. In this case, if the horizontal side is reduced, both sides are reduced to the same length, and If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of change of the horizontal length and vertical length can be set to be different depending on which direction within a specific drag direction range determined by the device, or a specific drag direction range. You can set the length of the width and height to be different in the same ratio regardless of the direction in which it is draped,

If the determined drag start direction is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. In this case, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length. A method characterized in that it is possible to set the change ratio of the length and the vertical length to be different, or to set the length of the width and the vertical to be different at the same ratio regardless of which direction is dragged within a specific drag direction range.

[Claim 62]

The method of claim 61,

When it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is upper right, lower right, upper left, lower left,

-If the determined drag start direction is the direction that approaches the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the determined drag among the three sides surrounding the recognized target range The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side does not change,

-If the determined drag start direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the determined drag direction among the three sides surrounding the recognized target range The position of the side perpendicular to and is moved for enlargement, and the position of the opposite side of the side does not change,

If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper right, lower right, upper left, or lower left directions,

-If the determined drag start direction is a direction that approaches the center of the object (or the active area of the object), the center of the object moves in the determined drag direction and is parallel to the drag direction among vertices in the recognized target range. The vertex closest to the straight line is moved to shrink, and the position of the opposite vertex of the vertex can be kept unchanged,

-If the determined drag start direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and a straight line parallel to the drag direction among vertices in the recognized target range The method of claim 1, wherein the vertex nearest to is moved to enlarge, and the position of the opposite vertex of the vertex may not be changed.

[Claim 63]

The method of claim 62,

① (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the active area of the object (object area or) before the shape of the object are transformed are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). time,

The index finger to be recognized as the reference finger is at a point in the (object area or) object activation area (e.g., area 5 in Fig. 45) with a Y value equal to or greater than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2). When the middle finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' upwards, the horizontal length of the object is not changed, and only the vertical length can be enlarged. Even when only the vertical length is enlarged, the coordinate(s) with the smallest Y value of the (object area or) object active area (e.g., lower horizontal side) remain unchanged, and the coordinate(s) with the largest Y value of the (object or) object active area ( (E.g., the upper horizontal side) can be moved to the upper side so that only the vertical length of the object is enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 27 can be exemplified.

If, at a point in the (object area or) object active area (eg, area 7 in Fig. 45) with a Y value less than the middle value of Y1 and Y2 (=(Y1+Y2)/2), it will be recognized as the reference finger. If the intended index finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' upwards, the horizontal length of the object can be reduced without changing the horizontal length. In order to reduce only the vertical length, the coordinate(s) with the largest Y value of the (object area or) object active area will remain unchanged, and the coordinate(s) with the smallest Y value of the (object area or) object active area will be more By moving upward, only the length of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 28 can be exemplified.

② (object or) The object activation area is multi-touched with the index finger and the middle finger so that it becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest Y value in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). time,

Make the index finger to be recognized as the reference finger touch the point in the object area or the object activation area that has a Y value of Y1, Y2 or more (=(Y1+Y2)/2), and the middle finger is the right side of the index finger. After touching any part of the part, when'multi-all dragging' downwards, it is possible to reduce the vertical length without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the smallest Y value of the (object area or) object active area are moved to the lower side without any change, and the coordinate(s) with the largest Y value of the (object or) object active area are moved further down. Only the vertical length of the object can be reduced in the form of paper. To briefly describe the above description in the drawings, a change from Fig. 27 to Fig. 26 may be exemplified.

If the index finger to be recognized as the reference finger is touched at a point in the object area or the active area of the object that has a Y value less than the middle value of Y1 and Y2 (=(Y1+Y2)/2), the middle finger is the index finger. If you touch any point on the right side of and then drag it to the lower side, you can enlarge the vertical length without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the largest Y value of the (object area or) object active area remain unchanged, and the coordinate(s) with the smallest Y value of the (object area or) object active area are more In the form of moving downward, only the vertical length of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 28 to Fig. 26 can be exemplified.

③ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest X value (X1, Y1) in the active area of the object (object area or) before shape transformation of the object are (X1, Y1) and the coordinates with the smallest X value are (X2, Y2). time,

The index finger, which is scheduled to be recognized as the reference finger, is at a point within the (object area or) object activation area (eg, area 6 in Fig. 45) with an X value equal to or greater than the intermediate value of X1 and X2 (=(X1+X2)/2). When the object is touched and the middle finger is touched to any point on the right side of the index finger and then'multi-all drag' to the right, the vertical length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate(s) with the smallest X value of the (object area or) object active area (e.g., the left vertical side) are unchanged, and the coordinate with the largest X value of the (object or) object active area (S) (e.g., right vertical side) can be moved to the right, so that only the horizontal length of the object is enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 29 can be exemplified.

If, at a point in the (object area or) object activation area (eg, area 8 in Fig. 45) with an X value less than the middle value of X1 and X2 (=(X1+X2)/2), it will be recognized as a reference finger. If the intended index finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' to the right, the vertical length of the object can be reduced without changing the vertical length. Even when only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object active area remain unchanged, and the coordinate(s) with the smallest X value of the (object area or) object active areas are more In the form of moving to the right, only the horizontal length of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 30 can be exemplified.

④ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest X value (X1, Y1) in the active area of the object (object area or) before shape transformation of the object are (X1, Y1) and the coordinates with the smallest X value are (X2, Y2). time,

Make the index finger to be recognized as the reference finger touch the point in the object area or the object activation area that has an X value equal to or greater than the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is the right side of the index finger. After touching any part of the part, when'multi-all dragging' to the left, the vertical length of the object is not changed, and only the horizontal length can be reduced. Even when only the horizontal length is reduced, the coordinates with the smallest X value of the (object area or) object active area are unchanged, and the coordinates with the largest X value of the (object or) object active area are moved further to the left. Only the horizontal length of can be reduced. To briefly describe the above description in the drawings, a change from Fig. 29 to Fig. 26 may be exemplified.

If the index finger to be recognized as the reference finger is touched at a point in the object area or the object activation area with an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2), the middle finger is the index finger. If you touch any point on the right side of and then drag it to the left, you can enlarge the horizontal length without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinates with the largest X value of the (object area or) object active area are moved to the left, while the coordinates with the smallest X value of the (object area or) object active area are moved to the left. Only the width of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 30 to Fig. 26 may be exemplified.

⑤ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

An object area (or an object area) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value equal to or greater than the median value of Y1 and Y2 (=(Y1+Y2)/2) ( Example: The index finger to be recognized as the reference finger is touched at a point within (area that can be included in area 2 in Fig. 45), and the middle finger touches any point on the right side of the index finger, and then'multi-all dragging' toward the upper right. ', it is possible to make the object's width and height enlarged at the same ratio. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates with the smallest X and Y values of the (object area or) object active area (eg, vertex 3 in Fig. 39) remain unchanged, (object or) In a form in which the coordinates (eg, vertex 2 in FIG. 39) having the largest X and Y values of the object activation area are moved to the upper right, the length of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 31 may be exemplified.

If the X value is less than the median value of X1 and X2 (=(X1+X2)/2) and the Y value is less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (object area or) Touch the index finger to be recognized as the reference finger at a point within the object activation area (e.g., an area that can be included in area 3 in Fig. 45), and the middle finger touch any point on the right side of the index finger, and then move to the upper right. When'multi-all dragging', the horizontal and vertical length of the object can be reduced in the same ratio. Even when the width and height of the object are reduced at the same ratio, the coordinates with the largest X and Y values of the (object area or) object active area are not changed, and the X and Y values of the (object area or) object active area are not changed. The coordinates with the smallest value are shifted to the upper right, so that the length and width of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 32 is exemplified.

⑥ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

Within the active area (object area or) with an X value of at least the median value of X1 and X2 (=(X1+X2)/2) and a Y value of at least the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as the reference finger is touched at the point, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the lower left, the width and height of the object are reduced in the same ratio. can do. Even when the width and height of the object are reduced by the same ratio, the coordinates with the smallest X and Y values of the (object area or) object active area are unchanged, and the X and Y values of the (object or) object active area are The largest coordinates are moved to the lower left and the horizontal and vertical lengths of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 31 to Fig. 26 may be exemplified.

If the X value is less than the median value of X1 and X2 (=(X1+X2)/2) and the Y value is less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (object area or) When the index finger to be recognized as the reference finger is touched at a point within the object activation area, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the lower left, the object has the same horizontal and vertical length. You can have it enlarged in proportion. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the largest X and Y values of the (object area or) object active area are not changed, and the X and Y values of the (object area or) object active area are not changed. The coordinates with the smallest value are moved to the lower left and the horizontal and vertical lengths of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 32 to Fig. 26 may be exemplified.

⑦ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the (object area or) active area of the object before shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

An object active area (object area or) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (Example: an area that can be included in area 4 in Fig. 45) Touch the index finger to be recognized as the reference finger at a point within the middle finger, touch any point on the right side of the index finger, and then move the'multi-all' to the lower right. When'drag', the horizontal and vertical length of the object can be enlarged at the same ratio. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the smallest X value and the largest Y value of the (object area or) object active area (e.g., vertex 1 in Fig.39) remain unchanged, and Alternatively, a coordinate (eg, vertex 4 in FIG. 39) having the largest X value and the smallest Y value of the object activation area may be moved to the lower right, thereby increasing the length of the object horizontally and vertically. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 33 can be exemplified.

If, the (object area or) object has an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1 and Y2 (=(Y1+Y2)/2) The index finger to be recognized as the reference finger is touched at a point within the active area (e.g., an area that can be included in area 1 in Fig. 45), and the middle finger is touched to any point on the right side of the index finger, and then moves to the lower right. When multi-all dragging, the width and height of the object can be reduced in the same ratio. Even when the width and height of the object are reduced at the same ratio, the coordinates with the largest X value and the smallest Y value of the (object area or) object active area are unchanged, and the X value of the (object area or) object active area The coordinates with the smallest Y value and the largest Y value are moved to the lower right, so that the horizontal and vertical lengths of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 34 can be exemplified.

⑧ (object or) The object activation area is multi-touched by detection and middle finger so that the target button becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

An object active area (object area or) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as the reference finger is touched at the point within, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the upper left, the width and length of the object are reduced to the same ratio. Can be made. Even when the width and height of the object are reduced by the same ratio, the X value of the (object or) object active area is the largest without changing the coordinates where the X value of the (object area or) object active area is the smallest and the largest Y value. It is possible to reduce the horizontal and vertical length of the object in a form in which the large and small coordinates of the Y value are moved to the upper left. To briefly describe the above description in the drawings, a change from Fig. 33 to Fig. 26 can be exemplified.

If, the (object area or) object has an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as a reference finger is touched at a point in the active area, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the upper left, the width and length of the object are the same Can be enlarged to. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the largest X value and the smallest Y value of the (object area or) object active area remain unchanged, and the X value of the (object area or) object active area The coordinates with the smallest Y value and the largest Y value are moved to the upper left, so that the horizontal and vertical lengths of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 34 to Fig. 26 can be exemplified.

[Claim 64]

The method of claim 61,

In the enlargement or reduction, the method characterized in that the center point of the object is moved.

[Claim 65]

The method according to any one of claims 41 to 64,

The multi-touch,

A method, characterized in that two multi-touch is recognized by two touch points by using two fingers.

[Claim 66]

The method of claim 65,

The two fingers,

The method characterized in that the index finger and middle finger.

[Claim 67]

The method of any one of claims 41 to 66,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 68]

The method of any one of claims 41 to 67,

The method characterized in that the operation after multi-touch is at least one of the following operations

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi Not All Drag

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

1.5.2..12. Multi power tap

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

[Claim 69]

In a device having a touch screen, in the method for inputting characters,

Displaying a keyboard on which buttons to which a plurality of characters are assigned are present on the touch screen;

In the process of multi-on & off so that a specific button is recognized as a target button,

After the multi-touch, including after the multi-touch or after the multi-touch finger is turned off (= multi-touch is released),

And a step of inputting a character of a specific sequence among characters assigned to a button recognized as a target button.

[Claim 70]

The method of claim 69,

When multi-touch is expressed in more detail with n multi-touch,

Character input method, characterized in that the specific sequence number is determined according to the value of n.

[Claim 71]

The method of claim 70,

Character input method, characterized in that it is determined such that the value n and a numeric value corresponding to the order of the specific order are the same.

[Claim 72]

The method of claim 70,

When the value of n is 2, that is, 2 multi-touch, a second character assigned to a button recognized as a target button is input and processed.

[Claim 73]

The method of claim 70,

If the value of n is 3, that is, 3 multi-touch, the third character assigned to the button recognized as the target button is input processing, or

When the value of n is 4, that is, 4 multi-touch, a fourth character assigned to a button recognized as a target button is input and processed.

[Claim 74]

The method of claim 69 to 73,

In the way the target button is recognized,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 75]

The method of claim 74,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 76]

The method of claim 75,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 77]

The method of claim 75,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 78]

The method of claim 75,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 79]

The method of claim 75,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 80]

The method of claim 74,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 81]

The method of claim 69 to 80,

The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or

The 3 multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger, and ring finger, or

The method of claim 1, wherein the 4 multi-touch is a multi-touch recognized by the index and middle fingers, the ring finger, and the touch points of the hand.

[Claim 82]

The method of any one of claims 69 to 81,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 83]

The method of any one of claims 69 to 82,

The method characterized in that the operation after multi-touch is at least one of the following operations

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..12. Multi power tap

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

[Claim 84]

The method of any one of claims 69 to 83,

A method, characterized in that the applicable character is water, and a number or special character is also included.

[Claim 85]

The method of any one of claims 69 to 84,

The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method.

[Claim 86]

In a device having a touch screen, in the method for inputting characters,

Displaying a keyboard on which buttons to which a plurality of characters are assigned are present on the touch screen;

When a specific button is operated after multi-touch so that it is recognized as a target button, after the multi-touch and after the operation starts, including after the operation starts or after the operation ends,

And inputting a character of a specific sequence among characters assigned to a button recognized as a target button by a multi-touch operation.

[Claim 87]

The method of claim 86,

According to the operation after the multi-touch,

Character input method, characterized in that the specific sequence number of the input character is determined.

[Claim 88]

The method of claim 87,

When the drag direction is different, it is recognized that the type of manipulation after the multi-touch is different.

[Claim 89]

The method of claim 87,

Depending on the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character related to the target button is inputted without changing the character mode while belonging to the matched character group. The method characterized in that.

[Claim 90]

The method of claim 89,

The "specific character group" is any one of the following character groups.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 91]

The method of claim 86-90,

In the way the target button is recognized,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method, characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 92]

The method of claim 91,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 93]

The method of claim 92,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 94]

The method of claim 92,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 95]

The method of claim 92,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 96]

The method of claim 92,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 97]

The method of claim 91,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 98]

The method according to any one of claims 86 to 97,

The multi-touch,

A method, characterized in that two multi-touch is recognized by two touch points by using two fingers.

[Claim 99]

The method of claim 98,

The two fingers,

The method characterized in that the index finger and middle finger.

[Claim 100]

The method of any one of claims 86 to 99,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 101]

The method according to any one of claims 86 to 100,

The operation after the multi-touch is at least one of the following operations.

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi Not All Drag

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

1.5.2..12. Multi power tap

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

[Claim 102]

The method according to any one of claims 86 to 101,

A method, characterized in that the applicable character is water, and a number or special character is also included.

[Claim 103]

The method of any one of claims 86-102,

The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method.

[Claim 104]

In a device having a touch screen, in the method for inputting characters,

After the keyboard is displayed on the touch screen,

In the case that a specific button is operated after multi-touch so that it is recognized as a target button,

The point at which the final operation of at least one of the final operations that can include nine behaviors including drag in eight directions: off or upper, lower, left, right, upper left, lower left, upper right, and lower right After or after the point at which the last operation begins, including after the point at which the last operation ends,

By multi-touch post-operation including the final operation of at least one of the final operations that may include off or multi-drag in 8 directions,

In the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group,

Depending on the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character related to the target button is inputted without changing the character mode while belonging to the matched character group. The method characterized in that.

[Claim 105]

The method of claim 104,

The "specific character group" is any one of the following character groups.

1) Any one character group among two or more different character groups classified into different groups according to the spelling rules.

2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 106]

The method of claim 105,

The "specific character group" is a character group to which other characters belong according to the spelling rule, which is a character group of characters input in another character mode under the spelling rule corresponding to the currently set character mode.

[Claim 107]

The method of claim 106,

"A specific character group" means any one character group among two or more different character groups classified into different groups according to the spelling rules.

In English,

If the currently set text mode is upper case mode, it is a character group that can be input in lower case mode, or

If the currently set text mode is a lowercase mode, it is a character group that can be input in uppercase mode, or

In Japanese

If the currently set text mode is Hiragana text mode, it is a character group that can be input in katakana text mode,

And if the currently set character mode is a katakana character mode, a character group that can be input in the hiragana character mode.

[Claim 108]

The method of claims 104 to 107,

In the way the target button is recognized,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method, characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 109]

The method of claim 108,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 110]

The method of claim 109,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 111]

The method of claim 109,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 112]

The method of claim 109,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 113]

The method of claim 109,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 114]

The method of claim 108,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 115]

The method of claims 104 to 114,

The multi-touch,

A method, characterized in that two multi-touch is recognized by two touch points by using two fingers.

[Claim 116]

The method of claim 115,

The two fingers,

The method characterized in that the index finger and middle finger.

[Claim 117]

The method of any one of claims 104 to 116,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 118]

The method of any one of claims 104 to 117,

The operation after the multi-touch is at least one of the following operations.

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi Not All Drag

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

1.5.2..12. Multi power tap

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

[Claim 119]

The method of any one of claims 104 to 118,

A method, characterized in that the applicable character is water, and a number or special character is also included.

[Claim 120]

The method according to any one of claims 104 to 119,

The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method.

[Claim 121]

In a device having a touch screen, in the method for inputting characters,

After the keyboard is displayed on the touch screen,

In the case that a specific button is operated after multi-touch so that it is recognized as a target button,

At least one of the final operations that can include 5 (9?) behaviors including drag in the 4 (8?) directions of off or up, down, left, right (upper left, lower left, upper right, lower right). After the start of the final manipulation of a behavior or after the start of the final manipulation, including after the end of the final manipulation,

By multi-touch post-manipulation including the final operation of at least one of the final operations that may include 5 (9?) behaviors including off or multi-drag in 4 (8?) directions,

A first character that belongs to a specific character group among at least one character group (delete?) and which is a specific character among at least one character related to the target button (or assigned to the target button??)

Regardless of the target button, the second character, which is at least one specific character promised for each final operation, is additionally input.

[Claim 122]

The method of claim 121,

In the way the target button is recognized,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method, characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 123]

The method of claim 122,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 124]

The method of claim 123,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 125]

The method of claim 123,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 126]

The method of claim 123,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 127]

The method of claim 123,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 128]

The method of claim 122,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 129]

The method of any one of claims 121 to 128,

Character input method, characterized in that the character assigned to the target button is displayed to the left of the additionally input character.

[Claim 130]

The method of any one of claims 121 to 129,

The second character is a character input method, characterized in that any one of vowels, consonants, half vowels, half consonants, or special characters.

[Claim 131]

Following on from claim 130,

The second character includes at least one of characters corresponding to pronunciations of English pronunciation symbols [a], [e], [i], [o], and [u] .

[Claim 132]

The method of claim 130,

The second character, A, E, I, O, or a character input method comprising at least one of U.

[Claim 133]

The method of claim 130,

The second character is a character input method comprising at least one of T, S, N, R, H, D, L, or C.

[Claim 134]

The method of claim 130,

The second character is at least one of ㅏ, ㅓ, ㅗ, ㅜ, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ㅣ, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅞ, ㅞ Character input method comprising a.

[Claim 135]

The method of any one of claims 121 to 129,

When long dragged, the second character is a character input method, characterized in that two or more characters.

[Claim 136]

The method of any one of claims 121 to 129,

The character input method further comprising: when the touch is maintained and dragged in the same direction once again or when the dragging direction is changed and dragged, additional characters to be input are continuously added and input.

[Claim 137]

The method of any one of claims 121 to 128,

Depending on the situation before the final operation, a specific character group among at least one character group is matched, and at least one character among at least one character belonging to the matched character group is matched with the character assigned to the target button without changing the character mode. A method, characterized in that it is additionally input together.

[Claim 138]

The method of claim 137,

When any one of the multi-all on & off or 4-direction multi-all drag operation is performed, the second letter is any one of A, E, I, O, U, or

When any one of multi-not all reference finger on & off or 4-direction multi-not all reference finger drag operation is performed, the second character is any one of W and Y,

When any one of the four directions of single drag operation is performed, the second letter is any one of T, S, N, R, or

When any one of the multi-all dragging is performed after a single touch in four directions, the second letter is any one of H, D, L, and C.

[Claim 139]

The method of any one of claims 121 to 138,

When there are more than two letters assigned to the target button,

According to the situation before the final operation, the method characterized in that the first character is selected and input.

[Claim 140]

The method of any one of claims 121 to 139,

When there are more than two letters assigned to the target button,

According to the situation before the final operation, the method characterized in that the first character is selected and input.

[Claim 141]

The method of claim 121 to 140,

The multi-touch,

A method, characterized in that two multi-touch is recognized by two touch points by using two fingers.

[Claim 142]

The method of claim 141,

The two fingers,

The method characterized in that the index finger and middle finger.

[Claim 143]

The method of any one of claims 121 to 142,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 144]

The method of any one of claims 121 to 143,

The operation after the multi-touch is at least one of the following operations.

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi Not All Drag

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

1.5.2..12. Multi power tap

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

[Claim 145]

The method of any one of claims 121 to 144,

A method, characterized in that the applicable character is water, and a number or special character is also included.

[Claim 146]

The method of any one of claims 121 to 145,

The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method.

[Claim 147]

In a device having a touch screen, in the method for inputting characters,

Displaying a keyboard on which buttons to which a plurality of characters are assigned are present on the touch screen;

In the process of multi-on & off so that a specific button is recognized as a target button,

After the multi-touch, including after the multi-touch or after the multi-touch finger is turned off (= multi-touch is released),

Depending on the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character related to the target button is inputted without changing the character mode while belonging to the matched character group. Character input method comprising the step of.

[Claim 148]

The method of claim 147,

The "specific character group" is any one of the following character groups.

1) Any one character group among two or more different character groups classified into different groups according to the spelling rules.

2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.

Deleted less?

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 149]

The method of claim 148,

The "specific character group" is a character group to which other characters belong according to the spelling rule, which is a character group of characters input in another character mode under the spelling rule corresponding to the currently set character mode.

[Claim 150]

The method of claim 149,

"A specific character group" means any one character group among two or more different character groups classified into different groups according to the spelling rules.

In English,

If the currently set text mode is upper case mode, it is a character group that can be input in lower case mode, or

If the currently set text mode is a lowercase mode, it is a character group that can be input in uppercase mode, or

In Japanese

If the currently set text mode is Hiragana text mode, it is a character group that can be input in katakana text mode,

And if the currently set character mode is a katakana character mode, a character group that can be input in the hiragana character mode.

[Claim 151]

The method of claim 147-150,

In the way the target button is recognized,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) or a method for recognizing a target button by an open touch point (= a method for recognizing a target button by an open finger) or two or more touch points. A method, characterized in that the target button is recognized as a target button recognition method based on a range.

[Claim 152]

The method of claim 151,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

[Claim 153]

The method of claim 152,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),

A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button.

[Claim 154]

The method of claim 152,

In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),

A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

[Claim 155]

The method of claim 152,

The target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the X coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate value is recognized as the target button,

3 In the case of multi-touch, the method of recognizing a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points as a target button.

[Claim 156]

The method of claim 152,

The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= the target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,

3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it.

[Claim 157]

The method of claim 151,

The method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

[Claim 158]

The method of claim 147-157,

The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or

The 3 multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger, and ring finger, or

The method of claim 1, wherein the 4 multi-touch is a multi-touch recognized by the index and middle fingers, the ring finger, and the touch points of the hand.

[Claim 159]

The method of any one of claims 147 to 158,

A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

[Claim 160]

The method of any one of claims 147 to 159,

The method characterized in that the operation after multi-touch is at least one of the following operations

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..12. Multi power tap

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

[Claim 161]

The method of any one of claims 147 to 160,

A method, characterized in that the applicable character is water, and a number or special character is also included.

[Claim 162]

The method of any one of claims 147 to 161,

The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method.

In the following, the word “finger” from the user's point of view can be replaced with the word “touch point” from the viewpoint of most devices.

[Sudan Port 1A]

In a method of recognizing a target button among buttons displayed on the touch screen in a device having a touch screen,

A recognition method using any one of a group including a target button recognition method by a reference finger, a target button recognition method by an open finger, and a target button recognition method by two or more multi-touched fingers.

[Sudan Port 2A]

The method of claim 1A,

The reference finger is a finger having an n (n>2)-th X coordinate value in a small order of X coordinate values among multi-touched fingers.

[Sudan Port 3A]

The method of claim 1A,

The reference finger is a finger having an n (n>2)-th Y coordinate value among the multi-touched fingers in an order in which the Y coordinate value is small.

[Sudan Port 4A]

The method of claim 2A,

The target button recognition method by the reference finger,

A recognition method, characterized in that, among the multi-touched touch points, a point having an X coordinate value touched by the reference finger is recognized as a target button.

[Sudan Port 5A]

The method of claim 3A,

The target button recognition method by the reference finger,

Recognizing a point having a Y coordinate value touched by the reference finger among the multi-touched touch points as a target button.

[Sudan Port 6A]

The method of claim 1A,

The method of recognizing a target button by the open finger,

Target button recognition method by the first open finger, target button recognition method by the second open finger, the target button recognition method by the third open finger, the target button recognition method by the fourth open finger, and the fifth open finger A recognition method, characterized in that at least one method from among groups including a target button recognition method is used.

[Sudan Port 7A]

The method of claim 6A,

The method for recognizing a target button by the first open finger,

A button including a new X-coordinate corresponding to the average value of the X-coordinates of the points touched by the multi-touched fingers and a new Y-coordinate corresponding to the average value of the Y-coordinates of the touched points by the multi-touched fingers as the target button. Recognition method, characterized in that to recognize.

[Sudan Port 8A]

The method of claim 6A,

The method for recognizing a target button by the second open finger,

A new X-coordinate corresponding to the average value of the X-coordinates of the points touched by the multi-touched fingers and the Y-coordinate paired with the X-coordinate of a specific order among the magnitudes of the X-coordinates of the points touched by the multi-touched fingers Recognition method, characterized in that recognizing the included touch button as a target button.

[Sudan Port 9A]

The method of claim 6A,

The method for recognizing a target button using the third open finger,

Target a touch button including a new X coordinate corresponding to the average value of the X coordinates of the points touched by the multi-touched fingers and a point consisting of the Y coordinates in a specific order among the Y coordinate values of the points touched by the multi-touched fingers. Recognition method, characterized in that the recognition with a button.

[Sudan Port 10A]

The method of claim 6A,

The method for recognizing a target button using the fourth open finger,

The new Y coordinate corresponding to the average value of the Y coordinates of the points touched by the multi-touched fingers and the X-coordinate forming a pair with the Y coordinate of a specific order among the size order of the Y coordinate values of the points touched by the multi-touched fingers Recognition method, characterized in that recognizing the included touch button as a target button.

[Sudan Port 11A]

The method of claim 6A,

The method for recognizing a target button by the fifth open finger,

A new Y coordinate corresponding to the average value of the Y coordinates of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers targeting a touch button including a point consisting of a specific order of X coordinates. Recognition method, characterized in that the recognition with a button.

[Sudan Port 12A]

The method of claim 1A,

The target button recognition method using the two or more multi-touched fingers,

A recognition method, characterized in that the range including two or more touch points is recognized as a target button.

[Sudan Port 13A]

The method of claim 1A,

The multi-touch is n multi-touch (n is a natural number), multi-all touch, multi-not all-touch, multi-not-all-based finger touch, multi-not-all-not-based finger touch, multi-not-all-based finger fluctuating touch, and multi-touch by open fingers. Touch, n multi-touch with open finger, multi-all touch with open finger, multi-not all touch with open finger, multi-not all reference finger touch with open finger, and multi-not all-not standard finger touch with open finger Recognition method, characterized in that in any one of the group including a.

[Sudan Port 1B]

Displaying buttons to which a plurality of characters are assigned to the touch screen in a device having a touch screen;

When a target button among the buttons is operated after a single touch, input processing a first character among a plurality of characters assigned to the target button; And

And when the target button is manipulated after multi-touch, inputting and processing a character other than the first character among a plurality of characters assigned to the target button.

[Sudan Port 2B]

The method of claim 1B,

The step of inputting characters other than the first character,

If the target button is operated after 2-multi-touch, inputting a second character from among a plurality of characters assigned to the target button;

If the target button is manipulated after 3-multi-touch, inputting a third character from among a plurality of characters assigned to the target button; And

When the target button is operated after 4-multi-touch, input processing a fourth character among a plurality of characters assigned to the specific button.

[Sudan Port 3B]

The method of claim 2B,

The operation after the multi-touch is multi-on&off, and characters assigned to the target button are displayed while circulating according to the number of times the multi-on&off is performed one or more times in succession.

[Sudan Port 4B]

The method of claim 2B,

The operation after the multi-touch is a multi-tap,

The target button is assigned a plurality of character groups consisting of at least one character, and after a specific character group is selected by the multi-touch, at least one character included in the specific character group is input by the multi-tap; Character input method, characterized in that it further comprises.

[Sudan Port 5B]

The method of claim 4B,

The character group is a character group consisting of at least one or more characters classified into different series in the spelling representation of the same character, a character group consisting of special characters, and a character group consisting of at least one character assigned to be sequentially input to a button And at least one of a group including a character group consisting of at least one character assigned to be displayed at a specific position of the button.

[Sudan Port 6B]

The method of claim 5B,

The character group consisting of at least one or more characters classified into different series in the spelling notation of the same character is a character group whose spelling is composed of uppercase letters, a character group whose spelling is composed of lowercase letters, and a character group whose spelling is composed of hiragana And a character input method in which the spelling notation is any one of a group including a character group consisting of katakana.

[Sudan Port 7B]

The method of claim 6B,

The specific character group,

If the character mode of the target button is an uppercase letter mode of an English letter, it is a character group consisting of lowercase letters, and if the letter mode of the target button is a lowercase letter mode of an English letter, it is a letter group consisting of uppercase letters,

Character input method, characterized in that if the character mode of the target button is a single character hiragana character mode, a character group consisting of katakana, and when the character mode of the target button is a single character katakana character mode, a character group consisting of hiragana characters.

[Sudan Port 8B]

The method of claim 1B,

The target button is determined by any one of a group including a target button recognition method by a reference finger, a target button recognition method by an open touch point, and a target button recognition method by a range including two or more touch points. Character input method, characterized in that.

[Sudan Port 9B]

The method of claim 8B,

The method of recognizing a target button by the reference finger is characterized in that, among the multi-touched fingers, a button touched by a finger having an X coordinate value of nth is recognized as a target button.

[Sudan Port 10B]

The method of claim 8B,

The method of recognizing a target button by a reference finger is characterized in that, among multi-touched fingers, a button touched by a finger having an nth Y coordinate value is recognized as a target button.

[Sudan Port 11B]

The method of claim 8B,

The method of recognizing a target button by the open finger includes an X coordinate value having a size in a specific order among X coordinate values of points touched by the multi-touched fingers and a Y coordinate value having a size in a specific order among the Y coordinate values. Character input method, characterized in that recognizing the button as a target button.

[Sudan Port 12B]

The method of claim 11B,

In the method of recognizing a target button by the open finger, a new X coordinate value determined as an average value of the X coordinate values of points touched by the multi-touched fingers and the average value of Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a new Y coordinate value as a target button.

[Sudan Port 13B]

The method of claim 11B,

In the method of recognizing a target button by the open finger, a new X coordinate determined as an average value of the X coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers are in a specific order. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

[Sudan Port 14B]

The method of claim 11B,

The method of recognizing the target button by the open finger includes a new X-coordinate determined as an average value of the X-coordinate values of the points touched by the multi-touched fingers and the Y-coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate as a target button.

[Sudan Port 15B]

The method of claim 11B,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of points touched by the multi-touched fingers and a specific order of the Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate paired with a Y coordinate as a target button.

[Sudan Port 16B]

The method of claim 11B,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate as a target button.

[Sudan Port 17B]

The method of claim 8B,

The target button recognition method using the two or more multi-touched fingers,

A method comprising recognizing a range including two or more touch points as a target button.

[Sudan Port 18B]

The method of claim 1B,

The character includes at least one of the group including Greek Roman characters, Cyrillic characters, Indian characters, Arabic characters, Thai characters, Vietnamese characters, Korean characters, English character modes, world language characters including Japanese characters, numbers, and special characters. Character input method, characterized in that to.

[Sudan Port 1C]

Displaying buttons to which a plurality of characters are respectively assigned to the touch screen in a device having a touch screen;

If a target button among the buttons is operated after a single touch, input processing any one of a plurality of characters assigned to the target button; And

And when the target button is manipulated after multi-touch, inputting and processing another character from among a plurality of characters assigned to the target button.

[Sudan Port 2C]

The method of claim 1C,

The operation after the single touch is single on & off, and the operation after the multi-touch is multi on & off.

[Sudan Port 3C]

The method of claim 2C,

The operations after multi-touch above are: Multi All On & Off, Multi Not All On & Off, Multi Not All On & Off, Multi Not All On & Off, Multi On & Off With Open Finger, Open Finger Multi-Not All On & Off by Open Finger, Multi Not All On & Off by Open Finger, Multi Not All-Not Standard Finger On & Off by Open Finger, and Multi-Not All Not Reference Finger On & Off by Open Finger Character input method, characterized in that one.

[Sudan Port 4C]

The method of claim 2C,

The step of inputting the character may further include input processing another character from among a plurality of characters assigned to the target button through dragging after a single touch or dragging after a multi-touch; Character input method.

[Sudan Port 5C]

The method of claim 4C,

After the multi-touch, dragging is multi-drag, multi-all drag, multi-not-all-drag, multi-not-all-based finger drag, multi-not-all-knot-based finger drag, multi-drag by open finger, multi-all drag by open finger, and wide open. Character input method, characterized in that any one of a group including multi-not all-not-all dragging by a finger, multi-not-all-reference finger drag by an open finger, and multi-not all-not-all reference finger drag by an open finger.

[Sudan Port 6C]

The method of claim 5C,

The direction of the dragging includes at least one of a group including top, bottom, left, right, top left, bottom left, top right, and bottom right.

[Sudan Port 7C]

The method of claim 6C,

In the step of inputting the character, different characters are input according to the direction of the drag.

[Sudan Port 8C]

The method of claim 1C,

The target button is determined by any one of a group including a target button recognition method by a reference finger, a target button recognition method by an open touch point, and a target button recognition method by a range including two or more touch points. Character input method, characterized in that.

[Sudan Port 9C]

The method of claim 8C,

The method of recognizing a target button by the reference finger is characterized in that, among the multi-touched fingers, a button touched by a finger having an X coordinate value of nth is recognized as a target button.

[Sudan Port 10C]

The method of claim 8C,

The method of recognizing a target button by a reference finger is characterized in that, among multi-touched fingers, a button touched by a finger having an nth Y coordinate value is recognized as a target button.

[Sudan Port 11C]

The method of claim 8C,

The method of recognizing a target button by the open finger includes an X coordinate value having a size in a specific order among X coordinate values of points touched by the multi-touched fingers and a Y coordinate value having a size in a specific order among the Y coordinate values. Character input method, characterized in that recognizing the button as a target button.

[Sudan Port 12C]

The method of claim 11C,

In the method of recognizing a target button by the open finger, a new X coordinate value determined as an average value of the X coordinate values of points touched by the multi-touched fingers and the average value of Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a new Y coordinate value as a target button.

[Sudan Port 13C]

The method of claim 11C,

In the method of recognizing a target button by the open finger, a new X coordinate determined as an average value of the X coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers are in a specific order. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

[Sudan Port 14C]

The method of claim 11C,

The method of recognizing the target button by the open finger includes a new X-coordinate determined as an average value of the X-coordinate values of the points touched by the multi-touched fingers and the Y-coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate as a target button.

[Sudan Port 15C]

The method of claim 11C,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of points touched by the multi-touched fingers and a specific order of the Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate paired with a Y coordinate as a target button.

[Sudan Port 16C]

The method of claim 11C,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate as a target button.

[Sudan Port 17C]

The method of claim 8C,

The target button recognition method using the two or more multi-touched fingers,

Character input method, characterized in that the range including two or more touch points is recognized as a target button.

[Sudan Port 18C]

The method of claim 1C,

The multi-touch is n multi-touch, multi-all touch, multi-not all touch, multi-not all-based finger touch, multi-not all-not standard finger touch, multi-not all-based finger fluctuation touch, n multi-touch by open finger, open finger It characterized in that any one of the group including multi-not all-touch by finger, multi-not all-touch by open finger, multi-not all-not reference finger touch by open finger, and multi-not all-not reference finger touch by open finger How to enter text.

[Sudan Port 19C]

The method of claim 1C,

The character includes at least one of the group including Greek Roman characters, Cyrillic characters, Indian characters, Arabic characters, Thai characters, Vietnamese characters, Korean characters, English character modes, world language characters including Japanese characters, numbers, and special characters. Character input method, characterized in that to.

[Sudan Port 1D]

Recognizing a target button among buttons to which a plurality of characters displayed on the touch screen are respectively assigned, in a device having a touch screen; And

Character input method comprising; determining a text mode according to an operation after touching the target button.

[Sudan Port 2D]

The method of claim 1D,

Wherein in the determining step, different text modes are determined according to a type of touch to the target button.

[Sudan Port 3D]

The method of claim 2D,

In the determining step, when an operation is input after a single touch on the target button, a first character mode is determined, and when an operation after multi-touch on the target button is input, a second character mode is determined. Way.

[Sudan Port 4D]

The method of claim 1D,

The determining step further comprises inputting a character in a character mode different from a character mode of a character assigned to the target button according to a type of operation after touching the target button.

[Sudan Port 5D]

The method of claim 1D,

And inputting a character of another character mode along with a character assigned to the target button according to an operation type after touching the target button.

[Sudan Port 6D]

The method of claim 1D,

The character mode is any one of the group including Greek and Roman mode, Cyrillic mode, Indian character mode, Arabic character mode, Thai character mode, Vietnamese character mode, English character mode, Korean character mode, Japanese character mode, and special character mode. Character input method characterized by.

[Sudan Port 7D]

The method of claim 6D,

The text mode includes an uppercase letter mode and a lowercase letter mode in the case of an English letter mode, and a hiragana letter mode and a katakana letter mode in the case of a Japanese letter mode.

[Sudan Port 8D]

The method of claim 1D,

The character input method, characterized in that the touch is a single touch or a multi-touch.

[Sudan Port 9D]

The method of claim 8D,

The multi-touch, character input method, characterized in that the touch using two or more fingers.

[Sudan Port 10D]

The method of claim 8D,

The multi-touch is n multi-touch, multi-all touch, multi-not all touch, multi-not all-based finger touch, multi-not all-not standard finger touch, multi-not all-based finger fluctuation touch, n multi-touch by open finger, open finger A character including any one of the group including multi-all touch by finger, multi-not all touch by open finger, multi-not all reference finger touch by open finger, and multi-not all-not reference finger touch by open finger Input method.

[Sudan Port 11D]

The method of claim 10D,

The above multi-touch is Multi On & Off, Multi All On & Off, Multi Not All On & Off, Multi Not All On & Off, Multi Not All On & Off, Multi On & Off With Open Finger, A group that includes multi-not all-on and off by open fingers, multi-not all-on and off by open fingers, multi-not all-reference finger on and off by open fingers, and multi-not all-not standard finger on and off by open fingers Character input method, characterized in that any one of.

[Sudan Port 12D]

The method of claim 8D,

The target button is determined by any one of a group including a target button recognition method by a reference finger, a target button recognition method by an open touch point, and a target button recognition method by a range including two or more touch points. Character input method, characterized in that.

[Sudan Port 13D]

The method of claim 12D,

The method of recognizing a target button by the reference finger is characterized in that, among the multi-touched fingers, a button touched by a finger having an X coordinate value of nth is recognized as a target button.

[Sudan Port 14D]

The method of claim 12D,

The method of recognizing a target button by a reference finger is characterized in that, among multi-touched fingers, a button touched by a finger having an nth Y coordinate value is recognized as a target button.

[Sudan Port 15D]

The method of claim 12D,

The method of recognizing a target button by the open finger includes an X coordinate value having a size in a specific order among X coordinate values of points touched by the multi-touched fingers and a Y coordinate value having a size in a specific order among the Y coordinate values. Character input method, characterized in that recognizing the button as a target button.

[Sudan Port 16D]

The method of claim 15D,

In the method of recognizing a target button by the open finger, a new X coordinate value determined as an average value of the X coordinate values of points touched by the multi-touched fingers and the average value of Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a new Y coordinate value as a target button.

[Sudan Port 17D]

The method of claim 15D,

In the method of recognizing a target button by the open finger, a new X coordinate determined as an average value of the X coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers are in a specific order. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

[Sudan Port 18D]

The method of claim 15D,

The method of recognizing the target button by the open finger includes a new X-coordinate determined as an average value of the X-coordinate values of the points touched by the multi-touched fingers and the Y-coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate as a target button.

[Sudan Port 19D]

The method of claim 15D,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of points touched by the multi-touched fingers and a specific order of the Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate paired with a Y coordinate as a target button.

[Sudan Port 20D]

The method of claim 15D,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate as a target button.

[Sudan Port 21D]

The method of claim 12D,

The target button recognition method using the two or more multi-touched fingers,

Character input method, characterized in that the range including two or more touch points is recognized as a target button.

[Sudan Port 1E]

Recognizing a target button among buttons to which a plurality of characters displayed on the touch screen are respectively assigned, in a device having a touch screen; And

And processing a first character assigned to the recognized target button and a second character matched for each type of operation after touching the target button together.

[Sudan Port 2E]

The method of claim 1E,

The target button is determined by single touch,

The character input method, characterized in that the second character is determined by operation after a single touch.

[Sudan Port 3E]

The method of claim 2E,

The character input method, characterized in that the operation after the single touch is a drag after a single touch.

[Sudan Port 4E]

The method of claim 3E,

The direction of the drag is at least one of a group including top, bottom, left, right, top left, bottom left, top right, and bottom right.

[Sudan Port 5E]

The method of claim 1E,

The target button is determined by multi-touch,

The character input method, characterized in that the second character is determined by an operation after multi-touch.

[Sudan Port 6E]

The method of claim 5E,

The character input method, characterized in that the manipulation after the multi-touch is a drag after the multi-touch.

[Sudan Port 7E]

The method of claim 6E,

The direction of the drag is at least one of a group including top, bottom, left, right, top left, bottom left, top right, and bottom right.

[Sudan Port 8E]

The method of claim 1E,

The second character is determined by a post-touch operation, and different characters are determined according to the type of the touch.

[Sudan Port 9E]

The method of claim 8E,

Character input method, characterized in that the type of the touch includes a single touch and a multi-touch.

[Sudan Port 10E]

The method of claim 9E,

Character input method, characterized in that the multi-touch using at least two fingers.

[Sudan Port 11E]

The method of claim 1E,

The target button is determined by any one of a group including a target button recognition method using a reference finger, a target button recognition method based on an open touch point, and a target button recognition method based on a range including two or more touch points. Character input method, characterized in that the.

[Sudan Port 12E]

The method of claim 11E,

The method of recognizing a target button by the reference finger is characterized in that, among the multi-touched fingers, a button touched by a finger having an X coordinate value of nth is recognized as a target button.

[Sudan Port 13E]

The method of claim 11E,

The method of recognizing a target button by a reference finger is characterized in that, among multi-touched fingers, a button touched by a finger having an nth Y coordinate value is recognized as a target button.

[Sudan Port 14E]

The method of claim 11E,

The method of recognizing a target button by the open finger includes an X coordinate value having a size in a specific order among X coordinate values of points touched by the multi-touched fingers and a Y coordinate value having a size in a specific order among the Y coordinate values. Character input method, characterized in that recognizing the button as a target button.

[Sudan Port 15E]

The method of claim 14E,

In the method of recognizing a target button by the open finger, a new X coordinate value determined as an average value of the X coordinate values of points touched by the multi-touched fingers and the average value of Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a new Y coordinate value as a target button.

[Sudan Port 16E]

The method of claim 14E,

In the method of recognizing a target button by the open finger, a new X coordinate determined as an average value of the X coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers are in a specific order. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate paired with an X coordinate as a target button.

[Sudan Port 17E]

The method of claim 14E,

The method of recognizing the target button by the open finger includes a new X-coordinate determined as an average value of the X-coordinate values of the points touched by the multi-touched fingers and the Y-coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of a Y coordinate as a target button.

[Sudan Port 18E]

The method of claim 14E,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of points touched by the multi-touched fingers and a specific order of the Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate paired with a Y coordinate as a target button.

[Sudan Port 19E]

The method of claim 14E,

The method of recognizing the target button by the open finger includes a new Y coordinate determined as an average value of the Y coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers. Character input method, characterized in that recognizing a button including a point consisting of an X coordinate as a target button.

[Sudan Port 20E]

The method of claim 11E,

The target button recognition method using the two or more multi-touched fingers,

Character input method, characterized in that the range including two or more touch points is recognized as a target button.

[Sudan Port 21E]

The method of claim 1E,

The first character is any one of a group including language characters, numbers, and special characters, and the second character is any one of a group including language characters, numbers, and special characters.

[Sudan Port 22E]

The method of claim 21E,

The first character is a consonant,

The second character is a character input method, characterized in that any one of a group including vowels, half vowels, half consonants, and consonants.

[Sudan Port 23E]

The method of claim 22E,

The first character is a consonant,

The second character is'ㅏ','ㅓ','ㅗ','ㅜ','ㅑ','ㅕ','ㅛ','ㅠ','ㅡ','ㅣ','ㅢ', At least one of the letters corresponding to the pronunciation of'ㅐ','ㅔ','ㅒ','ㅖ','ㅚ','ㅘ','ㅙ','ㅟ','ㅝ' and'ㅞ' Character input method, characterized in that.

[Sudan Port 24E]

The method of claim 22E,

The second character is at least one of characters corresponding to pronunciations of'ㅏ','ㅔ','ㅣ','ㅗ', and'ㅜ'.

[Sudan Port 25E]

The method of claim 21E,

The first character is an English character,

The second character is at least one of a group including'A','E','I','O', and'U'.

[Sudan Port 26E]

The method of claim 21E,

The first character is an English character,

The second character is at least one of a group including'T','S','N','R','H','D','L', and'C'. Way.

[Sudan Port 27E]

The method of claim 21E,

The first character is an English character,

The character input method, characterized in that the second character is'W' or'Y'.

[Sudan Port 28E]

The method of claim 1E,

The target button is determined by touch,

And when the target button is touched and then dragged for a predetermined period of time or more, inputting two characters together with the first character and two characters.

[Sudan Port 29E]

The method of claim 1E,

The target button is determined by touch,

When the target button is dragged two or more times after the touch or the drag direction is changed, when the drag is dragged two or more times with the first character or the drag direction is changed, two characters are input together with the first character; Character input method, characterized in that it further comprises.

[Sudan Port 30E]

The method of claim 28E or 29E,

The character input method, characterized in that the two characters are at least one of ING and ED.

[Sudan Port 31E]

The method of claim 1E,

The character includes at least one of the group including Greek Roman characters, Cyrillic characters, Indian characters, Arabic characters, Thai characters, Vietnamese characters, Korean characters, English character modes, world language characters including Japanese characters, numbers, and special characters. Character input method, characterized in that to.

[Sudan Port 1F]

Recognizing a target button by a touch among a plurality of buttons to which at least one character group displayed on the touch screen is assigned, in a device having a touch screen;

Selecting a specific character group assigned to a target button according to the touch; And

And inputting at least one character included in the specific character group according to the manipulation after the touch.

[Sudan Port 2F]

The method of claim 1F,

The selection of the specific character group is made before the final operation,

The character input method, characterized in that the touch is a single touch or a multi-touch.

[Sudan Port 3F]

The method of claim 2F,

The character input method, characterized in that the operation and the final operation are off or drag.

[Sudan Port 4F]

The method of claim 3F,

The direction of the drag is one of a group including upper, lower, left, right, upper left, lower left, upper right, and lower right.

[Sudan Port 5F]

The method of claim 2F,

The multi-touch includes n multi-touch (n>1), multi-all touch, multi-not all-touch, multi-not all-based finger touch, multi-not all-not-based finger touch, multi-not all-based finger fluctuation touch, and Any one of the groups including multi-touch, multi-not all-touch by open finger, multi-not all touch by open finger, multi-not all-not standard finger touch by open finger, and multi-not all-not reference finger touch by open finger Character input method including that.

[Sudan Port 6F]

The method of claim 5F,

The operations after the above multi-touch are: Multi On & Off, Multi All On & Off, Multi Not All On & Off, Multi Not All On & Off, Multi Not All On & Off, Multi Not All On & Off, Multi Drag, Multi All Drag , Multi-not all drag, Multi-not all-based finger drag, Multi-not all-not-based finger drag, Multi multi-tap, Multi on and off by open finger, Multi all on and off by open finger, Multi not all by open finger On & Off, multi-not all standard finger by open finger on and off, multi-not all-not standard finger by open finger on and off, multi drag by open finger, multi all drag by open finger, by open finger Character input method comprising any one of a group including multi-not all-drag, multi-not-all reference finger drag by an open finger, multi-not all-not reference finger drag by an open finger, and multi-multi tap by an open finger .

[Sudan Port 7F]

The method of claim 1F,

The character group is a character group consisting of at least one or more characters classified into different series in the spelling representation of the same character, a character group consisting of special characters, and a character group consisting of at least one character assigned to be sequentially input to a button And at least one of a group including a character group consisting of at least one character assigned to be displayed at a specific position of the button.

[Sudan Port 8F]

The method of claim 7F,

The character group consisting of at least one or more characters classified into different series in the spelling notation of the same character is a character group whose spelling is composed of uppercase letters, a character group whose spelling is composed of lowercase letters, and a character group whose spelling is composed of hiragana And a character input method in which the spelling notation is any one of a group including a character group consisting of katakana.

[Sudan Port 9F]

The method of claim 8F,

The specific character group,

If the character mode of the target button is an uppercase letter mode of an English letter, it is a character group consisting of lowercase letters, and if the letter mode of the target button is a lowercase letter mode of an English letter, it is a letter group consisting of uppercase letters,

Character input method, characterized in that if the character mode of the target button is a single character hiragana character mode, a character group consisting of katakana, and when the character mode of the target button is a single character katakana character mode, a character group consisting of hiragana characters.

[Sudan Port 10F]

The method of claim 1F,

The character may be any one of a group including Greek Roman characters, English characters, Cyrillic characters, Indian characters, Arabic characters, Thai characters, Vietnamese characters, Korean characters, Japanese characters, and language characters including at least special characters and numbers. How to enter characters.

[Sudan Port 11F]

The method of claim 1F,

The recognition step of the target button may include a method of recognizing a target button by a reference finger, a method of recognizing a target button by an open finger, and a method of recognizing a target button by a range including two or more touch points. Character input method, characterized in that.

[Sudan Port 12F]

The method of claim 11F,

The method of recognizing a target button by a reference finger is characterized in that a button including a touch point according to an n-th finger among an order of X coordinate values of the multi-touched fingers is recognized as a target button.

[Sudan Port 13F]

The method of claim 11F,

The method of recognizing a target button by a reference finger is characterized in that a button including a touch point according to an n-th finger in a sequence of Y coordinate values of the multi-touched fingers is recognized as a target button.

[Sudan Port 14F]

The method of claim 11F,

The method of recognizing the target button by the open finger includes an X coordinate value whose size is in a specific order among the X coordinate values of points touched by the multi-touched fingers, and a Y coordinate value whose size is in a specific order among the Y coordinate values. Character input method, characterized in that recognizing the button to be a target button.

[Sudan Port 15F]

The method of claim 14F,

The target button is a point consisting of a new X coordinate value determined as the average value of the X coordinate values of the points touched by the multi-touched fingers and a new Y coordinate value determined as the average value of the Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that the button comprising a.

[Sudan Port 16F]

The method of claim 14F,

The target button is a new X coordinate value determined as the average value of the X coordinate values of the points touched by the multi-touched fingers and a pair of the X coordinate value in a specific order among the order of magnitude of the X coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that it is a button including a point consisting of the Y-coordinate value.

[Sudan Port 17F]

The method of claim 14F,

The target button is a point consisting of a new X coordinate value determined as the average value of the X coordinate values of the points touched by the multi-touched fingers and the Y coordinate value in a specific order among the size order of the Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that the button comprising a.

[Sudan Port 18F]

The method of claim 14F,

The target button sets a new Y coordinate value determined as the average value of the Y coordinate values of the points touched by the multi-touched fingers and the Y coordinate value in a specific order among the order of magnitude of the Y coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that it is a button including a point consisting of the X-coordinate value.

[Sudan Port 19F]

The method of claim 13F,

The target button is a point consisting of a new Y coordinate value determined as the average value of the Y coordinate values of the points touched by the multi-touched fingers and the X coordinate value in a specific order among the size order of the X coordinate values of the points touched by the multi-touched fingers. Character input method, characterized in that the button comprising a.

[Sudan Port 1G]

Recognizing a target object through a touch among objects displayed on the touch screen in a device having a touch screen; And

Deforming the target object according to the manipulation after the touch; object transformation method comprising a.

[Sudan Port 2G]

The method of claim 1G,

Recognition of the target object,

An object transformation method, characterized in that one of a group including a method of recognizing a target object using a reference finger, a method of recognizing a target object using an open finger, and a method of recognizing a target object based on a range including two or more touch points is used.

[Sudan Port 3G]

The method of claim 2G,

In the method of recognizing a target object by the reference finger, an object including a touch point by a reference finger corresponding to a coordinate value according to a specific order of an X coordinate value or a Y coordinate value is recognized as a target object. Way.

[Sudan Port 4G]

The method of claim 3G,

In the method of recognizing a target object by the reference finger, in the case of 2-multi-touch, an object including a touch point having a first X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is a target object. Object transformation method, characterized in that recognized.

[Sudan Port 5G]

The method of claim 4G,

In the method of recognizing a target object by the reference finger, in the case of 3-multi-touch, an object including a touch point having a second X-coordinate value among the smallest order of the X-coordinate value among the multi-touched touch points is a target object. Object transformation method, characterized in that recognized.

[Sudan Port 6G]

The method of claim 3G,

In the method of recognizing a target object by the reference finger, in the case of 2-multi-touch, an object including a touch point having a first Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is a target object. Object transformation method, characterized in that recognized.

[Sudan Port 7G]

The method of claim 6G,

In the method of recognizing a target object by the reference finger, when 3-multi-touch is performed, an object including a touch point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target object. Object transformation method, characterized in that the.

[Sudan Port 8G]

The method of claim 2G,

The method of recognizing a target object based on the open touch points is determined by a new X coordinate value determined as an average value of X coordinate values of points touched by multi-touched fingers and an average value of Y coordinate values of points touched by multi-touched fingers. An object transformation method comprising recognizing an object including a point consisting of a new Y coordinate value to be the target object.

[Sudan Port 9G]

The method of claim 2G,

The method of recognizing a target object based on the open touch points includes a new X coordinate value determined as an average value of the X coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers. An object transforming method comprising recognizing an object including a point consisting of an X-coordinate value and a Y-coordinate value paired as the target object.

[Sudan Port 10G]

The method of claim 2G,

The method of recognizing a target object based on the open touch points includes a new X-coordinate value determined as an average value of the X-coordinate values of the points touched by the multi-touched fingers and the Y-coordinate value order of the points touched by the multi-touched fingers. An object transformation method comprising recognizing an object including a point consisting of an ordered Y coordinate value as a target object.

[Sudan Port 11G]

The method of claim 2G,

The method of recognizing a target object based on the open touch points includes a new Y coordinate value determined as an average value of Y coordinate values of points touched by multi-touched fingers and a size order of Y coordinate values of points touched by multi-touched fingers. An object transformation method comprising recognizing an object including a point consisting of an X coordinate value paired with a Y coordinate value in a specific order as a target object.

[Sudan Port 12G]

The method of claim 2G,

The method of recognizing a target object based on the open touch points includes a new Y coordinate value determined as an average value of the Y coordinate values of the points touched by the multi-touched fingers and the X coordinate value of the points touched by the multi-touched fingers. An object transformation method comprising recognizing an object including a point consisting of an X coordinate value in a specific order as a target object.

[Sudan Port 13G]

The method of claim 1G,

The post-touch operation is multi-touch and then drag, and the target object is enlarged or reduced by dragging after the multi-touch, and

The direction of the dragging is any one of a group including up, down, left, right, upper left, left and right, upper right and lower right.

[Sudan Port 14G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, when the reference finger is touched and dragged upwards at a point including a Y coordinate value equal to or greater than the average value of the target object's Y coordinate values, the smallest Y coordinate of the target object The object transformation method, characterized in that the value is moved to a point where the largest Y-coordinate value becomes larger without change.

[Sudan Port 15G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, when a reference finger is touched and dragged downward after touching a point including a Y coordinate that is less than the average value of the target object's Y coordinate values, the largest Y coordinate of the target object The object transformation method, characterized in that the value is moved to a point where the smallest Y coordinate value becomes smaller without changing.

[Sudan Port 16G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, when the reference finger is touched and dragged to the right at a point including an X coordinate equal to or greater than the average value of the X coordinate values of the target object, the smallest X coordinate value among the X coordinate values An object transformation method, characterized in that the largest X coordinate value increases without changing the coordinate value.

[Sudan Port 17G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, when the reference finger is touched and dragged to the left at a point including an X coordinate equal to or greater than the average value of the target object's X coordinate values, the smallest X coordinate value An object transformation method, characterized in that the largest X coordinate value decreases without changing the coordinate value.

[Sudan Port 18G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, when the reference finger is touched and dragged to the left at a point including the X coordinate less than the average value of the X coordinate values of the target object, the largest of the X coordinate values An object transformation method, characterized in that the X coordinate value is moved to a point where the smallest X coordinate value decreases without changing.

[Sudan Port 19G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, after the reference finger touches a point including an X coordinate value equal to or greater than the average value of the target object's X coordinate values and a Y coordinate value equal to or greater than the average value of the Y coordinate values. When the object is dragged, the smallest X coordinate value and Y coordinate value of the target object are moved to the upper right and the largest X coordinate value and Y coordinate value are moved to the upper right without changing, and the horizontal and vertical lengths are enlarged at the same ratio.

[Sudan Port 20G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, the upper right after the reference finger touches a point including an X coordinate value less than the average value of the X coordinate values of the target object and a Y coordinate value less than the average value of the Y coordinate values. When dragging in the direction, the largest X coordinate value and Y coordinate value of the target object are moved to the upper right and the smallest X coordinate value and Y coordinate value without change, so that the horizontal and vertical lengths are reduced at the same ratio. Way.

[Sudan Port 21G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, in the lower left direction after the reference finger touches a point including an X coordinate value equal to or greater than the average value of the target object's X coordinate values and a Y coordinate value equal to or greater than the average value of the Y coordinate values. When the object is dragged, the smallest X coordinate value and Y coordinate value of the target object are moved to the lower left and the largest X coordinate value and Y coordinate value are moved to the lower left without changing, and the horizontal and vertical lengths are reduced at the same ratio.

[Sudan Port 22G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, in the lower left direction after the reference finger touches a point including an X coordinate value less than the average value of the target object's X coordinate values and a Y value less than the average value of the Y coordinate values When dragged to, the largest X and Y coordinate values of the target object are moved to the lower left and the smallest X coordinate values and Y coordinate values of the target object are moved to the lower left, and the horizontal and vertical lengths are enlarged at the same ratio. .

[Sudan Port 23G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, a point including an X coordinate value equal to or greater than the average value of the target object's X coordinate values and a Y coordinate value less than the average value of the Y coordinate values in the lower right direction after the reference finger touches it. When dragged to, the smallest X coordinate value and the largest Y coordinate value of the target object are moved to the lower right without changing the largest X coordinate value and the smallest Y coordinate value, and the horizontal and vertical lengths are enlarged at the same ratio. How to transform an object.

[Sudan Port 24G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, a point including an X coordinate value less than the average value of the target object's X coordinate values and a Y coordinate value equal to or greater than the average value of the Y coordinate values, and then the lower right direction after the reference finger touches it. When dragged to, the largest X coordinate value and the smallest Y coordinate value of the target object are moved to the lower right and the smallest X coordinate value and the largest Y coordinate value without change, so that the horizontal and vertical lengths are reduced at the same ratio. How to transform an object.

[Sudan Port 25G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, the upper left direction after the reference finger touches a point including an X coordinate value equal to or greater than the average value of the target object's X coordinate values and a Y coordinate value less than the average value of the Y coordinate values. When dragged to, the smallest X coordinate value and the largest Y coordinate value of the target object are moved to the upper left and the largest X coordinate value and the smallest Y coordinate value without change, so that the horizontal and vertical lengths are reduced at the same ratio. How to transform an object.

[Sudan Port 26G]

The method of claim 13G,

The transformation of the target object is, in the case of 2-multi-touch, the upper left direction after the reference finger touches a point including an X coordinate value less than the average value of the X coordinate values of the target object and a Y coordinate value equal to or greater than the average value of the Y coordinate values. When dragged to, the largest X coordinate value and the smallest Y coordinate value of the target object are moved to the upper left and the smallest X coordinate value and the largest Y coordinate value are moved to the upper left, and the horizontal and vertical lengths are enlarged at the same ratio. How to transform an object.

[Sudan Port 27G]

The method of claim 13G,

When the target object is enlarged or reduced, at least one of a horizontal length and a vertical length is deformed.

[Sudan Port 28G]

The method of claim 27G,

The object transformation method, characterized in that the ratio of the horizontal length and the vertical length is maintained when the target object is enlarged or reduced.

[Sudan Port 29G]

The method of claim 28G,

When dragging in the right direction, the horizontal length increases, and when dragging in the left direction, the horizontal length decreases,

When dragging in the upward direction, the vertical length increases, and when dragging in the downward direction, the vertical length decreases,

When dragged in the upper left or upper right direction, the horizontal and vertical lengths are enlarged at the same ratio,

When dragged in a lower left or lower right direction, the object deformation method is reduced in a ratio equal to the horizontal length and the vertical length.

[Sudan Port 30G]

The method of claim 27G,

The object transformation method, wherein the target object has different ratios of a horizontal length and a vertical length when expanding or reducing.

[Sudan Port 31G]

The method of claim 30G,

When dragging in the right direction, the horizontal length increases, and when dragging in the left direction, the horizontal length decreases,

When dragging in the upward direction, the vertical length increases, and when dragging in the downward direction, the vertical length decreases,

When dragged in the upper left or upper right direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently depending on which direction of the upper left or upper right range,

A method, characterized in that when dragging in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently depending on which direction of the lower left range or the lower right range.

[Sudan Port 32G]

The method of claim 13G,

The object transformation method, wherein the target object is reduced if the drag direction is a direction closer to the center of the target object, and enlarged if the direction is farther away.

[Sudan Port 33G]

The method of claim 32G,

When the drag direction is one of a group including up, down, left and right, the target object,

If the drag direction is a direction closer to the center of the target object, the lengths of the two sides parallel to the drag direction are reduced, and the lengths of the two vertical sides do not change,

When the drag direction is a direction away from the center of the target object, the lengths of two sides parallel to the drag direction are enlarged, and the lengths of the two vertical sides do not change.

[Sudan Port 34G]

The method of claim 32G,

When the drag direction is one of a group including an upper right, lower right, upper left, and lower left direction, the target object is,

If the drag direction is a direction closer to the center of the target object, the lengths of both the horizontal and vertical sides are reduced,

When the drag direction is a direction away from the center of the target object, the lengths of both a horizontal side and a vertical side are enlarged.

[Sudan Port 35G]

The method of claim 32G,

When the drag direction is one of a group including an upper right, lower right, upper left, and lower left direction, the target object is,

If the drag direction is a direction closer to the center of the target object, the center of the object moves in the determined drag direction, and the position of the side perpendicular to the determined drag direction among the three sides surrounding the recognized target range is moved for reduction. And the position of the opposite side of the side does not change,

If the drag direction is a direction away from the center of the target object, the center of the object moves in the determined drag direction, and the position of the side perpendicular to the determined drag direction among the three sides surrounding the recognized target range is moved for expansion. , The object deformation method, characterized in that the position of the opposite side of the side does not change.

[Sudan Port 36G]

The method of claim 32G,

When the drag direction is one of a group including an upper right, lower right, upper left, and lower left direction, the target object is,

If the drag direction is a direction closer to the center of the target object, the center of the object moves in the determined drag direction, and among the vertices in the recognized target range, the vertex closest to the straight line parallel to the drag direction is moved for reduction. , The position of the opposite vertex of the vertex does not change,

If the drag direction is a direction away from the center of the target object, the center of the object moves in the determined drag direction, and among the vertices in the recognized target range, the vertex closest to a straight line parallel to the drag direction is moved for expansion, The object deformation method, characterized in that the position of the opposite vertex of the vertex does not change.

[Sudan Port 37G]

The method according to any one of claims 3G to 13G,

The multi-touch is n multi-touch, multi-all touch, multi-not all touch, multi-not all-based finger touch, multi-not all-not standard finger touch, multi-not all-based finger fluctuation touch, n multi-touch by open finger, open finger It characterized in that any one of the group including multi-not all-touch by finger, multi-not all-touch by open finger, multi-not all-not reference finger touch by open finger, and multi-not all-not reference finger touch by open finger How to transform objects.

[Sudan Port 1H]

In the method of inputting characters in a device having a touch screen,

When two or more touch points are touched within a certain time, that is, when they are touched substantially simultaneously,

Recognizing a virtual button or object including a point calculated by a function in which two or more touch points become variables as a target button or target object, and

A method comprising the step of performing a task including inputting a character or activating a function or changing an object related to a target button or a target object according to a change in a touch state.

[Sudan Port 2H]

The method of claim 1H,

A method, characterized in that the point calculated by the function in which the two or more touch points become variables is any one of the touched touch points.

[Sudan Port 3H]

The method of claim 2H,

The method of claim 2,

Of the size (order) of the x-coordinates of two or more touch points, the coordinate that is a specific order

The point calculated by the function in which two or more touch points become variables is any one of the touched touch points

[Sudan Port 4H]

The method of claim 3H,

A method characterized by the first or the last (or the largest or the smallest) among the order of sizes of the x-coordinates of two or more touch points.

[Sudan Port 5H]

The method of claim 2H,

Of the y-coordinates size (order) of two or more touch points, the coordinate that is a specific order

A method, characterized in that the point calculated by the function in which the two or more touch points become variables is any one of the touched touch points.

[Sudan Port 6H]

The method of claim 3H,

A method characterized by the first or the last (or the largest or the smallest) among the order of sizes of y-coordinates of two or more touch points.

When entering a character with the QWERTY keyboard on the touch screen of a conventional smartphone, there is a problem that a lot of typos occur due to the small size of the button assigned to the character, or it is necessary to input with great care to prevent typos.

When entering characters with a 12-key pad on the touch screen of a conventional smartphone, multiple characters are assigned to the same button as when entering characters on the physical 12-key pad of a conventional feature phone. There is a problem that you need a lot of at-bats. However, to solve the above problems through the present application.

When entering characters with the QWERTY keyboard of a conventional tablet PC, the size assigned to the characters is quite large, so there is no problem as described above such as typos, but through the present application, we want to improve the character input speed by entering 2 characters at a time with a single touch. do.

As described above, according to the present invention, buttons appearing on the touch screen are used to make the user's manipulation more convenient when the user inputs the input. In particular, even though the touch points to be multi-touched do not have to be touched only inside a specific small touch button, that is, the small touch button can be recognized as being multi-touched without actually multi-touching the small touch button.

In addition, specific characters can be input in addition to the characters assigned to the target button through various multi-touch manipulation methods, thereby improving the character input speed.

In addition, through various multi-touch operation methods, it can be assigned to the currently set text mode like characters in other text modes (including special characters), but not in the currently selected text mode, but only in the late order (e.g., the fourth or higher order). Characters that could not be assigned to the currently selected text mode because they can only be assigned, in fact, can be easily entered in the currently selected text mode without changing the text mode, although they are not assigned to the currently selected text mode. The character assigned to the mode can be interpreted as being additionally assigned to the currently selected character mode, and can be interpreted in such a way that it can be easily entered in the currently selected character mode.)

And, through various multi-touch operation methods, the size of each button of the conventional QWERTY keyboard is increased by 2 to 3 times, and typos are prevented through the improved QWERTY keyboard in which about 2 to 3 characters are assigned to each button. The same line of traffic is required so that the input speed can be improved as a result.

In addition, while objects including pictures, photos, browsers, and windows are multi-touched with two or more fingers, the moving direction of the touched finger is opposite, including expanding or reducing the object by pinching or stretching two or more fingers. It is not possible to change the shape of the object by the method, but to change the shape of the object including the enlargement or reduction of the object through a more convenient manipulation method including two or more fingers dragging in the same direction. Thereby, the operation speed is also fast, the movement of the finger is small and comfortable, and even a very small object can be easily enlarged or reduced.

In addition, through the multi-touch operation method, the object activation step, which must be performed before the shape of the object is deformed, is not separately performed as in the prior art, and the object is multi-touched to become a target button and then dragged, so that the shape of the object can be deformed.

When it comes to object transformation, it is possible to perform more precise work with a finger touched on the touch pad than with a mouse.

In the situation where the mouse pointer is moved with the mouse, in a normal case, the mouse pointer movement distance is set to be 5 times larger than the mouse movement distance, so it is not suitable for precise work. If it is performed with a finger touched on the touch pad, it is suitable for precise work because it can work with the concept that the finger movement distance and the mouse pointer movement distance are the same.

In addition, in achieving the above effect, in the process of multi-touching, the target button can be recognized even if multi-all touch is performed. Among the target button recognition methods, in particular, the user by the target button recognition method by the reference finger The convenience of the product is greatly improved, and the number of possible operations and convenience are rapidly increased when the multi-touch operation method is combined, especially, the multi-all on-and-off method.

1 is a diagram showing a 5X4 keyboard on a touch screen including a 3X4 keyboard (allocated to special characters),
2 is a view showing an electronic device showing a special character assigned with a general character by dedicating a portion of the display screen in relation to the physical buttons are mounted;
3 is a view showing a 5X4 keyboard to which a method of recognizing a target button using an open finger is also applicable.
4 is a diagram showing a 4X4 keyboard to which a method of recognizing a target button by a reference finger is applicable;
5 is a diagram showing an input keyboard in a 3X4 type Japanese hiragana input mode;
6 is a diagram showing a state in which five characters of hiragana (refer to the upper figure) and katakana (refer to the lower figure) assigned to each button are popped up;
7 is a diagram illustrating a conventional English QWERTY keyboard (the method of the present invention is also applicable),
8 is a diagram illustrating an improved English QWERTY keyboard to which the present invention is applicable in which two characters are assigned to one button;
9 is a diagram illustrating a conventional Korean QWERTY keyboard (the method of the present invention is also applicable),
10 is a diagram illustrating an improved Korean QWERTY keyboard to which the present invention is applicable in which two characters are assigned to one button;
11 is a diagram illustrating an improved English QWERTY keyboard to which the present invention is applicable in which three characters are assigned to one button;
12 is a diagram illustrating a Cheonjiin keyboard, which is one of 3X4 keyboards for Korean input;
13 is a diagram showing a state in which five vowels A, E, I, O, U, which are additionally input together with S and S assigned to the target button, are popped up (Example of operation after touch:'Multi All On&Off ','Multi-all drag'),
14 is a diagram for reference in memorizing drag directions related to A, E, I, O, U that are additionally input along with S assigned to a target button;
15 is a diagram provided for explanation of a process in which the English word "SAME" is input;
16 is a diagram provided for explanation of a process in which the English word "BEAUTIFUL" is input;
17 is a diagram showing a state in which T, S, N, and R additionally inputted together with S and S assigned to the target button are popped up (example of operation after touch:'single drag').
FIG. 18 is a diagram referred to for memorizing drag directions related to T, S, N, and R that are additionally input along with S assigned to a target button;
19 is a diagram showing a state in which H, D, L, and C additionally input together with S and S assigned to the target button are popped up (Example of operation after touch:'Single touch and then multi-all drag')
FIG. 20 is a diagram for reference in memorizing drag directions related to H, D, L, and C that are additionally input along with S assigned to a target button;
21 is a diagram showing a state in which? (Question mark),. (Dot),, (comma),! (Exclamation mark) that are additionally input together with S and S assigned to the target button are popped up (Example of operation after touch: 'Multi-Not All-Nick-Based Finger Drag'),
22 is a diagram showing a state in which W and Y additionally input together with S and S assigned to the target button are popped up (Example of operation after touch:'Multi-not all standard finger drag'),
23 is a diagram for reference in memorizing drag directions related to W and Y that are additionally input together with S assigned to a target button;
FIG. 24 is a diagram provided for explaining a method in which characters are continuously additionally input whenever dragging is performed twice or more in a row in the same direction or by changing the dragging direction;
25 is a block diagram of an electronic device to which the present invention is applicable.
Fig. 26 is a view compared to Figs. 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, and 37;
27 is a view in which only the vertical length is enlarged while the horizontal length is not changed and the center point of the object is moved upward, compared to FIG. 26;
FIG. 28 is a view in which the horizontal length is not changed, and the center point of the object is moved upward, and only the vertical length is reduced compared to FIG. 26;
29 is a view in which only the horizontal length is enlarged while the vertical length is not changed and the center point of the object is moved to the right, compared to FIG. 26;
FIG. 30 is a view in which the vertical length is not changed, and the center point of the object is moved to the right, and only the horizontal length is reduced compared to FIG. 26;
31 is a view in which the horizontal and vertical lengths are enlarged while the center point of the object is moved to the upper right, compared to FIG. 26;
Fig. 32 is a view in which the horizontal and vertical lengths are reduced while the center point of the object is moved to the upper right side, compared to Fig. 26;
33 is a view in which the horizontal and vertical lengths are enlarged while the center point of the object is moved to the lower right compared to FIG. 26;
Fig. 34 is a view in which the horizontal and vertical lengths are reduced while the center point of the object is moved to the lower right side compared to Fig. 26;
FIG. 35 is a view in which the center point of the object is not moved, the horizontal length is not changed, and only the vertical length is enlarged compared to FIG. 26;
FIG. 36 is a view in which the center point of the object is not moved, the vertical length is not changed, and only the horizontal length is enlarged compared to FIG. 26;
37 is a view in which the vertical and horizontal lengths are enlarged while the center point of the object is not moved compared to FIG. 26;
38 is an exemplary diagram before an object is activated
FIG. 39 is an exemplary view showing a boundary line of an active area in a rectangular shape after the object is activated, and eight enlargement/reduction control points and one rotation control point when an object is activated by a conventional method.
FIG. 40 is a diagram illustrating that when an object is activated by a conventional method, the mouse pointer is changed to a left and right double-headed arrow when the mouse pointer is placed on an enlargement/reduction control point in the middle of the right vertical side of the boundary of the active area of the object;
FIG. 41 is a diagram illustrating that when an object is activated by a conventional method, the mouse pointer is changed to an up and down bidirectional arrow when the mouse pointer is placed on an enlargement/reduction control point in the middle of the lower horizontal side of the boundary of the active area of the object;
FIG. 42 illustrates that when an object is activated by a conventional method, the mouse pointer is changed to a diagonal double-headed arrow when the mouse pointer is placed on an enlargement/reduction control point of the vertex of the lower right of the boundary line of the object's active area. drawing,
FIG. 43 is a diagram illustrating that when an object is activated by a conventional method, the mouse pointer is changed to a rotation arrow when the mouse pointer is placed on a rotation control point above the boundary line of the active area of the object;
44 illustrates a situation in which the index finger is recognized as the reference finger (= the point where the index finger was touched is recognized as the reference touch point), and a situation in which the index finger and the middle finger are multi-touched with the index finger and the middle finger so that the button S touched by the index finger is recognized as a target button. Drawing (the index finger touches button S, the middle finger touches any point to the right of the point touched by the index finger),
45 is a diagram illustrating subdividing the same object or an active area of an object into various target ranges;
46 is up, down, left and right. It is a figure which exemplifies ranges in the upper right, lower right, upper left, lower left, upper right, and lower right directions.
Among the drawings below, FIGS. 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 63, 64, 65, and 66 , FIG. 67 is a diagram of a keyboard of another form different from the above drawing to which the method of the present application can be applied.
54, 55, 56, 57, 58, 63, and 64 are used together when FIGS. 47, 48, 49, 50, 51, 52, and 53 are actually applied to the device. I tried adding a function button that can be done.
Fig. 47 is a diagram illustrating a Japanese keyboard to which the method of the present application can be applied. (Function buttons are omitted to make the point stand out).
48 is a diagram illustrating an English keyboard 1 to which the method of the present application can be applied. (Function buttons are omitted to make the main point stand out).
49 is a diagram illustrating an English keyboard 2 to which the method of the present application can be applied. (Function buttons are omitted to make the main point stand out).
Fig. 50 is a diagram illustrating an English keyboard 3 to which the method of the present application can be applied. (A function button is omitted to make the main point stand out).
FIG. 51 is a diagram illustrating an English keyboard 4 to which the method of the present application can be applied. (Function buttons are omitted to make the main point stand out).
Fig. 52 is a diagram illustrating a Korean keyboard 1 to which the method of the present application can be applied. (Function buttons are omitted to make the main point stand out).
Fig. 53 is a diagram illustrating a Korean keyboard 2 to which the method of the present application can be applied. (Function buttons are omitted to make the point stand out).
FIG. 54 is a diagram illustrating that function buttons that can be used together are added when FIG. 47 (Japanese) is actually applied to a device.
FIG. 55 is a diagram illustrating that function buttons that can be used together are added when FIG. 48 (English (1)) is actually applied to a device.
FIG. 56 is a diagram illustrating that function buttons that can be used together are added when FIG. 49 (English (2)) is actually applied to a device.
FIG. 57 is a diagram illustrating that function buttons that can be used together are added when FIG. 52 (Hangul (1)) is actually applied to a device.
58 is a diagram illustrating that function buttons that can be used together are added when FIG. 53 (Hangul (2)) is actually applied to a device.
(The blank button to which the rightmost character of FIGS. 1, 3, 4, 8, 10, 11, and 12 is not assigned is not any button that must be touched during multi-touch, but multi-touch If there is a free space necessary for (not necessarily a button and can be treated as a blank), it is only a button shape even though it is a sufficient seat, and Figs. 54, 55, 56, 57, 58, 63, 64, 65, 67, and 68 may be replaced with function buttons, and, FIGS. 54, 55, 56, 57, 58, 63, 64, 65, 67, When the functions of the function buttons in FIG. 68 are applied to an actual device, new functions may be added or some functions may be deleted.)
59 shows the index finger so that the index finger is recognized as a reference finger in the improved English QWERTY keyboard of FIG. 8 (= the point where the index finger was touched is recognized as the reference touch point), and the button QW touched by the index finger is recognized as a target button. It is a diagram illustrating a situation in which two multi-touch with the middle finger (the index finger touches the button QW, and the middle finger touches any point to the right of the point touched by the index finger).
60 is a diagram illustrating an English QWERTY keyboard in a conventional tablet PC.
61 is a diagram illustrating a Korean QWERTY keyboard in a conventional tablet PC.
FIG. 62 is a diagram illustrating a state in which drag is completed (multi-all) to the right by multi-touching in the state of FIG. 44;
FIG. 63 is a diagram illustrating another type of Korean keyboard (Hangul (3)) slightly different from FIG. 57 or FIG. 58.
FIG. 64 is a diagram illustrating another type of Hangul keyboard (Hangul (4)) slightly different from FIG. 57 or FIG. 58.
In the following figures of FIGS. 65, 66, 67 and 47 to 64, different points of the drawings excluding the QWERTY keyboard will be described,
In the drawings excluding the QWERTY keyboard among the drawings of FIGS. 47 to 64, phonemes are assigned in the order of standard enumeration when memorizing phonemes in Japanese, English, and Korean. It was difficult to know in advance whether the desired character was assigned to the 1st or 2nd of each button, so whether it will be input by single-touch or multi-touch.
In Figure 65, Figure 66, Figure 67 phonemes in the first half of the standard open net was assigned to the first of each button, it is in the second half to double the second of each button, that even did not memorize the keyboard, to input There may be an effect that makes it easier to know in advance whether a phoneme will be input by single touch or multi touch.
To explain it in more detail, it is as follows.
Figure 65 illustrates that out of the English alphabets A to Z (26), A to M (13) are assigned as the first letter of each button, and N to Z (13) are assigned as the second letter of each button. It is a drawing. (Compared with Fig. 55. For the effect, refer to the above description section of Figs.
Fig. 66 shows 10 representative letters of 50 Japanese phonemes (あかさたなはまやらわ) and 5 representative letters of the first half (あかさたな) and four letters of each representative character are 1 of each button. The first letter is assigned, and the 5 representative letters in the second half (はまやらわ) and the four letters attached to each representative letter are illustrated as the second letter of each button.) (Compared with Fig. 47. The effect is 65, 66, 67 after FIG. 64)
67 illustrates that among the basic Korean consonants ㄱ~ㅎ (14), ㄱ~ㅅ (7) are assigned as the first letter of each button, and ㅇ~ㅎ (7) are assigned as the second letter of each button. (Compared with Fig. 57. For the effect, see the above description of Figs.
8, 10, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 63, 64, 65 , In a state in which a plurality of characters are assigned to the same button including FIGS. 66 and 67, the characters in a specific order including the second character are displayed in different colors, including red, or in a different order, such as in thick letters. It is also possible to make it easier to determine the input method, including whether the character to be input is to be input by single-touch operation or multi-touch operation by making the order of the characters immediately conspicuous.

Hereinafter, a detailed description of preferred embodiments of the present invention will be described with reference to the accompanying drawings. In describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted.

And, unless otherwise noted, it would be nice to assume that the right hand was used.

First, introduce the table of contents to be described later.

1. Definition of terms

1.1. Definition of other terms

1.1.1. touch screen

1.1.2 Touch Button

1.1.3. text

1.1.4. finger

1.1.5. Qwerty Keyboard

1.1.6. ON

1.1.7. OFF

1.1.8. ON&OFF

1.1.9. drag

1.1.10. X coordinate

1.1.11. Y coordinate

1.1.12. Goal button

1.1.13. Reference finger (= reference touch point)

1.1.14. NOT reference finger (=NOT reference point)

1.1.15. Target range

1.1.16. Target point

1.1.17. Hit point

1.1.18. Situation before final operation

1.1.19. Final manipulation,

1.1.20. Operation after touching details

1.2 Definition of terms for drag direction

1.2.1. Straight drag

1.2.2. Drag back into place

1.2.3 Shape Drag

1.3. Definition of terms for drag length

1.3.1. Short drag

1.3.2. Long drag

1.4. Definition of terms for touch

1.4.1.. Definition of terms for single touch

1.4.1..1. Single touch

1.4.2.. Definition of terms for multi-touch

1.4.2..1. Multi-touch

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 Multi Not All Touch

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

1.5. Definition of terms for post-touch operation

1.5. Operation after touch

1.5.1.. Definition of terms for operation after single touch

1.5.1..1. Operation after single touch

1.5.1..2. Single on&off

1.5.1..3. Single drag

1.5.1..4. Single power strip

1.5.2.. Definition of terms for operation after multi-touch

1.5.2..1. Operation after multi-touch

1.5.2..2. Multi on&off

1.5.2..3. Multi All On&Off

1.5.2..4. Multi Not All On&Off

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi Not All Drag

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

1.5.2..12. Multi power tap

1.5.2..13. Definition of terms for manipulation after multi-touch with open fingers

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

1.5.2..14. The most recommended multi-touch post-operation

1.5.2..14.1. Most Recommended Multi On&Off

1.5.2..14.2. Most Recommended Multi Drag

1.5.3...Operation after single-touch and multi-touch

1.6. Definition of terms for target button recognition method

1.6.1.. Recognition method of target button by reference finger (=Recognition method of target button by reference touch point)

1.6.1..1 Target button recognition method by the reference finger according to the X coordinate value order (= target button recognition method by the reference touch point according to the X coordinate value order)

1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)

1.6.1..3 Method of recognizing target button by reference finger according to the order of X coordinate values according to the number of multi-touch (=Recognition method of target button by reference touch points according to the order of X coordinate values according to the number of multi-touch)

1.6.1..4 Target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number)

1.6.2.. Recognition method of target button by open finger (=Recognition method of target button by open touch point)

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

1.6.3.. Target button recognition method by range including two or more touch points

1.6.4.. Mixed use

2. Synthesis

3. How to input characters on the touch screen

4. How to manipulate objects

5. Electronic equipment to which the present invention is applicable

Now let's get to the point.

1. Definition of terms

1.1. Definition of other terms

1.1.1. touch screen

It is a concept of all screens capable of recognizing touches including laser pads and hologram pads, as well as general touch screens, as a virtual graphic button, not a keypad equipped with a physical button, can be displayed and selected.

1.1.2 Touch Button

This concept includes not only virtual graphic buttons that appear on the touch screen, but also all objects that the user can touch and appear on the touch screen including photos, pictures, browsers, and windows. When an object becomes a target button, the target button may also be referred to as a target object.

1 illustrates a touch screen in which touch buttons are arranged, and FIG. 2 illustrates an electronic device in which a touch screen and physical buttons are arranged together. The technical idea of the present invention is applicable not only to the case where only touch buttons are used as shown in FIG. 1, but also to the case where both touch buttons and physical buttons are implemented.

1.1.3. text

It is a comprehensive concept that means everything that can be input, including not only characters expressing general language, but also symbols including punctuation marks, special characters, and special characters including pictograms.

In addition, the concept of'character' in the whole of the present application does not have the concept of the general character as described above, but functions for executing any command other than the character for inputting a character assigned to a certain button (or icon), examples. listen,

Includes text deletion function in character input mode, line break function, space function, Korean/English conversion function and various setting functions in non-character input mode, and application execution functions in various application icons on the desktop of the smartphone. This includes the concept of a specific function assigned to any button (or icon). So, with such a function in mind, inputting text is the same as executing a function, so it should be understood that way.

1.1.4. finger

The concept includes not only a finger of a person performing a touch on the touch screen, but also a tool used to touch the touch screen, such as a stylus pen.

In addition, throughout the entire contents of the present application, the word finger is a concept that, from the point of view of a device, can also include a touch point touched by a finger.

so. In the entire contents of the present application, the word'finger', which is a word mainly used from the point of view of the user, can be replaced with'the touch point where the finger was touched' or'the touch point by the finger' or'touch point' from the point of view of the device. many. For example, the word'index finger' may be interpreted only as the meaning of the word'index finger' itself, but it can be replaced with'touch point by which the index finger was touched' or'touch point by the index finger' or'touch point'. There are many cases. In particular, the word finger in the term defined in the definition of the term is often the same term even if it is replaced with the word touch point.

That is, throughout the present application including the claims, the word of the concept of a finger, including a finger or an index or middle finger, is mainly used and described in the user's perspective, and rights are claimed, but the contents of the device are described as in the above and the following description. Even if it is changed into a statement from the standpoint, it should be regarded as being explained or claimed. (There are actually parts that have been explained or claimed to have been changed, but it is so natural that there are many parts that could not be explained or changed to claim rights. But In addition, parts that cannot be explained in any way or that cannot be claimed in a way should be regarded as above.)

So, as the phrase containing the word finger is changed to a phrase containing the word touch point, which is a phrase from the point of view of the device, even words used before or after the word finger can be changed according to the situation. It should also be regarded as being explained or claimed.

This is also because the device doesn't know which finger the person's finger touched.

for example,

The phrase'multi-touch with the index and middle finger' can be changed to the phrase'multi-touch by a certain touch and another touch point' or'multi-touch with two touch points' or a phrase with the same meaning. There is,

The phrase'the first touched finger is recognized as the reference finger, and the later touched finger is recognized as the sickle reference finger' means'the touch point touched first is recognized as the reference touch point, and the touch point touched later is the sickle reference point. It can be changed to the phrase'recognized' or a phrase that has the same meaning,

The phrase'when the index finger, which is the reference finger is touched first, and then the middle finger, which is the reference finger of the sickle, is touched later' is the phrase'when the reference touch point is touched first and then the sickle reference point is touched later' Can be changed to,

The phrase'touched finger' can be changed to the phrase'(touched) touch point' or a phrase with the same meaning,

The phrase'points where the fingers touched' can be changed to the phrase'(touched) touch points' or a phrase with the same meaning.

1.1.5. Qwerty Keyboard

Originally, it refers to an English computer keyboard standard keyboard with character assignments in the order of Q, W, E, R, T, and Y in the English keyboard, but in this application, any character in the world is a standard keyboard layout in each country's computer keyboard. It refers to the keyboard including the order of letter assignment in Most of the conventional QWERTY keyboards are assigned one letter per button. In addition, it is a concept including an improved QWERTY keyboard as shown in FIGS. 8, 10, and 11.

7, 8, 11, and 60 are examples of the English QWERTY keyboard, and FIGS. 9, 10, and 61 are examples of the Korean QWERTY keyboard.

1.1.6. ON

(Touch screen) refers to being touched, that is, touching a finger on the touch screen.

1.1.7. OFF

It refers to the release of the touch (at the touch point), that is, the falling of the finger from the touch screen.

1.1.8. ON&OFF

Refers to an operation in which a touch point is not dragged after being'on', but is immediately turned off.

1.1.9. drag

Refers to an operation in which the touch point is moved to another point while maintaining the'on' state. There are various drags including'straight drag','return drag', and'shape drag', and detailed descriptions of these will be described later.

And, throughout the present application,'drag' or'drag' includes most of the drag action itself as well as'drag and off'.

1.1.10. X coordinate

It is a coordinate on the horizontal axis indicating a specific point on the touch screen.

1.1.11. Y coordinate

It is a coordinate on the vertical axis indicating a specific point on the touch screen.

1.1.12. Goal button

When a user attempts to perform a specific task by'operation after touch', which will be described later, it refers to a button directly related to the specific task. That is, it refers to a specific button targeted by the user.

1.1.13. Reference finger (= reference touch point)

It refers to a finger that is a reference for the device to recognize a target button among multi-touched fingers. In a normal case, the finger touched on the target button is the reference finger.

From the perspective of the device, it refers to a touch point that is a reference for the device to recognize a target button among the multi-touched touch points, that is, a touch point touched on the target button.

1.1.14. NOT reference finger (=NOT reference point)

Refers to at least one finger other than the reference finger among the multi-touched fingers.

From the perspective of the device, it refers to at least one touch point other than the reference touch point among the multi-touched touch points.

1.1.15. Target range

It is a concept that is mainly needed when operations related to objects such as photos, pictures, and browsers are performed.

When a user attempts to perform a specific task by'touch-and-touch operation', which will be described later, a specific range within an object (or object activation area boundary) directly related to the specific task, that is, a specific range targeted by the user Refers to.

For example, in a single touch, a range including a point actually touched is recognized as a target range, and in a method of recognizing a target button by a reference finger, a range including a point actually touched by the reference finger is recognized as the target range.

For another example, as the center point of the object is moved, the length of the left vertical side, the length of the right vertical side, and the position of the left vertical side of the object are not changed, and the position of the right vertical side of the object is changed. The right range of the vertical line passing through the center point of the object (or the object active area boundary) among the points inside the object (or the object active area boundary line) is recognized as the target range in order to make the work of extending the length of the lower and the lower side equally to the right. It can also be multi-touched and dragged to the right as possible.

1.1.16. Target point

When a user attempts to perform a specific operation by'touch-and-operate', which will be described later, a button or object directly related to the specific operation (or object activation area boundary), that is, a specific point inside the user's target. It refers to a specific point to do.

For example, in the case of a single touch, it refers to a point that the user intended to touch, and in the method of recognizing a target button by a reference finger, it refers to a point where the reference finger was intended to be touched.

For another example, as the center point of the object is moved, the position of the lower left vertex of the object does not change, and the length of the upper horizontal side, the lower horizontal side, the left vertical side, and the right vertical side of the object is enlarged. , Among points inside the object (or object activation region boundary line), the upper right vertex of the object (or object activation region boundary line) may be multi-touched to be recognized as a target point, and then dragged in the upper right direction.

1.1.17. Hit point

It is also a specific point necessary for the device to recognize the target button or target range, and is a specific point calculated by at least one touch point actually touched, and the range including the hit point is recognized as the target range or target button. I can.

For example, in the case of single touch, the point where the single-touched finger is actually touched is the hit point, and in the target button recognition method by the reference finger, the point where the reference finger is actually touched is the hit point.

1.1.18. The situation before the final operation,

1.1.19. Final manipulation,

1.1.20. Operation after touching details

The situation before the final operation, the final operation, and the operation after the detailed touch are closely related to each other, so I will explain them all at once.

The situation before the final operation refers to the situation in the process of performing the operation after the (detail) touch, until just before the final operation begins.

The final operation is a process that follows the situation before the final operation, and is the last operation to complete the operation after the (detail) touch. For example, drag in various directions including off or up, down, left, back, top left, bottom left, top right, or bottom right, two or more consecutive drags (the drag direction may change), long drag, short drag There is.

The operation after the detailed touch is the sum of the situation before the final operation and the final operation. In short, as detailed contents of the post-touch operation related to the target button, if the operation behavior related to the target button is not the same, the operation after the detailed touch is different. The operation after a detailed touch can also be expressed simply as a detailed operation or operation (or operation after a multi-touch).

To give a comprehensive example of the situation before the final operation, the final operation, and the operation after a detailed touch,

In the operation after five detailed touches: single on&off and single drag in 4 directions, up, down, left, and right, starting with a single touch, five final operations start with off or drag in 4 directions. Since the situation just before the beginning is the same for all the five detailed touch and post operations, all the five detailed touch and post operations are the same operation before the final operation,

In the operation after five detailed touches: Multi All On & Off and Multi All Drag in each of the 4 directions, up, down, left, and right, starting with 2 multi-touch, there are 5 final types of off or drag in 4 directions. Since the situation just before the start of the operation is the same for all the five detailed touch and post operations, all the five detailed touch and post operations are the same operation before the final operation,

2 Start with multi-touch, multi-not all reference finger on & off, and multi-not all reference finger drag in each of the four directions up, down, left, and right. Since the situation just before the start of the five final manipulations called drag is the same for all the 5 detailed touch-and-touch operations, all of the five detailed touch-and-touch operations are the same before the final operation.

After single-touch, 2 multi-touch, then multi-all on & off, and after 2 multi-touch after each single touch in 4 directions. Since the situation until just before the five final operations, called dragging, are the same for all the five detailed touch and post operations, all of the five detailed touch and post operations are the same operation before the final operation.

However, the situation before the final operation is not the same for the multi-all on&off starting with 2 multi-touch and the multi all on&off starting with 3 multi-touch, so the situation before the final operation is different. It is the operation after touch, and as a result, the operation after the third tooth becomes different,

The situation before the final operation of dragging upwards is not the same until the final operation of dragging upwards, starting with 2 multi-touch and multi-all dragging upwards starting with 3 multi-touch, so the situation before the final operation is not the same. It is an operation after a different detailed touch, and as a result, the operation after a third tooth becomes different.

And, even if it starts with 2 multi-touch, the process of multi-touch is multi-all on&off while multi-all touch and multi-all on&off while multi-not all-touch is the final operation. Since the situation just before the start of this is not the same, the situation before the final operation is different after the detailed touch operation, and as a result, the operation after the three starts is different,

And, the final operation here refers to the last operation that is turned off or dragged (first) in the first full-fledged operation after being touched. In the content to be described later, dragging two or more times in a row in the same direction or dragging It doesn't mean the final manipulation of the way the direction changes, causing additional characters to be entered in succession each time it is dragged.

1.2 Definition of terms for drag direction

1.2.1. Straight drag

Refers to a drag made in one straight direction including left (west), right (east), up (north), down (south), right down (southeast), left down (southwest), up right (northeast), and up left (northwest) direction. do.

1.2.2. Drag back into place

It refers to a drag that is dragged in a straight line in one direction and then dragged back to its original position without being turned off.

1.2.3 Shape Drag

It refers to a drag made in multiple directions, not just a straight line, such as a circle, a semicircle, a triangle, or a square.

1.3. Definition of terms for drag length

1.3.1. Short drag

It refers to dragging below a certain (coordinate) length. Here, the constant (coordinate) length can be determined by the horizontal or vertical length of the two touch buttons, but it is also possible to set differently.

1.3.2. Long drag

It refers to dragging beyond a certain (coordinate) length. In the present specification, a'drag' that is not specifically marked as a'long drag' may be regarded as a'short drag'.

1.4. Definition of terms for touch

1.4.1.. Definition of terms for single touch

1.4.1..1. Single touch

It refers to touched so that only one finger is touched. In general, single touch is implemented by touching the target button with the index finger among five fingers.

From the point of view of the device, it refers to a touch so that only one touch point is touched.

1.4.2.. Definition of terms for multi-touch

1.4.2..1. Multi-touch

It refers to touched so that there is a state in which two or more fingers are touched.

From the point of view of the device, it refers to a touch so that a state in which two or more touch points are touched exists.

As for the point at which the device starts to determine one (unit) single touch or one (unit) touch including multi-touch, when there are no touch points, the touch point is newly touched. If it occurs and the newly generated touch point is turned off without generating additional touch after the point of touch, it can be judged that the operation after the touch was made only with a single touch, and the newly generated touch point has been touched until now. In a state in which none of the touched touch points are turned off, that is, each time another new touch occurs while maintaining the touch states of all touch points that have been touched so far, any of the various multi-touch methods described below can be used. It can be made to judge whether it is multi-touch.

For reference, in the embodiment of the present application as a whole, if it is not specified whether the hand to be used is a right hand or a left hand, it may be regarded as a right hand.

1.4.2..2. n Multi-touch

It refers to multi-touch so that there is a state in which n fingers are touched. (From the point of view of the device, it refers to multi-touch so that there is a state in which n touch points are touched.)

For example,

1) Two multi-touch is multi-touch so that there is a state in which two fingers (= touch point) are touched,

2) 3 multi-touch is multi-touch so that there is a state in which three fingers (= touch points) are touched,

3) 4 multi-touch refers to multi-touch so that there is a state in which four fingers (= touch points) are touched.

In the present application, n multi-touch or multi-touch is considered to be multi-touched in a multi-all-touch state to be described later, or as such an embodiment, unless there is any particular mention or suggestion of which multi-touch method among various multi-touch methods to be described later. It is recommended to regard it as, but it is not necessarily limited to interpreting it as it is.

1.4.2..3. Multi all touch

As a type of multi-touch, in the case of multi-touch, the time difference between the time when the first touched finger is turned on and the time when the last touched finger is turned on is less than a certain time (e.g., 0.1 seconds), and multi-touch is performed almost simultaneously. Refers to the multi-touch of the case.

(From the point of view of the device, it is a type of multi-touch, and in the case of multi-touch, the time difference between the time when the first touched point is turned on and the time when the last touched point is turned on is less than a certain period of time (e.g., 0.1 seconds). Refers to multi-touch when multi-touch is performed almost at the same time.)

For example, in two multi-touch with the index and middle fingers, for example, the middle and index fingers are, in fact, touched on the touch screen at the same time. In this case, even if the middle finger is touched on the touch screen before the index finger, if the time difference between the time when the middle finger is touched and the time when the index finger is touched is 0.1 seconds or less, the case is recognized as a multi-all touch between the middle finger and the index finger. .(For two multi-touch with the index finger and middle finger, it would be the case that the middle finger and the middle finger are operated with the intention of touching the touch screen at the same time.)

1.4.2..4 Multi Not All Touch

It is a type of multi-touch. In the case of multi-touch, it refers to a multi-touch in which the time difference between the time when the first touched finger is turned on and the time when the last touched finger is turned on exceeds a certain time (e.g., 0.1 seconds). (From the device's point of view, it is a type of multi-touch. In the case of multi-touch, the time difference between the time when the first touched point is turned on and the time when the last touched point is turned on is a certain amount of time (e.g. 0.1 seconds). Refers to the multi-touch exceeding .)

These include'Multi Not All Standard Finger Touch','Multi Not All Not Standard Finger Touch', and'Multi Not All Standard Finger Change Touch', which will be described later.

For example, in the case of two multi-touch with the index finger and middle finger, the middle finger is touched on the touch screen before the index finger, and the time when the stop is turned on exceeds the time when the index finger is turned on by exceeding a certain amount of time (e.g. 0.1 seconds). Is included here.

Since multi-not all-touch is not recommended unless it is a special case, it is not recommended to separately apply multi-not all-touch and multi-not all-touch when applying the method of the present application to an actual device.

1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)

It is a type of multi-not all-touch, and refers to a case where the reference finger is first touched, and then the sickle reference finger is touched later. That is, it refers to a case where the first touched finger is recognized as the reference finger, and the touched finger later is recognized as the sickle reference finger.

(From the perspective of the device, it is a kind of multi-not all-touch, which refers to a case where the reference touch point is touched first, and then the sickle reference touch point is touched later. That is, the touch point touched first is recognized as the reference touch point, and It refers to a case in which the touch point touched later is recognized as the sickle reference touch point.)

For example, in the case where the index finger is recognized as the reference finger and the middle finger is multi-touched with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, the index finger is touched after the index finger (the reference finger) is touched, and the middle finger (the sickle reference finger) is touched. This includes the case where the time difference between the time at which is touched and the time at which the stop is touched exceeds a certain time (eg 0.1 seconds).

1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)

It is a kind of multi-not all-touch, and refers to a case where the reference finger of the sickle is touched first, and then the reference finger is touched later. That is, it refers to a case where the first touched finger is recognized as the sickle reference finger, and the touched finger later is recognized as the reference finger.

(From the device's point of view, it is a kind of multi-not all-touch, which refers to a case where the sickle reference touch point is touched first and then the reference touch point later. That is, the touch point touched first is recognized as the sickle reference touch point. , Refers to a case in which the touch point touched later is recognized as the reference touch point.)

For example, when the index finger is recognized as the reference finger and the middle finger is multi-touched with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, the middle finger, which is the sickle reference finger, is touched, and then the index finger, which is the reference finger, is touched later. , This includes the case where the time difference between the time when the middle finger is touched and the time when the index finger is touched exceeds a certain time (eg 0.1 seconds). Even if the index finger, which is the reference finger, is touched later, the button containing the touch point to which the index finger was touched maintains its position as the target button.

1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)

It is a type of multi-not all-touch, which refers to a touch when a finger touched in a predetermined sequence is recognized as a reference finger, and is actually included in'multi-not all touch', and'multi-not all-reference finger touch' or The concept of'multi-not all-not standard finger touch' is also part of the concept.

(From a device's point of view, it is a kind of multi-not all-touch, which refers to a touch when a touch point touched in a predetermined sequence is recognized as a reference point. The concept of'Multi Not All Not Standard Touch Point Touch' or'Multi Not All Not Standard Touch Point Touch' is a concept that has some of the concepts.)

For example,

1) Designated so that the first touched finger (= touch point) is recognized as the reference finger (= reference touch point), or

2) Designated so that the second touched finger (= touch point) is recognized as the reference finger (= reference touch point), or

3) Designated so that the third touched finger (= touch point) is recognized as the reference finger (= reference touch point), or

4) The fourth touched finger (= touch point) may be designated to be recognized as a reference finger (= reference touch point).

If the index finger is touched before the middle finger in 2 multi-touch by the index finger and middle finger,

1) If the first touched finger is designated as the reference finger, the first touched index finger becomes the reference finger,

2) If the second touched finger is designated as the reference finger, the second touched middle finger becomes the reference finger.

1.4.2..8. Definition of terms for multi-touch with open fingers

1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)

It is a concept that is almost the same as the definition of the term of'multi-touch',

However, when the definition of the term'multi-touch' is understood, the'target button recognition method using an open finger' to be described later is only a concept applied as the target button recognition method.

1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)

As a concept almost the same as the definition of the term'n multi-touch',

However, when the definition of the term'n-multi-touch' is understood, the'target button recognition method using an open finger' to be described later is only a concept applied as the target button recognition method.

1.4.2..8.3. Multi-all touch by open finger (=multi-all touch by open touch point)

It is a concept that is almost the same as the definition of the term of'multi-all touch',

However, when the definition of the term'multi-all touch' is understood, the'target button recognition method using an open finger' to be described later is only a concept applied as the target button recognition method.

1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)

It is almost the same as the definition of the term'multi not all touch',

However, when the definition of the term'multi-not all touch' is understood, the'target button recognition method using an open finger', which will be described later, is only a concept applied as the target button recognition method.

Since multi-not all-touch with open fingers is not recommended except in special cases, when applying the method of the present application to an actual device, it is recommended to separately apply multi-not all touch with open fingers and multi-not all touch with open fingers. Not recommended.

1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)

It is a concept that is almost the same as the definition of the term'multi-not all standard finger touch',

However, when the definition of the term'multi-not all-reference finger touch' is understood, the'target button recognition method by open finger', which will be described later, is applied as the target button recognition method. In the definition of the term, the phrase reference finger (= reference touch point) is replaced by the leftmost finger (= touch point), and the phrase sickle reference finger (= reference touch point) is the finger touched on the rightmost It is just a concept replaced by (=touch point).

1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point)

It is almost the same as the definition of the term'multi-not all-not standard finger touch',

However, when the definition of the term'multi-not all-reference finger touch' is understood, the'target button recognition method by open finger', which will be described later, is applied as the target button recognition method. In the definition of the term, the phrase reference finger (= reference touch point) is replaced by the leftmost finger (= touch point), and the phrase sickle reference finger (= reference touch point) is the finger touched on the rightmost It is just a concept replaced by (=touch point).

1.5. Definition of terms for post-touch operation

1.5. Operation after touch

It is a term that includes'operation after single-touch' and'operation after multi-touch', which will be described later.

1.5.1.. Definition of terms for operation after single touch

1.5.1..1. Operation after single touch

'Single on&off','single drag', and'single multi-tap', which will be described later, are included in the operation after a single touch.

Post-single-touch operation refers to only the final operation, i.e., any operation in which subsequent movements are additionally performed after the single touch, but (there is almost no such case), including the moment of single touch before any operation after the single touch. It is a term that can be used in the sense of saying.

So, it can be misunderstood as being operated by being single-touched again after being single-touched, including being described as being single-touched and then single-on and off, or single-touched and then single-drag. Since the description may be misunderstood as occurring twice, or the content claimed in the claim is only mentioned so as to aid understanding, the single touch should be interpreted as occurring only once.

For example,

The expression of single on/off after being single-touched with the index finger means that the index finger is turned off without being dragged after being single-touched with the index finger, i.e., being single-touched and single on and off, or starting with a single touch. Means being single on & off,

The expression that the index finger is single-touched and then dragged upward means that after the index finger is single-touched, the index finger is not turned off, and the index finger is dragged upward while the index finger is touched. In other words, it refers to a single drag upwards while a single touch is performed or a single drag upwards starting with a single touch.

In other words, the expression of manipulation after single touch after single touch is just the same as the expression of manipulation after single touch, but it is expressed that way because the situation in which the word is used requires that type of speech.

This is because there is no need for an operation that requires a single touch twice unless it is related to'single multi-tap'.

1.5.1..2. Single on&off

It refers to an operation that is not dragged after a single touch, but is immediately turned off.

1.5.1..3. Single drag

Refers to an operation that is dragged while the finger remains in touch after a single touch. (From the perspective of the device, it refers to an operation that is dragged while the touch point remains in touch after a single touch.)

1.5.1..4. Single power strip

In general, it is a method called a multi-tap method, which refers to an operation in which the same button is continuously pressed with one finger (from a device's point of view, it is generally referred to as a multi-tap method, and the same button is continuously touched with one touch point. Losing refers to manipulation.)

1.5.2.. Definition of terms for operation after multi-touch

1.5.2..1. Operation after multi-touch

'Multi-drag','multi-on&off', and'multi-multi-tap', which will be described later, are included in the operation after multi-touch.

Operation after multi-touch refers only to any operation in which subsequent movements are additionally performed after multi-touch, but it is also meant to include the moment of multi-touch before any operation is performed after multi-touch (there is almost no such case). This is a term that can be used.

So, it can be misunderstood as being operated by multi-touching again after multi-touching, including descriptions such as multi-all on/off after multi-touch or multi-all drag after multi-touch. Since it is described so that it may be misunderstood as if the touch occurs twice, or the content claimed in the claim is mentioned so as to aid understanding, the multi-touch should be interpreted as occurring only once.

For example,

The expression of multi-all on and off after two multi-touch with the index and middle fingers means that after two multi-touch with the index and middle fingers, and without dragging, both the index and middle fingers are turned off at the same time, that is, the index and middle fingers are turned off. It refers to multi-all on & off while two multi-touch or multi-all on & off starting with two multi-touch by index finger and middle finger,

The expression of multi-all dragging upwards after two multi-touch with the index and middle fingers means that after two multi-touch with the index and middle fingers, the index and middle are not turned off, that is, detection while both the index and middle fingers are touched. Both stop and say that it is dragged upwards. That is, multi-all dragging while two multi-touching with the index finger and middle finger, or multi-all dragging starting with two multi-touching by the index and middle finger.

In other words, the expression of manipulating after multi-touch after multi-touch is just the same as that of manipulating after multi-touch, but the situation in which the word is used requires that type of speech, so it is expressed that way.

This is because there is no need for an operation that requires a multi-touch twice unless it is related to'multi-multi-tap'.

1.5.2..2. Multi on&off

One of the multi-touched fingers is not dragged, and all of them are turned off in place, including'Multi All On & Off' and'Multi Not All On & Off', which will be described later. From the standpoint, one of the multi-touched touch points is not dragged, and all of them are turned off in place. These include'Multi All On & Off' and'Multi Not All On & Off', which will be described later. do.)

For example, in the case of operation after two multi-touch with the index and middle fingers, the multi-touched middle and index fingers are not dragged, and this includes an operation that turns off all of them in place.

1.5.2..3. Multi All On&Off

When multi-touched fingers are multi-on/off, the time difference between the time when the first finger is turned off and the time when the last finger is turned off is less than a certain time (e.g., 0.1 seconds). (From the device's point of view, when multi-touch points are multi-on and off, the time difference between the time when the first off touch point is turned off and the time when the last off touch point is turned off is Refers to the multi-on & off to be less than a certain period of time (e.g. 0.1 seconds).)

For example, in the operation after 2 multi-touch with the index and middle fingers,

When the middle and index fingers are operated with the intention of turning off the touch screen at the same time, even when one of the middle and index fingers is turned off first on the touch screen and the other is turned off later, the time when the first off finger is turned off and later When the time difference from the time when the finger to be turned off is less than a certain time (eg 0.1 seconds),

To give a more detailed example, when the middle finger and the index finger are operated with the intent to turn off the touch screen at the same time, even if the middle finger is turned off on the touch screen before the index finger, the time when the middle finger is off and the time when the index finger is off. If the time difference is less than a certain amount of time (eg 0.1 seconds), it is included here.

1.5.2..4. Multi Not All On&Off

When multi-touched fingers are'multi-on & off', the time difference between the time when the first finger is turned off and the time when the last finger is turned off exceeds a certain time (e.g., 0.1 seconds). Refers to on&off. These include'Multi-Not All-Not Standard Finger On & Off' and'Multi-Not All-Not Standard Finger On & Off', which will be described later.

(From the device's point of view, when multi-touch points are'multi-on & off', the time difference between the time when the first off touch point is turned off and the time when the last off touch point is turned off is a certain amount of time (e.g. : Refers to multi-on & off exceeding 0.1 sec.)'Multi-Not All Standard Touch Point On&Off' and'Multi-Not All Not Standard Touch Point On&Off', which will be described later, are included here.)

For example, in the case that the index finger and the middle finger are operated after 2 multi-touch, one of the middle finger and the index finger is turned off first from the touch screen and the other is turned off later. If the time difference from the time when the finger is turned off exceeds a certain amount of time (eg 0.1 seconds), it is included here.

1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)

When multi-not all on and off, it refers to an operation in which the reference finger of the sickle is turned off first, and then the reference finger is turned off later. (From the perspective of the device, when multi-not all on and off, the reference point of the sickle is first turned off. After being turned off, it refers to an operation in which the reference touch point is turned off later.)

For example, the index finger is recognized as the reference finger, and the middle finger is operated after two multi-touch with the index and middle finger so that the middle finger is recognized as the sickle reference finger.The middle finger, which is the sickle reference finger, is turned off from the touch screen before the index finger, which is the reference finger. , When the index finger is turned off later, and the time difference between the time that is turned off when the stop is turned off and the time that is turned off when the index finger is turned off exceeds a certain period of time (eg, 0.1 second), it is included here.

1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)

Refers to an operation in which the reference finger is first turned off when the multi-not all is turned on and off, and then the reference finger is turned off later. (From the perspective of the device, when the multi-not all is turned on and off, the reference touch point is first turned off. It refers to an operation in which the sickle reference touch point is turned off later after being used.)

For example, since the index finger is recognized as the reference finger and the middle finger is operated after two multi-touch with the index and middle finger so that the middle finger is recognized as the sickle reference finger, the index finger, which is the reference finger, is turned off from the touch screen first than the middle finger, which is the reference finger of the sickle. , When the stop is turned off later, and the time difference between the time that is turned off when the index finger is turned on and off and the time that is turned off when the stop is turned on and off exceeds a certain period of time (e.g., 0.1 seconds), it is included here. .

Even if the index finger, which is the reference finger, is turned off first, the button containing the touch point to which the index finger was touched maintains its position as the target button.

1.5.2..7. Multi drag

Among the multi-touched fingers, one or more of the multi-touched fingers are dragged while the on-state is maintained.'Multi-All-Drag' and'Multi-Not All-Drag', which will be described later, are included here.

(From the device's point of view, one or more of the multi-touched touch points are dragged while being turned on, and'Multi-All-Drag' and'Multi-Not All-Drag', which will be described later, are included here.)

1.5.2..8. Multi All Drag

It refers to that none of the multi-touched fingers is turned off, but the entire drag starts to be dragged. (From the device's point of view, none of the multi-touched touch points are turned off, and the entirety starts to be dragged. It refers to being dragged.)

Multi-all dragging is established when all the fingers being multi-all dragged start to drag with a point in time that is moving together. Starting to be dragged from the edge of the touch screen (upper, lower, left, right, or corner area), even if at least one of the multi-all dragged fingers is turned off first due to the dragging in the edge direction, all of the first multi-touched If there was a point in time when the fingers were moving together, it is recognized as a multi-all drag.

For example, in the case that the index finger is recognized as the reference finger and the middle finger is operated after two multi-touch with the index finger and middle finger so that the middle finger is recognized as the sickle reference finger, both the middle finger, which is the sickle reference finger, and the index finger, which is the reference finger, are (not turned off). This is included in the case of dragging so that there is a viewpoint that starts to drag together.

1.5.2..9. Multi Not All Drag

This is a drag that is manipulated so that there is a point in time when at least one of the multi-touched fingers is turned off and only at least one remaining finger that is still on is started to be dragged. This includes'not all not standard finger drag'. (From the device's point of view, when at least one of the multi-touched touch points is turned off, only at least one remaining touch point that is still on is started to be dragged. As drags that are manipulated so that the viewpoint exists,'Multi-Not All-Not All Reference Touch Point Drag' and'Multi-Not All-Not Reference Touch Point Drag', which will be described later, are included here.)

The multi-not all-drag is established when the drag starts with a point in time where at least one remaining finger that has been turned on, except for the off finger, which is multi-not all-drag, is moving together. The drag started from the edge of the touch screen (top, bottom, left, right or corner area), and since it was dragged in the direction of the edge, at least one of the fingers that were still on until the multi-not all drag started was turned off first. Even so, if there was a point in time at which at least one finger was moving with the rest of the multi-not all-drag started, it is recognized as a multi-not all-drag.

For example, when the index finger is recognized as the reference finger and the middle finger is operated after two multi-touch with the index finger and middle finger so that the middle finger is recognized as the sickle reference finger, either the middle finger, which is the sickle reference finger, and the index finger, which is the reference finger, is turned off first. In, this includes the case where the remaining fingers start to be dragged and are then dragged.

1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)

Refers to a multi-not all-drag in which the reference finger starts to be dragged after at least one sickle reference finger is turned off. Refers to not all drag.)

For example, in the case that the index finger is recognized as the reference finger and the middle finger is operated after two multi-touch with the index and middle finger so that the middle finger is recognized as the sickle reference finger, the middle finger, which is the sickle reference finger, is the first among the middle finger which is the sickle reference finger and the index finger which is the reference finger. This includes a case in which the index finger, which is the reference finger, is dragged after being turned off later.

1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)

Refers to a multi-not all-drag in which at least one sickle reference finger starts dragging after the reference finger is turned off. (From the perspective of the device, at least one sickle reference touch point starts dragging after the reference touch point is turned off. Refers to not all drag.)

For example, in the case that the index finger is recognized as the reference finger and the middle finger is operated after two multi-touch with the index and middle fingers so that the middle finger is recognized as the sickle reference finger, the index finger, which is the reference finger, is first off among the middle finger, which is the sickle reference finger, and the index finger, which is the reference finger. This includes the case where the middle finger, which is the reference finger of the sickle, starts to be dragged after being dragged.

Even if the index finger, which is the reference finger, is turned off first, the button containing the touch point to which the index finger was touched maintains its position as the target button.

1.5.2..12. Multi power tap

In general, multi-tap refers to an operation of pressing a touch button several times with one finger. According to the present application, it can be said that it is a single multi-tap method.

For example, among the touch buttons shown in FIG. 1, a touch button to which A, B, and C are assigned,

1) Press once to enter A, or

2) Press 2 times to enter B, or

3) Press 3 times to input C.

On the other hand, multi-tap refers to multi-tap operation in a multi-touch method.

Specifically, the multi-tap method,

In a device equipped with a touch screen, in a method for generating a work signal for a certain task including character input or object transformation by being manipulated after multi-touch,

The operation method after the multi-touch is:

It may be a method that may be a method in which different tasks are performed depending on the number of times that multiple on&offs are performed continuously at least one or more times, and

In the case of text input using the multi-tap method,

Depending on the number of times the multi-on and off is performed at least one time in a row, the characters belonging to the target character group related to the target button are displayed while circulating, and then single-touch or multi-touch so that the other button is recognized as the target button. This method can be a method in which the displayed character is inputted definitively when the cursor is moved or a certain period of time (eg, 2 seconds) has passed. It is recommended to follow one or more of the methods in which characters are definitively input in the conventional (single) multi-tap method as a method for definitively inputting characters.

As an example of using this, even in the general text mode, the following steps 1) to 3) can be performed without changing the text mode.

Among the touch buttons shown in FIG. 1, A, B, C, and touch buttons assigned with !, ◆, / are multi-touched to become target buttons,

1) Multi All On&Off is performed once, so that the first character "!", which is the first character among the characters (!, ◆, /) assigned under A, B, and C, not A, can be entered.

2) Multi All On&Off is performed twice so that the second character "◆" among the characters assigned under A, B, and C (!, ◆, /), not B, can be entered.

3) Multi-All ON&OFF is performed 3 times, so that the third character "/" among the characters assigned under A, B, and C (!, ◆, /), not C, can be entered.

Simply put,

Among the touch buttons shown in Fig. 1, A, B, C and !, ◆, / are assigned to the target button by the index finger and the middle finger,

1) Multi-touch (precisely speaking, multi all on & off) can be performed to input the first character "!" among the characters (!, ◆, /) assigned under A, B, and C instead of A. There is,

2) Multi-touch (to be precise, multi-all on & off) is performed twice so that the second character "◆" among the characters (!, ◆, /) assigned under A, B, C, not B, can be entered. There is,

3) Multi-touch (to be precise, multi-all on & off) is performed 3 times so that the 3rd character "/" among the characters (!, ◆, /) assigned under A, B, C, not C, can be entered. have.

When the multi-tap method is used, in the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group, depending on the situation before the final operation, at least This method may be a method in which a specific character group is matched among one character group, belongs to the matched character group, and at least one character among at least one character related to the target button is input without changing the character mode. (Can also be applied to Qwerty keyboard.)

In short, without changing the character mode, at least one character belonging to a specific character group and related to the target button can be input. Here, the specific character group may be any one or more of the following.

1) Any one character group among two or more different character groups classified into different groups according to the spelling rules.

2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

Matters relating to (here 1) to 5) are covered in various places in the present application including "3. Character input method on a touch screen" and claims, which will be described later. Detailed descriptions including all explanations are omitted.)

For example, one character group may be one of two or more different character groups classified into different groups according to the spelling rule of "1)",

For example, if the current text mode is an English uppercase letter mode, the text mode to which a specific character group belongs is an alphabetical mode, and if the current text mode is the Japanese Hiragana text mode, for example, the character mode to which the specific character group belongs is Katakana. According to a spelling rule in the same character system including that in a character mode, it may be a character mode in which a character group consisting of characters belonging to the current character mode and other characters corresponding to each other is included. That is, it may be a character group consisting of characters input in another character mode according to the spelling rule corresponding to the currently set character mode.

For example, when multi-tapped so that a touch button assigned to A, B, and C is recognized as a target button in an English uppercase letter mode, any one of lowercase letters a, b, or c can be input even in the uppercase letter mode. .

Specifically, in an embodiment in which any one of !, ◆, or / is inputted when multi-tapped so that the touch button assigned with A, B, C and !, ◆, / is recognized as a target button, in the embodiment, !, ◆, since a, b, or c is substituted instead of /, a detailed embodiment is omitted.

Among the characters assigned to the same button in "3)" above, as an example that can be a character group assigned to a specific row, in the case of Fig. 1, the touch buttons assigned with A, B, C and !, ◆, / The "!" assigned to line 2 , "◆", and "/" may be a character group assigned to the second row of each button. As shown in FIG. 1, although the characters assigned to the second row of the touch button are special characters, these may be implemented as characters other than special characters.

For example, in the case of FIG. 1, A, B, C may be a group of characters assigned to a second specific sequence that is greater than or equal to the first specific sequence number from among the characters assigned to the same button of number "4)". And "!" assigned to the 4th~6th touch buttons assigned with !, ◆, / It may be a character assigned to the 4th to 6th of each button including "◆" and "/".

And, when the multi-touch at the time of multi-multi-tap is expressed in detail as n multi-touch, different character groups are matched according to different n values, so that the characters of the corresponding character group are input without changing the character mode. You may.

1.5.2..13. Definition of terms for manipulation after multi-touch with open fingers

1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)

It is a concept that is almost the same as the definition of the term'multi-touch post-operation',

However, when the definition of the term'manipulation after multi-touch' is understood, the'target button recognition method using a spread finger', which will be described later, is only a concept applied as the target button recognition method.

1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)

As a concept almost the same as the definition of the term'multi-on & off',

However, when the definition of the term'multi-on & off' is understood, the'target button recognition method using a spread finger' to be described later is only a concept applied as the target button recognition method.

1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)

It is almost the same concept as the definition of the term'multi-all on & off',

However, when the definition of the term'multi-all on & off' is understood, the'target button recognition method using open fingers' to be described later is only a concept applied as the target button recognition method.

1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)

It is almost the same concept as the definition of the term'multi not all on & off',

However, when the definition of the term'multi not all on & off' is understood, the'target button recognition method using a spread finger' to be described later is only a concept applied as the target button recognition method.

1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)

It is almost the same as the definition of the term'multi-not all standard finger on & off',

However, when the definition of the term'multi-not all reference finger on & off' is understood, the'target button recognition method by open finger', which will be described later, is applied as the target button recognition method, and'multi-not all reference finger on and off' is applied. In the definition of'&off', the phrase reference finger (= reference touch point) is replaced with the leftmost finger (= touch point), and the phrase sickle reference finger (= reference touch point) is the rightmost It is just a concept replaced by a finger (= touch point) touched on.

1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)

It is almost the same as the definition of the term'multi-not all-not standard finger on & off',

However, when the definition of the term'multi-not all-not criterion finger on & off' is understood, the'target button recognition method by open finger', which will be described later, is applied as the target button recognition method, and'multi-not all-not standard finger on&off' is applied as the target button recognition method. In the definition of the term'finger on & off', the phrase reference finger (= reference touch point) is replaced with the leftmost touched finger (= touch point), and the phrase sickle reference finger (= reference touch point) It is just a concept replaced by a finger (= touch point) touched on the far right.

1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)

As a concept almost the same as the definition of the term'multi-drag' above,

However, when the definition of the term'multi-drag' is understood, the'target button recognition method using an open finger' to be described later is only a concept applied as the target button recognition method.

1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)

It is almost the same concept as the definition of the term of'multi-all drag',

However, when the definition of the term'multi-all drag' is understood, the'target button recognition method using an open finger' to be described later is only a concept applied as the target button recognition method.

1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)

It is almost the same concept as the definition of the term of'multi not all drag',

However, when the definition of the term'multi-not all drag' is understood, the'target button recognition method using an open finger' to be described later is only a concept applied as the target button recognition method.

1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)

It is almost the same as the definition of the term'multi-not all standard finger drag',

However, when the definition of the term'multi-not all reference finger drag' is understood, the'target button recognition method by open finger', which will be described later, is applied as the target button recognition method. In the definition of the term, the phrase reference finger (= reference touch point) is replaced by the leftmost finger (= touch point), and the phrase sickle reference finger (= reference touch point) is the finger touched on the rightmost It is just a concept replaced by (=touch point).

1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)

It is almost the same as the definition of the term'multi-not all-not standard finger drag',

However, when the definition of the term'multi-not all-not standard finger drag' is understood, the'target button recognition method by open finger' to be described later is applied as the target button recognition method, and'multi-not all-not standard finger drag' The phrase reference finger (= reference touch point) in the definition of'is replaced with the leftmost finger (= touch point), and the phrase sickle reference finger (= reference touch point) touches the rightmost It's just a concept replaced by a finger (= touch point).

1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point)

It is almost the same concept as the definition of the term of'multi-multi-tap',

However, when the definition of the term'multi-tap' is understood, the'target button recognition method using an open finger', which will be described later, is only a concept applied as the target button recognition method.

1.5.2..14. The most recommended multi-touch post-operation

1.5.2..14.1. Most Recommended Multi On&Off

It is the most convenient multi-on & off operation for the user, and refers to'multi-all on & off' which is implemented with the index finger and middle finger, which are the methods exemplified in the definition of'multi-all on & off' above.

Since the index finger is recognized as the reference finger and the middle finger is recognized as the sickle reference finger, it is operated after two multi-touch with the index finger and middle finger.

When the middle and index fingers are operated with the intention of turning off the touch screen at the same time, even when one of the middle and index fingers is turned off first on the touch screen and the other is turned off later, the time when the first off finger is turned off and later When the time difference from the time when the finger to be turned off is less than a certain time (eg 0.1 seconds),

To give a more detailed example, when the middle finger and the index finger are operated with the intent to turn off the touch screen at the same time, even if the middle finger is turned off on the touch screen before the index finger, the time when the middle finger is off and the time when the index finger is off. It refers to an operation in which the multi-all is turned on and off when the time difference is less than a certain period of time (eg 0.1 seconds).

1.5.2..14.2. Most Recommended Multi Drag

It is the most convenient multi-drag operation for the user, and refers to'multi-all drag' implemented with the index finger and middle finger, which are examples in the definition of the multi-all drag, and the index finger is recognized as the reference finger, and the middle finger is recognized as the sickle reference finger. In the case of operation after two multi-touch with the index finger and middle finger as much as possible, it refers to an operation that is dragged so that there is a point in time when both the middle finger, which is the reference finger of the sickle and the index finger, which is the reference finger, starts to drag together (without being turned off).

1.5.3...Operation after single-touch and multi-touch

Operation in which operation is performed after the target button is single-touched, the single-touch status is maintained for a certain period of time (e.g. 0.1 seconds) or more, and after another at least one finger is additionally touched to become the multi-touch status (after multi-touch). Refers to. (From the device's point of view, after the target button is single-touched, after the single-touch state is maintained for a certain period of time (e.g. 0.1 seconds) or more, another at least one touch point is additionally touched to enter the multi-touch state, After touch) refers to the operation in which the operation is performed.)

'Single touch and then multi-touch operation' includes'single-touch and multi-all on&off' and'single-touch and multi-all dragging'.

To take the example of'Multi All On & Off after single touch',

After the index finger is single-touched on the target button, the middle finger is additionally touched while the touch state of the index finger is maintained for more than a certain period of time (e.g. 0.1 seconds), and then two multi-touch with the index finger and middle finger, and then the index finger and middle finger are dragged. This includes cases where it is not turned off and is turned off at the same time. To put the above example easily, it refers to a case in which multi-all is turned on and off after being single-touched with the index finger first, and then the middle finger is additionally touched to become a multi-touch state.

To take the example of'Single Touch and then Multi All Drag',

After the index finger is single-touched on the target button, the middle finger is additionally touched while the touch state of the index finger is maintained for a certain period of time (e.g. 0.1 seconds), and two multi-touch with the index finger and middle finger are performed, and then the index finger and the middle finger are simultaneously This includes the case of being dragged. To put the above example easily, it refers to a case where a single touch is performed with the index finger first, and then the middle finger is additionally touched to become a multi-touch state, and then a multi-all drag is performed.

In addition to'Single Touch and then Multi All On & Off' and'Single Touch and then Multi All Drag', you can also create various'Single Touch and then Multi Touch and then Operation' by substituting various multi-touch post-operations after single touch.

1.6. Definition of terms for target button recognition method

Before entering the definition of the term, referring to the point of time when the target button is judged from the device's point of view, within the time when one (unit) of multi-touch is recognized, at least the touch points that have been touched so far, including the touch point in the single-touch state, are In a state in which any one of the touch points has not been turned off or has not started to be dragged, the target button may be determined (by updating) each time a new touch occurs.

1.6.1.. Recognition method of target button by reference finger

(=Recognition method of target button by reference touch point)

In the method of recognizing a target button by a reference finger, one finger among multi-touched fingers is recognized as a reference finger, and a touch button including a point where the reference finger was touched is recognized as a target button. (From the perspective of the device, in the method of recognizing the target button by the reference touch point, any one of the multi-touched touch points is recognized as the reference touch point, and the touch button including the reference touch point is recognized as the target button. This is how it becomes.)

1.6.1..1 Target button recognition method by reference finger according to the order of X coordinate values

(=Recognition method of target button by reference touch point according to the order of X coordinate values)

This is a method in which a touch button including a point having a value in a specific order among the points touched by the multi-touched fingers is recognized as a target button.

That is, among the multi-touched touch points, a touch button including a point having a value in a specific order among the order of X coordinate values is recognized as a target button.

For example, there is a method in which a touch button including the leftmost point among points touched by the multi-touched fingers, that is, a point having the first X coordinate value in a small order of X coordinate values, is recognized as a target button.

For a more detailed example, in the keyboard arrangement of Figs. 1, 3, 4, the index finger touches button 5, and the middle finger touches the index finger including button 3, or button 6 (or even button 9 or button #). When touched to any of the points on the right of a point, the index finger touched at the leftmost point on the touch screen is recognized as the reference finger, and a button that contains the point touched by the index finger recognized as the reference finger 5 is recognized as a goal button.

Even when the index finger touches the left part of button 5 and the middle finger touches the right part of button 5, the index finger touching the leftmost point on the touch screen is recognized as the reference finger, and button 5 is the target. It is recognized as a button.

In this case, in the process of recognizing the reference finger, only the X coordinates of the multi-touched fingers are considered, and the Y coordinates of the multi-touched fingers are not considered.

Therefore, from the user's point of view, in order to multi-touch button 5 with the index finger and middle finger so that button 5 is recognized as the target button, buttons 5 are touched with the index finger, and buttons including points with a larger X coordinate value than button 5 or button 5 with the middle finger. (Example: Button 3, Button 6, Button 9, or Button #) or the borders of the buttons are touched, and as a result, two or more of Button 3, Button 6, Button 9, and Button # are duplicated at the same time. Just touch it.

Since a touch button including a point in a specific order among the points touched by the multi-touched fingers is recognized as the target button in the order of the X coordinate values, unlike the above example, the reference finger is recognized in the following manner, A touch button including a point where the reference finger was touched may be recognized as a target button.

For example,

1) A finger touched at the second point from the left (= touch point) may be set to be recognized as a reference finger (= reference touch point),

2) It may be set so that a finger touched at the third point from the left (= touch point) is recognized as a reference finger (= touch point),

3) A finger touched at the fourth point from the left (= touch point) may be set to be recognized as a reference finger (= touch point).

1.6.1..2 Target button recognition method by the reference finger according to the order of Y coordinate values

(=Recognition method of target button by reference touch point according to the order of Y coordinate value)

This is a method in which a touch button including a point having a value in a specific order among the points touched by the multi-touched fingers in the order of Y coordinate values is recognized as a target button.

That is, among the multi-touched touch points, a touch button including a point having a value in a specific order among the order of Y coordinate values is recognized as a target button.

This method can be implemented because the lengths of the fingers are different. In general, the middle finger is longer than the index finger, so it is assumed that it is also used in the following and an example is given. So, when two multi-touch with the right index finger and middle finger, when the index finger touches button 5, the middle finger is not touched on button 6, which is the right button of button 5, but is touched on button 3, which is the top of button 6. Is holding. Even if the index finger is longer than the middle finger, the index finger is bent and the middle finger is stretched to form a shape as if the middle finger is longer than the index finger, and an example to be described later can be applied.

For example, a touch button including the lowest point among points touched by the multi-touched fingers, that is, a point having the first Y coordinate value in a small order of Y coordinate values, is recognized as a target button.

For a more detailed example, in the keyboard of the arrangement as shown in Figs. 1, 3 and 4, the index finger is touched on button 5, and the middle finger is above the point touched by the index finger including button 3 (or even button 1 or button 2). When touching any of the points, the index finger being touched at the lowest point on the touch screen is recognized as the reference finger, and button 5, which is a button containing the point touched by the index finger recognized as the reference finger, is the target button. Is recognized as.

Even when the index finger touches the lower part of the button 5 and the middle finger touches the upper part of the button 5, the index finger touching the lowest point on the touch screen is recognized as the reference finger, and button 5 is the target. It is recognized as a button.

In this case, when the reference finger is recognized, only the Y coordinates of the multi-touched fingers are considered, and the X coordinates of the multi-touched fingers are not considered.

Therefore, from the user's point of view, to multi-touch button 5 with the index finger and middle finger so that button 5 is recognized as the target button, buttons 5 are touched with the index finger, and buttons including a point with a Y coordinate value greater than that of button 5 or button 5 with the middle finger. (Example: button 1, button 2, or button 3) or one of the buttons is touched, or the borders of the buttons are touched, and as a result, two or more of button 1, button 2, and button 3 can be touched simultaneously.

Since a touch button including a point in a specific order among the points touched by the multi-touched fingers is recognized as a target button in the order of Y coordinate values, unlike the above example, the reference finger is recognized in the following manner, A touch button including a point where the reference finger was touched may be recognized as a target button.

For example,

1) A finger touched at the second point from the bottom (= touch point) may be set to be recognized as a reference finger (= reference touch point),

2) The finger touched at the third point from the bottom (= touch point) may be set to be recognized as the reference finger (= touch point),

3) A finger touched at the fourth point from the bottom (= touch point) may be set to be recognized as a reference finger (= touch point).

On the other hand, if the reference finger recognition method here is applied, it is possible to perform multi-teach in which both hands are used while the right hand and the left hand alternately. This is because the same rules can be applied to both the left and right hands. In a more specific example, a touch button including the lowest point among the points touched by the multi-touched fingers, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is the target button. When the recognition method is applied, the index finger of both hands touching the lower touch point among the multi-touched touch points, whether it is the right hand or the left hand, is the reference finger when the index and middle finger are used alternately with the right hand and the left hand. This is because a button including a point where the index finger of both hands recognized as the reference finger was touched is recognized as the target button.

However, by the method of recognizing the target button by the reference finger according to the order of the X coordinate values, it is virtually impossible to use multi-teach in which both hands are alternately used. This is because the same rules cannot be applied to both the left and right hands.

To explain more specifically, for example, the leftmost point among the points touched by the multi-touched fingers, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is the target button. In the case where the recognition method is applied, and two multi-touch with the index and middle fingers of both hands alternately, the middle finger will be recognized as the reference finger when two multi-touch with the index and middle fingers of the left hand, and the index and middle fingers of the right hand This is because in the case of multi-touching with 2, the index finger will be recognized as the reference finger.

1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch

(=Recognition method of target button by reference touch point according to the order of X coordinate values according to the number of multi-touch)

This is a method in which a specific order in which the reference finger is set in the order of the X coordinate values in which the reference finger is recognized is determined in the'target button recognition method by the reference finger according to the order of X coordinate values' according to the n value in the multi-touch situation. From the point of view of, the specific order to be set in the order of the X coordinate values in which the reference touch points are recognized is determined in'Recognition Method of the Target Button by the Reference Touch Point According to the X Coordinate Value Order' according to the n value in the n-multi-touch situation. That's how it works.)

To explain with an example,

1) When 2 multi-touch, the finger touched at the first point from the left (= touch point) is recognized as the reference finger (= reference touch point),

2) When 3 multi-touch, the finger touched at the second point from the left (= touch point) is recognized as the reference finger (= reference touch point),

3) When 4 multi-touch, the finger touched at the third point from the left (= touch point) can be set to be recognized as the reference finger (= reference touch point).

For a more specific example, in the keyboard of FIG. 3 or 4 and the arrangement,

1) When button 2 is single-touched with the index finger, the first character assigned to button 2 is input,

2) When button 2 is touched with the index finger, and button 3, the right button of the button touched with the index finger, is touched with the middle finger, the index finger, which is the finger touched at the first point from the left, is recognized as the reference finger, Button 2 touched with the index finger, which is the reference finger, is recognized as the target button, so that the second character assigned to button 2, which is the target button, is input,

3) When button 1 is touched with the index finger, button 2, the right button of the button touched with the index finger, is touched with the middle finger, and button 3, the right button of the button touched with the middle finger, is touched with the ring finger. The middle finger, which is the finger touched at the second point in, is recognized as the reference finger, and button 2 touched with the middle finger, which is the reference finger, is recognized as the target button, so that the third character assigned to the target button 2 can be input. have.

1.6.1..4 Target button recognition method by the reference finger according to the order of Y coordinate values according to the number of multi-touch

(=Recognition method of target button by reference touch point according to Y coordinate value order according to the number of multi-touch)

This is a method in which specific orders to be set in the order of the Y-coordinate values in which the reference finger is recognized in the'Recognition Method of the Target Button by the Reference Finger according to the Y-coordinate Value Order' according to the n-value in the n-multi-touch situation is determined. From the point of view of, the specific order to be set in the order of the Y coordinate value in which the reference touch point is recognized is determined in'How to recognize target button by the reference touch point according to the Y coordinate value order' according to the n value in the n-multi-touch situation. That's how it works.)

To explain with an example,

1) When 2 multi-touch, the finger touched at the first point from the bottom (= touch point) is recognized as the reference finger (= reference touch point),

2) When 3 multi-touch, the finger touched at the second point from the bottom (= touch point) is recognized as the reference finger (= reference touch point),

3) When 4 multi-touch, the finger touched at the third point from the bottom (= touch point) can be set to be recognized as the reference finger (= reference touch point).

For a more specific example, in the keyboard of FIG. 3 or 4 and the arrangement,

1) When button 5 is single-touched with the index finger, the first character assigned to button 5 is entered,

2) When button 5 is touched with the index finger, and button 2, which is the upper button of the button touched with the index finger, is touched with the middle finger, the index finger, which is the finger touched at the first point from the bottom, is recognized as the reference finger, Button 5 touched with the index finger, which is the reference finger, is recognized as the target button, so that the second character assigned to button 5, which is the target button, is input,

3) When button 8 is touched with the index finger, button 5, the upper button of the button touched with the index finger, is touched with the middle finger, and button 2, the upper button of the button touched with the middle finger, is touched with the ring finger. The middle finger, which is the finger touched at the second point in, is recognized as the reference finger, and the button 5 touched with the middle finger, which is the reference finger, is recognized as the target button, so that the third character assigned to the target button 5 can be input. have.

1.6.2.. Recognition method of target button by open finger

(=Recognition method of target button by open touch point)

The'target button recognition method using open fingers' is a method in which a touch button including a new point determined based on the points touched by the multi-touched fingers is recognized as a target button. The following five methods are included here: (From the device's point of view, the'target button recognition method by open touch points' is a touch that includes a new point determined based on the multi-touch points. This is how the button is recognized as the target button.)

1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)

A touch button including a new X-coordinate determined based on the X-coordinates of the points touched by the multi-touched fingers, and a new Y-coordinate determined based on the Y-coordinates of the touched points by the multi-touched fingers. A method of recognizing as a target button is also possible (from the device's point of view, a new X coordinate determined based on the X coordinates of the multi-touched touch points, and a new X coordinate determined based on the Y coordinates of the multi-touched touch points. A method of recognizing a touch button including a point consisting of Y coordinates as a target button is also possible.)

For example, a touch button including a new X coordinate that becomes the center of the X coordinates of the points touched by multi-touch fingers, and a new Y coordinate that becomes the center of the Y coordinates of the points touched by the multi-touched fingers. It is also possible to be recognized as a target button.

For a specific example, if the index finger and middle finger are multi-touched, and the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the intermediate coordinate of X1 and X2 is X3(=(X1). A touch button including a point (X3, Y3) consisting of +X2)/2) and Y3 (=(Y1+Y2)/2), which is an intermediate coordinate between Y1 and Y2, is recognized as the target button.

For a more specific example, in a keyboard having an arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used and two multi-touch,

When the index finger touches button 4 and the middle finger touches button 6, button 5 is recognized as the target button, even if the index finger touches button 7 and the middle finger touches button 3, button 5 is recognized as the target button. .

1.6.2..2 Target button recognition method using the second open finger (=target button recognition method using the second open touch point)

A new X-coordinate determined based on the X-coordinates of the points touched by multi-touched fingers, and a point composed of a Y-coordinate paired with the X-coordinate of a specific order among the magnitudes of the X-coordinates of the points touched by the multi-touched fingers. A method of recognizing a touch button including a target button is also possible (from the device's point of view, a new X coordinate determined based on the X coordinates of the multi-touched touch points, and the X coordinate values of the multi-touched touch points. A method of recognizing a touch button including a point consisting of a Y coordinate paired with an X coordinate in a specific order among the size order is recognized as a target button is also possible.)

For example, a new X-coordinate that becomes the center of the X-coordinates of the points where the multi-touched fingers are touched, and the Y-coordinate of the first order of the small order of the X-coordinate values of the points where the multi-touched fingers are touched. A touch button including a coordinate, that is, a point consisting of the smallest X coordinate and the Y coordinate paired may be recognized as a target button.

For a specific example, if the index finger and middle finger are multi-touched, and the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the intermediate coordinate of X1 and X2 is X3(=(X1). The touch button including the point (X3, Y1) consisting of +X2)/2) and Y1 is recognized as the target button (in general, since it is touched with the right hand, the index finger is the point to the left of the middle finger, that is, the X coordinate. Since the value will be touched at the smaller point, the X coordinate of the first order of the small order of the X coordinate value is X1, which is the X coordinate of the point where the index finger touched, and the Y coordinate paired with the X1 is Y1.)

For a more specific example, in a keyboard having an arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used and two multi-touch,

When the index finger touches button 4 and the middle finger touches button 6, button 5 is recognized as the target button, and even if the index finger touches button 4 and the middle finger touches button 3, button 5 is recognized as the target button. .

1.6.2..3 Recognition method of target button by 3rd open finger (=Recognition method of target button by 3rd open touch point)

A new X-coordinate determined based on the X-coordinates of the points touched by the multi-touched fingers, and a touch button including a point consisting of a Y-coordinate of a specific order among the size order of the Y-coordinates of the points touched by the multi-touched fingers. It is also possible to recognize as a target button (from the device's point of view, a new X coordinate determined based on the X coordinates of the multi-touched touch points, and the Y coordinate value of the multi-touched touch points in a specific order. A method of recognizing a touch button including a point consisting of Y coordinates as a target button is also possible.)

For example, a new X-coordinate that is the center of the X-coordinates of the points touched by multi-touched fingers, and a point consisting of the Y-coordinate of the first order among the smallest order of the Y-coordinate values of the points touched by the multi-touched fingers. It is also possible for the touch button to be recognized as the target button.

For a specific example, if the index finger and middle finger are multi-touched, and the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the intermediate coordinate of X1 and X2 is X3(=(X1). The touch button including the point (X3, Y1) consisting of +X2)/2) and Y1 is recognized as the target button (in general, since the index finger is shorter than the middle finger, the index finger is at a point below the middle finger, that is, Since the Y coordinate value will be touched at the smaller point, the Y coordinate of the first order of the small order of the Y coordinate value is Y1, which is the Y coordinate of the point where the index finger touched.)

For a more specific example, in a keyboard having an arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used and two multi-touch,

When the index finger touches button 4 and the middle finger touches button 3, button 5 is recognized as the target button, and even if the index finger touches button 4 and the middle finger touches button 6, button 5 is recognized as the target button. .

1.6.2..4 Recognition method of target button by 4th open finger (=Recognition method of target button by 4th open touch point)

A new Y-coordinate determined based on the Y-coordinates of the points touched by multi-touched fingers, a point composed of an X-coordinate paired with the Y-coordinate of a specific order among the size order of the Y-coordinates of the points touched by the multi-touched fingers A method of recognizing a touch button including a target button is also possible (from the device's point of view, a new Y coordinate determined based on the Y coordinates of the multi-touched touch points, and the Y coordinate value of the multi-touched touch points. A method of recognizing a touch button including a point consisting of a Y-coordinate paired with a Y-coordinate in a specific order among the size order is recognized as a target button is also possible.)

For example, a new Y-coordinate that becomes the center of the Y-coordinates of the points where the multi-touched fingers are touched, and the X-coordinate of the first order of the smallest order of the Y-coordinates of the points where the multi-touched fingers are touched. It is also possible that a touch button including a coordinate, that is, a point consisting of the smallest Y coordinate and the X coordinate paired with the smallest Y coordinate, is recognized as the target button.

For a specific example, if the index finger and middle finger are multi-touched, and the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the intermediate coordinate of Y1 and Y2 is Y3 (=(Y1) The touch button including the point (X1, Y3) consisting of +Y2)/2) and X1 is recognized as the target button (in general, regardless of whether the index finger is shorter than the middle finger, if the right hand is counterclockwise) When turned 90 degrees in the direction, the index finger will be touched at a point below the middle finger, that is, the point where the Y coordinate value is smaller, so the Y coordinate in the first order among the smallest Y coordinate values is the Y coordinate of the point where the index finger touched. The coordinate is Y1, and the X coordinate paired with the Y1 is X1.)

For a more specific example, in a keyboard having an arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used and two multi-touch,

With the right hand turned 90 degrees counterclockwise, when the index finger touches button 8 and the middle finger touches button 1, button 5 is recognized as the target button, and even, the index finger touches button 8 and the stop button 2 Even if it is touched, button 5 is recognized as a target button.

1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point)

A touch button including a new Y coordinate determined based on the Y coordinates of the points touched by the multi-touched fingers, and a point consisting of a specific order of X coordinates among the X coordinate values of the points touched by the multi-touched fingers. It is also possible to recognize as a target button (from the device's point of view, the new Y coordinate determined based on the Y coordinates of the multi-touched touch points, and the X coordinate value of the multi-touched touch points are in a specific order. A method of recognizing a touch button including a point consisting of X coordinates as a target button is also possible.)

For example, a new Y-coordinate that becomes the center of the Y-coordinates of the points touched by the multi-touched fingers, and a point consisting of the first-order X-coordinate of the X-coordinate values of the points touched by the multi-touched fingers. It is also possible for the touch button to be recognized as the target button.

For a specific example, if the index finger and middle finger are multi-touched, and the touch point of the index finger is (X1, Y1) and the touch point of the middle finger is (X2, Y2), the intermediate coordinate of Y1 and Y2 is Y3 (=(Y1) The touch button including the point (X1, Y3) consisting of +Y2)/2) and X1 is recognized as the target button (in general, since the index finger is shorter than the middle finger, if the right hand is 90 counterclockwise) In the rotated state, the index finger will be touched to the right point (although it is lower) than the middle finger, anyway, the point where the X coordinate value is larger, so the X coordinate in the first order of the X coordinate values is the point where the index finger was touched. It is X1, the X coordinate of.)

For a more specific example, in a keyboard having an arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used and two multi-touch,

With the right hand turned 90 degrees counterclockwise, when the index finger touches button 8 and the middle finger touches button 1, button 5 is recognized as the target button, and even, the index finger touches button 8 and the middle finger touches button 2. Even if it is touched, button 5 is recognized as a target button.

1.6.3.. Target button recognition method by range including two or more touch points

As a method for the device to recognize a target button when multi-touch is performed, a range including two or more touch points is recognized as a target button or a target range. This method is a method in which the target range or target button must be quite wide, and the size of the button to which the text is assigned for text input is small, so it is very difficult for two fingers to touch the same button. It can be said that it is actually very difficult to recognize, and since most of the objects including pictures or photos are large enough to accommodate two fingers, in this way, most of the target buttons can be recognized. However, if the object is too small, it can be said that it is actually very difficult to recognize the target button in this way. Since the object is sometimes too small, the method of recognizing the target button by the reference finger is most recommended.

Here, when the target button recognition method based on a range including two or more touch points is applied as the target button recognition method, a method for the device to recognize the hit point can be variously set. For example, it is possible to select and set any one of the hit point recognition methods for various target button recognition methods in "1.6 Definition of Terms for Target Button Recognition Method".

1.6.4.. Mixed use

The above-described'target button recognition method using open fingers' and'target button recognition method using reference fingers' may be used in combination to recognize the target button. For example, when the distance between the fingers to be multi-touched is greater than or equal to a predetermined distance and when the distance is less than a predetermined distance, they may be used separately.

Specifically, in the keyboard of the arrangement as shown in Fig. 1 or 3 or 4,

When you want to input any one of A, B or C from the button assigned to the touch button assigned to ABC,

1) The first character, A, is entered when the button is'operated after a single touch' once,

2) When multi-touch so that the distance between the multi-touched fingers is less than a certain distance, when the'target button recognition method by the reference finger' is set to be applied among various methods of recognizing the target button, the index finger and the middle finger are used. When the button assigned ABC is operated after two multi-touch with the index and middle fingers so that the interval between the touch points is less than a certain distance, the button with the index and middle finger is the target button, the second letter B is input

3) When multi-touch so that the distance between the multi-touched fingers is more than a certain distance, when the'target button recognition method by open finger' is set to be applied among the various methods of recognizing the target button, the index finger and the middle finger are used. If the button to which ABC is assigned so that the interval between the touch points is more than a certain distance becomes the target button, and is operated after two multi-touch with the index and middle fingers, the third letter, C, can be made.

2. Synthesis

As explained in the next section,

A general situation in the process of inputting characters and transforming the shape of an object by using multi-touch post-manipulation will be described.

In operation after multi-touch,

The main hand is the right hand,

The mainly used n multi-touch is 2 multi-touch using the index and middle fingers,

The most commonly used target button recognition method is the leftmost point among the points touched by the multi-touched fingers among the target button recognition methods by the reference finger according to the X-coordinate value order among the target button recognition methods by the reference finger, that is, X. This is a method in which a touch button including a point having the first X coordinate value of the smallest coordinate value, that is, the X coordinate value is recognized as the target button.

In addition, the multi-touch mainly used is multi-all touch among various multi-touch methods mentioned in the definition of the term for multi-touch. In simple terms, it is a touch method in which multi-touched fingers are simultaneously touched.

And, the mainly used post-touch operation methods are multi all on & off and multi all drag methods.

In simple terms, the right index finger and middle finger are two multi-touch, and in two multi-touch, the index finger touches the target button, and the middle finger touches anywhere on the right of the index finger, so that the index finger and middle finger are operated to be turned off at the same time. This means that both the index and middle fingers are manipulated to drag while maintaining the touch state of the index and middle fingers. At this time, the index finger is recognized as the reference finger, and the middle finger is recognized as the sickle reference finger.

And, in the content of the entire application, including examples to be described later,

If there is no particular mention of the hand used in the operation after multi-touch, the multi-touch method, the target button recognition method, and the post-touch operation method, it may be regarded as an example to which the above-mentioned mainly used methods are applied.

In addition, the description of a button that is operated after multi-touch may be regarded as being operated while being multi-touched so that a button can be recognized as a target button, unless otherwise noted.

In addition, in the operation after a single touch, unless otherwise specified, a finger mainly used is an index finger, and a target button is touched with the index finger, and it may be regarded as an example in which a method of turning off or dragging is applied thereafter.

However, it should be borne in mind that this is an example for convenience of explanation, and the hand, n multi-touch method, reference finger setting and target button recognition method, and post-touch operation method are different from the frequently used methods and embodiments mentioned above. It should be noted that the implementation is also included in the technical idea of the present invention.

For example, the left hand may be used, and the method of recognizing the reference finger as the reference finger may be a method in which the finger touched at the point where the Y coordinate value of the touched point is the smallest among the multi-touched fingers may be applied, and the method of recognizing the target button is wide open. It goes without saying that the target button recognition method by fingers can be applied.

And, as long as the technique introduced in a specific part of the present application is also a technique that can be applied to other parts, it is natural that it can be applied to other parts.

In addition, the keyboard to which the method of the present application is applicable is not limited to the form described for example herein, but can be applied to various keyboards developed in the prior art or to any form of a newly developed form.

In the following embodiments, a method of recognizing a target button using a reference finger is mainly assumed as a method of recognizing a target button because this method is convenient for a user. The target button recognition method by the reference finger is:

1) Unlike the target button recognition method by open fingers, not only does the user have to deliberately open their fingers,

2) When all of the buttons of the 3X4 type keyboard are multi-touched so that they can become target buttons, one more column is added to the left of the first column, as shown in FIG. 3, in order to use the'target button recognition method by open finger'. As a result, a 5X4 keyboard is required because it must be added and one more column to the right of the third column, whereas the target by the reference finger according to the order of the X coordinate value in the'Recognition Method of Target Button by the Reference Finger' The leftmost point among points touched by multi-touched fingers, which is one of the embodiments of'button recognition method', that is, the first point in the smallest order of the X coordinate value, that is, the point having the smallest X coordinate value. When a method in which the included touch button is recognized as a target button is used, and two multi-touch using the right hand index and middle finger is used, as shown in FIG. 4, one more column needs to be added only to the right side of the third column. As a result, a 4X4 keyboard Because only it is needed, the button for entering text takes up less space on the touchpad,

3) In order to be single-touched with the index finger, the middle, ring, and hands must be closed, whereas in the case of multi-touch with the index and middle fingers, only the ring and hands need to be closed, so there are cases where the fingers are more comfortable than the single touch.

On the other hand, in the process of manipulation after multi-touch, the spatial positional relationship (=relative distance) of the fingers (=touch points) at the moment of multi-touch and the spatial positional relationship of the fingers (=touchpoints) maintaining the touch (= It is obvious that the difference in relative distance) should be kept below a certain standard value.

For example, compared to the moment when the multi-touch was performed, it means that it is difficult if the fingers, whose touch is maintained, exceed a certain reference value and become more constricted or extended in the process of being manipulated.

For reference, when implementing multi-touch, it can be implemented using fingers of both hands. For example, you can implement 2 multi-touch using 1 thumb of each hand.

3. How to input characters on the touch screen

Hereinafter, a method of inputting characters on a touch screen will be described in detail by applying the above-described various operations.

First, in a device equipped with a touch screen, in the method for inputting characters,

A keyboard with buttons assigned with multiple characters is displayed on the touch screen,

When a specific button is operated after multi-touch so that it is recognized as a target button, after the multi-touch and after the operation starts, including after the operation starts or after the operation ends,

Let's look at a method that may be a method of inputting a character in a specific order among characters assigned to a button recognized as a target button by multi-touch operation.

Additionally,

According to the operation after the multi-touch, a specific sequence number of the input character may be determined,

In the above, if the drag direction is different, it may be recognized that the type of operation after the multi-touch is different,

In the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group, according to the situation before the final operation, a specific character among at least one character group The character group is matched, and while belonging to the matched character group, at least one character among at least one character related to the target button may be input without changing the character mode.

So, the type of situation before the final operation and a specific character group different from the character group input by the operation method after the single touch are matched, and the characters of the matched character group are matched. It can be entered without changing the text mode.

In addition, the "specific character group" may be any one of the following character groups.

1) A group of characters assigned to a specific line among the characters assigned to the same button.

2) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

3) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

If it is extended further, it can be extended to the following 4) and 5).

4) Any one character group among two or more different character groups classified into different categories according to the spelling rules.

5) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group of the special character mode.

4 is a view showing a pad including a conventional 3X4 keyboard.

(In the pad shown in Fig. 4, the blank buttons in the 4th row on the far right are not buttons that perform any function, but are only drawn to add a function button as well as a free space for multi-touch.)

In the pad shown in FIG. 4, alphabetic characters are assigned as follows.

1) ABC is assigned to button 2,

2) DEF is assigned to button 3,

3) GHI is assigned to button 4,

4) JKL is assigned to button 5,

5) Button 6 is assigned MNO,

6) Button 7 is assigned PQRS,

7) TUV is assigned to button 8,

8) Button 9 is assigned WXYZ,

9) English characters are not assigned to buttons 1, *, 0, and #.

Among the buttons provided on the phone button pad shown in FIG. 1, the button to which the most letters are assigned is button 9, and four (W, X, Y, Z) are assigned.

In this embodiment, 10 to 6 lowercase letters and special characters are additionally assigned to the buttons, and if it is assumed that 10 characters are assigned to each of the buttons, the first to fifth characters are'operation after single touch. ', and the 6th to 10th characters can be entered as'manipulation after multi-touch'.

for example,

1) The 1st character assigned to each button can be entered with each button being single on & off with the index finger,

2) The second character assigned to each button can be entered by dragging upwards (= north) after each button is single-touched with the index finger,

3) The 3rd letter assigned to each button can be entered by single-touching each button with an index finger and then dragging it to the right (=east),

4) The 4th character assigned to each button can be entered by dragging downward (= south) after each button single-touch with the index finger,

5) The 5th letter assigned to each button can be entered by single-touching each button with an index finger and then dragging it to the left (= west),

6) The 6th character assigned to each button can be entered by multi-touching each button with an index finger and middle finger so that each button is recognized as a target button, and then'multi-all on&off'.

7) The 7th character assigned to each button can be entered by multi-touching with the index and middle fingers so that each button is recognized as a target button, and then'multi-all drag' toward the top (= north).

8) The 8th character assigned to each button can be entered by multi-touching with the index and middle fingers so that each button is recognized as a target button, and then'multi-all dragging' in the right (=east) direction.

9) The ninth character assigned to each button can be entered by multi-touching each button with an index finger and middle finger so that each button is recognized as a target button, and then'multi-all dragging' in the downward (= south) direction.

10) The tenth character assigned to each button can be input by multi-touching each button with an index finger and middle finger so that each button is recognized as a target button, and then'multi-all dragging' toward the left (= west).

If, assuming the 6th character assigned to button 5 is a question mark "?",

a) When button 5 is touched with the index finger and any point on the right side of the index finger (i.e., the point where the X coordinate value is greater than the index finger, and the Y coordinate is an irrelevant point, for example, button 6 or button 3) or the middle finger is touched, , The index finger becomes the reference finger and button 5 is recognized as the target button.

b) In this state, when'multi-all on&off' (that is, when the index finger and middle finger are released at the same time (=off)), a question mark "?" is input.

And, assuming that the 7th character assigned to button 5 is a heart "♥",

a) Button 5 is touched with the index finger and any point on the right of the index finger is touched with the middle finger, so that button 5 is recognized as the target button,

b) In this state, when multi-all dragging in the upward (=north) direction (that is, if the index finger and middle finger are dragged while being touched on the touch screen), the heart “♥” is input.

On the other hand, when the 6th character is input, it is possible to use'multi not all on & off' instead of'multi all on & off', and more specifically'multi not all standard finger on & off' is used. It is possible.

For example, in order to input the sixth character assigned to button 5, the question mark "?", after multi-touching button 5 to be recognized as the target button, the middle finger, which is the'sickle reference finger', is first turned off and then for a certain period of time ( For example: 0.1 second), the index finger, which is the reference finger, is turned off.

In addition, when entering the 7th to 10th characters, it is possible to use'multi not all drag' instead of'multi all drag', and more specifically,'multi not all reference finger drag' may be used.

For example, in order to input the 7th character "♥", which is the 7th character assigned to button 5, after multi-touching button 5 to be recognized as the target button, only the index finger, which is the reference finger, with the middle finger, which is the sickle reference finger, is off. It is a multi-notch finger dragging in the upward (= north) direction while sticking to the touch screen.

On the other hand, as a target button recognition method in the case of using multi-touch, aside from the'target button recognition method by open fingers', in the'target button recognition method by the reference finger', the reference finger according to the order of the X coordinate value The leftmost point among the points touched by multi-touched fingers, which is one of the embodiments of'target button recognition method by means of', that is, the first point in the smallest order of the X coordinate value, that is, the X coordinate value having the smallest X coordinate value. Even if only the method in which the touch button including the point is recognized as the target button is used, and only two multi-touch using the right hand index and middle finger is used, as an operation method, even if only the following three operation methods are applied, a special character is applied to one button. Even if 15 characters including the are assigned, characters can be entered easily and quickly without changing the character mode, or characters assigned to different character modes on the same button can be entered easily and quickly without changing the character mode.

1)'Single On&Off','Single Drag' in 4 directions,

2)'Multi All On & Off','Multi All Drag' in 4 directions,

3)'Multi-not all standard finger on & off', 4 directions'multi-not all standard finger drag'

Now, in the method of inputting characters in a device equipped with a touch screen, in the case of multi-touch operation so that a specific button is recognized as a target button after the keyboard is displayed on the touch screen,

One of the final manipulations of which one of the final manipulations is initiated may include drags in each direction of off or top, bottom, left, right (top left, bottom left, top right, bottom right). After the point in time or after the point at which the final operation begins, including after the point at which the last operation ends,

By multi-touch post-operation including the final operation of at least one of the final operations that may include off or multi-drag in 8 directions,

In the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group,

Depending on the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character related to the target button is inputted without changing the character mode while belonging to the matched character group. Let's look at a method that can be a method.

Additionally, the "specific character group" may be any one of the following character groups.

1) Any one character group among two or more different character groups classified into different groups according to the spelling rules.

2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.

To expand further, it can be extended to the following cases 3), 4), and 5).

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

When the above method is applied, a description will be given of Japanese input as an example of the fact that characters assigned to the same button for different character modes can be easily and quickly input without changing the character mode.

Japanese are divided into different types of characters such as'Hiragana' and'Katakana' even though they have the same pronunciation as English uppercase and lowercase letters.

Therefore, in hiragana text mode, without changing text mode

1)'Single On&Off' and'Single Drag' in 4 directions are used to input 5 Hiragana characters,

2)'Multi All On&Off'and'Multi All Drag' in 4 directions are used to input 5 characters in Katakana,

3) Five special characters can be entered by using'Multi-Not All Standard Finger On & Off' and'Multi-Not All Standard Finger Drag' in 4 directions.

Naturally, even in Katakana mode, hiragana characters and special characters may be input without changing the character mode.

The above embodiments will be described in more detail.

5 shows a 3X4 type Japanese input keyboard. In the input keyboard as shown in FIG. 5, five Japanese characters are assigned to each button, and only one representative character is displayed among the assigned five characters.

5 is a Japanese input keyboard in hiragana text mode.

First, to explain how hiragana is input in hiragana mode as an example,

When a button is'single-touch' (the condition of turning off after a single touch is possible in the following method 1), 5 Hiragana characters assigned to the single-touched button as shown in the upper drawing of FIG. 6 are displayed. All are popped up. At this time, there are two examples of how to input the desired text.

1. After the single-touched finger is turned off, one of the pop-up hiragana characters is touched (eg, single-touch) to input the desired hiragana. As a result, it is a method that requires two touches to input the desired character.

2. The single-touched finger is not turned off, and the desired hiragana character can be input by single dragging in the direction in which the desired hiragana character is located. If the desired hiragana character is located in the center, the finger is turned off without dragging, so that the hiragana character located in the center can be input. That is, five hiragana characters can be input by single on & off and single drag in four directions.

Now, to explain how to input katakana characters in hiragana mode without changing the character mode, for example,

When a button is'multi-touched' so that it is recognized as a target button (a condition of turning off after a multi-touch is possible in the following method 1), as shown in the lower figure of FIG. 6, it is assumed that it is in Katakana mode. , All five katakana characters assigned to the'multi-touch' button to be recognized as the target button are popped up. At this time, there are two examples of how to input the desired character.

1. After the multi-touched fingers are turned off at the same time, one of the pop-up katakana characters is touched (eg, single-touch) to input desired katakana characters. As a result, it is a method that requires two touches to input the desired character.

2. The multi-touched finger is not turned off, and all fingers are multi-drag in the direction in which the desired katakana letter is located, so that the desired katakana letter can be input. If the desired katakana character is located in the center, the multi-touched fingers are simultaneously turned off without dragging, so that the katakana character located at the center can be input. That is, five katakana characters can be input by multi-all on & off and multi-all drag in four directions.

In addition, the above-described method can be applied to a conventional Qwerty keyboard as shown in FIG. 7 or 60. For example, if the current text mode is the lowercase letter mode,

1) Single on&off is used to input lowercase letters in English,

2) Multi ON&OFF is used so that even though the current text mode is an English lowercase mode, English uppercase letters are input without changing the text mode. That is, without changing the text mode, it is possible to input a text in another text mode corresponding to the current text mode.

For example, if the current text mode is an English lowercase letter mode,

When button S is single on & off, small letter s is input, and multi all on & off so that button S is recognized as a target button, capital letter S can be input even though the current letter mode is an English lower case mode.

(To make the rightmost button P and button L of FIG. 7 be recognized as target buttons when multi-touching, in most cases, there is sufficient free space in which no letter is assigned to the rightmost side as shown in FIG. 8 or 60. It would be better if there was.

In addition, button V is displayed just to the right of button T in FIGS. 7, 44, and 62, but it is actually button Y as shown in FIG. 60, but it is incorrectly displayed. You can understand the text of the present application by replacing button V with button Y just to the right of button T. Even if you don't think about it, it doesn't matter to understand this application.)

Now, in a method of inputting characters in a device equipped with a touch screen, in the process of multi-on & off so that a specific button is recognized as a target button,

After the multi-touch, including after the multi-touch or after the multi-touch finger is turned off (= multi-touch is released),

Let's look at a method that can be a method of inputting a character in a specific sequence among characters assigned to a button recognized as a target button.

Additionally, when the multi-touch is expressed in more detail as n multi-touch, the specific sequence number may be determined according to the n value, or the n value may be determined so that the numeric value corresponding to the sequence number of the specific sequence number is the same. have.

In particular, in order to compensate for the problem of many typos, as shown in FIG. 8, since the size of the button is small and the target button is not pressed correctly and the surrounding button is pressed incorrectly, as shown in FIG. Compared to the buttons shown in FIG. 7, after increasing the size of the button, two or more characters are assigned to one button, and then input without a typo can be performed by the method of the following exemplary embodiment.

1) When'Single On&Off' is used, the first character of each button is entered,

2) When'Multi On&Off' is used, the second character of each button recognized as the target button can be entered.

In more detail, taking the button assigned to'QW' in FIG. 8 as an example,

1) If the button assigned to'QW' is single-touched and then'single on & off', that is, when single on & off starting with a single touch, for example, the button assigned to'QW' is touched with the index finger. When it is turned off immediately,'Q', which is the first letter of the button assigned to'QW', is entered,

2) If the button assigned to'QW' is multi-touched to be recognized as a target button and then'multi-all on&off', that is, multi-all on & off starting with multi-touch, for example, as shown in FIG. 59 The button assigned to'QW' is touched with the index finger and the middle finger touches any point on the right side of the index finger, and when both the index finger and the middle finger are turned off at the same time,'W', the second letter of the button assigned to'QW', is implemented to be input. It becomes.

According to this, the second character assigned to each button can also be directly input by one touch action. Even in the case of 2 multi-touch, since the wrist or elbow is a type that is used only once, it can be said to be a single touch action. Yet, since the buttons of FIG. 8 have a larger button size than the buttons of FIG. 7, a typo hardly occurs.

Meanwhile, the principle of the input method described above may be applied to the Korean keyboard as shown in FIG. 10 in which the conventional Korean QWERTY keyboard as shown in FIG. 9 is improved. You will be able to fully understand it without a detailed explanation.

In addition, the input method described above can be applied even when three characters are assigned to one button as shown in FIG. 11. Specifically,

1) The 1st character assigned to each button is single-touched and then entered as single on&off,

2) The 2nd letter assigned to each button is entered as multi-all on & off after 2 multi-touch so that each button is recognized as a target button,

3) The third character assigned to each button can be input as multi-all on & off after 3 multi-touching so that each button is recognized as a target button.

To explain with a more specific example,

1) When the button assigned to'QWE' is single-touched and then single-on & off, that is, when single-on & off starting with a single-touch, for example, the button assigned to'QWE' is touched with the index finger and immediately When off,'Q', the first letter of the button assigned to'QWE', is input,

2) If the button assigned to'QWE' is multi-touched to be recognized as the target button and then multi-all is turned on and off, that is, if multi-all is turned on and off starting with two multi-touch, for example,'QWE' is displayed. When the assigned button is touched with the index finger and the middle finger touches any point on the right side of the index finger, and both the index finger and the middle finger are turned off at the same time,'W', the second letter of the button assigned to'QWE', is input,

3) If the button assigned to'QWE' is multi-touched to be recognized as the target button and then multi-all is turned on and off, that is, if multi-all is turned on and off starting with three multi-touch, for example,'QWE' is displayed. When the assigned button is touched with the index finger and the middle and ring fingers touch any point on the right of the index finger and multi-touch three, and then the index, middle, and ring fingers are all turned off at the same time, the third letter of the button assigned with'QWE' It can be implemented so that'E' is input.

According to this, the third character assigned to each button can also be directly input by one touch action. Even in the case of 3 multi-touch, the wrist or elbow is a type that is used only once, so it can be said to be a single touch action. Yet, since the buttons of FIG. 11 have a larger button size than the buttons of FIG. 7 or 8, a typo does not occur further.

In the method of inputting the third letter in FIG. 11, a special character including a punctuation mark is additionally assigned to at least one button of the keyboard as shown in FIG. 8 in a form in which two characters are assigned per button. By applying it to a keyboard (not shown) in the form of a button to which three letters are assigned, it can also be applied to quickly and easily input a special letter assigned to the third for each button without changing the letter mode. It would be much more useful to do this than FIG. 11.

On the other hand, in order to input'S' in the keyboard layout as shown in FIG. 4, if the button assigned with'PQRS' is multi-touched so that it is recognized as a target button, then multi-all is turned on and off, that is, with 4 multi-touch. When starting multi-all on & off, for example, button 7 assigned with'PQRS' must be touched with the index finger, and with the middle finger, ring finger, and holding finger, any point on the right of the index finger is touched and 4 multi-touch is performed, and the index finger When the, middle finger, ring finger, and holding are all turned off at the same time, the fourth letter'S' of button 7 may be input. In this case, the fourth character assigned to each button can also be directly input with one touch action.

The input principle related to Fig. 8, Fig. 10, Fig. 11, or Fig. 4 is Fig. 47, Fig. 48, Fig. 49, Fig. 50, Fig. 51, Fig. 52, Fig. 53, Fig. 54, Fig. 55, Fig. 56, Fig. 57, 58, 63, 64, 65, 66, 67, it is natural that the same can be applied to a form in which two or three letters are assigned per button. (Please refer to the "Simple Description of Drawings" section for additional description of the drawings.)

In particular, Japanese is composed of 50 tones. To implement a QWERTY keyboard, 50 buttons are required, but conventionally, the English version, which only requires 26 buttons, is small and causes many typos, so the device is vertically installed in portable devices including smartphones. Implementing and using 50 keyboards while upright was expected to cause too frequent typos, so it was virtually impossible to implement and use Qwerty keyboards in Japanese, but as shown in FIG. 47, two characters were assigned per button. Therefore, by implementing only 25 buttons, Japanese can also be used as a QWERTY keyboard.

As for the Indian language, as in Japanese, the keyboard of a mobile phone having a 12-key pad of physical buttons among conventional mobile phones is often assigned 5 characters per button. Therefore, in a device equipped with a touch screen including a smart phone, it is almost the same as that of Japanese. You will be able to enter text in this way.

In addition, a method of inputting double consonants when inputting Korean characters related to FIGS. 52, 53, 57, 58, 63, 64, and 67 will be described, with FIG. 57 as a representative drawing thereof. However, since it is easy to see that the same method or almost similar method may be applied to the remaining drawings, it will not be described separately.

In FIG. 57, different phonemes are paired and assigned to each button as follows.

'ㄱ' and'ㄴ','ㄷ' and'ㄹ','ㅁ' and'ㅂ','ㅅ' and'ㅇ','ㅈ' and'ㅊ','ㅋ' and'ㅌ','ㅍ 'And'ㅎ','ㅏ' and'ㅑ','ㅓ' and'ㅕ','ㅗ' and'ㅛ','ㅜ' and'ㅠ','ㅡ' and'ㅣ'

(For reference, the 40 Korean phonemes are as follows.

14 basic consonants: ㄱ ㄴ ㄷ ㄹ ㅁ ㅂ ㅅ ㅇ ㅈ ㅊ ㅋ ㅌ ㅍ ㅎ

5 hard tones: ㄲ ㄸ ㅃ ㅆ ㅉ

10 basic vowels: ㅏ ㅑ ㅓ ㅕ ㅗ ㅛ ㅜ ㅡ ㅣ

11 vowels: ㅐ ㅒ ㅔ ㅖ ㅚ ㅟ ㅘ ㅝ ㅢ ㅙ ㅞ)

To explain how to input 14 basic consonants and 10 basic vowels, since it is indicated as above in Fig. 57, the first phoneme assigned to each button is single-touched and then single-on and off (=single-touch). The phoneme assigned to each button is multi-all on & off (= multi-all on & off after 2 multi-touch). You probably already know that you can enter it without explaining it,

When explaining how to enter 11 vowels, you may already know that you can enter a combination of basic vowels.

To explain how to input a pair of consonants, there are two methods as follows (the first method is not recommended, and the second method is highly recommended).

To explain the first method,

As in most methods of inputting biconsonants in a device having a QWERTY keyboard for a conventional Korean smart phone as shown in FIG. 9, pressing the shift button (= an upward arrow) will place the diconsonant at the place where the diconsonant can be derived from among the basic consonants. When is displayed, the displayed double consonant is single-touched and then single-on and off.

As in the conventional smartphone QWERTY keyboard, when the shift button is pressed (the shift button is not shown in FIG. 57, it is necessary to add the shift button when applied to an actual device, or the upward arrow in the bottom row of FIG. 57 is called a shift button. You can consider it.),

When'ㄲ' is displayed in the place where'ㄱ' is assigned,'ㄲ' is single-touched and then single on and off, and'ㄲ' is entered.

When'ㄸ' is displayed in the place where'ㄷ' is assigned,'ㄸ' is single-touched and then single on & off, and'ㄸ' is entered.

If'ㅃ' is displayed in the place where'ㅂ' is assigned,'ㅃ' is single-touched and then single on & off, and'ㅃ' is input.

When'ㅆ' is displayed in the place where'ㅅ' is assigned,'ㅆ' is single-touched, and then'ㅆ' is inputted by single on/off.

When'ㅉ' is displayed in the place where'ㅈ' is assigned,'ㅉ' is single-touched and then single on and off, so that'ㅉ' can be input.

To explain the second method,

Like the Korean input method in the conventional Samsung Electronics or Pantech 12-keypad format,

Among the basic consonants, it is assumed that the consonants from which diconsonants can be derived are already assigned in the third order, but are not displayed only, and multi-all on&off (=3 multi-touch starts). As a method of inputting double consonants by multi-all on & off)

Considering that'ㄲ' is assigned to the 3rd digit of the button assigned with'ㄱ', the button assigned with'ㄱ' is multi-touched 3 times, then multi-all is turned on and off, and'ㄲ' is input.

Considering that'ㄸ' is assigned to the 3rd digit of the button assigned with'ㄷ','ㄸ' is input as Multi All On & Off after 3 multi-touching of the button assigned with'C',

It is assumed that'ㅃ' is assigned to the 3rd digit of the button assigned with'ㅂ', and'ㅃ' is input as Multi All On & Off after 3 multi-touch of the button assigned'ㅂ'.

It is assumed that'ㅆ' is assigned to the 3rd digit of the button assigned to'ㅅ', and'ㅆ' is input as Multi All On & Off after 3 multi-touch of the button assigned'ㅅ'.

This is a method in which'ㅉ' can be input by multi-all ON & OFF after three multi-touching of the button assigned'ㅈ' as it is assumed that'ㅉ' is assigned to the 3rd digit of the button assigned with'ㅈ'. .

When Korean is inputted in the second method, in the case of FIG. 63 or 64, particularly, in FIG. 63, when consonant is input, it is possible to enter a deep probability as follows.

1. Among the basic consonants, it can be said to be more basic consonants, and the frequency of use very high ㄱ, ㄴ, ㄷ, ㄹ, ㅁ ㅂ, ㅅ, ㅇ, ㅈ is assigned to the first order of each button, and is single-touched. Single on & after off Is entered,

2. Among the basic consonants, ㅊ, ㅋ, ㅌ, ㅍ, ㅎ, which can be called consonants with strokes added to the more basic consonants, are assigned to the second order of each button, 2 Multi-touched Hue multi all on & Off Is entered,

3. Diconsonant ㄲ, ㄸ, ㅃ, ㅆ, ㅉ are assigned to the third order of each button, 3 mul Multi All On & After Teach Touch Off Can be entered.

(If, like the button assigned to'ㅅ' in Fig. 63, among the basic consonants, such consonants are assigned solely to the button to which the consonant from which the double consonant can be derived is assigned, and in the second order, the letter is assigned in a blank state. If diconsonants can be assigned to the second order, including the case where they are not, assuming that the diconsonants are assigned to the second order, such diconsonants may be input as multi-all on/off after being multi-touched by two.)

Previously, it was only said that it was possible to input vowels by combining basic vowels, but to introduce a method of inputting Korean vowels as another method, as the basic vowels are assigned to each button as a complete form, the vowels are composed of a consonant button or a vowel button. The method of assigning a complete type to the 2nd, 3rd or 4th order and multi-all on&off after 2 multi-touching, or multi all on&off after 3 multi-touching, or multi-all on&off after 4 multi-touching. It can also be input by multi-all on&off method after including multi-touch. This can be understood by anyone who has understood the above description, and thus detailed description and drawings will be omitted.

In addition, the input principle related to FIGS. 8, 10, 11, or 4 is not limited to text input, but can be applied to the function of the function button as it is. In most cases, conventional function buttons are designed to exhibit only one function per button. After assigning and displaying two or more such functions per button, the above-described Figs. 8, 10, 11, and Alternatively, it can be implemented with the input principle related to FIG. 4.

For example, like the function button immediately under the button TUV in Fig. 56, a one-letter deletion function (= backspace function) is assigned to a function button as the first function of the function button, and a shift button function (upward arrow) Is assigned as the second function of the function button, that is, when two functions are assigned to the same button, (after single touch), if a single ON/OFF function is performed, the character deletion function is implemented, and the function button becomes the target button. (After multi-touch) If you turn multi all on and off, you can implement the shift button function.

That way, more functions can be implemented in buttons that take up the same space. In the conventional smart phone, the space is small, and even if only the text input mode is considered, the buttons that are naturally present on the computer keyboard including the DEL button and the INSERT button cannot be arranged, but this is solved to some extent by the above method.

And, when two or more functions are assigned to one virtual button, not only the functions required in the text input mode are possible, but also the function of the execution icon on the touch screen screen of smartphones, tablet PCs, notebooks, and desktop PCs. A detailed description of this will be omitted since it can be implemented by sufficiently inferring from the above description.

Of course, it is possible to implement as described above by allocating general characters for expressing the above-described functions and languages to the same button. For example, a single character deletion function (= backspace function) in the example in which a single character deletion function (= backspace function) and a shift button function (upward arrow) are assigned to a certain button above is alphabetized. By replacing S with S (after single touch), when single on & off, alphabet S is input, and multi-all on & off shift button function can be implemented so that the function button becomes the target button (after multi-touch).

For reference, regardless of the target button recognition method, depending on how the touch was performed and the operation was performed thereafter, any function described above may be implemented.

For example, spaces (=spaces) are among the most used in character input mode. When entering spaces, no specific button is the target button, but only anywhere on the input keypad (or a specific designated area). In) After 4 multi-touch, you can also enter multi-all ON&ON. Of course, when implementing general character input or functions, it will be possible when multi-all on & on signals are not used after 4 multi-touch.

In addition, the above-described method can be applied to a conventional Qwerty keyboard as shown in FIG. 7 or 60.

If the multi-touch is expressed in detail as n multi-touch, the specific sequence number is not determined according to the n value, but according to the n value, that is, according to the situation before the final operation, among at least one character group. A specific character group is matched, and while belonging to the matched character group, at least one character among at least one character related to the target button may be input without changing the character mode.

For example, if the current text mode is the lowercase letter mode,

1) Single on&off is used to input lowercase letters in English,

2) Multi ON&OFF is used so that even though the current text mode is an English lowercase mode, English uppercase letters are input without changing the text mode. That is, without changing the text mode, it is possible to input a text in another text mode corresponding to the current text mode.

For example, if the current text mode is an English lowercase letter mode,

When button S is single on & off, small letter s is input, and multi all on & off so that button S is recognized as a target button, capital letter S can be input even though the current letter mode is an English lower case mode.

In addition, the "specific character group" may be any one of the following character groups.

1) Any one character group among two or more different character groups classified into different groups according to the spelling rules.

2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.

To expand further, it can also be extended in the following cases.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

Hereinafter, as a method of additionally inputting predetermined characters in addition to the characters assigned to the target button by manipulation after touch, a method of inputting two or more characters by manipulation after one touch will be described.

In a device having a touch screen, in the method for inputting characters,

In the case of operation after multi-touch so that a specific button is recognized as a target button after the keyboard is displayed on the touch screen,

The final operation of at least one of the final operations that can include the drag in each direction of off or upper, lower, left, right (upper left, lower left, upper right, lower right) begins. After the time when the last operation is started, or after the time when the final operation begins, including after the time when the last operation ends,

By multi-touch post-operation including the final operation of at least one of the final operations that may include off or multi-drag in 8 directions,

Belonging to a specific character group among at least one character group,

A first character that is a specific character among at least one character associated with (or assigned to) the target button, and

Regardless of the target button, this method may be a method of additionally inputting a second character, which is at least one specific character promised for each final operation.

Additionally, according to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character belonging to the matched character group is assigned to the target button without changing the character mode. It can be entered additionally with text. And, when there are two or more letters assigned to the target button,

Depending on the situation before the final operation, the first character may also be selected.

First, the case of application to an English keyboard will be described as an example. 7 (or FIG. 60) illustrates an English QWERTY keyboard, but it can be seen that only one character is displayed per button.

On the English QWERTY keyboard shown in FIG. 7 (or FIG. 60), after a touch operation is used, two or more characters may be input simultaneously with a single operation.

To be more specific, in addition to the character assigned to the target button, one character including a specific vowel or half vowel (or half consonant) or consonant is additionally entered, or 2 including the suffix ING of the present continuous form and the suffix ED of the past tense. More than one character can be implemented to be input in addition to the character assigned to the target button.

In the following, in English character input, it is assumed that the target button is button S, and after the button S is touched (single touch or multi-touch) to be recognized as the target button, drag or turn off in four directions (up, down, left, right). It will be described that, for example, specific characters are additionally input together with the character assigned to the target button by taking an example that another character is additionally input along with the S through the operation that is performed.

First, in the case of multi-on/off or multi-all dragging in four directions, a description will be given of allowing A, E, I, O, U to be additionally input in addition to the letter assigned to the target button.

(When this method is applied to characters other than English, it corresponds to the pronunciation of [a], [e], [i], [o], [u] on English phonetic symbols instead of A, E, I, O, U. It is recommended to be replaced with a character that says.)

For example, when the button S is multi-touched (eg, FIG. 44), as shown in the left drawing of FIG. 13, all five'S+ vowels' are popped up, and multi-all on-off or multi-all drag in four directions is performed. Thus, one of SA, SI, SE, SU, or SO may be input. (Of course, pop-ups may be omitted. All pop-ups may be omitted throughout the present application.)

To explain in more detail, in a state in which all five'S+ vowels' are popped up by multi-touch, a desired'S+ vowel' can be input by dragging the multi-all in the direction in which the desired'S+ vowel' is located. If the desired'S+ vowel' is positioned in the center, all fingers are turned off without dragging, and as a result, the'S+ vowel' positioned in the center may be input by turning multi-all on and off.

In this case, instead of SE, SI, SO, and SU as shown in the right diagram of FIG. 13, it may be implemented to indicate only E, I, O, and U as shown in the right diagram of FIG. 13.

To explain for a specific example, as shown in FIG. 13, after two multi-touch with an index finger and a middle finger so that button S is recognized as a target button (eg, FIG. 44),

1) When'Multi All On&Off', A is additionally input with S assigned to the target button, that is, SA is input,

2) When'multi-all dragging' upwards, I is additionally input along with S assigned to the target button, that is, SI is input,

3) When'multi-all drag' to the right (e.g., Fig. 62), E is additionally input along with the S assigned to the target button, that is, SE is input,

4) When'multi-all drag' to the lower side, U is additionally input along with the S assigned to the target button, that is, SU is input,

5) When'multi-all drag' to the left, O can be additionally input along with S assigned to the target button, that is, SO can be input.

On the other hand, it is possible to input the two touches in a necessary manner, but as a method that is not recommended, when the button S is multi-touched, all five'S+ vowels' are popped up as shown in the left drawing of FIG. 13, First, all fingers are turned off, and in that state, a desired'S+ vowel' is selected as a touch (eg, single touch), so that one of SA, SI, SE, SU, or SO can be input. In this case, it is also possible to implement only E, I, O, and U as shown in the right diagram of FIG. 13 instead of SE, SI, SO, and SU as shown in the right diagram of FIG. 13.

Of course, the method of notifying what additional characters are input according to the on/off and drag directions is possible in a method other than the pop-up method in FIG. 13, and the user does not inform the user what the additional characters are input. You can also rely on memorizing only.

In the method in which specific characters are additionally input together with the character assigned to the target button in the present application including the above embodiment, the point of view that the additional character is not assigned to the target button is mainly described. It can also be described in terms of being assigned. However, this is only a matter of perspective and has nothing to do with understanding the principles of the present application. For example, in the above, A, E, I, O, U additionally input with S assigned to button S, which is the target button, includes those that are considered to be the 2nd to 6th characters assigned to button S. It can also be said that it is a method in which one of the 2nd to 6th characters is additionally input along with the 1st character assigned to each button by operation after one touch. The same applies to an embodiment in which specific characters are additionally input together with the character assigned to the target button, which will be described later.

On the other hand, it is a method that is not recommended because the method used in almost all QWERTY keyboards from the past is a method in which only the characters assigned to the target button are entered with a single ON&OFF.

In the case of single on/off or single dragging in 4 directions, A, E, I, O, U are additionally input in addition to the letter assigned to the target button.

When all five'S+ vowels' are popped up by a single touch, the desired'S+ vowel' can be input by dragging in the direction in which the desired'S+ vowel' is located. If the desired'S+ vowel' is located in the center, the finger is turned off without dragging and the'S+ vowel' located in the center can be input.

To explain with a specific example, after button S is single-touched with the index finger (so that it is recognized as a target button),

1) When single ON&OFF, A is additionally input with S assigned to the target button, that is, SA is input,

2) When'single drag' upwards, I is additionally input with S assigned to the target button, that is, SI is input,

3) When'single drag' to the right, E is additionally input along with the S assigned to the target button, that is, SE is input,

4) When'single drag' to the lower side, U is additionally input along with the S assigned to the target button, that is, SU is input,

5) When'single drag' to the left, O can be additionally input along with S assigned to the target button, that is, SO can be input.

On the other hand, it is not recommended because the number of multi-touched fingers in the on&off method and the drag method do not match. As an embodiment to which multi-on & off is applied,

1) When all four'S+ vowels' are popped up by a single touch, the desired'S+ vowel' is input by dragging in the direction in which the desired'S+ vowel' is located.

2) If the desired'S+ vowel' is located in the center, it can be entered as Multi All On & Off.

To explain with a specific example,

1) If button S is multi-touched with the index finger and middle finger to be recognized as the target button (e.g., Fig. 44), when multi-all is turned on and off, A is additionally input along with the S assigned to the target button, that is, SA is Is entered,

2) After the button S is single-touched with the index finger, when'single drag' upwards, I is additionally input along with the S assigned to the target button, i.e., SI is input,

3) If button S is single-touched with the index finger and then'single drag' to the right, E is additionally input with S assigned to the target button, that is, SE is input,

4) If button S is single-touched with the index finger and then'single drag' downward, U is additionally input with S assigned to the target button, that is, SU is input,

5) When the button S is single-touched with the index finger and then'single dragged' to the left, O can be additionally input together with the S assigned to the target button, that is, SO can be input.

For reference, I will introduce three methods of assigning the assigned positions for A, E, I, O, and U that are additionally input with S to make it easier to memorize. Other methods are possible.

As a first method, a method with reference to FIG. 14 will be described.

This method is the most recommended memorization method and is also a method applied to the above-described embodiments.

1) Since A is the most used vowel, it is assigned to the center,

2) Since I is a vertically standing shape, it is assigned to the top,

3) E is assigned to the right because the right side of the letter is bursting,

4) U is assigned to the bottom, reminiscent of the first spelling of the word Under (or U is assigned with two vertical lines at the bottom, since I with one vertical line is at the top),

5) Since O is the shape of a human mouth, it can be assigned to the left.

However, since this is only an example, the positions of A, E, I, O, and U that are additionally input together with S may be assigned differently from the above. The same is true for the following methods.

For example, since O is a shape that seems to be in the middle, it is possible to be assigned to the bottom, and it is possible to assign U to the left.

As a second method, as another example, according to the order of pronunciation during vocalization practice, A, E, I, O, U in order 1) A is assigned to the center first, 2) Clockwise from the top, E on the top, and the right It can be assigned an I to the bottom, an O to the bottom, and a U to the left.

As a third method, which is not recommended,

1) O is a shape that seems to be in the middle, so it is assigned to the center,

2) I is assigned to the top for the same reason as method 1,

3) E is also assigned to the right for the same reason as the first method,

4) U is also assigned to the bottom for the same reason as the first method,

5) The remaining A can be assigned to the left.

As a fourth method, which is not recommended,

1) O is a shape that seems to be in the middle, so it is assigned to the center,

2) I is assigned to the top for the same reason as method 1,

3) E is also assigned to the right for the same reason as the first method,

4) An A with a shape like a pedestal or a steeple that can be well balanced in left and right is assigned to the bottom,

5) The remaining U can be assigned to the left.

Hereinafter, a process of inputting actual words will be described in detail.

15 is a diagram provided to explain a process in which the English word "SAME" is input. Entering the English word "SAME" is possible through the process of sequentially entering "SA" and "ME".

To explain with an example,

1) When button S is multi-touched with the index finger and middle finger to be recognized as the target button, and when'multi all on & off', A is additionally input along with the S assigned to the target button, that is, SA is input.

2) If button M is multi-touched with the index finger and middle finger to be recognized as the target button, and then'multi-all drag' to the right, E can be additionally input, that is, ME, together with the M assigned to the target button.

16 is a diagram provided for explanation of a process in which the English word "BEAUTIFUL" is input. Entering the English word "BEAUTIFUL" is possible through the process of sequentially entering "BE", "AU", "TI", "FU", and "L".

To explain with an example,

1) If button B is multi-touched with the index finger and middle finger to be recognized as the target button, and then'multi-all drag' to the right, E is additionally input along with B assigned to the target button, that is, BE is input.

2) If button A is multi-touched with the index finger and middle finger to be recognized as the target button and then'multi-all drag' downward, U is additionally input along with the A assigned to the target button, that is, AU is input.

3) If button T is multi-touched with the index finger and middle finger to be recognized as the target button and then'multi-all drag' upwards, I is additionally input along with the T assigned to the target button, that is, TI is input.

4) If button F is multi-touched with the index finger and middle finger to be recognized as the target button and then'multi-all drag' downward, U is additionally input along with the F assigned to the target button, that is, FU is input,

5) Button L is single ON & OFF so that L can be input.

Referring to FIGS. 15 and 16, according to the character input method according to the present embodiment in which the representative vowels A, E, I, O, and U, which are representative vowels, can be simultaneously input together with the character assigned to the target button, the input speed is You can guess that it can be significantly faster.

It may be more useful in the tablet PC Qwerty keyboard as shown in FIG.

And, in the above, it has been described that A, E, I, O, and U are additionally input together with the character assigned to the target button, but this is only an example for convenience of explanation, so it may be implemented differently. .

That is, in addition to vowels, characters other than A, E, I, O, U, including half vowels, half consonants, and consonants, can be implemented to be additionally input together with the letter assigned to the target button.

If the number of buttons is less than all alphabetic numbers used like a 3X4 type, 4X4 type or 5X4 type keyboard, alphabets with a high frequency of use should be displayed on the touch buttons, and characters with a low frequency of use should be operated after touching. You can also have them entered together.

On the other hand, it is possible to realize that a vowel is additionally input in addition to the character assigned to the target button by operation after multi-touch, and the consonant is used together with the character assigned to the target button by operation after a single touch. It is preferable that other consonants that are input together by manipulation after a single touch are composed of consonants with a high frequency of use.

T, S, N, R, H, D, L, and C are consonants that are frequently used with other English characters in order of frequency.

And, for example, as in the above-described embodiment

In the case of'Multi All On & Off' and'Multi All Drag', A, E, I, O, U are entered together with the letter assigned to the target button,

In the case of'single drag', make sure to input T, S, N, R together with the letter assigned to the target button,

In the case of multi-all dragging after a single touch, make sure to input H, D, L, C in addition to the letter assigned to the target button.

In the case of finger dragging based on multi-not all, make sure to input W, Y along with the letter assigned to the target button,

Multi-Not All-Not When the finger is dragged,? (Question mark),. (Dot),, (comma),! (Exclamation mark) can be entered in addition to the character assigned to the target button without changing the device settings. .

In other words, it is possible to change the operation method after the touch and change the input character group together with the character assigned to the target button without changing the settings of the device.

In other words, it can be said that a specific character group additionally input is matched according to the situation before the final operation without changing the character mode.

That is, according to the situation before the final operation, a specific character group is matched among at least one character group, and the characters of the matched character group are inputted without changing the character mode.

First, in the case of'single drag', a description will be given of making additional inputs of T, S, N, and R in addition to the letter assigned to the target button.

For example, as shown in FIG. 17, after the button S is'single touch' with the index finger,

1) When the index finger is'single drag' to the left, T is additionally input with S assigned to the target button, that is, ST is input,

2) When the index finger is'single drag' downward, S is additionally input along with the S assigned to the target button, that is, SS is input,

3) When the index finger is'single drag' upward, N is additionally input along with the S assigned to the target button, that is, SN is input,

4) When the index finger is'single drag' to the right, R can be additionally input along with S assigned to the target button, that is, SR can be input.

When reminiscent of the contents shown in FIG. 18, it is possible to easily memorize how the additionally input characters along with the characters assigned to the target button vary according to the dragging direction.

Now, in the case of multi-all dragging after a single touch, H, D, L, and C are additionally input in addition to the letter assigned to the target button.

For example, as shown in FIG. 19, after'single touch' with the index finger so that the button S becomes the target button, the index finger is in a state where the touch state of the index finger is maintained for a certain period of time (for example, 0.1 seconds) or more. 2 Multi-touch so that button S is recognized as the target button by making it touch with the middle finger anywhere on the right side of the touched part,

1) When the index and middle finger are multi-drag upward, H is additionally input with S assigned to the target button, that is, SH is input,

2) When the index and middle finger are multi-drag to the right, D is additionally input with S assigned to the target button, that is, SD is input,

3) When the index finger and middle finger are multi-all dragged downward, L is additionally input with S assigned to the target button, that is, SL is input,

4) When the index and middle finger are multi-drag to the left, C can be additionally input along with S assigned to the target button, that is, SC can be input.

Recalling the contents shown in FIG. 20, it is possible to easily memorize how the characters assigned to the target button and additionally input characters vary according to the dragging direction.

(S should be marked in the center of Fig. 20, but since it is incorrectly marked as I, please change it.)

Now, in the case of multi-not all-based finger dragging, a description will be given of inputting W and Y in addition to the letter assigned to the target button.

For example, assuming that two multi-touch with the index and middle finger of the right hand, the index finger is recognized as the reference finger, and the middle finger becomes the sickle reference finger,

As shown in Fig. 22, after two multi-touch with the index finger and middle finger so that the button S is recognized as the target button, only the middle finger, which is the sickle reference finger, is turned off, and the touch state of the index finger is maintained,

1) When the index finger is dragged to the right, Y is additionally input with S assigned to the target button, that is, SY is input,

2) When the index finger is dragged to the left, W can be additionally input together with S assigned to the target button, that is, SW can be input.

When reminiscent of the contents shown in FIG. 23, it is possible to easily memorize how the additionally input characters along with the characters assigned to the target button vary according to the dragging direction.

Now, when the multi-not all-not standard finger is dragged, frequently used special characters "? (question mark),. (Dot),, (comma),! (Exclamation mark)" are entered in addition to the character assigned to the target button. Let me explain with an example.

For example, assuming that two multi-touch with the index and middle finger of the right hand, the index finger is recognized as the reference finger, and the middle finger becomes the sickle reference finger,

As shown in Fig. 21, after two multi-touch with the index finger and middle finger so that the button S is recognized as the target button, only the index finger, which is the reference finger, is turned off, and the touch state of the middle finger, which is the sickle reference finger, is maintained,

1) When the middle finger is dragged upward,? (Question mark) is additionally input with S assigned to the target button, that is, S? is input,

2) When the middle finger is dragged to the right, .(dot) is additionally input with the S assigned to the target button, that is, S. is input,

3) When the middle stop is dragged to the left,, (comma) is additionally input with the S assigned to the goal button, that is, S, is input,

4) When the index finger is dragged downward, the! (Exclamation mark) can be additionally input with the S assigned to the target button, that is, the S! can be input.

On the other hand, multi-touch operation including'single-touch and drag' or'multi-touch and drag' is used, and the number of additional characters to be input along with the character assigned to the target button in the'target button' is 2 instead of 1 It is also possible to implement more than one.

For example, depending on whether the touch before dragging is single or multi, the number of additionally input characters together with the character assigned to the target button may be determined.

For a more specific example, in the case of'single touch and drag', the number of additional characters to be input together with the character assigned to the target button is 1, and in the case of'multi-touch and drag', the character assigned to the target button and The number of additional characters to be input together is 2 or more, and each can be implemented.

On the other hand, in the case of short dragging after touching, the number of characters input with the character assigned to the target button is 1, and in the case of long dragging after the touch, the number of characters input together with the character assigned to the target button is 2, It is also possible to implement each.

For example, after two multi-touch with the index finger and middle finger so that button S is recognized as the target button,

1-1) If you drag the multi-all to the upper side briefly,'I' is additionally input with the S assigned to the target button, that is, SI is input.

1-2) When multi-all dragging upwards,'II' (or'ING') is additionally input with S assigned to the target button, that is, SII (or SING) is input,

2-1) If you drag the multi-all to the right briefly,'E' is additionally input along with the S assigned to the goal button, that is, SE is input.

2-2) When multi-all dragging to the right,'EE' or'ED' (past-type suffix) is additionally input along with the S assigned to the target button, that is, SEE (or SED) is input,

3-1) If you drag the multi-all to the left briefly,'O' is additionally input with the S assigned to the goal button, that is, SO is input.

3-2) If you drag the multi-all long to the left,'OO' (or'ON') is additionally input with the S assigned to the target button, that is, SOO (or SON) is input.

4-1) If you drag the multi-all down shortly,'U' is additionally input along with the S assigned to the target button, that is, SU is input.

4-2) When the multi-all drag is long downward,'UU' (or'US') is additionally input together with the S assigned to the target button, that is, SUU (or SUS) can be input.

On the other hand, the same direction may be dragged two or more times in a row or the drag direction is changed, so that each time the characters are dragged, additional characters may be input in succession.

For example, in the case where a character that is additionally inputted together with a character assigned to the target button according to the drag direction is as shown in FIG. 13, as shown in FIG. 24,

1) After multi-touch with the index and middle fingers so that the button S is recognized as the target button, when the index and middle fingers are multi-all dragged to the right,'SE' is input as shown in [1] of FIG. 24,

2) Even after'SE' is input, if the index finger and the middle stop are not turned off, and if multi-all drag is done to the right one more time,'E' is additionally input, and as a result,'SEE' is input as shown in [3] of Fig. 24. And

3) After inputting'SE', if the index and middle finger are not turned off and dragged to the left,'O' is additionally input, and as a result,'SEO' is input as shown in [4] in Fig. 24.

4) After inputting'SE', if the index finger and the middle finger are not turned off and drag the multi-all to the lower side and then multi-all to the left, the'U' and'O' are additionally inputted, as shown in Fig. 24 [2]. It can be implemented so that'SEUO' is input together.

On the other hand, as in a keyboard including a 3X4 keyboard arrangement as shown in FIG. 3 or 4, when a plurality of characters are assigned to the same button, other characters (e.g., A, E, I) together with the characters assigned to the target button , O, U) are additionally entered,

Depending on the operation method, it is possible to determine what character is assigned to the target button that is input together with other characters (eg A, E, I, O, U).

For example, in the case of a button in which'J, K, L'is assigned to button 5 of FIG. 4 together,

Button 5 with'J, K, L'assigned together can be recognized as the target button.

1) A single ON&OFF and a single drag in four directions allow A, E, I, O, U to be additionally input along with the J assigned to the target button first in a similar principle to the above embodiments,

2) A, E, I, O, U can be additionally input along with the second K assigned to the target button with the same principle as the above embodiments with multi-all on&off and multi-all drag in four directions. and,

3) A, E, I, O, U with the third L assigned to the target button using a principle similar to the above examples by using multi-not all-based finger on & off and 4-way multi-not all-based finger dragging. You can also have additional inputs.

Also, depending on the situation before the final operation, a specific character group is matched among at least one character group, and the characters of the matched character group are matched. It can be said that it is an input method without changing the text mode.

On the one hand, it is also possible to implement a button that induces a combination with another button such as a shift button, a control button, and an alt button to exert an effect combined with such a button without being used.

For example, after 2 multi-touch with the index finger and middle finger so that button S in FIG. 7 (or FIG. 60) is recognized as a target button (eg, FIG. 44),

1) When the index and middle fingers are'multi-all drag' upward,'control + S'is input, that is, the effect of pressing button S while holding down the control button is exerted.

2) When the forefinger and middle finger are'multi-all drag' to the right,'ALT+S' is input, that is, the effect of pressing button S while holding down the alt button is exerted.

3) When the index and middle fingers are'multi-all drag' to the lower side,'Shift+S' is input, that is, the effect of pressing button S while holding down the shift button can be exerted.

It is possible to implement a single-touch operation or multi-touch operation after a single-touch operation or multi-touch operation so that it is recognized as a target button in Korean, so that additional characters (such as vowels) are input together with the characters (such as consonants) assigned to the target button.

For example, in the same character mode including the conventional Korean QWERTY keyboard as shown in FIG. 9 (or FIG. 61), in the keyboard in which most of the characters are assigned to each button, use the index finger so that the button'ㅈ' is recognized as the target button. After single touch,

1) When single dragging upwards,'ㅗ' is additionally input along with'ㅈ' assigned to the target button, resulting in'Joe' being input,

2) When single dragging to the right,'ㅏ' is additionally input along with'ㅈ' assigned to the target button, and as a result,'ruler' is input.

3) When single dragging downwards,'TT' is additionally input along with'ㅈ' assigned to the target button, resulting in'week' being input.

4) When single dragging to the left,'ㅓ' is additionally input along with'ㅈ' assigned to the target button, so that'me' can be input as a result.

(In order to recognize the rightmost button'ㅔ' and button'ㅣ' as the target button when multi-touching in FIG. 9, in most cases, a letter is not assigned to the rightmost side as shown in FIG. 10 or FIG. It would be even better if there was enough free space.)

And, for example, in the conventional Korean QWERTY keyboard as shown in FIG. 9 (or FIG. 61), after two multi-touch with the index finger and the middle finger so that the button'ㅈ' is recognized as the target button,

5) When multi-all dragging upwards,'ㅛ' is additionally input along with'ㅈ' assigned to the target button, and as a result,'Joe' is input.

6) When multi-all dragging to the right,'ㅑ' is additionally input along with'ㅈ' assigned to the target button, and as a result,'ja' is input.

7) When multi-all dragging downwards,'T' is additionally input with'ㅈ' assigned to the target button, resulting in'Ju' being input.

8) When multi-all dragging to the left,'ㅕ' is additionally input along with'ㅈ' assigned to the target button, and as a result,'low' can be input.

Here, according to the situation before the final operation, a specific character group is matched among at least one character group, and the characters of the matched character group are inputted without changing the character mode.

On the other hand, as in the Cheonjiin keyboard as shown in Fig. 12, which is a type of the conventional Hangul 3X4 keyboard, even when a number of characters are assigned to the same button, the number of fingers at the time of touch and the type of operation after the touch are different, With each consonant assigned to,'ㅗ,ㅏ,ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ' can be additionally input.

In other words, when multiple characters are assigned to the same button, other characters (e.g.'ㅗ,ㅏ, ㅜ,ㅓ,ㅛ,ㅑ, ㅠ,ㅕ') are added together with the characters assigned to the target button. In being input,

Depending on the number of fingers and operation method when touching, the character assigned to the target button that is input together with other characters (e.g.,'ㅗ,ㅏ, ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ') can be determined. You may.

For example, in the case of a keyboard to which the Cheonjiin Hangul input method as shown in Fig. 12 is applied, only'ㅈ, ㅊ'is marked on button 9, but'ㅈ, ㅊ, ㅉ'is assigned to the unmarked'ㅉ' Has been. In the case of buttons with'ㅈ, ㅊ, ㅉ', so that the button with'ㅈ, ㅊ, ㅉ'can be recognized as the target button.

1) Eight vowels,'ㅗ,ㅏ, ㅜ,ㅓ,ㅛ,ㅑ, ㅠ, ㅕ'are additionally input together with'ㅈ' as in the above embodiment with single drag in 4 directions and multi old lag in 4 directions. To be able to be,

2) Four-way multi-not all standard finger drag and four-direction single-touch multi-not all standard finger drag with'ㅊ' and'ㅗ,ㅏ, ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ' Vowels are additionally entered,

2) Multi-not all-not standard finger drag in 4 directions and single touch in 4 directions, then multi-not all not standard finger drag with'ㅉ' and'ㅗ,ㅏ, ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ' Eight vowels can be additionally input.

Here, according to the situation before the final operation, a specific character group is matched among at least one character group, and the characters of the matched character group are inputted without changing the character mode.

In addition, it is possible to implement a consonant assigned to the target button and another vowel to be input together by using another manipulation method including a long dragging operation for other vowels other than the eight vowels among 21 Korean vowels.

For example, when'long dragging', vowels added with'ㅣ' may be input in addition to vowels that are additionally input when'short dragging' is performed. Specifically,

1) In case of a short single drag to the right,'ㅏ' is added, and in case of a long single drag to the right,'ㅐ' is additionally input along with the consonant assigned to the target button.

2) In case of a short single drag to the left,'ㅓ' is added, and in case of a long single drag to the left,'ㅔ' is additionally input along with the consonant assigned to the target button.

3) In the case of a short single dragging upward,'ㅗ' is additionally inputted with the consonant assigned to the target button, and'ㅚ' in the case of a long single dragging upward,

4) In the case of a short single drag downward,'TT' is added, and in the case of a long single drag downward,'ㅟ' is additionally input along with the consonant assigned to the target button.

5) In the case of a short multi-all dragging to the right,'ㅑ' is added, and in the case of a long multi-all dragging to the right,'ㅒ' is additionally input along with the consonant assigned to the target button.

6) In the case of a short multi-all dragging to the left,'ㅕ' can be added, and in the case of a long multi-all dragging to the left,'ㅖ' can be added together with the consonant assigned to the target button.

In addition, in the previous English input embodiment, a method in which characters are continuously inputted each time the dragging direction is changed or dragged twice or more in a row in the same direction may be applied to Korean.

For example, after the consonant button is recognized as a target button, it is possible to combine two operations and input two vowels together.

For a more specific example, after a single touch with the index finger or two multi-touch with the index finger and middle finger so that the button'ㅈ' is recognized as the target button (in the case of single dragging in the following, it is considered as single-touch, and in the case of multi-drag Can be regarded as multi-touched.),

1) After'single drag' to the upper side and'ㅗ' is selected, the finger is not turned off and the finger is continuously'single drag' to the right and'ㅏ' is selected, so that the vowel'ㅘ' with'ㅈ' is Is additionally entered, resulting in'left',

2) After'single drag' to the lower side and'TT' is selected, the finger is not turned off and'single drag' to the left is selected and'ㅓ' is selected, so that the vowel'ㅝ' with'ㅈ' is It is additionally entered, and as a result,'Give' is entered,

3) After'single drag' to the upper side and'ㅗ' is selected, the finger is not turned off, and'single drag' to the right for a long time and'ㅐ' is selected. As a result, the vowel'ㅙ' with'ㅈ' Is additionally entered, resulting in'Zone',

4) After'single drag' to the lower side and'TT' is selected, the finger is not turned off and the finger is continuously'single drag' to the left and'ㅔ' is selected, so the vowel'ㅞ' with'ㅈ' Is additionally input, and consequently,'zoom' can be input.

Korean vowels are 10 basic vowels (ㅏ ㅑ ㅓ ㅕ ㅗ ㅛ ㅜ ㅠ ㅡ ㅣ) and 11 complex vowels (ㅐ ㅒ ㅔ ㅖ ㅚ ㅟ ㅘ ㅝ ㅢ ㅙ ㅞ), a total of 21 vowels.

In the previous examples, out of a total of 21 vowels, it was examined that the remaining vowels except for'ㅡ','ㅣ' and'ㅢ' are input together with the consonants assigned to the target button.

In case'ㅡ','ㅣ' and'ㅢ' are entered, separate buttons for'ㅡ' and'ㅣ' are provided, and combinations of'ㅡ','ㅣ' and ('ㅡ','ㅣ' In)'ㅢ' can be entered, but it is also possible to assign a separate operation method for inputting'ㅡ','ㅣ' and'ㅢ'.

For example, in the Hangul input example so far, only drag was used, and on&off was not used, so now I am going to use on&off.

For example, after two multi-touch with the index finger and middle finger so that the consonant button'ㅈ' is recognized as the target button,

1) In the case of'Multi All On&Off', the vowel'ㅡ' is additionally input along with the'ㅈ' assigned to the target button, and as a result,'Z' is input.

2) In the case of'Multi-Not All-Based Finger On & Off', the vowel'ㅣ' is additionally input along with'ㅈ' assigned to the target button, and as a result,'ji' is input.

3) In the case of'Multi-Not All-Not Standard Finger On & Off', the vowel'ㅢ' is additionally input together with the'ㅈ' assigned to the target button, and as a result,'Zㅣ' can be input.

The text input method described so far is applicable to other kinds of languages other than the mentioned languages. For example, it is applicable to Greek/Roman, Cyrillic, Arabic, Southeast Asian, Indic, Thai, Vietnamese, and detailed languages such as English, French, German, and Spanish.

In the above embodiments, in the drag direction, it was described only as dragging in a total of four directions, up, down, left, and right, but more work is possible when subdividing the direction. For example, when dragging in the lower right (southeast), lower left (southwest), upper right (northeast), and upper left (northwest) directions is added, more characters are assigned to one button and input or various tasks may be performed.

As well as,

The drag is divided into short dragging and long dragging according to the drag length,

Depending on the drag direction, the drag is subdivided into straight drag, return drag, shape drag,

Multi-not all-not standard finger on & off, multi-not all-not standard finger drag, and more, more work becomes possible.

4. How to manipulate objects

Until now, it has been described that characters are input by manipulation after touch. Hereinafter, the method used in the text input method is used, and a method of manipulating an object such as a picture, a picture, a browser, and a window will be described in detail.

In the present embodiment, among various post-multi-touch manipulation methods, a method of recognizing a target button by a reference finger is used, but among the multi-touched fingers, the finger located at the leftmost (= 1st from the left) is a'reference finger'. I will use the method determined by. More specifically, multi-touch is performed using an index finger and a middle finger, and a method in which the index finger is recognized as a'reference finger' is assumed.

According to the method to be described later, it is difficult to predict the exact position of the boundary line of the active area of the object when the object is activated, such as a star shape, not when the boundary line of the active area is formed in the same shape as the rectangle, or the object. Even if it is difficult to multi-touch only the inside of the object area because of too small, after multi-touching the object (or the active area of the object) to become the target button, it is possible to change the shape of the object including zoom in/out without the need for an object activation step. Do.

Conventionally, after the thumb and index finger are multi-touched on the object, the object becomes smaller when the thumb and index finger move in the direction where the thumb and index finger are closed, and the object becomes larger when the thumb and index finger move in the direction where the thumb and index finger are spread apart. This method is commonly used in smartphones including Apple's iPhone, and has the disadvantage of expanding or reducing the size of the object only while maintaining the ratio of the width and height of the object.

If you wanted to change only the horizontal or vertical length without maintaining the ratio of the horizontal and vertical length of the object, the step of activating the object was required as a preparatory step for transforming the shape of the object by clicking the object with the mouse. .

However, according to the present application, after the object (or the active area of the object) is multi-touched to become the target button, the shape of the object can be changed by'manipulating after multi-touch', so the step of activating the object is not required, and the touch screen In, multi-touch can be used to change the shape of the object.

The phrase "active region of an object" is used herein.

Although according to the method of the present application there is no need for a process for the object to be activated, such a phrase is used. In this application, the meaning of the phrase "activated area of an object" does not actually mean the area within the boundary of the active area of the object when the object is activated, but is reminiscent of how the shape of the object is transformed after the object is activated, as in the prior art. When the object is activated, it is the area within the boundary of the active area, that is, the area within the boundary of the active area of the object when it is assumed that the object will be activated.

And, the term "object area" refers to an area occupied by an object. The size of the object area will be less than or equal to the size of the active area of the object as long as there is no abnormal change. Referring to FIG. 39, it can be said that the object area exists in the active area of the object.

In addition, there are many cases where it is safe to abbreviate the object area as an object.

So, in order to change the shape of the object without the need for the activation step of the object even when the point outside the object area but still inside the active area of the object is multi-touched, the expected active area of the object is Even if the object is multi-touched to be recognized as the target button, the object is set to be activated, so that the shape of the object is recognized by the device as being multi-touched to change the shape of the object, and the shape of the object must be changed by subsequent manipulations. . In the case where the object area is multi-touched to be recognized as a target button, of course, it is recognized by the device as being multi-touched to change the shape of the object by the user, and the shape of the object must be changed by subsequent manipulations.

Since the multi-touch signal required to implement the method of the present invention is different from the conventional method, it may be used in parallel with the conventional method. And, because the size of the object is too small, the object cannot actually be multi-touched, so even an object that could not be enlarged or reduced by the conventional multi-touch zooming method cannot actually be multi-touched. If the object is multi-touched so that it can be recognized as a target button, such an object can be enlarged or reduced. And, because the size of the object is too small, by the method of expanding the object after being activated by a conventional mouse, it cannot be enlarged in the diagonal direction immediately, and it cannot be enlarged in the diagonal direction only after it is enlarged in the horizontal or vertical direction. An object that could have been able to be enlarged in a diagonal direction can be made by the method of the present application.

Hereinafter, some concepts of the direction will be described. (Here, the concept of the direction is described in the section "3. Character input method on a touch screen" and also in the field to which the present application is applied, as it is or modified or partially. It can be selected and applied.)

When referring to the vertical direction including the upper and lower sides, which are words used in the following description, from the user's point of view, even if the user tries to drag in the perfect vertical direction including the perfect upper side and the perfect lower side, there is no user capable of such dragging. From the device's point of view, when recognizing the user's intended drag direction, the trajectory actually dragged by the user is close to a straight line within a set curvature range, perfectly parallel to a vertical line (= a straight line parallel to the Y axis), or completely parallel. However, if it is parallel within the set range, it is judged by the device that the user attempted to drag in a perfect vertical direction including a perfect upper side and a perfect lower side, and the drag performed by the user is judged to be a perfect vertical direction including a perfect upper side and a perfect lower side. It refers to the vertical direction, including the upper and lower sides, which are judged when they become.

When referring to the horizontal direction including left and right, which are words used in the following description, from the user's point of view, even if they try to drag in the perfect horizontal direction including the perfect left and perfect right, there is no user who has the ability to drag like that. From the device's point of view, when recognizing the user's intended drag direction, the track actually dragged by the user is close to a straight line within the set curvature range, and is not perfectly parallel or perfectly parallel to the horizontal line (= a straight line parallel to the X axis). However, if it is parallel within a set range, it is judged by the device that the user attempted to drag in a perfect horizontal direction including the perfect left and perfect right, and the drag performed by the user would be judged to be a perfect vertical direction including the perfect top and perfect bottom. It refers to the vertical direction including the upper and lower sides determined at the time.

When referring to the diagonal direction including the upper left, lower left, upper right, and lower right, which are words used in the following description, when the device recognizes the intended drag direction, the determined direction is upper and lower. , Means a direction other than left or right. So, the diagonal direction does not mean only one exact direction, such as top, bottom, left, and right, but refers to a range that is a collection of directions other than top, bottom, left, and right. For example, even if only the upper right side is used, the upper right direction of various angles within 0 to 90 degrees including 10 degrees, 30 degrees, 45 degrees, 60 degrees, and 80 degrees with respect to the X-axis is used by the device. Is judged. So, there can be no perfect top left, perfect bottom left, perfect top right, perfect bottom right.

However, depending on the setting, the diagonal direction can also be set to mean only one exact direction, such as top, bottom, left, and right. For example, the upper right direction determined by the device may be set to mean only a 45 degree angle with respect to the X axis. That is, even if the direction dragged by the user is any of the upper-right directions from among the upper-right directions of a certain range, the device may set the angle to the X-axis to determine the upper-right direction of 45 degrees. In this case, there may be a perfect top left, a perfect bottom left, a perfect top right, and a perfect bottom right. However, from the user's point of view, even if a user tries to drag in a perfect diagonal direction including a perfect top left, a perfect bottom left, a perfect top right, and a perfect bottom right, there is no user capable of such dragging. When recognizing the drag direction, the trajectory actually dragged by the user is close to a straight line within a set curvature range, and the angle with the horizontal line (= a straight line parallel to the X axis) is a perfectly 45 degree angle direction, or a perfectly 45 degree angle direction. It is not, but it is determined by the device that the user attempted to drag in the direction of the perfect master line, including the perfect top left, perfect bottom left, perfect top right, and perfect bottom right, if the direction is 45 degrees within the set range. It refers to the diagonal direction including the top left, bottom left, top right, and bottom right when the drag is judged to be a perfect diagonal direction including a perfect top left, a perfect bottom left, a perfect top right, and a perfect bottom right.

In the above, a certain range when judged as upper, lower, right, left, upper left, lower left, upper right, lower right, may be considerably small or considerably large depending on the number of directions currently set.

In the description of the "1)" method to be described later, a method that only needs to be determined by separating the upper and lower directions is given as an example. In this embodiment, it is not necessary to cover the left and right as well as the upper left and upper right sides. As shown in (c) of FIG. 46, a certain range determined as the upper side may be set to a range of 180 degrees upward based on the hitting point, and a certain range determined as the lower side may be set as a range of 180 degrees downward based on the hitting point. .

Among the descriptions of the "2)" and "3)" methods to be described later, examples of the method of determining which are classified into upper, lower, left, right, upper left, lower left, upper right, and lower right are given as examples. In the case, when the diagonal direction is set not to mean only one exact direction, such as top, bottom, left, and right, but is set to mean a range that is an aggregate of directions other than top, bottom, left, and right, Fig.46(a) )As shown in the drawing, it is recommended that the angle range be set small (e.g. 10 degrees each) for a certain range in the upper, lower, left, and right directions, and diagonally including upper left, lower left, upper right, and lower right. For a certain range, it is recommended that the angle be set large (eg, by 80 degrees). If the diagonal direction is set to mean only one correct direction, such as top, bottom, left, and right, for example, the device is X-axis even if the direction dragged by the user is any of the top-right directions of a certain range. When the angle of and is set to be judged in the upper-right direction of 45 degrees, as shown in (b) of Fig. 46, a certain range of upper, lower, left, right, upper left, lower left, upper right, and lower right It is recommended to set the angle range of 45 degrees to divide the direction of 360 degrees.

(For reference, in the "2)" method to be described, it is a method that only needs to be determined by separating the upper, lower, left, right and diagonal directions, but in the diagonal direction, it can be divided into upper left, lower left, upper right, and lower right. It is not necessary in some cases, but since the upper, lower, left and right must be separated, as a result, the diagonal direction must also be divided into upper left, lower left, upper right, and lower right.),

If it is a method that only needs to be determined by separating only the upper, lower, left, and right directions, the diagonal direction including upper left, lower left, upper right, and lower right may not need to be distinguished. If the direction determined by the direction is set to mean only one correct direction, such as up, down, left, and right.For example, even if the direction dragged by the user is an upward direction among a certain range of upward directions, the device will be parallel to the Y-axis. In the case of setting to be judged in the upward direction, it is recommended to divide the direction of 360 degrees so that the upper, lower, left, and right certain ranges are all 90 degree angle ranges, as shown in (d) of FIG. 46.

A method of transforming various objects by the method of the present application will be described with reference to the following three methods, 1), 2), and 3).

1) After multi-touching the (object or) active area of the object to become a target button (= target object or target active area), it is enlarged when dragged in at least one first specific direction, and then expanded in at least one second specific direction. This is how it shrinks when dragged.

For example, after the index finger is recognized as the reference finger, and the index finger and middle finger are used so that the (object or) active area of the object becomes a target button (= target object or target active area), two multi-touch is performed,

When the index finger and middle finger are multi-all dragged upward, as the aspect changes from Fig. 26 to Fig. 37, the ratio of the horizontal length and the vertical length of the object is maintained and expanded, and when the index finger and middle finger are multi-all dragged downward , As the aspect changed from Fig. 37 to Fig. 26, it may be possible to reduce the ratio of the horizontal length and the vertical length of the object to be maintained. (Of course, in the above embodiment, the upper side is replaced with the right side, and the lower side is replaced with the right side. It may be implemented to be replaced with the left side, the upper side may be mixed to show the same result as the right side, and the lower side may be mixed to show the same result as the left side.)

In addition, it is a method that can be enlarged or reduced without changing the position of the center point of the object.

2) The object (or the active area of the object) is multi-touched to be recognized as the target button and then dragged, and only the horizontal length or the vertical length or the horizontal length of the object (or the active area of the object) is determined by the drag direction determined by the device. This is how the length and length are enlarged or reduced together.

To define this a little more specifically,

When the object (or the active area of the object) desired to change shape is multi-touched and dragged to be recognized as the target button, the dragging direction (determined by the device), that is, the dragging direction intended by the user, is the upper and lower sides. , In the case that it is determined to be one of the right and left directions,

When dragged in the first specific direction in the horizontal direction, the vertical length does not change, the horizontal length is enlarged,

When dragging in the second specific direction in the horizontal direction, the vertical length does not change, the horizontal length is reduced,

When dragging in the first specific direction in the vertical direction, the horizontal length does not change, the vertical length is enlarged,

When dragging in the second specific direction in the vertical direction, the horizontal length does not change, the vertical length is reduced,

When the object (or the active area of the object) desired to change shape is multi-touched and dragged to be recognized as the target button, the dragging direction (determined by the device), that is, the dragging direction intended by the user, is the upper right. , If it is judged to be one of the diagonal directions including the lower right, upper left, and lower left,

In the first way,

When dragged in at least one of the diagonal directions in the first specific direction, the horizontal length and the vertical length are enlarged at the same ratio,

When dragging in at least one of the diagonal directions in the second specific direction, there is a method in which the horizontal length and the vertical length are reduced at the same ratio,

In the second way,

When dragging in at least one first specific direction range among the diagonal directions, the variation ratio of the horizontal length and the vertical length is differently enlarged according to each direction within the range,

When dragging in at least one of the diagonal directions in the second specific direction range, there is a method in which the variation ratios of the horizontal length and the vertical length are differently reduced according to each direction within the range.

In addition, it is a method that can be enlarged or reduced without changing the position of the center point of the object.

To explain the above-described method as an example,

After the index finger is recognized as the reference finger, the index finger and middle finger are used so that the active area of the (object or) object becomes the target button, and 2 multi-touch,

When the index finger and middle finger are dragged upward in the vertical direction, the shape of the object is deformed so that only the vertical length is increased without changing the horizontal length of the object, as in the aspect that changes from Fig. 26 to Fig. 35, and the index finger and middle finger are in the vertical direction. When multi-all dragging in the middle of the lower direction, the shape of the object is deformed so that only the vertical length is reduced without changing the horizontal length of the object, as in the aspect that changes from Fig. 35 to Fig. 26,

When the index finger and middle finger are multi-drag to the right of the horizontal direction, the shape of the object is deformed so that only the horizontal length is increased without changing the vertical length of the object, as in the aspect that changes from Fig. 26 to Fig. 36, and the index and middle finger are horizontal When multi-all dragging in the left direction, the shape of the object is deformed so that only the horizontal length is reduced without changing the vertical length of the object, as in the aspect that changes from Fig. 36 to Fig. 26,

When the determined drag direction is diagonal,

As an embodiment of the first method,

Even if the index finger and middle finger are multi-all dragged in any of the various upper-right directions among the diagonal directions or in any of the various upper-left directions, the ratio of the horizontal length and the vertical length of the object is changed from Fig. 26 to Fig. 37. Even if the index finger and middle finger are multi-all dragged in any of the various directions of the lower right or the lower left of the diagonal direction, the horizontal length of the object is changed from Fig. 37 to Fig. 26. It can be implemented so that the ratio of and vertical length is maintained and reduced.

As an embodiment of the second method,

Depending on whether the index finger and middle finger are dragged in various upper-right directions among diagonal directions, in which upper-right direction among various upper-left directions, or in which upper left direction, the ratio of the horizontal and vertical length of the object is enlarged to be different. The ratio of the horizontal length and the vertical length of the object can be reduced so that the ratio of the horizontal length and the vertical length of the object is reduced depending on whether the and middle fingers are dragged in various directions to the lower right of the diagonal direction, or to which direction to the lower right or to the lower left of the various directions. You may.

3) In the Background Art section, "According to the method of this document, the object shape transformation method requires the activation step of the above conventional object only by multi-touching the object to be recognized as a target button (= target object). While having the same effect as performing the step, it is also possible to perform step 4 in the object shape transformation method, which requires the activation step of the conventional object in which 17 object change aspects are implemented, through multi-touch post-manipulation. It is a method that includes the method mentioned, "There is."

And, it is a method that can be enlarged or reduced while the position of the center point of the object is changed.

In more detail, it can be said that it is a method that consists of the following steps.

Step 1: The object (or the active area of the object) is multi-touched and dragged to be recognized as the target button, and a specific range inside the object (or the active area of the object) is the target range by the hitting point and the dragging direction. To be recognized as.

Step 2: As the horizontal or vertical length of the object (or the active area of the object) is changed according to the recognized target range and the determined drag direction, the starting direction of the drag is close to the center of the object (or the active area of the object). In the losing direction, it is reduced, and in the away direction, it is expanded. (The center of the object may be moved in the determined drag direction.)

Depending on the implementation method, the target range itself may be an object or the entire active area of the object. This will mainly be the case in a way that the center point of the object does not move. In the method of moving the center point, it is recommended that the object or a part of the active area of the object be recognized as the target range.

That is, expansion or reduction is determined not only according to the recognized target range or hit point, as well as the direction in which the drag started determined by the device, and optionally, if the center point is moved, the moving direction of the center point can also be determined. That's the way.

(In the above, the center of the object (or the active area of the object) is a straight line passing through the center of the object (or the active area of the object) that is perpendicular to the determined drag direction, or the object (or object) that is perpendicular to the determined drag direction. The result may be the same even if it is replaced by the concept of a straight line that divides the object (or the active area of the object) into two while passing through the center of the active area of ().)

From the user's point of view, the target range is determined first, and any point within the target range is selected as the target point, multi-touch so that the target point is the hitting point, and then drag is started. Likewise, it is possible to determine which range the user has considered as the target range based on two factors: the hitting point and the direction in which the drag starts.

In the above, there is a part that is not called the drag direction but is expressed as the direction where the drag started. To explain why, for example, when dragging downwards in the range 5 in FIG. 45, the center of the object when dragging starts However, if dragged downwards beyond the horizontal line passing through the center of the object, it becomes a direction away from the center of the object.However, it is a direction that approaches the center of the object until it reaches the horizontal line. From the moment it collapsed and crossed the horizontal line, it was not dragged downward as much as the length of the vertical side of the object, because it was not dragged downwards as far as the length of the object's center was, because the object should not be enlarged immediately. This is because it must be reduced continuously until it is dragged downward by the length of the vertical side of the object.

Adding some techniques to the above method is as follows.

① The object (or the active area of the object) that you want to change shape starts to be multi-touched and dragged to be recognized as the target button, and the specific range inside the object (or the active area of the object) is determined by the hitting point and the dragging direction. To be recognized as a target range,

If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper, lower, right, or left directions,

If the determined drag start direction is a direction that approaches the center of the object (or the active area of the object), two horizontal sides or two vertical sides of the object (or the active area of the object) are parallel to the determined drag direction. The lengths of the two sides are reduced, and the lengths of the two sides perpendicular to the determined drag direction remain unchanged (additionally, as the center of the object moves in the determined drag direction, the determined drag is among the three sides surrounding the recognized target range. The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side may not be changed.),

If the determined drag start direction is a direction away from the center of the object (or the active area of the object), two horizontal sides or two vertical sides of the object (or the active area of the object) are parallel to the determined drag direction. The length of the side is enlarged, and the length of the two sides perpendicular to the determined drag direction is unchanged.(Additionally, the center of the object moves in the determined drag direction, and the determined drag direction is among the three sides surrounding the recognized target range. The position of the side perpendicular to and is moved for enlargement, and the position of the opposite side of the side may not be changed.).

For the contents of the method "①", the aspects 1) to 8) of the 17 object change patterns in the 4th step in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section are the subject of the present application. This is a description of a method that may be implemented in the method of.

② The object (or the active area of the object) that you want to change shape starts to be multi-touched and dragged to be recognized as the target button, and the specific range inside the object (or the active area of the object) is determined by the hitting point and the dragging direction. To be recognized as a target range,

When it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper right, lower right, upper left, or lower left,

If the determined drag start direction is a direction that approaches the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced. In this case, if the horizontal side is reduced, both sides are reduced to the same length, and If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of change of the horizontal length and vertical length can be set to be different depending on which direction within a specific drag direction range determined by the device, or a specific drag direction range. You can also set the length of the width and height to be different in the same ratio, no matter which direction it is draped in. (And, additionally, as the center of the object moves in the determined drag direction, among the vertices in the recognized target range, the vertex closest to the straight line parallel to the drag direction is moved for reduction, and the position of the opposite vertex of the vertex May not change.)

If the determined drag start direction is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. In this case, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length. You can set the change ratio of the length and the vertical length to be different, or you can set the length of the horizontal and vertical length to be different in the same ratio no matter which direction is dragged within a specific drag direction range. (And, additionally, as the center of the object moves in the determined drag direction, among the vertices in the recognized target range, the vertex closest to the straight line parallel to the drag direction is moved to enlarge, and the position of the vertex facing the vertex May not change.)

The content of method "②" here is the method of the present application, among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section. This is a description of a method that may be implemented as.

To explain with a more specific example,

The object (or the active area of the object) that you want to change shape starts to be multi-touched and dragged to be recognized as the target button, and a specific range inside the object (or the active area of the object) is targeted by the hit point and the direction in which the drag starts. In order to be recognized as a range, two multi-touch with the index finger and middle finger so that the index finger is recognized as the reference finger,

1) After 2 multi-touching so that the 5th range of Fig.45(a) is recognized as the target range, the 5th range is touched with the index finger, which is the reference finger, and then multi-all is dragged. Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of an object mentioned in the background art section, "1)" is implemented.

2) After 2 multi-touching so that the 5th range of Figure 45(a) is recognized as the target range, the 5th range is multi-touched so that it is touched with the index finger as the reference finger. Among the 17 object change patterns in the 4th step in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "2)" is implemented.

3) After 2 multi-touching so that the 7th range in Fig.45 (a) is recognized as the target range, the multi-all is dragged so that the 7th range is touched with the index finger, which is the reference finger, when the drag starts and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "3)" is implemented.

4) After 2 multi-touching so that the 7th range in Fig.45 (a) is recognized as the target range, the multi-all is dragged so that the 7th range is touched with the index finger as the reference finger, when dragging starts and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "4)" is implemented.

5) After 2 multi-touching so that the 8th range of Fig.45(b) is recognized as the target range, the 8th range is multi-touched so that it is touched with the index finger, which is the reference finger, and then dragging to the right starts and when it is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "5)" is implemented.

6) Multi-touch dragging after 2 multi-touching so that range 8 in Fig. 45(b) is recognized as the target range is touched with the index finger, which is the reference finger, and when the drag starts to the left and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "6)" is implemented.

7) After 2 multi-touching so that the range 6 in FIG. 45(b) is recognized as the target range, the range 6 is multi-touched with the index finger, which is the reference finger, and then multi-all is dragged.When the drag starts to the right and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "7)" is implemented.

8) After 2 multi-touching so that the range 6 in Fig. 45 (b) is recognized as the target range, the range 6 is multi-touched to be touched with the index finger, which is the reference finger, and then dragged to the left. Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "8)" is implemented.

9) After multi-touching 2 so that the range 1 is touched with the index finger, which is the reference finger, so that the range 1 in the drawing (b) of FIG. 45 is recognized as the target range, the multi-all is dragged. Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "9)" is implemented.

10) After multi-touching 2 so that the range 1 is touched with the index finger, which is the reference finger, so that the range 1 in the drawing (b) of FIG. 45 is recognized as the target range, the multi-all is dragged. When the drag starts to the upper left and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background art section, "10)" is implemented.

11) After 2 multi-touching so that the range 4 in FIG. 45(b) is recognized as the target range, the range 4 is multi-touched to be touched with the index finger, which is the reference finger, and then multi-all is dragged. Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "11)" is implemented.

12) After 2 multi-touching so that the range 4 in Fig. 45 (b) is recognized as the target range, the multi-all is dragged so that the range 4 is touched with the index finger, which is the reference finger, when the drag starts to the upper left and is completed, Among the 17 object change patterns in the 4th step in the conventional object shape transformation method that requires the activation step of an object mentioned in the background section, "12)" is implemented.

13) After multi-touching 2 so that the 2nd range in Fig.45(b) is recognized as the target range, the 2nd range is touched with the index finger, which is the reference finger, and then multi-all is dragged.When the drag starts to the upper right and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires an activation step of an object mentioned in the background art section, "13)" is implemented.

14) After multi-touching 2 so that the 2nd range in Fig.45(b) is recognized as the target range, the 2nd range is multi-touched so that it is touched with the index finger, which is the reference finger, and when the drag starts to the lower left and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "14)" is implemented.

15) After multi-touch dragging after 2 multi-touching so that the area 3 is touched with the index finger, which is the reference finger, so that the range 3 in the drawing (b) of FIG. 45 is recognized as the target range, when the drag starts to the upper right and is completed, Among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, "15)" is implemented.

16) After multi-touching 2 so that the range 3 in Fig. 45 (b) is recognized as the target range, the range 3 is touched with the index finger, which is the reference finger, and then multi-all is dragged. In the conventional object shape transformation method that requires the activation step of the object mentioned in the background section, the aspect "16)" is implemented among the 17 object change aspects in the fourth step.

17) Regardless of any of the drawings (a), (b), (c), and (d) of Fig. 45, any range of the object (or the active area of the object) is recognized as a target range, that is, any point In multi-all dragging after two multi-touching so as to be touched with the index finger, which is the reference finger, if the drag trajectory is not a trajectory close to a straight line within a certain curvature range, but a trajectory of a curve, the object (or the active area of the object) is rotated.

When expressed in technical language as above, it seems a little complicated. From the user's point of view, according to the intuition, if the target button recognition method by the reference finger is used as the target button recognition method, touch the touch point to which the reference finger should be touched, and drag in the desired direction to reduce or You just have to zoom in.

In the conventional object shape transformation method that requires the activation step of an object, place the mouse pointer only on the zoom control point at the side or vertex where the expansion or contraction starts, and then drag the object in the desired direction while holding down the left mouse button. I zoomed in or out,

In the multi-touch method of the present application, referring to the point at which the reference finger is to be touched, the method of the present application does not require activation of an object, but the object activation region boundary line assuming that the object activation region boundary line appears as in the prior art. It may be extended to an existing zoom control point or to an internal point of an object near or near it. And, the drag direction is the same as the conventional method.

Let me explain a more specific example.

In the following examples of (a), (b), (c), (d),

The concept of the active area of an object is that the method of the present application does not require the activation of the object, but it is assumed that the object is activated as in the past, and the object activation area is assumed to appear only in the mind that the boundary of the object activation area appears. Please keep in mind that

The same is true of the concept of the boundary line of the active area of the object.

In addition, the target point can be applied not only to the expansion/reduction control point on the boundary of the object activation area in the conventional method, but also to a point within the boundary line adjacent to the control point, and to a point outside the object or a point within the object adjacent to the control point. , It is recommended to do so. Of course, in order for an object to be recognized as a target object even if it is a point within the boundary line adjacent to the control point as well as the enlargement/reduction control point on the boundary of the object active area, even if the external point of the object is multi-touched with the reference finger, it is recognized in that way It should be set as much as possible.

(a) For example, multi-touch so that the reference finger touches the zoom control point on the boundary of the left/right active area of the object or the inner point of the object near or near it, for example, the index finger is the reference. After two multi-touch with the index finger and middle finger to be recognized as a finger, the touch state of the index finger and middle finger is maintained and dragged left/right, so that the vertical length of the object is not changed, and the horizontal length of the object can be enlarged or reduced.

The contents of this are described in the method in which steps 5) to 8) are implemented by the method of the present application among the 17 object change patterns in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section. I am referring to an example.

(If it is difficult to predict the location of the boundary line of the area to be activated, such as a star shape, rather than the case where the boundary line of the active area is formed in the same range as the shape, such as a square, the method described above after activating the object with a single touch, etc. It is also possible to enlarge or reduce by dragging after the multi-touch is performed. The same applies to the examples in 2) or 3) below.)

(b) For example, multi-touch so that the reference finger touches the zoom control point on the boundary of the upper/lower active area of the object or the inner point of the object near or near it, for example, the index finger is the reference. After two multi-touch with the index finger and middle finger to be recognized as a finger, the touch state of the index finger and middle finger is maintained and dragged up/down, so that the horizontal length of the object is not changed, and the vertical length of the object can be enlarged or reduced.

The contents of this are described in the method in which the aspects 1) to 4) are implemented by the method of the present application among the 17 object change aspects in the 4 stages in the conventional object shape transformation method that requires the activation stage of the object mentioned in the background art. I am referring to an example.

(c) For example, multi-touch so that the reference finger touches the zoom control point at the vertex of the boundary line of the object activation area or the inner point of the object near or near it, for example, using the index finger as the reference finger. After two multi-touch with the index finger and middle finger to be recognized, the touch state of the index finger and middle finger is maintained and dragged in a diagonal direction, so that the horizontal length and the vertical length of the object can be enlarged or reduced. Of course, the ratio of the enlarged/reduced horizontal length and vertical length may vary depending on the dragging direction.

The contents of this are described in the method in which the aspects 9) to 16) are implemented by the method of the present application among the 17 object change aspects in the 4 stages in the conventional object shape transformation method that requires the activation stage of the object mentioned in the background art. I am referring to an example.

(d) For example, multi-touch so that the reference finger touches the inner point of the object inside the boundary of the object activation area, for example, after two multi-touch with the index finger and middle finger so that the index finger is recognized as the reference finger, While the touch state is maintained, the object may be rotated by being dragged in a curve with a certain curvature or more.

The content here refers to an example of a method in which aspect 17) is implemented by the method of the present application out of the 17 object change aspects in step 4 in the conventional object shape transformation method that requires the activation step of the object mentioned in the background section. I did it.

It will be easier to understand if you go through the following ①~⑧ examples.

The following examples ① to ⑧ are included in the above concept, and if the drag proceeds in a direction that approaches a straight line passing through the center of the object at right angles to the dragging direction, it is reduced, and the center of the object at right angles to the dragging direction is reduced. It can also be said that if the drag progresses in the direction away from the passing straight line, it expands.

In the following examples ①~⑧, when dragged in the diagonal direction, only the case where the horizontal length and the vertical length are enlarged or reduced at the same ratio is given.

① (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the active area of the object (object area or) before the shape of the object are transformed are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). time,

The index finger to be recognized as the reference finger is at a point in the (object area or) object activation area (e.g., area 5 in Fig. 45) with a Y value equal to or greater than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2). When the middle finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' upwards, the horizontal length of the object is not changed, and only the vertical length can be enlarged. Even when only the vertical length is enlarged, the coordinate(s) with the smallest Y value of the (object area or) object active area (e.g., lower horizontal side) remain unchanged, and the coordinate(s) with the largest Y value of the (object or) object active area ( (E.g., the upper horizontal side) can be moved to the upper side so that only the vertical length of the object is enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 27 can be exemplified.

If, at a point in the (object area or) object active area (eg, area 7 in Fig. 45) with a Y value less than the middle value of Y1 and Y2 (=(Y1+Y2)/2), it will be recognized as the reference finger. If the intended index finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' upwards, the horizontal length of the object can be reduced without changing the horizontal length. In order to reduce only the vertical length, the coordinate(s) with the largest Y value of the (object area or) object active area will remain unchanged, and the coordinate(s) with the smallest Y value of the (object area or) object active area will be more By moving upward, only the length of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 28 can be exemplified.

② (object or) The object activation area is multi-touched with the index finger and the middle finger so that it becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest Y value in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). time,

Make the index finger to be recognized as the reference finger touch the point in the object area or the object activation area that has a Y value of Y1, Y2 or more (=(Y1+Y2)/2), and the middle finger is the right side of the index finger. After touching any part of the part, when'multi-all dragging' downwards, it is possible to reduce the vertical length without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the smallest Y value of the (object area or) object active area are moved to the lower side without any change, and the coordinate(s) with the largest Y value of the (object or) object active area are moved further down. Only the vertical length of the object can be reduced in the form of paper. To briefly describe the above description in the drawings, a change from Fig. 27 to Fig. 26 may be exemplified.

If the index finger to be recognized as the reference finger is touched at a point in the object area or the active area of the object that has a Y value less than the middle value of Y1 and Y2 (=(Y1+Y2)/2), the middle finger is the index finger. If you touch any point on the right side of and then drag it to the lower side, you can enlarge the vertical length without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the largest Y value of the (object area or) object active area remain unchanged, and the coordinate(s) with the smallest Y value of the (object area or) object active area are more In the form of moving downward, only the vertical length of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 28 to Fig. 26 can be exemplified.

③ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest X value (X1, Y1) in the active area of the object (object area or) before shape transformation of the object are (X1, Y1) and the coordinates with the smallest X value are (X2, Y2). time,

The index finger, which is scheduled to be recognized as the reference finger, is at a point within the (object area or) object activation area (eg, area 6 in Fig. 45) with an X value equal to or greater than the intermediate value of X1 and X2 (=(X1+X2)/2). When the object is touched and the middle finger is touched to any point on the right side of the index finger and then'multi-all drag' to the right, the vertical length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate(s) with the smallest X value of the (object area or) object active area (e.g., the left vertical side) are unchanged, and the coordinate with the largest X value of the (object or) object active area (S) (e.g., right vertical side) can be moved to the right, so that only the horizontal length of the object is enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 29 can be exemplified.

If, at a point in the (object area or) object activation area (eg, area 8 in Fig. 45) with an X value less than the middle value of X1 and X2 (=(X1+X2)/2), it will be recognized as a reference finger. If the intended index finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' to the right, the vertical length of the object can be reduced without changing the vertical length. Even when only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object active area remain unchanged, and the coordinate(s) with the smallest X value of the (object area or) object active areas are more In the form of moving to the right, only the horizontal length of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 30 can be exemplified.

④ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest X value (X1, Y1) in the active area of the object (object area or) before shape transformation of the object are (X1, Y1) and the coordinates with the smallest X value are (X2, Y2). time,

Make the index finger to be recognized as the reference finger touch the point in the object area or the object activation area that has an X value equal to or greater than the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is the right side of the index finger. After touching any part of the part, when'multi-all dragging' to the left, the vertical length of the object is not changed, and only the horizontal length can be reduced. Even when only the horizontal length is reduced, the coordinates with the smallest X value of the (object area or) object active area are unchanged, and the coordinates with the largest X value of the (object or) object active area are moved further to the left. Only the horizontal length of can be reduced. To briefly describe the above description in the drawings, a change from Fig. 29 to Fig. 26 may be exemplified.

If the index finger to be recognized as the reference finger is touched at a point in the object area or the object activation area with an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2), the middle finger is the index finger. If you touch any point on the right side of and then drag it to the left, you can enlarge the horizontal length without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinates with the largest X value of the (object area or) object active area are moved to the left, while the coordinates with the smallest X value of the (object area or) object active area are moved to the left. Only the width of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 30 to Fig. 26 may be exemplified.

⑤ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

An object area (or an object area) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value equal to or greater than the median value of Y1 and Y2 (=(Y1+Y2)/2) ( Example: The index finger to be recognized as the reference finger is touched at a point within (area that can be included in area 2 in Fig. 45), and the middle finger touches any point on the right side of the index finger, and then'multi-all dragging' toward the upper right. ', it is possible to make the object's width and height enlarged at the same ratio. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates with the smallest X and Y values of the (object area or) object active area (eg, vertex 3 in Fig. 39) remain unchanged, (object or) In a form in which the coordinates (eg, vertex 2 in FIG. 39) having the largest X and Y values of the object activation area are moved to the upper right, the length of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 31 may be exemplified.

If the X value is less than the median value of X1 and X2 (=(X1+X2)/2) and the Y value is less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (object area or) Touch the index finger to be recognized as the reference finger at a point within the object activation area (e.g., an area that can be included in area 3 in Fig. 45), and the middle finger touch any point on the right side of the index finger, and then move to the upper right. When'multi-all dragging', the horizontal and vertical length of the object can be reduced in the same ratio. Even when the width and height of the object are reduced at the same ratio, the coordinates with the largest X and Y values of the (object area or) object active area are not changed, and the X and Y values of the (object area or) object active area are not changed. The coordinates with the smallest value are shifted to the upper right, so that the length and width of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 32 is exemplified.

⑥ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

Within the active area (object area or) with an X value of at least the median value of X1 and X2 (=(X1+X2)/2) and a Y value of at least the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as the reference finger is touched at the point, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the lower left, the width and height of the object are reduced in the same ratio. can do. Even when the width and height of the object are reduced by the same ratio, the coordinates with the smallest X and Y values of the (object area or) object active area are unchanged, and the X and Y values of the (object or) object active area are The largest coordinates are moved to the lower left and the horizontal and vertical lengths of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 31 to Fig. 26 may be exemplified.

If the X value is less than the median value of X1 and X2 (=(X1+X2)/2) and the Y value is less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (object area or) When the index finger to be recognized as the reference finger is touched at a point within the object activation area, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the lower left, the object has the same horizontal and vertical length. You can have it enlarged in proportion. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the largest X and Y values of the (object area or) object active area are not changed, and the X and Y values of the (object area or) object active area are not changed. The coordinates with the smallest value are moved to the lower left and the horizontal and vertical lengths of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 32 to Fig. 26 may be exemplified.

⑦ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

An object active area (object area or) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (Example: an area that can be included in area 4 in Fig. 45) Touch the index finger to be recognized as the reference finger at a point within the middle finger, touch any point on the right side of the index finger, and then move the'multi-all' to the lower right. When'drag', the horizontal and vertical length of the object can be enlarged at the same ratio. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the smallest X value and the largest Y value of the (object area or) object active area (e.g., vertex 1 in Fig.39) remain unchanged, and Alternatively, a coordinate (eg, vertex 4 in FIG. 39) having the largest X value and the smallest Y value of the object activation area may be moved to the lower right, thereby increasing the length of the object horizontally and vertically. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 33 can be exemplified.

If, the (object area or) object has an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1 and Y2 (=(Y1+Y2)/2) The index finger to be recognized as the reference finger is touched at a point within the active area (e.g., an area that can be included in area 1 in Fig. 45), and the middle finger is touched to any point on the right side of the index finger, and then moves to the lower right. When multi-all dragging, the width and height of the object can be reduced in the same ratio. Even when the width and height of the object are reduced at the same ratio, the coordinates with the largest X value and the smallest Y value of the (object area or) object active area are unchanged, and the X value of the (object area or) object active area The coordinates with the smallest Y value and the largest Y value are moved to the lower right, so that the horizontal and vertical lengths of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 34 can be exemplified.

⑧ (object or) The object activation area is multi-touched by detection and middle finger so that the target button becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),

An object active area (object area or) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as the reference finger is touched at the point within, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the upper left, the width and length of the object are reduced to the same ratio. Can be made. Even when the width and height of the object are reduced by the same ratio, the X value of the (object or) object active area is the largest without changing the coordinates where the X value of the (object area or) object active area is the smallest and the largest Y value. It is possible to reduce the horizontal and vertical length of the object in a form in which the large and small coordinates of the Y value are moved to the upper left. To briefly describe the above description in the drawings, a change from Fig. 33 to Fig. 26 can be exemplified.

If, the (object area or) object has an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as a reference finger is touched at a point in the active area, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the upper left, the width and length of the object are the same Can be enlarged to. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the largest X value and the smallest Y value of the (object area or) object active area remain unchanged, and the X value of the (object area or) object active area The coordinates with the smallest Y value and the largest Y value are moved to the upper left, so that the horizontal and vertical lengths of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 34 to Fig. 26 can be exemplified.

For reference, in the case of a device such as a mobile phone or a smart phone equipped with a small display device, in the case of a device such as a mobile phone or a smartphone equipped with a small display device, in a situation where an object is to be manipulated, including a change in the shape of an object including a picture, photo, browser, and window, rather than a button to which text is assigned In most cases, since only one object is displayed and used in many cases, it is not important which finger among the multi-touched fingers is determined as the'reference finger'.

That is, when one or more fingers touch an object, the object can be recognized by the device as a target button, and in that state, the object is reduced or enlarged through various manipulations including multi-all dragging. The shape may change.

Even if there is no finger touched on the object among the multi-touched fingers on the dedicated screen where the shape of the object is changed, the object is recognized as a target button by itself, as above, even if the screen is multi-touched. The shape of the object, including the reduction or expansion of the object, may be changed through various manipulations including multi-all dragging.

And, when a specific button is touched with a finger, the button desired to be touched is also touched, but there may be cases where the finger is thick and even the button that is not desired is touched. It can also be made to be perceived as being done.

5. Electronic equipment to which the present invention is applicable

Devices to which the present invention is applicable are all devices capable of recognizing a touch.

For example, there are mobile phones, smartphones, feature phones, PDAs, tablet PCs, general PCs, and notebook computers.

25 is a block diagram of an electronic device to which the present invention is applicable. As shown in FIG. 25, an electronic device to which the present invention is applicable includes a touch screen 110, a function block 120, a control unit 130, a storage unit 140, and a communication unit 150.

The touch screen 110 displays the above-described touch buttons, and is a means used to touch a desired touch button with a user's finger.

The function block 120 performs the original function of the electronic device. If, 1) if the electronic device is a mobile phone, the function block 120 performs a mobile phone function, 2) if the electronic device is a mobile computer, the function block 120 performs a computing function, and 3) the electronic device In the case of a mobile multimedia player, the function block 120 performs a multimedia playback function, and 4) if the electronic device is a general notebook or PC, the function block 120 performs a computing function.

The storage unit 140 stores programs and data used to perform functions of an electronic device and generate a GUI screen composed of the aforementioned touch buttons, and provides a storage space for storing multimedia files.

The control unit 130 executes a program stored in the storage unit 140 to control function execution by the function block 120 and displays a GUI composed of touch buttons on the touch screen 110. In addition, the controller 130 performs text input, object adjustment, function execution, and the like according to a user's manipulation input using touch buttons displayed through the touch screen 110.

The communication unit 150 is connected to enable communication with other electronic devices to perform data communication.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be understood individually from the technical spirit or prospect of the present invention.

110: touch screen
120: function block
130: control unit
140: storage unit
150: communication department

Claims (162)

In a device having a touch screen, in the method of recognizing a target button when the touch screen is multi-touched,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method according to claim 1,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method according to claim 2,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method according to claim 2,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method according to claim 2,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method according to claim 2,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method according to claim 1,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method according to any one of claims 1 to 7,
In a device equipped with a touch screen, in the method of generating a work signal for a certain task including character input or object transformation by being manipulated after multi-touch,
A method characterized in that the method of operation after the multi-touch is multi-on&off, multi-drag, and post-multi-touch operation with an open finger. The method of claim 8,
The multi on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off The method of claim 9,
Multi multi not all on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off) The method of claim 8,
A method, characterized in that the multi-drag method is any one or more of the following methods.
1.5.2..8. Multi All Drag
1.5.2..9. Multi Not All Drag The method of claim 11,
The multi-not all-drag method is a method, characterized in that any one or more of the following methods.
1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)
1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag) The method of claim 8,
A method characterized in that the method of multi-touch post-multi-touch operation by an open finger (= post multi-touch operation by open touch point) is any one or more of the following methods.
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)
1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)
1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)
1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)
1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)
1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)
1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point) In a device equipped with a touch screen, when the touch screen is multi-touched, the multi-touch method, which is a method for multi-touching, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) In a device equipped with a touch screen, in the method of generating a work signal for a certain task including character input or object transformation by being manipulated after multi-touch,
A method characterized in that the method of operation after the multi-touch is multi-on&off, multi-drag, and post-multi-touch operation with an open finger. The method of claim 15,
The multi on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off The method of claim 16,
Multi multi not all on & off method is a method, characterized in that any one or more of the following methods.
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off) The method of claim 15,
A method, characterized in that the multi-drag method is any one or more of the following methods.
1.5.2..8. Multi All Drag
1.5.2..9. Multi Not All Drag The method of claim 18,
The multi-not all-drag method is a method, characterized in that any one or more of the following methods.
1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)
1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag) The method of claim 15,
A method characterized in that the method of multi-touch post-multi-touch operation by an open finger (= post multi-touch operation by open touch point) is any one or more of the following methods.
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)
1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)
1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)
1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)
1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)
1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)
1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point) In a device equipped with a touch screen, in the method of generating a work signal for a certain task including character input or object transformation by being manipulated after multi-touch,
The operation method after the multi-touch is:
A method characterized in that it is a method in which different operations are performed according to the number of times that multi-on and off is performed continuously at least one or more times, that is, a multi-tap method. The method according to claim 21, in the case of text input by the multi-tap method,
A method, characterized in that, according to the number of times the multi-on and off is performed at least one or more times in succession, the characters belonging to the target character group related to the target button are circulated and displayed. The method of claim 22,
After the characters are displayed in circulation, the displayed character is inputted definitively after a single touch or multi-touch so that the other button is recognized as the target button, the cursor is moved, or a certain period of time (eg, 2 seconds) elapses. The method of claim 22,
When multi-touch when multi-tap is expressed in more detail with n multi-touch,
According to at least one n value, that is, according to the situation before the final operation, a specific character group is matched from among at least one character group, belongs to the matched character group, and at least one of at least one character related to the target button is matched. A method, characterized in that the text is input without changing the text mode. The method of claim 24,
The "specific character group" is any one of the following character groups.
1) Any one character group among two or more different character groups classified into different categories according to the spelling rules
2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method of claim 25,
The "specific character group" is a character group to which other characters belong according to the spelling rule, which is a character group of characters input in another character mode under the spelling rule corresponding to the currently set character mode. The method of claim 24,
"A specific character group" means any one character group among two or more different character groups classified into different groups according to the spelling rules.
In English,
If the currently set text mode is upper case mode, it is a character group that can be input in lower case mode, or
If the currently set text mode is lowercase mode, it is a character group that can be input in uppercase mode, or
In Japanese
If the currently set text mode is Hiragana text mode, it is a character group that can be input in katakana text mode,
And if the currently set character mode is a katakana character mode, a character group that can be input in the hiragana character mode. The method according to any one of claims 21 to 27,
In the way the target button is recognized,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method of claim 28,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method of claim 29,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method of claim 29,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method of claim 29,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method of claim 29,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method of claim 28,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method according to any one of claims 21 to 34,
The multi-touch,
A method, characterized in that two multi-touch is recognized by two touch points by using two fingers. The method of claim 35,
The two fingers,
The method characterized in that the index finger and middle finger. The method according to any one of claims 21 to 36,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) The method according to any one of claims 21 to 37,
The operation after the multi-touch is at least one of the following operations.
1.5.2..2. Multi on&off
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point) The method according to any one of claims 21 to 38,
A method, characterized in that the applicable character is water, and a number or special character is also included as a general character expressing a language. The method according to any one of claims 21 to 39,
The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method. Step of multi-touching the object (or the active area of the object) to be recognized as a target button
The input method comprising: transforming the object (or the active area of the object) according to the manipulation after the multi-touch. The method of claim 41,
In the way the target button is recognized,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method of claim 42,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method of claim 43,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method of claim 43,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method of claim 43,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method of claim 43,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method of claim 42,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method of any one of claims 41 to 48,
The object transformation method, characterized in that the manipulation is drag. The method of claim 49
A method in which an object (or an active area of an object) is enlarged when dragged in at least one first specific direction, and an object (or an active area of an object) is reduced when dragged in at least one second specific direction. The method of claim 50,
If you drag in the upward direction, it will be enlarged,
A method, characterized in that it is reduced when dragged in the downward direction. The method of claim 50,
In the expansion or reduction, the method characterized in that the ratio of the horizontal length and the vertical length of the object is maintained. The method of claim 50,
The method according to claim 1, wherein the center point of the object is not moved during enlargement or reduction. The method of claim 49,
A method, characterized in that only a horizontal length or a vertical length or a horizontal length and a vertical length of the object (or the active area of the object) are enlarged or reduced together by the drag direction determined by the device. The method of claim 54,
When dragged in the first specific direction in the horizontal direction, the vertical length does not change, the horizontal length is enlarged,
When dragging in the second specific direction in the horizontal direction, the vertical length does not change, the horizontal length is reduced,
When dragging in the first specific direction in the vertical direction, the horizontal length does not change, the vertical length is enlarged,
When dragging in the second specific direction in the vertical direction, the horizontal length does not change, the vertical length is reduced,
When dragged in at least one of the diagonal directions in the first specific direction, the horizontal length and the vertical length are enlarged at the same ratio,
When dragging in at least one second specific direction among diagonal directions, the horizontal length and the vertical length are reduced by the same ratio. The method of claim 55,
When dragged to the right, the horizontal length is enlarged,
When dragging to the left, the horizontal length is reduced,
When dragging in the upward direction, the vertical length is enlarged,
When dragging in the downward direction, the vertical length is reduced,
When dragged in the upper left or upper right direction, the horizontal and vertical lengths are enlarged at the same ratio,
When dragging in the lower left or lower right direction, the method characterized in that the reduction in a ratio equal to the horizontal length and the vertical length. The method of claim 54,
When dragged in the first specific direction in the horizontal direction, the vertical length does not change, the horizontal length is enlarged,
When dragging in the second specific direction in the horizontal direction, the vertical length does not change, the horizontal length is reduced,
When dragging in the first specific direction in the vertical direction, the horizontal length does not change, the vertical length is enlarged,
When dragging in the second specific direction in the vertical direction, the horizontal length does not change, the vertical length is reduced,
When dragging in at least one of the diagonal directions in the range of the first specific direction, the horizontal length and the vertical fluctuation ratio are differently enlarged according to each direction within the range,
When dragging in at least one second specific direction range among diagonal directions, the horizontal length and the vertical variation ratio are reduced differently according to each direction within the range. The method of claim 57,
When dragged to the right, the horizontal length is enlarged,
When dragging to the left, the horizontal length is reduced,
When dragging in the upward direction, the vertical length is enlarged,
When dragging in the downward direction, the vertical length is reduced,
When dragged in the upper left or upper right direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently depending on which direction of the upper left or upper right range,
A method, characterized in that when dragging in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently depending on which direction of the lower left range or the lower right range. The method of claim 54,
In the enlargement or reduction, the method characterized in that the center point of the object is moved or not moved. The method of claim 49,
Step 1: The object (or the active area of the object) is multi-touched and dragged to be recognized as the target button, and a specific range inside the object (or the active area of the object) is the target range by the hitting point and the dragging direction. Step to make it recognized as (delete?
Step 2: As the horizontal or vertical length of the object (or the active area of the object) is changed according to the recognized hit point and the determined drag direction, the direction in which the drag is started becomes closer to the center of the object (or the active area of the object). The method comprising the step of reducing if the direction is, and expanding if the direction is farther away. The method of claim 60,
If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper, lower, right, or left directions
If the determined drag start direction is the direction that approaches the center of the object (or the active area of the object),
Of the two horizontal sides or two vertical sides of the object (or the active area of the object), the lengths of the two sides parallel to the determined drag direction are reduced, and the lengths of the two sides perpendicular to the determined drag direction do not change,
If the determined drag start direction is the direction away from the center of the object (or the active area of the object),
Of the two horizontal sides or two vertical sides of the object (or the active area of the object), the lengths of the two sides parallel to the determined drag direction are enlarged, and the lengths of the two sides perpendicular to the determined drag direction are unchanged,
If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper right, lower right, upper left, or lower left directions,
If the determined drag start direction is a direction that approaches the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced. In this case, if the horizontal side is reduced, both sides are reduced to the same length, and If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of change of the horizontal length and vertical length can be set to be different depending on which direction within a specific drag direction range determined by the device, or a specific drag direction range. You can set the length of the width and height to be different in the same ratio regardless of the direction in which it is draped,
If the determined drag start direction is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. In this case, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length. A method characterized in that it is possible to set the change ratio of the length and the vertical length to be different, or to set the length of the width and the vertical to be different at the same ratio regardless of which direction is dragged within a specific drag direction range. The method of claim 61,
If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is upper right, lower right, upper left, lower left,
-If the determined drag start direction is a direction that approaches the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the determined drag among the three sides surrounding the recognized target range The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side does not change,
-If the determined drag start direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the determined drag direction among the three sides surrounding the recognized target range The position of the side perpendicular to and is moved for enlargement, and the position of the side facing the side does not change,
If it is determined that the dragging direction (determined by the device), that is, the dragging direction intended by the user, is one of the upper right, lower right, upper left, or lower left directions,
-If the determined drag start direction is a direction that approaches the center of the object (or the active area of the object), the center of the object moves in the determined drag direction and is parallel to the drag direction among vertices in the recognized target range. The vertex closest to the straight line is moved to shrink, and the position of the opposite vertex of the vertex can be kept unchanged,
-If the determined drag start direction is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and a straight line parallel to the drag direction among the vertices in the recognized target range The method of claim 1, wherein the vertex nearest to is moved to enlarge, and the position of the opposite vertex of the vertex may not be changed. The method of claim 62,
① (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2In the case of multi-touch, the coordinates with the largest Y value in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). time,
The index finger to be recognized as the reference finger is at a point in the (object area or) object activation area (e.g., area 5 in Fig. 45) with a Y value equal to or greater than the intermediate value of Y1 and Y2 (=(Y1+Y2)/2). When the middle finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' upwards, the horizontal length of the object is not changed, and only the vertical length can be enlarged. Even when only the vertical length is enlarged, the coordinate(s) with the smallest Y value of the (object area or) object active area (e.g., lower horizontal side) remain unchanged, and the coordinate(s) with the largest Y value of the (object or) object active area ( (E.g., the upper horizontal side) can be moved to the upper side so that only the vertical length of the object is enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 27 can be exemplified.
If, at a point in the (object area or) object active area (eg, area 7 in Fig. 45) with a Y value less than the middle value of Y1 and Y2 (=(Y1+Y2)/2), it will be recognized as the reference finger. If the intended index finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' upwards, the horizontal length of the object can be reduced without changing the horizontal length. In order to reduce only the vertical length, the coordinate(s) with the largest Y value of the (object area or) object active area will remain unchanged, and the coordinate(s) with the smallest Y value of the (object area or) object active area will be more By moving upward, only the length of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 28 can be exemplified.
② (object or) The object activation area is multi-touched with the index finger and the middle finger so that the target button becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest Y value in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest Y value are (X2, Y2). time,
Make the index finger to be recognized as the reference finger touch the point in the object area or the object activation area that has a Y value of Y1, Y2 or more (=(Y1+Y2)/2), and the middle finger is the right side of the index finger. After touching any part of the part, when'multi-all dragging' downwards, it is possible to reduce the vertical length without changing the horizontal length of the object. Even when only the vertical length is reduced, the coordinate(s) with the smallest Y value of the (object area or) object active area are moved to the lower side without any change, and the coordinate(s) with the largest Y value of the (object or) object active area are moved further down. Only the vertical length of the object can be reduced in the form of paper. To briefly describe the above description in the drawings, a change from Fig. 27 to Fig. 26 may be exemplified.
If the index finger to be recognized as the reference finger is touched at a point in the object area or the active area of the object that has a Y value less than the middle value of Y1 and Y2 (=(Y1+Y2)/2), the middle finger is the index finger. If you touch any point on the right side of and then drag it to the lower side, you can enlarge the vertical length without changing the horizontal length of the object. Even when only the vertical length is enlarged, the coordinate(s) with the largest Y value of the (object area or) object active area remain unchanged, and the coordinate(s) with the smallest Y value of the (object area or) object active area are more In the form of moving downward, only the vertical length of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 28 to Fig. 26 can be exemplified.
③ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest X value (X1, Y1) in the active area of the object (object area or) before shape transformation of the object are (X1, Y1) and the coordinates with the smallest X value are (X2, Y2). time,
The index finger, which is scheduled to be recognized as the reference finger, is at a point within the (object area or) object activation area (eg, area 6 in Fig. 45) with an X value equal to or greater than the intermediate value of X1 and X2 (=(X1+X2)/2). If the middle finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' to the right, the vertical length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate(s) with the smallest X value of the (object area or) object active area (e.g., the left vertical side) are unchanged, and the coordinate with the largest X value of the (object or) object active area (S) (e.g., right vertical side) can be moved to the right, so that only the horizontal length of the object is enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 29 can be exemplified.
If, at a point in the (object area or) object activation area (eg, area 8 in Fig. 45) with an X value less than the middle value of X1 and X2 (=(X1+X2)/2), it will be recognized as a reference finger. If the intended index finger is touched and the middle finger is touched to any point on the right side of the index finger, and then'multi-all drag' to the right, the vertical length of the object can be reduced without changing the vertical length. Even when only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object active area remain unchanged, and the coordinate(s) with the smallest X value of the (object area or) object active areas are more In the form of moving to the right, only the width of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 30 can be exemplified.
④ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, it is assumed that the coordinates with the largest X value (X1, Y1) in the active area of the object (object area or) before shape transformation of the object are (X1, Y1) and the coordinates with the smallest X value are (X2, Y2). time,
Make the index finger to be recognized as the reference finger touch the point in the object area or the object activation area that has an X value equal to or greater than the intermediate value of X1 and X2 (=(X1+X2)/2), and the middle finger is the right side of the index finger. After touching any part of the part, when'multi-all dragging' to the left, the vertical length of the object is not changed, and only the horizontal length can be reduced. Even when only the horizontal length is reduced, the coordinates with the smallest X value of the (object area or) object active area are unchanged, and the coordinates with the largest X value of the (object or) object active area are moved further to the left. Only the horizontal length of can be reduced. To briefly describe the above description in the drawings, a change from Fig. 29 to Fig. 26 may be exemplified.
If the index finger to be recognized as the reference finger is touched at a point in the object area or the object activation area with an X value less than the intermediate value of X1 and X2 (=(X1+X2)/2), the middle finger is the index finger. If you touch any point on the right side of and then drag it to the left, you can enlarge the horizontal length without changing the vertical length of the object. Even when only the horizontal length is enlarged, the coordinates with the largest X value of the (object area or) object active area are moved to the left, while the coordinates with the smallest X value of the (object area or) object active area are moved to the left. Only the width of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 30 to Fig. 26 may be exemplified.
⑤ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
An object area (or an object area) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value equal to or greater than the median value of Y1 and Y2 (=(Y1+Y2)/2) ( Example: The index finger to be recognized as the reference finger is touched at a point within (area that can be included in area 2 in Fig. 45), and the middle finger touches any point on the right side of the index finger, and then'multi-all dragging' toward the upper right. ', it is possible to make the object's width and height enlarged at the same ratio. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates with the smallest X and Y values of the (object area or) object active area (eg, vertex 3 in Fig. 39) remain unchanged, (object or) In a form in which the coordinates (eg, vertex 2 in FIG. 39) having the largest X and Y values of the object activation area are moved to the upper right, the length of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 31 may be exemplified.
If the X value is less than the median value of X1 and X2 (=(X1+X2)/2) and the Y value is less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (object area or) Touch the index finger to be recognized as the reference finger at a point within the object activation area (e.g., an area that can be included in area 3 in Fig. 45), and the middle finger touch any point on the right side of the index finger, and then move to the upper right. When'multi-all dragging', the horizontal and vertical length of the object can be reduced in the same ratio. Even when the width and height of the object are reduced by the same ratio, the coordinates with the largest X and Y values of the (object area or) object active area are unchanged, and the X and Y values of the (object area or) object active area are not changed. The coordinates with the smallest value are moved to the upper right, so that the length of the object's width and height can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 32 can be exemplified.
⑥ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
Within the active area (object area or) with an X value of at least the median value of X1 and X2 (=(X1+X2)/2) and a Y value of at least the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as the reference finger is touched at the point, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the lower left, the width and height of the object are reduced in the same ratio. can do. Even when the width and height of the object are reduced by the same ratio, the coordinates with the smallest X and Y values of the (object area or) object active area are unchanged, and the X and Y values of the (object or) object active area are The largest coordinates are moved to the lower left and the horizontal and vertical lengths of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 31 to Fig. 26 may be exemplified.
If the X value is less than the median value of X1 and X2 (=(X1+X2)/2) and the Y value is less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (object area or) When the index finger to be recognized as the reference finger is touched at a point within the object activation area, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the lower left, the object has the same horizontal and vertical length. You can have it enlarged in proportion. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the largest X and Y values of the (object area or) object active area are not changed, and the X and Y values of the (object area or) object active area are not changed. The coordinates with the smallest value are moved to the lower left and the horizontal and vertical lengths of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 32 to Fig. 26 may be exemplified.
⑦ (object or) Two multi-touch with the index finger and middle finger so that the object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
An object active area (object area or) with an X value equal to or greater than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1 and Y2 (=(Y1+Y2)/2) (Example: an area that can be included in area 4 in Fig. 45) Touch the index finger to be recognized as the reference finger at a point within the middle finger, touch any point on the right side of the index finger, and then move the'multi-all' to the lower right. When'drag', the horizontal and vertical length of the object can be enlarged at the same ratio. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the smallest X value and the largest Y value of the (object area or) object active area (e.g., vertex 1 in Fig.39) remain unchanged, and Alternatively, a coordinate (eg, vertex 4 in FIG. 39) having the largest X value and the smallest Y value of the object activation area may be moved to the lower right, thereby increasing the length of the object horizontally and vertically. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 33 can be exemplified.
If, the (object area or) object has an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value of more than the median value of Y1 and Y2 (=(Y1+Y2)/2) The index finger to be recognized as the reference finger is touched at a point within the active area (e.g., an area that can be included in area 1 in Fig. 45), and the middle finger is touched to any point on the right side of the index finger, and then moves to the lower right. When multi-all dragging, the width and height of the object can be reduced in the same ratio. Even when the width and height of the object are reduced at the same ratio, the coordinates with the largest X value and the smallest Y value of the (object area or) object active area are unchanged, and the X value of the (object area or) object active area The coordinates with the smallest Y value and the largest Y value are moved to the lower right, so that the horizontal and vertical lengths of the object can be reduced. To briefly describe the above description in the drawings, a change from Fig. 26 to Fig. 34 can be exemplified.
⑧ (object or) The object activation area is multi-touched by detection and middle finger so that the target button becomes the target button. 2 In multi-touch, the coordinates with the largest X and Y values in the active area of the object (object area or) before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2),
An object active area (object area or) with an X value equal to or greater than the median value of X1 and X2 (=(X1+X2)/2) and a Y value less than the median value of Y1 and Y2 (=(Y1+Y2)/2) When the index finger to be recognized as the reference finger is touched at the point within, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the upper left, the width and length of the object are reduced to the same ratio. Can be made. Even when the width and height of the object are reduced by the same ratio, the X value of the (object or) object active area is the largest without changing the coordinates where the X value of the (object area or) object active area is the smallest and the largest Y value. It is possible to reduce the horizontal and vertical length of the object in a form in which the large and small coordinates of the Y value are moved to the upper left. To briefly describe the above description in the drawings, a change from Fig. 33 to Fig. 26 can be exemplified.
If, the (object area or) object has an X value less than the median value of X1 and X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1 and Y2 (=(Y1+Y2)/2) If the index finger to be recognized as the reference finger is touched at a point in the active area, and the middle finger touches any point on the right side of the index finger, and then'multi-all drag' toward the upper left, the horizontal and vertical length of the object are the same Can be enlarged to. Even when the width and height of the object are enlarged at the same ratio, the coordinates with the largest X value and the smallest Y value of the (object area or) object active area are unchanged, and the X value of the (object area or) object active area The coordinates with the smallest Y value and the largest Y value are moved to the upper left, so that the horizontal and vertical lengths of the object can be enlarged. To briefly describe the above description in the drawings, a change from Fig. 34 to Fig. 26 can be exemplified. The method of claim 61,
In the expansion or reduction, the method characterized in that the center point of the object is moved. The method according to any one of claims 41 to 64,
The multi-touch,
A method, characterized in that two multi-touch is recognized by two touch points by using two fingers. The method of claim 65,
The two fingers,
The method characterized in that the index finger and middle finger. The method of any one of claims 41 to 66,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) The method of any one of claims 41 to 67,
The operation after the multi-touch is at least one of the following operations.
1.5.2..2. Multi on&off
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi Not All Drag
1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)
1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)
1.5.2..12. Multi power tap
1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)
1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)
1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)
1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)
1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)
1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)
1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point) In a device having a touch screen, in the method for inputting characters,
Displaying a keyboard on which buttons to which a plurality of characters are assigned are present on the touch screen;
In the process of multi-on & off so that a specific button is recognized as a target button,
After the multi-touch, including after the multi-touch or after the multi-touch finger is turned off (= multi-touch is released),
And a step of inputting a character of a specific sequence among characters assigned to a button recognized as a target button. The method of claim 69,
When multi-touch is expressed in more detail with n multi-touch,
Character input method, characterized in that the specific sequence number is determined according to the value of n. The method of claim 70,
Character input method, characterized in that it is determined such that the value n and a numeric value corresponding to the order of the specific order are the same. The method of claim 70,
When the value of n is 2, that is, 2 multi-touch, a second character assigned to a button recognized as a target button is input and processed. The method of claim 70,
If the value of n is 3, that is, 3 multi-touch, the third character assigned to the button recognized as the target button is input processing, or
When the value of n is 4, that is, 4 multi-touch, a fourth character assigned to a button recognized as a target button is input and processed. The method of claim 69 to 73,
In the way the target button is recognized,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method of claim 74,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method of claim 75,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method of claim 75,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method of claim 75,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method of claim 75,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method of claim 74,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method of claim 69 to 80,
The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or
The 3 multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger, and ring finger, or
The method of claim 1, wherein the 4 multi-touch is a multi-touch recognized by the index and middle fingers, the ring finger, and the touch points of the hand. The method of any one of claims 69 to 81,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) The method of any one of claims 69 to 82,
The operation after the multi-touch is at least one of the following operations.
1.5.2..2. Multi on&off
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)
1.5.2..12. Multi power tap
1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point) The method of any one of claims 69 to 83,
A method, characterized in that the applicable character is water, and a number or special character is also included as a general character expressing a language. The method of any one of claims 69 to 84,
The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method. In a device having a touch screen, in the method for inputting characters,
Displaying a keyboard on which buttons to which a plurality of characters are assigned are present on the touch screen;
When a specific button is operated after multi-touch so that it is recognized as a target button, after the multi-touch and after the operation starts, including after the operation starts or after the operation ends
And inputting a character of a specific sequence among characters assigned to a button recognized as a target button by a multi-touch operation. The method of claim 86,
According to the operation after the multi-touch,
Character input method, characterized in that the specific sequence number of the input character is determined. The method of claim 87,
When the drag direction is different, it is recognized that the type of manipulation after the multi-touch is different. The method of claim 87,
Depending on the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character related to the target button is inputted without changing the character mode while belonging to the matched character group. The method characterized in that. The method of claim 89,
The "specific character group" is any one of the following character groups.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method of claim 86-90,
In the way the target button is recognized,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method of claim 91,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method of claim 92,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method of claim 92,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method of claim 92,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method of claim 92,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method of claim 91,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method according to any one of claims 86 to 97,
The multi-touch,
A method, characterized in that two multi-touch is recognized by two touch points by using two fingers. The method of claim 98,
The two fingers,
The method characterized in that the index finger and middle finger. The method according to any one of claims 86 to 99,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) The method according to any one of claims 86 to 100,
The operation after the multi-touch is at least one of the following operations.
1.5.2..2. Multi on&off
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi Not All Drag
1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)
1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)
1.5.2..12. Multi power tap
1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)
1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)
1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)
1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)
1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)
1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)
1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point) The method according to any one of claims 86 to 101,
A method, characterized in that the applicable character is water, and a number or special character is also included as a general character expressing a language. The method according to any one of claims 86 to 102,
The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method. In a device having a touch screen, in the method for inputting characters,
After the keyboard is displayed on the touch screen,
In the case that a specific button is operated after multi-touch so that it is recognized as a target button,
The point at which the final operation of at least one of the final operations that can include nine behaviors including drag in eight directions: off or upper, lower, left, right, upper left, lower left, upper right, and lower right After or after the point at which the last operation begins, including after the point at which the last operation ends,
By multi-touch post-operation including the final operation of at least one of the final operations that may include off or multi-drag in 8 directions,
In the input of a specific character among at least one character related to a button recognized as a target button while belonging to a specific character group among at least one character group,
Depending on the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character related to the target button is inputted without changing the character mode while belonging to the matched character group. The method characterized in that. The method of claim 104,
The "specific character group" is any one of the following character groups.
1) Any one character group among two or more different character groups classified into different categories according to the spelling rules
2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method of claim 105,
The "specific character group" is a character group to which other characters belong according to the spelling rule, which is a character group of characters input in another character mode under the spelling rule corresponding to the currently set character mode. The method of claim 106,
"A specific character group" means any one character group among two or more different character groups classified into different groups according to the spelling rules.
In English,
If the currently set text mode is upper case mode, it is a character group that can be input in lower case mode, or
If the currently set text mode is lowercase mode, it is a character group that can be input in uppercase mode, or
In Japanese
If the currently set text mode is Hiragana text mode, it is a character group that can be input in katakana text mode,
And if the currently set character mode is a katakana character mode, a character group that can be input in the hiragana character mode. The method of claim 104-107,
In the way the target button is recognized,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method of claim 108,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method of claim 109,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method of claim 109,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method of claim 109,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method of claim 109,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method of claim 108,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method of claims 104 to 114,
The multi-touch,
A method, characterized in that two multi-touch is recognized by two touch points by using two fingers. The method of claim 115,
The two fingers,
The method characterized in that the index finger and middle finger. The method of any one of claims 104 to 116,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) The method of any one of claims 104 to 117,
The method characterized in that the operation after multi-touch is at least one of the following operations
1.5.2..2. Multi on&off
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi Not All Drag
1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)
1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)
1.5.2..12. Multi power tap
1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)
1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)
1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)
1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)
1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)
1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)
1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point) The method of any one of claims 104 to 118,
A method, characterized in that the applicable character is water, and a number or special character is also included as a general character expressing a language. The method according to any one of claims 104 to 119,
The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method. In a device having a touch screen, in the method for inputting characters,
After the keyboard is displayed on the touch screen (delete??),
In the case that a specific button is operated after multi-touch so that it is recognized as a target button,
At least one of the final operations that can include 5 (9?) behaviors including drag in the 4 (8?) directions of off or up, down, left, right (upper left, lower left, upper right, lower right). After the start of the final manipulation of a behavior or after the start of the final manipulation, including after the end of the final manipulation,
By multi-touch post-manipulation including the final operation of at least one of the final operations that may include 5 (9?) behaviors including off or multi-drag in 4 (8?) directions,
A first character that belongs to a specific character group among at least one character group (delete?) and which is a specific character among at least one character related to the target button (or assigned to the target button??)
Regardless of the target button, the second character, which is at least one specific character promised for each final operation, is additionally input. The method of claim 121,
In the way the target button is recognized,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method of claim 122,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method of claim 123,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method of claim 123,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method of claim 123,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method of claim 123,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method of claim 122,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method of any one of claims 121 to 128,
Character input method, characterized in that the character assigned to the target button is displayed to the left of the additionally input character. The method of any one of claims 121 to 129,
The second character is a character input method, characterized in that any one of vowels, consonants, half vowels, half consonants, or special characters. Following on from claim 130,
The second character includes at least one of characters corresponding to pronunciations of English pronunciation symbols [a], [e], [i], [o], and [u] . The method of claim 130,
The second character, A, E, I, O, or a character input method comprising at least one of U. The method of claim 130,
The second character is a character input method comprising at least one of T, S, N, R, H, D, L, or C. The method of claim 130,
The second character is at least one of ㅏ, ㅓ, ㅗ, ㅜ, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ㅣ, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅞ, ㅞ Character input method comprising a. The method of any one of claims 121 to 129,
When long dragged, the second character is a character input method, characterized in that two or more characters. The method of any one of claims 121 to 129,
The character input method further comprising: when the touch is maintained and dragged in the same direction once again or when the dragging direction is changed and dragged, additional characters to be input are continuously added and input. The method of any one of claims 121 to 128,
Depending on the situation before the final operation, a specific character group among at least one character group is matched, and at least one character among at least one character belonging to the matched character group is matched with the character assigned to the target button without changing the character mode. A method, characterized in that it is additionally input together. The method of claim 137,
When any one of the multi-all on & off or 4-direction multi-all drag operation is performed, the second letter is any one of A, E, I, O, U, or
When any one of multi-not all reference finger on & off or 4-direction multi-not all reference finger drag operation is performed, the second character is any one of W and Y,
When any one of the four directions of single drag operation is performed, the second letter is any one of T, S, N, R, or
When any one of the multi-all dragging is performed after a single touch in four directions, the second letter is any one of H, D, L, and C. The method of any one of claims 121 to 138,
When there are more than two letters assigned to the target button,
According to the situation before the final operation, the method characterized in that the first character is selected and input. The method according to any one of claims 121 to 139,
When there are more than two letters assigned to the target button,
According to the situation before the final operation, the method characterized in that the first character is selected and input. The method of claim 121 to 140,
The multi-touch,
A method, characterized in that two multi-touch is recognized by two touch points by using two fingers. The method of claim 141,
The two fingers,
The method characterized in that the index finger and middle finger. The method of any one of claims 121 to 142,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) The method of any one of claims 121 to 143,
The operation after the multi-touch is at least one of the following operations.
1.5.2..2. Multi on&off
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi Not All Drag
1.5.2..10. Multi-not all-based finger drag (=Multi-not all-based touch point drag)
1.5.2..11. Multi-not all-not reference finger drag (=Multi-not all-not reference touch point drag)
1.5.2..12. Multi power tap
1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point)
1.5.2..13.7. Multi-drag by open finger (=multi-drag by open touch point)
1.5.2..13.8. Multi-all drag by open finger (=multi-all drag by open touch point)
1.5.2..13.9. Multi-not all-drag by open finger (=Multi-not all-drag by open touch point)
1.5.2..13.10. Multi-not all reference finger drag by open finger (=Multi-not all reference touch point drag by open touch point)
1.5.2..13.11. Multi-not all-not standard finger drag by open finger (=Multi-not all-not standard touch point drag by open touch point)
1.5.2..13.12. Multi-tap by open finger (=multi-tap by open touch point) The method of any one of claims 121 to 144,
A method, characterized in that the applicable character is water, and a number or special character is also included as a general character expressing a language. The method of any one of claims 121 to 145,
The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method. In a device having a touch screen, in the method for inputting characters,
Displaying a keyboard on which buttons to which a plurality of characters are assigned are present on the touch screen;
In the process of multi-on & off so that a specific button is recognized as a target button,
After the multi-touch, including after the multi-touch or after the multi-touch finger is turned off (= multi-touch is released),
Depending on the situation before the final operation, a specific character group is matched among at least one character group, and at least one character among at least one character related to the target button is inputted without changing the character mode while belonging to the matched character group. Character input method comprising the step of. The method of claim 147,
The "specific character group" is any one of the following character groups.
1) Any one character group among two or more different character groups classified into different categories according to the spelling rules
2) A character group corresponding to any one of the various character modes in the conventional general mobile phone including the character group in the special character mode.
3) A group of characters assigned to a specific line among the characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number greater than or equal to the first specific sequence number in the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number.)
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method of claim 148,
The "specific character group" is a character group to which other characters belong according to the spelling rule, which is a character group of characters input in another character mode under the spelling rule corresponding to the currently set character mode. The method of claim 149,
"A specific character group" means any one character group among two or more different character groups classified into different groups according to the spelling rules.
In English,
If the currently set text mode is upper case mode, it is a character group that can be input in lower case mode, or
If the currently set text mode is lowercase mode, it is a character group that can be input in uppercase mode, or
In Japanese
If the currently set text mode is Hiragana text mode, it is a character group that can be input in katakana text mode,
And if the currently set character mode is a katakana character mode, a character group that can be input in the hiragana character mode. The method of claim 147-150,
In the way the target button is recognized,
Target button recognition method by reference finger (= target button recognition method by reference touch point) or target button recognition method by open touch point (= target button recognition method by open finger) or two or more touch points A method, characterized in that the target button is recognized by a target button recognition method based on a range. The method of claim 151,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) is any one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by the reference finger according to the Y coordinate value order (= target button recognition method by the reference touch point according to the Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to the order of X coordinate values according to the number of multi-touch (= target button recognition method by reference touch points according to the order of X coordinate values according to the number of multi-touch)
1.6.1..4 Target button recognition method by reference finger according to the order of Y coordinate value according to the number of multi-touch (= target button recognition method by reference touch point according to the order of Y coordinate value according to the number of multi-touch) The method of claim 152,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the X coordinate value order (= the target button recognition method by the reference touch point according to the X coordinate value order),
A method in which a touch button including a leftmost point among multi-touched touch points, that is, a point having a first X coordinate value in a small order of X coordinate values, is recognized as a target button. The method of claim 152,
In the case where the target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order (= the target button recognition method by the reference touch point according to the Y coordinate value order),
A method in which a touch button including the lowest point among the multi-touched touch points, that is, a point having a first Y coordinate value in a small order of Y coordinate values, is recognized as a target button. The method of claim 152,
The target button recognition method is the target button recognition method by the reference finger according to the order of the X coordinate values according to the number of multi-touch (= target button recognition method by the reference touch points according to the order of the X coordinate values according to the number of multi-touch). In case,
2 In the case of multi-touch, the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second X-coordinate value among the smallest order of X-coordinate values among the multi-touched touch points is recognized as a target button. The method of claim 152,
The target button recognition method is the target button recognition method by the reference finger according to the Y coordinate value order according to the number of multi-touch (= target button recognition method by the reference touch point according to the Y coordinate value order according to the multi-touch number). In case,
2 In the case of multi-touch, a touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate value, is recognized as the target button,
3 A method characterized in that in the case of multi-touch, a touch button including a point having a second Y-coordinate value among the smallest order of Y-coordinate values among the multi-touched touch points is recognized as a target button. How to do it. The method of claim 151,
A method of recognizing a target button by an open finger (= a method of recognizing a target button by an open touch point) is any one or more of the following methods.
1.6.2..1 Target button recognition method by the first open finger (=target button recognition method by the first open touch point)
1.6.2..2 Target button recognition method using the second open finger (= target button recognition method using the second open touch point)
1.6.2..3 Target button recognition method using the third open finger (= target button recognition method using the third open touch point)
1.6.2..4 Target button recognition method by the fourth open finger (= target button recognition method by the fourth open touch point)
1.6.2..5 Target button recognition method by the 5th open finger (= target button recognition method by the 5th open touch point) The method of claim 147 to 157,
The 2 multi-touch is a multi-touch recognized by the touch points of the index and middle fingers, or
The 3 multi-touch is a multi-touch recognized by the touch points of the index finger, middle finger, and ring finger, or
The method of claim 1, wherein the 4 multi-touch is a multi-touch recognized by the index and middle fingers, the ring finger, and the touch points of the hand. The method of any one of claims 147 to 158,
A method, characterized in that the multi-touch method, which is a method for the multi-touch process, is any one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 Multi Not All Touch
1.4.2..5. Multi-Not All-Based Finger Touch (=Multi-Not All-Based Touch Point)
1.4.2..6. Multi-not all-not reference finger touch (=Multi-not all-not reference touch point touch)
1.4.2..7. Multi-not all standard finger fluctuation touch (=Multi-not all standard touch point fluctuation touch)
1.4.2..8. Definition of terms for multi-touch with open fingers
1.4.2..8.1. Multi-touch by open finger (=multi-touch by open touch point)
1.4.2..8.2. N multi-touch by open finger (=n multi-touch by open touch point)
1.4.2..8.3. Multi-All Touch by Open Finger (= Multi-All Touch by Open Touch Point)
1.4.2..8.4. Multi-Not All Touch by Open Finger (=Multi-Not All Touch by Open Touch Point)
1.4.2..8.5. Multi-not all reference finger touch by open finger (=Multi-not all reference touch point touch by open touch point)
1.4.2..8.6. Multi-not all-not standard finger touch by open finger (=Multi-not all-not standard touch point touch by open touch point) The method of any one of claims 147 to 159,
The operation after the multi-touch is at least one of the following operations.
1.5.2..2. Multi on&off
1.5.2..3. Multi All On&Off
1.5.2..4. Multi Not All On&Off
1.5.2..5. Multi-Not All-Based Finger On&Off (=Multi-Not All-Based Touch Point On&Off)
1.5.2..6. Multi-not all-not reference finger on&off (=multi-not all-not reference touch point on&off)
1.5.2..12. Multi power tap
1.5.2..13.1. Operation after multi-touch by open finger (= operation after multi-touch by open touch point)
1.5.2..13.2. Multi on & off with open finger (= multi on & off by open touch point)
1.5.2..13.3. Multi-all on & off by open finger (= multi-all on & off by open touch point)
1.5.2..13.4. Multi-not all on & off by open finger (= multi-not all on & off by open touch point)
1.5.2..13.5. Multi-not all standard finger on & off by open finger (= Multi-not all standard touch point on & off by open touch point)
1.5.2..13.6. Multi-not all-not standard finger on and off by open finger (=Multi-not all-not standard touch point on and off by open touch point) The method of any one of claims 147 to 160,
A method, characterized in that the applicable character is water, and a number or special character is also included as a general character expressing a language. The method of any one of claims 147 to 161,
The characters include at least one of Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai mode, Vietnamese characters, Korean characters, English character mode, and global languages including Japanese characters and special characters. Character input method.

Images