KR20190012977A - Recognition method of multi-touch of touch button on touch screen, text input method on touch screen and modifying method of object - Google Patents

Abstract

The present invention relates to a method for generating a task signal for a task including character input or object deformation through operation after multi-touch in an apparatus having a touch screen. When a character is inputted by a multi-tap method, characters belonging to a target character group related to a target button are circulated and displayed according to the number of times that the multi-on and off is performed at least one time in succession. Further, in a keyboard operating method, that method is that a primary factor determining what response to show is multi-touched so that any button is included among buttons that any button remains touched for a certain amount of time or any button is multi-touched to be included.

Description

FIELD OF THE INVENTION [0001] The present invention relates to a method of recognizing a multi-touch of a touch button on a touch screen, a character input method,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an input method, and more particularly, to a method of inputting a user command in a manner that touch buttons displayed on a touch screen are operated after being touched.

=================================

Contents

A .. Long press on multi-touch What you want to solve by not recognizing.

B .. What we want to solve by multi-touch target button recognition method and multi-touch character input method. (There is a lot of content.)

=================================

A .. When multi-touch  Long press Unrecognizable  What you want to solve by doing.

Some keyboards assume that the following rules of 1 and 2 are generally applied.

1. When a multi-touch is made on a keyboard having a plurality of buttons, a specific button is recognized as a target button.

(Or as a narrower range of phrases)

When a multi-touch is made on a keyboard having a plurality of buttons, a button including any one of two or more multi-touched touch points is recognized as a target button.)

2 ... what button until the button is to be a single touch after being launched off a single touch,

(Depending on how long the touch remains)

If the touch state is held for a certain time (= long touch)

It reacts differently when the touched state is kept below a certain time (= when touched briefly).

(E.g,

When touching the 'a' button (= 'a' displayed button)

If you touch briefly ,

The state in which the touch certain period of time (e.g., 0.5 second) if held to less than, for example, a state in which the touch certain period of time (e.g., 0.5 sec) after holding is less than if the touch is released the 'A' is input ,

If you touch it for a long time ,

If the touch state is maintained for more than a certain time (0.5 second), '@' is input .)

.

Some keyboards, when the same rules as 1 and 2 above are generally applied,

As in the section B, I want to work on inputting characters using multi touch,

(For example, trying to multi-touch to include a lowercase 'a' button to enter the capital 'A' immediately without changing the character mode)

Since it is not yet familiar with the multi-touch and multi-touch reactions, when the multi-touch is performed, that is, until the multi-touch is released after the multi-

by mistake,

Multi-Touch Touch Points

Some buttons may be touched for longer than a certain amount of time (eg 0.5 seconds).

(That is, there may be a case where a state in which a button is touched for more than a predetermined time (for example, 0.5 seconds) is maintained.)

So, I want to do something with multi touch,

(For example, trying to multi-touch to include a lowercase 'a' button to enter the capital 'A' immediately without changing the character mode)

Multi-Touch Method For various reasons, such as observing how the multi-touch response occurs when the user is a beginner ,

As some buttons (such as the 'a' button with a lowercase letter) are touched (accidentally)

Expected response to the multi-touch (e.g., search capital letter 'A' is input) before onset of,

The reaction time of the touch and hold any button is displayed if I is the upset (such as abandoned '@' is shown)

So, while some keyboards, such as 1 and 2 above, are commonly applied,

Until the " certain button " is included and the multi-touch is released,

Even if the state in which the " certain button " is touched is held for a predetermined time or longer,

And reacts in the same manner as when the state in which the " certain button " is touched remains below a predetermined time.

B .. When multi-touch  How to recognize the target button Multi-touch  What you want to solve by using the character input method. (There is a lot of content.)

When a character is input using a QWERTY keyboard on a touch screen of a conventional smart phone, there is a problem that a size of a button assigned to a character is small,

When a character is input by using a 12-keypad keyboard on a touch screen of a conventional smart phone, since a plurality of characters are assigned to the same button as when inputting characters on a physical 12 keypad of a conventional feature phone, There is a problem that a lot of batting is needed. However, the above problems are solved through the present invention.

When a character is input using a conventional tablet PC's QWERTY keyboard, the size assigned to the character is so large that there is no such problem as typos. However, in the present invention, two letters are inputted by one touch to improve the character input speed do.

Since a small touch button in a device having a small touch screen including a conventional mobile phone is small in size, it is very difficult or impossible to precisely and quickly multi-touch with two or more fingers in one small button area. Therefore, it is necessary to develop a multi-touch method which is more convenient for the user.

On the other hand, a typical method of enlarging or reducing an object on a touch screen is a "one finger zoom" and a method in which an object is reduced or enlarged by pinching or unfolding the thumb and index finger.

According to the "one-finger zoom", when an object (such as a photograph) is double-clicked or long-pressed, an upward direction arrow and a downward direction arrow are displayed on the object. At this time, dragging the object upward enlarges the object, and dragging downward reduces the object. The disadvantage of this method is that it requires double-clicking or long-pressing before dragging to zoom in or out of the object.

On the other hand, the method in which the object is reduced or enlarged by pinching or unfolding the thumb and forefinger is excellent in intuitiveness and operation speed, but still needs improvement of the operation speed, and enlargement or reduction There is a problem in that it is impossible to implement the effect of deforming the object including the 17 object changing patterns or changing the rotation of the object, which is conventionally implemented through a mouse, which will be described later. And, there is a problem that it is difficult to enlarge or reduce a very small object. It is very difficult or virtually impossible to multi-touch very small objects with thumb and index finger.

Among the methods in which a conventional object is enlarged or reduced, a mouse is generally used most commonly as a method. In general, a method in which an activation step of an object is called an object shape transformation method, There are methods by the same steps.

Step 1: Activation of the object, including mouse-pointer placement at any point on the object and activation of the object, including clicking the left mouse button, activates the object as the active region boundary of the rectangular object (see Figure 39) step

(The active area border of the object has 8 zooms as shown in 1 to 8 of FIG. 39, in which the shape of the mouse pointer is changed by a double-headed arrow indicating the direction in which the object can be scaled by moving the mouse pointer The rotation adjustment point 9 shown in Figure 39 is displayed in which the mouse pointer shape is changed by the adjustment point and the rotation arrow. The eight zoom adjustment points are located at the middle point of the four sides of the active region boundary of the rectangular shaped object, The rotation adjustment point appears at the top of the active area boundary of the object.

Step 2: Move the mouse pointer over each zoom control point to change the shape of the mouse pointer to indicate the direction that it can be zoomed in or, if you move the mouse pointer over the rotation adjustment point, 40, 41, 42, and 43) in which the pointer shape is changed,

(Depending on the position of each zoom control point, a left / right double arrow or an up / down double arrow or a left upper right diagonal double arrow or a right diagonal double arrow will appear.)

Step 3: Press the left mouse button

It is a step to generate a signal to start zooming or rotating the object immediately.

Step 4: If the object is zoomed or rotated by dragging in the desired direction

In this fourth step, the object enlargement / reduction aspect of the 16 adjustment points selected from the enlargement / reduction adjustment points 1 to 8 in FIG. 39 by the straight line dragging in two directions per each adjustment point, Examples of 17 different aspects of object variation, including one rotation aspect, are included.

The object enlargement / reduction aspect of the 16 aspects by the selected adjustment point and the two-direction linear drag from 1 to 8 enlargement / reduction adjustment points of FIG. 39 to be described later is proportional to the rate of change of the horizontal / The rate of change of the horizontal / vertical length of the object is changed, and the position of the center point of the object is also changed.

According to the method of the present invention, as in the case where the first to third steps of the object shape transformation method are performed by merely touching the object so that the object is recognized as a target button (= target object) And four steps in the object shape transformation method which require the activation step of the conventional object in which 17 object change patterns are implemented can be performed through multi-touch post-manipulation.

For the sake of clarity, we will illustrate by way of example the above-mentioned 17 object changes.

Hereinafter, the upper side transverse side refers to the side connecting the adjustment points 1 and 2 among the adjustment points on the active region boundary of the object shown in FIG. 39, and the lower side side refers to the side of the adjustment points And the left vertical side refers to the side connecting the adjustment points 1 and 3 among the adjustment points on the boundary line of the active area of the object, and the right side refers to the side connecting the adjustment points of the object Refers to the side connecting the adjustment points 2 and 4 among the adjustment points in the region boundary.

1) When dragging upward from the adjustment point No. 5 on the upper side of Fig. 39, the length of the upper side and the lower side and the position of the lower side do not change, and only the length of the left side and the side of the right side are enlarged. For example, Fig. 26 shows a change in the aspect of Fig. 27.

2) When dragged downward from the adjustment point 5 on the upper side of Fig. 39, the length of the upper side and the lower side and the position of the lower side do not change and only the length of the left side and the side of the right side are reduced. For example, it is the degree of change from FIG. 27 to FIG. 26.

3) When dragging upward from the adjustment point 7 on the lower side of FIG. 39, the length of the upper side and the lower side and the position of the upper side are not changed, and only the length of the left side and the side of the right side are reduced. For example, Fig. 26 is a view showing a variation of Fig. 28.

4) When dragged downward from the adjustment point 7 on the lower side of Fig. 39, the length of the upper side and the lower side and the position of the upper side are not changed, and only the length of the left side and the side of the right side are enlarged. For example, the degree of change from FIG. 28 to FIG.

5) When dragged rightward from the 8th adjustment point on the left side of FIG. 39, the length of the left vertical side and the right vertical side and the position of the right vertical side do not change, and only the length of the upper side and lower side are reduced. For example, it is the aspect that changes from FIG. 26 to FIG. 30.

6) When dragged in the left direction from the 8th adjustment point on the left side of FIG. 39, the length of the left vertical side and the right vertical side and the position of the right vertical side do not change, and only the length of the upper side and the lower side are enlarged. For example, it is the degree of change from FIG. 30 to FIG. 26.

7) When dragged to the right from the sixth adjustment point on the right vertical side of FIG. 39, the length of the left vertical side and the right vertical side and the position of the left vertical side do not change, and only the length of the upper side and the lower side are enlarged. For example, it is the degree of change from FIG. 26 to FIG. 29.

8) When dragged in the left direction from the sixth adjustment point on the right vertical side of FIG. 39, the length of the left vertical side and the right vertical side and the position of the left vertical side do not change, and only the length of the upper lateral side and the lower vertical side are reduced. For example, it is the degree of change from FIG. 29 to FIG. 26.

9) If the upper left corner vertex of FIG. 39 is dragged from the first adjustment point toward the lower right direction, the position of the fourth vertex, which is the lower right vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length differs depending on which side of the lower right direction is dragged within the range of 90 degrees in the lower right direction. For example, the degree of change from FIG. 26 to FIG.

10) When the upper left corner vertex of FIG. 39 is dragged in the left upper direction from the first adjustment point, the position of the fourth vertex, which is the lower right vertex, does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length differs depending on which upper left side direction has been dragged within the range of 90 degrees left upper side. For example, the degree of change from FIG. 34 to FIG.

11) When dragging from the fourth lower adjustment point to the lower right direction in FIG. 39, the position of the vertex of the upper left corner is not changed and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length differs depending on which side of the lower right direction is dragged within the range of 90 degrees in the lower right direction. For example, the degree of change from FIG. 26 to FIG.

12) When dragged in the left upper direction from the fourth adjustment point, which is the lower right corner of FIG. 39, the position of the vertex of the upper left vertex is not changed, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length differs depending on which upper left side direction has been dragged within the range of 90 degrees left upper side. For example, it is the degree of change from FIG. 33 to FIG. 26.

13) When the upper right corner vertex of FIG. 39 is dragged in the upper right direction from the second adjustment point, the position of the vertex No. 3 as the lower left corner does not change and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length differs depending on which upper right side direction is dragged within 90 degrees of the upper right side direction. For example, the degree of change from FIG. 26 to FIG.

14) When dragged in the lower left direction from the second adjustment point, which is the upper right corner of FIG. 39, the position of the third lower vertex, i.e., the vertex No. 3, is not changed, and the lengths of the four sides are reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which lower left direction is dragged within the range of 90 degrees to the lower left direction. For example, it is the degree of change from FIG. 31 to FIG. 26.

15) When dragged in the upper right direction from the lower left corner vertex of FIG. 39, the position of the vertex of the upper right corner is not changed, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length differs depending on which upper right side direction is dragged within 90 degrees of the upper right side direction. For example, it is the degree of change from FIG. 26 to FIG.

16) When dragged in the lower left direction from the lower left corner vertex of FIG. 39, the position of the vertex of the upper right corner is not changed, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length differs depending on which lower left direction is dragged within the range of 90 degrees left lower direction. For example, the degree of change from FIG. 32 to FIG.

17) When dragging in any direction among the 360 degrees from the adjustment point 9, which is the rotation adjustment point in FIG. 39, the object rotates in the drag direction.

In fact, it is possible to drag the drag direction at any one of the 360-degree directions (especially, at the adjustment points 1 to 4) in the adjustment points 1 to 8 of FIG. 39, The direction of dragging is merely an example in the above example. Also, the drag length is generally assumed to be the length of dragging.

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above problems, and it is an object of the present invention to provide an image processing apparatus and a method thereof, in which a button or objects appearing on a touch screen are touched, And a method for improving convenience.

Furthermore,

When a multi-touch is performed on a keyboard having a plurality of buttons,

A specific button is made to be recognized as a target button,

A certain button on the keyboard will be pressed until the button is released from the single touch,

(Depending on how long the touch remains)

If the touching state is maintained for a certain time or longer,

In a case where the touching state is different from the case where the touching state is maintained for less than the predetermined time,

Until the " certain button " is included and the multi-touch is released,

Even if the state in which the " certain button " is touched is held for a predetermined time or longer,

To react in the same manner as when the state in which the " certain button " is touched is held for less than a predetermined time,

I want to do something with multi touch,

As a button is touched (accidentally)

Even before the response to multi-touch appears,

I want to make sure that there is no embarrassment that a button will react when it is touched for a long time.

In the following, the word " finger " from the user's point of view can be replaced with the word " touch point "

=================================

Contents

A .. Multi-touch long press to disable recognition.

Method for recognizing the target button in multi - touch and character input method using multi - touch. ( There is a lot of content.)

=================================

A .. When multi-touch  Long press Unrecognizable  doing.

[Sudan Port 1-1]

A method of operating a keyboard,

Some buttons remain touched for a certain amount of time.

Which buttons are multi-touched with

The primary factor that determines which button will respond when touched

A method in which a button is multi-touched.

[Sudan Port 1-2]

Any button on the keyboard will remain on the display until a single touch for that button is initiated and then the single touch is released,

If the touching state is maintained for a certain time or longer ,

In a case where the touching state is different from the case where the touching state is maintained for less than the predetermined time,

The "any key" after a multi-touch being undertaken will be contained until the multi-touch is released,

Even if the state in which the " certain button " is touched is held for a predetermined time or longer,

The "any key" single-touch method is that the reaction time after being set out in a state in which the touch until a single touch is released is maintained above a certain period of time not to.

[Sudan Port 1-3]

The method according to claim 1,

Any button on the keyboard will remain on the display until a single touch for that button is initiated and then the single touch is released,

If the touching state is maintained for a certain time or longer ,

In a case where the touching state is different from the case where the touching state is maintained for less than the predetermined time,

The "any key" after a multi-touch being undertaken will be contained until the multi-touch is released,

Even if the state in which the " certain button " is touched is held for a predetermined time or longer,

How to react when multi-touch.

[Sudanese Ports 1-4]

The method according to any one of claims 1 to 3,

When a multi-touch on the keyboard,

Way that the button is recognized as a target button with any one of the touch point of the multi-touch at least two touch points.

[Sudanese Port 2]

The method according to claim 1,

'Any one touch point'

When the touch points are represented by (X, Y) coordinates,

A point having a value in a particular order among the order of magnitude of the X value or Y value of the multi-touched touch point.

[Sudanese Port 3]

3. The method of claim 2,

'Any one touch point'

When the touch point is represented by (X, Y) coordinates,

If the X value or Y value is the touch point with the greatest

Wherein the X value or Y value is the least touch point.

[Sudan Port 4]

4. The method of claim 3,

A method in which a specific character assigned to a button recognized as a target button is input.

[Sudanese Port 5]

5. The method of claim 4,

When the multi-touch touch point number is referred to as N,

Depending on the value of N,

How input characters can be different.

[Sudan Port 6]

6. The method of claim 5,

Make sure that any button is recognized as a target button

The way in which input characters are changed when a single touch is made and when a multi-touch is made.

[Sudan Port 7]

5. The method of claim 4,

When a multi-touch is dragged without releasing the multi-touch,

Depending on the direction in which you drag,

How input characters can be different.

[Sudanese Port 8]

8. The method of claim 7,

Make sure that any button is recognized as a target button

The way in which input characters are changed when a single touch is made and when a multi-touch is made.

[Sudanese Port 9]

9. The method according to any one of claims 4 to 8,

So that any button is recognized as a target button

When single-touch or multi-touch,

When the number of touch points is referred to as N,

And the Nth or Nth displayed character is input to the button recognized as the target button.

[Sudanese Port 10]

9. The method according to any one of claims 4 to 8,

When a single button is touched so that the button is recognized as the target button, the character displayed on the button is input,

When a button is multi-touched so that it is recognized as a target button, a character not displayed on the button is input.

[Sudanese Port 11]

9. The method according to any one of claims 4 to 8,

When a button is multi-touched so that it is recognized as a target button,

Wherein when a single touch is made such that any of the buttons is recognized as a target button, characters of a character group classified into different sequences are input on a spelling rule of a language character to which a character to be input belongs.

[Sudan Port 12]

12. The method of claim 11,

&Quot; What is a character in a character group classified into different series in the spelling rule "

If the language character is Hangul, the basic character (= bistered consonant) and the pair consonant

If the language character is English, it is lowercase and uppercase,

If the language character is Japanese, it is Hiragana and Katakana.

[Sudanese Port 13]

11. The method of claim 10,

When multi-touch,

When Hangul is input, a pair consonant is input,

When an English letter is entered, capital letters are entered.

How to input katakana when Japanese is input.

[Sudan Port 14]

11. The method of claim 10,

When multi-touch,

When Hangul is input, the character corresponding to the pair consonant of the character displayed on the corresponding button is input,

When an alphabet is entered, the uppercase letter of the lowercase letter on the button is entered

When Japanese is input, the character corresponding to the katakana hiragana displayed on the button is input.

[Sudan Port 15]

9. The method according to any one of claims 4 to 8,

If the same button is multi-touched so that it is recognized as the target button, or the multi-touch is dragged while the multi-touch is not released

If one or more consecutive runs are performed,

How different characters are entered depending on the number of times it is performed.

[Sudan Port 16]

When a multi-touch is made on a keyboard having a plurality of buttons, a specific button is recognized as a target button,

A certain button on the keyboard will be pressed until the button is released from the single touch,

If the touching state is maintained for a certain time or longer,

In a case where the touching state is different from the case where the touching state is maintained for less than the predetermined time,

Until the " certain button " is included and the multi-touch is released,

Even if the state in which the " certain button " is touched is held for a predetermined time or longer,

Wherein said " some button " is touched in the same manner as when it is held for less than a predetermined time.

B .. When multi-touch  How to recognize the target button Multi-touch  Input character using Way. ( There is a lot of content.)

[B Sudan Port 1]

In a device equipped with a touch screen, when a target button is recognized when the touch screen is multi-touched,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan Port 2]

B means In Item 1,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudanese section 3]

B means in item 2,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan section 4]

B means in item 2,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan section 5]

B means in item 2,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B means section 6]

B means in item 2,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan section 7]

B means In Item 1,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan section 8]

B means 1 to B In any one of the items 7 to 7,

In an apparatus equipped with a touch screen, in a method in which an operation signal is generated for a certain operation including multi-touch operation, including character input or object modification,

Wherein the method of operation after multi-touch is multi-on-off < RTI ID = 0.0 > and / or < / RTI >

[B Sudan Port 9]

B means In item 8,

Wherein the multi-on-off method is any one of the following methods.

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

[B Sudan Item 10]

B means In item 9,

Wherein the multi-multi-all-on-and-off method is any one of the following methods.

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

[B Sudan section 11]

B means In item 8,

Wherein the multi-drag method is one or more of the following methods.

1.5.2..8. Multi-drag

1.5.2..9. Multi-all drag

[B Sudan Port 12]

B means in item 11,

Wherein the multi-all-drag method is any one of the following methods.

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

[B Sudan section 13]

B means In item 8,

Wherein the multi-touch post-operation by the open finger (= multi-touch post-operation by the open touch point) method is any one of the following methods.

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

[B Sudan section 14]

A method for multi-touching a multi-touching touch screen, the method comprising the steps of: a)

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan section 15]

In an apparatus equipped with a touch screen, in a method in which an operation signal is generated for a certain operation including multi-touch operation, including character input or object modification,

Wherein the method of operation after multi-touch is multi-on-off < RTI ID = 0.0 > and / or < / RTI >

[B Sudan section 16]

B means in item 15,

Wherein the multi-on-off method is any one of the following methods.

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

[B Sudan section 17]

B means 16. In item 16,

Wherein the multi-multi-all-on-and-off method is any one of the following methods.

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

[B means section 18]

B means in item 15,

Wherein the multi-drag method is one or more of the following methods.

1.5.2..8. Multi-drag

1.5.2..9. Multi-all drag

[B Sudan section 19]

In the B means clause 18,

Wherein the multi-all-drag method is any one of the following methods.

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

[B Sudan Port 20]

B means in item 15,

Wherein the multi-touch post-operation by the open finger (= multi-touch post-operation by the open touch point) method is any one of the following methods.

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

[B Sudan Port 21]

In an apparatus equipped with a touch screen, in a method in which an operation signal is generated for a certain operation including multi-touch operation, including character input or object modification,

After the multi-touch operation,

Characterized in that the multi-tasking method is a method in which the multi-task is performed according to the number of times that the multi-on-off is performed at least one or more consecutive times.

[B Sudan section 22]

In the B means section 21, when a character is inputted by the multi-multi-tap method,

Wherein the characters belonging to the target character group related to the target button are displayed in a cyclic manner according to the number of times that the multi-on-off is performed at least one or more times in succession.

[B Sudan section 23]

B means in item 22,

After the characters are displayed in a cyclic manner, the displayed characters are input definitively when the cursor is moved or after a certain period of time (eg 2 seconds) so that another button is recognized as the target button.

[B Sudan section 24]

B means in item 22,

When multi-touch multi-touch is more detailed with n multi-touch,

At least one of the at least one character associated with the target button, belonging to the matched character group, is matched with at least one of the at least one character group among the at least one character group according to at least one n value, Character is input without changing the character mode.

[B Sudan section 25]

In B means clause 24,

Wherein the " specific character group " is any one of the following character groups:

1) One character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to one of the various character modes in a conventional general mobile phone including a character group of a special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

[B Sudan section 26]

B means 25. In item 25,

The term " specific character group " means that the character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode on the spelling rule corresponding to the currently set character mode.

[B Sudan Item 27]

In B means clause 24,

The term " a specific character group " is defined as any one of two or more different character groups that are classified into different series according to a spelling rule

In English,

If the currently set character mode is an upper case mode, it is a character group that can be input in the lower case mode,

If the currently set character mode is the lower case mode, it is a character group that can be input in the upper case mode,

In Japanese,

If the currently set character mode is the Hiragana character mode, it is a character group that can be input in the katakana character mode,

And if the currently set character mode is the katakana character mode, the character set is a character group that can be input in the hiragana character mode.

[B Sudan section 28]

B means 21 to B 27. A method according to any one of claims 27 to 27,

In a method in which a target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan Port 29]

B means 28. In the item 28,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudan Port 30]

B means in Item 29,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan Port 31]

B means in Item 29,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan 32]

B means in Item 29,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B Sudan section 33]

B means in Item 29,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan section 34]

B means 28. In the item 28,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan section 35]

B means clause 21 to B Clause 34. The method according to any one of claims 34 to 34,

The multi-

Wherein two fingers are used and are two multi-touches recognized by two touch points.

[B Sudan section 36]

B means Item 35,

The two fingers,

Characterized in that it is an index finger and a stop finger.

[B Sudan section 37]

B means clause 21 to B clause 36. The method according to any one of claims 36 to 36,

A multi-touch method as claimed in claim 1, wherein the multi-touch method is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan section 38]

B means clause 21 to B means according to any one of claims 37 to 37,

Wherein the multi-touch post-operation is at least one of the following operations.

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

[B Sudanese section 39]

B means clause 21 to B means according to any one of claims 38 to 38,

Wherein the applicable characters include common characters representing the language, such as water, numbers, or special characters.

[B Sudan Port 40]

B means clause 21 to B 39. A method according to any one of claims 39 to 39,

The character is characterized in that it includes at least one of Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Hangul, alphabetic mode, .

[B Sudan section 41]

A step of multi-touching an object (or an activated region of the object) to be recognized as a target button

And modifying the object (or the active area of the object) according to the multi-touch post-manipulation.

[B Sudan section 42]

In the B means section 41,

In a method in which a target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan section 43]

B means in item 42,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudan Item 44]

In the B means clause 43,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan section 45]

In the B means clause 43,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan section 46]

In the B means clause 43,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B Sudan section 47]

In the B means clause 43,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan section 48]

B means in item 42,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan Item 49]

B means clause 41 to B means according to any of the preceding clauses,

Wherein the manipulation is a drag.

[B Sudan Port 50]

In B means clause 49

The object (or the active area of the object) is enlarged when dragged in at least one first specific direction, and the object (or the active area of the object) is reduced when dragged in at least one second specific direction.

[B Sudan section 51]

B means 50. In the item 50,

When it is dragged upward, it is enlarged,

And dragging in the downward direction.

[B Sudan Port 52]

B means 50. In the item 50,

Wherein the ratio of the horizontal length to the vertical length of the object is maintained when the object is enlarged or reduced.

[B Sudan Item 53]

B means 50. In the item 50,

Wherein the center point of the object is not shifted when it is enlarged or reduced.

[B Sudan section 54]

B means in Item 49,

Only the horizontal length or the vertical length of the object (or the active area of the object) or the horizontal length and the vertical length are enlarged or reduced together with the drag direction determined by the apparatus.

[B Sudan section 55]

In B means 54,

When dragged in the first specific direction of the horizontal direction, the vertical length is not changed, the horizontal length is enlarged,

When dragged in the second specific direction of the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,

When dragged in the first specific direction of the vertical direction, the horizontal length does not vary, the vertical length is enlarged,

When dragged in the second specific direction of the vertical direction, the horizontal length does not vary, the vertical length is reduced,

When dragged in at least one first specific direction out of the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,

And dragging in at least one second specific direction out of the diagonal directions, wherein the transverse length and the longitudinal length are reduced at the same rate.

[B Sudan section 56]

B means in item 55,

When dragged in the right direction, the horizontal length is enlarged,

When dragging in the left direction, the horizontal length is reduced,

When dragged in the upward direction, the vertical length is enlarged,

When dragged in the downward direction, the vertical length is reduced,

When dragged in the upper left side or the upper right side direction, the horizontal length and the vertical length are enlarged at the same ratio,

When dragged in the lower left or lower right direction, the width is reduced in the same ratio as the width and height.

[B Sudan section 57]

In B means 54,

When dragged in the first specific direction of the horizontal direction, the vertical length is not changed, the horizontal length is enlarged,

When dragged in the second specific direction of the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,

When dragged in the first specific direction of the vertical direction, the horizontal length does not vary, the vertical length is enlarged,

When dragged in the second specific direction of the vertical direction, the horizontal length does not vary, the vertical length is reduced,

When dragged in at least one first specific direction range out of the diagonal directions, the transverse length and the vertical variation ratio are differently enlarged along the respective directions in the range,

And dragging to at least one second specific direction range out of the diagonal directions, the transverse length and the longitudinal variation ratio are reduced differently in each direction within the range.

[B Sudan section 58]

In the B means clause 57,

When dragged in the right direction, the horizontal length is enlarged,

When dragging in the left direction, the horizontal length is reduced,

When dragged in the upward direction, the vertical length is enlarged,

When dragged in the downward direction, the vertical length is reduced,

The enlargement ratio of the horizontal length and the vertical length is enlarged differently depending on which direction of the upper left side range or the upper right side range is dragged,

When dragged in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently depending on which direction of the lower left side range or the lower right side range is dragged.

[B Sudan section 59]

In B means 54,

Wherein the center point of the object is not moved or moved when the object is enlarged or reduced.

[B Sudan section 60]

B means in Item 49,

Step 1: The object (or the active area of the object) is multi-touched and dragged to be recognized as the target button, and the specific range within the object (or the active area of the object) .

Step 2: As the horizontal length or the vertical length of the object (or the active area of the object) changes depending on the recognized hit point and the determined drag direction, the direction in which the dragging starts approaches the center of the object (or the active area of the object) Direction in a direction in which the image is to be enlarged, and enlarging in a direction in which the image is farther away.

[B Sudan section 61]

B means 60. In the item 60,

If it is determined that the direction in which the dragging is started (as judged by the device), that is, the drag direction the user intended is one of the upper side, the lower side, the right side, or the left side,

If the determined dragged direction is a direction approaching the center of the object (or the active area of the object)

The length of two sides parallel to the drag direction determined from the two transverse sides or two longitudinal sides of the object (or the active area of the object) is reduced, the length of the two sides perpendicular to the determined drag direction is not changed,

If the determined dragged direction is a direction away from the center of the object (or the active area of the object)

The length of two sides parallel to the drag direction determined from the two transverse sides or two longitudinal sides of the object (or the active region of the object) is enlarged, and the lengths of the two sides perpendicular to the determined drag direction are not changed,

If it is determined that the direction in which the dragging is started (as judged by the device), that is, the drag direction intended by the user is one of the upper right side, the lower right side, the upper left side, or the lower left direction,

If the determined direction of dragging is the direction approaching the center of the object (or the active area of the object), the length of the side and sides are reduced. If the side is reduced, both sides are reduced to the same length, If the variation is reduced, both of the vertical sides are reduced to the same length, and it is possible to set the changing ratio of the horizontal length and the vertical length to be different depending on which direction is dragged in the specific drag direction range determined by the device. The length of the horizontal and vertical portions may be set to be the same at the same ratio,

If the determined dragged direction is the direction away from the center of the object (or the active area of the object), the length of the side and sides is widened. At this time, if the lateral side is enlarged, both lateral sides are enlarged to the same length. If the longitudinal side is enlarged, both vertical sides are enlarged to the same length. Depending on which direction is dragged in the specific drag direction range determined by the device, Wherein the change ratio of the length and the vertical length may be set to be different or the length of the horizontal and vertical lengths may be set to be the same at the same ratio regardless of the direction of the drag in the specific drag direction range.

[B Sudan section 62]

B means item 61,

 If it is determined that the direction in which the dragging is started (as judged by the device), that is, the drag direction intended by the user is the upper right side, the lower right side, the upper left side,

If the determined dragged direction is the direction approaching the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and dragging determined from the three sides surrounding the recognized target range The position of the side perpendicular to the direction is moved for reduction, the position of the opposite side of the side is not changed,

The center of the object moves in the judged drag direction and the drag direction judged from the three sides surrounding the recognized target range is detected if the judged dragged direction is a direction moving away from the center of the object (or the active area of the object) And the position of the opposite side of the side is not changed,

If it is determined that the direction in which the dragging is started (as judged by the device), that is, the drag direction intended by the user is one of the upper right side, the lower right side, the upper left side, or the lower left direction,

If the determined direction of dragging is the direction approaching the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and among the vertices in the recognized target range, The vertex closest to the straight line is moved for reduction, the position of the vertex opposite to the vertex may not be changed,

If the determined direction of dragging is the direction moving away from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and a straight line parallel to the drag direction Wherein the vertex closest to the vertex is moved for enlargement, and the position of the vertex opposite the vertex may not be changed.

[B Sudan section 63]

In the B means clause 62,

① (Object or object) 2 Multi-touch is done by sensing and stopping so that the activation area is the target button. (X1, Y1) and the Y value is the smallest coordinate (X2, Y2) in the activation area of the object before the shape transformation of the object time,

An index to be recognized as a reference finger at a point in an object activation area (e.g., area 5 in FIG. 45) having a Y value equal to or greater than the intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2 Touch "to the right part of the index finger, and then" drag all "to the upper side, it is possible to enlarge only the vertical length without changing the width of the object. Even when the vertical length is enlarged, the coordinate (s) having the smallest Y value (object area) or the object activation area (e.g., the lower side road) (E.g., the upper side of the road) can be enlarged so that only the vertical length of the object is shifted upward. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 27.

If it is recognized as a reference finger at a point in the object activation area (for example, area 7 in FIG. 45) having a Y value less than the intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2 When the multi-all is dragged to the upper side, the length of the object can be reduced without changing the length of the object, so that only the vertical length can be reduced. The coordinate (s) having the smallest Y value of the object activation area (object area) or object activation area (s) without changing the coordinate (s) having the largest Y value of the object activation area Only the length of the object can be reduced in the form of being shifted to the upper side. To simplify the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 28.

② (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activation area becomes the target button. 2 Multi-touch When the coordinates of the object with the largest Y value in the active region (object region or object) before transformation are (X1, Y1) and the coordinate with the smallest Y value is (X2, Y2) time,

An object to be recognized as a reference finger is touched to a point in the object activation area (object area or area) having a Y value equal to or greater than the intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2, If the object is touched at any point and then dragged downward, it is possible to reduce the length of the object without changing the length of the object. Even when the vertical length is reduced, the coordinate (s) having the smallest Y value of the object region (or the object region) are not changed, and the Y value of the (object or) object activation region is shifted downward It is possible to reduce the length of the object in the losing form. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 27 to FIG. 26.

If an index finger to be recognized as a reference finger is touched to a point in the object activation area (object area or area) having a Y value less than an intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2, The object can be enlarged only by the vertical length without changing the width of the object when the object is touched to the right of the object and then 'drag all' to the lower side. The coordinate (s) having the smallest Y value of the object activation area (object area) or object activation area (s) without changing the coordinate (s) having the largest Y value of the object activation area The length of the object can be enlarged only in the form of being moved to the lower side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 28 to FIG. 26.

③ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. (X1, Y1) and the coordinate with the smallest X value is (X2, Y2) in the active region of the object before the shape transformation of the object time,

An index to be recognized as a reference finger at a point in the object activation area (e.g., area 6 in FIG. 45) having an X value equal to or larger than the intermediate value (= (X1 + X2) / 2) of X1 and X2 Touch "to the right part of the index finger, and then" drag all "to the right, the object can be enlarged only by the width without changing the vertical length. Even if only the width is enlarged, the coordinate (s) having the smallest X value (object area) or the object activation area (e.g., the left vertical side) (S) (eg, the right vertical side) can be enlarged so that only the horizontal length of the object is shifted to the right. The above description will be briefly described with reference to the drawings.

If it is recognized as a reference finger at a point in the object activation area (for example, area 8 in FIG. 45) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) When the multi-all is dragged to the right after the predetermined detection is touched and the stop is touched at any point on the right side of the index finger, the length of the object can be reduced without changing the vertical length. The coordinate (s) having the smallest X value of the object activation area (object area) or the object activation area (s) without changing the coordinate (s) having the largest X value of the object activation area It is possible to reduce only the length of the object in the form of shifting to the right. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 30.

④ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. (X1, Y1) and the coordinate with the smallest X value is (X2, Y2) in the active region of the object before the shape transformation of the object time,

An object to be recognized as a reference finger is touched to a point in the object activation area (object area or the object area) having an X value equal to or larger than an intermediate value (= (X1 + X2) / 2) of X1 and X2, When the object is dragged to the left side, it is possible to reduce the width of the object without changing the length of the object. The coordinates of the object having the smallest X value of the object area or the object activation area are not changed and the coordinates of the object having the largest X value of the object activation area are shifted to the left, Only the length of the transverse direction can be reduced. Briefly describing the above description with reference to the drawings, it is exemplified that it is changed from FIG. 29 to FIG. 26.

If an index finger to be recognized as a reference finger is touched at a point in the object activation area (object area or area) having an X value less than the intermediate value (= (X1 + X2) / 2) of X1 and X2, When the object is touched at any point on the right side of the object, and then 'multi-all-dragged' to the left side, the object can be enlarged only in its length without changing its length. The coordinate having the largest X value of the (object region or) object activation region remains unchanged, and the coordinate having the smallest X value of the object activation region (object region) or the object activation region is shifted further to the left Only the horizontal length of the object can be enlarged. The above description will be briefly described with reference to the drawings, for example, changing from FIG. 30 to FIG. 26.

⑤ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area is the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

An object region or an object activation region having an Y value equal to or larger than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and an intermediate value (= (Y1 + Y2) / 2) For example, an area that can be included in the area 2 of FIG. 45) is touched, and the stop is made to touch any point on the right side of the index finger, and then the multi- , The horizontal and vertical lengths of the object can be enlarged at the same rate. (Object or area), the coordinates of the object having the smallest X value and Y value (e.g., the third vertex in FIG. 39) of the object activation area (object or area) The horizontal and vertical lengths of the object can be enlarged in such a manner that the coordinates having the largest X value and Y value of the object activation area (for example, the second vertex in FIG. 39) are shifted to the upper right side. The above description will be briefly described with reference to the drawings.

(Object region or object region) having an X value less than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) It is possible to touch an index finger to be recognized as a reference finger at a point in the object activation area (for example, an area that can be included in the area 3 of FIG. 45), and to stop the touch at any point on the right part of the index finger, When 'multi-drag all', the horizontal and vertical length of the object can be reduced to the same ratio. The X and Y values of the (object region or object) activation region have the largest coordinate, and the X value and the Y value of the object activation region (object region or object activation region) The length and width of the object can be reduced in such a way that the coordinate having the smallest value is shifted to the upper right side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 32.

⑥ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

(Object region or object) region having an X value equal to or greater than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value equal to or larger than an intermediate value (= (Y1 + Y2) / 2) between Y1 and Y2 And the stop is touched at any point on the right side of the index finger, and then when the 'multi-drag' is performed to the lower left side, the horizontal and vertical lengths of the object are reduced to the same ratio can do. Even if the width and height of the object are reduced to the same ratio, the coordinates with the smallest X value and Y value of the (object area or object) area can be changed without changing the X value and Y value of the (object or object) The length and width of the object may be reduced in such a manner that the largest coordinate is shifted to the lower left side. The above description will be briefly described with reference to the drawings.

(Object region or object region) having an X value less than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) The object to be recognized by the reference finger is touched at a point in the object activation area, and the stop is touched at any point on the right side of the index finger, and then when the object is multi-dragged to the lower left side, Quot ;, respectively. The coordinates of the object having the largest X value and the Y value of the object area (or object area) are not changed, and the X value and the Y value of the object activation area (object area or object activation area) The width and height of the object can be increased in such a way that the coordinate with the smallest value is shifted to the lower left. The above description will be briefly described with reference to the drawings.

⑦ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activation area is the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

(Object region or object) region having an X value equal to or greater than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) (For example, an area that can be included in the area No. 4 in FIG. 45) is touched to be recognized by the reference finger, and the stop is made to touch any point on the right side of the index finger, Drag ", the horizontal and vertical lengths of the object can be enlarged at the same rate. Even when the width and height of the object are enlarged at the same ratio, the coordinates (the object area or the object having the smallest X value and the largest Y value of the object activation area, for example, the first vertex in FIG. 39) Or, the horizontal and vertical lengths of the object can be enlarged in such a manner that the coordinates of the object having the largest X value and the smallest Y value (for example, the fourth vertex in FIG. 39) are shifted to the lower right side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 33.

If an object (object region or object) having an X value less than an intermediate value of X1 and X2 (= (X1 + X2) / 2) and a Y value equal to or greater than an intermediate value of Y1 and Y2 (= (Y1 + Y2) 45), and the stop is made to be touched at any point on the right side of the index finger, and then the finger is touched to the right side of the index finger, Drag ", the horizontal and vertical lengths of the object can be reduced to the same ratio. The coordinates of the object having the largest X value and the smallest Y value are not changed (the object area or the object area), and the X value of the object activation area And the length of the object is reduced in the form in which the coordinate having the smallest Y value is shifted to the lower right side. The above description will be briefly described with reference to the drawings.

⑧ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

(Object region or object) region having an X value equal to or greater than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) And the stop is touched at any point on the right side of the index finger, and then when the object is multi-dragged to the upper left side, the object is horizontally and vertically scaled down at the same rate . Even if the width and height of the object are reduced by the same ratio, the coordinates of the object (or object) or the area of the object activation area having the smallest X value and the greatest Y value do not change, It is possible to reduce the horizontal and vertical length of the object in such a form that the coordinates with the largest Y value are shifted to the upper left side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 33 to FIG. 26.

If an object (object region or object) having an X value less than an intermediate value of X1 and X2 (= (X1 + X2) / 2) and a Y value equal to or greater than an intermediate value of Y1 and Y2 (= (Y1 + Y2) When the multi-all dragging is performed to the upper left side after touching any one of the right side portions of the index finger, the stopper is touched at the same ratio of the horizontal and vertical lengths of the object As shown in FIG. The coordinates of the object having the largest X value and the smallest Y value are not changed (the object area or the object area), and the X value of the object activation area The horizontal and vertical lengths of the object can be enlarged in such a manner that the coordinate with the smallest Y value is shifted to the upper left side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 34 to FIG. 26.

[B Sudan section 64]

B means item 61,

Wherein the center point of the object is shifted in magnification or reduction.

[B Sudan section 65]

B means clause 41 to B means according to any one of claims 64 to 64,

The multi-

Wherein two fingers are used and are two multi-touches recognized by two touch points.

[B Sudan section 66]

B means section 65,

The two fingers,

Characterized in that it is an index finger and a stop finger.

[B Sudan section 67]

B means clause 41 to B means according to any one of claims 66 to 66,

A multi-touch method as claimed in claim 1, wherein the multi-touch method is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan Port 68]

B means clause 41 to B means according to any one of claims 67 to 67,

The multi-touch post-operation is at least one of the following operations

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..7. Multi-drag

1.5.2..8. Multi-drag

1.5.2..9. Multi-all drag

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

1.5.2..12. Multi-tap

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

[B Sudan Port 69]

A method for inputting characters in an apparatus equipped with a touch screen,

Displaying a keyboard on which a plurality of characters are assigned to a touch screen;

In the process of multi-on and off so that a specific button is recognized as a target button,

After the point of multi-touch, or after the point of multi-touch including the point after the multi-touch finger is turned off (= the multi-touch is released)

And inputting a character of a specific sequence number among the characters assigned to the button recognized as the target button.

[B Sudan Port 70]

B means section 69,

When multi-touch is more detailed with n multi-touch,

and the specific order number is determined according to the value of n.

[B Sudan 71]

In B means section 70,

n is equal to the numerical value corresponding to the sequence number of the specific sequence number.

[B Sudan 72]

In B means section 70,

if the value of n is 2, that is, if it is two multi-touch, the second character assigned to the button recognized as the target button is input.

[B Sudan section 73]

In B means section 70,

If the value of n is 3, that is, 3 multi-touch, the third character assigned to the button recognized as the target button is input,

if the value of n is 4, that is, if it is 4 multi-touch, the fourth character assigned to the button recognized as the target button is input.

[B Sudan section 74]

B means clause 69 to B In means 73,

In a method in which a target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan 75]

B means 74,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudan section 76]

In B means clause 75,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan Port 77]

In B means clause 75,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan Port 78]

In B means clause 75,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B Sudan Port 79]

In B means clause 75,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan Port 80]

B means 74,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan Port 81]

B means clause 69 to B In clause 80,

The two multi-touches may be multi-touches recognized by touch points of detection and stop,

The three multi-touches may be multi-touches recognized by the touch points of the finger,

Wherein the 4 multi-touches are multi-touches recognized by the touch points of the finger, the finger, and the finger.

[B Sudan Port 82]

B means clause 69 to B means 81. The method according to any one of claims 81 to 81,

A multi-touch method as claimed in claim 1, wherein the multi-touch method is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan Port 83]

B means clause 69 to B means 82. A method according to any one of claims 69 to 82,

The multi-touch post-operation is at least one of the following operations

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..12. Multi-tap

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

[B Sudan section 84]

B means clause 69 to B Clause 83. A method according to any one of claims 69 to 83,

Wherein the applicable characters include common characters representing the language, such as water, numbers, or special characters.

[B Sudan Port 85]

B means clause 69 to B means 74. A method according to any one of the preceding claims,

The character is characterized in that it includes at least one of Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Hangul, alphabetic mode, .

[B Sudan Port 86]

A method for inputting characters in an apparatus equipped with a touch screen,

Displaying a keyboard on which a plurality of characters are assigned to a touch screen;

When a multi-touch operation is performed after a multi-touch operation such that a specific button is recognized as a target button, after the multi-touch operation is started or after the operation is started,

And inputting a character of a specific sequence number among the characters assigned to the button recognized as the target button by the multi-touch post-operation.

[B Sudan section 87]

In the B means clause 86,

According to the multi-touch post-operation,

Wherein a specific sequence number of characters to be input is determined.

[B Sudan Port 88]

In B means clause 87,

And when the drag direction is different, it is recognized that the type of operation after the multi-touch is different.

[B Sudan Port 89]

In B means clause 87,

Wherein at least one character among at least one character associated with the target button is input without changing the character mode while belonging to the matched character group so that at least one character among at least one character group is matched according to the pre- ≪ / RTI >

[B Sudan Port 90]

In B means 89,

Wherein the " specific character group " is any one of the following character groups:

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

[B Sudan section 91]

B means clause 86 to B In clause 90,

In a method in which a target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan Port 92]

In B means 91,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudan Port 93]

B means 92. In item 92,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan section 94]

B means 92. In item 92,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan section 95]

B means 92. In item 92,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B Sudan section 96]

B means 92. In item 92,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan section 97]

In B means 91,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan Item 98]

B means clause 86 to B Clause 97. The method according to any one of claims 97 to 97,

The multi-

Wherein two fingers are used and are two multi-touches recognized by two touch points.

[B Sudan Item 99]

B means Item 98,

The two fingers,

Characterized in that it is an index finger and a stop finger.

[B Sudan Port 100]

B means clause 86 to B means that in any one of the items 99 to 99,

A multi-touch method as claimed in claim 1, wherein the multi-touch method is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan section 101]

B means clause 86 to B In item 100,

Wherein the multi-touch post-operation is at least one of the following operations.

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..7. Multi-drag

1.5.2..8. Multi-drag

1.5.2..9. Multi-all drag

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

1.5.2..12. Multi-tap

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

[B Sudan Port 102]

B means clause 86 to B means according to any one of claims 101 to 101,

Wherein the applicable characters include common characters representing the language, such as water, numbers, or special characters.

[B Sudan section 103]

B means clause 86 to B Clause 102. A device according to any one of claims 102 to 102,

The character is characterized in that it includes at least one of Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Hangul, alphabetic mode, .

[B means section 104]

A method for inputting characters in an apparatus equipped with a touch screen,

After the keyboard is displayed on the touch screen,

In a case where a specific button is operated after multi-touch so as to be recognized as a target button,

Off operation or a final operation of at least one of the final operations that may include nine operations including dragging in eight directions such as upper, lower, left, right, upper left, lower right, upper right, and lower right After the end of the last operation, including after or after the end of the last operation,

Multi-touch post-manipulation involving the final manipulation of at least one of the final operations that may include nine behaviors,

When a specific character among at least one character associated with a button recognized as a target button while belonging to a specific character group among at least one character group is input,

Wherein at least one character among at least one character associated with the target button is input without changing the character mode while belonging to the matched character group so that at least one character among at least one character group is matched according to the pre- ≪ / RTI >

[B Sudan section 105]

In the B means section 104,

Wherein the " specific character group " is any one of the following character groups:

1) One character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to one of the various character modes in a conventional general mobile phone including a character group of a special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

[B Sudan section 106]

In the B means section 105,

The term " specific character group " means that the character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode on the spelling rule corresponding to the currently set character mode.

[B Sudan section 107]

In B means section 106,

The term " a specific character group " is defined as any one of two or more different character groups that are classified into different series according to a spelling rule

In English,

If the currently set character mode is an upper case mode, it is a character group that can be input in the lower case mode,

If the currently set character mode is the lower case mode, it is a character group that can be input in the upper case mode,

In Japanese,

If the currently set character mode is the Hiragana character mode, it is a character group that can be input in the katakana character mode,

And if the currently set character mode is the katakana character mode, the character set is a character group that can be input in the hiragana character mode.

[B Sudan section 108]

B means 104 to B In means 107,

In a method in which a target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan Port 109]

In the B means section 108,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudan 110]

In B means 109,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan Port 111]

In B means 109,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan section 112]

In B means 109,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B Sudan section 113]

In B means 109,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan Port 114]

In the B means section 108,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan Item 115]

B means 104 to B In means 114,

The multi-

Wherein two fingers are used and are two multi-touches recognized by two touch points.

[B Sudan Port 116]

In B means section 115,

The two fingers,

Characterized in that it is an index finger and a stop finger.

[B Sudan section 117]

B means clause 104 to B means Clause 116. The method according to any of claims &

A multi-touch method as claimed in claim 1, wherein the multi-touch method is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan Port 118]

B means clause 104 to B means that in any one of items 117 to 117,

Wherein the multi-touch post-operation is at least one of the following operations.

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..7. Multi-drag

1.5.2..8. Multi-drag

1.5.2..9. Multi-all drag

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

1.5.2..12. Multi-tap

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

[B Sudan 119]

B means clause 104 to B means clause 118. The method according to any one of the preceding claims,

Wherein the applicable characters include common characters representing the language, such as water, numbers, or special characters.

[B Sudan Port 120]

B means clause 104 to B means that in any one of the clauses 119,

The character is characterized in that it includes at least one of Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Hangul, alphabetic mode, .

[B Sudan Port 121]

A method for inputting characters in an apparatus equipped with a touch screen,

After the keyboard is displayed on the touch screen,

In a case where a specific button is operated after multi-touch so as to be recognized as a target button,

Of the final operations that may include 5 (9?) Branching including 4 (8?) Directional dragging such as off, or up, down, left, right (upper left, lower left, upper right, lower right) After the start of the last operation, including after the start of the last operation of one operation or after the end of the last operation,

By a multi-touch post-operation including a final operation of at least one of the final operations that may include 5 (9?) Kinds of behaviors including multi-drag in the direction of 4 (8?

A first character which is a specific character of at least one character associated with a target button (or assigned to a target button ??) and belongs to a specific character group among at least one character group,

Characterized in that a second character, at least one specific character promised for each final operation, is additionally entered regardless of the target button.

[B Sudan 122]

In B means section 121,

In a method in which a target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan Port 123]

In B means section 122,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudan section 124]

In B means section 123,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan section 125]

In B means section 123,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan section 126]

In B means section 123,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B Sudan section 127]

In B means section 123,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan section 128]

In B means section 122,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan 129]

B means clause 121 to B means that in any one of the clauses 128,

And the character assigned to the target button is displayed to the left of the character to be additionally input.

[B Sudan 130]

B means Item 121 to B means Item 129:

Wherein the second character is one of a vowel, a consonant, a half vowel, a semi-consonant, or a special character.

[B Sudan 131]

At B-Sudan port 130,

Wherein the second character includes at least one of characters corresponding to pronunciations of English pronunciation symbols [a], [e], [i], [o], and [u] .

[B Sudan Item 132]

In B means section 130,

Wherein the second character includes at least one of A, E, I, O, and U.

[B Sudan section 133]

In B means section 130,

Wherein the second character comprises at least one of T, S, N, R, H, D, L,

[B Sudan section 134]

In B means section 130,

The second character may be at least one of a, b, c, t, ㅑ, ㅕ, ㅛ, ㅠ,,, ㅢ, ㅐ, ㅔ, ㅖ, ㅚ, ㅘ, ㅙ, ㅟ, The character input method comprising the steps of:

[B Sudan 135]

B means Item 121 to B means Item 129:

And if the character is dragged longer, the second character is two or more characters.

[B Sudan 136]

B means Item 121 to B means Item 129:

Further comprising the step of continuously adding and inputting additional characters when the drag is repeatedly dragged in the same direction or the drag direction is changed and dragged while the touch is maintained.

[B Sudan section 137]

B means clause 121 to B means that in any one of the clauses 128,

Wherein at least one character among at least one character belonging to the matched character group matches at least one of the character assigned to the target button and the character assigned to the target button without changing the character mode Are input together.

[B Sudan section 138]

B means section 137,

E, I, O, and U, if any one of the multi-all on-off and the multi-all dragging in four directions is performed,

If any one of the multi-nor-all reference fingers on and off or the four-way multi-nor-all reference finger drag is performed, the second character is either W or Y,

If any one of the four directions of the single drag operation is performed, the second character may be any one of T, S, N and R,

Wherein the second character is one of H, D, L, and C when any one of four directions of a single touch and a multi-all drag is performed.

[B Sudan 139]

B means clause 121 to B means clause [

When the number of characters assigned to the target button is two or more,

Wherein the first character is selected and input according to a state before the final operation.

[B Sudan section 140]

B means clause 121 to B Clause 139. A device according to any one of the preceding claims,

When the number of characters assigned to the target button is two or more,

Wherein the first character is selected and input according to a state before the final operation.

[B Sudan section 141]

B means section 121 to B instrument section 140,

The multi-

Wherein two fingers are used and are two multi-touches recognized by two touch points.

[B Sudan section 142]

B means section 141,

The two fingers,

Characterized in that it is an index finger and a stop finger.

[B Sudan section 143]

B means clause 121 to B means clause [

A multi-touch method as claimed in claim 1, wherein the multi-touch method is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan Item 144]

B means clause 121 to B means clause 143. The method according to any one of claims 121 to 143,

Wherein the multi-touch post-operation is at least one of the following operations.

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..7. Multi-drag

1.5.2..8. Multi-drag

1.5.2..9. Multi-all drag

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

1.5.2..12. Multi-tap

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

[B Sudan section 145]

B means clause 121 to B means clause 144. The method according to any of the preceding claims,

Wherein the applicable characters include common characters representing the language, such as water, numbers, or special characters.

[B Sudan section 146]

B means clause 121 to B means that in any one of the clauses 145,

The character is characterized in that it includes at least one of Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Hangul, alphabetic mode, .

[B Sudan Item 147]

A method for inputting characters in an apparatus equipped with a touch screen,

Displaying a keyboard on which a plurality of characters are assigned to a touch screen;

In the process of multi-on and off so that a specific button is recognized as a target button,

After the point of multi-touch, or after the point of multi-touch including the point after the multi-touch finger is turned off (= the multi-touch is released)

Wherein at least one character among at least one character associated with the target button is input without changing the character mode while belonging to the matched character group so that at least one character among at least one character group is matched according to the pre- The character input method comprising the steps of:

[B Sudan Port 148]

B In item 147,

Wherein the " specific character group " is any one of the following character groups:

1) One character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to one of the various character modes in a conventional general mobile phone including a character group of a special character mode.

Delete below?

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

[B Sudan 149]

B means section 148,

The term " specific character group " means that the character group to which other characters belong in the spelling rule is a character group of characters inputted in another character mode on the spelling rule corresponding to the currently set character mode.

[B Sudan Port 150]

In B means section 149,

The term " a specific character group " is defined as any one of two or more different character groups that are classified into different series according to a spelling rule

In English,

If the currently set character mode is an upper case mode, it is a character group that can be input in the lower case mode,

If the currently set character mode is the lower case mode, it is a character group that can be input in the upper case mode,

In Japanese,

If the currently set character mode is the Hiragana character mode, it is a character group that can be input in the katakana character mode,

And if the currently set character mode is the katakana character mode, the character set is a character group that can be input in the hiragana character mode.

[B Sudan section 151]

B means Item 147 to Item B In Item 150,

In a method in which a target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by a bullet point (= a method of recognizing a target button by a fingertip) And the target button is recognized by the target button recognition method based on the range.

[B Sudan section 152]

In B means section 151,

A method for recognizing a target button by a reference finger (= a method for recognizing a target button by a reference touch point) is any one of the following methods.

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

[B Sudan 153]

In the B means section 152,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on the reference touch point in accordance with the X-coordinate value order) by the reference finger in accordance with the X-coordinate value order,

Wherein a touch button including a point having an X coordinate value at the leftmost of the multi-touched touch points, that is, a first smallest of the X coordinate values, is recognized as a target button.

[B Sudan section 154]

In the B means section 152,

In the case where the target button recognition method is a target button recognition method (= target button recognition method based on a reference touch point according to the Y coordinate value order) by the reference finger in accordance with the Y coordinate value order,

Wherein a touch button including a point having a first Y coordinate value in a lowest order among a multi-touched touch point, that is, a small order of Y coordinate values, is recognized as a target button.

[B Sudan section 155]

In the B means section 152,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of X coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of X coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the X coordinate value of the first leftmost among the multi-touched touch points, that is, the smallest order of the X coordinate values, is recognized as the target button,

The touch button including a point having a second X coordinate value in a small order of the X coordinate values among the multi-touched touch points is recognized as the target button.

[B Sudan section 156]

In the B means section 152,

A target button recognition method is a method of recognizing a target button by a reference finger according to the order of Y coordinate values according to the number of multi-touched points (= a method of recognizing a target button by a reference touch point according to the order of Y coordinate values according to the number of multi- In some cases,

In the case of two multi-touches, the touch button including the point having the Y coordinate value of the first lowest among the multi-touched touch points, that is, the smallest order of the Y coordinate values, is recognized as the target button,

The touch button including a point having a second Y coordinate value in a small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. Lt; / RTI >

[B Sudan section 157]

In B means section 151,

Wherein the target button recognizing method (= target button recognizing method by the bullet touch point) by the opened finger is one of the following methods or more.

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

[B Sudan Port 158]

B means Item 147 to B means Item 157,

The two multi-touches may be multi-touches recognized by touch points of detection and stop,

The three multi-touches may be multi-touches recognized by the touch points of the finger,

Wherein the 4 multi-touches are multi-touches recognized by the touch points of the finger, the finger, and the finger.

[B Sudan Port 159]

B means clause 147 to B means 158. A method according to any one of the preceding claims,

A multi-touch method as claimed in claim 1, wherein the multi-touch method is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

[B Sudan section 160]

B means clause 147 to B Clause 159,

The multi-touch post-operation is at least one of the following operations

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..12. Multi-tap

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

[B Sudan 161]

B means clause 147 to B Clause 160. A device according to any of the claims 160 to 160,

Wherein the applicable characters include common characters representing the language, such as water, numbers, or special characters.

[Item B] Item 147 to Item B Item 161]

The character is characterized in that it includes at least one of Greek, Roman, Cyrillic, Indian, Arabic, Thai, Vietnamese, Hangul, alphabetic mode, .

In the following, the word " finger " from the user's point of view can be replaced with the word " touch point "

[Sudan Port 1A]

A method for recognizing a target button among buttons displayed on a touch screen in an apparatus having a touch screen,

A method of recognizing a target button by a reference finger, a method of recognizing a target button by using an opened finger, and a method of recognizing a target button by using two or more multitouch fingers.

[Sudan Port 2A]

The method of claim 1,

Wherein the reference finger is a finger having n (n > 2) th X coordinate values in a small sequence of X coordinate values among multi-touched fingers.

[Sudan Port 3A]

The method of claim 1,

Wherein the reference finger is a finger having n (n > 2) Y coordinate values among the multi-touched fingers in a sequence having a small Y coordinate value.

[Sudan Port 4A]

The method according to claim 2,

The method of claim 1,

Wherein a point having an X coordinate value touched by the reference finger among the multi-touched touch points is recognized as a target button.

[Sudanese Line 5A]

A method according to claim 3,

The method of claim 1,

Wherein a point having a Y coordinate value touched by the reference finger among the multi-touched touch points is recognized as a target button.

[Sudan Port 6A]

The method of claim 1,

A method for recognizing a target button by using a fingertip,

A method of recognizing a target button by a first opened finger, a method of recognizing a target button by a second opened finger, a method of recognizing a target button by a third opened finger, a method of recognizing a target button by a fourth opened finger, And a target-button recognition method according to an embodiment of the present invention.

[Sudan Port 7A]

The method according to claim 6,

The method of claim 1,

A button including a new X coordinate corresponding to the average value of the X coordinates of the touched points of the multi-touched fingers and a new Y coordinate corresponding to the average value of the Y coordinates of the touched points of the multi-touched fingers And recognizes the recognition result.

[Sudanese Port 8A]

The method according to claim 6,

The method of claim 1,

A point made up of a new X coordinate corresponding to the average value of the X coordinates of the touched points of the multi-touched fingers and a Y coordinate paired with the X coordinate of the specific order among the order of magnitude of the X coordinate value of the points touched with the multi- And recognizes the included touch button as the target button.

[Sudan Port 9A]

The method according to claim 6,

The method of claim 3,

A touch button including a point consisting of a new X coordinate corresponding to an average value of X coordinates of points touched by the multi-touched fingers and a Y coordinate of a specific order among the order of magnitude of Y coordinate values of points touched with multi- Button. ≪ / RTI >

[Sudan Port 10A]

The method according to claim 6,

The method of claim 1,

A point consisting of a new Y coordinate corresponding to the average value of the Y coordinates of the touched points of the multi-touched fingers and an X coordinate paired with the Y coordinate of the specific order among the order of magnitude of the Y coordinate values of the points where the multi- And recognizes the included touch button as the target button.

[Sudan Port 11A]

The method according to claim 6,

The method of claim 5,

A touch point including a point consisting of a new Y coordinate corresponding to an average value of Y coordinates of points touched by multi-touched fingers and an X coordinate of a specific order among the order of magnitude of X coordinate values of points touched by multi- Button. ≪ / RTI >

[Sudan Port 12A]

The method of claim 1,

Wherein the target-button recognition method using the two or more multi-

And a range including two or more touch points is recognized as a target button.

[Sudan Port 13A]

The method of claim 1,

The multi-touch includes n multi-touch (n is a natural number), multi-touch, multi-all touch, multi-touch all-finger touch, multi- Multi-touch by finger, Multi-touch by finged finger, Multi-touch by touch of fingertip, Touch of finger by multi-nadol by finger, ≪ / RTI >

[Sudanese Port 1B]

Displaying buttons assigned a plurality of characters on the touch screen in an apparatus having a touch screen;

Inputting a first character among a plurality of characters assigned to the target button when a target button among the buttons is operated after a single touch; And

And inputting characters other than the first character among a plurality of characters assigned to the target button when the target button is operated after multi-touch operation.

[Sudanese Port 2B]

The method according to claim 1,

Wherein the step of inputting a character other than the first character comprises:

Inputting a second character among a plurality of characters assigned to the target button when the target button is operated after two-multi-touch;

Inputting a third character among a plurality of characters assigned to the target button when the target button is operated after 3-multi-touch; And

And inputting the fourth character among the plurality of characters assigned to the specific button when the target button is operated after the multi-touch operation.

[Sudanese Port 3B]

The method according to claim 2,

Wherein the multi-touch post-manipulation is multi-on-off, and the characters assigned to the target button are displayed in a cyclic manner according to the number of times that the multi-on-off is continuously performed one or more times.

[Sudanese Port 4B]

The method according to claim 2,

The multitouch post-operation is a multi-tap,

Wherein the target button comprises a plurality of character groups including at least one character and a plurality of character groups selected by the multi-touch, and inputting at least one character included in the specific character group by the multi-tap; The character input method further comprising:

[Sudanese Port 5B]

The method of claim 4,

Wherein the character group includes at least one character group consisting of at least one or more characters classified in different sequences in the spelling of the same character, a character group consisting of special characters, a character group consisting of at least one character assigned to the buttons sequentially And a group of characters including at least one character assigned to be displayed at a specific position of the button.

[Sudan Port 6B]

The method of claim 5,

The group of characters consisting of at least one or more characters classified in different series on the basis of the spelling of the same character may be a group of letters consisting of capital letters, a group of letters consisting of lowercase letters, a group of letters consisting of hiragana And a character group consisting of katakana characters is spelled out.

[Sudan Port 7B]

The method of claim 6,

Wherein the specific character group includes:

If the character mode of the target button is an upper-case letter mode of the alphabet letters, and if the target mode is a lower-case letter mode of the alphabet letters,

Wherein if the character mode of the target button is a one-character hiragana character mode, the character group is a group of characters consisting of katakana, and if the target character mode of the target button is a one-character katakana character mode, the character group is composed of a hiragana character group.

[Sudan Port 8B]

The method according to claim 1,

The target button is determined by any one of a group including a target finger recognition method using a reference finger, a target button recognition method using a bulleted touch point, and a target button recognition method using a range including two or more touch points The character input method comprising:

[Sudan Port 9B]

The method of claim 8,

Wherein the target button recognition method using the reference finger recognizes a button touched by a finger having an X coordinate value of the n-th coordinate among the multi-touched fingers as a target button.

[Sudanese Port 10B]

The method of claim 8,

Wherein the target button recognition method using the reference finger recognizes a button touched with a finger whose Y coordinate value is nth among multi-touched fingers as a target button.

[Sudanese Port 11B]

The method of claim 8,

The method of recognizing a target button using the opened finger includes the steps of: determining whether an X-coordinate value and a Y-coordinate value having a magnitude in a specific order among the X-coordinate values of points touched by the multi- And the button is recognized as the target button.

[Sudanese Port 12B]

The method of claim 11,

The target button recognition method using the opened finger is determined by a new X coordinate value determined as an average value of X coordinate values of the touched points and an average value of Y coordinate values of the touched points of the multi-touched finger And a button including a point made up of a new Y coordinate value is recognized as a target button.

[Sudan Port 13B]

The method of claim 11,

The method for recognizing a target button using the opened finger may include a new X coordinate determined by an average value of X coordinate values of touched points and an X coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates paired with the X coordinate is recognized as the target button.

[Sudan port 14B]

The method of claim 11,

The method for recognizing a target button using the opened finger may include a step of obtaining a new X coordinate determined by an average value of X coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates is recognized as a target button.

[Sudan Port 15B]

The method of claim 11,

The method for recognizing a target button using the opened finger may include a new Y coordinate determined by an average value of Y coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of an X-coordinate and a pair of Y-coordinates, is recognized as a target button.

[Sudan Port 16B]

The method of claim 11,

The method of recognizing a target button by the opened finger is a method of recognizing a target button in a specific order among a new Y coordinate determined by an average value of Y coordinate values of touched points and an X coordinate value magnitude order of points touched by multi- And a button including a point made up of X coordinates is recognized as a target button.

[Sudan Port 17B]

The method of claim 8,

Wherein the target-button recognition method using the two or more multi-

And a range including two or more touch points is recognized as a target button.

[Sudan Port 18B]

The method according to claim 1,

The character may include at least one of the following groups including Greek Roman characters, Cyrillic characters, Indian characters, Arabic letters, Thai letters, Vietnamese letters, Hangul letters, alphabetic letters, world language letters including Japanese letters, numbers and special characters The character input method comprising:

[Sudanese Port 1C]

Displaying buttons assigned to a plurality of characters on the touch screen in an apparatus having a touch screen;

Inputting any one of a plurality of characters assigned to the target button when the target button of the buttons is operated after a single touch; And

And inputting another character among a plurality of characters assigned to the target button when the target button is operated after multi-touch operation.

[Sudanese Port 2C]

The method according to claim 1,

Wherein the single-touch post-operation is a single on-off operation, and the multi-touch post-operation is a multi-on-off operation.

[Sudanese Port 3C]

The method according to claim 2,

The multitouch post-manipulation includes multi-on-off, multi-all all on & off, multi-allall standard finger on & off, multi-all all reference standard finger on & off, multi- , Multi-all on & off by multi-all on & off by fingers, multi-on all off by finged fingers, multi-all all by fingers The character input method comprising the steps of:

[Sudanese Port 4C]

The method according to claim 2,

The step of inputting and processing the character further includes inputting another character among a plurality of characters assigned to the target button through single touch dragging or multi touching dragging, respectively .

[Sudanese Port 5C]

The method according to claim 4,

The multi-touch post-dragging may be a multi-drag, a multi-drag, a multi-all drag, a multi-nath all, a standard drag, a multi-drag, A multi-pick all-drag based on a finger, a multi-pick all-finger drag by a finged finger, and a multi-all all reference finger drag by a finged finger.

[Sudanese Port 6C]

The method according to claim 5,

Wherein the direction of the drag includes at least one of a group including upper, lower, left, right, upper left, lower left, upper right, and lower right.

[Sudanese Port 7C]

The method according to claim 6,

Wherein the inputting of the characters comprises inputting different characters according to the direction of the drag.

[Sudanese Port 8C]

The method according to claim 1,

The target button is determined by any one of a group including a target finger recognition method using a reference finger, a target button recognition method using a bulleted touch point, and a target button recognition method using a range including two or more touch points The character input method comprising:

[Sudan Port 9C]

The method according to claim 8,

Wherein the target button recognition method using the reference finger recognizes a button touched by a finger having an X coordinate value of the n-th coordinate among the multi-touched fingers as a target button.

[Sudanese Port 10C]

The method according to claim 8,

Wherein the target button recognition method using the reference finger recognizes a button touched with a finger whose Y coordinate value is nth among multi-touched fingers as a target button.

[Sudanese Port 11C]

The method according to claim 8,

The method of recognizing a target button using the opened finger includes the steps of: determining whether an X-coordinate value and a Y-coordinate value having a magnitude in a specific order among the X-coordinate values of points touched by the multi- And the button is recognized as the target button.

[Sudan Port 12C]

The method according to claim 11,

The target button recognition method using the opened finger is determined by a new X coordinate value determined as an average value of X coordinate values of the touched points and an average value of Y coordinate values of the touched points of the multi-touched finger And a button including a point made up of a new Y coordinate value is recognized as a target button.

[Sudan Port 13C]

The method according to claim 11,

The method for recognizing a target button using the opened finger may include a new X coordinate determined by an average value of X coordinate values of touched points and an X coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates paired with the X coordinate is recognized as the target button.

[Sudan port 14C]

The method according to claim 11,

The method for recognizing a target button using the opened finger may include a step of obtaining a new X coordinate determined by an average value of X coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates is recognized as a target button.

[Sudan Port 15C]

The method according to claim 11,

The method for recognizing a target button using the opened finger may include a new Y coordinate determined by an average value of Y coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of an X-coordinate and a pair of Y-coordinates, is recognized as a target button.

[Sudan Port 16C]

The method according to claim 11,

The method of recognizing a target button by the opened finger is a method of recognizing a target button in a specific order among a new Y coordinate determined by an average value of Y coordinate values of touched points and an X coordinate value magnitude order of points touched by multi- And a button including a point made up of X coordinates is recognized as a target button.

[Sudan Port 17C]

The method according to claim 8,

Wherein the target-button recognition method using the two or more multi-

And a range including two or more touch points is recognized as a target button.

[Sudan Port 18C]

The method according to claim 1,

The multi-touch can be divided into n multi-touch, multi-all touch, multi-all touch, multi-nath all reference finger touch, multi-not all reference finger touch, multi- A multi-all-touch by a finger, a multi-all-touch by a fingertip, a multi-allall reference finger by a fingered finger, and a multi-all all reference by a finged finger. Character input method.

[Sudan Port 19C]

The method according to claim 1,

The character may include at least one of the following groups including Greek Roman characters, Cyrillic characters, Indian characters, Arabic letters, Thai letters, Vietnamese letters, Hangul letters, alphabetic letters, world language letters including Japanese letters, numbers and special characters The character input method comprising:

[Sudanese Port 1D]

Recognizing a target button among buttons assigned to a plurality of characters displayed on the touch screen in an apparatus having a touch screen; And

And determining a character mode according to a post-touch operation on the target button.

[Sudan Port 2D]

In the first aspect,

Wherein the determination step is determined as a different character mode depending on the type of touch with respect to the target button.

[Sudan Port 3D]

The method of claim 2,

Wherein the determining step determines the first character mode when the single-touch operation is input to the target button, and determines the second character mode when the multi-touch post-operation is input to the target button. Way.

[Sudan Port 4D]

In the first aspect,

Wherein the determining step further comprises the step of inputting characters of a character mode different from the character mode of the character assigned to the target button according to the type of operation after touching the target button.

[Sudanese Port 5D]

In the first aspect,

And inputting characters of another character mode together with the characters assigned to the target button according to a type of operation after touching the target button.

[Sudan Port 6D]

In the first aspect,

The character mode may be any one of a group including a Greek roman mode, a Cyrillic character mode, an Indian character mode, an Arabic character mode, a Thai character mode, a Vietnamese character mode, an English character mode, a Hangul character mode, Character input method.

[Sudanese Port 7D]

The method according to claim 6,

Wherein the character mode includes an upper case mode and a lower case mode in the case of the alphabetic character mode, and a hiragana character mode and a katakana character mode in the case of the one character mode.

[Sudanese Port 8D]

In the first aspect,

Wherein the touch is a single touch or a multitouch.

[Sudanese Port 9D]

The method according to claim 8,

Wherein the multi-touch is a touch using two or more fingers.

[Sudanese Port 10D]

The method according to claim 8,

The multi-touch can be divided into n multi-touch, multi-all touch, multi-all touch, multi-nath all reference finger touch, multi-not all reference finger touch, multi- A character including any one of the group consisting of a multi-all touch by a finger, a multi-all-all touch by an opened finger, a multi-not all-reference finger touch by an opened finger, and a multi- Input method.

[Sudanese Port 11D]

The method according to claim 10,

The multi-touch can be multi-on and off, multi-on & off, multi-all all on & off, multi-on all fingertip on & off, multi- Multi-all on & off by open fingers, Multi-all all on & off by opened fingers, Multi-notar by standard fingers A group including multi-nor all fingers based on on and off and open fingers The character input method comprising the steps of:

[Sudanese Port 12D]

The method according to claim 8,

The target button is determined by any one of a group including a target finger recognition method using a reference finger, a target button recognition method using a bulleted touch point, and a target button recognition method using a range including two or more touch points The character input method comprising:

[Sudanese Port 13D]

The method according to claim 12,

Wherein the target button recognition method using the reference finger recognizes a button touched by a finger having an X coordinate value of the n-th coordinate among the multi-touched fingers as a target button.

[Sudan Port 14D]

The method according to claim 12,

Wherein the target button recognition method using the reference finger recognizes a button touched with a finger whose Y coordinate value is nth among multi-touched fingers as a target button.

[Sudanese Port 15D]

The method according to claim 12,

The method of recognizing a target button using the opened finger includes the steps of: determining whether an X-coordinate value and a Y-coordinate value having a magnitude in a specific order among the X-coordinate values of points touched by the multi- And the button is recognized as the target button.

[Sudanese Port 16D]

The method according to claim 15,

The target button recognition method using the opened finger is determined by a new X coordinate value determined as an average value of X coordinate values of the touched points and an average value of Y coordinate values of the touched points of the multi-touched finger And a button including a point made up of a new Y coordinate value is recognized as a target button.

[Sudan Port 17D]

The method according to claim 15,

The method for recognizing a target button using the opened finger may include a new X coordinate determined by an average value of X coordinate values of touched points and an X coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates paired with the X coordinate is recognized as the target button.

[Sudan Port 18D]

The method according to claim 15,

The method for recognizing a target button using the opened finger may include a step of obtaining a new X coordinate determined by an average value of X coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates is recognized as a target button.

[Sudan Port 19D]

The method according to claim 15,

The method for recognizing a target button using the opened finger may include a new Y coordinate determined by an average value of Y coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of an X-coordinate and a pair of Y-coordinates, is recognized as a target button.

[Sudanese Port 20D]

The method according to claim 15,

The method of recognizing a target button by the opened finger is a method of recognizing a target button in a specific order among a new Y coordinate determined by an average value of Y coordinate values of touched points and an X coordinate value magnitude order of points touched by multi- And a button including a point made up of X coordinates is recognized as a target button.

[Sudan Port 21D]

The method according to claim 12,

Wherein the target-button recognition method using the two or more multi-

And a range including two or more touch points is recognized as a target button.

[Sudanese Port 1E]

Recognizing a target button among buttons assigned to a plurality of characters displayed on the touch screen in an apparatus having a touch screen; And

Inputting a first character assigned to the recognized target button and a second character matched for each type of after-touch operation to the target button.

[Sudanese Port 2E]

In the first E,

The target button is determined by a single touch,

And the second character is determined by a single touch operation.

[Sudanese Port 3E]

The method according to claim 2,

Wherein the single-touch post-operation is a single-touch post-drag operation.

[Sudanese Port 4E]

In the third embodiment,

Wherein the direction of the drag is at least one of a group including upper, lower, left, right, upper left, lower left, upper right, and lower right.

[Sudanese Port 5E]

In the first E,

The target button is determined by multi-touch,

And the second character is determined by a multi-touch post-operation.

[Sudan Port 6E]

The method according to claim 5,

Wherein the multi-touch post-operation is multi-touch post-drag.

[Sudan Port 7E]

The method according to claim 6,

Wherein the direction of the drag is at least one of a group including upper, lower, left, right, upper left, lower left, upper right, and lower right.

[Sudanese Port 8E]

In the first E,

Wherein the second character is determined by a post-touch operation, and different characters are determined according to the type of the touch.

[Sudan Port 9E]

The method according to claim 8,

Wherein the type of the touch includes a single touch and a multi-touch.

[Sudanese Port 10E]

The method according to claim 9,

Wherein the multi-touch uses at least two fingers.

[Sudanese Port 11E]

In the first E,

The target button is determined by any one of a group including a target button recognition method using a reference finger, a target button recognition method using a bullet point, and a target button recognition method using a range including two or more touch points The character input method comprising:

[Sudanese Port 12E]

The method according to claim 11,

Wherein the target button recognition method using the reference finger recognizes a button touched by a finger having an X coordinate value of the n-th coordinate among the multi-touched fingers as a target button.

[Sudanese Port 13E]

The method according to claim 11,

Wherein the target button recognition method using the reference finger recognizes a button touched with a finger whose Y coordinate value is nth among multi-touched fingers as a target button.

[Sudan port 14E]

The method according to claim 11,

The method of recognizing a target button using the opened finger includes the steps of: determining whether an X-coordinate value and a Y-coordinate value having a magnitude in a specific order among the X-coordinate values of points touched by the multi- And the button is recognized as the target button.

[Sudanese Port 15E]

The method according to claim 14,

The target button recognition method using the opened finger is determined by a new X coordinate value determined as an average value of X coordinate values of the touched points and an average value of Y coordinate values of the touched points of the multi-touched finger And a button including a point made up of a new Y coordinate value is recognized as a target button.

[Sudan Port 16E]

The method according to claim 14,

The method for recognizing a target button using the opened finger may include a new X coordinate determined by an average value of X coordinate values of touched points and an X coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates paired with the X coordinate is recognized as the target button.

[Sudan Port 17E]

The method according to claim 14,

The method for recognizing a target button using the opened finger may include a step of obtaining a new X coordinate determined by an average value of X coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of Y coordinates is recognized as a target button.

[Sudan Port 18E]

The method according to claim 14,

The method for recognizing a target button using the opened finger may include a new Y coordinate determined by an average value of Y coordinate values of points touched by the multi-touched fingers and a Y coordinate value magnitude order of points touched by the multi- And a button including a point made up of an X-coordinate and a pair of Y-coordinates, is recognized as a target button.

[Sudan Port 19E]

The method according to claim 14,

The method of recognizing a target button by the opened finger is a method of recognizing a target button in a specific order among a new Y coordinate determined by an average value of Y coordinate values of touched points and an X coordinate value magnitude order of points touched by multi- And a button including a point made up of X coordinates is recognized as a target button.

[Sudanese Port 20E]

The method according to claim 11,

Wherein the target-button recognition method using the two or more multi-

And a range including two or more touch points is recognized as a target button.

[Sudanese Port 21E]

In the first E,

Wherein the first character is one of a group including a language character, a number, and a special character, and the second character is any one of a group including a language character, a number, and a special character.

[Sudanese Port 22E]

The method according to claim 21,

Wherein the first character is a consonant,

Wherein the second character is one of a group including a vowel, a half vowel, a semi-consonant, and a consonant.

[Sudanese Port 23E]

The method according to claim 22E,

Wherein the first character is a consonant,

The second character may be any one of a number of characters such as' a ',' ㅓ ',' ㅗ ',' ㅜ ',' ㅑ ',' ㅕ ',' ㅛ ',' ㅠ ',' ㅡ ',' At least one of the characters corresponding to the pronunciation of 'ㅐ', 'ㅔ', 'ㅒ', 'ㅖ', 'ㅚ', 'ㅘ', 'ㅙ', 'ㅟ', 'ㅝ' The character input method comprising:

[Sudan port 24E]

The method according to claim 22E,

Wherein the second character is at least one of letters corresponding to pronunciations of 'a', 'ㅔ', 'ㅣ', 'ㅗ' and 'ㅜ'.

[Sudanese Port 25E]

The method according to claim 21,

Wherein the first character is an alphabetic character,

Wherein the second character is at least one of a group including 'A', 'E', 'I', 'O' and 'U'.

[Sudan Port 26E]

The method according to claim 21,

Wherein the first character is an alphabetic character,

Wherein the second character is at least one of a group including 'T', 'S', 'N', 'R', 'H', 'D', 'L' and 'C' Way.

[Sudanese line 27E]

The method according to claim 21,

Wherein the first character is an alphabetic character,

And the second character is 'W' or 'Y'.

[Sudanese Port 28E]

In the first E,

The target button is determined by a touch,

And inputting two characters together with the first character when the target button is dragged for a predetermined period of time after the touch operation.

[Sudanese Port 29E]

In the first E,

The target button is determined by a touch,

When the target button is dragged two or more times after the touch or when the drag direction is changed, when the dragging is performed twice or more along with the first character or when the drag direction is changed, two characters are input together with the first character The character input method further comprising:

[Sudan Port 30E]

28. The method according to claim 28 or 29,

Wherein the two characters are at least one of ING and ED.

[Sudan port 31E]

In the first E,

The character may include at least one of the following groups including Greek Roman characters, Cyrillic characters, Indian characters, Arabic letters, Thai letters, Vietnamese letters, Hangul letters, alphabetic letters, world language letters including Japanese letters, numbers and special characters The character input method comprising:

[Sudan Port 1F]

Recognizing a target button by touching among a plurality of buttons assigned to at least one character group displayed on the touch screen in a device having a touch screen;

Selecting a specific character group assigned to a target button according to the touch; And

And inputting at least one character included in the specific character group according to the touch operation.

[Sudanese Port 2F]

In the first aspect,

The selection of the specific character group is performed before the final operation,

Wherein the touch is a single touch or a multitouch.

[Sudanese Port 3F]

The method according to claim 2,

Wherein the operation and the final operation are off or drag.

[Sudan Port 4F]

In the third aspect,

Wherein the direction of the drag is a direction of any one of a group including an upper side, a lower side, a left side, a right side, an upper left side, a lower left side, an upper right side and a lower right side.

[Sudanese Port 5F]

The method according to claim 2,

The multi-touch may include at least one of n multi-touch (n > 1), multi-touch, multi-all touch, multi-allall reference finger touch, multi- n Any one of the groups including multi-touch, multi-touch by a fingertip, multi-allall touch by a fingertip, multi-sickle by a fingertip, and multi-sick by a fingertip ≪ / RTI >

[Sudan Port 6F]

The method of claim 5,

The multitouch post-manipulation can be performed in a multi-on-off mode, a multi-on-on-off mode, a multi-all on and off mode, a multi- , Multi-all all-drag, multi-not-all fingertip drag, multi-do-all all fingertip drag, multi-tap, multi-on & off with fingertip, multi-all on & off with fingertip, multi- On and off, multi-natall reference by on-off fingers Finger on & off by multi-nat all good reference on-off by fingertip, multi-drag by fingertip fingers, multi-all drag by fingertip fingers, Multi-all-all-drag, multi-sick-based fingers dragged by a fingertip, multi-sick by a fingertip, finger drag by a fingertip, and multi- Text input method according to claim any one of a group that includes the tab.

[Sudan Port 7F]

In the first aspect,

Wherein the character group includes at least one character group consisting of at least one or more characters classified in different sequences in the spelling of the same character, a character group consisting of special characters, a character group consisting of at least one character assigned to the buttons sequentially And a group of characters including at least one character assigned to be displayed at a specific position of the button.

[Sudanese Port 8F]

The method of claim 7,

The group of characters consisting of at least one or more characters classified in different series on the basis of the spelling of the same character may be a group of letters consisting of capital letters, a group of letters consisting of lowercase letters, a group of letters consisting of hiragana And a character group consisting of katakana characters is spelled out.

[Sudan Port 9F]

The method of claim 8,

Wherein the specific character group includes:

If the character mode of the target button is an upper-case letter mode of the alphabet letters, and if the target mode is a lower-case letter mode of the alphabet letters,

Wherein if the character mode of the target button is a one-character hiragana character mode, the character group is a group of characters consisting of katakana, and if the target character mode of the target button is a one-character katakana character mode, the character group is composed of a hiragana character group.

[Sudanese Port 10F]

In the first aspect,

The character is any one of a group including a language character including at least Greek roman characters, alphabetic characters, Cyrillic characters, Indian characters, Arabic characters, Thai characters, Vietnamese characters, Hangeul characters, Japanese characters, special characters and numbers .

[Sudan Port 11F]

In the first aspect,

The step of recognizing the target button may include using a group including a target finger recognition method using a reference finger, a target button recognition method using a fingertip, and a target button recognition method using a range including two or more touch points The character input method comprising:

[Sudan Port 12F]

The method of claim 11,

Wherein the target button recognition method using the reference finger recognizes the button including the touch point corresponding to the n-th finger among the X coordinate value orders of the multi-touched fingers as the target button.

[Sudanese Port 13F]

The method of claim 11,

Wherein the target button recognition method using the reference finger recognizes the button including the touch point corresponding to the n-th finger among the Y coordinate values of the multi-touched fingers as the target button.

[Sudan Port 14F]

The method of claim 11,

The method for recognizing a target button by the opened finger includes the steps of: obtaining an X coordinate value, which is a size of the X coordinate values of points touched by the multi-touched fingers; and a Y coordinate value, Is recognized as a target button.

[Sudan Port 15F]

The method of claim 14,

The target button may include a new X coordinate value determined as an average value of X coordinate values of the touched points of the multi-touched finger and a new Y coordinate value determined as an average value of Y coordinate values of the touched points of the multi- And a button for inputting a character.

[Sudan Port 16F]

The method of claim 14,

The target button is a pair of a new X coordinate value determined by an average value of X coordinate values of touched points of the multi-touched fingers and an X coordinate value of a specific order among the order of magnitude of X coordinate values of points touched by the multi- And a point including a Y coordinate value formed by the Y coordinate value.

[Sudan Port 17F]

The method of claim 14,

The target button may include a new X coordinate value determined by an average value of X coordinate values of touched points of the multi-touched fingers, and a Y coordinate value of a specific order of Y coordinate values of the touched points And a button for inputting a character.

[Sudan Port 18F]

The method of claim 14,

The target button may include a new Y coordinate value determined by an average value of Y coordinate values of touched points of the multi-touched fingers and a Y coordinate value of a specific order among the T coordinate values of the touched points Wherein the button is a button including a point made up of an X coordinate value formed by the X coordinate value.

[Sudan Port 19F]

The method according to claim 13,

The target button may include a new Y coordinate value determined by an average value of Y coordinate values of touched points of multi-touched fingers and an X coordinate value of a specific order among the X coordinate value magnitude order of points touched by multi- And a button for inputting a character.

[Sudan Port 1G]

Recognizing a target object through touching among objects displayed on the touch screen in an apparatus having a touch screen; And

And modifying the target object according to the post-touch operation.

[Sudan Port 2G]

In the first G,

The recognition of the target object may include:

A method of recognizing a target object by a reference finger, a method of recognizing a target object by using a fingertip, and a method of recognizing a target object by a range including two or more touch points are used.

[Sudan Port 3G]

In the second G,

Wherein an object including a touch point by a reference finger corresponding to a coordinate value according to a specific order of an X coordinate value or a Y coordinate value is recognized as a target object, Way.

[Sudan Port 4G]

The method according to claim 3,

The method of recognizing a target object using the reference finger is characterized in that when an object including two touch points having a first X coordinate value among a sequence of X coordinate values among multi- Wherein the object is recognized as the object.

[Sudan Port 5G]

In the fourth G,

The method of recognizing a target object by the reference finger is characterized in that when an object including a touch point having a second X coordinate value among a sequence of X coordinate values among multi- Wherein the object is recognized as the object.

[Sudan Port 6G]

The method according to claim 3,

The method of recognizing a target object by the reference finger is characterized in that when an object including a touch point having a Y coordinate value of the first Y coordinate value among the multi- Wherein the object is recognized as the object.

[Sudan Port 7G]

The method of claim 6,

The method of recognizing a target object by the reference finger is characterized in that when an object including a touch point having a Y coordinate value of a second Y coordinate value among the multi- Of the object.

[Sudan Port 8G]

In the second G,

The method of recognizing a target object by the open touch point is determined by a new X coordinate value determined by an average value of X coordinate values of touched points and an average value of Y coordinate values of points touched by multi-touched fingers And a new Y-coordinate value that is a new Y-coordinate value.

[Sudan Port 9G]

In the second G,

The method of recognizing a target object by the open touch point may include a new X coordinate value determined by an average value of X coordinate values of touched points and an X coordinate value size order of points touched by multi- And an object including a point made up of a Y coordinate value paired with an X coordinate value of a sequence is recognized as the target object.

[Sudan Port 10G]

In the second G,

The method of recognizing a target object by the open touch point may include a new X coordinate value determined by an average value of X coordinate values of touched points and a Y coordinate value size order of points touched by multi- And an object including a point made up of a Y coordinate value of a sequence is recognized as a target object.

[Sudan Port 11G]

In the second G,

The method of recognizing a target object by the bulleted touch point may include a step of obtaining a new Y coordinate value determined as an average value of Y coordinate values of touched points and a Y coordinate value size order of points touched with multi- And recognizing the object as a target object including a point made up of an X coordinate value paired with a Y coordinate value in a specific order.

[Sudan Port 12G]

In the second G,

The method of recognizing a target object by the open touch point may be a new Y coordinate value determined by an average value of Y coordinate values of touched points and an X coordinate value size order of points touched by multi- And recognizing an object including a point made up of X-coordinate values in a specific order as a target object.

[Sudan port 13G]

In the first G,

The post-touch operation is a multi-touch post-drag, and enlarges or reduces the target object through the multi-touch post-drag,

Wherein the direction of the drag is one of a group including up, down, left, right, upper left, left and right, upper right, and lower right.

[Sudan Port 14G]

The method according to claim 13,

When the reference finger is dragged in the upward direction after touching the point including the Y coordinate value of the average value of the Y coordinate values of the target object in the case of 2-multi-touch, Value is shifted to a point at which the largest Y coordinate value becomes larger without change.

[Sudan Port 15G]

The method according to claim 13,

When the reference finger is dragged in the downward direction after touching the point including the Y coordinate less than the average value of the Y coordinate values of the target object in the case of 2-multi-touch, Value is shifted to a point at which the smallest Y coordinate value becomes smaller without change.

[Sudan Port 16G]

The method according to claim 13,

When the reference finger is dragged in the rightward direction after touching the point including the X coordinate of the average value of the X coordinate values of the target object in the case of 2-multi-touch, Wherein the coordinate value is not changed, and the largest X coordinate value becomes large.

[Sudan Port 17G]

The method according to claim 13,

When the reference finger is dragged in the left direction after touching the point including the X coordinate of the average value of the X-coordinate values of the target object in the case of 2-multi-touch, Wherein the coordinate value is not changed, and the largest X coordinate value is reduced.

[Sudan Port 18G]

The method according to claim 13,

When the reference finger is dragged in the left direction after touching the point including the X coordinate less than the average value of the X coordinate values of the target object in the case of 2-multi-touch, Wherein the X coordinate value is shifted to a point at which the smallest X coordinate value is reduced without change.

[Sudan Port 19G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object is performed by moving the reference finger in the upper right direction after touching the point including the X coordinate value equal to or more than the average value of the X coordinate values of the target object and the Y coordinate value more than the average value of the Y coordinate values When the object is dragged, the smallest X-coordinate value and Y-coordinate value of the target object are shifted to the upper right side without changing and the largest X-coordinate value and Y-coordinate value are enlarged at the same ratio.

[Sudan Port 20G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object is performed on the right side of the reference object after touching the point including the X coordinate value less than the average value of the X coordinate values of the target object and the Y coordinate value less than the average value of the Y coordinate values , The smallest X coordinate value and the Y coordinate value of the target object are shifted to the upper right side without changing the largest X coordinate value and the Y coordinate value of the target object, Way.

[Sudan Port 21G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object is performed by touching the reference finger at a point including the X coordinate value of the average value of the X coordinate values of the target object and the Y coordinate value of the Y coordinate value or more, When the object is dragged, the smallest X coordinate value and the Y coordinate value of the target object are shifted to the lower left side without changing the largest X coordinate value and the Y coordinate value, and the horizontal and vertical lengths are reduced to the same ratio.

[Sudan Port 22G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object may be performed by touching a point including a Y coordinate value less than the average value of the X coordinate values of the target object and an Y coordinate value less than the average value of the Y coordinate values, , The smallest X-coordinate value and Y-coordinate value of the target object are shifted to the lower left side without changing the largest X-coordinate value and the Y-coordinate value of the target object, and the horizontal and vertical lengths are enlarged at the same ratio .

[Sudanese Port 23G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object may be performed such that the reference finger touches the point including the X coordinate value of the average value of the X coordinate values of the target object and the Y coordinate value less than the average value of the Y coordinate values, The smallest X coordinate value and the largest Y coordinate value of the target object are shifted to the lower right side without changing the largest X coordinate value and the smallest Y coordinate value, Object transformation method.

[Sudan port 24G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object is performed by moving the reference finger at a point including an X coordinate value less than the average value of the X coordinate values of the target object and an Y coordinate value equal to or more than the average value of the Y coordinate values The smallest X coordinate value and the smallest Y coordinate value of the target object are shifted to the lower right side without changing the smallest X coordinate value and the smallest Y coordinate value so that the horizontal and vertical lengths are reduced to the same ratio Object transformation method.

[Sudan Port 25G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object is performed by touching a reference finger at a point including an X coordinate value that is equal to or greater than an average value of the X coordinate values of the target object and an Y coordinate value that is less than an average value of the Y coordinate values The largest X coordinate value and the smallest Y coordinate value are shifted to the upper left side without changing the smallest X coordinate value and the largest Y coordinate value of the target object so that the horizontal and vertical lengths are reduced to the same ratio Object transformation method.

[Sudan Port 26G]

The method according to claim 13,

In the case of 2-multi-touch, the deformation of the target object is performed by touching the reference finger at a point including an X coordinate value less than the average value of the X coordinate values of the target object and a Y coordinate value equal to or more than the average value of the Y coordinate values The smallest X coordinate value and the smallest Y coordinate value of the target object are shifted to the upper left side without changing and the smallest X coordinate value and the smallest Y coordinate value are shifted to the upper left side, Object transformation method.

[Sudan Port 27G]

The method according to claim 13,

Wherein at least one of a horizontal length and a vertical length is modified when the target object is enlarged or reduced.

[Sudan Port 28G]

28. The method of claim 27,

Wherein the target object is maintained in a ratio of a horizontal length and a vertical length when enlarged or reduced.

[Sudanese Port 29G]

28. The method of claim 28,

When dragging in the right direction, the horizontal length is enlarged, and when dragging in the left direction, the horizontal length is reduced,

When dragged in the upward direction, the vertical length is enlarged, and when dragged in the downward direction, the vertical length is reduced,

When dragged in the upper left side or the upper right side direction, the horizontal length and the vertical length are enlarged at the same ratio,

And when the object is dragged in the lower left or lower right direction, the width and the vertical length are reduced to the same ratio.

[Sudan Port 30G]

28. The method of claim 27,

Wherein the target object has a different ratio of the horizontal length and the vertical length when enlarged or reduced.

[Sudan Port 31G]

The method of claim 30,

When dragging in the right direction, the horizontal length is enlarged, and when dragging in the left direction, the horizontal length is reduced,

When dragged in the upward direction, the vertical length is enlarged, and when dragged in the downward direction, the vertical length is reduced,

The enlargement ratio of the horizontal length and the vertical length is enlarged differently depending on which direction of the upper left side range or the upper right side range is dragged,

When dragged in the lower left or lower right direction, the reduction ratio of the horizontal length and the vertical length is reduced differently depending on which direction of the lower left side range or the lower right side range is dragged.

[Sudan Port 32G]

The method according to claim 13,

Wherein the target object is reduced if the drag direction is in the direction of approaching the center of the target object, and is expanded if the drag direction is in the direction away from the target object.

[Sudan Port 33G]

32. The method of claim 32,

If the drag direction is one of a group including up, down, left, and right,

The length of the two sides parallel to the drag direction is reduced and the lengths of the two vertical sides are not changed if the drag direction is the direction approaching the center of the target object,

Wherein if the drag direction is a direction away from the center of the target object, the length of two sides parallel to the drag direction is enlarged, and the lengths of the two vertical sides do not change.

[Sudan Port 34G]

32. The method of claim 32,

When the drag direction is one of a group including an upper right side, a lower right side, an upper left side, and a lower left direction,

If the drag direction is a direction approaching the center of the target object, the lengths of both sides and sides are reduced,

If the drag direction is a direction away from the center of the target object, the lengths of the side and sides are both enlarged.

[Sudan Port 35G]

32. The method of claim 32,

When the drag direction is one of a group including an upper right side, a lower right side, an upper left side, and a lower left direction,

If the drag direction is the direction approaching the center of the target object, the center of the object moves in the determined drag direction, and the position of the side perpendicular to the drag direction determined from the three sides surrounding the recognized target range is moved The position of the opposite side of the side is not changed,

If the drag direction is the direction away from the center of the target object, the center of the object moves in the determined drag direction, and the position of the side perpendicular to the drag direction determined from the three sides surrounding the recognized target range is moved for enlargement , And the position of the opposite side of the side is not changed.

[Sudan Port 36G]

32. The method of claim 32,

When the drag direction is one of a group including an upper right side, a lower right side, an upper left side, and a lower left direction,

If the drag direction is the direction approaching the center of the target object, the center of the object moves in the determined drag direction, and the vertex closest to the straight line parallel to the drag direction among vertexes in the recognized target range is moved for reduction , The position of the opposite vertex of the vertex is not changed,

If the drag direction is the direction away from the center of the target object, the center of the object moves in the determined drag direction. Of the vertices in the recognized target range, the vertex closest to the straight line parallel to the drag direction is moved for enlargement, Wherein the position of the vertex of the vertex is not changed.

[Sudan Port 37G]

The method according to any one of claims 3 to 13,

The multi-touch can be divided into n multi-touch, multi-all touch, multi-all touch, multi-nath all reference finger touch, multi-not all reference finger touch, multi- A multi-all-touch by a finger, a multi-all-touch by a fingertip, a multi-allall reference finger by a fingered finger, and a multi-all all reference by a finged finger. Object transformation method.

[Sudan Hang 1H]

A method of inputting characters in a device having a touch screen,

When two or more touch points are touched within a predetermined time, that is, when they are touched at substantially the same time,

The device recognizing a virtual button or an object including a point calculated by a function having two or more touch points as a target button or a target object; and

Comprising the steps of inputting a character related to a target button or a target object, or performing an operation including a function or an object change according to a change in a touch state.

[Sudanese Hang 2H]

The method according to claim 1,

Wherein a point calculated by a function having two or more touch points as a variable is one of touched touch points.

[Sudanese 3H]

The method according to claim 2,

3. The method of claim 2,

The coordinates (x, y, z) of a particular sequence number

The point calculated by the function of two or more touch points as a variable is one of the touch points touched

[Sudanese 4H]

The method according to claim 3,

Wherein the specific sequence number of the x coordinate magnitudes order of the two or more touch points is the first or last one (or the largest or smallest).

[Sudanese Port 5H]

The method according to claim 2,

The coordinates (x, y, z) of a particular sequence number of the y coordinates of two or more touch points

Wherein a point calculated by a function having two or more touch points as a variable is one of touched touch points.

[Sudan Port 6H]

The method according to claim 3,

Wherein the specific order of the y coordinate sizes of the two or more touch points is the first or last (or largest or smallest).

When a character is input using a QWERTY keyboard on a touch screen of a conventional smart phone, there is a problem that a size of a button assigned to a character is small,

When a character is input by using a 12-keypad keyboard on a touch screen of a conventional smart phone, since a plurality of characters are assigned to the same button as when inputting characters on a physical 12 keypad of a conventional feature phone, There is a problem that a lot of batting is needed. However, the above problems are solved through the present invention.

When a character is input using a conventional tablet PC's QWERTY keyboard, the size assigned to the character is so large that there is no such problem as typos. However, in the present invention, two letters are inputted by one touch to improve the character input speed do.

As described above, according to the present invention, the buttons appearing on the touch screen are used to make the user's operation more convenient for the user to input. In particular, although the multi-touching touch points do not have to be touched only within a specific small touch button, i.e., a small touch button is not actually multi-touched, it can be recognized as being multi-touched.

Further, specific characters can be input in addition to the characters assigned to the target button through various multi-touch operation methods, so that the character input speed can be improved.

The user can be assigned to the currently set character mode, such as characters in other character modes (including special characters), rather than characters of the currently selected character mode through various multi-touch operation methods, Characters which can not be assigned to the currently selected character mode are assigned to the currently selected character mode but can be easily input in the currently selected character mode without changing the character mode Mode can be interpreted as being further assigned to the currently selected character mode and can be easily input in the currently selected character mode).

In addition, through the various multi-touch operation methods, the size of each button of the conventional QWERTY keyboard is increased to 2 to 3 times, and an improved QWERTY keyboard having 2 to 3 characters per button is prevented, So that the same copper line is consumed and the input speed can be improved as a result.

In addition, when an object including a picture, a photograph, a browser, and a window is multi-touched with two or more fingers, when two or more fingers are pinched or unfolded, Instead of modifying the shape of an object, it allows the shape of the object to be transformed, including the enlargement or reduction of the object, through a more convenient manipulation involving two or more fingers being dragged in the same direction. As a result, the manipulation speed is increased, the finger lines are small and comfortable, and even very small objects can be easily enlarged or reduced.

Further, through the multi-touch operation method, an object activation step, which is to be performed before the shape of an object is deformed, is not performed separately, but is dragged after being multi-touched so that the object becomes a target button, and the shape of the object can be deformed.

In object modification, it is possible to work more precisely with a finger touching the touchpad than with a mouse.

In a situation in which the mouse pointer is moved by the mouse, the mouse pointer movement distance is set to be five times larger than the mouse movement distance in a normal case, so that it is not suitable for precise work. If you use a finger touching the touchpad, you can work with the concept that the finger movement distance and the mouse pointer movement distance are the same, which is suitable for precise work.

In order to achieve the above-described effects, the target button can be recognized even when the multi-touch is performed in the multi-touching process. Among the target button recognition methods, in particular, The convenience of the multitouch post-manipulation method is greatly improved. In particular, when the multi-on-off method is combined with the multitouch post-manipulation method, the number of possible operations and convenience are drastically increased.

Furthermore,

When a multi-touch is performed on a keyboard having a plurality of buttons,

A specific button is made to be recognized as a target button,

A certain button on the keyboard will be pressed until the button is released from the single touch,

(Depending on how long the touch remains)

If the touching state is maintained for a certain time or longer,

In a case where the touching state is different from the case where the touching state is maintained for less than the predetermined time,

Until the " certain button " is included and the multi-touch is released,

Even if the state in which the " certain button " is touched is held for a predetermined time or longer,

To react in the same manner as when the state in which the " certain button " is touched is held for less than a predetermined time,

I want to do something with multi touch,

As a button is touched (accidentally)

Even before the response to multi-touch appears,

There is no worry that a button will react when it is touched for a long time.

1 is a drawing (assigned to a special character) of a 5X4 keyboard on a touch screen including a 3X4 keyboard,
FIG. 2 is a view showing an electronic device for displaying a special character allocated with a general character on a part of a display screen in a state where physical buttons are mounted;
3 is a diagram showing a 5X4 keyboard that can be applied to a method of recognizing a target button by a fingertip,
4 is a diagram showing a 4X4 keyboard that is applicable to a method of recognizing a target button by a reference finger,
Fig. 5 is a view showing an input keyboard in a Japanese hiragana input mode of 3X4 type,
Fig. 6 is a diagram showing a state in which five characters of hiragana (see the upper side) assigned to each button and katakana (see the lower side) are popped up,
7 is a diagram illustrating a conventional English QWERTY keyboard (the method of the present invention is also applicable), FIG.
FIG. 8 illustrates an improved English QWERTY keyboard to which the present invention is applicable, in which two characters are assigned to one button,
9 is a view showing a conventional Hangul QWERTY keyboard (the method of the present invention is also applicable), Fig.
FIG. 10 illustrates an improved Korean QWERTY keyboard to which the present invention is applicable, in which two characters are assigned to one button,
11 is a diagram illustrating an improved English QWERTY keyboard to which the present invention is applicable, in which three characters are assigned to one button,
FIG. 12 is a diagram illustrating an example of a keyboard that is one of 3X4 keyboards for Hangul input,
13 shows a state in which five vowels A, E, I, O, and U are additionally input together with the S and S assigned to the target button are popped up ',' Multi-drag '),
14 is a view for memorizing a drag direction related to A, E, I, O, U which is additionally input with S assigned to a target button,
15 is a diagram provided for explanation of a process in which the English word " SAME " is input,
FIG. 16 is a diagram provided in the explanation of the process of inputting the English word " BEAUTIFUL &
FIG. 17 is a drawing showing a state in which T, S, N, and R, which are additionally input together with S and S assigned to a target button are popped up ('single drag' after touch operation).
18 is a view for memorizing a drag direction related to T, S, N, R additionally input with S assigned to a target button,
FIG. 19 is a drawing showing a state in which H, D, L, and C are additionally input together with S and S assigned to a target button (multi-drag after single touch operation)
20 is a view for memorizing a drag direction related to H, D, L, and C that are additionally input with S assigned to a target button,
21 is a diagram showing a state in which? (Question mark),. (Dot), (comma), and! (Exclamation mark) are additionally inputted together with S and S assigned to the target button 'Multi-Not All Good Finger Drag'),
22 is a diagram showing a state in which W and Y are additionally inputted together with the S and S assigned to the target button (a post-touch operation example: 'multi-threshold reference finger drag'),
Fig. 23 is a drawing for referring to memorizing the drag direction related to W and Y additionally input with S assigned to the target button,
FIG. 24 is a diagram illustrating a method of continuously inputting characters each time a character is dragged by dragging two or more times in succession in the same direction, changing the drag direction,
25 is a block diagram of an electronic apparatus to which the present invention is applicable.
FIG. 26 is a view comparing with FIGS. 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37;
Fig. 27 is a plan view showing a state in which only the vertical length is enlarged while the center point of the object is shifted to the upper side,
Fig. 28 is a diagram in which only the vertical length is reduced as the center point of the object is shifted to the upper side,
Fig. 29 is a view showing a state in which only the width is enlarged while the vertical length is not changed and the center point of the object is moved to the right,
Fig. 30 is a drawing in which the vertical length is unchanged, the center point of the object is moved to the right side,
Fig. 31 is a drawing in which the horizontal and vertical lengths are enlarged while the center point of the object is shifted to the upper right side in comparison with Fig. 26,
32 is a view in which the center point of the object is moved to the upper right side and the horizontal and vertical lengths are reduced,
33 is an enlarged view of the horizontal and vertical lengths as the center point of the object is moved to the lower right side,
Fig. 34 is a drawing in which the horizontal and vertical lengths are reduced while the center point of the object is shifted to the lower right side as compared with Fig. 26,
Fig. 35 is a diagram showing an example in which the center point of the object is not moved, the width is unchanged, only the vertical length is enlarged,
Fig. 36 is a diagram showing an example in which the center point of the object is not moved, the vertical length is unchanged, only the horizontal length is enlarged,
Fig. 37 is a drawing showing the enlargement of the vertical length and the horizontal length of the object without moving the center point of the object,
38 shows an example before the object is activated
Fig. 39 is a diagram showing an example of a rectangle-shaped active area boundary after the object is activated, eight zoom adjustment points and one rotation adjustment point when the object is activated by the conventional method
40 is a diagram illustrating that the mouse pointer is changed to a right and left double arrow when the mouse pointer is brought to an enlargement / reduction adjustment point in the middle of the right vertical side of an active area boundary of the object when the object is activated according to a conventional method;
FIG. 41 is a diagram illustrating that the mouse pointer is changed to an up / down arrow when the mouse pointer is brought to an enlargement / reduction adjustment point in the middle of the lower lateral side of the active region boundary of the object when the object is activated by a conventional method;
FIG. 42 illustrates a case where the mouse pointer is changed to a diagonal double-headed arrow when the mouse pointer is moved to an enlargement / reduction adjustment point of the vertex on the lower right side of the active area boundary of the object of the object when the object is activated by the conventional method drawing,
FIG. 43 is a diagram illustrating that the mouse pointer is changed to a rotation arrow when the mouse pointer is brought to the rotation adjustment point on the active region boundary of the object of the object when the object is activated according to the conventional method;
Fig. 44 exemplifies a situation where the index finger is recognized as a reference finger (the point where the detection is touched is recognized as the reference touch point), and the multi-touch is performed by sensing and stopping so that the button S Drawing (touching button S for indexing, touching any point to the right of the point at which the index finger touches the stop)
FIG. 45 is a diagram illustrating an active region of the same object or object subdivided into various target ranges;
Fig. 46 is a diagram showing the relationship among the upper, lower, left, and right sides. Upper right, lower right, upper left, lower left, upper right, and lower right directions.
In the following drawings, reference numerals 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 63, 64, 65, 66 And FIG. 67 is a view of another type of keyboard different from the above-described drawings to which the present method can be applied.
Figs. 54, 55, 56, 57, 58, 63, and 64 are diagrams for explaining the operation of the apparatus shown in Figs. 47, 48, 49, 50, 51, 52, I have added a function button that can be used.
47 is a diagram illustrating a Japanese keyboard that can be applied to the method of the present invention. (Function buttons are omitted in order to make the subject matter prominent).
FIG. 48 is a diagram illustrating an English keyboard 1 to which the method of the present invention can be applied. (Function buttons are omitted in order to make the subject matter prominent).
Fig. 49 is a diagram illustrating an English keyboard 2 to which the method of the present invention can be applied. (Function buttons are omitted in order to make the subject matter prominent).
50 is a diagram illustrating an English keyboard 3 to which the method of the present invention can be applied. (Function buttons are omitted in order to make the subject matter prominent).
51 is a diagram illustrating an English keyboard 4 to which the method of the present invention can be applied. (Function buttons are omitted in order to make the subject matter prominent).
52 is a diagram illustrating a Korean keyboard 1 to which the method of the present invention can be applied (the function buttons are omitted in order to make the subject matter prominent).
53 is a diagram illustrating a Korean keyboard 2 to which the method of the present invention can be applied. (Function buttons are omitted in order to make the subject matter prominent).
Fig. 54 is a diagram illustrating the addition of function buttons that can be used together when Fig. 47 (Japanese) is practically applied to a device.
Fig. 55 is a diagram illustrating the addition of function buttons that can be used together when Fig. 48 ((1)) is actually applied to the device.
56 is a diagram illustrating the addition of function buttons that can be used together when FIG. 49 (English (2)) is actually applied to the device.
Fig. 57 is a diagram illustrating the addition of function buttons that can be used together when Fig. 52 (Korean (1)) is practically applied to a device.
Fig. 58 is a diagram illustrating the addition of function buttons that can be used together when Fig. 53 (Korean (2)) is practically applied to a device.
(A blank button in which the rightmost characters in Figs. 1, 3, 4, 8, 10, 11, and 12 are not assigned is not necessarily a button that must be touched during multi- 54, 55, 56, 57, 58, 63, 63, 63, 64, 65, 64, 65, and 60, although only enough space is required for a clearance space (which need not necessarily be a button but can be processed only in a blank space) 54, 55, 56, 57, 58, 63, 64, 65, 67, and 68 may be replaced with function buttons as shown in Figs. 64, 65, 67, The function of the function buttons shown in FIG. 68 may be added to the actual device, and some functions may be deleted.)
Fig. 59 is a diagram showing an example in which in the improved English QWERTY keyboard of Fig. 8, the index finger is recognized as the reference finger (= the point where the detection is touched is recognized as the reference touch point) (Two touches of the button QW for sensing, and one touching the right of any point to the right of the touch point).
60 is a diagram illustrating an English QWERTY keyboard in a conventional tablet PC.
61 is a diagram illustrating a Korean QWERTY keyboard in a conventional tablet PC.
Fig. 62 is a diagram illustrating a state in which multi-touching and dragging to the right (multi-all) state in Fig. 44 is completed.
Fig. 63 is a diagram illustrating another type of Hangul key board (Hangul (3)) slightly different from Fig. 57 or 58. Fig.
Fig. 64 is a diagram illustrating another type of Korean character plate (Hangul (4)) slightly different from Fig. 57 or 58. Fig.
65, FIG. 66, FIG. 67, and FIG. 47 to FIG. 64,
47 to 64, in the drawings excluding the QWERTY keyboard, phonemes are assigned in Japanese, English, and Hangul in the standard enumeration order when memorizing phonemes. Therefore, in a state in which the keyboard can not be memorized, It is difficult to know in advance whether a character to be input is assigned to the first or the second button of the respective buttons and whether the input is to be input by a single touch or multi touch,
In Figure 65, Figure 66, Figure 67 phonemes in the first half of the standard open net was assigned to the first of each button, it is in the second half to double the second of each button, that even did not memorize the keyboard, to input It may be easier to know in advance whether a phoneme will be entered as a single-touch or multi-touch .
A little more detail is as follows.
FIG. 65 illustrates the assignment of the letters A to M (13 letters) among the English alphabets A to Z (26 letters) to the first letter of each button and the letters N to Z (13 letters) to the second letter of each button (Compare with Figure 55. The effect is the same as that of Figures 65, 66, 67 in Figure 64 above)
66 is 10 representing letters of Japanese 50 the notes (あかさたなはまやらわ) and five four letters of the first half representing letters over each representative character (あかさたな) and four letters over each representative character is one of the buttons And the four letters attached to each representative letter are assigned to the second letter of each button) (See FIG. 47. The effect is as shown in FIG. 65, Fig. 66 and Fig. 67 after Fig. 64)
FIG. 67 is a diagram illustrating an example of assigning a first letter of each button among 7 basic alphabetic letters a to h (14 letters) and assigning the second letter of each button to 7 alphabetic letters (7 letters) (Compare with Figure 57. The effect is the same as that described above with reference to Figures 65, 66 and 67 in Figure 64 above)
Figures 8, 10, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 63, 64, 65 , 66, and 67, when a plurality of characters are assigned to the same button, the characters in a specific order including the second character are displayed in different colors including red, So that the input method including whether to input the character to be input by the single-touch operation or the multi-touch operation can be more easily judged.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

=================================

Contents

A .. Multi-touch long press to disable recognition.

Method for recognizing the target button in multi - touch and character input method using multi - touch. ( There is a lot of content.)

=================================

A .. When multi-touch  Long press Unrecognizable  doing.

The contents are implied as follows.

(In the following, " single touch " is the opposite of multi-touch. It refers to touching only one finger, that is, touching a button such that only one touch point is formed.)

keyboard How to operate ,

If a certain button is over a certain time Touch  And the state that

Which button to include Multitouched  medium

Which button Be touched  The first factor in determining what response to

Which button to include Multi-Touch Inn  Way.

The underlined phrases immediately above can be expressed as:

A method of operating a keyboard,

Some buttons A touch on  After Touch  How long it will stay

Which button Single-touch  Or any button, Multi-touch  Whether or not they belong to the buttons

Which button Be touched  The first factor in determining what response to

Which button Single-touch  Or any button, Multi-touch  Whether or not they belong to the buttons that cause them to recognize.

((In the underlined sentence immediately above Multi-touch Touch point  In terms of number, it can also be expressed as follows.

A method of operating a keyboard,

which A touch on the button is initiated  Then how long does the touch last?

Which button Touch  When there is a state Touch  If the number of other buttons that were in the state was an integer greater than or equal to 0

Which button Be touched  The first factor in determining what response to

Which button Touch  When there is a state Touch  The number of other buttons that were in the state was what was an integer greater than or equal to zero.

Of the above phrases

"Which button Touch  When there is a state Touch  For example, to say that the number of other buttons in the state is 0 or more,

together Touch  The number of other buttons in the state

- If 0 , Which button Single touch  Meaning,

- 1 , One button and one other button Touch  There were two states With touch point  Made Multi-touch (= 2 multi-touch)  And,

- 2 , A button and two other buttons Touch  There were three states With touch point  Made Multi-touch (= 3 multi-touch)  .

In this case

Which button Be touched  The first factor in determining what response to

Which button Single-touch  Or any button, Multi-touch  Whether or not they belong to the buttons

2 multi-touch  When 3 multi-touch  And the reaction when they are made may be different from each other.

))

For the sake of an authentic explanation, I will refer to the above-mentioned phrase again.

keyboard How to operate ,

If a certain button is over a certain time Touch  And the state that

Which button to include Multitouched  medium

Which button Be touched  The first factor in determining what response to

Which button to include Multi-Touch Inn  Way.

(It does not matter whether the button recognized as the target button when the multi-touch occurs is any of the buttons or the other buttons.)

The lower-right implicit phrases immediately above can be expressed as a narrow range of phrases (examples).

On keyboard  For some buttons, Single touch  After the launch Singlet The value is released until,

( Touch  Depending on how long the state is held)

If the touching state is maintained for a certain time or longer,

Touch  In the case where the state is in a state different from that when the state is maintained for less than a predetermined time,

The " certain button " Multi-touch  After the launch Multi-touch  Until it is released,

The " certain button " Touch  If the state is longer than a certain time Even if kept,  A reaction such as a or b appears.

a ..

For the " some button & Single touch  After the launch Single touch  Until it is released Touch  And the reaction does not occur when the state is maintained for more than a predetermined time.

(a method,

'Which buttons to include Multi-touch  During the process of being launched and released

Even if a certain button is held in a state of being touched for a predetermined time or more,

Which button With a single touch  Over a certain time Touch  The way in which the preset response does not appear when the state is maintained. "

It can be said that.

b ,,

Multi-touch  The way in which the reaction when it happens is shown.

Then, on the keyboard (with multiple buttons) When multi-touch ,

One button with one touch point of the multi-touch at least two touch points may be recognized as a target button. The button recognized as the target button when multi-touch occurs may be any of the above-mentioned "any button" or any other button. )

(

"(With multiple buttons) On the keyboard Multi-touch  Then,

In the table of contents In Lesson B  together,

Multi-touch  Two or more Touch point  Either Touch point  The included buttons are intended to be recognized as target buttons "

A wider range, for example,

" When a multi-touch on the keyboard (with multiple buttons)

Which button is intended to be recognized as the target button ").

Let me give an example of the underlined proximal phrases above.

Some keyboards assume that the following rules of 1 and 2 are generally applied.

1. When a multi-touch is made on a keyboard with a plurality of buttons, a certain button is recognized as a target button.

(Or as a narrower range of phrases)

When a multi-touch is made on a keyboard having a plurality of buttons, a button including any one of two or more multi-touched touch points is recognized as a target button.)

2 ... what button until the button is to be a single touch after being launched off a single touch,

(Depending on how long the touch remains)

If the touch state is held for a certain time (= long touch)

It reacts differently when the touched state is kept below a certain time (= when touched briefly).

(E.g,

The ' a' button (= the button marked 'a') When the single-touch,

If you touch briefly ,

The state in which the touch certain period of time (e.g., 0.5 second) if held to less than, for example, a state in which the touch certain period of time (e.g., 0.5 sec) after holding is less than if the touch is released the 'a' is input ,

If you touch it for a long time ,

If the touched state has been held for more than a certain period of time (0.5 seconds), enter the special character '@' shown on the 'a' button.

.

Some keyboards, when the same rules as 1 and 2 above are generally applied,

I want to work on character input by using multi-touch including multi-touch method as in the section B,

(For example, to enter a capital letter 'A' directly without changing the character mode by multi-touching so that the lowercase 'a' button is included (and the 'a' button is recognized as the target button)

Not yet familiar with multi-touch and multi-touch reactions,

When a tee touch is performed, that is, until the multi-touch is released after the multi-touch is started,

Multi-Touch Touch Points

Some buttons may be touched for longer than a certain amount of time (eg 0.5 seconds).

(That is, there may be a case where a state in which a button is touched for more than a predetermined time (for example, 0.5 seconds) is maintained.)

.

So, I want to do something with multi touch ,

E.g,

A 'button and an' e 'button, the' a 'button is recognized as a target button,

I want to type the capital 'A' immediately, without changing the character mode.

Multi-Touch Method For various reasons, such as observing how the multi-touch response occurs when the user is a beginner ,

Some buttons (e.g., small letter 'a' button) As the long touch (accidentally) thus

Expected response to the multi-touch (e.g., search capital letter 'A' is input) before onset of,

If a button responds to a single long touch, it will be overwhelmed ( eg the special character '@' shown on the 'a' button)

(Drawing with '@' together in the 'a' button is omitted.)

As another example,

Condition 1 above

"1. When a multi-touch on a keyboard with multiple buttons , a certain button is recognized as the target button."

"1. When a multi-touch is made on a keyboard with multiple buttons , the other buttons are recognized as target buttons."

In other words, for example, when a "long time" button is changed to a condition other than a button recognized as a target button in multi-touch,

A 'button and an' e 'button so that the' a 'button is recognized as a target button,

I want to type the capital 'A' immediately, without changing the character mode.

Multi-Touch Method For various reasons, such as observing how the multi-touch response occurs when the user is a beginner ,

Some buttons (e.g., small letter 'e' button) As the long touch (accidentally) thus

Expected response to the multi-touch (e.g., search capital letter 'A' is input) before onset of,

This response when any button is shown holding a single touch if I become upset (for example: 'e' is a special character, the '$' input is displayed with the button abandoned)

(Drawing with '$' in the 'e' button is omitted.)

.

So, while some keyboards, such as 1 and 2 above, are commonly applied,

Until the " certain button " is included and the multi-touch is released,

Even if the state in which the " certain button " is touched is held for a predetermined time or longer,

The above-  For buttons Single touch  After the launch Single touch  To be released until,

So that the reaction when the touched state is maintained for more than a predetermined time is not displayed .

(Multi-touch when multi-touch is, any one or more of the multi-touch touch point that is a predetermined time (for example, until the start is released: When less than 0.5 second) (tall) touch the touch that point be easily tell (long) Even if multi-touch ,

If there is no specific response when you are multi-touched,

(The " certain button " Multi-touch  After the launch Multi-touch  Regardless of the time until it is released)

Let 's show the reaction when multi-touch ,

If you see a long single-touch response, it will often be difficult.)

That is, in the above embodiment

A 'button and an' e 'button, the' a 'button is recognized as a target button,

If you tried to type the capital 'A' immediately without changing the character mode,

Multi-Touch Method For various reasons, such as observing how the multi-touch response occurs when the user is a beginner ,

Some buttons (e.g., small letter 'a' button) may be a touch and hold (accidentally)

It is recommended that the expected response to multi-touch ( eg capital letter 'A' is entered) appears.

(Of course, when multi touch is started and the multi touch is canceled, when the touch point where one or more of the multi touch points are touched is not determined when the touch point exists.)

B .. When multi-touch  How to recognize the target button Multi-touch  A method for inputting characters.

(There is a lot of content.)

Unless otherwise specified in the description of the embodiments below, it may be considered that the right hand is used.

First, the contents of the following contents are introduced.

1. Definition of Terms

1.1. Definition of other terms

1.1.1. touch screen

1.1.2 Touch Button

1.1.3. text

1.1.4. finger

1.1.5. QWERTY keyboard

1.1.6. ON

1.1.7. OFF (OFF)

1.1.8. ON & OFF (ON & OFF)

1.1.9. drag

1.1.10. X coordinate

1.1.11. Y coordinate

1.1.12. Goal button

1.1.13. The reference finger (= reference touch point)

1.1.14. NOT reference finger (= NOT reference touch point)

1.1.15. Target range

1.1.16. Target point

1.1.17. Hit point

1.1.18. Situation before final operation

1.1.19. Final operation,

1.1.20. Detailed touch after operation

1.2 Definitions of Terms for Drag Direction

1.2.1. Straight Drag

1.2.2. Drag back to home

1.2.3 Dragging shapes

1.3. Definition of term for drag length

1.3.1. Drag short

1.3.2. Drag long

1.4. Definition of terms for touch

1.4.1 .. Definition of terms for single touch

1.4.1..1. Single touch

1.4.2 .. Definition of Terms for Multi-Touch

1.4.2..1. Multi-touch

1.4.2..2. n Multi-touch

1.4.2..3. Multi All Touch

1.4.2..4 Multitool All Touch

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

1.4.2..8.4. Multi-touch all-in-one touch with open finger

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

1.5. Definition of Terms for Post-Touch Operation

1.5. Touch Operation

1.5.1 .. Definitions of terms for single-touch post-operation

1.5.1..1. Operation after single touch

1.5.1..2. Single on & off

1.5.1..3. Single drag

1.5.1..4. Single-tap

1.5.2 .. Definitions of terminology for multi-touch post-manipulation

1.5.2..1. Multi-touch after operation

1.5.2..2. Multi-on & Off

1.5.2..3. Multi all on & off

1.5.2..4. Multi-all All On & Off

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

1.5.2..7. Multi-drag

1.5.2..8. Multi-drag

1.5.2..9. Multi-all drag

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

1.5.2..12. Multi-tap

1.5.2..13. Definition of terminology for multi-touch post-manipulation by open finger

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

1.5.2..14. The most recommended multi-touch post-operation

1.5.2..14.1. Most recommended multi-on & off

1.5.2..14.2. The most recommended multi-drag

1.5.3 ... after single touch, after multitouch operation

1.6. Definition of terms for target button recognition methods

1.6.1 .. Target button recognition method by reference finger (= target button recognition method by reference touch point)

1.6.1..1 Method of recognizing the target button by the reference finger according to the order of the X coordinate value (= method of recognizing the target button by the reference touch point according to the order of X coordinate value)

1.6.1..2 Method of recognizing target button by reference finger according to order of Y coordinate value (= method of recognizing target button by reference touch point in order of Y coordinate value)

1.6.1..3 Method of recognizing the target button by the reference finger according to the order of X coordinate value according to the number of multi-touched (= method of recognizing the target button by reference touch point according to the order of X coordinate value according to the number of multi-

1.6.1..4 Y-coordinate value according to the number of multi-touched points Target button recognition method by reference finger (= target button recognition method by reference touch point according to Y-coordinate value sequence according to the number of multi-touched)

1.6.2 .. Target Button Recognition Method with Open Finger (= Target Button Recognition Method with Open Touch Point)

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

1.6.3 .. A method of recognizing a target button by a range including two or more touch points

1.6.4 .. mixed

2. Comprehensive

3. How to enter text on the touch screen

4. How to manipulate objects

5. Electronic appliances to which the present invention is applicable

Now I will go into the mainstream.

1. Definition of Terms

1.1. Definition of other terms

1.1.1. touch screen

A virtual graphical button is displayed and selectable, not a keypad with a physical button, which is a concept of any screen that can recognize a touch, including a general touch screen as well as a laser pad and a hologram pad.

1.1.2 Touch Button

It is a concept that includes all the objects that can be touched by the user, appearing on the touch screen including photos, pictures, browsers and windows as well as virtual graphic buttons appearing on the touch screen. When the object is a target button, the target button may also be referred to as a target object.

FIG. 1 shows a touch screen in which touch buttons are arranged. FIG. 2 shows an electronic device in which a touch screen and physical buttons are arranged together. The technical idea of the present invention can be applied not only to the touch buttons but also to the case where the touch buttons and the physical buttons are implemented together as shown in FIG.

1.1.3. text

It is a comprehensive concept that means all possible characters, including symbols representing ordinary language, symbols including special punctuation marks, special characters including pictograms, and special characters.

The concept of 'character' throughout the present application is not limited to the concept of general characters as described above, but includes functions for executing a command other than a character for inputting a character assigned to a certain button (or icon) listen,

Includes application execution functions such as character deletion function in text input mode, line feed function, space function, Korean / English conversion function, various setting functions in non-character input mode, and various application icons on the smartphone desktop And also includes the concept up to a specific function assigned to any button (or icon). So, entering a character with such a function in mind is like saying running a function, so you should understand.

1.1.4. finger

Is a concept including not only a finger of a person to be touched on a touch screen but also a tool used for touching the touch screen such as a stylus pen.

In addition, the word " finger " throughout the present description is a concept that, from the viewpoint of the device, the touch point including a finger can be included.

so. In the entire contents of the present application, a word 'finger' which is mainly used by a user can be replaced with 'touch point with finger' or 'touch point with finger' or 'touch point' many. For example, the word 'index finger' may be interpreted only as the meaning of the word 'index finger' itself, but it can be replaced by 'touch point with index finger' or 'touch point by index finger' There are many cases. In particular, the word "finger" in the term defined in the definition of the term is often used as the same term even if it is replaced with the word "touch point".

That is, throughout the present application, including the claims, the words of the finger concept, including fingers or sensing or pausing, are primarily used and described and claimed by the user for the purposes of the present invention, It should be regarded as being explained or claimed even if it is changed into a phrase in the position. (There are some parts that have been explained or claimed in reality, but they are too obvious, , The parts that are not explained or altered and are not claimed should be regarded as above.)

Thus, the phrase including the word finger may be changed to a phrase including the word touch point, which is a phrase in the device's viewpoint, and the words used before or after the word " finger " Shall be regarded as being explained or claimed.

It is also because the device does not know which fingers have been touched by a person's fingers.

for example,

The phrase 'multi-touch with index and stop' can be replaced with 'multi-touch with one touch gym and another touch point' or 'multi-touch with two touch points' or the same phrase However,

The phrase " firstly touched finger is recognized as a reference finger and later touched finger is recognized as a good reference finger " means that the touch point first touched is recognized as the reference touch point, and the touch point later touched Can be changed into a phrase that is recognized, or a phrase with the same meaning,

The phrase " when the index finger is first touched first and then the stop with the better reference finger is touched later " is a word " when the reference touch point is touched first and then the better reference touch point is touched later & , ≪ / RTI >

The phrase 'touch finger' can be changed to a phrase '(touch) touch point' or the same meaning as that,

The phrase "points where the fingers are touched" can be changed to a phrase that is "(touch) touch points" or the same meaning.

1.1.5. QWERTY keyboard

Originally, it refers to a standard keyboard of an English computer keyboard in which character assignments of Q, W, E, R, T, and Y are present in an English keyboard. However, Quot; is a character string including a character assignment sequence in " Most of the conventional QWERTY keyboards are assigned one character per button. 8, FIG. 10, and FIG. 11. FIG.

7, 8, 11, and 60 are examples of English QWERTY keyboards, and FIGS. 9, 10, and 61 are examples of Hangul QWERTY keyboards.

1.1.6. ON

(Touch screen) is touched, i.e., touching the touch screen.

1.1.7. OFF (OFF)

(At the touch point) that the touch is released, i.e., the finger falls off the touch screen.

1.1.8. ON & OFF (ON & OFF)

Refers to an operation in which the touch point is turned " on " and is not dragged but immediately turned off.

1.1.9. drag

Refers to an operation that moves the touch point to another point while maintaining the state that the touch point is 'on'. There are various types of drag including 'straight drag', 'return to the original position', and 'shape drag', and a detailed description thereof will be described later.

Also, throughout this application, 'dragging' or 'dragging' mostly includes not only the dragging action itself but also 'being dragged off'.

1.1.10. X coordinate

It is a coordinate on the horizontal axis indicating a specific point on the touch screen.

1.1.11. Y coordinate

It is a coordinate on the vertical axis indicating a specific point on the touch screen.

1.1.12. Goal button

Refers to a button directly related to a specific operation when a user intends to perform a specific operation with a 'touch operation' to be described later. That is, it refers to a specific button targeted by the user.

1.1.13. The reference finger (= reference touch point)

Among the multi-touched fingers, a finger that is a reference for the device to recognize the target button. In the normal case, the finger touched on the target button is the reference finger.

From the viewpoint of the device, a touch point that is a reference for recognizing the target button among the multi-touched touch points, that is, a touch point touched to the target button.

1.1.14. NOT reference finger (= NOT reference touch point)

Refers to at least one finger of the multi-touched fingers excluding the reference finger.

From the standpoint of the device, at least one touch point among the multi-touched touch points excluding the reference touch point is referred to.

1.1.15. Target range

It is a concept that is mainly required when tasks related to objects such as photographs, pictures and browsers are performed.

When a user tries to perform a specific operation with a 'touch operation' to be described later, a specific range within an object (or an object activation area boundary) directly related to the specific operation, that is, a specific range Quot;

For example, in a single touch, a range including a point actually touched is recognized as a target range, and in a target button recognition method using a reference finger, a range including a point at which a reference finger is actually touched is recognized as a target range.

As another example, as the center point of the object is moved, the position of the right side of the object is changed without changing the length of the left side of the object, the length of the right side of the object, and the position of the left side of the object. The right range of the vertical line passing through the center point of the object (or the object activation area boundary) within the object (or the object activation boundary line) is recognized as the target range in order to perform the operation of enlarging the right side So that it can be multi-touched and dragged to the right.

1.1.16. Target point

When a user tries to perform a specific operation with a 'touch operation' to be described later, a specific point within a button or object (or an object activation area boundary) directly related to the specific operation, that is, Quot; refers to a particular point to which the < / RTI >

For example, a point at which a user intended to touch is referred to at the time of a single touch, and a point at which a reference finger is intended to be touched at a target button recognition method by the reference finger.

As another example, when the center point of the object is moved, the position of the lower left and right vertexes of the object is not changed, but the object of the upper and lower sides of the object, the left side, and the right side are enlarged , The upper right corner of the object (or the object activation region boundary) among the points within the object (or the object activation boundary line) is recognized as the target point, and dragged in the upper right direction.

1.1.17. Hit point

It is a specific point required for the device to recognize the target button or the target range and is a specific point calculated by at least one touch point actually touched and the range including the hit point is recognized as the target range or the target button .

For example, at the time of a single touch, a point at which a single-touch finger is actually touched is a hit point, and at a target button recognition method using the reference finger, a point at which the reference finger is actually touched is a hit point.

1.1.18. Before the final operation,

1.1.19. Final operation,

1.1.20. Detailed touch after operation

The situation before the final operation, the final operation, and the detailed touch operation are closely related to each other.

The state prior to the final operation refers to a situation in which the operation after the (detailed) touch operation is performed, until the last operation is started.

The final manipulation is the process that follows the state before the final manipulation and is the last step manipulation to complete the (detailed) touch manipulation. For example, dragging in various directions, including off or up, down, left, back, up, down, left, right or down, two or more consecutive drag (drag direction may change), long drag, .

The detailed touch operation is the sum of the state before final operation and final operation. In other words, if the details of the post-touch operation related to the target button are not the same as those of the target button, the operation after the detailed touch is different. After the detailed touch, the operation may be expressed simply as a detailed operation or operation (or a multi-touch operation).

A comprehensive example of the situation before the final operation, the final operation, and the detailed touch operation,

There are five final touch operations: single-on-off, single-on-off, and single-drag in each of the four directions: up, down, left and right. Since the situation up to just before the touchdown is the same in all of the five detailed touch operations, all the operations after the five detailed touch operations are the same operations before the final operation,

In the five multi-touch after-operation operations of multi-touch, multi-all on and off, and multi-all dragging in four directions up, down, left and right, Since the situation up to just before the start of the operation is the same for all of the five detailed touch operations, all of the operations after the five detailed touch operations are the same operations before the final operation,

2 For multi-touch starting, multi-touch all-finger fingertip on and off, and four multi-touch fingertip dragging in four, up, down, left, and right directions, Since the situation up to just before the last five operations of dragging is the same in all of the five detailed touch operations, all the operations after the five detailed touch operations are the same operations before the final operation,

After single touch 2 After multi touch All touch on and off and up, down, left and right 4 single touch after each touch 2 touch after multi touch All five touch after touch Since the situation up to just before the last five operations of dragging is started is the same in all of the five detailed touch operations, all of the operations after the five detailed touch operations are the same operations before the final operation.

However, multi-all on and off, which starts with 2 multi-touch, and multi-all on & off, which starts with 3 multi-touch, are not the same until the last operation, Touch operation, and as a result, the operation after the detailed touch is different,

 The multi-all dragging in the upward direction starting from the multi-touch 2 and the multi-dragging in the upward direction starting from the multi-touch in 3 are not equal to each other until the final operation of dragging to the upper side is started. Therefore, Another detailed touch operation is performed. As a result, the operation after the detailed touch operation is different.

And, even if it is multi-all on and off which starts with two multi-touch, multi-all on and off while the multi-touch process is multi-all touch and multi-all on and off while multi- The situation before the final operation is different from that before the start of operation, so that the operation after the detailed touch is different,

Here, the final operation here refers to the last operation to be turned off (the first time) in the earliest full-fledged operation after being touched, or to be dragged twice or more in succession in the same direction two or more times in the following description, This does not imply a final manipulation of how the characters are added in succession each time they are dragged.

1.2 Definitions of Terms for Drag Direction

1.2.1. Straight Drag

It refers to a drag made up of one straight line including left, right, top, north, south, bottom left, south, north, top left do.

1.2.2. Drag back to home

It refers to a drag that is dragged straight in one direction and then dragged back without being turned off.

1.2.3 Dragging shapes

Refers to a drag made up of a plurality of directions other than a straight line, such as a circle, a semi-circle, a triangle, or a rectangle.

1.3. Definition of term for drag length

1.3.1. Drag short

(Coordinate) length or less. Here, the predetermined (coordinate) length can be set to the horizontal or vertical length of two touch buttons, but it is also possible to specify them in other ways.

1.3.2. Drag long

Refers to dragging beyond a predetermined (coordinate) length. In this specification, 'drag' which is not specifically indicated as 'long drag' may be regarded as 'drag short'.

1.4. Definition of terms for touch

1.4.1 .. Definition of terms for single touch

1.4.1..1. Single touch

Quot; is touched such that only one finger is touched. In a typical case, a single touch is realized by touching the target button with the index finger among five fingers.

From the standpoint of the apparatus, it is referred to as being touched so that only one touch point is touched.

1.4.2 .. Definition of Terms for Multi-Touch

1.4.2..1. Multi-touch

Quot; refers to touching such that two or more fingers are touched.

From the standpoint of the apparatus, it is referred to as being touched so that two or more touch points are touched.

In terms of the point of starting to judge one (unit) touch including one (unit) single touch or multi touch from the standpoint of the apparatus, when the touch point is no longer touched, If a new touch point is touched after the touch point is newly touched and the touch point is turned off without any additional touch, it can be judged that the touch operation is performed only with the single touch. After the newly generated touch point is touched, When any one of the touch points is not turned off, that is, every time a new touch is generated at least once while the touch states of all touch points touched so far are maintained, any one of various methods It is possible to judge whether or not it is a multi-touch.

For reference, in the embodiments of the entirety of this application, it is preferable to consider the used hand as the right hand if it is not specified as the right hand or the left hand.

1.4.2..2. n Multi-touch

touches the touch screen so that there is a state in which n fingers are touched. (In terms of the device, it refers to multi-touch such that n touch points are touched.)

E.g,

1) 2 Multi-touch is a multi-touch in which two fingers (= touch points) are touched,

2) 3 Multi-touch is a multi-touch in which three fingers (= touch points) are touched,

3) Four multi-touch means that multi-touch is made so that four fingers (= touch points) are touched.

In the present application, the n-multi-touch or multi-touch may be regarded as multi-touch in a multi-touch state, which will be described later, unless there is any specific mention or implication as to which of the various multi- , But it is not limited to the interpretation of it by all means.

1.4.2..3. Multi All Touch

As one kind of multi-touch, when a multi-touch is performed, the time difference between the time when the finger first touched first is turned on and the time when the finger most recently touched is turned on is equal to or shorter than a predetermined time (e.g., 0.1 second) Quot; multi-touch "

(In view of the device, as a kind of multi-touch, when a multi-touch is performed, a time difference between a time at which the touch point first touched first is turned on and a time at which the touch point touched at the latest is turned on is a predetermined time Quot; refers to multi-touch when multi-touch is performed at almost the same time.

For example, in the case of two multi-touches, for example, with the detection and the stop, the stop and the detection are actually touched on the touch screen at the same time. Here, even when the stop is touched on the touch screen before the detection, the case where the time difference between the time when the stop is touched and the time when the detection is touched is 0.1 seconds or less is recognized as the multi-all touch of stop and detection (In the case of two multi - touches with sensing and stopping, it will be the case that the stop and sensing are manipulated with the intention to touch the touch screen at the same time.

1.4.2..4 Multitool All Touch

Refers to a type of multi-touch in which a time difference between a time at which the finger first touched first when the finger is multi-touched and a time at which the finger most recently touched is turned on exceeds a predetermined time (for example, 0.1 second) (In terms of the device, it is a kind of multi-touch, and when the touch is multi-touched, the time difference between the time when the first touch point is turned on and the time when the touch point is touched last is a certain time Touch ").

These include 'multi-nathal-based finger touch', 'multi-nath all-ness finger touch' and 'multi-nathol based finger touch touch', which will be described later.

For example, when two multi-touches are performed by sensing and stopping, the stop is first touched on the touch screen, and the time when the stop is turned on is ahead of a certain time (for example, 0.1 second) Are included.

Multi-all touch is not recommended unless it is a special case, so it is not recommended to apply Multi-All Touch and Multi-All Touch separately when applying this method to a real device.

1.4.2..5. Multi-natall reference finger touch (= Touch multi-natool touch point)

A type of multi-all-touch, which refers to a case where a reference finger is touched first and then a better reference finger is touched. That is, it refers to a case where a finger first touched is recognized as a reference finger and a finger later touched is recognized as a reference finger.

(In view of the device, a multi-all-touch type refers to a case in which a reference touch point is touched first and then a better reference touch point is touched. Refers to a case in which a later-touched touch point is recognized as a better reference touch point).

For example, in the case where the index finger is recognized as the reference finger and the stop is recognized as the reference finger by two multi-touches with the index finger and the stop finger, And the time difference between the time when the touch is turned on and the time when the stop is touched is longer than a predetermined time (e.g., 0.1 second).

1.4.2..6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Sized Touch Point Touch)

It is a kind of multi-all-touch, which refers to a case where a reference finger is touched first and then a reference finger is touched. That is, the first finger is recognized as the reference finger and the second finger is recognized as the reference finger later.

(In view of the device, a multi-all-touch type refers to a case where the reference touch point is touched first and then the reference touch point is touched. , And a later-touched touch point is recognized as a reference touch point.)

For example, in the case where the index finger is recognized as the reference finger and the stop is multi-touched by the index finger and the stopper so as to be recognized as the reference finger, the index finger as the reference finger is touched, , And the case where the time difference between the time at which the stop is touched and the time at which the detection is touched exceeds a predetermined time (for example, 0.1 second). Even if the index finger is later touched, the position of the button including the touch point to which the index finger has been touched is maintained as the target button.

1.4.2..7. Multi-Sized All Fingertip Touch (= Multi-Sized Touch Point Touch)

Refers to a kind of multi-all-touch touch, which refers to a touch when a finger touched at a predetermined sequential number is recognized as a reference finger, and is actually included in a 'multi-all touch' It is a concept that has some of the concept of 'multi-not all-nod reference finger touch'.

(In view of the device, a multi-all-touch type touch refers to a touch in which a touch point touched at a predetermined sequential number is recognized as a reference touch point. In fact, the touch is included in the 'multi- Multi-nath all touch point touch 'or' multi nath all nath touch point touch 'concept is part of the concept.)

E.g,

1) The first-touched finger (= touch point) is designated to be recognized as the reference finger (= reference touch point)

2) The second-touched finger (= touch point) is designated to be recognized as the reference finger (= reference touch point)

3) The third-touched finger (= touch point) is designated to be recognized as the reference finger (= reference touch point)

4) The fourth finger (= touch point) may be designated to be recognized as the reference finger (= reference touch point).

If two multi-touches due to detection and stop are touched before the detection is stopped,

1) If the first-touched finger is designated to be the reference finger, the first-touched finger is the reference finger,

2) If the second-touched finger is designated as the reference finger, the second-touched stop is the reference finger.

1.4.2..8. Definition of Terms for Multi-Touch by Opened Fingers

1.4.2..8.1. Multi-touch by fingertip (= Multi-touch by gap touch point)

As a concept almost identical to the definition of the term 'multi-touch'

However, when the definition of the term 'multi-touch' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method.

1.4.2..8.2. N Multi-touch by fingertip (= n multi-touch by gap touch point)

As an almost same concept as the definition of the term 'n multi-touch'

However, when the definition of the term 'n multi-touch' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method.

1.4.2..8.3. Multi-all touch by opened finger (multi-all touch by earned touch point)

As a concept almost identical to the definition of the term 'multi-touch'

However, when the definition of the term 'multi-touch' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method.

1.4.2..8.4. Multi-touch all-in-one touch with open finger

As a nearly same concept as the definition of the term 'multi-all touch'

However, when the definition of the term 'multi-all touch' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method.

Multi-all-touch by a fingertip is not recommended unless it is a special case. Therefore, when applying the method of the present invention to a real device, a multi-all touch by a fingertip and a multi- Not recommended.

1.4.2..8.5. Multi-natall reference finger touch by opened finger (= Touch multi-natol touch point by earned touch point)

As a nearly same concept as the definition of the term " multi-allall reference finger touch &

However, when the definition of the term 'multi-allall reference finger touch' is understood, a 'target button recognition method using a separated finger' will be applied as a target button recognition method, A phrase referred to as a reference finger (= reference touch point) in the definition of the term is replaced with a finger that is touched to the left most (= touch point), and a phrase referred to as a sick reference finger (= (= Touch point).

1.4.2..8.6. Multi-Sized All-Sized Finger Touch (= Multi-Sized All-Touch Touch Point Touch by Earned Touch Point)

As a nearly same concept as the definition of the term 'multi-all all good reference finger touch'

However, when the definition of the term 'multi-allall reference finger touch' is understood, a 'target button recognition method using a separated finger' will be applied as a target button recognition method, A phrase referred to as a reference finger (= reference touch point) in the definition of the term is replaced with a finger that is touched to the left most (= touch point), and a phrase referred to as a sick reference finger (= (= Touch point).

1.5. Definition of Terms for Post-Touch Operation

1.5. Touch Operation

Quot; operation after single-touch " and " operation after multi-touch "

1.5.1 .. Definitions of terms for single-touch post-operation

1.5.1..1. Operation after single touch

"Single on & off", "single drag" and "single multi tap" are included in the operation after the single touch described later.

The single-touch post-operation may include only a single touch, which may be followed by a single touch, after a single touch, although it may also refer to any operation in which subsequent movement is further performed after a single touch, It is a term that can be used in the sense of.

Thus, it is possible to misunderstand the operation of single-touch after being single-touched, including a single-on-and-off operation after single-touching, or a single-touch operation after single-touching, Is described so as to be misunderstood as if it occurs twice, or the content claimed in the claims is also referred to in order to facilitate understanding, so that a single touch should be interpreted to occur only once.

E.g,

The word "single on" and "off" after a single touch with the index finger indicates that the index finger is turned off without being dragged after being single-touched with the index finger, that is, single- Quot; and " on "

The word "single drag" to the upper side after the finger is single-touch means that the finger is dragged upward while the finger is single-touched with the index finger and the index finger is not turned off and the index finger is touched. That is, a single-dragging is performed with a single-touch, or a single-dragging is performed with an upper-side starting with a single-touch.

In other words, the expression that after a single touch is manipulated after a single touch is just the same as saying that it is manipulated after a single touch, and the situation in which it is used requires such a statement.

This is because there is no need to perform a single touch twice unless it is related to "single multi-tap".

1.5.1..2. Single on & off

Refers to an operation that is not dragged after a single touch but is immediately turned off.

1.5.1..3. Single drag

Refers to an operation in which a finger is touched while a finger is touched after a single touch. (In terms of the device, the operation is referred to as dragging while a touch point is kept touched after a single touch.)

1.5.1..4. Single-tap

[0003] In general, a method called a multi-tap method refers to an operation in which the same button is continuously pressed with one finger. (In terms of the device, a method commonly called a multi-tap method, Quot;

1.5.2 .. Definitions of terminology for multi-touch post-manipulation

1.5.2..1. Multi-touch after operation

Multi-drag ',' multi-on & off 'and' multi-multi-tap 'are included in the multi-touch post-operation.

The multi-touch post-operation may mean any operation in which a subsequent movement is additionally performed after a multi-touch (but in such a case is rarely), but also includes the moment when the multi- It is a term that can be used.

In order to be misunderstood in such a manner that a multi-touch is turned on after being multi-touched or a multi-touch is performed after being multi-touched, It should be interpreted that a multi-touch occurs only once, as it may be misinterpreted as two occurrences of a touch, or the content claimed in a claim is merely referred to for the sake of understanding.

E.g,

The word "multi-all on and off" after two multi-touches with the detection and stop means that both the detection and stop are simultaneously turned off without being dragged, And the multi-all on and off is started with two multi-touches by sensing and stopping.

After two multi-touches with the detection and stop, the word "multi-all" is dragged to the upper side. The word "multi-touch" means that the sensor and the stop are not turned off, that is, And stopping are all dragged upward. In other words, multi-touch is performed by two multi-touches by sensing and stopping, or multi-all is started by two multi-touches by sensing and stopping.

In other words, the expression that after multitouch is manipulated after multitouch is just the same as saying that it is manipulated after multitouch, and the situation in which the word is used sometimes requires such a statement.

  This is because it is not necessary to perform multi-touch operations twice without the contents related to 'multi-tap'.

1.5.2..2. Multi-on & Off

Multi-all on and off 'and' multi-all on and off 'are included here as an operation for making one of the multi-touched fingers not to be dragged but to be turned off in place. From the standpoint of the user, the touch point of one of the multi-touch points is not dragged, and all of them are turned off, and the multi-all on and off and multi-on all on and off do.)

For example, when two multi-touch operations are performed after detection and stop, the operation of causing the multi-touch stop and the detection to be turned off without being dragged is included here.

1.5.2..3. Multi all on & off

A multi-on (multi-touch) operation in which, when multi-touch fingers are turned on and off, the time difference between the time when the finger is turned off the first time and the time when the finger is turned off the last time is off (In terms of the device, when the multi-touch points are multi-on and off, the time difference between the time when the touch point is turned off the first time and the time when the touch point is turned off the last time is off) On-off " which causes the time to be less than a predetermined time (e.g., 0.1 second).

For example, when two multi-touch operations are performed by sensing and stopping,

When one of the stop and the detection is first turned off on the touch screen and the other is turned off later when the operation is performed with the intent of turning off the stop and detection simultaneously on the touch screen, The time difference between the time when the finger is turned off and the time when the finger is turned off is equal to or less than a predetermined time (for example, 0.1 second)

More specifically, for example, when the stop and detection are operated simultaneously with the intention of turning off the touch screen, even if the stop is turned off on the touch screen before the detection, the time when the stop is turned off and the time when the detection is off If the time difference is less than a certain time (for example, 0.1 second), it is included here.

1.5.2..4. Multi-all All On & Off

When the multi-touch fingers are 'multi-on & off', the time difference between the time when the fingers are turned off the first time and the time when the fingers are turned off the last time is longer than a predetermined time (for example, 0.1 second) On & off ". This includes the multi-nathal-based fingers on and off and the multi-ning all-on fingers on-off.

(In view of the device, when the multi-touch points are 'multi-on & off', the time difference between the time when the touch point is turned off the first time and the time when the touch point is turned off the last time is off : 0.1 second), which is included in the multi-on-all reference touch point on & off and multi-on all reference touch point on and off described below.

For example, in the case where one of the stop and the detection is first turned off on the touch screen and the other is turned off later in the operation of two multi-touch operations by sensing and stopping, If the time difference between the time when the finger is turned off exceeds a predetermined time (for example, 0.1 second), it is included here.

1.5.2..5. Multi-nathall reference finger on & off (= multi-nathall touch point on & off)

When the multi-all all on and off, the reference finger is turned off first, and then the reference finger is turned off. (From the standpoint of the device, when multi-all all on & off, Quot; off " after turning off the reference touch point).

For example, when the index finger is recognized as a reference finger and the stop is recognized as a reference finger by two index finger touches, , And when the detection is later turned off, the time difference between the time when the stop is turned off and the time when the detection is turned off is longer than a predetermined time (for example, 0.1 second).

1.5.2..6. Multi-Sized All-Sided Finger On & Off (= Multi-Sized All Sense Touch Point On & Off)

Refers to an operation in which a reference finger is turned off first and then a good reference finger is turned off when the multi-all-on-all is turned on and off. (From the standpoint of the apparatus, , And later a better reference touch point is turned off.)

For example, in the case where the index finger is recognized as the reference finger and the stop is recognized as the reference finger, the index finger is first turned off on the touch screen , When the stopping is later turned off, and when the time difference between the time when the detection is turned on and off and the time when the stopping is turned on and off exceeds a certain time (for example, 0.1 second) .

The position of the button including the touch point to which the detection is touched is maintained as the target button even if the detection of the reference finger is turned off first.

1.5.2..7. Multi-drag

Here, 'multi-drag' and 'multi-all drag', which will be described later, are included as dragging while one or more fingers of multi-touched fingers are kept on.

(From the viewpoint of the device, one or more touch points of the multi-touched touch points are maintained in the ON state, and the 'multi-drag' and the 'multi-all drag' are included.

1.5.2..8. Multi-drag

Refers to the fact that none of the multi-touched fingers are turned off and the whole is dragged and started to be dragged (in terms of the device, none of the multi-touched touch points are turned off, Refers to dragging.)

The multi-drag is established when all the fingers to which the multi-drag is being dragged start to be dragged in a state in which there is a point of movement together. Even if one or more of the multi-dragged fingers are turned off first due to dragging in the edge of the touch screen (top, bottom, left, right, or edge areas) and dragging in the edge direction, If the point at which the finger is moving together is present, it is recognized as a multi-drag.

For example, when the index finger is recognized as the reference finger and the stop is recognized as the reference finger, the stop as the reference finger and the finger as the reference finger are not turned off, If you are dragged so that there is a point where you start dragging together, it is included here.

1.5.2..9. Multi-all drag

A drag that is manipulated such that at least one remaining finger still turned on is present so that there is a time point at which at least one remaining finger still starts being dragged while at least one of the multi-touched fingers is turned off, (In terms of the device, when at least one of the multi-touched touch points is off and at least one remaining touch point that is still on is dragged, This is a drag that is manipulated so that the point of view exists, as described below, 'Multi-Not All Reference Touch Point Drag' and 'Multi Not All Reference Touch Point Drag'.

A multi-all drag is established when at least one remaining finger, which has been turned on except for the off-fingered multi-all dragged finger, starts to be dragged in a state where there is a point of movement together. At the touch screen edge (upper, lower, left, right or corner area), dragging has begun and at least one of the fingers that were still on has been turned off before the multi- Even if at least one of the remaining fingers that have started to be multi-all dragged has been moved together, it is recognized as multi-all drag.

For example, in the case where the index finger is recognized as a reference finger and the stop is recognized as a reference finger, the index finger and the stop are operated after two multi-touch operations, The case where the remaining fingers start to be dragged and dragged are included here.

1.5.2..10. Multi-Sided Fingered Drag (= dragging multi touch points based on multi-sided)

Refers to a multi-all drag in which the reference finger begins to be dragged after at least one better reference finger is turned off. (From the perspective of the device, the multi- It refers to a dragon.

For example, in the case where the index finger is recognized as the reference finger and the stop is recognized as the reference finger and then the finger is operated after two multi-touches with the index finger and the stop, And the case where the index finger, which is the reference finger, is dragged and started to be dragged later after the finger is turned off.

1.5.2..11. Multi-Sick All-Good Finger Drag (= Multi-Sick All-Sick Touch Point Drag)

Refers to a multi-all drag in which at least one better reference finger begins to be dragged after the reference finger is turned off. (In view of the device, the multi- It refers to a dragon.

For example, in the case where the index finger is recognized as the reference finger and the stop is recognized as the reference finger as well as two multi-touches after the detection and stop, And then a stop, which is a better reference finger, is dragged and started to be dragged.

The position of the button including the touch point to which the detection is touched is maintained as the target button even if the detection of the reference finger is turned off first.

1.5.2..12. Multi-tap

Generally, a multi-tap refers to an operation of pressing the touch button with one finger several times. Speaking in this context, it can be said to be a single multi-tap method

For example, the touch buttons assigned A, B, and C among the touch buttons shown in FIG.

1) Press A once to enter A,

2) Press B twice to enter,

3) Press C three times.

On the other hand, the multi-multi-tap refers to multi-tap operation in the multi-touch manner.

More specifically, the multi-multi-

In an apparatus equipped with a touch screen, in a method in which an operation signal is generated for a certain operation including multi-touch operation, including character input or object modification,

After the multi-touch operation,

Off may be a method in which another operation is performed depending on the number of times that the multi-on-off is performed at least one time in succession,

When a character is input by the multi-tap method,

Touches or multi-touches such that the characters belonging to the target character group related to the target button are cyclically displayed according to the number of times that the multi-on and off is continuously performed at least once, and then the other button is recognized as the target button This can be a way in which the displayed characters are input definitively when the cursor is moved or after a certain period of time (for example, 2 seconds). It is recommended that the method of inputting the characters definitively follow one or more of the methods in which characters are input definitively in the conventional (single) multi-tap method.

For example, in the normal character mode, the following 1) to 3) processes can be performed without changing the character mode,

Touch buttons A, B, C and!,?, And / among the touch buttons shown in FIG. 1 are multi-touched to be the target button,

1) Multi-all on and off are performed once so that the first character "!" Among the characters (!, ◆, /) assigned under A, B and C but not A can be inputted,

2) It is possible to input the second character "◆" of the characters (!, ◆, /) assigned under A, B,

3) The multi-all on and off is 3 times so that the third character "/" of the characters (!, ◆, /) assigned under A, B, C other than C can be input.

Simply put,

The touch buttons assigned to A, B, C and!, 占, / among the touch buttons shown in FIG. 1 are detected and stopped to be the target buttons,

1) Multi-touch (multi-all on and off) is the number 1, so that the first character "!" Among the characters (!, ◆, /) assigned under A, B and C However,

2) The multi-touch (multi-all on and off) is 2 times so that the second character "◆" of the characters (!, ◆, /) assigned under A, However,

3) The multi-touch (multi-all on and off) is 3 times so that the third character "/" of the characters (!, ◆, /) assigned under A, have.

When a multi-tap method is used, a specific character among at least one character related to a button recognized as a target button, belonging to a specific character group among at least one character group, is input. A method in which at least one character among at least one character associated with a target button is input without changing the character mode while a specific character group is matched with one character group and belongs to the matched character group. (It can also be applied to QWERTY keyboard.)

Briefly, without changing the character mode, at least one character associated with the target button can be entered belonging to a specific character group. Here, the specific character group may be any one or more of the following.

1) One character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to one of the various character modes in a conventional general mobile phone including a character group of a special character mode.

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

(1) to 5) are covered in detail here, including "3. How to input text on the touch screen" and the claims, and the implications are the same as the following. Detailed descriptions including all the explanations are omitted.)

For example, in the above-mentioned " 1) " spelling rule, a character group may be one of two or more different character groups classified into different series,

For example, when the current character mode is the uppercase letter mode, the character mode to which the specific character group belongs is the lowercase character mode. If the current character mode is the Japanese hiragana character mode, for example, The character mode may be a character mode in which a character group including other characters corresponding to the current character mode and other characters corresponding to the current character mode are included in the spelling rule in the same character system including the character mode. That is, it may be a character group consisting of characters input in another character mode on the spelling rule corresponding to the currently set character mode.

For example, if the touch button assigned A, B, and C in the upper case letter mode is multi-tapped to be recognized as the target button, any of lower case letters a, b, or c may be input even in the upper case letter mode .

Specifically, when the touch buttons assigned to A, B, C and!,, And / are multi-multi-tapped so as to be recognized as target buttons, , Or a, b, or c is substituted for /, the detailed detailed embodiment will be omitted.

In the example shown in FIG. 1, the letters A, B, C and!,?, And / are assigned to the same button among the characters assigned to the same button of "3) The "!" , &Quot; ", and " / ". 1, the characters assigned to the second row of the touch buttons are special characters, but they can also be implemented with characters other than special characters.

In the example shown in FIG. 1, the letters A, B, and C may be letters assigned to the same button in the above-mentioned " 4) " ! "," /! "And" /! "Are assigned to the 4th to 6th touch buttons assigned to the"! " , &Quot; ", and " / ", respectively.

When the multi-touch is multi-tapped in detail by n multi-touch, different character groups are matched according to different n values, and characters of the corresponding character group are input without changing the character mode You may.

1.5.2..13. Definition of terminology for multi-touch post-manipulation by open finger

1.5.2..13.1. Multi-touch operation with fingertip (= Multi-touch operation with open touch point)

As a concept almost identical to the definition of the term " multi-touch after manipulation &

However, when the definition of the term 'multi-touch after manipulation' is understood, a 'target button recognition method using a fingertip' will be described below as a target button recognition method.

1.5.2..13.2. Multi-on & off by fingertip (= multi-on & off by earned touch point)

As a concept almost identical to the definition of the term " multi-on &

However, when the definition of the term 'multi-on-off' is understood, the 'target finger recognition method using target finger' will be applied to the target button recognition method.

1.5.2..13.3. Multi-all on & off by fingers (= multi-all on & off by gaping touch point)

Almost the same concept as the definition of the term " multi-all on &

However, when the definition of the term 'multi-all on and off' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method.

1.5.2..13.4. Multi-all all on & off by opened finger (= multi-all all on & off by earned touch point)

As a concept almost identical to the definition of the term 'multi-all on and off'

However, when the definition of the term 'multi-all on and off' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method.

1.5.2..13.5. Multi-natall reference finger on & off by opened finger (= touch point on & off based on multi-natall by bullet touch point)

As a nearly same concept as the definition of the term " multi-allall reference finger on & off &

When the definition of the term " multi-allall reference finger on & off " is understood, a method of recognizing a target button by a separated finger is described as a target button recognition method, (= Reference touch point) in the definition of the word " off " is replaced by the leftmost touch finger (= touch point) Is replaced with a finger (= touch point) touching the touch point.

1.5.2..13.6. Multi-Sized All-Sided Finger On & Off by Opened Fingers (= Multi-Sized All Sense Touch Point On & Off by Earned Touch Point)

As a nearly same concept as the definition of the term 'multi-all all good fingers on and off'

However, when the definition of the term 'multi-all all good reference finger on & off' is understood, a 'target finger recognition method using target finger' will be applied as a target button recognition method, Quot; reference finger point " in the definition of the term " finger on & off " is replaced by a leftmost touched finger (= touch point) It is only a concept that has been replaced with the right-most touched finger (= touch point).

1.5.2..13.7. Multi Drag with open finger (= Multi Drag with open touch point)

In almost the same concept as the definition of the term " multi-drag &

However, when the definition of the term 'multi-drag' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method only.

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

Almost the same concept as the definition of the term " multi-drag "

However, when the definition of the term 'multi-drag' is understood, the 'target button recognition method using the extracted finger' will be applied to the target button recognition method only.

1.5.2..13.9. Multi-all drag with dragged fingers (= multi-all drag by dragging one point)

Almost the same concept as the definition of the term 'multi-all drag'

However, when the definition of the term 'multi-all drag' is understood, the 'target button recognition method using a fingertip' will be applied to the target button recognition method.

1.5.2..13.10. Drag the multi-picked finger by the fingertip (= drag the multi-picked touch point by the open touch point)

As a nearly same concept as the definition of the term " multi-allall reference finger drag &

When the definition of the term of 'multi-allall reference finger drag' is understood, 'a method of recognizing a target button by a separated finger' to be described later is applied as a method of recognizing a target button, A phrase referred to as a reference finger (= reference touch point) in the definition of the term is replaced with a finger that is touched to the left most (= touch point), and a phrase referred to as a sick reference finger (= (= Touch point).

1.5.2..13.11. Multi-Sized All-Sided Fingers Drag with Open Fingers (= Multi-Sized All-Sized Touch Points Dragging with Opening Touch Points)

Almost the same concept as the definition of the term 'multi-all all good fingertip drag'

However, when the definition of the term of 'multi-all all reference fingers drag' is understood, a 'method for recognizing a target button by a fingertip' to be described later is applied as a method for recognizing a target button, (= Reference point) in the definition of the term is replaced by a finger that is touched to the left most (= touch point), and the phrase "good reference finger" Is replaced by a finger (= touch point).

1.5.2..13.12. Multi-tap with fingertip (= Multi-multi tap with open touch point)

As a concept almost identical to the definition of the term " multi-multi-tap &

However, when the definition of the term 'multi-tap' is understood, a 'target button recognition method using a fingertip' will be applied as a target button recognition method.

1.5.2..14. The most recommended multi-touch post-operation

1.5.2..14.1. Most recommended multi-on & off

Off " is a multi-on & off operation, which is the simplest multi-on-off operation for the user.

In the case where the index finger is recognized as a reference finger and the stop is recognized as a reference finger,

When one of the stop and the detection is first turned off on the touch screen and the other is turned off later when the operation is performed with the intent of turning off the stop and detection simultaneously on the touch screen, The time difference between the time when the finger is turned off and the time when the finger is turned off is equal to or less than a predetermined time (for example, 0.1 second)

More specifically, for example, when the stop and detection are operated simultaneously with the intention of turning off the touch screen, even if the stop is turned off on the touch screen before the detection, the time when the stop is turned off and the time when the detection is off And the time difference is equal to or less than a predetermined time (for example, 0.1 second).

1.5.2..14.2. The most recommended multi-drag

Multi-drag "is a multi-drag operation that is the simplest multi-drag operation to the user and is performed in the same manner as in the definition of the multi-drag. The index finger is recognized as a reference finger and the stop is recognized as a reference finger The finger and the reference finger are both dragged so that there is a point at which both the stop as the reference finger and the finger as the reference finger start to be dragged together (without being turned off).

1.5.3 ... after single touch, after multitouch operation

After the target button is single-touched, an operation is performed in which after the single-touch state is maintained for a predetermined time (e.g., 0.1 second) or more and another at least one finger is further touched so that the multi- Quot; (From the standpoint of the device, after the target button is single-touched, after the single-touch state is maintained for a predetermined time (for example, 0.1 second) or more and another at least one touch point is further touched, Touch) operation is performed.

'Single Touch After Multi Touch Operation' includes 'Multi All On & Off after Single Touch' and 'Multi All Drag After Single Touch'.

As an example of 'multi-all on and off after single touch'

After the index finger touches the target button, the touch state of the index finger is maintained for a certain period of time (for example, 0.1 second), the stop is further touched, and the index finger 2 is multi- But are simultaneously turned off. To be more specific, the multi-all on / off state is obtained after the finger is first touched with the index finger and then the stop is further touched to the multi-touch state.

As an example of 'multi-drag after a single touch'

After the index finger is single-touched on the target button and the touch state of the index finger is maintained for a certain period of time (for example, 0.1 second), the stop is further touched to perform two multi-touches with the index finger and stop, This includes cases where dragging is performed. To be more specific, the multi-all dragging is performed after the finger is first touched with the index finger and then the stop is further touched to the multi-touch state.

In addition to 'Multi touch all on & off' after 'Single touch' and 'Multi touch all after touch', it is also possible to make a variety of 'After single touch and after multi touch operation' by assigning various multi touch after operation after single touch.

1.6. Definition of terms for target button recognition methods

To describe the point at which the target button is judged from the standpoint of the device before entering the definition of the term, at least the touch point including the touch point in the single-touched state within the time in which one (unit) (Update) the target button every time a new touch occurs in a state in which any one of the touch points is not turned off or dragged.

1.6.1 .. How to recognize target button by reference finger

(= Target button recognition method by reference touch point)

A method of recognizing a target button by a reference finger is a method in which a finger of one of multi-touched fingers is recognized as a reference finger and a touch button including a point at which the reference finger is touched is recognized as a target button. (In view of the device, in the target button recognition method using the reference touch point, any one of the multi-touched touch points is recognized as the reference touch point, and the touch button including the reference touch point is recognized as the target button This is how it works.)

1.6.1..1 How to recognize target button by reference finger in order of X coordinate value

(= Method of recognizing target button by reference touch point according to X coordinate value order)

A touch button including a point having a value in a specific order among the order of the X coordinate values among the points where the multi-touched fingers are touched is recognized as the target button.

That is, a touch button including a point having a specific order value in the order of the X coordinate values among the multi-touched touch points is recognized as the target button.

For example, there is a method in which a touch button including a point having the first X coordinate value among the leftmost points of the points touched by the multi-touched fingers, that is, a small order of the X coordinate values, is recognized as the target button.

For example, in the keyboard of the arrangement as shown in Figs. 1, 3 and 4, the detection is touched to the button 5 and the stop including the stop button 3 or the button 6 (or even the button 9 or button # When the touch point is touched at any one of the right points of one point, the index finger touching the leftmost point on the touch screen is recognized as the reference finger, and the button including the point touching the index finger recognized as the reference finger 5 is recognized as the target button.

Even when the detection is touched on the left side portion inside the button 5 and the stop is touched on the right side portion inside the button 5, the index finger touching the leftmost point on the touch screen is recognized as the reference finger, Button.

In this case, in the process of recognizing the reference finger, only the X-coordinates of the multi-touched fingers are considered, and the Y-coordinates of the multi-touched fingers are not considered.

Therefore, in the case of the user, the buttons 5 are touched with the index finger and the button 5 includes a point having a larger X coordinate value than the button 5, (Eg, button 3, button 6, button 9, or button #) is touched or the boundaries of the buttons are touched, resulting in duplication of two or more of button 3, button 6, button 9, Touch.

Since the touch button including the point in the specific order among the order of the X coordinate values among the points where the multi-touched fingers are touched is recognized as the target button, unlike the above example, the reference finger is recognized in the following manner, It is also possible that the touch button including the point where the reference finger is touched is recognized as the target button.

E.g,

1) A finger (= touch point) touched at the second point from the left may be set to be recognized as the reference finger (= reference touch point)

2) The finger (= touch point) touched at the third point from the left may be set to be recognized as the reference finger (= touch point)

3) The finger (= touch point) touched at the fourth point from the left may be set to be recognized as the reference finger (= touch point).

1.6.1..2 How to recognize the target button by the reference finger according to the Y coordinate value order

(= Method of recognizing target button by reference touch point according to Y coordinate value sequence)

A touch button including a point having a value in a specific order among the order of Y coordinate values among the points where multi-touched fingers are touched is recognized as a target button.

That is, a touch button including a point having a specific order value among the order of Y coordinate values among multi-touched touch points is recognized as a target button.

It is a feasible method because the length of fingers is different. Normally, since the stop is longer than the index finger, the following assumption is made. Thus, when the index finger is touched to the button 5 when the right hand is double-touched with the detection of the right hand, the stop is not touched to the button 6, which is the right button of the button 5, but is touched to the button 3, . Even if the index finger is longer than the stop, the index finger can bend and the stop can be made longer as the stop finger is longer than the index finger, and the following example can be applied.

For example, a touch button including a point having the Y coordinate value of the first of the smallest points of the points touched by the multi-touched fingers, that is, the smallest Y coordinate value, is recognized as the target button.

More specifically, in the keyboard of the arrangement as shown in Figs. 1, 3 and 4, the index finger is touched to the button 5, and the stop button 3 (or even button 1 or button 2) When the touch point is touched at any point among the points, the index finger touching the lowest point on the touch screen is recognized as the reference finger, and the button 5 including the point touching the index finger recognized as the reference finger is displayed on the target button .

Even when the detection is touched on the lower part inside the button 5 and the stop is touched on the upper part inside the button 5, the index finger touching the lowest point on the touch screen is recognized as the reference finger, Button.

In this case, when the reference finger is recognized, only the Y coordinates of the multi-touched fingers are considered, and the X coordinates of the multi-touched fingers are not considered.

Therefore, in the case of the user, the button 5 is touched by the index finger and the button including the point where the Y coordinate value is larger than the button 5 or the stop button 5 in order to multi- (For example, button 1, button 2, or button 3) may be touched or the boundary of the buttons may be touched so that at least two of the buttons 1, 2, and 3 are simultaneously touched.

Since the touch button including the point in the specific order among the order of the Y coordinate values among the points where the multi-touched fingers are touched is recognized as the target button, unlike the above example, the reference finger is recognized in the following manner, It is also possible that the touch button including the point where the reference finger is touched is recognized as the target button.

E.g,

1) a finger (= touch point) touched at the second point from the bottom may be set to be recognized as the reference finger (= reference touch point)

2) The finger (= touch point) touched at the third point from the bottom may be set to be recognized as the reference finger (= touch point)

3) The finger (= touch point) touched at the fourth point from the bottom may be set to be recognized as the reference finger (= touch point).

On the other hand, when the reference finger recognition method is applied, multi-teaching in which both hands are used while the right hand and the left hand alternate are possible. This is because the same rules can be applied to both the left and right hands. More specifically, for example, a touch button including a point having the Y coordinate value of the first one of the smallest points of the points touched by the multi-touched fingers, that is, the smallest order of the Y coordinate values, When the recognized method is applied, when two multi-touches are used in which the right and left hands are alternately used for detecting and stopping, the index finger of both hands touching the lower touch point among the multi- And the button including the point at which the detection of both hands recognized as the reference finger is touched is recognized as the target button.

However, according to the method of recognizing the target button by the reference finger according to the order of the X coordinate value, it is practically impossible to use the multi-teach which is used by alternately hands. This is because the same rules can not be applied to both the left and right hands.

More specifically, for example, a touch button including a point having the first X coordinate value among the leftmost points among the touched points of the multi-touched fingers, that is, the small order of the X coordinate values, When the recognized method is applied and two hands are turned alternately and two multi-touches are performed with both hands, the stop will be recognized as the reference finger when the two hands are multi-touched by the detection and stop of the left hand, In the case of two multi-touches, the index finger will be recognized as the reference finger.

1.6.1..3 How to recognize the target button by the reference finger according to the order of X coordinate value according to the number of multi-touch

(= Target button recognition method by reference touch point according to the order of X coordinate value according to the number of multi-touched points)

n The specific order to be set in the order of the X coordinate values in which the reference finger is recognized is determined in the 'method of recognizing the target button by the reference finger according to the order of the X coordinate value' according to the n value in the multi- A specific sequence to be set in the X coordinate value order in which the reference touch point is recognized is determined in the 'method of recognizing the target button by the reference touch point according to the order of the X coordinate value' according to the n value in the multi- This is how it works.)

For example,

1) 2 When multi-touch is performed, the finger (= touch point) touched at the first position from the left is recognized as the reference finger (= reference touch point)

2) 3 When a multi-touch is performed, the finger (= touch point) touched at the second point from the left is recognized as the reference finger (= reference touch point)

3) When 4 multi-touched, a finger (= touch point) touched at the third point from the left can be set to be recognized as the reference finger (= reference touch point).

More specifically, in the keyboard of Fig. 3 or Fig. 4 and the arrangement,

1) When button 2 is single-touched with the index finger, the first character assigned to button 2 is input,

2) When the button 2 is touched with the index finger, and the button 3, which is the right button of the button touched with the index finger, becomes two multi-touched touched, the index finger, The second character assigned to the button 2, which is the target button, is input so that the button 2 touched by the index finger as the reference finger is recognized as the target button,

3) When the button 1 is touched by the index finger, the button 2 which is the right button of the button touched by the index finger is touched by stop, and the button 3 which is the right button of the touched button is touched by the finger The button 2 which is touched at the second point is recognized as the reference finger and the button 2 touched by the stop as the reference finger is recognized as the target button so that the third character assigned to the button 2 as the target button can be inputted have.

1.6.1..4 Y-coordinate value according to the number of multi-touched points

(= Target button recognition method based on the reference touch point according to the order of Y coordinate values according to the number of multi-touched points)

n The specific order to be set in the Y coordinate value order in which the reference finger is recognized is determined in the 'method of recognizing the target button by the reference finger according to the Y coordinate value order' according to the n value in the multi- The specific order to be set in the Y coordinate value order in which the reference touch point is recognized is determined in the 'method of recognizing the target button by the reference touch point according to the Y coordinate value order' according to the n value in the n multi- This is how it works.)

For example,

1) 2 When multi-touch is performed, the finger (= touch point) touched at the first point from the bottom is recognized as the reference finger (= reference touch point)

2) 3 When multi-touch is performed, the finger (= touch point) touched at the second point from the bottom is recognized as the reference finger (= reference touch point)

3) When 4 multi-touches are made, the finger (= touch point) touched at the third point from the bottom can be set to be recognized as the reference finger (= reference touch point).

More specifically, in the keyboard of Fig. 3 or Fig. 4 and the arrangement,

1) When the button 5 is single-touched with the index finger, the first character assigned to the button 5 is input,

2) When the button 5 is touched with the index finger, and the button 2, which is the upper button of the button touched with the index finger, becomes two multi-touched touched, the index finger, The second character assigned to the button 5, which is the target button, is input so that the button 5 touched by the index finger as the reference finger is recognized as the target button,

3) When the button 8 is touched by the index finger and the button 5, which is the upper button of the button touched by the index finger, is touched by stop, and the button 2, which is the upper button of the touched button, is touched by the finger, The button 5, which is touched by the stop of the reference finger, is recognized as the target button, so that the third character assigned to the button 5, which is the target button, can be input have.

1.6.2 .. How to recognize the target button by using the fingertip

(= Target button recognition method by the bulleted touch point)

A method of recognizing a target button by using fingertips is a method in which a touch button including a new point determined based on points where multi-touched fingers are touched is recognized as a target button. Hereinafter, the following five methods are included. (From the viewpoint of the device, the 'method of recognizing the target button by the bulleted touch points' includes a touch including a new point determined based on the multi- This is how the button is recognized as the target button.)

1.6.2..1 Target Button Recognition Method with First Blank Finger (= Target Button Recognition Method with First Blank Touch Point)

Touch buttons including a new X coordinate determined based on the X coordinates of the touched points of the multi-touched fingers, and a new Y coordinate determined based on the Y coordinates of the touched points of the multi-touched fingers (In terms of the device, a new X coordinate determined based on the X coordinates of the multi-touched touch points, a new X coordinate determined based on the Y coordinates of the multi-touched touch points, A method in which a touch button including a point made up of Y coordinates is recognized as a target button is also possible).

For example, a touch button including a new X coordinate that is the center of the X coordinates of the touched points of the multi-touched finger, and a new Y coordinate that is the center of the Y coordinates of the touched points of the multi- It is also possible to recognize it as a target button.

For example, when the touch point of the index finger is (X1, Y1) and the touch point of the stop is (X2, Y2), the center coordinate X3 (= X1 The touch button including the point (X3, Y3) consisting of the center coordinates Y1 (+ X2) / 2) and Y3 (= (Y1 + Y2) / 2) between Y1 and Y2 is recognized as the target button.

More specifically, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the detection and the stop are used and two multi-touches are performed,

The button 5 is recognized as the target button when the detection is touched by the button 4 and the stop is touched by the button 6. Even if the detection is touched by the button 7 and the stop is touched by the button 3, .

1.6.2..2 Method of recognizing the target button by the second opened finger (= method of recognizing the target button by the second opened touch point)

A new X coordinate determined based on the X coordinates of the touched points of the multi-touched fingers, and a Y coordinate that is paired with the X coordinate of the specific sequence of the order of magnitude of the X coordinate value of the touched points of the multi- (In terms of the device, a new X coordinate determined based on the X coordinates of the multi-touched touch points, an X coordinate value of the multi-touched touch points It is also possible that a touch button including a point consisting of an X coordinate in a specific order and a Y coordinate pair in a size order is recognized as a target button.)

For example, a new X coordinate which is the center of the X coordinates of the touched points of the multi-touched fingers, a Y coordinate which is a pair of the X coordinate of the first order among the smaller order of the X coordinate values of the touched points of the multi- It is also possible that a touch button including a point made up of coordinates, that is, a Y coordinate which is paired with the smallest X coordinate, is recognized as a target button.

For example, when the touch point of the index finger is (X1, Y1) and the touch point of the stop is (X2, Y2), the center coordinate X3 (= X1 + X2) / 2) and Y1 (X3, Y1) is recognized as the target button. (Normally, since the touch is right-handed, The X coordinate of the first order among the small orders of the X coordinate values is X1 which is the X coordinate of the point where the detection is touched and the Y coordinate which is paired with the X1 is Y1.

More specifically, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the detection and the stop are used and two multi-touches are performed,

When the detection is touched by the button 4 and the stop by the button 6, the button 5 is recognized as the target button, and even if the detection is touched by the button 4 and the stop by the button 3, .

1.6.2..3 Method of recognizing the target button by the third opened finger (= method of recognizing the target button by the third bullet point)

A touch button including a point consisting of a new X coordinate determined based on X coordinates of points touched by multi-touched fingers, and a Y coordinate of a specific order among the order of magnitude of Y coordinate values of points touched by multi-touched fingers (In terms of the device, a new X coordinate determined based on the X coordinates of the multi-touched touch points, a Y coordinate value of the multi-touched touch points, A method in which a touch button including a point made up of Y coordinates is recognized as a target button is also possible).

For example, a new X-coordinate that is the center of the X-coordinates of the touched points of the multi-touched fingers, and a Y-coordinate of the first one of the smaller order of the Y-coordinate values of the touched points of the multi- It is also possible that the touch button to be recognized as the target button.

For example, when the touch point of the index finger is (X1, Y1) and the touch point of the stop is (X2, Y2), the center coordinate X3 (= X1 + X2) / 2) and Y1 (X3, Y1) is recognized as the target button. (In the normal case, since the detection is shorter than the stop, Since the Y coordinate value will be touched at a smaller point, the Y coordinate in the first order of the smallest sequence of Y coordinate values is Y1, which is the Y coordinate of the point where the detection is touched.)

More specifically, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the detection and the stop are used and two multi-touches are performed,

When the detection is touched by the button 4 and the stop by the button 3, the button 5 is recognized as the target button, and even if the detection is touched by the button 4 and the stop by the button 6, .

1.6.2..4 Method of recognizing the target button by the fourth opened finger (= method of recognizing the target button by the fourth bullet point)

A new Y coordinate determined based on the Y coordinates of the touched points of the multi-touched fingers, and an X coordinate that is paired with the Y coordinate in a specific order among the order of magnitude of the Y coordinate value of the touched points of the multi- (In terms of the device, a new Y coordinate determined based on the Y coordinates of the multi-touched touch points, a Y coordinate value of the multi-touched touch points It is also possible that a touch button including a point consisting of an X-coordinate and a Y-coordinate in a specific order in the size order is recognized as a target button.)

For example, a new Y coordinate which is the center of the Y coordinates of the touched points of the multi-touched fingers, an X coordinate which is a pair of the Y coordinate of the first order among the smaller order of the Y coordinate values of the touched points of the multi- It is also possible that a touch button including a point made up of a coordinate, that is, an X-coordinate paired with the smallest Y coordinate, is recognized as a target button.

For example, when the touch point of the index finger is (X1, Y1) and the touch point of the stop is (X2, Y2), the center coordinates Y3 and Y3 + Y2) / 2) and X1 (X1, Y3) is recognized as the target button. (Normally, regardless of whether the detection is shorter than the stop, The Y coordinate of the first one of the smaller order of the Y coordinate values is the Y coordinate of the point where the detection is touched, Coordinate Y1, and the X coordinate paired with the Y1 is X1.)

More specifically, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the detection and the stop are used and two multi-touches are performed,

When the index finger is touched by the button 8 while the right hand is turned by 90 degrees counterclockwise and the stop is touched by the button 1, the button 5 is recognized as the target button and even the index finger is touched by the button 8, Even if the button is touched, the button 5 is recognized as the target button.

1.6.2..5 Method of recognizing the target button by the fifth opened finger (= method of recognizing the target button by the fifth bullet point)

A touch button including a point consisting of a new Y coordinate determined based on Y coordinates of points touched by multi-touched fingers, and an X coordinate of a specific order among the order of magnitude of X coordinate values of points touched by multi-touched fingers (In terms of the device, the new Y coordinate determined based on the Y coordinates of the multi-touched touch points, the X coordinate value size order of the multi-touched touch points) A method in which a touch button including a point made up of X coordinates is recognized as a target button is also possible).

For example, a new Y coordinate which is the center of Y coordinates of the touched points of the multi-touched fingers, and a X coordinate of the first one of the larger order of the X coordinate values of the touched points of the multi-touched fingers It is also possible that the touch button to be recognized as the target button.

For example, when the touch point of the index finger is (X1, Y1) and the touch point of the stop is (X2, Y2), the center coordinates Y3 and Y3 + Y2) / 2) and X1 (X1, Y3) is recognized as the target button. (Normally, the detection is shorter than the stop, so if the right hand is rotated 90 The X coordinate of the first one of the large orders of the X coordinate values is set to the point at which the index finger touches the touch point at which the index finger is touched, X1, which is the X coordinate of the object.)

More specifically, in the keyboard of the arrangement as shown in Fig. 3 or 4, when the detection and the stop are used and two multi-touches are performed,

When the index finger is touched by the button 8 while the right hand is turned by 90 degrees counterclockwise and the stop is touched by the button 1, the button 5 is recognized as the target button and even the index finger is touched by the button 8, Even if the button is touched, the button 5 is recognized as the target button.

1.6.3 .. A method of recognizing a target button by a range including two or more touch points

A method in which a device recognizes a target button when a multi-touch is made is a method of recognizing a range including two or more touch points as a target button or a target range. This method is a method in which the target range or the target button must be considerably wide. It is very difficult for the two-finger to touch the same button because the button to which the character for character input is assigned is small in size. Recognition is in fact very difficult, and objects, including pictures or photographs, are large enough to accommodate two fingers in most cases, so that in most cases, the target button can be recognized in this way. However, if the object is too small, it is actually very difficult to recognize the target button in this way. Since the object may be too small, the method of recognizing the target button by the reference finger is highly recommended.

Here, when the target button recognition method based on the range including two or more touch points is applied as the target button recognition method, a method of recognizing the hit point by the device can be variously set. For example, it is possible to select and set any of the hit point recognition methods for various target button recognition methods described in " Definition of Terms for Target Button Recognition Method 1.6 " above.

1.6.4 .. mixed

It is also possible for the target button to be recognized by using the above-described 'method for recognizing the target button by the opened fingers' and the method for 'recognizing the target button by the reference finger'. For example, the distances between the fingers to be multi-touched can be divided into a range of a distance greater than a certain distance and a range of a distance smaller than a certain distance.

Specifically, in the keyboard of the arrangement as shown in Fig. 1, Fig. 3 or Fig. 4,

When you want to input any one of A, B, or C in the button assigned to the touch button to which ABC is assigned,

1) The first letter A is entered when the button is operated after the single touch of the single touch,

2) When the multi-touching finger is multi-touched so that the distance between the multi-touched fingers is less than a predetermined distance, when the target button recognition method by the reference finger is set to be applied among the various methods of recognizing the target button, When the button having the ABC assigned thereto is set to be the target button so that the interval between the touch points is less than the predetermined distance,

3) When the multi-touch finger is multi-touched so that the distance between the fingers is equal to or greater than a predetermined distance, when the target button recognition method using the fingertip is set to be applied among the various methods of recognizing the target button, When the button with the ABC assigned to the touch point is equal to or longer than a certain distance, the third character C can be selected when the button is operated after touching and stopping the touch screen 2 times.

2. Comprehensive

As explained from the next section,

The general situation in the process of multi-touch post-manipulation, character input and object shape transformation will be described.

In multi-touch operation,

The main used hand is the right hand,

The n-multi-touch, which is mainly used, is two multi-

A method of recognizing a target button mainly used is a method of recognizing a target button by a reference finger among the target button recognition methods by a reference finger among the target button recognition methods by a reference finger, A touch button including a point having an X coordinate value that is the first of the small coordinate values, i.e., the smallest X coordinate value, is recognized as the target button.

The multi-touch which is mainly used is a multi-touch among various multi-touch methods mentioned in the definition of the term of multi-touch. In other words, it is a touch method in which multi-touch fingers are touched simultaneously.

The touch operation method mainly used is multi-all on & off and multi-all drag method.

In other words, when the right hand detection and stopping are two multi-touches and two multi-touches are performed, the index finger is touched to the target button, and the stop is touched to the right of the index finger, This means that both the sensing and the stopping are operated so that the touch state of the sensing and stopping is maintained. At this time, the index finger is recognized as the reference finger, and the stop is recognized as the standard finger.

Incidentally, in the entire contents of the present application including the embodiments to be described later,

It will be appreciated that the above-mentioned mainly used methods are applied to the embodiments, unless otherwise specified in the hand, multi-touch method, target button recognition method, and post-touch operation method in multitouch operation.

It should be noted that a description of a certain button operated after multi-touch operation is regarded as being operated while being multi-touched so that any button can be recognized as a target button, unless otherwise specified.

In addition, in the case of being operated after a single touch, unless otherwise stated, it may be considered to be an embodiment in which a mainly used finger is a finger, a target button is touched with a finger, and then a method of turning off or dragging is applied.

However, it should be borne in mind that this is merely for convenience of explanation, and it should be noted that the hand, n multi-touch method, reference finger setting and target button recognition method, and post-touch operation method are different from the above- It should be noted that the present invention is also embodied in the technical idea of the present invention.

For example, a left hand may be used, and a method of recognizing with a reference finger may be a method in which a finger is touched at a point having the smallest Y coordinate value of a touched point among multi-touched fingers, It is needless to say that the target button recognition method using fingers can be applied.

It is to be understood that the techniques introduced in the specific portions of the present application may be applied to other portions as long as the techniques can be applied to the other portions.

And, the keyboards to which the method of the present invention can be applied are applicable not only to the types described in the present invention but also to various types of keyboards developed in the past or newly developed types.

In the following embodiments, the target button recognition method by the reference finger is mainly assumed in the target button recognition method because the method is convenient for the user. A method for recognizing a target button by a reference finger,

1) Unlike the method of recognizing the target button by the opened fingers, the user does not need to open his /

2) In order to use the 'target finger recognition method of target button' when all of the buttons of the 3X4 type keypad are multi-touched so as to be the target button, as shown in FIG. 3, And a single column should be added to the right of the third column. As a result, a 5x4 keyboard is required as a result, whereas the target by the reference finger according to the order of the X coordinate value among the target button recognition method using the reference finger Quot; button recognition method ", which is one of the smallest order of the X coordinate values, that is, the point having the smallest X coordinate value, When the method in which the included touch button is recognized as the target button is used and two multi-touches in which the right hand detection and the stop are used are used, one row is added to the right side of the third row as shown in FIG. As a result, only the 4x4 keyboard is needed, so the button for entering characters occupies a smaller area of the touchpad,

3) In order to get a single touch with index finger, stop, finger, and hold should be pushed in. However, finger touch can be more convenient than single finger touch because finger and finger are only needed when multi touch is done by index finger and stop.

On the other hand, the spatial relationship (= relative distance) between the fingers (= touch points) at the moment of multitouch operation and the spatial relationship (= relative distance) between the fingers (= touch points) Relative distance) should be maintained below a certain level.

For example, it means that the fingers holding the touch in the process of manipulation as compared with the multi-touch moment are more likely to exceed the predetermined reference value, or to be more difficult to spread.

For reference, it can be implemented using fingers of both hands when implementing multi-touch. For example, two thumbs of both hands can be used to implement two multi-touches.

3. How to enter text on the touch screen

Hereinafter, a method of inputting characters on a touch screen will be described in detail by applying the various operations described above.

First, in a method of inputting characters in a device equipped with a touch screen,

A keyboard on which a plurality of buttons assigned to a plurality of characters are present is displayed on the touch screen,

When a multi-touch operation is performed after a multi-touch operation such that a specific button is recognized as a target button, after the multi-touch operation is started or after the operation is started,

Let us now turn to a method in which a character of a specific sequence number among the characters assigned to a button recognized as a target button by multi-touch post operation may be input.

Additionally,

According to the multi-touch post-operation, the specific sequence number of the input character can be determined,

In the above, if the drag direction is different, it can be recognized that the multi-touch post-operation type is different,

Wherein a specific character among at least one character associated with a button recognized as a target button belongs to a specific character group among at least one character group, At least one character of at least one character associated with the target button may be entered without changing the character mode while the character group is matched and belongs to the matched character group.

Therefore, a specific character group that is different from the type of the situation before the final operation and the character group that is input by the single-touch operation method is matched, and the characters of the matched character group are the same. May be input without changing the character mode.

The " specific character group " may be any one of the following character groups.

1) A group of characters assigned to a specific line among the characters assigned to the same button.

2) a character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (meaning one sequence number if the first specific sequence number and the second specific sequence number are the same)

3) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

If it is extended further, it can be expanded to the following 4), 5).

4) One character group among two or more different character groups classified into different series according to spelling rules.

5) A character group corresponding to one of the various character modes in a conventional general mobile phone including a character group of a special character mode.

FIG. 4 is a view showing a pad including a conventional 3 × 4 keyboard.

(In the pad shown in FIG. 4, the buttons in the fourth row on the far right side are intended to be added to the function buttons while providing space for multi-touch rather than functioning buttons.)

The pads shown in FIG. 4 are assigned the following alphabetic characters.

1) Button 2 is assigned ABC,

2) Button 3 is assigned DEF,

3) Button 4 is assigned GHI,

4) Button 5 is assigned JKL,

5) MNO is assigned to button 6,

6) Button 7 is assigned PQRS,

7) TUV is assigned to button 8,

8) Button 9 is assigned WXYZ,

9) Buttons 1, *, 0, # are not assigned alphabetic characters.

(W, X, Y, Z) are assigned to the buttons assigned the largest number of characters among the buttons provided on the telephone button pad shown in Fig.

In this embodiment, 10 to 6 small letters and special characters are additionally assigned to the buttons, and if it is assumed that 10 characters are allocated to the buttons, the first to fifth characters are ' ', And the 6th to 10th characters can be input as' operation after multi-touch'.

for example,

1) The first character assigned to each button can be input by turning on and off each button individually,

2) The second character assigned to each button can be input by dragging each button in the upper direction (= north direction) after single touch with the index finger,

3) The third character assigned to each button can be input by dragging each button to the right (= east) direction after single touch with the index finger,

4) The fourth character assigned to each button can be input by dragging each button in the lower direction (= south direction) after single touch with the index finger,

5) The 5th character assigned to each button can be input by dragging each button in the left (= west) direction after single touch with the index finger,

6) The 6th character assigned to each button can be input in 'multi all on & off' after multitouch with detection and stop so that each button is recognized as a target button,

7) The seventh character assigned to each button can be input by 'multi-all-drag' in the upper (= north) direction after being multi-touched by the detection and stop so that each button is recognized as the target button,

8) The eighth character assigned to each button can be input by 'multi-all-drag' in the right (= east) direction after being multi-touched by sensing and stopping so that each button is recognized as a target button,

9) The 9th character assigned to each button can be input by 'multi-all-drag' in the lower (= south) direction after being multi-touched by the detection and stop so that each button is recognized as the target button,

10) The 10th character assigned to each button can be input by 'multi-all-drag' in the left (= west) direction after being multi-touched by sensing and stopping so that each button is recognized as a target button.

If the sixth character assigned to button 5 is a question mark "? &

a) When the button 5 is touched by the index finger and any point on the right side of the index finger (that is, the point where the X coordinate value is larger than the index finger and the Y coordinate is irrelevant, for example, button 6 or button 3) , The index finger becomes the reference finger and the button 5 is recognized as the target button,

b) If 'multi all on & off' is selected in this state (that is, when detection and stop are simultaneously released (= off)), a question mark "?"

Assuming that the seventh character assigned to the button 5 is a heart "

a) The button 5 is touched with the index finger, and any point on the right side of the index finger is touched, and the button 5 is recognized as the target button,

b) When multi-all is dragged in the upper (= north) direction in this state (that is, when the detection and stop are dragged while being touched on the touch screen), heart "♥" is input.

On the other hand, when the sixth character is inputted, it is also possible to use 'multi-all on & off' instead of 'multi-all on & off', more specifically, It is possible.

For example, after the question mark "? &Quot;, which is the sixth character assigned to the button 5, is inputted, the button 5 is multi-touched so as to be recognized as the target button, For example, 0.1 second) is exceeded, the detection of the reference finger is turned off.

In addition, it is also possible to use 'multi-all drag' instead of 'multi-drag' when inputting the 7th to 10th characters, and more specifically, it is possible to use 'multi-all all reference finger drag'.

For example, after the seventh letter "♥" assigned to the button 5 is inputted, the button 5 is multi-touched so that the button 5 is recognized as the target button. Then, only the detection as the reference finger While it is stuck on the touch screen, it is dragged in the upper (= north) direction with the multi-pick all fingers.

On the other hand, as a target button recognition method in the case of using multi-touch, there is a method of recognizing a target button by using 'opened fingers' Quot; method of recognizing a target button ", which is an example of a method for recognizing a target button, that is, an X-coordinate value having the smallest X-coordinate value Even if only the method in which the touch button including the point is recognized as the target button and only the two multi-touch using the right hand detection and stop are used, even if only the following three operation methods are applied as the operation method, , The characters can be input easily and quickly without changing the character mode, These are characters that can be entered quickly and easily without changing text mode.

1) 'Single On & Off', 'Single Drag' in 4 directions,

2) 'Multi-all on & off', 'Multi-all drag' in 4 directions,

3) 'Multi-nathall reference finger on & off', 4-way 'Multi-nathall reference finger drag'

Now, in a method of inputting characters in a device equipped with a touch screen, in a case where after a keyboard is displayed on a touch screen, after a multi-touch is operated so that a specific button is recognized as a target button,

The final operation of one of the final operations that may include nine behaviors including dragging in the respective directions of off, top, bottom, left, right (upper left, lower left, upper right, lower right) After the point at which the final operation, including after the point in time or after the point at which the last operation ends,

Multi-touch post-manipulation involving the final manipulation of at least one of the final operations that may include nine behaviors,

When a specific character among at least one character associated with a button recognized as a target button while belonging to a specific character group among at least one character group is input,

Wherein at least one character among at least one character associated with the target button is input without changing the character mode while belonging to the matched character group so that at least one character among at least one character group is matched according to the pre- Let's see how it could be.

Additionally, the " specific character set " may be any of the following character sets:

1) One character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to one of the various character modes in a conventional general mobile phone including a character group of a special character mode.

To further expand, we can expand to the following 3), 4), 5).

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

Application of the above method will be described by taking Japanese input as an example, in which characters assigned to different character modes on the same button can be inputted quickly and quickly without changing the character mode.

Japanese is divided into different types of characters such as 'Hiragana' and 'Katakana', even though they are the same pronunciation letters as upper and lower case letters in English.

Thus, in the Hiragana character mode, without changing the character mode

1) 'Single On & Off' and 'Single Drag' in 4 directions are used to input 5 characters of Hiragana,

2) 'Multi All On &Off' and 'Multi All Drag' in 4 directions are used to input 5 characters of katakana ,

3) The 'multi-nath all fingers on and off' and the four-way 'multinath all fingertip drag' are used to input 5 special characters.

Naturally, even in katakana mode, hiragana characters and special characters can be input without changing the character mode.

The above embodiment will be described more concretely.

Fig. 5 shows a 3x4 type Japanese input keyboard. 5, five Japanese characters are assigned to each button, and only one representative character is indicated from among the five characters allocated to each button.

5 is a Japanese input board in the Hiragana letter mode.

First, as an example of how hiragana is input in Hiragana mode,

When a certain button is 'single-touched' (a condition in which a single touch is performed and then turned off in the following method 1), five hiragana characters assigned to a single- There are two ways to enter the desired characters.

1. The desired hiragana may be input in such a way that one of the popped up hiragana characters is touched (e.g., single touch) after the single-touched finger is turned off. As a result, two touches are required to enter the desired character.

2. The single-touch finger is not turned off, and the desired hiragana character can be input by single dragging in the direction in which the desired hiragana character is located. If the desired Hiragana character is located in the center, the finger can be turned off without dragging, so that the centered Hiragana character can be input. That is, five hiragana characters can be input by single on-off and four-directional single dragging.

Now, as an example of how Katakana characters are entered without changing the character mode in Hiragana mode,

 When a button is multi-touched so as to be recognized as a target button (a condition that the multi-touch is turned off after the first method is also possible), as shown in the lower diagram of Fig. 6, , All the five katakana characters assigned to the 'multi-touch' button to be recognized as the target button are popped up. Here are two examples of how to input desired characters.

1. The desired katakana characters may be input in such a way that one of the popped up katakana characters is touched (e.g., single touch) after the multi-touched fingers are turned off simultaneously. As a result, two touches are required to enter the desired character.

2. The multi-touch fingers are not turned off, and all the fingers are multi-dragged in the direction of the desired katakana characters, so that the desired katakana characters can be input. If the desired katakana character is located at the center, the katakana characters located at the center can be input by dragging the multi-touch fingers simultaneously without dragging. That is, five katakana characters can be input by multi-all on and off and multi-all-dragging in four directions.

Also, the above-described method can be applied to a conventional QWERTY keyboard as shown in FIG. 7 or FIG. For example, if the current character mode is in English lowercase mode,

1) Single on and off are used, lower case letters are input,

2) Even when the current character mode is the English lower case mode by using multi-on-off, the upper case letter is inputted without changing the character mode. That is, characters in other character modes corresponding to the current character mode can be input without changing the character mode.

For example, if the current text mode is in English lowercase mode,

When the button S is singly turned on and off, a small letter s is input. When the button S is multi-all turned on and off so that the button S is recognized as the target button, an uppercase letter S can be input even when the current character mode is the English lowercase letter mode.

(In order to allow the button P and the button L, which are the rightmost buttons in Fig. 7, to be recognized as the target button at the time of multi-touch, in most cases, It would be better if you had.

The button V is displayed on the right side of the button T in FIGS. 7, 44, and 62. Actually, the button Y is incorrectly displayed as shown in FIG. By replacing the button V with the button Y just to the right of the button T, you will understand our text. Even if you do not think otherwise, it does not matter how you understand this book.)

Now, in a method of inputting characters in a device equipped with a touch screen, in a process of multi-on and off such that a specific button is recognized as a target button,

After the point of multi-touch, or after the point of multi-touch including the point after the multi-touch finger is turned off (= the multi-touch is released)

Let's look at a method that can be a method of inputting characters of a specific order among the characters assigned to a button recognized as a target button.

In addition, when the multi-touch is expressed in more detail with n multi-touch, the specific sequence number may be determined according to the value of n, and it may be determined that the numerical value corresponding to the sequence number of the specific sequence number is equal to n have.

In particular, in order to compensate for the problem that many buttons are mis-pressed due to the small size of the buttons and the buttons are not pressed correctly, like the QWERTY keyboard in a state where the smartphone is set up, Compared to the buttons shown in FIG. 7, after the size of a button is made larger, two or more characters are assigned to one button, and then input can be made without a typo by the following embodiment method.

1) When 'Single On & Off' is used, the first character of each button is input,

2) When 'Multi-on & Off' is used, the second character of each button recognized as the target button can be input.

Describing in detail with the button assigned 'QW' in FIG. 8 as an example,

1) When the button assigned to 'QW' is 'Single ON & OFF' after a single touch, that is, when the single ON and OFF starts with a single touch, for example, the button assigned 'QW' Quot; Q ", which is the first character of the button to which " QW " is assigned, is input,

2) 'Multi-all on and off' after two multi-touches so that the button assigned 'QW' is recognized as the target button, that is, when the multi-all that starts with multi-touch is turned on and off, When the button assigned to 'QW' is touched by the index finger, and the stop is touched at any point on the right side of the index finger, and when both the finger and stop are both turned off, 'W', the second letter of the button assigned 'QW' .

According to this, the second character assigned to each button can be directly input by one touch action. 2 Even if it is a multi-touch, since the wrist or elbow is used only once, it can be said to be one touch act. In addition, since the buttons of Fig. 8 are larger in size than the buttons of Fig. 7, there is almost no error.

Meanwhile, in the case of the Hangeul keyboard as shown in FIG. 10 in which the conventional Hangul QWERTY keyboard as shown in FIG. 9 is improved, the principle of the input method described above can be applied. Without a detailed explanation, it will be fully understood.

In addition, the above-described input method can be applied to a case where three characters are assigned to one button as shown in FIG. Specifically,

1) The first character assigned to each button is input to the single on & off after single touch,

2) The second character assigned to each button is input to multi-all on & off after two multi-touches so that each button is recognized as a target button,

3) The third character assigned to each button can be input to multi-all on & off after three multi-touches so that each button is recognized as the target button.

More specifically, for example,

1) When the button assigned to 'QWE' is single-touched and then single-on and off, that is, when the single-on and off single-touching starts, for example, the button assigned 'QWE' When it is off, the first character 'Q' of the button to which 'QWE' is assigned is input,

2) When the multi-all is turned on and off after the multi-touch is performed so that the button assigned to 'QWE' is recognized as the target button, that is, when the multi-all turns on and off starting with two multi-touches, for example, 'QWE' When the assigned button is touched by the index finger, the stop is touched at any point on the right side of the index finger, and if both the finger and stop are simultaneously turned off, the second letter 'W' of the button to which 'QWE'

3) If the multi-all is turned on and off after 3 multi-touches so that the button assigned to 'QWE' is recognized as the target button, that is, if the multi-all turns on and off starting with 3 multi-touches, for example, 'QWE' When the assigned button is touched by the index finger, and the stop and ring finger are touched at any point on the right side of the index finger. 3 After multitouch, if the index finger, stop finger and finger finger are all turned off at the same time, 'QWE' Quot; E " may be input.

According to this, the third character assigned to each button can be directly input by one touch action. 3 Even if it is a multi-touch, since the wrist or elbow is used only once, it can be said to be one touch act. However, the buttons in Fig. 11 are larger in size than the buttons in Fig. 7 or Fig. 8, so that there is no more error.

In the method of inputting the third letter in FIG. 11, one special character including a punctuation mark is additionally assigned to at least one button of the keyboard as shown in FIG. 8 in which two characters are assigned per one button It is possible to apply the present invention to a keyboard (not shown) having a button with three characters assigned thereto, so that the special character assigned to the third button for each button can be easily and quickly input without changing the character mode. This would be much more useful than in Figure 11.

On the other hand, in order to input 'S' in the keyboard layout shown in FIG. 4, when the button assigned 'PQRS' is multi-touched so as to be recognized as the target button and then multi-all turned on and off, For example, the button 7 assigned with 'PQRS' is necessarily touched by the index finger, and the stop, the fingerprint, and the fingerprint are touched at any point on the right of the index finger 4, , The stop, the ring finger, and the possession are all turned off at the same time, the fourth character 'S' of the button 7 can be inputted. In this case, the fourth character assigned to each button can be directly input by one touch action.

The input principle related to FIG. 8, FIG. 10, FIG. 11, or FIG. 4 above is shown in FIGS. 47, 48, 49, 50, 51, 52, 53, 54, 55, 57, 57, 58, 63, 64, 65, 66, and 67, two or three letters are assigned to each button. (For a further description of the above figures, please refer to the section " Brief Description of the Drawings ").

In particular, the Japanese language is made up of 50 notes. In order to implement the QWERTY keyboard, 50 buttons are required. In the past, since the English alphabet button requiring only 26 buttons is small, a lot of typos occur, It is impossible to implement a QWERTY keyboard in Japanese. However, as shown in FIG. 47, when two characters are assigned per one button, So that only 25 buttons exist, so that Japanese can be used as a QWERTY keyboard.

In the case of an Indian language, in the case of a keyboard of a mobile phone having a 12-keypad of a physical button among the conventional mobile phones, five characters are allocated per one button. Therefore, in a device having a touch screen including a smartphone, You will be able to enter characters in the way.

A method of inputting a pair of consonants at the time of Hangul input relating to Figs. 52, 53, 57, 58, 63, 64, and 67 will be described with reference to Fig. 57 , And it is easy to know that the same method or a similar method should be applied to the remaining drawings, so it will not be described separately.

In Fig. 57, different phonemes are mapped to the respective buttons as follows.

'A' and 'b', 'c' and 'd', 'ks' and' f ',' g 'and' o ',' g 'and' g ',' k 'and' 'And' ㅎ ',' a 'and' ㅑ ',' ㅓ 'and' ㅕ ',' ㅗ 'and' ㅛ '

(For reference, 40 Hangul phonemes are as follows.

14 consonant consonants: ㄱ ㄴ ㄷ ㅁ

Five consonants: ㄲ ㄸ ㅃ ㅃ ㅆ ㅆ

10 basic collections: ㅑ ㅑ ㅓ ㅗ ㅗ ㅛ ㅜ ㅠ ㅡ ㅣ

11 voices: ㅐ ㅒ ㅔ ㅔ ㅖ ㅖ ㅚ ㅟ ㅟ ㅘ ㅘ ㅝ ㅢ ㅢ ㅙ ㅞ)

A method of inputting 14 basic consonants and 10 basic vowels will be described with reference to FIG. 57 as described above. Therefore, the first phoneme assigned to each button is single- ), And the second phoneme assigned to each button is multi-all on and off (= multi-all on and off after 2 multi-touch) starting with 2 multi-touch You will already know that you can enter it,

To explain how to enter the 11 vowels, you already know that you can combine basic vowels.

There are two ways to enter the pair consonants: (The first method is not recommended and the second method is highly recommended.)

To explain the first method,

As shown in FIG. 9, when a shift button (= upward arrow) is pressed in most devices for inputting a pair of consonants in a device having a conventional Korean smartphone QWERTY keyboard, Is displayed, the displayed pair of consonants is subjected to a single touch and is then turned on and off singly,

As in the case of the conventional smartphone QWERTY keyboard, when the shift button is pressed (the shift button is not shown in FIG. 57, the shift button is added when the device is applied to an actual device, or the upward arrow on the bottom row of FIG. ),

If 'ㄲ' is displayed in the place where 'a' is assigned, 'ㄲ' is single-touched, then single on and off, 'ㄲ'

If 'ㄸ' is displayed on the place where 'ㄷ' is assigned, 'ㄸ' is single-touched, then single on and off, 'ㄸ'

When 'ㅃ' is displayed on the place where 'ㅂ' is assigned, 'ㅃ' is single-touched, then single on and off, 'ㅃ'

When 'ㅆ' is displayed on the place where 'ㅅ' is assigned, 'ㅆ' is single-touched, then single on and off, 'ㅆ'

If 'ㅉ' is displayed on the place where 'ゃ' is assigned, 'ㅉ' is single-touched, then single on and off, and 'ㅉ' can be input.

To explain the second method,

Like traditional Hangul input method in Samsung Electronics or Pantech's 12 keypad format,

The consonants that can be derived from the consonants of the basic consonants can be derived from the third multi-touch on the assumption that the second consonant is already assigned but not displayed, Multi-all on & off "),

It is assumed that 'ㄲ' is assigned to the third position of the button assigned 'a', so that the button allocated with 'ㄱ' is multi-touched after the button 3 is multi-touched, 'ㄲ'

It is assumed that 'ㄸ' is assigned to the third position of the button to which 'c' is assigned, and 'ㄸ' is inputted to the multi-all on and off after the button allocated with 'c'

It is assumed that 'ㅃ' is assigned to the third position of the button to which 'ub' is assigned, and 'ㅃ' is inputted to the multi-all on and off after the button assigned to '

It is assumed that 'ㅆ' is assigned to the third position of the button to which 'ㅅ' is assigned, and 'ㅆ' is inputted to the multi-all on and off after the button assigned to 'ㅅ'

It is considered that 'ㅉ' is assigned to the third position of the button to which 'ㅈ' is assigned, and 'ㅉ' can be inputted to the multi-all on and off after the button assigned to ' .

When Hangul is input in the second method, in the case of FIG. 63 or FIG. 64, and particularly FIG. 63, it is possible to input the likelihood as follows when inputting consonants.

1. It can be said that it is a more basic consonant of the basic consonants and the first, the second, the third, the fourth, the second, After single & off  Respectively,

2. The consonants of the basic consonants, which are more consonant consonants plus stroke, are assigned to the second order of each button, 2 Multi-touch  After the multi- Off  Is input,

3. Twin consonant  ㄲ, ㄸ, ㅃ, ㅆ, ㅉ are assigned to the 3rd order of each button, Three After touching the tee, Off  Can be input.

(If the consonant is assigned to a button to which a consonant can be derived from among the basic consonants, such as the button allocated to 'g' in FIG. 63, the consonant is assigned solely to the button, If the twin consonants can be assigned in the second order, including the case where the twin consonants are assigned in the second order, such twin consonants may be input as multi-all on and off after two multi-taps.

In other words, the basic vowel is assigned to each button as a complete type. In this case, the vowel sound is divided into consonant or vowel buttons 2, 3, or 4, and then the multi-all is turned on or off after the multi-touch is turned on or off, or the multi-all is turned on or off after the multi- And multi-all on and off method after multi-touch including the above. The above description will be understood by anyone skilled in the art, so that detailed description and drawings are omitted.

8, 10, 11, or 4, the input principle is not limited to the character input, but can be applied to the functional implementation of the function button as it is. In the conventional function button, only one function is displayed per one button. When two or more such functions are assigned to one button, the function is displayed and then, Or with the input principle associated with FIG.

For example, a one-character deletion function (= backspace function) is assigned to a function button as a first function of the function button, and a shift button function (an upward arrow) is assigned to a function button just below the button TUV in FIG. Is assigned to the second function of the function button, that is, when the two functions are assigned to the same button, a single character is turned on and off (after the single touch), the character deletion function is implemented and the function button becomes the target button (After multi-touch) multi-all on and off, the shift button function can be implemented.

By doing so, more functions can be implemented in buttons occupying the same space. In a conventional smart phone, even if a space is narrow and only a character input mode is considered, a button of course can not be arranged on a computer keyboard including a DEL button and an INSERT button.

In addition, two or more functions are assigned to one virtual button, and not only the functions required in the character input mode, but also the function of the execution icon on the touch screen screen of the smartphone, the tablet PC, the notebook, and the desktop PC are possible. The detailed description thereof will be omitted because it can be implemented by analogy with the above description.

Of course, it is also possible to implement the above-described functions by assigning common characters representing the functions and languages described above to the same button. For example, the one character deletion function (= backspace function) in the example in which the one character deletion function (= backspace function) and the shift button function (upward direction arrow) S (after single touch), the alphabet S is inputted and the multi-all on & off shift button function is implemented so that the function button becomes the target button (after multi-touch).

For reference, regardless of the target button recognizing method, any of the functions described above may be implemented depending on how the touch is made and the operation is performed after that.

For example, in a character input mode, there is a space (= space) which is most frequently used. When a space is input, a certain button is not used as a target button, 4) Multi-touch after multi-touch All can be turned on & on. Of course, when implementing general character input or function, it will be possible if you do not use multi all on & on signal after 4 multi touch.

Also, the above-described method can be applied to a conventional QWERTY keyboard as shown in FIG. 7 or FIG.

If the multi-touch is expressed in detail by n multi-touches, the specific sequence number is not determined as described above according to the value of n, but may be determined according to the value of n, that is, A specific character group may be matched so that at least one character of at least one character associated with the target button is included in the matched character group without changing the character mode.

For example, if the current character mode is in English lowercase mode,

1) Single on and off are used, lower case letters are input,

2) Even when the current character mode is the English lower case mode by using multi-on-off, the upper case letter is inputted without changing the character mode. That is, characters in other character modes corresponding to the current character mode can be input without changing the character mode.

For example, if the current text mode is in English lowercase mode,

When the button S is singly turned on and off, a small letter s is input. When the button S is multi-all turned on and off so that the button S is recognized as the target button, an uppercase letter S can be input even when the current character mode is the English lowercase letter mode.

The " specific character group " may be any one of the following character groups.

1) One character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to one of the various character modes in a conventional general mobile phone including a character group of a special character mode.

To further expand, it is possible to expand to:

3) A group of characters assigned to a specific line among the characters assigned to the same button.

4) A character group assigned to a second specific sequence number from the first specific sequence number to the second specific sequence number among the characters assigned to the same button (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned to or marked at a particular position among at least one character assigned to the same button.

Hereinafter, a method in which predetermined characters are input in addition to the characters assigned to the target button by the touch operation, will be described in which a method in which two or more characters are input by a single touch operation.

A method for inputting characters in an apparatus equipped with a touch screen,

In a case where after a keyboard is displayed on a touch screen, a specific button is operated after being multi-touched so as to be recognized as a target button,

The final operation of at least one of the final operations that may include nine behaviors including dragging in each direction of off, top, bottom, left, right (upper left, lower left, upper right, lower right) Or after the end of the last operation, including after the end of the last operation,

Multi-touch post-manipulation involving the final manipulation of at least one of the final operations that may include nine behaviors,

Belonging to a specific character group among at least one character group,

A first character, which is a specific character of at least one character associated with (or assigned to) the target button,

Regardless of the target button, a second character, which is at least one specific character promised for each final operation, is additionally input.

In addition, depending on the situation before the final operation, at least one of the at least one character belonging to the matched character group may be assigned to the target button without changing the character mode, Can be input with characters. When the number of characters assigned to the target button is two or more,

Depending on the situation before the final operation, the first character may also be selected.

First, I will explain the case of application to English keyboard. In FIG. 7 (or FIG. 60), an English QWERTY keyboard is exemplified, but it can be seen that only one character is displayed per button.

The post-touch operation is used on the English QWERTY keyboard shown in FIG. 7 (or FIG. 60) so that two or more characters can be input simultaneously by a single operation.

More specifically, one character including a specific vowel or a half vowel (or semi consonant) or a consonant is additionally input in addition to the character assigned to the target button, or a character including the suffix ING of the present progressive type and the suffix ED of the past type 2 Or more characters can be additionally input in addition to the character assigned to the target button.

In the following description, it is assumed that the target button is the button S and the button S is touched (single-touch or multi-touch) so as to be recognized as the target button and then dragged or off in four directions For example, a character other than the character assigned to the target button is additionally input as an example of inputting another character along with the character S through an operation to be performed.

First, in the case of multi-on-off or multi-all-dragging in four directions, an example will be described in which A, E, I, O, and U are additionally input in addition to the characters assigned to the target button.

(When the method of the present application is applied to a character except English, it corresponds to the pronunciation of [a], [e], [i], [o], [u] on the English pronunciation symbol in place of A, E, It is recommended that the characters be replaced with letters.)

For example, when the button S is multi-touched (e.g., FIG. 44), all of the five 'S + vowels' are popped up as shown in the left drawing of FIG. 13, One of SA, SI, SE, SU, or SO may be input. (Of course, popups may be omitted.) All of the popups in this document can be omitted altogether.)

More specifically, in a state where all the five 'S + vowels' are popped up by multi-touch, a desired 'S + vowel' can be input by multi-dragging in a direction in which a desired 'S + vowel' is located. If the desired 'S + vowel' is located at the center, all the fingers are turned off without a drag, and as a result, the multi-all on and off and the centered 'S + vowel' can be input.

 At this time, instead of SE, SI, SO, and SU as shown in the right diagram of FIG. 13, only E, I, O, U may be displayed as shown in the right drawing of FIG.

For example, as shown in FIG. 13, after the button S is multi-touched (for example, FIG. 44) by the detection and stop so that the button S is recognized as the target button,

1) When 'Multi-all on & off', A is input in addition to S assigned to the target button, that is, SA is inputted,

2) When 'multi-all-dragging' is performed to the upper side, I is additionally inputted together with S assigned to the target button, that is, SI is input,

3) When 'multi-all-dragged' to the right (for example, FIG. 62), E is additionally inputted together with S assigned to the target button, that is, SE is input,

4) If 'Multi-All Drag' is performed to the lower side, U is further input together with S assigned to the target button, that is, SU is input,

5) If 'Multi-All Drag' is performed to the left side, 'O' can be additionally input with SO assigned to the target button, that is, SO can be input.

If the button S is multi-touched, the five S + vowels are popped up as shown in the left drawing of FIG. 13, SI, SE, SU, or SO may be input in such a manner that all the fingers are turned off and the desired 'S + vowel' is selected as the touch (e.g., single touch) In this case, instead of SE, SI, SO, and SU as shown in the right diagram of FIG. 13, only E, I, O, U may be displayed as shown in the right drawing of FIG.

Of course, a method of notifying the user of what additional characters are input in accordance with the on-off and drag directions may be a method other than the pop-up method of the method shown in Fig. 13, And may depend only on memorization of.

In the present invention including the above embodiment, in the method in which specific characters are additionally input along with the characters assigned to the target button, it is noted that the characters to be further input are not assigned to the target button. It can also be described in terms of being assigned. But this is a matter of perspective, and it has nothing to do to understand our principles. For example, A, E, I, O, and U, which are additionally input with the S assigned to the button S, which is the target button in the above, include those regarded as the second to sixth assigned characters to the button S It is also possible to say that one of the characters of the second to sixth characters is additionally inputted together with the first character assigned to each button by the operation after the touch of the second touch. This also applies to the embodiment in which specific characters are additionally input with the characters assigned to the target button, which will be described later.

On the other hand, since the method used in almost all the QWERTY keyboards, which is a method in which only the characters assigned to the target button are inputted with the single on-off, is not applied,

E, I, O, and U are input in addition to the characters assigned to the target button in the case of single-on / off or single-dragging in four directions.

In the state where all five 'S + vowels' are popped up by a single touch, a desired 'S + vowel' can be input by dragging in a direction in which a desired 'S + vowel' is located. If the desired 'S + vowel' is located at the center, the finger can be turned off without dragging and the centered 'S + vowel' can be input.

As a specific example, after the button S is single-touched to the index finger (so that it is recognized as the target button)

1) When the single is ON and OFF, A is further input together with S assigned to the target button, that is, SA is inputted,

2) When 'Single Drag' is made to the upper side, 'I' is further input together with S assigned to the target button, that is, SI is input,

3) When 'single dragging' to the right, E is additionally input together with S assigned to the target button, that is, SE is inputted,

4) If 'Single Drag' is performed to the lower side, U is further input together with S assigned to the target button, that is, SU is input,

5) When 'single drag' to the left, it is possible to input O in addition to S assigned to the target button, that is, SO.

On the other hand, it is not recommended because it is a method that can confuse the user because the number of multi-touched fingers in the on-off method and the drag method is inconsistent. However, a drag is applied to a single drag, As an embodiment in which multi-on-off is applied,

1) In a state where all four 'S + vowels' are popped up by a single touch, a desired 'S + vowel' is input by dragging in a direction in which a desired 'S + vowel'

2) If the desired 'S + vowel' is located at the center, it can be entered as multi-all on & off.

As a concrete example,

1) When the multi-all is turned on and off after the button S is recognized as the target button and two multi-touches (for example, as shown in FIG. 44) are performed by sensing and stopping, A is further input together with the S assigned to the target button. Is input,

2) When the button S is single-touched to the index finger and then 'single-dragged' to the upper side, I is further input together with the S assigned to the target button, that is, SI is input,

3) When the button S is single-touched to the index finger and then 'single-dragged' to the right, E is further input together with the S assigned to the target button, that is, SE is input,

4) When the button S is single-touched to the index finger and then 'single-dragged' downward, U is further input together with the S assigned to the target button, that is, SU is input,

5) When the button S is single-touched to the index finger and then 'single dragged' to the left, it is possible to input O in addition to the S assigned to the target button, that is, SO.

For reference, there are three ways to allocate additional positions for A, E, I, O, U with S so that they can be easily memorized. Other methods are possible.

As a first method, a method referring to Fig. 14 will be described.

This method is also the method which has been applied to the above-mentioned embodiments as the most recommended memorizing method.

1) Since A is the most used vowel, it is centered,

2) I is assigned to the top because it is standing vertically,

3) E is assigned to the right because the right side of the character is erased,

4) U assigns U to the bottom of the word (or I, with one vertical line at the top because U is the first spelling of the word Under)

5) Since O is the shape of a human mouth, it can be assigned to the left.

However, since this is merely an example, the positions of A, E, I, O, and U, which are additionally input with S, may be assigned differently from the above. This also applies to the following methods.

For example, O is assigned to the bottom because it is the shape that is in the center, and it is also possible to assign U to the left.

As a second method, in another example, according to the pronunciation order in the vocal practice, 1) A is assigned to the center in the order of A, E, I, O and U, 2) clockwise from the top, E I to the left, O to the bottom, and U to the left.

As a third method, a method which is not very recommended,

1) Since O is in the shape of a center, it is assigned to the center,

2) I is assigned to the top for the same reason as the first method,

3) E is assigned to the right for the same reason as the first method,

4) U is assigned to the bottom for the same reason as the first method,

5) The remaining A can be assigned to the left.

As a fourth method, a method not recommended very much,

1) Since O is in the shape of a center, it is assigned to the center,

2) I is assigned to the top for the same reason as the first method,

3) E is assigned to the right for the same reason as the first method,

4) A with a shape like a pedestal or pointed top that is well balanced in the left and right is placed on the lower side,

5) The remaining U can be assigned to the left.

Hereinafter, input words will be described in detail, for example.

15 is a diagram provided for explaining a process of inputting the English word " SAME ". The input of the English word "SAME" is possible by the process of sequentially inputting "SA" and "ME"

For example,

1) After the button S is recognized as the target button and the button is multi-touched 2 times by sensing and stopping, when 'Multi-all on & off' is performed, A is further input together with the S assigned to the target button,

2) When the button M is multi-touched by sensing and stopping so that the button M is recognized as the target button and then 'multi-all-dragged' to the right side, E can be further input, that is, ME can be inputted together with the M assigned to the target button.

Fig. 16 is a diagram provided for explaining the process of inputting the English word " BEAUTIFUL ". The input of the English word "BEAUTIFUL" is a process of sequentially inputting "BE", "AU", "TI", "FU", "L"

For example,

1) When the button B is multi-touched by the sensing and stopping so that the button B is recognized as the target button and then 'multi-all-dragged' to the right side, E is further input together with B allocated to the target button,

2) If the button A is recognized as the target button by two multi-touches by sensing and stopping and then 'multi-all-dragged' to the lower side, U is further input together with A allocated to the target button,

3) When the button T is multi-touched by sensing and stopping so that the button T is recognized as the target button and then 'multi-all-dragged' to the upper side, I is further input together with the T assigned to the target button,

4) If the button F is recognized as the target button by two multi-touches by sensing and stopping and then 'multi-all-dragged' to the lower side, U is further input together with F assigned to the target button, that is, FU is input,

5) Button L can be turned on and off singly and L can be input.

15 and 16, according to the character input method according to the present embodiment in which representative vowels A, E, I, O, and U can be input simultaneously with the characters assigned to the target button, It can be assumed that it can be significantly accelerated.

The button may be more useful on a Tablet PC QWERTY keyboard like Figure 60, where the problem of cursor misalignment is minimal.

In the above description, the letters A, E, I, O, and U are additionally input along with the characters assigned to the target button, but this is merely an example for convenience of explanation, .

That is, characters other than A, E, I, O, and U including semi-vowels, semi-consonants, and consonants may be additionally input along with the characters assigned to the target button.

If the number of buttons is smaller than all the alphanumeric characters used in the 3X4 type, 4X4 type or 5X4 type keyboard, the frequently used alphabets are displayed on the touch buttons, and the less frequently used characters are displayed by touch operation So that they can be input together.

On the other hand, a vowel is additionally input with the character assigned to the target button by the multi-touch post-operation, and the consonant is used together with the character assigned to the target button by the single-touch post-operation. It is preferable that the other consonants input together by the single touch operation are composed of consonants having a high frequency of use.

T, S, N, R, H, D, L, and C are frequently used consonants in alphabetical order.

And, for example, as in the above-described embodiment

In the case of 'Multi All On & Off' and 'Multi All Drag', A, E, I, O and U are input together with the characters assigned to the target button,

In the case of 'single drag', T, S, N and R are inputted together with the character assigned to the target button,

When multi-all is dragged after a single touch, H, D, L and C are inputted together with the characters assigned to the target button,

When the finger is dragged based on the multi-pick all, W and Y are inputted together with the character assigned to the target button,

Multi-Sized All Sight When a finger is dragged, it is possible to input? (Question mark),. (Dot), (comma), or! (Exclamation point) .

That is, it is possible to change the input character group with the character assigned to the target button by changing the operation method after the touch, without changing the setting of the device.

In other words, it can be said that the specific character group to be input is matched according to the state before the final operation without changing the character mode.

That is, it can be said that a specific character group among at least one character group is matched according to the situation before the final operation, and the characters of the matched character group are input without changing the character mode.

First, in the case of 'single drag', an example will be described in which T, S, N, and R are additionally input in addition to the characters assigned to the target button.

For example, as shown in FIG. 17, after the button S is 'single-touched'

1) When the index finger is 'single dragged' to the left, T is further input together with S assigned to the target button, that is, ST is input,

2) When the index finger is 'single dragged' downward, S is added to the target button together with S, that is, SS is input,

3) When the index finger is 'single-dragged' to the upper side, N is further input together with S assigned to the target button, that is, SN is input,

4) When the index finger is 'single dragged' to the right side, it is possible to input R in addition to S assigned to the target button, that is, SR.

18, it is possible to easily memorize how characters to be additionally inputted along with the characters assigned to the target button vary according to the drag direction.

Now, in the case of multi-all dragging after single touch, an example will be described in which H, D, L, and C are additionally input in addition to the characters assigned to the target button.

For example, as shown in FIG. 19, in a state in which the touch state of the detection for a predetermined time (for example, 0.1 second) is maintained after the button S is 'single-touched' Touches the right side of the touched portion to the right, and then performs multi-touching so that the button S is recognized as the target button,

1) When the detection and stop are multi-dragged to the upper side, H is further input together with S assigned to the target button, that is, SH is input,

2) If the detection and stop are multi-dragged to the right side, D is added with S assigned to the target button, that is, SD is input,

3) When the detection and stop are multi-all dragged to the lower side, L is additionally input together with S assigned to the target button, that is, SL is inputted,

4) If the detection and stop are multi-all dragged to the left, SC can be input so that C is additionally input with S assigned to the target button.

20, it is possible to easily memorize how characters to be additionally input along with the characters assigned to the target button vary according to the drag direction.

(S should be indicated at the center of FIG. 20, but it is mistakenly written as I, so please change it.)

Now, in the case where the multi-nor all finger is dragged, an example will be described in which W and Y are input in addition to the characters assigned to the target button.

For example, assuming that the index finger is recognized as the reference finger when the index finger is recognized as the index finger when the index finger 2 is multi-touched with the right index finger,

As shown in Fig. 22, after the button S is two-multi-touched by the detection and stop so as to be recognized as the target button, only the stop as the good reference finger is turned off,

1) When the detection finger is dragged to the right, Y is additionally input together with S assigned to the target button, that is, SY is input,

2) When the index finger is dragged to the left, SW can be inputted so that W is additionally inputted together with S assigned to the target button.

23, it is possible to easily memorize how characters to be additionally input along with the characters assigned to the target button vary according to the drag direction.

Now, if you are dragging your fingertip with a multi-not all-good fiducial, you can enter the frequently used special characters "? (Question mark),. (Dot),, (comma),! For example,

For example, assuming that the index finger is recognized as the reference finger when the index finger is recognized as the index finger when the index finger 2 is multi-touched with the right index finger,

As shown in Fig. 21, in a state where the finger S is detected as the target button and two multi-touched by the detection and stop, only the detection as the reference finger is turned off, and the touch state of the stop as the good reference finger is maintained,

1) When the stop is dragged upward, a? (Question mark) is additionally input with S assigned to the target button, that is, S?

2) When the stop is dragged to the right, a. (Point) is additionally input together with S assigned to the target button, that is, S. is input,

3) When the pause is dragged to the left, a (comma) is input in addition to the S assigned to the target button, that is, S, is input,

4) When the index finger is dragged downward, it is possible to input an! (Exclamation mark), that is, S !, together with the S assigned to the target button.

The multi-touch post-operation including "single-touch-drag" or "multi-touch-post-drag" is used so that the number of characters input to the target button together with the character assigned to the target button in the 'target button' Or more.

For example, it is possible to implement such that the number of characters to be additionally inputted together with the character assigned to the target button is determined depending on whether the touch before dragging is single or multi-touch.

More specifically, for example, in the case of 'single-touch-drag', the number of characters to be input together with the character assigned to the target button is one, and in the case of 'multi-touch and drag' And the number of additional input characters is two or more.

On the other hand, if the character is dragged briefly after touching, the number of characters to be input with the character assigned to the target button is set to one, and when the character is dragged after touching, Respectively.

For example, after the button S is multi-touched by the detection and stop so as to be recognized as the target button,

1-1), the 'I' is additionally input together with the S assigned to the target button, that is, the SI is input,

1-2), 'II' (or 'ING') is additionally input together with the S assigned to the target button, that is, SII (or SING) is input,

2-1) When multi-all is dragged to the right side, 'E' is additionally inputted together with S assigned to the target button, that is, SE is input,

2-2) When multi-all is dragged to the right side, 'EE' or 'ED' (past type suffix) is additionally input together with S assigned to the target button, that is, SEE (or SED)

3-1) When multi-all is dragged to the left side, 'O' is additionally inputted together with S assigned to the target button, that is, SO is inputted,

3-2) When multi-all is dragged to the left side, 'OO' (or 'ON') is additionally inputted together with S assigned to the target button, that is, SOO (or SON)

4-1) When the multi-all is dragged downwardly, 'U' is additionally inputted together with S assigned to the target button, that is, SU is input,

4-2) When multi-all is dragged downward, it is possible to input 'UU' (or 'US'), that is, SUU (or SUS), together with the S assigned to the target button.

On the other hand, it is also possible to drag two or more times in succession in the same direction, or to change the direction of dragging so that the characters are continuously input every time they are dragged.

For example, in the case where characters to be input in addition to the characters assigned to the target button in accordance with the drag direction are as shown in Fig. 13,

1) When the button S is multi-touched by the detection and stop so that the button S is recognized as the target button, and when the detection and stop are multi-dragged rightward, 'SE' is input as shown in [1]

2) Even if 'SE' is input, 'E' is further inputted when the detection and stop are not turned off and multi-all is once again dragged to the right side. As a result, 'SEE' And,

3) When 'SE' is inputted and then multi-all is dragged to the left without turning off detection and stop, 'O' is further input, and as a result, 'SEO' is inputted as [4]

4) After the input of 'SE', detection and stop are not turned off but multi-all is dragged downward and then multi-all is dragged to the left, 'U' and 'O' It is also possible to implement 'SEUO' as input.

On the other hand, when a plurality of characters are assigned to the same button as in the keyboard including the 3X4 keyboard layout as shown in FIG. 3 or FIG. 4, other characters (e.g., A, E, I , O, U) are further input,

Depending on the method of operation, it may be possible to determine what characters are assigned to the target button to be input with other characters (e.g., A, E, I, O, and U).

For example, in the case of a button in which 'J, K, L' is assigned to button 5 in FIG. 4,

 So that the button 5 assigned 'J, K, L' together can be recognized as the target button

1) A, E, I, O, and U can be additionally input with the J assigned first to the target button on the principle similar to the above-described embodiments by the single on-off and the single-

2) Multi-all on and off and multi-all dragging in four directions, so that A, E, I, O, U can be additionally input with K assigned second to the target button on a similar principle to the above embodiments and,

3) A, E, I, O, U with the L assigned third to the target button on a principle similar to the above embodiments with multi-nathool reference finger on-off and 4-way multi- It may be further input.

Also in this case, a specific character group among at least one character group is matched in accordance with the situation before the final operation, and the character of the matched character group is. It can be said that it is inputted without changing the character mode.

On the other hand, it is also possible to realize the effect of being combined with such a button without using a button for inducing a combination with other buttons such as a shift button, a control button, and an alt button.

For example, after the button S of Fig. 7 (or Fig. 60) is multi-touched by the detection and stop so that the button S is recognized as the target button (e.g., Fig. 44)

1) When the detection and stop are 'multi-all-dragged' to the upper side, 'control + S' is inputted, that is, the effect of pressing the button S while pressing the control button is exerted,

2) When the detection and stop are 'multi-all-dragged' to the right, 'Alt + S' is inputted, that is, the effect of pressing the button S while pressing the Alt button is exerted,

3) When the detection and stop are 'multi-all-dragged' to the lower side, 'shift + S' is inputted, that is, the effect of pressing the button S while pressing the shift button can be exerted.

It is possible to implement another character (e.g., a vowel) in addition to the character assigned to the target button (e.g., consonant), so that the target button is operated after the single-touch operation or the multi-touch operation so that the target button is recognized in Korean.

For example, in the same character mode including the conventional Hangul QWERTY keyboard as shown in FIG. 9 (or FIG. 61), in a keypad in which most of one character is assigned to each button, the button ' After being single-touched,

1) Upward, '' 'and' ㅗ 'are additionally input to the target button, and as a result,' Joe 'is input,

2) When a single drag is performed to the right side, 'a' assigned to the target button and 'a' are further input, resulting in '

3) When a single drag is performed to the lower side, 'T' and 'T' are additionally input to the target button and 'Week' is input as a result,

4) When a single drag is performed to the left side, '' 'and' ㅓ 'added to the target button are further input, and as a result,' Low 'can be inputted.

(In order to recognize the button 'ㅔ' and the button 'ㅣ' as the rightmost button in Fig. 9 as a target button at the time of multi-touch, in most cases, It would be better if there was plenty of free space.)

Then, for example, in the conventional Hangul QWERTY keyboard as shown in FIG. 9 (or FIG. 61), after the button 'X' is multi-touched by the detection and stop so as to be recognized as the target button,

5) When multi-all is dragged to the upper side, '' 'and' ㅛ 'are additionally input to the target button,' jog 'is input as a result,

6) When multi-all is dragged to the right side, '' 'and' ㅑ 'are additionally input to the target button,' ja 'is input as a result,

7) When multi-all is dragged to the lower side, 'ㅠ' and 'ㅠ' are additionally input to the target button, 'joo' is input as a result,

8) When multi-all is dragged to the left side, '' 'and' ㅕ 'are additionally input to the target button, so that' Ji 'can be inputted as a result.

Here again, it can be said that a specific character group among at least one character group is matched according to the situation before the final operation, and the characters of the matched character group are inputted without changing the character mode.

On the other hand, even in a case where a plurality of characters are assigned to the same button as in the case of the keyboard of the sky as shown in Fig. 12, which is one type of the conventional Hangul 3X4 keyboard, the number of fingers at the time of touching and the kind of post- ,,,,, ㅛ, ㅑ, ㅠ, ㅕ 'can be additionally input together with the respective consonants assigned to the sentence.

That is, when a plurality of characters are assigned to the same button, other characters (for example, 'ㅗ, ㅏ, ㅜ, ㅓ, ㅛ, ㅑ, ㅠ, ㅕ' In inputting,

By the number of fingers at the time of touch and the operation method, it is possible to determine what character is assigned to the target button to be input together with other characters (e.g., 'ㅗ, ㅏ, ㅜ, ㅓ, ㅛ, You may.

For example, in the case of a keyboard in which the Hangul input method as shown in FIG. 12 is applied, only 'Yi' and 'Ji' are displayed on the button 9, but 'Yi, Ji, . In the case of the buttons assigned with 'i', 'd' and 'u', the buttons assigned with 'i', '

1) Four dragging in four directions and multi-dragging in four directions, as in the above embodiment, the eight vowels "ㅗ, a, ㅜ, ㅓ, ㅛ, ㅑ, ㅠ, ㅕ" And,

2) Four-way multi-nathole By dragging the fingers and touching the four directions in a single direction, you can drag the multi-nathall finger by dragging '8', '8,', '8' Additional vowels are entered,

2) 4-way multi-sick all-good criteria After dragging the fingers and touching the single direction in 4 directions, the multi-sick all-good fingers drag the ' May be further input.

Here again, it can be said that a specific character group among at least one character group is matched according to the situation before the final operation, and the characters of the matched character group are inputted without changing the character mode.

In addition, another operation method including an operation of dragging the other vowels except for the above eight vowels among the 21 Korean vowels can be used to input the consonant assigned to the target button and another vowel together.

For example, when 'dragging long', 'short dragging', you can input the additional vowel to which 'ㅣ' is added. Specifically,

1) When a single drag is performed to the right side shortly, 'a' is input. When a single drag is performed to the right side, 'ㅐ' is further input together with the consonant assigned to the target button,

2) 'ㅓ' is displayed when a single dragging is performed to the left side, and 'ㅔ' is displayed when a single dragging is performed to the left side, together with the consonant assigned to the target button,

3) When the single dragging is performed shortly on the upper side, 'ㅗ' is input and when the single dragging is performed to the upper side, 'ㅚ' is further input together with the consonant assigned to the target button,

4) In the case of single dragging shortly to the lower side, 'T' is dragged downward. When the dragging is single long, 'J' is further input together with the consonant assigned to the target button,

5) 'ㅑ' is dragged when a multi-all is dragged to the right side, 'ㅒ' is dragged when a multi-long drag is long to the right,

6) When the multi-all is dragged to the left side, 'ㅕ' is dragged to the left, and when the multi-drag is long to the left, 'ㅖ' can be further input together with the consonant assigned to the target button.

In addition, in the above-described English input embodiment, a method of continuously dragging two or more times in succession in the same direction, or changing the drag direction, so that characters are continuously input every time the dragging is applied can be applied to Hangul.

For example, after the consonant button is recognized as the target button, it is possible to combine the two operations and input two vowels together.

More specifically, for example, when the button 'C' is detected as a target button by a single touch or by multi-touching by sensing and stopping (when a single drag is performed next, it is regarded as a single touch, , It can be regarded as multi-touch)

1) After 'ㅗ' is selected as 'Single Drag' on the upper side, 'Single Drag' is selected to the right side without continuing from the position of the finger and the finger is not turned off. Quot; left " is input,

2) After selecting '' 'as' single drag' to the bottom, 'finger drag' and 'ㅓ' are selected on the left side of the finger without turning off the finger. Quot; is inputted, and as a result,

3) After 'ㅗ' is selected as 'Single Drag' on the upper side, 'ㅐ' is selected as long as 'single drag' Quot; is input, and as a result, "

4) After 'ㅜ' is selected as 'single drag' to the lower side, 'ㅔ' is selected as long as 'single drag' Can be input, and as a result, '줴' can be input.

The Hangul collection consists of 10 basic vowels (11 vowels) and 11 vowels (21 vowels, total vowels, total vowels, and vowels).

In the above embodiments, among the total of 21 vowels, the vowels other than 'ㅡ', 'ㅣ' and 'ㅢ' are inputted together with the consonants assigned to the target button.

In case of inputting 'ㅡ', 'ㅣ', and 'ㅢ', a separate button for 'ㅡ' and 'ㅣ' should be prepared separately and a combination of 'ㅡ', 'ㅣ', and 'ㅡ' Can be input, but it is also possible to assign a separate operation method for inputting '?', '?', And '?'.

For example, since the Hangul input embodiment so far uses only drag and on and off are not used, it is now tried to use on & off,

For example, after two multi-touches are performed with the detection and stop so that the consonant button 'C' is recognized as the target button,

1) In the case of 'multi-all on & off', 'v' and 'v' assigned to the target button are additionally input, resulting in '

2) In the case of 'multi-not all reference finger ON & OFF', 'V' assigned to the target button is additionally input with a 'V', and as a result,

3) In the case of 'multi-not all good fingers on and off', 'v' assigned to the target button and vowel 'ㅢ' are further input, so that 'び ㅣ' can be input as a result.

The character input method described so far is applicable to languages other than the languages mentioned. For example, it is applicable to Greek / Roman, Cyrillic, Arabic, Southeast Asian, Indic, Thai, English, French, German, Spanish and so on.

In the above embodiments, only dragging in four directions of up, down, left, and right in the drag direction has been described, but if the direction is subdivided, more work is possible. For example, when dragging in the direction of the lower right (south), lower left (southwest), upper right (northeast), and upper left (north) directions is added, more characters can be assigned to one button or various operations can be performed.

As well as,

Depending on the drag length, you can drag the drag briefly,

Depending on the direction of the drag, you can subdivide the drag into a straight drag, a drag back, or a shape drag,

Multi-Sick All-Good Finger On & Off, Multi-Sick All-Sick By using various manipulations including finger dragging, more work is possible.

4. How to manipulate objects

Up to now, a description has been given of a case where a character is input by a post-touch operation. Hereinafter, a method used in a character input method will be used to describe in detail how a object such as a photograph, a picture, a browser, a window, and the like is operated.

Also in this embodiment, among the various multi-touch post-manipulation methods, a method of recognizing a target button by a reference finger is used. In this embodiment, the leftmost (= first leftmost) finger among multi- As shown in Fig. More specifically, it is assumed that the multi-touch is performed by using the detection and stop, and a method in which the detection is recognized as the " reference finger ".

According to the method described below, it is not possible to predict the exact position of the active region boundary of the object when the object is activated, such as a star shape, Can be transformed into an object shape including zooming without having to activate the object after the object (or the active area of the object) is multi-touched so that the object (or the active area of the object) becomes the target button even if the finger is difficult to multi- Do.

Conventionally, when the thumb and index finger are multi-touched to the object and then the thumb and index finger move in the direction in which the thumb and index finger move together, the object becomes small and when the thumb and index finger move in the direction of opening the thumb and index finger, This method is commonly used in smartphones including Apple's iPhone, but it has the disadvantage that the size of the object is enlarged or reduced only while maintaining the ratio of the object's width to height.

If you want to change only the width or height only without maintaining the ratio between the width and height of the object, you need a step where the object is clicked and the object is activated as a preparation step for transforming the shape of the object .

However, according to the present invention, after the object (or the active area of the object) is multi-touched to be the target button, the shape of the object can be changed by 'multi-touch operation and manipulation' Multi-touch can be used to transform the shape of an object.

The phrase " activation region of an object " is used herein.

According to the method of the present invention, such a phrase is used even though the process of activating the object is not required. The phrase " activation area of an object " in the present application does not refer to an area within an activation area boundary of an object in a state where the object is actually activated, but reminds a method of deforming the shape of the object after the object is activated Refers to an area within the activated area boundary, that is, an area within the active area boundary of the object when the object is assumed to be activated.

And the term "object area" refers to the area occupied by the object. The size of the object area will be less than the size of the active area of the object, unless there is a difference. Referring to FIG. 39, it can be assumed that the object region exists in the active region of the object.

In addition, there are many cases in which the object area can be abbreviated as an object.

Therefore, even if the point outside the object area and still inside the active area of the object is multi-touched, in order for the shape of the object to be transformed without requiring the activation step of the object, The object is set to be activated even when the object is multi-touched so as to be recognized as the target button, the object is recognized as being multi-touched by the user in order to transform the shape of the object, and the shape of the object must be transformed by a subsequent operation . When the object region is multi-touched so as to be recognized as the target button, it is naturally recognized by the device that the shape of the object is changed by the user to be multi-touched, and the shape of the object should be transformed by a subsequent operation.

Since the multi-touch signal required for implementing the method of the present invention is different from that of the conventional method, the multi-touch signal may be used in parallel with the conventional method. In addition, since the size of the object is too small, the object can not be multi-touched. Therefore, an object that can not be enlarged or reduced by the conventional multi-touch zooming method can not be actually multi-touched , So that the object is multi-touched so that it can be recognized as a target button, such that the object can be enlarged or reduced. Since the size of the object is too small, the object can not be enlarged in the diagonal direction by the method in which the object is enlarged after the object is activated by the conventional mouse. The object is enlarged in the diagonal direction The object that can be made can also be magnified in the diagonal direction directly by the method of the present invention.

(Here, the conceptual description of the directions is given in the section entitled " Method of inputting characters on the touch screen ", and also in the field to which the present application is applied, Can be selected and applied.)

As for the vertical direction including the upper and lower sides, which are words used in the following description, there is no user who can drag in the perfect vertical direction including the perfect upper side and the perfect lower side in the user's standpoint, When the user recognizes the intended drag direction, the trajectory actually dragged by the user is close to a straight line within a predetermined constant curvature range, completely parallel to a vertical line (= a straight line parallel to the Y axis) But if it is parallel to the set range, it is judged by the device that the user has attempted to drag in the perfect longitudinal direction including the perfect upper side and the perfect lower side, and judges that the drag performed by the user is perfect vertical direction including perfect upper side and perfect lower side Including the upper and lower sides, Direction.

As for the horizontal direction including left and right words used in the following description, there is no user who is able to drag in a perfect horizontal direction including a perfect left side and a perfect right side in the case of a user, From the standpoint of the device, when the user recognizes the intended drag direction, the trajectory actually dragged by the user is close to a straight line within a predetermined constant curvature range, completely parallel to a horizontal line (= straight line parallel to the X axis) But is parallel to the set range, it is determined by the device that the user has attempted to drag in the full horizontal direction including the complete left, complete right, so that the drag performed by the user is considered to be perfectly vertical, including perfect top, perfect bottom Including the judged upper and lower sides It means the direction.

The diagonal directions including the upper left side, lower left side, upper right side and lower right side, which are words used in the following description, refer to diagonal directions including the lower right side and the lower right side. When the user recognizes the drag direction intended by the user, , Left, and right direction. Thus, the diagonal direction means not only one of the precise one direction such as the upper side, the lower side, the left side, and the right side, but a range that is an aggregation of directions other than the upper side, lower side, left side and right side. For example, even if only the upper right side is used, the direction of the upper right side of various angles within the range of 0 to 90 degrees including the angles with the X axis of 10 degrees, 30 degrees, 45 degrees, 60 degrees, and 80 degrees . So there can be no perfect upper left, perfect lower left, perfect upper right, perfect lower right.

However, depending on the setting, the diagonal direction may also be set to mean only one direction, such as upward, downward, left, or right. For example, the upper right direction determined by the device may be set to mean only the 45-degree direction with respect to the X-axis. That is, even if the direction dragged by the user is an upper right side direction among the upper right side direction of a certain range, the device may be set to determine the angle with respect to the X axis to the upper right direction of 45 degrees. In this case, there could be perfect upper left, complete lower left, perfect upper right, and perfect lower right. However, from the viewpoint of the user, there is no user who is capable of dragging in a perfect diagonal direction including the perfect upper left side, the perfect lower left side, the perfect upper right side, and the perfect lower right side, When the drag direction is recognized, the locus actually dragged by the user is close to a straight line within a predetermined curvature range, and the angle between the horizontal line (= straight line parallel to the X axis) is completely 45 degrees or completely 45 degrees If it is not, but within 45 degrees of the set range, it is judged by the device that the user has attempted to drag in a perfect line direction including the complete left upper side, the perfect left lower side, the perfect right side, and the perfect right side Drag is perfectly left upper side, perfect left lower side, perfect upper right side, perfect lower right side Means the diagonal direction including the upper left side, the lower left side, the upper right side, and the lower right side judged to be the complete diagonal direction inclusive.

The predetermined range when the upper, lower, right, left, upper left, lower left, upper right, and lower right sides are judged may be considerably small or considerably large depending on the currently determined direction number.

In the following description of the "1)" method, only the upper and lower directions need only be distinguished. However, in this embodiment, it is not necessary to cover the upper left side and the upper right side as well as the upper left side , A certain range determined on the upper side as shown in FIG. 46 (c) may be set to a range of 180 degrees on the upper side with respect to the hit point, and a certain range determined on the lower side may be set to a range of 180 degrees downward with respect to the hit point .

There is an example in which the upper, lower, left, right, upper left, lower left, upper right, and lower right sides are judged to be judged in the description of the second and third methods described later, In the case where the diagonal direction is not limited to only one specific direction such as the upper side, the lower side, the left side, and the right side, but a range that is an aggregation of directions other than the upper side, the lower side, the left side, As shown in the drawing, it is recommended that the angular range be set small (for example, every 10 degrees) in a certain range of the upper side, the lower side, the left side, and the right side and the diagonal direction including the upper left side, lower left side, upper right side, It is recommended that the range be set to a large setting (for example, 80 degrees). For example, if the diagonal direction is set to mean only one accurate direction such as the upper side, the lower side, the left side, and the right side, for example, even if the direction dragged by the user is an upper right direction out of a certain upper right side direction, The upper, lower, left, right, upper left, lower right, upper right, and lower right sides are all set as shown in FIG. 46 (b) It is recommended that the angle be set to 45 degrees so that the 360 degree direction is divided.

In the second method, the upper, lower, left, and right and diagonal directions are distinguished from each other. However, in the diagonal direction, the upper left, lower right, upper right, and lower right sides are distinguished However, since the upper, lower, left, and right sides should be separated, the diagonal direction should be divided into upper left side, lower left side, upper right side, and lower right side)

Since it is not necessary to distinguish the diagonal directions including the upper left side, the lower left side, the upper right side, and the lower right side, while it is a method that only upper, lower, left, When the direction determined by the user is only one direction, for example, upward, downward, left, right, and so on, for example, even if the direction dragged by the user is the upward direction in the upper direction of the certain range, When it is set to judge in the upward direction, it is recommended that the upper, lower, left, and right ranges are all set to be in the 90 degree angle range and the 360 degree direction is set to be divided as shown in FIG. 46 (d).

We will describe three methods of transformation of various objects by the method of this paper, 1), 2), 3).

 1) the object is enlarged when dragged in at least one first specific direction after being multi-touched so that the active area of the object (or object) becomes the target button (= target object or target active area) Dragging is a way to shrink.

For example, after the index finger is recognized as the reference finger and the detection area and the stop area are used so that the active area of the (object or) object is the target button (= target object or target active area)

When the detection and stop are multi-all-dragged in the upward direction, the ratio of the horizontal length to the vertical length of the object is enlarged and enlarged as shown in Fig. 26 to Fig. 37, and when the detection and stop are multi-dragged in the downward direction (FIG. 37 to FIG. 26), it is possible to make the object to be reduced such that the ratio of the horizontal length to the vertical length is maintained (naturally, the upper side is replaced with the right side, The upper side may be mixed with the same result as the right side, and the lower side may be mixed with the same result as the left side.)

It is a method that can be enlarged or reduced without changing the center point position of the object.

2) When the object (or the active area of the object) is multi-touched and dragged so that it is recognized as the target button, only the width of the object (or the active area of the object) And the length and the vertical length are enlarged or reduced together.

To be more specific,

When the object to be deformed (or the active area of the object) is multi-touched so as to be recognized as the target button and starts to be dragged, the direction to be dragged (as judged by the device) , Right direction, or left direction,

When dragged in the first specific direction of the horizontal direction, the vertical length is not changed, the horizontal length is enlarged,

When dragged in the second specific direction of the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,

When dragged in the first specific direction of the vertical direction, the horizontal length does not vary, the vertical length is enlarged,

When dragged in the second specific direction of the vertical direction, the horizontal length does not vary, the vertical length is reduced,

When the dragged direction (as judged by the device), that is, the drag direction the user intended, is dragged to the upper right side (as determined by the device) when the object (or the active area of the object) , The lower right side, the upper left side, and the lower left side,

As a first method,

When dragged in at least one first specific direction out of the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,

When dragged in at least one second specific direction out of the diagonal directions, there is a method in which the horizontal length and the vertical length are reduced at the same ratio,

As a second method,

If the image is dragged to at least one first specific direction range out of the diagonal directions, the variation ratio of the horizontal length and the vertical length is differently enlarged along each direction in the range,

There is a method in which, when dragged in at least one second specific direction range out of the diagonal directions, the variation ratio of the horizontal length and the vertical length is reduced differently in each direction within the range.

It is a method that can be enlarged or reduced without changing the center point position of the object.

As an example of the above-described method,

After the index finger is recognized as a reference finger and the detection area and the stop area are used so that the active area of the object (or object) becomes the target button,

When the detection and stop are multi-all-dragged in the upward direction in the vertical direction, the object shape is deformed such that the horizontal length of the object is increased only in the vertical length as in the case of FIG. 26 to FIG. 35, 35, the object shape is transformed so that the length of the object is reduced only by the vertical length without changing the width of the object,

When the detection and stop are multi-all-dragged in the rightward direction in the horizontal direction, the object shape is deformed so that the vertical length of the object is increased only by the horizontal length as in the case of changing from FIG. 26 to FIG. 36, When the multi-all is dragged in the middle left direction, the shape of the object is transformed so that the length of the object is reduced to the width of the object without changing the length of the object,

When the determined drag direction is a diagonal direction,

As an example of the first method,

Even if the detection and stop are multi-all-dragged in any direction of any of the various upper-right-side directions or diverse upper-left-side directions in the diagonal direction, the ratio of the horizontal length to the vertical length of the object And even if the detection and stop are multi-dragged in any direction among the various right-and-lower directions in various diagonal directions or in any of the various left-and-lower directions, as shown in Fig. 37 to Fig. 26, And the vertical length ratio may be maintained while being reduced.

As an example of the second method,

The ratio of the horizontal length to the vertical length of the object is varied depending on whether the detection and stop are multi-all-dragged in the upper right direction or the upper left direction in any of the diverse upper right direction or diverse upper left direction, It is possible to realize that the ratio of the horizontal length to the vertical length of the object is reduced in accordance with whether the stop is multi-right-dragged in any right-down direction or any left-down direction among the diverse right- You may.

3) In the background section, " According to the method of the present invention, in the object shape transformation method requiring the activation step of the conventional object only by multi-touching the object to be recognized as the target button (= It is possible to perform the four steps in the object shape transformation method which requires the activation step of the conventional object in which 17 object change patterns are implemented while performing the same effect as the step is performed through the multi- Quot ;, which is incorporated by reference herein.

It is a method that can be enlarged or reduced by changing the position of the center point of the object.

In more detail, the following steps can be taken.

Step 1: The object (or the active area of the object) is multi-touched and dragged to be recognized as the target button, and the specific range within the object (or the active area of the object) .

Step 2: As the horizontal or vertical length of the object (or the active area of the object) changes depending on the recognized target range and the determined drag direction, the direction in which the dragging starts is close to the center of the object (or the active area of the object) (The center of the object may be shifted in the determined drag direction).

Depending on the implementation, the target scope itself may be the entire activation area of the object or object. It will mainly do so in the way that the center point of the object does not move. In the method in which the center point moves, it is recommended that some range of the active area of the object or object is recognized as the target range.

In other words, if the magnification or reduction is determined not only by the direction of the dragged position determined by the device but also by the recognized target range or shot point, and if the center point is selectively moved, the moving direction of the center point can also be determined Method.

(The center of the object (or the active area of the object) is a straight line passing through the center of the object (or the active area of the object) perpendicular to the determined drag direction, or an object perpendicular to the determined drag direction The result may be the same even if it is replaced with the concept of a straight line bisecting the object (or the object activation area) as it passes through the center of the active area).

In the case of the user, the target range is first determined, and any point within the target range is selected as the target point, and the target point is multi-touched and then dragged so as to be the hit point. On the contrary, Likewise, two factors, the hit point and the direction to start dragging, may allow the user to determine what range he considered to be the target range.

In the above description, there is a portion expressed as a direction in which dragging is started instead of a drag direction. To explain the reason for this, for example, when dragging downward in the range # 5 in FIG. 45, , But if you drag it downward beyond the horizontal line passing through the center of the object, then it will be moving away from the center of the object, which means that until the object is still near the horizon, It is because the direction away from the center of the object has not been dragged downward by the length of the longitudinal side of the object from the moment when it is reduced and beyond the horizon, but the object should not be enlarged right away. This is because it must continue to be reduced until it is dragged downward by the length of the object's longitudinal side.

A few techniques are added to the method as follows.

① It starts to be multi-touched and dragged so that the object (or the active area of the object) to be deformed is recognized as the target button, and the specific range within the object (or the active area of the object) To be recognized as a target range,

If it is determined that the direction in which the dragging is started (as judged by the device), that is, the drag direction the user intended is one of the upper side, the lower side, the right side, or the left side,

(Or the active region of the object) of the object (or the active region of the object) if the determined dragged direction is a direction approaching the center of the object (or the active region of the object) The lengths of the sides are reduced, and the lengths of the two sides perpendicular to the determined drag direction are not changed (additionally, as the center of the object moves in the determined drag direction, dragging determined from three sides surrounding the recognized target range The position of the side perpendicular to the direction may be moved for reduction and the position of the opposite side of the side may not be changed)

If the determined dragged direction is a direction away from the center of the object (or the active area of the object), two traces of the object (or the active area of the object) or two traces parallel to the drag direction The length of the sides is enlarged and the lengths of the two sides perpendicular to the determined drag direction are not changed (additionally, while the center of the object moves in the determined drag direction, the drag direction determined from the three sides surrounding the recognized target range And the position of the side opposite to the side of the side may be made unchanged).

In this paper, we propose a new method for transforming object shape, which is required for activating the conventional object, which is described in the background section. ≪ RTI ID = 0.0 > and / or < / RTI >

(2) It starts to be multi-touched and dragged so that the object (or the active area of the object) to be deformed is recognized as the target button, and the specific range within the object (or the active area of the object) To be recognized as a target range,

If it is determined that the direction in which the dragging is started (as judged by the device), that is, the drag direction intended by the user is one of the upper right side, the lower right side, the upper left side,

If the determined direction of dragging is the direction approaching the center of the object (or the active area of the object), the length of the side and sides are reduced. If the side is reduced, both sides are reduced to the same length, If the variation is reduced, both of the vertical sides are reduced to the same length, and it is possible to set the changing ratio of the horizontal length and the vertical length to be different depending on which direction is dragged in the specific drag direction range determined by the device. The length of the horizontal and vertical portions may be set to be the same at the same rate, regardless of the direction in which they are drawn. (Further, while the center of the object moves in the determined drag direction, among the vertexes in the recognized target range, the vertex closest to the straight line parallel to the drag direction is moved for reduction, and the position of the opposite vertex of the vertex May be made unchanged.)

If the determined dragged direction is the direction away from the center of the object (or the active area of the object), the length of the side and sides is widened. At this time, if the lateral side is enlarged, both lateral sides are enlarged to the same length. If the longitudinal side is enlarged, both vertical sides are enlarged to the same length. Depending on which direction is dragged in the specific drag direction range determined by the device, The change ratio of the length and the vertical length may be set to be different or the length of the horizontal and vertical portions may be set to be the same at the same rate regardless of the direction in which the drag direction is drawn. (Further, as the center of the object moves in the determined drag direction, the vertex closest to the straight line parallel to the drag direction among vertexes in the recognized target range is moved for enlargement, and the position of the opposite vertex of the vertex May be made unchanged.)

The method of "②" in this section is based on the 17 aspect change patterns in the 4th step of the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section, 9) to 16) Lt; RTI ID = 0.0 > a < / RTI >

More specifically, for example,

The object to be deformed (or the active area of the object) is multi-touched and dragged so that it is recognized as the target button, and the specific range within the object (or the active area of the object) In the case where the finger is recognized as a reference finger,

1) The multi-touch is performed so that the range No. 5 in FIG. 45 (a) is recognized as the target range and the range No. 5 is touched by the index finger as the reference finger. Then, when the multi- The "1)" aspect of the 17 object changes in the 4th step in the object shape transformation method that requires the activation step of the conventional object mentioned in the background art section is implemented.

2) The multi-touch is performed so that the range No. 5 in FIG. 45 (a) is recognized as the target range by touching the range No. 5 with the index finger as the reference finger. Then, when the multi- The aspect of "2)" is implemented among the 17 object change patterns in the 4th step in the object shape transformation method requiring the activation step of the conventional object mentioned in the background art section.

3) After the multi-touch is performed so that the range 7 is touched by the index finger, so that the range 7 in FIG. 45 (a) is recognized as the target range, the multi-all is dragged, In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art, "3)" aspect is implemented among the 17 object change patterns in the 4th step.

4) After the multi-touch is performed so that the range 7 is touched by the index finger as the reference finger so that the range 7 in FIG. 45 (a) is recognized as the target range, In the object shape transformation method that requires the activation step of the conventional object mentioned in the background art, "4)" aspect is implemented among the 17 object changes in the 4th step.

5) After multi-touching is performed so that the range No. 8 in FIG. 45 (b) is recognized as the target range and the range 8 is touched by the index finger, the multi-touch is started to be dragged to the right, In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art, "5)" aspect is implemented among the 17 object changes in the 4th step.

6) After multi-touching is performed so that the range 8 is touched by the index finger as shown in FIG. 45 (b) so that the range 8 is recognized as the target range, the multi- In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section, the aspect of " 6) "

7) After multi-touching is performed so that the range 6 is touched by the index finger as a reference finger so that the range 6 of FIG. 45 (b) is recognized as the target range, In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art, "7)" aspect is implemented among the 17 object change aspects in the 4th step.

8) After multi-touch is performed so that the range 6 is touched by the index finger as shown in FIG. 45 (b), the range 6 is recognized as the target range. In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section, the aspect of "8)" is implemented among 17 object changes in the 4th step.

9) When the first range is recognized as the target range in FIG. 45 (b), the first range is multi-touched so as to be touched by the index finger as the reference finger, and then multi-all is dragged. The aspect of "9)" is implemented among the 17 object changes in the 4th step in the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section.

10) When the first range is recognized as the target range in FIG. 45 (b), the first range is dragged in multi-touched manner so as to be touched by the index finger as the reference finger, The aspect of "10)" is implemented among the 17 object change patterns in the 4th step in the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section.

11) After multi-touching is performed so that the range No. 4 in FIG. 45 (b) is recognized as the target range and the range No. 4 is touched by the index finger, the finger is dragged to the lower right side. In the object shape transformation method that requires the activation step of the conventional object mentioned in the background art, "11)" aspect is implemented among the 17 object changes in the 4th step.

12) After multi-touching is performed so that the range No. 4 in FIG. 45 (b) is recognized as the target range and the range No. 4 is touched by the index finger, the finger is dragged in the upper left direction. In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section, the aspect of "12)" is implemented among 17 object changes in the 4th step.

13) When the second range is touched by the index finger such that the second range is touched by the index finger so that the second range in the diagram (b) of FIG. 45 is recognized as the target range, In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art, "13)" aspect is implemented among the 17 object changes in the 4th step.

14) When the second range is touched by the index finger such that the second range is touched by the index finger so that the second range in the drawing of FIG. 45 (b) is recognized as the target range, In the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section, the aspect of "14)" is implemented among the 17 object change patterns in the 4th step.

15) After multi-touching is performed so that the range of No. 3 in FIG. 45 (b) is recognized as the target range by touching with the index finger as the reference finger, The aspect of "15)" is implemented among the 17 object changes in the 4 steps in the object shape transformation method which requires the activation step of the conventional object mentioned in the background art section.

16) After multi-touching two multi-touches so that the range of No. 3 is touched by the index finger as the reference finger so that the range of No. 3 in FIG. 45 (b) is recognized as the target range, In the object shape transformation method that requires the activation step of the conventional object mentioned in the background art, "16)" aspect is implemented among the 17 object change patterns in the 4th step.

17) It is possible to recognize any range of the object (or the active area of the object) as a target range, that is, any point in the drawing, irrespective of any of the drawings in FIGS. 45A, 45B, The object (or the active area of the object) rotates when the drag trajectory is a trajectory of a curve rather than a trajectory close to a straight line within a certain curvature range.

Expressed in a technical language like this, it seems a bit complicated. From the viewpoint of the user, if the target button recognizing method using the reference finger is used as the target button recognizing method, the touch point to be touched by the reference finger is determined and touched, .

In the object shape transformation method that requires the activation step of the conventional object, move the mouse pointer only to the zoom adjustment point on the side where the zooming starts or the zooming point or the vertex, and then drag the mouse pointer in the desired direction .

In the multi-touch method according to the present invention, when the reference finger is to be touched, the method of the present invention does not require the activation of the object, but the object activation area boundary It may be extended to the inner point of the object near or at or near the zoom adjustment point. The drag direction is the same as the conventional method.

I will explain it as a more concrete example.

In the following examples of (a), (b), (c) and (d)

The concept of the active area of the object is that the object activation is not required in the method of the present invention but the object activation area boundary line is assumed assuming that the object is activated as in the conventional case. Please bear in mind.

So is the concept of the active area boundary of an object.

The target point can be extended not only to the zoom adjustment point in the object activation area boundary in the conventional method but also to an external point of the object or a point in the object adjacent to the adjustment point, , It is recommended to do so. Of course, in order to recognize an object as a target object, not only the zoom adjustment point at the boundary of the object activation area but also an external point of the object in the vicinity of the boundary line at the adjustment point is multitouch with the reference finger, .

(a) For example, when a multi-touch is performed so that the reference finger is touched at an enlargement / reduction adjustment point in the object left / right active area boundary or an internal point of the object near the periphery or its vicinity, After two multi-touches with the detection and stopping to be recognized by the finger, the touching state of the detection and stop is maintained and dragged left / right so that the length of the object can be enlarged or reduced without changing the vertical length of the object.

In this paper, we propose a new method for transforming objects in the object shape transformation method which requires the activation step of the conventional object mentioned in the background section. I have mentioned an example.

(In the case where it is difficult to predict the position of the area boundary to be activated, such as a star shape, rather than the case where the active area boundary line is formed in the same range as the shape like a rectangle, the object is activated by a single touch or the like, And then dragged to be enlarged or reduced after being multi-touched. The same applies to the following 2) and 3).

(b) For example, when a multi-touch is performed so that the reference finger is touched at an enlargement / reduction adjustment point in the boundary line of the object upper / lower active area or an inner point of the object near the vicinity of or around the zoom adjustment point, After two multi-touches, the object is dragged up and down while the touch state of the detection and stop is maintained, and the vertical length of the object can be enlarged or reduced without changing the width of the object.

In this paper, we propose a new method for transforming objects in the object shape transformation method which requires the activation step of the conventional object mentioned in the background section. I have mentioned an example.

(c) For example, when the reference finger is touched to an inside point of an object near the zoom control adjustment point at or near the object activation area boundary edge, for example, After two multi-touches with detection and stopping to recognize, the touch and hold states of the detection and stop are maintained and dragged diagonally, so that the width and height of the object can be enlarged or reduced. Of course, the ratio of the horizontal length to the vertical length may vary depending on the direction in which the image is dragged.

In this paper, we propose a new method for transforming objects in the object shape transformation process. In this paper, we propose a new method for transforming object shape objects. I have mentioned an example.

(d) For example, when a multi-touch is performed so that a reference finger is touched to an internal point of an object inside an object activation region boundary line, for example, after two multi-touches are detected and stopped so that the detection finger is recognized as a reference finger, While the touch state is maintained, the object can be rotated by being dragged to a curve beyond a predetermined curvature.

Here, we mention an example of how 17 aspect of 17 object changes in 4 steps in object shape transformation method that requires activation step of conventional object mentioned in the background section is implemented by our method It is.

It can be understood more easily through the following ① ~ ⑧ example.

The following examples ① through ⑧ are included in the concept described above. When the dragging progresses in a direction approaching a straight line passing through the center of the object perpendicular to the drag direction, the object is reduced, and the center of the object perpendicular to the drag direction It can be said that it is enlarged if the dragging progresses in the direction of going straight ahead.

When dragging in the diagonal direction in the following examples (1) to (8), it is natural that it is possible to set to be enlarged at different ratios according to the drag direction, although the examples are exemplified only when the horizontal length and the vertical length are enlarged or reduced at the same ratio.

① (Object or object) 2 Multi-touch is done by sensing and stopping so that the activation area is the target button. (X1, Y1) and the Y value is the smallest coordinate (X2, Y2) in the activation area of the object before the shape transformation of the object time,

An index to be recognized as a reference finger at a point in an object activation area (e.g., area 5 in FIG. 45) having a Y value equal to or greater than the intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2 Touch "to the right part of the index finger, and then" drag all "to the upper side, it is possible to enlarge only the vertical length without changing the width of the object. Even when the vertical length is enlarged, the coordinate (s) having the smallest Y value (object area) or the object activation area (e.g., the lower side road) (E.g., the upper side of the road) can be enlarged so that only the vertical length of the object is shifted upward. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 27.

If it is recognized as a reference finger at a point in the object activation area (for example, area 7 in FIG. 45) having a Y value less than the intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2 When the multi-all is dragged to the upper side, the length of the object can be reduced without changing the length of the object, so that only the vertical length can be reduced. The coordinate (s) having the smallest Y value of the object activation area (object area) or object activation area (s) without changing the coordinate (s) having the largest Y value of the object activation area Only the length of the object can be reduced in the form of being shifted to the upper side. To simplify the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 28.

② (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activation area becomes the target button. 2 Multi-touch When the coordinates of the object with the largest Y value in the active region (object region or object) before transformation are (X1, Y1) and the coordinate with the smallest Y value is (X2, Y2) time,

An object to be recognized as a reference finger is touched to a point in the object activation area (object area or area) having a Y value equal to or greater than the intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2, If the object is touched at any point and then dragged downward, it is possible to reduce the length of the object without changing the length of the object. Even when the vertical length is reduced, the coordinate (s) having the smallest Y value of the object region (or the object region) are not changed, and the Y value of the (object or) object activation region is shifted downward It is possible to reduce the length of the object in the losing form. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 27 to FIG. 26.

If an index finger to be recognized as a reference finger is touched to a point in the object activation area (object area or area) having a Y value less than an intermediate value (= (Y1 + Y2) / 2) of Y1 and Y2, The object can be enlarged only by the vertical length without changing the width of the object when the object is touched to the right of the object and then 'drag all' to the lower side. The coordinate (s) having the smallest Y value of the object activation area (object area) or object activation area (s) without changing the coordinate (s) having the largest Y value of the object activation area The length of the object can be enlarged only in the form of being moved to the lower side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 28 to FIG. 26.

③ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. (X1, Y1) and the coordinate with the smallest X value is (X2, Y2) in the active region of the object before the shape transformation of the object time,

An index to be recognized as a reference finger at a point in the object activation area (e.g., area 6 in FIG. 45) having an X value equal to or larger than the intermediate value (= (X1 + X2) / 2) of X1 and X2 Touch "to the right part of the index finger, and then" drag all "to the right, the object can be enlarged only by the width without changing the vertical length. Even if only the width is enlarged, the coordinate (s) having the smallest X value (object area) or the object activation area (e.g., the left vertical side) (S) (eg, the right vertical side) can be enlarged so that only the horizontal length of the object is shifted to the right. The above description will be briefly described with reference to the drawings.

If it is recognized as a reference finger at a point in the object activation area (for example, area 8 in FIG. 45) having an X value less than the median value of X1, X2 (= (X1 + X2) / 2) When the multi-all is dragged to the right after the predetermined detection is touched and the stop is touched at any point on the right side of the index finger, the length of the object can be reduced without changing the vertical length. The coordinate (s) having the smallest X value of the object activation area (object area) or the object activation area (s) without changing the coordinate (s) having the largest X value of the object activation area It is possible to reduce only the length of the object in the form of shifting to the right. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 30.

④ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. (X1, Y1) and the coordinate with the smallest X value is (X2, Y2) in the active region of the object before the shape transformation of the object time,

An object to be recognized as a reference finger is touched to a point in the object activation area (object area or the object area) having an X value equal to or larger than an intermediate value (= (X1 + X2) / 2) of X1 and X2, When the object is dragged to the left side, it is possible to reduce the width of the object without changing the length of the object. The coordinates of the object having the smallest X value of the object area or the object activation area are not changed and the coordinates of the object having the largest X value of the object activation area are shifted to the left, Only the length of the transverse direction can be reduced. Briefly describing the above description with reference to the drawings, it is exemplified that it is changed from FIG. 29 to FIG. 26.

If an index finger to be recognized as a reference finger is touched at a point in the object activation area (object area or area) having an X value less than the intermediate value (= (X1 + X2) / 2) of X1 and X2, When the object is touched at any point on the right side of the object, and then 'multi-all-dragged' to the left side, the object can be enlarged only in its length without changing its length. The coordinate having the largest X value of the (object region or) object activation region remains unchanged, and the coordinate having the smallest X value of the object activation region (object region) or the object activation region is shifted further to the left Only the horizontal length of the object can be enlarged. The above description will be briefly described with reference to the drawings, for example, changing from FIG. 30 to FIG. 26.

⑤ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area is the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

An object region or an object activation region having an Y value equal to or larger than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and an intermediate value (= (Y1 + Y2) / 2) For example, an area that can be included in the area 2 of FIG. 45) is touched, and the stop is made to touch any point on the right side of the index finger, and then the multi- , The horizontal and vertical lengths of the object can be enlarged at the same rate. (Object or area), the coordinates of the object having the smallest X value and Y value (e.g., the third vertex in FIG. 39) of the object activation area (object or area) The horizontal and vertical lengths of the object can be enlarged in such a manner that the coordinates having the largest X value and Y value of the object activation area (for example, the second vertex in FIG. 39) are shifted to the upper right side. The above description will be briefly described with reference to the drawings.

(Object region or object region) having an X value less than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) It is possible to touch an index finger to be recognized as a reference finger at a point in the object activation area (for example, an area that can be included in the area 3 of FIG. 45), and to stop the touch at any point on the right part of the index finger, When 'multi-drag all', the horizontal and vertical length of the object can be reduced to the same ratio. The X and Y values of the (object region or object) activation region have the largest coordinate, and the X value and the Y value of the object activation region (object region or object activation region) The length and width of the object can be reduced in such a way that the coordinate having the smallest value is shifted to the upper right side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 32.

⑥ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

(Object region or object) region having an X value equal to or greater than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value equal to or larger than an intermediate value (= (Y1 + Y2) / 2) between Y1 and Y2 And the stop is touched at any point on the right side of the index finger, and then when the 'multi-drag' is performed to the lower left side, the horizontal and vertical lengths of the object are reduced to the same ratio can do. Even if the width and height of the object are reduced to the same ratio, the coordinates with the smallest X value and Y value of the (object area or object) area can be changed without changing the X value and Y value of the (object or object) The length and width of the object may be reduced in such a manner that the largest coordinate is shifted to the lower left side. The above description will be briefly described with reference to the drawings.

(Object region or object region) having an X value less than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) The object to be recognized by the reference finger is touched at a point in the object activation area, and the stop is touched at any point on the right side of the index finger, and then when the object is multi-dragged to the lower left side, Quot ;, respectively. The coordinates of the object having the largest X value and the Y value of the object area (or object area) are not changed, and the X value and the Y value of the object activation area (object area or object activation area) The width and height of the object can be increased in such a way that the coordinate with the smallest value is shifted to the lower left. The above description will be briefly described with reference to the drawings.

⑦ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activation area is the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

(Object region or object) region having an X value equal to or greater than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) (For example, an area that can be included in the area No. 4 in FIG. 45) is touched to be recognized by the reference finger, and the stop is made to touch any point on the right side of the index finger, Drag ", the horizontal and vertical lengths of the object can be enlarged at the same rate. Even when the width and height of the object are enlarged at the same ratio, the coordinates (the object area or the object having the smallest X value and the largest Y value of the object activation area, for example, the first vertex in FIG. 39) Or, the horizontal and vertical lengths of the object can be enlarged in such a manner that the coordinates of the object having the largest X value and the smallest Y value (for example, the fourth vertex in FIG. 39) are shifted to the lower right side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 26 to FIG. 33.

If an object (object region or object) having an X value less than an intermediate value of X1 and X2 (= (X1 + X2) / 2) and a Y value equal to or greater than an intermediate value of Y1 and Y2 (= (Y1 + Y2) 45), and the stop is made to be touched at any point on the right side of the index finger, and then the finger is touched to the right side of the index finger, Drag ", the horizontal and vertical lengths of the object can be reduced to the same ratio. The coordinates of the object having the largest X value and the smallest Y value are not changed (the object area or the object area), and the X value of the object activation area And the length of the object is reduced in the form in which the coordinate having the smallest Y value is shifted to the lower right side. The above description will be briefly described with reference to the drawings.

⑧ (Object or Object) 2 Multi-touch is done by sensing and stopping so that the activated area becomes the target button. 2 In multi-touching, the coordinate with the largest X value and Y value (X1, Y1) and the smallest X value and Y value in the active area (object area or object) X2, Y2), < / RTI >

(Object region or object) region having an X value equal to or greater than an intermediate value (= (X1 + X2) / 2) of X1 and X2 and a Y value less than an intermediate value (= (Y1 + Y2) / 2) And the stop is touched at any point on the right side of the index finger, and then when the object is multi-dragged to the upper left side, the object is horizontally and vertically scaled down at the same rate . Even if the width and height of the object are reduced by the same ratio, the coordinates of the object (or object) or the area of the object activation area having the smallest X value and the greatest Y value do not change, It is possible to reduce the horizontal and vertical length of the object in such a form that the coordinates with the largest Y value are shifted to the upper left side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 33 to FIG. 26.

If an object (object region or object) having an X value less than an intermediate value of X1 and X2 (= (X1 + X2) / 2) and a Y value equal to or greater than an intermediate value of Y1 and Y2 (= (Y1 + Y2) When the multi-all dragging is performed to the upper left side after touching any one of the right side portions of the index finger, the stopper is touched at the same ratio of the horizontal and vertical lengths of the object As shown in FIG. The coordinates of the object having the largest X value and the smallest Y value are not changed (the object area or the object area), and the X value of the object activation area The horizontal and vertical lengths of the object can be enlarged in such a manner that the coordinate with the smallest Y value is shifted to the upper left side. Briefly describing the above description with reference to the drawings, it is exemplified that the state is changed from FIG. 34 to FIG. 26.

For reference, in a case where an object including a change of the shape of an object including a picture, a photograph, a browser, and a window is to be operated rather than a button to which a character is assigned, in the case of a device such as a mobile phone or a smart phone equipped with a small display device, In most cases, since only one object is displayed and used, it does not matter which finger among multi-touched fingers is determined as the " reference finger ".

That is, when one or more fingers of any finger are touched on the object, the object is recognized as a target button by the device. In this state, the object including the multi-all drag operation is reduced or enlarged The shape may change.

Even in the dedicated screen in which the shape of the object is changed, even if there is no finger touching the object among multi-touched fingers, the fact that the screen is multi-touched allows the object to be recognized by the target button, The shape of the object may be changed, including that the object is shrunk or enlarged through various manipulations including multi-dragging.

When a specific button is touched by a finger, a button that is desired to be touched is also touched. However, in some cases, a button that is not desired may be touched while the finger is thick. In such a case, Or the like.

5. Electronic appliances to which the present invention is applicable

A device to which the present invention is applicable is all devices capable of recognizing a touch.

Examples include mobile phones, smart phones, feature phones, pda, tablet PCs, general PCs, and laptops.

25 is a block diagram of an electronic apparatus to which the present invention is applicable. As shown in FIG. 25, an electronic apparatus to which the present invention can be applied includes a touch screen 110, a function block 120, a control unit 130, a storage unit 140, and a communication unit 150.

The touch screen 110 displays the above-described touch buttons, and is a means used by a user to touch a desired touch button with a finger.

The function block 120 performs the function of the electronic device itself. If the electronic device is a mobile phone, the function block 120 performs a mobile phone function; 2) if the electronic device is a mobile computer, the function block 120 performs a computing function; and 3) If the mobile multimedia player is a multimedia player, the function block 120 performs a multimedia playback function, and 4) if the electronic device is a general notebook or a PC, the function block 120 performs a computing function.

The storage unit 140 stores a program and data used for creating a GUI screen including the functions of the electronic device and the touch buttons, and provides a storage space for storing multimedia files.

The control unit 130 executes a program stored in the storage unit 140 to control the functioning of the function block 120 and displays a GUI composed of touch buttons on the touch screen 110. [ In addition, the control unit 130 performs character input, object adjustment, and function execution according to a user's operation, which is input using the touch buttons displayed on the touch screen 110.

The communication unit 150 is connected to communicate with other electronic devices and performs data communication.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

110: Touch screen
120: Function block
130:
140:
150:

Claims (4)

A method of operating a keyboard,
Some buttons remain touched for a certain amount of time.
Which buttons are multi-touched with
The primary factor that determines which button will respond when touched
A method in which a button is multi-touched.
Any button on the keyboard will remain on the display until a single touch for that button is initiated and then the single touch is released,
If the touching state is maintained for a certain time or longer ,
When the touching state is set to react differently from when it is held below the predetermined time,
The "any key" after a multi-touch being undertaken will be contained until the multi-touch is released,
Even if the state in which the " certain button " is touched is held for a predetermined time or longer,
The "any key" single-touch method is that the reaction time after being set out in a state in which the touch until a single touch is released is maintained above a certain period of time not to.
3. The method of claim 2,
Any button on the keyboard will remain on the display until a single touch for that button is initiated and then the single touch is released,
If the touching state is maintained for a certain time or longer ,
In a case where the touching state is different from the case where the touching state is maintained for less than the predetermined time,
The "any key" after a multi-touch being undertaken will be contained until the multi-touch is released,
Even if the state in which the " certain button " is touched is held for a predetermined time or longer,
How to react when multi-touch. 4. The method according to any one of claims 1 to 3,
When a multi-touch on the keyboard,
Way that the button is recognized as a target button with any one of the touch point of the multi-touch at least two touch points.

Images