KR20060052989A - Method and device for recognizing a dual point user input on a touch based user input device - Google Patents

Abstract

There is disclosed a method for recognizing a dual point user input on a touch based user input device, comprising receiving a first user input to said input device relating to a first position, forming a first position signal relating to said first user input, receiving a second user input to said input device relating to a second position, forming a second position signal relating to said first input and said second input, determining on the basis of said first position signal and said second position signal, if said second user input has its source in a simultaneous dual point user input, generating a third position based on said first position and said second position, and using said first and third positions, as the coordinates of said dual point user input. Further there is provided a touch based input device controller for a touch based user input device, wherein said input device is only capable of outputting a single input position signal that depends on the actual user input, comprising, an input connectable to said touch based user input device to receive successive position signals each representing a position on said touch based user input device, which a user has touched, a memory, connected to said input, tcr store at least one of said position signals, a differentiator to detect time dependent transition properties between two different successive positions, a first evaluation circuit connected to said differentiator to determine, if a position following a preceding position is caused by a single point user input or by a dual point user input, a second evaluation circuit, connected to said input, said memory and said first evaluation circuit, wherein said second evaluation circuit is provided to calculate a dual point user input by reflecting a first input position at a successive second position, and an output, connected to said second evaluation unit, connectable to a processing unit.

Description

Method and device for recognizing a dual point user input on a touch based user input device}

The present invention relates to a touch input means in an electronic device. The present invention relates to touch screen devices such as PDAs, mobile phones or handheld computers. The invention also relates to touch screens and the like, and more particularly to implementing dual inputs on conventional single-point output touch pads.

Touch screens are increasingly used in handheld electrical devices. Primarily, users hold the device in one hand and use the device's user interface with the other hand. However, in certain circumstances it may be more useful to have the user use both hands to access the user interface (UI). However, currently used resistive touch pads do not accept multiple inputs.

When the user touches the touch pad using two fingers, the resistive touch pad device treats this as an error and determines that the user intended to substantially touch the midpoint of the line connecting the two input points.

There are many electrical and electronic devices that use touch pads as user input, such as PDAs, mobile phones, laptop computers and PC monitors. In general, these devices allow only one point of user input in a user input area on the device, such as pressing a pictogram icon, menu item, or drawing with a pen or stylus.

However, there is a growing interest in using both points as a user input in special cases. An example of such use is a QURTY keyboard with special keys (shift, alt, ctrl, etc.) that must be pressed in conjunction with other keys. Another commonly used user interface feature is the drag and drop, which is not possible with current touch pad technology, because you must press the shift key.

Some touch pad technologies can detect more than one input point substantially simultaneously, but these techniques are expensive to implement in a mobile device and also require a large amount of operating power, processing power and memory. Accordingly, there is a need for an inexpensive touch pad technology based on a user input device capable of recognizing input from two points of a user.

It is also desirable to allow conventional touch pads that allow only one point of input to a user to recognize multiple user input points.

According to a first embodiment of the present invention, a method for recognizing a dual point user input on a touch based user input device is provided. The method includes recognizing dual point user input on a touch based user input device, the method comprising: receiving a first user input associated with a first location at the input device; Forming a first location signal associated with the first user input; Receiving a second user input associated with a second location at the input device; Forming a second position signal associated with the first input and the second input; Determining based on the first location signal and the second location signal when the second user input has its origin in a simultaneous dual point user input; Generating a third position based on the first position signal and the second position signal; And using the first and third positions as coordinate axes of the dual point user input.

According to a second embodiment of the present invention, a method for recognizing dual point user input on a touch based user input device is provided. In this case the input device can only output a single input position signal. That is, the touch input device provides all kinds of inputs related to a single position output signal, but different input situations exist for generating the same output signal. The method comprises the steps of: forming or sensing a first location signal, preferably storing the location signal, detecting a second continuous location signal if the second location has its origin in a simultaneous dual point user input And generating a third location by reflecting the stored first location at the second location.

Assume that a single point user input is detected on the touch-based input device by forming a first location signal associated with a first user input of the input device.

Advantageously by storing the first and third signals, the location is available even if the input point substantially changes its location. The position signals can be stored on the signal itself or in the form of, for example, binarized code coordinate data. Note that storage of the first user input location may be performed using a temporary memory.

More preferably, the event is detected by dual point user input or by single point user input by forming a second position signal associated with a second continuous user input to the input device and preferably different from the first position. do.

To distinguish between two possible user inputs, it is determined whether the second location has its origin in a coalescing dual point user input. The determination can be performed by evaluating the characteristics of the signal shift from the first position signal to the second position signal.

The determination may be based substantially on the difference between continuous and discontinuous from the first signal to the second signal. In this case substantially discontinuous signal movement indicates dual point user input and substantially continuous movement of signal indicates single-point user input (such as movement of an input point on a touch based input device, for example).

When a dual point user input is detected, a third location is generated by reflecting the stored first location in the second location. The first position and the third position are then used as the coordinate axis of the dual point user input.

Advantageously, said generated third location is substantially the same location as said second user input in said second location.

Reflecting the first location at the second location visualizes the creation of the third point. If the second location represents the "center of gravity" of the two points that are substantially in contact on the touch-based input device, a criteria for dual-point user input is performed. Information about the center of gravity (second position) and one of the two points (eg the first position) and the third position can be calculated.

The third position can also be found by creating a difference in the signal between the stored first position and the second position and adding the generated signal difference to the actual second position. This represents signal-based generation of the third location. Generating the third position is easier to implement by calculating the coordinates of the positions.

For the reasons described above, the device using the method of the present invention can distinguish user input cases of single contact points or dual contact points. Once this distinction is made, the hardware then calculates incorrect data to determine where the second input point is.

The first part of the method of the invention can be considered a static case. In this case, the second point does not move. The present invention can also be applied when the movement of the second point is detected. The movement of the third point can be calculated by continuously reflecting the first point at the second (moving) point. Thus, the first point may serve as a reference point for generating the movement of the third point.

In another embodiment of the invention, if the second location has its origin in a dual point user input simultaneously, the determining step is based on the slope between the first location signal and the second location signal. do. In this case, the inclination between the signals represents the inclination of the position signal from the first position to the second position.

The inclination of the position means the time axis derivative of the position and is proportional to the speed at which the position point moves. When the position signal suddenly rises, the position signal becomes substantially discontinuous and the slope increases.

Substantially discontinuous signal movements represent dual point user inputs and substantially continuous signal movements represent single-point user inputs. For example, the movement of a single input point on a touch-based input device. Instead of the slope used above, the steepness of the signal in the travel zone can also be used as a reference measure to determine whether the travel is discontinuous.

Note that the first location should be stored while the location is substantially static. To implement this, the first location can be stored in a temporary memory and used after a time period during discontinuous signal movement. The time interval may range from 1/10 seconds or less and corresponds to the maximum measurement time required while the input activator (eg, pen) or finger on the touch pad is held down.

In another embodiment of the present invention, the method comprises storing the third location. When the second position is stored and movement of the second position is detected, it can be used as a reference position point for calculating the movement of the first position.

In another embodiment of the present invention, the method further comprises detecting a movement of the second position; Setting one of the first position or the third position as a reference point; And calculating the movement of the position other than the reference point by reflecting the reference point on the second position. This indicates that the method of the present invention is dynamically implementable in this detected dual point input mode at the "center" point.

As described above, the touch pad can detect only the movement of the center point or the "center of gravity" of the dual-point user input, in which case the movement of the second input point can be interpreted in an unclear way. One of the positions can be considered fixed.

In order to use one fixed reference point, this reference point must be stored. In the case of input characteristics, for example user input such as string, alt, cap lock, etc., the first position can be used as a reference point and likewise the position used to press the 'string' input area on the touch screen does not move. .

For user input of "drag and drop", the user points the first point so that the object is dragged and presses the input area continuously to activate the "drag and drop" function. Then move the object.

In this case, the location point used to activate the drag and drop feature (eg, the third location) does not move on the touch screen and thus the calculated third location can be used as a fixed reference location point. Note that the setting of the reference position should be performed before the movement of the second position is detected.

In another embodiment of the present invention, the method also includes receiving a signal indicating when the first position or the third position is used as a reference point.

By receiving information from a software application running on a user device, all of the input features can be implemented under a single device or under a single application. The application may determine based on actual positions of the dual point input when the first or third position is considered a reference point.

It is also possible to select the input position to be positioned close to the left side of the input device as a reference point. It is also possible to select an input position such that it is disposed close to the left side of the input device as a reference point.

By accessing the location based on the right / left reference point, one can consider the tendency of the user to hold the touchable device in the user's primary hand and perform the input with their primary hand using, for example, a finger or a pen. Can be.

The user can easily use the thumb of the hand, which is not mainly used for tapping the touch-input device, and a point near the left side can be used as a reference point. Thus, a general method of controlling a touch input based device is obtained by combined movement of two points, such as a pen or thumb.

In another embodiment of the present invention, if the second location has its origin in a dual point user input entered at the same time, the determination is made based on the border area. The border zone is defined by the possible input selections and the first location. Dual point user input is excluded when at least one of the second locations is detected outside of the at least one border area.

By using the border zone an input representing a discontinuous signal but leading to an unacceptable or unreadable second input signal may not be recognized as a dual-point input. Thus, the number of possible input signals can be excluded from being recognized as dual input from the beginning.

In another embodiment, the input area is defined by a 'half edge distance area' from the first location. The 'half edge distance area' around the first area may define a basic boundary area. If the second input location is detected outside the half edge distance area, the second input point may be calculated outside the senseable area of the touch pad. Thus, when calculating the third position at the second position outside the half edge distance area, an invalid value is obtained.

In order to prevent a wrong third point from being generated, the second point is considered one single point user input if the distance between the first user input point and the second user input point is too large. Therefore, if it is larger than 1, it is generally interpreted as single point user input. New second user input-positions may be excluded from the dual point user input when using three quarters of the half width boundary area. As a result, accuracy can be significantly increased.

Note that the border area depends on the first input position and therefore must be calculated. The concept of the border zone can also be thought of as a kind of user input prediction. In this case, the area within the second user input is less likely to be allowed as the dual-point input area. By using boundary regions, the reliability and operation of recognition of dual point user input can be significantly increased. In addition, implementation of the boundary area will be described with reference to FIGS. 9 and 10.

In another embodiment of the present invention, the method also includes setting a 'dual point user input flag' if the second input location has its origin in a dual point user input.

This may be useful if the device can know whether the touch pad is actually in dual point input mode. The method of the present invention may also include a 'dual point user input enabled' flag sent from a user application that enables or disables dual point user input on a touch based input device. The flag can be used to add a restriction on the recognition of dual-point inputs and as a result can increase the accuracy of the recognition process.

In another embodiment of the present invention, the method further includes the second location as the actual location of the single point user input when the dual point user input flag is set and the second location input has its origin within the dual point user input. It further comprises the step of using as a location.

In the dual point input mode, when the user lifts one of the two elements in contact with the touch pad, the movement trend of the second position shows the characteristic of the discontinuous movement transition.

In this case, the reference point or 'calculated' third position point disappears. If the calculated third point disappears, it is detected that the calculated position or the second position returns to the reference point (continuously or discontinuously). Similarly. If the reference point disappears, it is indicated that the second position has been 'jumped' into the calculated position or that a calculated 'jump' of the calculated position has been made as a reflection of the reference point at the calculated point, and the set flag is reset. Can be de-set.

If neither of these cases occurs, the discontinuous movement from the second position to the fourth position can be used to calculate the fifth position, indicating the third contact position on the touch pad. Note that the impact of the new center of gravity position requires different computational equations than the third position generation to consider the second position, which actually marks two points rather than a single point.

The method further includes the step of unsetting or resetting the dual point user input flag. The method may also further include de-setting the dual point user input flag if no user input is detected. That is, when the touch pad automatically detects a case in which the user does not touch the touch pad, the flag may be automatically released.

In another embodiment of the present invention, the method further comprises indicating that dual point user input is used. Users who do not know the dual user input selection may be surprised if the device does not work as expected for user input. Thus, it may be useful to indicate that the touch pad / screen is substantially a dual user input mode.

An icon displayed on the device or an indicator inserted with a cursor can do this. Cursors are invisible when placed under a finger or input activator and therefore cannot be used on touch screen devices such as PDAs (Personal Digital Assistants).

In the case of dual-point user input, the 'reference point' moves, so the position of the cursor must be able to escape the contact point on the touchpad. The cursor may indicate which of the two points is actually determined as the reference point. Cursors can provide clues as to why the device works in a particular way.

Even if the user does not know how the dual point input is generated, the user can easily recognize where the actual cursor is located in the view of the device. The cursor may be implemented as a connecting line between the reference point and the calculated point.

As another embodiment of the present invention, the method further comprises setting the second location to a new location of the single point user input if the second location input does not have its origin in the dual point user input. Include.

In another embodiment of the present invention, there is provided a software tool comprising program code stored on a computer readable medium executing on a computer or a network device for performing the above-described method.

In another embodiment of the present invention, there is provided a computer program medium downloadable from a server comprising computer program code executed on a computer or network device for performing the above-described method.

In another embodiment of the invention, a computer data signal is provided. The computer data signal is embodied in the form of a carrier wave and allows the computer to perform the steps of the method described above. In this case, the computer program is executed on the computer or the network device.

In another embodiment of the present invention, a touch based input device controller in a touch based user input device is provided. The input device can only output a single input position signal in accordance with the actual user input. The controller includes an input, a memory, a differentiator, first and second verification circuits and an output coupled to the touch based user input device.

The input unit may be connected to the touch-based user input device to receive a continuous position signal from the touch-based user input device that the user has already touched. Due to the constraints of the touch-based user input device, the input can only receive a single point user input location signal. The input unit may also be implemented as an interface of the input device to power the input device.

A memory is coupled to the input for storing at least one of the received position signals. The memory may also be connected to one of the verification circuits for storing the calculated position, for example as a reference point. The memory can store position signals at at least two different moments.

In this case the first position should be stored when the position signal changes to a second position point and the first signal is no longer accessible. Transient memory can support this. The memory may be directly connected to the input or indirectly via a signal pre-processing step such as the first or second verify circuit. The memory may store the position signal as a signal itself or in a coded form such as a variable or coordinate.

The differentiator is connected for detecting time dependent movement features between two different positions, for example to determine the time slope and / or movement time of the movement.

The first verification circuit is coupled to the differentiator to determine if the position after the previous position is a dual point user input derived by a single point user input or a dual point user input. A first verification circuit can also be connected to the input. The differentiator may be integrated into the first verification circuit. The first verify circuit is provided to determine whether a dual-touch input was actually performed.

The second verification circuit is connected to the input, the memory and the first verification circuit. The second verification circuit calculates a dual point user input based on the first input position and the second consecutive position. This means that performing the calculation requires reflecting the first input location point at successive second location points.

The output may be coupled to the second verification circuitry and coupled to a processing portion to write the calculated dual point user input to an application device. This provides single point and dual point inputs to the application. The output may also be implemented as an interface of an input device such that a connected application device provides power to the input device.

In another embodiment of the invention the touch based input device controller also includes an input. An input unit may be connected to the second verification unit and a processing unit that receives control information from the processing unit to control the operation of the second verification unit.

The control information may include things such as 'dual input capable' or 'first / second location is reference point' or boundary area related information. The input controller may also be integrated with a touch based input device such as a touch screen module or touch pad module. The input controller can also be integrated into the touch screen controller and implemented.

According to another embodiment of the invention, the electrical device includes a touch-based input device, a processor and an input controller connecting the touch-based input device and the processor. In this case, the input controller may provide dual point user input according to the foregoing description.

According to another embodiment of the present invention, the electronic device is a mobile terminal device. The terminal device may be implemented in the form of a touch screen PDA or a touch screen telephone.

1 illustrates two points of input and in each case an output on a touch pad for the user interface of a conventional touch-based user input device.

2 shows the trajectory when the user moves the stylus on the touch pad surface.

3 shows the x- and y-axis signals due to the trajectory of FIG. 2.

4 shows two points of input and in each case an output on a touch pad for a conventional resistive user interface.

5 illustrates the discontinuity of a signal that occurs as a user touches a touch pad at a second input point.

6 illustrates the use of signal rise time used as a judgment variable between a point where discontinuity occurs and a point where it does not.

7 shows the process of restoring the exact position of two input points.

8 is a flowchart implementing the method of the present invention.

9 shows that the boundary area implements other embodiments using the method of the present invention.

FIG. 10 is a flow diagram of yet another implementation method of the present invention using the boundary area of FIG. 9.

11 structurally illustrates an implementation of a touch-based input device controller in a touch-based user input device.

In the following description of the invention, the positions P ₁ , P ₂ and P _M represent the first, second and third points, respectively. The first point is represented by P ₁ , the second point by P _M, and the third point by P ₂ .

1 illustrates input on a 10 * 10 matrix touch pad of a conventional user electronic input device such as a sense touch pad used in devices such as PDAs, mobile phones, laptop computers and PC monitors. In general, these devices allow only one point of user input in the user input area on the device, such as pressing a pictogram icon, menu item, or drawing with a pen or stylus. Sensitive touch pad hardware works by marking one point, the middle point between the two points that the user actually entered, as the input point when the user presses two points on the input point. When two input points P1 and P2 are pressed into an active input window, a conventional touchpad (touchpad designed with single point input) identifies this situation as the middle point (P _M) on the line connecting the two points is pressed. Only one point P _M is decoded as entered. Thus, the hardware causes a substantially incorrect signal.

In FIG. 2, the user is moving the stylus on the touch pad surface. In this case, the stylus moves from a specific start point, X _start , Y _start to a specific end point X _end , Y _end .

In FIG. 3, the x- and y-axis signals generated by the motion along the path shown in FIG. 2 are shown. Different output signals indicate the speed of movement of the different stylus when the stylus moves slowly, quickly and very quickly (from left to right). Despite the change in speed, the signal remains continuous and no discontinuities occur.

4 illustrates an input at one point and an output of a touch pad at each point in the case of a conventional sensing user interface. When pressing the point P2 after the first contact point P1, the center point PM of the connection line between the first contact point P1 and P1 and P2 is decoded on the device as being pressed.

There are two essential requirements used for dual point input detection and input.

1) Dual point input detection (separate from normal single point input)

2) Calculate the point where the user actually entered the second time

This requirement can be used to implement dual point user input and to calculate the coordinates of two pairs of these input points, which can then be used in a UI application. Figures 5 and 6 below relate to the detection of dual point inputs, and Figure 7 relates to calculating the second actual input point by the user.

Figure 5 illustrates a discontinuous signal or discontinuity of the signal that occurs due to contact at the user's second input point. The signal changes very quickly when the user presses the second point on the touch pad. This signal transition time is essentially determined by the time from when the stylus or finger first touches the surface of the touch pad until a certain pressure is established again.

This time interval can be measured quite small. For example, it may be smaller than 1/10 second. Compared with a typical stylus shift, one can predict that a time in the range of about 0.1 seconds is required, and both signals can be distinguished. Therefore, the rise time of the signal can be used as a judgment variable that distinguishes continuous and discontinuous.

6 shows an enlarged time axis scale at a point where discontinuity has occurred. Finding discrete values can be applied to both X and Y axis values. It is sufficient to detect the discontinuity at one of the axes.

If P1 and P2 have the same y-axis coordinates, discrete points can only be detected on the x-axis, and vice versa. In the diagram shown, the discontinuities are represented by two variables, signal rise time or transition time Δt _0. And the side may be represented by the slope S.

The transition slope is proportional to the position change P ₀ divided by the transition time Δt ₀ . The larger change is the variation slope S. These two values can be used to detect discontinuities. Transition Time △ t ₀ Only a small position change (for example, a change in one digit) can be used to lead to a situation where the discrepancy can be recognized. Transition slope S has the advantage that it can automatically consider the case of small position change as continuous state.

Dual point user input may be detected through the process described below. As already mentioned, typical touch pad hardware produces a single point of input data in everyday use and even when the user presses two points.

In order to be able to use dual point input, there must be a way to separate the two cases from each other. This can be done by characterizing the hardware signal in the time domain.

Typically in everyday use, when a user presses the touch pad hardware with an input actuator (eg, a finger, stylus or pen), a signal is generated indicating the point of contact. The input point can also be moved while the user drags the input actuator (sliding, pulling out, scrolling through the menu, etc.).

In both of these general / typical cases, the hardware signal is continuous (see FIG. 3). This movement can be very fast, but the signal is always continuous. However, when the user touches the touchpad at the second point, this signal experiences an immediate and very fast discontinuity, indicating that there is another input point (see FIG. 5).

Such results can be used by setting limits on the rate of signal change. The rate of signal change is a general expression for a technician who processes / processes an electrical signal and it indicates the time of increase or decrease of the signal.

The rate of change may be determined by Fourier analysis through edge detection of the signal, Schmitt trigger, high pass filter or high frequency component detection. The signal change rate value thus determined can be used to determine whether the input is made once or twice.

If the signal exceeds the steepness of a given slope, discontinuity is detected. The appropriate value of the limiting factor can be set based on the study of the use, so that the use of the dual input touch pad can be made convenient and normal.

A solution to the question of finding a suitable value for a limiting element suitable for a general method of using a touch pad will be described with a flow chart in FIGS. 8 and 9. The most basic process should be applied sequentially during the input process to perform the continuous detection method.

7 shows a process for calculating accurate position data of two input points. When two input points are pressed in an active input area, the device built for a single input sees this situation as being pressed only at one point in the middle of the line connecting the two points (FIG. 1 for clarity). Reference).

When two input points are detected, the first input point and the "wrong center point" become data from which the second input point can be derived substantially by calculating as follows.

P ₁ = {X ₁ , Y ₁ }; The first input point on the coordinates actually entered and detected by the user

P ₂ = {X ₂ , Y ₂ }; The second user input point on the coordinates actually entered by the user

P _M = {X _M , Y _M }; Second user input point on detected coordinates

While the user presses two points, we know the first (and previous) input point P ₁ and the incorrect center point P _M , which is created by hardware misdecoding at the actual input actuator. With the two point inputs detected (as described in FIGS. 5 and 6), the actual second input point can be calculated.

First, the center point PM for any two points P1, P2 can be defined as follows.

X _M = X1 +

Y _M = Y1 +

The exact actual position of the second user input point P2 in this equation can be derived by

X2 = 2X _M -X1

Y2 = 2Y _M -Y1

Thus, the first user input point P1 is known and the second user input point P2 can be calculated based on the misidentified touch pad signal. Therefore, accurate data of dual point user input points are available in the user interface application.

The following table shows the exact one-to-one relationship between P ₁ , P ₂ and P _M. This calculation method can be used in any pair at the point of user input and allows any combination of their relative placement. Thus, the brief idea presented can be generalized regardless of the size or shape of the touch screen display device or other touch sensitive area.

For 10 * 10 matrix samples

Note that the locations on the table may include one or more user input points. The equations can thereby derive non-integer positional values. Non-integer values can be avoided by interpolating location values or by using a touch area instead of a second input point. As the calculated position error of the third point P2 increases by a factor of three, the position resolution of the second input point decreases.

Dual point user input can be used for new user interface features when touch pad technology is used, such as selecting two items on the screen keypad, shift / alt / control functions, drag & drop, keyboard shortcuts, and the like. The principle of operation is simple and requires only minor modifications when implemented in software (hardware driver modules). The invention can also be implemented in hardware modules. The present invention allows the implementation of a new user interface style.

When the dual point input is activated and the center point P _M moves, the one-to-one correspondence no longer exists. For example, if the center point moves one step to the right, in principle it cannot be detected if the user moves each point one step to the right or one of them not moved to the right by two steps. In some cases, however, you can determine what is actually the input that the user has entered.

One possible case is when the first input point is always used as a fixed reference point when calculating the motion of the second point according to the above equation. This possibility is very useful for the shift / alt / ctrl function on screen keypads and keyboard shortcuts.

In the case of the drag and drop feature, one can expect the user to first activate the drag function by pointing to the item and then pressing the second point on the touch pad or touch screen. In this case, it is assumed that the calculated second input point is stationary.

In contrast to the ad hoc approach, the calculated second input point is fixed and the movement of the first input point can be calculated from the movement of the center point. This is implemented by setting the reference point and swapping the first and second points before calculating the motion.

8 is a flowchart implementing the method of the present invention. The method starts by detecting an input event at position P1. In the next step, the rate of change of position is determined. For example, if the rate of change exceeds a preset value, it is determined as 82. If the rate of change does not exceed this value, the change is considered to have had a conventional one point user input at the P1 position. This corresponds to the case where the P1 position hardly changes or moves relative to the surface of the touch-input device. The P1 location is then passed to 84 using the touch input device as the user interface.

If the rate of change exceeds the threshold value, the change is considered to be a "jump" of discontinuous movement or one user history point. If a jump is detected, a new input event is detected as 88 at the PM point.

The points P1 and PM are then used to calculate the second input point P2 to 90 similarly to the above equation. A new dual or dual input point {P1, P2} is created at 92 and passed to 84 to an application using the touch input device as a user interface.

9 shows an example of how a border area can improve the accurate recognition of two-point user input at a touch-input device. Boundary areas can be defined and used to exclude two incorrectly recognized user input points. In FIG. 9 embodiments of the economic zones shown in the 10 * 10 input matrix numbered four one to four are shown.

In matrix number 1 the P1 position is located near the lower left side. If a discontinuous jump to the PM position is detected, the P2 point can be easily calculated. For example, if the PM location is detected instead at the P2 point, each calculated location point will be placed outside, not inside the matrix.

To prevent it, the calculated points are placed outside the matrix. The dual-point input can only be detected if a new point PM is detected within the boundary area 98 defined by the “half edge distance” line 94.

The half edge distance line 94 represents all points having the same length between the first input points P1 at each corner of the touch pad (parts indicated by dotted lines in the figure). The combination of all half-edge distance lines 94 marks the boundary of boundary area 98.

By using the border area 98, three quarters of the input area and three quarters of the possible user inputs can be excluded from being recognized as possible dual point user inputs. Jumps longer than normal jumps (outside the border area 98) exclude dual point user input. Note that the position of this border zone is calculated depending on the position of the first input point P1.

In matrix number 2 P1 was also placed close to the lower left part. The boundary line 100 separates the boundary area 98 ′ from the rest of the touch pad. The border area 98 'separates the rest of the touch pad area from the border area 98'.

The border area 98 ′ may include user interface features such as shift / alt / ctrl functions, keyboard shortcuts, and the like. The border area 98 'may be used as the border area for the P1 location, and the shifr / alt / ctrl function key, keyboard shortcut input area (not shown) is located within the area 98'.

The boundary area 98 'can be used, for example, for right handed people, in which case the right handed people hold the device with the left hand that is not primarily used and shift with the left thumb while the right hand uses the input pen. Press the / alt / ctrl function key.

In the case of left-handed, the shift / alt / ctrl function key input area should be located on the right side of the touch-input device. This is indicated by a dotted line 100 '. In a preferred embodiment, the electronic device has the potential of providing "reverse" content such as, for example, a touch screen display in which left-handed people can use the device in a comfortable manner. The setting of the left hand right hand direction can be implemented in the Settings / User Profile menu which the user can selectively select.

In matrix number 3 the right hand boundary 100 separates the boundary region 98 ′ for point P1 and couples it to the half edge distance region 98. In this case, the boundary line 100 is defined as a line between the line 94 and the line 100. Matrix number 3 is only possible if the recognition for dual point input is within P1 location within area 98 'or PM location is within area 98. In other words, as two other location-based constraints that enable dual point user input, this in turn increases the recognition accuracy of the dual point input.

In matrix number 4, there are other input regions 102, each representing an input feature known as a drag and drop feature or an activation of other input stylus known from a drawing program.

The input regions 102 are, for example, drawing or erasing to the point P1-the function is actually contacted by the pen. Assume that at point P 1, the input is set on the touchpad before the input enters one of the input regions 102.

P1 and the input regions 102 are known, and the boundary regions 104 can be calculated only when an input comes into one of the input regions 102, which can be formed. Dual-point input is only possible if a discontinuous jump is detected in one of the boundary regions 104.

When the movement of the PM is detected, the P2 point in the input regions 102 is used as a reference position point for calculating the movement of P1 from the PM movement.

In matrix number 4, the number of possible dual input points is significantly reduced compared to the conventional method. The boundary regions 104 may be considered as input prediction used to increase awareness of the accuracy of dual-point input.

Note that Matrix 4 is an embodiment for left-handed users, where input regions 102 are operated by the thumb of the right hand, for example. Then, it is located on the right side of the matrix 4.

10 is another flow chart for implementing the method of the present invention. Basically, since the method of the present invention includes the same steps as shown in Fig. 8, similar steps are not shown, but reference numerals are recorded as shown in Fig. 8.

10 differs from the method of FIG. 8 by the addition of a query step 11 added after detection 80 of the input event at point P1. The querying step determines whether an input event is detected within the boundary area.

If no input event is detected within the boundary area, the input is assumed not to be generated by the user's two-point input, and from a new single input to a single input Performed (84).

If an input event is detected within the border area, a second input is detected at the PM location (88), and then the method proceeds as shown in FIG.

The method of the present invention may include steps such as determining an input area and calculating a boundary area to speed up the procedure.

11 is a structural diagram of a touch-based input device controller in a touch-based user input device. 11 includes three blocks and a touch based input device 2 such as a touch pad or touch screen, a touch pad input controller 6, and an interface 4 connected to the touch pad 2. The figure also includes a processor 18 for executing the application.

The processor is controlled by user input via the touch pad 2. The controller 6 is connected to the processor 18 via an interface 16. The controller 6 includes a memory 8, a differentiator 10 and first and second validation logic circuits. At the controller 6, the differentiator 10 receives a single position signal at the touch pad 2 and determines the time derivative of the position signal.

For example, the speed is obtained at the point where the signal moves on the touch pad 2. The determined value is sent to the verification circuit 12 to determine if the change in the position signal exceeds a preset limit.

If the limit exceeds the signal, it is considered discontinuous and is defined as dual point user input. Information that the current input is a dual-point user input is sent to the second verify circuit 14.

Differentiator 10 and verify circuit 12 are provided to determine whether a dual-point input has occurred. If a dual-point user input is detected, the second verification circuit 14 is used to determine the actual two points at which the user is expected to be in contact with the touch pad 2.

The second verification circuit 14 calculates the actual dual point user input point using the first position previously stored in the memory 8 and the actual position received via the interface 4.

In order to calculate both points of the expected actual dual-point user input, the equations previously described in connection with FIG. 7 can be used. The second verify circuit 14 sends the calculated dual point user input point to the processor 18 via the interface 16 to control the application running on the processor.

An application running on the processor 18 may transmit the controlled information to the second verification circuit 14 via the interface 16.

In the present invention, the characteristics of a touch pad that can output information for only a single input location point regardless of the actual input point or area number allow dual input, as for example, for a sensing touch pad. do.

The present invention is essentially a two step process. In the first step, dual input conditions are detected by monitoring hardware signals. In a second step, a substantially second input point is calculated based on the first input point and the center point.

The present invention provides a single method of allowing dual input on a touch pad made for only a single input. In addition, it is possible to implement dual input on an existing touch-based input device at low cost. The present invention creates the characteristics of a new user interface and can also improve its use on devices using touch pads or touch screens.

The method of the present invention is a novel method for interpreting a sensed touch pad signal and the implementation is possible via software. Thus, this new technology implemented in the present invention can be implemented in a sensitive touch pad device or other touch pad technology that operates similarly.

One useful feature of conformance touch pad technology is that when two input points are contacted in an active input area, the devices (built on the basis of a single input) interpret the state and then center the line between the two input points. Only one point corresponding to the point is interpreted as being touched.

Originally, only an uncertain signal and an uncertain relationship between a point of contact and two input points connected simultaneously are practically required. In such a case, the derivative of the third location point P2 may be more complicated.

This principle of operation is simple and the implementation only requires minor modifications in the software of the hardware driver module. The implementation and characterization of the new implementation is justified, so development time in research and development can be carried out in a short time.

The invention can be easily implemented and tested. The present invention can be used in certain applications when implementing the full user integration interface-style takes time.

The present invention can be implemented only in software and does not require more processing power or memory. The present invention allows for new input concepts and reimplemented user interface styles. The present invention allows a user interface with features of dual point user input not previously available while still using existing hardware technology.

Note that in the present invention, only flat and rectangular touch input devices are illustrated, but the present invention can also be implemented in a sector shape touch input device having a circular, elliptical or circular or ring shape. The invention can also be implemented in curved or even spherical touch input devices. Corrector terms may also be used to implement the invention even in the case of non-Euclidean touch sensor distribution.

Note that throughout the present invention, the touch pad expression is used to indicate all types of touch-based input devices such as touch pads, touch screens, and touch displays.

Note that the present invention may also be applied to the detection of two or more user input points. Starting from a two-point user input, if a movement of a second discontinuity signal is detected, the first center point can be used to calculate a third user input point on the touch pad. The problem that occurs at the third input point is the uncertain relationship between the points where the center point between the three input points can move.

In the case of three input points, it is not clear which of the three points is substantially induced by the movement of the center point. However, there are exceptions, for example in the case of a combination of consecutive keys known to a PC (personal computer) user by restarting the PC, such as "Shift-Alt-Del".

The best embodiments have been disclosed in the drawings and specification above. Although specific terms have been used herein, they are used only for the purpose of describing the present invention and are not used to limit the scope of the present invention as defined in the meaning or claims.

In addition, in order to be more faithful to the present invention, it is noted that changes or modifications can be made by those skilled in the art without departing from the spirit of the present invention. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

Claims (22)

A method of recognizing dual point user input on a touch-based user input device, Receiving a first user input associated with a first location at the input device; Forming a first location signal associated with the first user input; Receiving a second user input associated with a second location at the input device; Forming a second position signal associated with the first input and the second input; Determining based on the first location signal and the second location signal when the second user input has its origin in a simultaneous dual point user input; Generating a third position based on the first position signal and the second position signal; And Using the first and third positions as coordinate axes of the dual point user input. The method of claim 1, And wherein said generated third location is substantially the same location as said second user input in said second location. The method according to claim 1 or 2, And the determining step is based on the slope between the first position signal and the second position signal. The method according to any one of claims 1 to 3, Storing the first and third locations. The method according to any one of claims 1 to 4, Detecting movement of the second position; Setting one of the first position or the third position as a reference point; And Calculating a movement of the position other than the reference point by reflecting the reference point on the second position. The method of claim 5, wherein Receiving a signal indicative when the first position or the third position is used as a reference point. The method according to any one of claims 1 to 6, If the second location has its origin in a simultaneous dual point user input, the determining step is based on the first location and at least one boundary area defined by possible input selections, in which case the second location And dual point user inputs are excluded if is not detected to be within one of the border zones. The method of claim 7, wherein And wherein the border area is a half edge distance area that is half the distance from the first location to an edge. The method according to any one of claims 1 to 8, Setting a dual point user input flag if the second location input has its origin within the dual point user input. The method of claim 9, Using the second location as the actual location of the single point user input if the dual point user input flag is set and the second location is determined to have its origin in the simultaneous dual point user input; Characterized in that the method. 11. The method of any of claims 1 to 10, further comprising displaying an indication that the dual point user input has been used. The method according to any one of claims 1 to 11, If the second location input does not have its origin in the dual point user input, setting the second location to a new location of the actual single point user input. The method according to any one of claims 1 to 12, And the input device is only capable of outputting a single input position signal that depends on the actual user input. The method according to any one of claims 1 to 13, Storing the first location signal. The method according to any one of claims 1 to 14, And the second position is different from the first position. A software tool comprising program code means stored on a computer readable medium for performing the method of any one of claims 1 to 15 and executed on a computer or network device. A computer program product, executed on a computer or network device, comprising program code means stored on a computer readable medium for performing the method of any one of claims 1 to 15. A computer program product comprising program code downloadable from a server and executed on a computer or network device for performing the method of any one of claims 1 to 15. A touch based input device controller for a touch based user input device, An input unit connectable to the touch-based user input device to receive successive position signals, each representing a position on the touch-based user input device when the user touches; A memory coupled to the input for storing at least one of the position signals; A differentiator for detecting time dependent movement characteristics between two different consecutive positions; A first verification circuit coupled to said differentiator to determine whether a location following a previous location was caused by a single point user input or by a dual point user input; A second verify circuit for calculating dual point user input based on a first input position and a second consecutive position and coupled to the input, the memory and the first verify circuit; and And an output coupled to the second verify circuit and capable of being coupled to a processing. The method of claim 19, And an input unit coupled to the second verifying circuit and capable of connecting to a processing unit for receiving control information from the processing unit for controlling the operation of the second verifying circuit. Touch-based input devices; A processor; And A controller for connecting the touch-based input device to the processor, wherein the controller is the controller according to claim 19 or 20. The method of claim 21, And the device is a mobile terminal device.

Images