WO2013191491A1

WO2013191491A1 - Touch sensing apparatus and touch sensing method

Info

Publication number: WO2013191491A1
Application number: PCT/KR2013/005461
Authority: WO
Inventors: 원광연; 황성재
Original assignee: 한국과학기술원
Priority date: 2012-06-20
Filing date: 2013-06-20
Publication date: 2013-12-27

Abstract

The present invention relates to a touch sensing apparatus and a touch sensing method. The touch sensing apparatus comprises: a vibration generation unit for vibrating a mobile terminal; a vibration energy measurement unit for measuring vibration energy generated by a vibration operation of the mobile terminal; and a touch pressure intensity measurement unit for measuring the intensity of touch pressure on the basis of a change in the vibration energy when the vibration energy is changed by the touch of a user. Thus, the present invention can sense the touch state of a user and the intensity of touch pressure by utilizing a unit included in a mobile device, and can recognize touch actions in all parts through which vibrations can be transferred as well as a touch screen area.

Description

Touch sensing device and method

An object of the present invention is to provide a touch sensing device and a method for sensing a user's touch and a touch pressure strength by using a device provided in a mobile terminal.

Touch screen means that if a person's hand or an object touches a character or a specific location on the screen (screen) without using a keyboard, the input screen can be input directly on the screen so that the location can be detected and processed by the stored software. It refers to a screen that can be received, and is widely used as an input screen of a mobile terminal such as a mobile phone or a computer. The touch screen is generally divided into a pressure sensitive type and a capacitive type (capacitive type), and the pressure sensitive type has an advantage that there is no limitation on the input device by detecting a pressure change on the touch screen. The capacitive type senses a touch by using a minute current flowing through the body, and has the advantage of multi-touch and quick response. However, since the capacitive touch screens commercialized so far cannot distinguish the pressure (intensity) to touch, only the on-off type touch control is possible. Furthermore, in the conventional touch input strength measurement, the touch intensity is measured according to the contact between the touch pad and the electrode, but in this case, a problem of deterioration of image quality due to the spaced space between the touch pad and the electrode layer occurs.

On the other hand, Korean Patent Laid-Open Publication No. 10-2009-0127544 provides a technique for measuring a touch time by measuring a contact time using an acceleration sensor and summing dispersion values of signal information of the acceleration sensor during the measured time. However, since the above technique is a method of summing signal information of all measured acceleration sensors, when the actual vibration is caused by external vibration (for example, in a bus) rather than by human touch, There is a problem that all the sensor signal information is added to the intensity of the touch input. In addition, there is a limit that it is not possible to determine the act of changing the pressure after the touch.

Higher input resolutions are required for a better user experience, and pressure awareness is increasing, especially in touchscreen environments. However, in the situation where it is difficult to equip a mobile terminal such as a mobile phone with a physical button anymore, it is urgent to achieve this purpose by utilizing existing components used in the mobile phone in various ways.

There is a problem in that new hardware must be provided for higher input resolution. In addition, the current mobile device has a problem that the interaction area is limited within the touch screen.

Therefore, there is a need for a method capable of measuring the strength of pressure even with a sensor provided in advance and a method of extending the interaction range of a mobile device.

Therefore, the present invention can have the same effect only by the vibration motor / microphone and software provided in the existing device without having hardware such as a pressure sensor, and can recognize the touch behavior in all parts to which vibration is transmitted as well as the touch screen area. It is an object of the present invention to provide a new interaction method and apparatus for controlling a terminal in such a manner.

The present invention can also sense the contact strength to the user terminal only by the device provided in the existing equipment without having hardware such as a pressure sensor, and furthermore, the terminal area, for example, the touch screen area that is not provided with a touch sensor The present invention provides a method, apparatus, and application method of contact strength sensing of a user terminal, which can recognize a contact strength of an external object (for example, a user's hand) with respect to the user terminal.

As a means for solving the above problems, according to an embodiment of the present invention, a touch sensing device of a mobile terminal, comprising: a vibration generating unit for vibrating the mobile terminal; Vibration energy measuring unit for measuring the vibration energy generated by the vibration operation of the mobile terminal; And a touch pressure intensity measuring unit which measures the touch pressure intensity based on the change amount of the vibration energy when the vibration energy is changed by the user touch.

The vibration energy measuring unit measures the vibration energy based on the sound generated by the vibration operation of the mobile terminal.

The vibration energy measuring unit includes a microphone for measuring a sound generated by the vibration operation of the mobile terminal; And a frequency spectrum analyzer configured to analyze the frequency spectrum of the sound and calculate vibration energy.

The vibration energy measuring unit measures vibration energy based on the amount of movement change generated by the vibration operation of the mobile terminal.

The vibration energy measuring unit includes a motion sensor for sensing the movement of the mobile terminal by the vibration operation of the mobile terminal; And a motion change amount analyzing unit configured to calculate vibration energy from the motion change amount of the mobile terminal. The vibration generating unit is characterized in that the vibration motor.

As a means for solving the above problems, a contact strength sensing device of a user terminal according to an embodiment of the present invention, a vibration generating unit for vibrating the user terminal; Vibration variable measuring unit for generating a vibration variable, generated in accordance with the absorption of the vibration by the external object in contact with the user terminal vibrating by the vibration generating unit; And a contact strength determiner for determining a contact strength of the external object with respect to the user terminal according to the vibration variable measured by the vibration variable measurer.

The vibration parameter measuring unit is one of a motion sensor such as an acceleration sensor, a geomagnetic sensor, and a gyroscope (rotation) sensor provided in the user terminal.

The vibration variable is a variable that may vary from the contact strength of the external object in contact with the user terminal.

The vibration variable is one or more of vibration energy, vibration distance, vibration speed, vibration acceleration.

The external object may be a skin of a person who comes into contact with the user terminal.

The vibration absorption of the external object is characterized in that it depends on the contact strength.

As a means for solving the above problem, the contact strength sensing method of the user terminal according to another embodiment of the present invention, the external object in contact with the user terminal from the vibration variable caused by absorbing the vibration generated in the user terminal The contact strength between the external object and the user terminal is determined. The vibration variable is one or more of vibration energy, vibration distance, vibration speed, vibration acceleration.

The touch intensity sensing method of the user terminal may include detecting a vibration variable after absorbing vibration of an external object in contact with the user terminal; And determining the contact strength with respect to the user terminal from the vibration variable.

The vibration variable is a variable measured by an acceleration sensor provided in the user terminal.

The vibration variable is a variable that may vary from the contact strength of the external object in contact with the user terminal. As a means for solving the above problems, a user terminal control method according to another embodiment of the present invention, the step of measuring the vibration variable from the vibration occurring in the user terminal; Detecting a change in the vibration variable resulting from vibration absorption of an external object in contact with the user terminal; Determining a contact strength with respect to the user terminal from the detected change in the vibration variable; And performing a predetermined control command stored in the user terminal from the determined contact strength.

The performing of the predetermined control command may include: comparing the determined contact strength with a predetermined contact strength; Determining a predetermined contact strength matching the determined contact strength; And performing a control command assigned to the matched preset contact strength.

In order to solve the above problems, another embodiment of the present invention is a user terminal control device, the sensing unit for sensing the vibration of the user terminal; And a controller configured to determine a control command for the user terminal according to the vibration change pattern for the user terminal. In one embodiment of the present invention, the vibration change pattern is determined according to a combination of at least one of the touch intensity, the number of touches, and the touch period of the external object with respect to the user terminal. In one embodiment of the invention, the external object is a human hand. In an embodiment of the present invention, the user terminal controller includes a motion sensor, and the vibration intensity is calculated as a motion coefficient of the user terminal sensed by the motion sensor. In one embodiment of the present invention, the motion sensor of the user terminal control device, any one or a combination of two or more of a gyroscope, an acceleration sensor, a camera, a geomagnetic sensor. In one embodiment of the present invention, the stronger the touch intensity of the external object, the lower the vibration intensity. .

The present invention provides a touch sensing method that can have a large effect at low cost because it can have the same effect only with the vibration motor / microphone and software provided in the existing equipment without having a hardware such as a pressure sensor.

Since the present invention uses the vibration of the entire mobile device, the input range is not limited to a specific position. As a result, the touch sensitive area of the present invention can extend beyond the touch screen area to the entire mobile device.

1 relates to a touch sensing device according to an embodiment of the present invention.

2 is a view for explaining a touch sensing method according to an embodiment of the present invention.

3 is a diagram illustrating a sound measured according to an embodiment of the present invention.

4 relates to a touch sensing device according to another embodiment of the present invention.

5 is a view for explaining a touch sensing method according to another embodiment of the present invention.

6 is a diagram illustrating an application example of a mobile terminal of a touch sensing device according to an embodiment of the present invention.

7 is a diagram illustrating a display example of user touch pressure strength according to an exemplary embodiment of the present invention.

8 is a diagram showing an example of display of user touch pressure strength according to another embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

However, in describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. Even if the terms are the same, if the displayed portions are different, it is to be noted that the reference numerals do not match.

The terms to be described below are terms set in consideration of functions in the present invention, and may be changed according to a user's intention or custom such as an experimenter and a measurer, and the definitions should be made based on the contents throughout the present specification.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. A singular expression includes a plural expression unless the context clearly indicates otherwise.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, the same reference numerals are used for the same elements in the drawings and redundant descriptions of the same elements will be omitted.

Referring to Figure 1, the touch sensing device 100 of the present invention is a vibration generating unit 110 for vibrating the mobile terminal at a predetermined vibration frequency, vibration energy measurement for measuring the vibration energy generated by the vibration operation of the mobile terminal When the vibration energy is changed by the unit 120 and the user touch, the touch sensor 130 may include a touch sensing controller 130 that measures the touch pressure intensity based on the vibration energy change amount.

The touch sensing device 100 is provided in a mobile terminal such as a smart phone or a tablet PC to measure whether the user touches or presses hard on the mobile terminal.

According to the present invention, when a part of a user's body (for example, a finger) is touched by a mobile terminal generating vibration, a part of the vibration is transmitted to and absorbed by the user's body to reduce vibration energy. The sensing area may extend beyond the touch screen area to the entire mobile device. That is, in the present invention, even if the user touches not only the touch screen but also the back of the device or the corner of the device, the user can measure whether the user touches or the touch pressure intensity by using the vibration energy change phenomenon. Subsequently, the vibration generating unit 110 may be implemented as a vibration motor already provided in the mobile terminal. That is, the vibration motor provided in the mobile terminal is recycled to generate vibrations required for the touch pressure intensity measurement operation. Of course, when there is no vibration motor in the mobile terminal it is natural that a separate vibration motor can be additionally provided. The vibration energy measuring unit 120 measures the vibration energy based on the sound generated by the vibration operation of the mobile terminal, and for this purpose, the microphone 121 measuring the sound generated by the vibration operation of the mobile terminal, and a microphone. It may be configured to include a frequency spectrum analyzer 122 for analyzing the frequency spectrum of the sound measured by the 121 to calculate the vibration energy.

When the mobile terminal vibrates, a sound due to vibration inevitably occurs, and the vibration sound at this time is also changed according to whether the user touches or the touch pressure intensity. Accordingly, in the present invention, vibration energy is indirectly measured through sound energy, and based on this, whether a user touches or touch pressure strength can be detected.

The touch sensing controller 130 presets and stores a minimum vibration energy change amount (that is, a threshold value) for detecting a user touch and information for converting the vibration energy change amount into a touch pressure intensity change amount in advance. Then, the vibration energy change amount is calculated while monitoring the sound measured by the vibration energy measurement unit 120, and the vibration energy change amount and the threshold value are compared and analyzed to determine whether the user touches. In addition, when the occurrence of the user touch is confirmed, the amount of change in the sound energy based on the converted information is converted into the touch pressure intensity to notify the user.

First, when a touch sensing operation is requested by the user, the touch sensing apparatus 100 vibrates the mobile terminal (S11), and measures sound generated by vibration of the mobile terminal (S12).

After acquiring sound energy by analyzing the frequency spectrum of the measured sound (S13), the sound energy is changed by comparing the previously obtained sound energy with the currently obtained sound energy (S14). In this case, the sound energy may be calculated from the sum of the sound energy for each frequency.

As a result of checking in step S14, if the sound energy has changed more rapidly than the threshold compared to the previous, it is determined that the user is touching the mobile terminal (S15).

The sound energy change amount is calculated by comparing the sound energy before the touch and the sound energy after the touch, and the touch pressure intensity is calculated from the sound energy change amount by referring to the preset conversion information (S16).

Referring to FIG. 3, it can be seen that the sound frequency spectrum is gradually changed according to the strength of the pressure of the user touching the mobile terminal. That is, it can be seen that sound energy decreases as the user touch pressure intensity on the mobile terminal increases.

As described above, when the mobile device vibrates, the physical vibration is transmitted and absorbed through the user's body (especially the skin) according to the intensity of the user's grip gesture or touch gesture. This is due to the phenomenon of reduced energy. Accordingly, in the present invention, it is possible to check whether the user touches the mobile terminal and how hard the user is holding or pressing the mobile terminal. In addition, the present invention may be to measure the vibration energy based on the movement of the mobile terminal instead of the sound generated by the vibration operation of the mobile terminal.

4 is a view illustrating a touch sensing device according to another embodiment of the present invention, wherein the vibration energy measuring unit 140 of FIG. 4 is operated by the vibration operation of the mobile terminal instead of the microphone 121 and the frequency spectrum analyzer 122. Including a motion sensor 141 for sensing the movement of the mobile terminal and a motion variation analyzer 142 for calculating vibration energy from the movement of the mobile terminal, based on the movement of the mobile terminal generated by the vibration operation of the mobile terminal As can be seen from the vibration energy.

In this case, the motion sensor 141 may be implemented as a motion sensor already provided in the mobile terminal, such as an acceleration sensor, a gyroscope, a compass sensor, and the like. Of course, if there is no motion sensor in the mobile terminal it is natural that a separate motion sensor can be additionally provided.

5 is a view for explaining a touch sensing method according to another embodiment of the present invention, which is a method for measuring the touch pressure intensity based on a mobile movement.

First, when a touch sensing operation is requested by the user, the touch sensing apparatus 100 vibrates the mobile terminal (S21), and then senses the movement of the mobile terminal through the motion sensor (S22).

After calculating the motion energy by tracking the movement of the mobile terminal (S23), it is checked whether the motion energy changes by comparing the previously obtained motion energy with the currently obtained motion energy (S24). In this case, the sound energy may be calculated by collecting and accumulating the amount of motion generated during the predetermined period.

As a result of checking in step S24, if the movement energy has changed more rapidly than the threshold compared to the previous, it is determined that the user is touching the mobile terminal (S25).

After calculating the movement energy change by comparing the movement energy before the touch and the movement energy after the touch, the movement energy change amount is converted into the touch pressure intensity and output by referring to the preset conversion information (S26).

As shown in FIG. 6, the mobile terminal is configured as shown in FIG. 2 or FIG. 4 to determine whether the user touches, the touch sensing device 100 capable of sensing the touch pressure strength, and the touch sensing device 100 according to a user's request. The controller 200 may be configured to perform the touch sensing operation, and notify the user of the touch sensing result using the touch screen 300, the speaker 400, and the like.

That is, the mobile terminal utilizes the touch sensing device 100 as one sensing device to sense whether the user touches or the touch pressure intensity, and then the sensing result is transmitted to the user through the touch screen 300 and the speaker 400. You can report audio-visually. For example, as shown in FIG. 7, the user's touch pressure intensity may be displayed in text form, or may be displayed in graphic form as shown in FIG. 8. In this case, the graphic display position may be determined and changed according to the touch position value obtained through the touch screen 300.

In addition, the mobile terminal may adjust the speaker volume by using the touch pressure intensity sensing result of the touch sensing device 100, or answer the call without using a button input operation by using a user's touch (for example, a touch or a 쥠 gesture). For example, the touch sensing device 100 may be utilized as a user interface device.

According to another embodiment of the present invention, when the user catches a vibrating terminal, the degree of vibration absorption (Vibration absorption or Vibration damping) depends on the grabbing force (ie, contact strength). Sensing the contact strength for the terminal. Herein, the contact strength means a force applied to the user terminal by an external object contacting the user terminal such as a mobile phone.

9 is a block diagram of a contact strength sensing device according to an embodiment of the present invention.

Referring to FIG. 9, the contact strength sensing apparatus 100 according to an embodiment of the present invention may include a vibration generator 110 for vibrating a user terminal at a preset vibration frequency and a variable extracted from vibration of the user terminal. From the vibration variable measuring unit 120 for measuring the vibration variable) and the changed vibration variable generated in accordance with the absorption of the vibration by the external object in contact with the user terminal, the contact strength of the object to the user terminal The contact strength determining unit 130 to determine.

The touch sensing device 100 according to the present invention may be provided in a user terminal such as a smart phone, a tablet PC, and the like to determine whether the user is touching the user terminal with what strength.

That is, according to the present invention, when a part of the user's body (for example, an external object such as a finger) comes into contact with a user terminal where vibration is occurring, the vibration part is transmitted or absorbed to the user's body, so-called vibration absorption. ), And the degree of vibration absorption by the external object depends on the contact strength between the external object and the user terminal.

In the present invention, the vibration variable that is varied by the absorption of vibration by an external object is extracted through a vibration measuring unit such as an acceleration sensor, and the contact strength is inferred from the change of the vibration parameter to determine it. That is, the vibration variable in the present invention may be changed when the terminal vibration is absorbed in the skin of a person such as energy, vibration distance, vibration speed, vibration acceleration, and the like. Any vibration variable extracted from the vibration may be the vibration variable. Can be

10 is an analysis result of an accelerometer measuring contact strength and vibration absorption thereof.

Referring to FIG. 10, the force (contact strength) applied to the user terminal may be measured by a vibration variable such as a spatial displacement of the user terminal measured by the acceleration sensor, which may be distinguishable from the reading data of the acceleration sensor. It appears as a difference. For example, in FIG. 2, the hard press, the light press, and the release release the terminal, the acceleration sensor recognizes the data differently, and the pattern depends on the force holding the user terminal. You can see the pattern. Therefore, the present invention can measure the contact strength in the entire area of the terminal using only the software for measuring the degree of vibration absorption. Therefore, the contact strength sensing method and apparatus according to the present invention has an advantage that the entire terminal can be sensed only by software without a separate hardware configuration. That is, the present invention has a big difference in the method of recognizing the pressure of the prior art, the prior art was a method of obtaining the touch strength by providing a hardware in which the resistance is variable according to the pressing pressure in a portion of the mobile device, the present invention is constant Vibration is applied to the device, and the vibration absorbed in accordance with the applied pressure is sensed by the acceleration sensor, and then the contact strength is obtained therefrom. Therefore, there is no need to use a separate hardware, there is an advantage that can quickly calculate the strength of the contact pressure quickly and simply.

In the present invention, the vibration variables obtainable from the vibration absorption described in FIG. 2 are not only spatial displacements of these terminals, but also any vibration variables that can be varied from the vibration absorption (this is another method by another sensor. May be sensed) is within the scope of the present invention. For example, vibration displacement (spatial and temporal), speed, vibration energy, etc. may be the vibration variables.

11 to 13 are photographs of a case in which the user grips the user terminal weakly, if the user grips it with a moderate force, according to the contact strength sensing method according to the present invention.

In Figs. 11 to 13, the red circle size represents the intensity of the contact pressure determined from the vibration parameter, and it can be seen that the red circle size of Figs. 11 to 13 is consistent with the actual grip force. In particular, it can be seen from FIGS. 3 to 5 that effective touch intensity detection is possible even when the user touches only the back and side surfaces without touching the touch screen.

In an embodiment of the present invention, the vibration variable Vmotion2 at time 2 was obtained as in Equation 1 below.

[Equation 1]

V _motion2 = (| X _acc2 -X _acc1 | + | Y _acc2 -Y _acc1 | + | Z _acc2 -Z _acc1 |) × 100

In the formula, X, Y, Z means X, Y, Z axis and gradually acc1 and acc2 are measured values from the acceleration sensor. Where acc2 is the value at time 2 and acc1 is the sensor value at time 1 measured 50ms before acc2. In addition, by multiplying the difference in sensing value for 50ms in the above expression by 100, the value was increased to a level that can be distinguished.

Referring to the above equation and the results of FIG. 10, the grip on the Z axis has the largest difference according to the force, which is determined by the position of the linear motor moving along the Z axis. (At this time, the algorithm for obtaining the vibration variable is not limited to the above equation, and any algorithm may be used as long as it uses only the z-axis or the motion change such as the absolute value of the change in the x, y, z three-dimensional vector, which is included in the present invention. )

The present invention provides a contact strength sensing method for determining the contact strength between the external object and the user terminal from the vibration variable as the external object in contact with the user terminal absorbs the vibration generated in the user terminal through the above-described device. .

14 is a flowchart of one specific embodiment for implementing the above-described method.

Referring to FIG. 14, the contact strength sensing method may include detecting a vibration variable from vibrations generated in a user terminal (S110); After the vibration absorption of the external object in contact with the user terminal, the changed vibration variable is detected (S120); And determining a contact strength with respect to the user terminal from the changed vibration parameter (S130).

In one embodiment of the present invention, the vibration variable is a variable measured by an acceleration sensor provided in a user terminal. In the case of a 3-axis sensor, the displacement in each axis may be the vibration variable. Since the vibration variable and the change in the vibration variable according to the vibration absorption are the same as described above, they will be omitted below.

The present invention provides a method of utilizing the touch strength sensed in the above-described manner as a control command signal of the terminal. That is, the terminal control method according to the present invention takes a method of controlling the terminal according to the strength of the contact with the vibrating terminal.

15 is a flowchart illustrating a method for controlling a user terminal according to an embodiment of the present invention.

Referring to FIG. 15, after the vibration absorption of the external object in contact with the vibrating user terminal, a vibration variable is detected (S210); Determining a contact intensity with respect to the user terminal from the vibration variable (S220); And performing a preset control command S230 stored in the user terminal from the determined contact strength. In another embodiment of the present invention, the vibration variable extracted from the vibration before the vibration absorption is detected before the step S210, it can be used as a reference value for the vibration parameter change.

Herein, the control command according to the contact strength determined as the vibration variable may be stored in advance in the terminal storage unit. In this case, the control command corresponding to the matched contact intensity is matched by matching the actually determined contact intensity with the stored control command. This is done.

16 to 19 are diagrams illustrating an example of use of a user terminal including a contact strength sensing device according to an embodiment of the present invention.

Referring to FIGS. 16 to 19, the user may receive a call received by vibration through the gesture of firmly grasping the vibrating user terminal (FIGS. 16 and 17) or photograph by a camera provided in the terminal (FIG. 18). And 19). In addition, as a gesture of holding or tapping the terminal when vibrating, various control commands for the terminal can be performed, all of which are within the scope of the present invention.

Unlike the touch screen which is recognized only when the user's body touches directly, the gesture can be recognized even when it is in various objects such as inside a pocket or a bag. In particular, in one embodiment, when the mobile phone is located in the user's pocket, when the call is received it can be rejected by simply pressing on the user's pocket. This can be especially useful for rejecting ringtones that suddenly come from the same space as a meeting. In such a scenario, the vibration to convey the information that the phone is coming can be reused, which can alleviate the battery problem caused by the vibration, and can preset various patterns to the pressing gestures (such as Morse code, pressing strength, repetition numbers, rhythm, etc.). So you can send different rejection messages to the caller. (E.g. during a meeting, driving, eating, etc.)

20 to 22 are diagrams illustrating an example of controlling a terminal according to a vibration change pattern according to an embodiment of the present invention.

Referring to FIG. 20, when the phone comes in the vibration mode, the user briefly holds the user terminal twice (pattern A of FIG. 21). Accordingly, the user terminal can automatically send a message to the sender that it is difficult to answer the call.

Referring to FIG. 21, when the mobile phone is strongly held for a predetermined time as in the pattern C, the reception is immediately rejected without sending a message.

Referring to FIG. 22, when a pressure is applied to a hand holding a mobile phone, when the pressure is changed for a very short time (strong, weak, strong, weak), a vibration change pattern such as a pattern D is formed. Accordingly, the telephone call mode may proceed.

According to the present invention, various holding patterns that can be identified in the user terminal and various control command signals corresponding thereto can be stored in the user terminal in advance, thereby extending the range of the automatic control command in the terminal.

23 is a flowchart illustrating a method for controlling a user terminal according to an embodiment of the present invention.

Referring to FIG. 23, a method of controlling a user terminal according to an embodiment of the present invention may include: sensing vibration of the user terminal (S220); And determining a control command for the user terminal according to the sensed vibration change pattern of the user terminal (S230). That is, in the present invention, the pattern of the gesture of the user holding the user terminal appears as a vibration change pattern, and the user terminal is controlled according to the displayed vibration change pattern. In one embodiment of the present invention, the vibration change pattern may be determined according to at least one combination of at least one of touch, strength, and number of touches of an external object contacting the user terminal, as described above with reference to FIG. 2.

FIG. 24 is a detailed diagram of a method for controlling a user terminal according to another embodiment of the present invention, in which a control command for the user terminal is determined according to a vibration change pattern of the user terminal.

Referring to FIG. 24, in the method of determining a control command for the user terminal according to the sensed vibration change pattern of the user terminal, first, a vibration change generated by a touch between the user terminal and an external object is recognized. (S310). In one embodiment of the present invention, the vibration change may be recognized according to the change in the sensing value obtained by the acceleration sensor. Thereafter, a control command matched to the vibration change pattern is determined according to the recognized pattern of vibration change (S320). In one embodiment of the present invention, the vibration change is a method in which the vibration intensity is greatly reduced in proportion to the touch intensity by an external object such as a hand.

As described above, although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited to the above-described embodiments, which can be variously modified and modified by those skilled in the art to which the present invention pertains. Modifications are possible. Accordingly, the spirit of the invention should be understood only by the claims set out below.

Since the present invention is applicable to an electronic device having a touch screen, industrial applicability is recognized.

Claims

In the touch sensing device of a mobile terminal,

A vibration generator for vibrating the mobile terminal;

Vibration energy measuring unit for measuring the vibration energy generated by the vibration operation of the mobile terminal; And

When the vibration energy is changed by the user touch, the touch sensing device including a touch pressure intensity measuring unit for measuring the touch pressure intensity based on the vibration energy change amount.
According to claim 1, wherein the vibration energy measuring unit

Touch sensing device, characterized in that for measuring the vibration energy based on the sound generated by the vibration operation of the mobile terminal.
According to claim 2, wherein the vibration energy measuring unit

A microphone for measuring sound generated by the vibration operation of the mobile terminal; And

And a frequency spectrum analyzer configured to analyze the frequency spectrum of the sound and calculate vibration energy.
According to claim 1, wherein the vibration energy measuring unit

Touch sensing device, characterized in that for measuring the vibration energy on the basis of the amount of movement change generated by the vibration operation of the mobile terminal.
The vibration energy measuring unit of claim 4, wherein

A motion sensor for sensing a movement of the mobile terminal due to the vibration operation of the mobile terminal; And

And a movement variation analysis unit for calculating vibration energy from the movement variation of the mobile terminal.
According to claim 1, wherein the vibration generating unit

Touch sensing device, characterized in that the vibration motor.
A mobile terminal comprising a touch sensing device according to any one of claims 1 to 6.
The method of claim 7, wherein the mobile terminal

According to whether the touch detected by the touch sensing device according to any one of claims 1 to 6 and the touch intensity. The mobile terminal further comprises a control unit for performing a control command for the mobile terminal.
In the contact strength sensing device of the user terminal,

A vibration generator for vibrating the user terminal;

Vibration variable measuring unit for generating a vibration variable, generated in accordance with the absorption of the vibration by the external object in contact with the user terminal vibrating by the vibration generating unit; And

And a contact strength determiner for determining a contact strength of the external object with respect to the user terminal according to the vibration variable measured by the vibration variable measurer.
The method of claim 9,

The vibration variable measuring unit is a touch intensity sensing device of the user terminal, characterized in that one of the movement sensor, such as an acceleration sensor, a geomagnetic sensor, a gyroscope (rotation) sensor provided in the user terminal.
The method of claim 9,

The vibration variable is a touch intensity sensing device of the user terminal, characterized in that a variable that can be varied from the contact strength of the external object in contact with the user terminal.
The method of claim 9,

The vibration variable is a touch strength sensing device of the user terminal, characterized in that any one or more of vibration energy, vibration distance, vibration speed, vibration acceleration.
The method of claim 9,

And the external object is a skin of a person in contact with the user terminal.
The method of claim 9,

Absorption of the vibration to the external object is a touch intensity sensing device of the user terminal, characterized in that depending on the contact strength.
A user terminal comprising a contact strength sensing device of the user terminal according to any one of claims 9 to 14.