KR101079619B1 - Apparatus and method to provide mulit-touch information in an apparatus providing a touch interface - Google Patents

Abstract

According to an aspect of the present invention, in a device providing a touch interface, data is generated as multi-touch information using multi-touch using a touch reference area of a touch input tool selected in a touch application, and the multi-touch information includes N touch sensor cell groups. Touch information, wherein the touch information includes a touch sensor cell group identifier (ID) of the corresponding touch sensor cell group, a center coordinate, a horizontal length, a vertical length, and state information. .

Multi-touch data, multi-touch information, touch sensor cell group ID, center coordinates, width, height, status information

Description

Apparatus and method for providing multi-touch information in a device providing a touch interface {APPARATUS AND METHOD TO PROVIDE MULIT-TOUCH INFORMATION IN AN APPARATUS PROVIDING A TOUCH INTERFACE}

The present invention relates to an apparatus and method for providing multi-touch information in an apparatus for providing a touch interface.

As mobile phones evolve, so too has the user interface (UI). In particular, various UIs are provided to increase user convenience of a mobile phone, and a representative UI is a touch interface for inputting data using a touch method. In addition, various high resolution touch input devices are being developed as the touch interface is activated, and these high resolution touch input devices can provide high resolution touch data, that is, multi-touch raw data. Here, the high resolution indicates a resolution equal to or greater than a preset threshold resolution.

However, the multi-touch raw data cannot be used directly according to user convenience of the mobile phone. That is, although a high-resolution touch input device is provided, it is possible to provide data by multi-touch, but a specific method of processing data so that the user can directly use the provided multi-touch has not been presented until now. It can not satisfy the various needs of the user of the mobile phone acts as a factor that reduces the user convenience.

Accordingly, there is a need for a method of processing data by multi-touch in a mobile phone and providing the data as multi-touch information.

The present invention proposes an apparatus and method for providing multi-touch information in an apparatus for providing a touch interface.

The device proposed in the present invention; A multi-touch information providing apparatus in a device providing a touch interface, comprising: a control unit for generating data as multi-touch information by multi-touch using a touch input unit and a touch reference area of a touch input tool selected in a touch application The multi-touch information includes touch information of N touch sensor cell groups, and the touch information includes a touch sensor cell group identifier (ID), a center coordinate, and a horizontal length of a corresponding touch sensor cell group. And a vertical length and state information.

The method proposed in the present invention; A method of providing multi-touch information in a device providing a touch interface, the method comprising: generating data as multi-touch information by multi-touch using a touch reference area of a touch input tool selected in a touch application, wherein the multi-touch information is generated. The touch information includes touch information of N touch sensor cell groups, and the touch information includes a touch sensor cell group identifier (ID) of the corresponding touch sensor cell group, a center coordinate, a horizontal length, a vertical length, It is characterized by including the status information.

The present invention enables the multi-touch data to be generated as multi-touch information having a relatively simplified form in a device providing a touch interface, so that a touch application can provide a fast touch interface with only minimal information. There is.

In addition, the present invention provides multi-touch information to simplify touch information (menu selection, execution, gesture, movement, rotation magnification, reduction, etc.) or miniaturization (picture memo, handwriting recognition, thickness, pressure) to suit various touch applications. Recognition, etc.), and the number of multi-touches can be used correspondingly to touch applications.

In addition, the present invention has the effect of generating the multi-touch information by accurately reflecting the variety of touch input tools used in the touch application by generating the multi-touch information using the touch reference area. That is, the present invention increases the operational efficiency of the touch application by enabling accurate generation of multi-touch information regardless of the size of the input tool used in the touch application.

In addition, the present invention makes it possible to provide a structured, relatively simple multi-touch information to implement a variety of touch applications, and to be able to respond to problems that may occur during operation of the touch application relatively easily. .

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that in the following description, only parts necessary for understanding the operation according to the present invention will be described, and descriptions of other parts will be omitted so as not to distract from the gist of the present invention.

The present invention proposes an apparatus and method for providing multi-touch information by processing multi-touch raw data in a device providing a touch interface. Although the present invention describes a device and a method for providing a multi-touch information, for example, a device providing a touch interface to a mobile phone, touch as well as the personal digital assistants (PDAs) as well as the mobile phone. Of course, any device that provides a touch interface for inputting data using a touch method may be implemented. That is, the multi-touch information providing apparatus and method proposed by the present invention can be applied to all devices providing a touch interface.

1 is a view showing the internal structure of a mobile phone according to an embodiment of the present invention.

Referring to FIG. 1, the mobile phone includes a radio frequency (RF) processing unit 111, a sensor unit 113, and data. ) Processing unit 115, audio processing unit 117, camera processing unit 119, image processing unit 121, control unit 123, and key input The unit 125 includes a dispaly unit 127, a memory 129, and a touch input unit 131.

First, the RF processing unit 111 performs a wireless communication operation of the mobile phone. The RF processing unit 111 includes an RF transmitting unit for up converting and amplifying a frequency of a transmitted signal, an RF receiving unit for amplifying a received signal and down converting a frequency, and the like. .

The data processing unit 115 includes a transmitting unit for encoding and modulating the transmitted signal, a receiving unit for demodulating and decoding the received signal, and the like. The audio processing unit 117 may be implemented as a codec, and the codec includes a data codec for processing packet data and an audio codec for processing an audio signal such as voice. The audio processing unit 117 converts and reproduces the digital audio signal received by the data processing unit 115 into an analog signal through the audio codec, or from an audio signal input unit (not shown separately) such as a microphone. The input analog audio signal is converted into a digital audio signal through the audio codec and output to the data processing unit 115.

The memory 129 may include a program memory and a data memory. The program memory may provide programs for controlling general operation of the mobile phone and process data with multi-touch input through the touch input unit 131 according to an embodiment of the present invention to provide multi-touch information. You can store programs that control the operation. In addition, the data memory temporarily stores data generated during the execution of the programs.

The control unit 123 performs a function of controlling the overall operation of the mobile phone. In addition, the control unit 123 may include the data processing unit 115 and a codec. In addition, the control unit 123 controls an operation of providing multi-touch information by processing data with multi-touch input through the touch input unit 131 according to an embodiment of the present invention. Since the control operation performed by the control unit 123 will be described in detail below, detailed description thereof will be omitted.

The camera unit 119 photographs image data, and includes a camera sensor unit that converts the photographed optical signal into an electrical signal, and a signal processing unit that converts the analog image signal photographed from the camera sensor into digital data. do. The camera sensor unit may be implemented as a charge-coupled device (CCD) sensor, and the signal processing unit may be implemented as a digital signal processor (DSP). In addition, the camera sensor unit and the signal processing unit may be implemented integrally, or may be implemented separately.

The image processing unit 121 performs a function of generating screen data for displaying an image signal output from the camera unit 119. The image processing unit 121 processes the image signal output from the camera unit 119 in a predetermined unit, for example, in a frame unit, and processes the frame image data of the display unit 127. And output corresponding to the size. In addition, the image processing unit 121 includes an image codec, compresses the frame image data displayed on the display unit 127 in a predetermined manner, or restores the compressed frame image data to the original frame image data. It performs the function. The image codec may be a Joint Photographic Experts Group (JPEG) codec, a Motion Picture Experts Group 4 (MPEG4) codec, a Wavelet codec, or the like.

The display unit 127 displays an image signal output from the image processing unit 121 on a screen, and displays user data output from the control unit 123. In this case, the display unit 127 may be implemented as an LCD (Liquid Crystal Display) and a TV. In this case, the display unit 127 may include an LCD control unit, a memory capable of storing image data, an LCD display element, and the like. It may include. In this case, when the LCD is implemented using a touch screen method, the display unit 127 may operate as an input unit.

The key input unit 125 includes keys for inputting numeric and character information and function keys for setting various functions. The sensor unit 113 includes various sensors. In addition, the touch input unit 131 receives data by using a touch method and stores the input data in the memory 129. For example, the touch input unit 131 may be implemented as a touch sensor.

1 illustrates the internal structure of a mobile phone according to an exemplary embodiment of the present invention. Next, referring to FIG. 2, when the touch input unit 131 of FIG. 1 is implemented as a touch sensor, the entire touch sensor cell structure is illustrated. Let's explain.

FIG. 2 is a diagram illustrating an entire touch sensor cell structure when the touch input unit 131 of FIG. 1 is implemented as a touch sensor.

Referring to FIG. 2, the entire touch sensor cell 211 has a resolution of nxm according to the resolution of the touch sensor. That is, the entire touch sensor cell 211 includes nxm touch sensor cells, and the position of each of the nxm touch sensor cells is scanned by the control unit 123 in the X direction and the Y direction. It depends on the order in which you do it. In the embodiment of the present invention, it will be assumed that the control unit 123 scans the touch sensor cell from left to right and from top to bottom as an example.

In this case, the coordinates of the uppermost left touch sensor cell 213 are (0,0), and the coordinates of the uppermost right touch sensor cell 215 are (n, 0) and the lowermost left touch sensor The coordinate of the cell 217 is (0, m), and the coordinate of the right bottommost touch sensor cell 219 is (n, m). Accordingly, the touch sensor cell 213 has a position of coordinate (0,0), the touch sensor cell 215 has a position of coordinate (n, 0), and the touch sensor cell 221 has a coordinate (0, m). ), The touch sensor cell 223 has a position of the coordinate (n, m).

In FIG. 2, when the touch input unit 131 of FIG. 1 is implemented as a touch sensor, the entire touch sensor cell structure is described. Next, the touch input unit 131 of FIG. 1 is implemented as a touch sensor with reference to FIG. 3. If so, the sensed touch sensor cells will be described.

FIG. 3 is a diagram schematically illustrating sensed touch sensor cells when the touch input unit 131 of FIG. 1 is implemented as a touch sensor.

Referring to FIG. 3, it can be seen that the touch sensor cells sensed through the touch sensor are represented by touch sensor cell groups 311, 313, 315, 317 and 319 corresponding to the number of touch input tools. The touch input tool may be determined in various forms such as a finger and a fan according to various touch applications, and the touch reference width and the touch reference length are determined according to the touch input tool. Here, the touch reference horizontal length refers to the horizontal length of the touch reference area, the touch reference vertical length refers to the vertical length of the touch reference area, and the touch reference area corresponds to 1 by the touch input tool. The maximum area that can be sensed when touched twice. For example, when the touch input tool is determined by a finger, the touch reference horizontal length may be 1 cm, for example, and the touch reference vertical length may be 1 cm, for example. Thus, the touch reference area may be 1 cm ² .

Of course, even if the same touch input tool is used, the touch reference width and the touch reference length may be adjusted according to the user. For example, when the touch input tool is determined as a finger, since a man has a larger finger than a woman, the touch reference width and the touch reference length set in the case of a man are the touch reference width and the touch set in the case of a woman. Adjust larger than the standard height.

3 illustrates a case in which a touch input tool is determined as a finger and five touch sensor cell groups are sensed as all five fingers are touched by the touch sensor. The touch sensor cell group indicates touch sensor cells included in the touch reference area, and the touch sensor cell group will be described in detail below, and thus a detailed description thereof will be omitted.

3 illustrates the touch sensor cells sensed when the touch input unit 131 of FIG. 1 is implemented as a touch sensor. Next, the touch sensor cells of FIG. 3 are processed by referring to FIGS. 4 to 8. A method of providing touch information will be described.

4 is a diagram schematically illustrating a method of providing touch information by processing the touch sensor cell group 311 of FIG. 3.

Before describing FIG. 4, the touch reference width is defined as 'input_device_width' and the touch reference height is defined as 'input_device_hight'.

Referring to FIG. 4, the control unit 123 scans data in a multi-touch representing the touch sensor cells stored in the memory 129 according to the scanning order in the X direction and the Y direction, and thus the touch sensor cell. Scan 411 for the first time and detect its coordinates. The coordinate of the touch sensor cell 411 becomes the reference coordinate of the touch sensor cell group 311, and the X coordinate value of the reduced position of input_device_width / 2 in the opposite direction of the X direction based on the reference coordinate is' Assume that 'Probe_Start_x1', the X coordinate value of the increased position by input_device_width / 2 in the X direction is 'Probe_End_x1', and assume that the Y-direction coordinate value of the touch sensor cell 411 is 'Probe_Start_y1'. It is assumed that the Y coordinate value of the position increased by input_device_hight in the direction is 'Probe_End_y1'.

In this case, the touch reference area 413 including the touch sensor cell group 311 may be expressed as end points Probe_End_x1 and Probe_End_y1 at start points Probe_Start_x1 and Probe_Start_y1. The control unit 123 includes coordinates of the touch sensor cells sensed among the touch sensor cells included in the touch reference area 413 in the memory 129 of the touch sensor cells 311. Store in coordinates. Herein, the control unit 123 increases the coordinates of the touch sensor cells included in the touch sensor cell group 311 by increasing the Probe_Start_x1 by '1' from the starting coordinates Probe_Start_x1 and Probe_Start_y1 to Probe_End_x1 and Probe_Start_y1 to '1'. Can be detected by scanning the coordinates up to Probe_End_y1 in increments.

Meanwhile, assuming that the X coordinate value of the coordinate 415 having the minimum value in the X direction among the coordinates of the detected touch sensor cells is 'minimum_x1', the coordinate having the maximum value in the X direction among the coordinates of the detected touch sensor cells. Assume that the X coordinate value 417 is 'maximum_x1', and assume that the Y coordinate value of the coordinate 419 having the minimum value in the Y direction among the coordinates of the detected touch sensor cells is 'minmum_y1', and the detected touch sensor. Assuming that the Y coordinate value of the coordinate 421 having the maximum value in the Y direction among the coordinates of the cells is 'maximum_y1', the X coordinate value of the center coordinate of the touch sensor cell group 311 and the Y coordinate of the center coordinate The value, the width 423 and the length 425 can be detected, as shown in Equations 1 to 4 below.

group_width1 = maximum_x1-minmum_x1

In Equation 1, group_width1 represents the horizontal length 423 of the touch sensor cell group 311.

group_hight1 = maximum_y1-minmum_y1

In Equation 2, group_hight1 represents the vertical length 425 of the touch sensor cell group 311.

group_center_x1 = minmum_x1 + (maximum_x1-minmum_x1) / 2

In Equation 3, group_center_x1 represents an X coordinate value of the center coordinate of the touch sensor cell group 311.

group_center_y1 = minmum_y1 + (maximum_y1-minmum_y1) / 2

In Equation 4, group_center_y1 represents a Y coordinate value of the center coordinate of the touch sensor cell group 311.

Meanwhile, the control unit 123 is the first touch sensor cell detected by the touch sensor cell scanning order in the touch sensor cell scanning order, so that the touch sensor cell group identifier of the touch sensor cell group 311 (ID: Identifier, Hereinafter referred to as 'ID') is set to '1'.

In addition, the control unit 123 may touch the touch sensor cell group 311 of the touch sensor cell group 311, the center coordinates, the horizontal length, the vertical length, and the state information of the touch sensor cell group 311. The information is generated and stored in the memory 129 and provided to the touch application currently in operation. Since the state information will be described in detail below, detailed description thereof will be omitted.

In addition, since the control unit 123 generates the touch information of the touch sensor cell group 311, the control unit 123 deletes data with the multi-touch corresponding to the touch sensor cell group 311 from the memory 129.

In FIG. 4, a method of providing touch information by processing the touch sensor cell group 311 of FIG. 3 has been described. Next, the touch information is processed by processing the touch sensor cell group 313 of FIG. 3 with reference to FIG. 5. It will be described how to provide.

FIG. 5 is a diagram schematically illustrating a method of providing touch information by processing the touch sensor cell group 313 of FIG. 3.

Referring to FIG. 5, since the multi-touch data corresponding to the touch sensor cell group 311 is deleted among the multi-touch data indicating the touch sensor cells stored in the memory 129 as described with reference to FIG. 4. The control unit 123 may scan the touch sensor cell 511 when the data is scanned in the X- and Y-direction scanning data with the multi-touch indicating the touch sensor cells stored in the memory 129. It scans for the first time and detects the coordinates. The coordinate of the touch sensor cell 511 becomes the reference coordinate of the touch sensor cell group 313, and the X coordinate value of the reduced position of input_device_width / 2 in the opposite direction of the X direction based on the reference coordinate is' Assume that 'Probe_Start_x2', the X coordinate value of the increased position by input_device_width / 2 in the X direction is 'Probe_End_x2', and assume that the Y-direction coordinate value of the touch sensor cell 511 is 'Probe_Start_y2'. It is assumed that the Y coordinate value of the position increased by input_device_hight in the direction is 'Probe_End_y2'.

In this case, the touch reference area 513 including the touch sensor cell group 313 may be expressed as end points Probe_End_x2 and Probe_End_y2 at start points Probe_Start_x2 and Probe_Start_y2. The control unit 123 includes coordinates of touch sensor cells sensed among touch sensor cells included in the touch reference area 513 in the memory 129 of the touch sensor cells 313. Store as coordinates. In this case, the control unit 123 increases the coordinates of the touch sensor cells included in the touch sensor cell group 313 by increasing the Probe_Start_x2 by '1' from the start coordinates Probe_Start_x2 and Probe_Start_y2 to Probe_End_x2 and Probe_Start_y2 by '1'. It can be detected by scanning the coordinates up to Probe_End_y2 in increments.

Meanwhile, assuming that the X coordinate value of the coordinate 515 having the minimum value in the X direction among the coordinates of the detected touch sensor cells is 'minimum_x2', the coordinate having the maximum value in the X direction among the coordinates of the detected touch sensor cells. Assume that the X coordinate value 517 is 'maximum_x2', and the Y coordinate value of the coordinate 519 having the minimum value in the Y direction among the coordinates of the detected touch sensor cells is assumed to be 'minmum_y2', and the detected touch sensor Assuming that the Y coordinate value of the coordinate 521 having the maximum value in the Y direction among the coordinates of the cells is 'maximum_y2', the X coordinate value of the center coordinate of the touch sensor cell group 313 and the Y coordinate of the center coordinate The value, the horizontal length 523 and the vertical length 525 can be detected, as shown in Equations 5 to 8 below.

group_width2 = maximum_x2-minmum_x2

In Equation 5, group_width2 represents the horizontal length 523 of the touch sensor cell group 313.

group_hight2 = maximum_y2-minmum_y2

In Equation 6, group_hight2 represents the vertical length 525 of the touch sensor cell group 313.

group_center_x2 = minmum_x2 + (maximum_x2-minmum_x2) / 2

In Equation 7, group_center_x2 represents an X coordinate value of the center coordinate of the touch sensor cell group 313.

group_center_y2 = minmum_y2 + (maximum_y2-minmum_y2) / 2

In Equation 8, group_center_y2 represents a Y coordinate value of the center coordinate of the touch sensor cell group 313.

Meanwhile, the control unit 123 is the first touch sensor cell detected by the touch sensor cell 511 in the touch sensor cell scanning order among the touch sensor cells except the touch sensor cells included in the touch sensor cell group 311. Therefore, the touch sensor cell group ID of the touch sensor cell group 313 is set to '2'.

In addition, the control unit 123 touches the touch sensor cell group ID, the center coordinate, the horizontal length, the vertical length, and the state information of the touch sensor cell group 313 to the touch sensor cell group 313. The information is generated and stored in the memory 129 and provided to the touch application currently in operation. Since the state information will be described in detail below, detailed description thereof will be omitted.

In addition, since the control unit 123 generates the touch information of the touch sensor cell group 313, the control unit 123 deletes data from the memory 129 using the multi-touch corresponding to the touch sensor cell group 313.

In FIG. 5, a method of providing touch information by processing the touch sensor cell group 313 of FIG. 3 has been described. Next, the touch information is processed by processing the touch sensor cell group 315 of FIG. 3 with reference to FIG. 6. It will be described how to provide.

FIG. 6 is a diagram schematically illustrating a method of providing touch information by processing the touch sensor cell group 315 of FIG. 3.

Referring to FIG. 6, a touch sensor cell group 311 and a touch sensor cell group 313 of data are stored in a memory 129 as described above with reference to FIGS. 4 and 5. Since the multi-touch data corresponding to the data has been deleted, the control unit 123 uses the multi-touch data indicating the touch sensor cells stored in the memory 129 in the X- and Y-direction scanning order. When scanning, the touch sensor cell 611 is first scanned and its coordinates are detected. The coordinates of the touch sensor cell 611 become the reference coordinates of the touch sensor cell group 315, and the X coordinate value of the reduced position of input_device_width / 2 in the opposite direction of the X direction with respect to the reference coordinates is' Assume that 'Probe_Start_x3', the X coordinate value of the increased position of input_device_width / 2 in the X direction is 'Probe_End_x3', and the Y-direction coordinate value of the touch sensor cell 611 is assumed to be 'Probe_Start_y3'. It is assumed that the value of Y coordinate of the position increased by input_device_hight in the direction is 'Probe_End_y3'.

In this case, the touch reference area 613 including the touch sensor cell group 315 may be expressed as end points Probe_End_x3 and Probe_End_y3 at start points Probe_Start_x3 and Probe_Start_y3. The control unit 123 may include coordinates of touch sensor cells sensed among touch sensor cells included in the touch reference area 613 in the memory 129 of the touch sensor cell group 315. Store in coordinates. Here, the control unit 123 increases the coordinates of the touch sensor cells included in the touch sensor cell group 315 by increasing the Probe_Start_x3 by '1' from the starting coordinates Probe_Start_x3 and Probe_Start_y3 to Probe_End_x3 and Probe_Start_y3 by '1'. It can be detected by scanning the coordinates up to Probe_End_y3 in increments.

Meanwhile, it is assumed that the X coordinate value of the coordinate 615 having the minimum value in the X direction among the coordinates of the detected touch sensor cells is 'minimum_x3', and the coordinate having the maximum value in the X direction among the detected touch sensor cells. Assume that the X coordinate value of 617 is 'maximum_x3' and the Y coordinate value of the coordinate 619 having the minimum value in the Y direction among the coordinates of the detected touch sensor cells is 'minmum_y3', and the detected touch sensor Assuming that the Y coordinate value of the coordinate 621 having the maximum value in the Y direction among the coordinates of the cells is 'maximum_y3', the X coordinate value of the center coordinate of the touch sensor cell group 315 and the Y coordinate of the center coordinate The value, the width 623 and the length 625 can be detected, as shown in Equations 9-12 below.

group_width3 = maximum_x3-minmum_x3

In Equation 9, group_width3 represents a horizontal length 623 of the touch sensor cell group 315.

group_hight3 = maximum_y3-minmum_y3

In Equation 10, group_hight3 represents the vertical length 625 of the touch sensor cell group 315.

group_center_x3 = minmum_x3 + (maximum_x3-minmum_x3) / 2

In Equation 11, group_center_x3 represents an X coordinate value of the center coordinate of the touch sensor cell group 315.

group_center_y3 = minmum_y3 + (maximum_y3-minmum_y3) / 2

In Equation 12, group_center_y3 represents a Y coordinate value of the center coordinate of the touch sensor cell group 315.

On the other hand, the control unit 123 is a touch sensor cell scanning order among the touch sensor cells excluding the touch sensor cells included in the touch sensor cell group 311 and the touch sensor cell group 313 in the touch sensor cell 611 The touch sensor cell group ID of the touch sensor cell group 315 is set to '3' because it is the first touch sensor cell detected according to FIG.

In addition, the control unit 123 touches the touch sensor cell group ID, the center coordinate, the horizontal length, the vertical length, and the state information of the touch sensor cell group 315. Information is generated and stored in the memory 129 and provided to the touch application currently in operation. Since the state information will be described in detail below, detailed description thereof will be omitted.

In addition, since the control unit 123 generates the touch information of the touch sensor cell group 315, the control unit 123 deletes data with the multi-touch corresponding to the touch sensor cell group 315 from the memory 129.

In FIG. 6, a method of providing touch information by processing the touch sensor cell group 315 of FIG. 3 has been described. Next, the touch information is processed by processing the touch sensor cell group 317 of FIG. 3 with reference to FIG. 7. It will be described how to provide.

FIG. 7 is a diagram schematically illustrating a method of providing touch information by processing the touch sensor cell group 317 of FIG. 3.

Referring to FIG. 7, the touch sensor cell group 311 to the touch sensor cell group 315 of the multi-touch data representing the touch sensor cells stored in the memory 129 as described with reference to FIGS. 4 to 6. Since the multi-touch data corresponding to the data has been deleted, the control unit 123 uses the multi-touch data indicating the touch sensor cells stored in the memory 129 in the X- and Y-direction scanning order. When scanning, the touch sensor cell 711 is first scanned and its coordinates are detected. The coordinate of the touch sensor cell 711 becomes the reference coordinate of the touch sensor cell group 317, and the X coordinate value of the reduced position of input_device_width / 2 in the opposite direction of the X direction based on the reference coordinate is' Assume that 'Probe_Start_x4', the X coordinate value of the increased position by input_device_width / 2 in the X direction is 'Probe_End_x4', and assume that the Y-direction coordinate value of the touch sensor cell 711 is 'Probe_Start_y4'. It is assumed that the value of the Y coordinate of the position increased by input_device_hight in the direction is 'Probe_End_y4'.

In this case, the touch reference area 713 including the touch sensor cell group 317 may be expressed as end points Probe_End_x4 and Probe_End_y4 at start points Probe_Start_x4 and Probe_Start_y4. The control unit 123 includes coordinates of touch sensor cells sensed among touch sensor cells included in the touch reference area 713 in the memory 129 of the touch sensor cells 317. Store in coordinates. Here, the control unit 123 increases the coordinates of the touch sensor cells included in the touch sensor cell group 317 by increasing the Probe_Start_x4 by '1' from the start coordinates Probe_Start_x4 and Probe_Start_y4 to Probe_End_x4 and Probe_Start_y4 by '1'. It can be detected by scanning the coordinates up to Probe_End_y4 in increments.

Meanwhile, it is assumed that the X coordinate value of the coordinate 715 having the minimum value in the X direction among the coordinates of the detected touch sensor cells is 'minimum_x4', and the coordinate having the maximum value in the X direction among the coordinates of the detected touch sensor cells. Assume that the X coordinate value 717 is 'maximum_x4', and the Y coordinate value of the coordinate 719 having the minimum value in the Y direction among the coordinates of the detected touch sensor cells is 'minmum_y4', and the detected touch sensor Assuming that the Y coordinate value of the coordinate 721 having the maximum value in the Y direction among the coordinates of the cells is 'maximum_y4', the X coordinate value of the center coordinate of the touch sensor cell group 317 and the Y coordinate of the center coordinate The value and the width 723 and the length 725 can be detected, as shown in Equations 13 to 16 below.

group_width4 = maximum_x4-minmum_x4

In Equation 13, group_width4 represents a horizontal length 723 of the touch sensor cell group 317.

group_hight4 = maximum_y4-minmum_y4

In Equation 14, group_hight4 represents the vertical length 725 of the touch sensor cell group 317.

group_center_x4 = minmum_x4 + (maximum_x4-minmum_x4) / 2

In Equation 15, group_center_x4 represents an X coordinate value of the center coordinate of the touch sensor cell group 317.

group_center_y4 = minmum_y4 + (maximum_y4-minmum_y4) / 2

In Equation 16, group_center_y4 represents a Y coordinate value of the center coordinate of the touch sensor cell group 317.

Meanwhile, the control unit 123 scans the touch sensor cells among the touch sensor cells except for the touch sensor cells included in the touch sensor cell groups 311 to 315. The touch sensor cell group ID of the touch sensor cell group 317 is set to '4' because it is the first touch sensor cell detected according to FIG.

In addition, the control unit 123 touches the touch sensor cell group ID, the center coordinate, the horizontal length, the vertical length, and the state information of the touch sensor cell group 317 to the touch sensor cell group 317. The information is generated and stored in the memory 129 and provided to the touch application currently in operation. Since the state information will be described in detail below, detailed description thereof will be omitted.

In addition, since the control unit 123 generates the touch information of the touch sensor cell group 317, the control unit 123 deletes data with the multi-touch corresponding to the touch sensor cell group 317 from the memory 129.

In FIG. 7, a method of providing touch information by processing the touch sensor cell group 317 of FIG. 3 has been described. Next, the touch information is processed by processing the touch sensor cell group 319 of FIG. 3 with reference to FIG. 8. It will be described how to provide.

FIG. 8 is a diagram schematically illustrating a method of providing touch information by processing the touch sensor cell group 319 of FIG. 3.

Referring to FIG. 8, the touch sensor cell group 311 to the touch sensor cell group 317 of data, which are stored in the memory 129 as illustrated in FIGS. 4 to 7, are multi-touch data representing touch sensor cells. Since the multi-touch data corresponding to the data has been deleted, the control unit 123 uses the multi-touch data indicating the touch sensor cells stored in the memory 129 in the X- and Y-direction scanning order. When scanning, the touch sensor cell 811 is first scanned and its coordinates are detected. The coordinates of the touch sensor cell 811 become reference coordinates of the touch sensor cell group 319, and the X coordinate value of the reduced position of input_device_width / 2 in the opposite direction of the X direction with respect to the reference coordinates is' Assume that 'Probe_Start_x5', the X coordinate value of the increased position by input_device_width / 2 in the X direction is 'Probe_End_x5', and assume that the Y-direction coordinate value of the touch sensor cell 811 is 'Probe_Start_y5'. It is assumed that the value of the Y coordinate of the position increased by input_device_hight in the direction is 'Probe_End_y5'.

In this case, the touch reference area 813 including the touch sensor cell group 319 may be expressed as end points Probe_End_x5 and Probe_End_y5 at start points Probe_Start_x5 and Probe_Start_y5. The control unit 123 includes coordinates of the touch sensor cells sensed among the touch sensor cells included in the touch reference area 813 in the memory 129 of the touch sensor cells 319. Store in coordinates. Herein, the control unit 123 increases the coordinates of the touch sensor cells included in the touch sensor cell group 319 by Probe_Start_x5 by '1' from the start coordinates Probe_Start_x5 and Probe_Start_y5 to Probe_End_x5 and Probe_Start_y5 by '1'. It can be detected by scanning the coordinates up to Probe_End_y5 in increments.

Meanwhile, it is assumed that the X coordinate value of the coordinate 815 having the minimum value in the X direction among the coordinates of the detected touch sensor cells is 'minimum_x5', and the coordinate having the maximum value in the X direction among the coordinates of the detected touch sensor cells. Assume that the X coordinate value of 817 is 'maximum_x5', and the Y coordinate value of the coordinate 819 having the minimum value in the Y direction among the coordinates of the detected touch sensor cells is 'minmum_y5', and the detected touch sensor Assuming that the Y coordinate value of the coordinates 821 having the maximum value in the Y direction among the coordinates of the cells is 'maximum_y5', the X coordinate value of the center coordinates of the touch sensor cell group 319 and the Y coordinate of the center coordinates The value, the horizontal length 823, and the vertical length 825 can be detected, as shown in Equations 17 to 20 below.

group_width5 = maximum_x5-minmum_x5

In Equation 17, group_width5 represents a horizontal length 823 of the touch sensor cell group 319.

group_hight5 = maximum_y5-minmum_y5

In Equation 18, group_hight5 represents the vertical length 825 of the touch sensor cell group 319.

group_center_x5 = minmum_x5 + (maximum_x5-minmum_x5) / 2

In Equation 19, group_center_x5 represents an X coordinate value of the center coordinate of the touch sensor cell group 319.

group_center_y5 = minmum_y5 + (maximum_y5-minmum_y5) / 2

In Equation 20, group_center_y5 represents a Y coordinate value of the center coordinate of the touch sensor cell group 319.

Meanwhile, the control unit 123 scans the touch sensor cells among the touch sensor cells except for the touch sensor cells included in the touch sensor cell groups 311 to 317. The touch sensor cell group ID of the touch sensor cell group 319 is set to '5' because it is the first touch sensor cell detected according to FIG.

In addition, the control unit 123 touches the touch sensor cell group ID, the center coordinate, the horizontal length, the vertical length, and the state information of the touch sensor cell group 319 to the touch sensor cell group 319. The information is generated and stored in the memory 129 and provided to the touch application currently in operation. Since the state information will be described in detail below, detailed description thereof will be omitted.

In addition, since the control unit 123 generates touch information of the touch sensor cell group 319, the control unit 123 deletes data with the multi-touch corresponding to the touch sensor cell group 319 from the memory 129.

Meanwhile, as described with reference to FIGS. 4 to 8, each of the touch sensor cell groups is set with a touch sensor cell group ID for identifying the corresponding touch sensor cell group. Here, the touch sensor cell group ID is assigned according to the order in which the control unit 123 scans the touch sensor cell group, and thus the touch sensor cell group ID of the touch sensor cell group 311 becomes '1', The touch sensor cell group ID of the touch sensor cell group 313 is '2', the touch sensor cell group ID of the touch sensor cell group 315 is '3', and the touch sensor of the touch sensor cell group 317. The cell group ID is '4', and the touch sensor cell group ID of the touch sensor cell group 319 is '5'.

On the other hand, the touch information of each touch sensor cell group includes state information, and when the first detection is performed, the state information is 'touch down', and after the preset time set in the touch down state elapses, The state information when no touch is sensed in the touch cell group is 'touch up', and the state information when the center coordinate moves in the touch down state is 'touch move'.

Next, a method of providing multi-touch information in a mobile phone according to an embodiment of the present invention will be described with reference to FIG. 9.

9 is a flowchart illustrating a method of processing data by multi-touch in a mobile phone according to an embodiment of the present invention.

Referring to FIG. 9, first, in step 911, the control unit 123 detects a touch input tool selected from a currently running touch application and proceeds to step 913. In step 913, the control unit 123 sets a touch reference width, a touch reference length, and a touch reference area according to the selected touch input tool. If the control unit 123 detects that a touch event occurs from the touch input unit 131 in step 915, the control unit 123 proceeds to step 917.

In step 917, the control unit 123 reads the data with the multi-touch sensed by the touch input unit 131, stores the data in the memory 129, and proceeds to step 919. In step 919, the control unit 123 sets an initial value of the variable n to a default value, for example, '0', in order to generate data as the multi-touch information in step 921. do. In step 921, the control unit 123 checks whether data exists with the multi-touch stored in the memory 129. If there is multi-touch data stored in the memory 129 as a result of the inspection, the control unit 123 proceeds to step 923.

In step 923, the control unit 123 detects the first touch sensor cell by scanning data with multi-touch representing the touch sensor cells stored in the memory 129 according to a preset touch sensor cell scanning order. The coordinates of the first touch sensor cell are set as reference coordinates, the coordinate values of the reference coordinates are stored in the memory 129, and the flow proceeds to step 925. In the embodiment of the present invention, since the touch sensor cell scanning proceeds from left to right and from top to bottom, the first touch sensor cell has a minimum X direction coordinate value and a minimum Y direction coordinate value among the sensed touch sensor cells. It becomes a touch sensor cell.

In step 925, the control unit 123 uses one touch cell to coordinate coordinates of the touch sensor cells scanned as described with reference to FIGS. 4 to 8 using the touch reference area set corresponding to the touch input tool in the reference coordinates. The sensor group is generated as the sensor group and stored in the memory 129. In step 927, the control unit 123 sets the touch sensor cell group ID of the touch cell sensor group to n + 1, that is, '1', and sets the center coordinates, the horizontal length, and the vertical length of the touch cell sensor group. The length and state information are generated as touch information of the touch cell sensor group, stored in the memory 129, and the flow proceeds to step 929.

In step 929, the control unit 123 deletes the multi-touch data corresponding to the touch cell sensor group in which the touch information is generated, from among the multi-touch data stored in the memory 129, and proceeds to step 931. Proceed. In step 931, the control unit 123 increases the value of the variable n to a preset value, for example, 1 and stores the result in the memory 129 and returns to step 921.

On the other hand, if there is no multi-touch data stored in the memory 129 as a result of the test in step 921, the control unit 123 proceeds to step 933. In step 933, the control unit 123 checks whether the variable value of the variable n is 1 or more. If the variable value of the variable n is 1 or more as a result of the inspection, the control unit 123 proceeds to step 935. In operation 935, the control unit 123 provides the touch application with the same number of touch information as the variable value of the variable n to the touch application and ends.

Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined not only by the scope of the following claims, but also by the equivalents of the claims.

1 is a view showing the internal structure of a mobile phone according to an embodiment of the present invention

FIG. 2 is a diagram illustrating the entire touch sensor cell structure when the touch input unit 131 of FIG. 1 is implemented as a touch sensor.

3 is a diagram schematically illustrating sensed touch sensor cells when the touch input unit 131 of FIG. 1 is implemented as a touch sensor.

4 is a diagram schematically illustrating a method of providing touch information by processing the touch sensor cell group 311 of FIG. 3.

FIG. 5 schematically illustrates a method of processing touch sensor cell group 313 of FIG. 3 to provide touch information.

FIG. 6 schematically illustrates a method of processing touch sensor cell group 315 of FIG. 3 to provide touch information.

FIG. 7 schematically illustrates a method of processing touch sensor cell group 317 of FIG. 3 to provide touch information.

FIG. 8 is a diagram schematically illustrating a method of processing the touch sensor cell group 319 of FIG. 3 to provide touch information.

9 is a flowchart illustrating a method of processing data with multi-touch in a mobile phone according to an embodiment of the present invention.

Claims (14)

In the device for providing a touch interface, the multi-touch information providing method, And generating multi-touch raw data as multi-touch information using the touch reference area of the touch input tool selected in the touch application. The touch reference area indicates a maximum area that can be sensed when the selected touch input tool is touched once by the touch sensor. The multi-touch raw data represents high resolution touch data having a predetermined threshold resolution or more, The multi-touch information includes touch information of N touch sensor cell groups. The touch information includes a touch sensor cell group identifier (ID) of the corresponding touch sensor cell group, a center coordinate, a horizontal length, a vertical length, and state information. Each of the X coordinate value and the horizontal length of the center coordinate includes an X coordinate value of a coordinate having a minimum value in the X direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group, and the corresponding touch sensor cell group. It is calculated using the X coordinate value of the coordinate having the maximum value in the X direction among the coordinates of the touch sensor cells, Each of the Y coordinate value and the vertical length of the center coordinates includes a Y coordinate value of a coordinate having a minimum value in the Y direction among coordinates of the touch sensor cells included in the corresponding touch sensor cell group, and the corresponding touch sensor cell group. A method for providing multi-touch information in an apparatus for providing a touch interface, characterized in that it is calculated using the Y coordinate value of the coordinate having the maximum value in the Y direction among the coordinates of the touch sensor cells. The method of claim 1, The method for providing multi-touch information in a device providing a touch interface further comprising the step of providing the generated multi-touch information to the touch application. delete The method of claim 1, The X coordinate value of the center coordinate is expressed as follows, group_center_x = minmum_x + (maximum_x-minmum_x) / 2 (where group_center_x represents the X coordinate value of the center coordinate, and minmum_x represents the minimum value in the X direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group). , minmum_x represents the X coordinate value of the coordinate having the maximum value in the X direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group.) The Y coordinate value of the center coordinate is expressed as follows. group_center_y = minmum_y + (maximum_y-minmum_y) / 2 (where group_center_y represents the Y coordinate value of the center coordinate, and minmum_y represents the minimum value in the Y direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group). , maximum_y represents a maximum value in the Y direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group.) The horizontal length is expressed as follows, group_width = maximum_x-minmum_x, where group_width indicates the width The vertical length is represented as follows. A method for providing multi-touch information in a device providing a touch interface. group_hight = maximum_y-minmum_y (where group_hight indicates the vertical length) The method of claim 1, And the status information indicates one of a touch down, a touch up, and a touch move. The method according to any one of claims 1 to 2 and 4 to 5, Generating data as multi-touch information by multi-touch using a touch reference area of the touch input tool selected in the touch application; A first step of setting an initial value of the variable n to a default value, Detecting a first touch sensor cell by scanning data with the multi-touch according to a touch sensor cell scanning order; Setting a coordinate of the first touch sensor cell as a reference coordinate and generating coordinates of the touch sensor cells scanned using the touch reference area from the reference coordinate as an n + 1 th touch cell sensor group; Generating a center coordinate, a horizontal length, a vertical length, and state information of the touch sensor cell group as touch information of the n + 1th touch sensor cell group; And deleting a multi-touch data corresponding to the n + 1 th touch sensor cell group from the multi-touch data, increasing a value of the variable n, and then proceeding to the second process. The multi-touch information providing method in a device providing a touch interface. The method of claim 6, And wherein the touch reference area indicates a maximum area that can be sensed when the touch input tool is touched once by the touch input unit. In the multi-touch information providing apparatus in a device providing a touch interface, Touch input unit, It includes a control unit for generating multi-touch raw data (multi-touch raw data) using the touch reference area of the touch input tool selected in the touch application, The touch reference area indicates a maximum area that can be sensed when the selected touch input tool is touched once by the touch sensor. The multi-touch raw data represents high resolution touch data having a predetermined threshold resolution or more, The multi-touch information includes touch information of N touch sensor cell groups. The touch information includes a touch sensor cell group identifier (ID) of the corresponding touch sensor cell group, a center coordinate, a horizontal length, a vertical length, and state information. Each of the X coordinate value and the horizontal length of the center coordinate includes an X coordinate value of a coordinate having a minimum value in the X direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group, and the corresponding touch sensor cell group. It is calculated using the X coordinate value of the coordinate having the maximum value in the X direction among the coordinates of the touch sensor cells, Each of the Y coordinate value and the vertical length of the center coordinates includes a Y coordinate value of a coordinate having a minimum value in the Y direction among coordinates of the touch sensor cells included in the corresponding touch sensor cell group, and the corresponding touch sensor cell group. The multi-touch information providing apparatus of the apparatus for providing a touch interface, characterized in that calculated using the Y coordinate value of the coordinate having the maximum value in the Y direction among the coordinates of the touch sensor cells. The method of claim 8, And the control unit provides the generated multi-touch information to the touch application. delete The method of claim 8, The X coordinate value of the center coordinate is expressed as follows, group_center_x = minmum_x + (maximum_x-minmum_x) / 2 (where group_center_x represents the X coordinate value of the center coordinate, and minmum_x represents the minimum value in the X direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group). , minmum_x represents the X coordinate value of the coordinate having the maximum value in the X direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group.) The Y coordinate value of the center coordinate is expressed as follows. group_center_y = minmum_y + (maximum_y-minmum_y) / 2 (where group_center_y represents the Y coordinate value of the center coordinate, and minmum_y represents the minimum value in the Y direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group). , maximum_y represents a maximum value in the Y direction among the coordinates of the touch sensor cells included in the corresponding touch sensor cell group.) The horizontal length is expressed as follows, group_width = maximum_x-minmum_x, where group_width indicates the width The vertical length is expressed as follows: multi-touch information providing apparatus in the device providing a touch interface. group_hight = maximum_y-minmum_y (where group_hight indicates the vertical length) The method of claim 8, And the status information indicates one of a touch down, a touch up, and a touch move. The method according to any one of claims 8 to 9 and 11 to 12, The control unit has a first operation of setting an initial value of the variable n to a default value, A second operation of detecting an initial touch sensor cell by scanning data with the multi-touch according to a touch sensor cell scanning order; A third operation of setting coordinates of the first touch sensor cell as reference coordinates and generating coordinates of the touch sensor cells scanned using the touch reference area in the reference coordinates as an n + 1 th touch cell sensor group; Generating a center coordinate, a horizontal length, a vertical length, and state information of the touch sensor cell group as touch information of the n + 1th touch sensor cell group; And deleting the multi-touch data corresponding to the n + 1th touch sensor cell group from the multi-touch data, increasing the value of the variable n, and performing the second operation again. Multi-touch information providing apparatus in the device providing the interface. The method of claim 13, And wherein the touch reference area indicates a maximum area that can be sensed when the touch input tool is touched once by the touch input unit.

Images