CN103809782A - touch position compensation method and device - Google Patents

Abstract

The invention relates to a touch position compensation method and device, which are suitable for an electronic device with a touch screen and a plurality of position sensors. The method comprises the steps of detecting the eye position of eyes of a user relative to a touch screen by using a position sensor, obtaining the object position of an object displayed on the touch screen, calculating the visual angle of the object watched by the eyes according to the eye position and the object position, and calculating the parallax of the object watched by the eyes according to the visual angle and the thickness of the touch screen. And finally, compensating the touch position of the object displayed on the touch screen by the finger of the user by using the parallax. According to the invention, the parallax of each object viewed by the user is calculated by detecting the relative position of the eyes of the user relative to the displayed object on the screen, and the touch position detected by the touch screen is adjusted, so that the touch position deviation caused by the parallax can be compensated. In addition, the invention also combines the three-dimensional space detection of the touch screen and the finger size detection of the user, and can improve the accuracy of touch position compensation.

Description

Touch position compensation method and device

technical field

The invention relates to a method and device for detecting a touch position, and in particular to a method and a device for detecting an eye position to compensate for a touch position.

Background technique

Compared with the traditional keyboard input method, the operation method of the touch screen has simple and intuitive advantages. Therefore, today's consumer electronics products such as mobile phones, personal digital assistants, tablet computers, and even notebook computers, desktop computers and various household appliances, There is a trend of using a touch screen instead of a traditional keyboard as an input interface.

In the traditional keyboard input method, the user must press the keyboard while comparing the images displayed on the screen to successfully complete the operation functions such as text input or menu switching. However, if the touch screen operation method is adopted, the user can easily operate various functions of the electronic device by simply clicking with a stylus or directly pressing with a finger. It can be seen that the touch screen is actually a more convenient input method.

However, since the touch panel of the touch screen has a certain thickness, with the user's different viewing postures and angles, parallax will occur when the user's eyes watch the objects displayed under the touch panel. The parallax will cause a gap between the touch position of the finger and the display position of the object when the user touches the object with the finger, and the parallax will become more obvious as the size of the touch screen increases.

For example, FIG. 1( a ) and FIG. 1( b ) are schematic diagrams of parallax when a user watches a screen. Please refer to Figure 1(a) first. When a user watches a mobile phone with a screen size of 3.5 inches (2.9 inches wide and 2 inches high) at a distance of 15 inches, his eyes turn from facing the center of the screen to the edge of the screen. , there will be a viewing angle (viewing angle) difference of 3.8 degrees (height direction) to 5.5 degrees (width direction). When a user watches an all-in-one (AIO) computer with a screen size of 27 inches (23.5 inches wide and 13.2 inches high) at a distance of 20 inches, his eyes turn from facing the center of the screen to When looking at the edges of the screen, this results in a viewing angle of up to 30.4 degrees (widthwise). It can be seen that the viewing angle of the user viewing the screen will increase with the increase of the screen size, thereby increasing the parallax of the user viewing the objects under the screen, resulting in a large gap between the touch position of the finger and the display position of the object , which in turn may cause erroneous operation of the electronic device.

Contents of the invention

In view of this, the present invention proposes a touch position compensation method and device, which can compensate the touch position deviation caused by parallax.

The invention proposes a touch position compensation method, which is suitable for an electronic device with a touch screen and multiple position sensors. The method is to use a position sensor to detect the eye position of the user's eyes relative to the touch screen, and obtain the object position of the object displayed on the touch screen, and calculate the viewing angle of the eye to watch the object according to the eye position and the object position , and according to the viewing angle and the thickness of the touch screen, the parallax of the object viewed by the eyes is calculated. Finally, parallax is used to compensate the touch position where the user's finger touches the object displayed on the touch screen.

The present invention further proposes a touch position compensation device, which includes an eye position detection module, a parallax calculation module, and a position compensation module. Wherein, the eye position detection module uses a plurality of position sensors to detect the eye position of the user's eyes relative to the touch screen. The parallax calculation module is used to obtain the object position of the object displayed on the touch screen, and calculate the viewing angle of the eye viewing the object according to the eye position and the object position, and calculate the parallax of the eye viewing the object according to the viewing angle and the thickness of the touch screen. The position compensation module is used to use the parallax to compensate the touch position of the user's finger touching the displayed object on the touch screen.

Based on the above, the touch position compensation method and device of the present invention calculates the parallax of each object viewed by the user by detecting the relative position of the user's eyes relative to the objects displayed on the screen, and uses it for the detection of the touch screen. The touch position can be adjusted to compensate for the deviation of the touch position caused by parallax.

In addition, the present invention also combines the three-dimensional space detection of the touch screen and the user's finger size detection to improve the accuracy of touch position compensation.

Description of drawings

Fig. 1(a) is a schematic diagram of parallax when a user watches a screen;

Figure 1(b) is also a schematic diagram of parallax when a user watches the screen;

FIG. 2 is a schematic diagram of a finger touching an object displayed on the screen in an embodiment of the present invention.

FIG. 3 is a block diagram of a touch position compensation device according to an embodiment of the present invention.

FIG. 4 is a flowchart of a touch position compensation method according to an embodiment of the present invention.

FIG. 5 is a block diagram of an eye position detection module according to an embodiment of the invention.

FIG. 6 is an example of detecting eye positions in an embodiment of the present invention.

Among them: 22: finger 24: touch screen 242: touch panel 244: display panel 244a-244f: object 30: compensation device 31: eye position detection module 312: first sensing module 314: second sensing module 316: position calculation Module 32: Acquisition of Object Position Module 33: Angle of View Calculation Module 34: Parallax Calculation Module 35: Position Compensation Module S402-S410: Steps

Detailed ways

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail in conjunction with the accompanying drawings.

The present invention combines position sensors such as an image sensor and a proximity sensor configured on an electronic device to detect the relative position between the user's eyes and the screen display objects when watching the screen, and then calculates the The user observes the parallax of the object and compensates for the deviation of the touch position caused by the parallax. Through the above touch position compensation, the present invention can more accurately identify the object that the user intends to operate and the user's action of operating the object.

FIG. 2 is a schematic diagram of a finger touching an object displayed on the screen according to an embodiment of the present invention. Please refer to FIG. 2 , this embodiment illustrates how the user operates the touch screen 24 with fingers 22. The touch screen 24 can be divided into a touch panel 242 and a display panel 244, wherein the touch panel 242 has a thickness Ti, and Objects 244 a - 44 f are displayed on the display panel 244 , for example. Assume that when the user looks at the touch screen 24, his eyes 26 are just facing the object 244b. At this time, if the user touches the object 244b with the finger 22, since the line of sight of the eye 26 watching the object 244b just falls on the touch area corresponding to the object 244b on the touch panel 242, the user touches the object 244b. There will be no touch position deviation due to parallax. However, if the user touches the object 244f with the finger 22, since the line of sight of the eye 26 viewing the object 244f has an angle of view _θf with the normal vector of the touch screen 24, it does not fall on the touch panel 242 in the same direction as the object 244f. Therefore, when the user touches the object 244f, the touch position deviation will occur due to parallax.

Specifically, corresponding to the thickness Ti of the touch panel 242 , there is a parallax Df between the position pt where the user's finger 22 actually touches the touch panel 242 and the center point pf of the object 244 f. Wherein, the parallax Df can be obtained by multiplying the thickness Ti of the touch panel 242 by the tangent value of the viewing angle θf, and the relational formula is as follows:

D _f =T _i ×tanθ _f

Based on the above-mentioned relationship between the eye angle of view and the touch position, the present invention proposes a touch position compensation method and device, which can calculate the angle of view of each object displayed on the touch screen with the user's eyes, thereby compensating the user's touch The touch position deviation of each object due to parallax. Hereinafter, another embodiment will be given in detail.

FIG. 3 is a block diagram of a touch position compensation device according to an embodiment of the invention. Please refer to FIG. 3 , the compensation device 30 of this embodiment is configured in, for example, mobile phones, personal digital assistants, tablet computers, notebook computers, desktop computers, household appliances and other electronic devices with touch screens, or directly integrated in touch screens. It can assist the electronic device to detect the user's operation on the touch screen and properly compensate the touch position on the touch screen.

The compensation device 30 includes an eye position detection module 31, an object position acquisition module 32, a viewing angle calculation module 33, a parallax calculation module 34, and a position compensation module 35. compensation function; these modules can also be programs stored in the electronic device, which can be loaded into the processor of the electronic device to perform the compensation function of the touch position, and there is no limitation here.

FIG. 4 is a flowchart of a touch position compensation method in an embodiment of the present invention. Please refer to FIG. 4, the method of this embodiment is applicable to the compensation device 30 in the above-mentioned FIG.

First, the eye position of the user's eyes relative to the touch screen is detected by the eye position detection module 31 (step S402 ). Wherein, the eye position detection module 31 for example uses more than two position sensors to detect the user's eyes, and calculates the position of the user's eyes relative to the touch screen. The above-mentioned position sensor is, for example, a proximity sensor, a Charge Coupled Device (CCD) sensor or a Complementary Metal-Oxide Semiconductor (CMOS) sensor, which is not limited here.

In detail, FIG. 5 is a block diagram of an eye position detection module in an embodiment of the present invention. Please refer to FIG. 5 , the eye position detection module 31 can be subdivided into a first sensing module 312 , a second sensing module 314 and a position calculation module 316 . Wherein, the first sensing module 312 uses the first position sensor to detect the first distance between the user's eyes and the first position sensor, the first elevation angle and the projected position of the eyes on the touch screen relative to the first position sensor. The first relative direction of the sensor position; the second sensing module 314 will use the second position sensor to detect the second distance between the user's eyes and the second position sensor, the second elevation angle and the projection of the eyes on the touch screen A second relative direction of the position relative to the position of the second position sensor.

According to the above detection data, the position calculation module 316 can further calculate the vertical distance between the eyes and the touch screen by using the first distance and the first elevation angle, or the second distance and the second elevation angle. The position calculation module 316 can also calculate the projected position of the eyes on the touch screen by using the positions of the first position sensor and the second position sensor on the touch screen and the above-mentioned first relative direction and second relative direction. In addition, the position calculation module 316 can also use the above projection position and vertical distance to calculate the position of the eyes relative to the eyes of the touch screen.

第二位置感应器可检测到使用者眼睛与其之间的距离d2、仰角α2以及眼睛在触控屏幕上的投影位置P相对于第二位置感应器位置S2的相对方向 For example, FIG. 6 is an example of detecting eye positions in an embodiment of the present invention. Referring to FIG. 6 , in this embodiment, it is assumed that the first position sensor and the second position sensor of the electronic device are located at positions S1 and S2 respectively, and the user's eyes are located at position E. Referring to FIG. Wherein, the first position sensor can detect the distance d1 between the user's eyes, the elevation angle α1, and the relative direction of the projected position P of the eyes on the touch screen relative to the position S1 of the first position sensor.

The second position sensor can detect the distance d2 between the user's eyes, the elevation angle α2 and the relative direction of the projected position P of the eyes on the touch screen relative to the position S2 of the second position sensor

及

则可计算出眼睛在触控屏幕上的投影位置P。最后，利用投影位置P及垂直距离d3，即可取得眼睛相对于触控屏幕的位置。Wherein, the vertical distance d3 can be calculated by using the geometric relationship between the distance d1 and the elevation angle α1, or the second distance d2 and the second elevation angle α2, and the vertical distance d3 between the eyes and the touch screen. And reuse the first position sensor position S1 and the second position sensor position S2 and the above relative direction

and

Then the projection position P of the eyes on the touch screen can be calculated. Finally, using the projected position P and the vertical distance d3, the position of the eyes relative to the touch screen can be obtained.

After obtaining the position of the eyes relative to the touch screen, the object position obtaining module 32 then obtains the object position of the object displayed on the touch screen (step S404 ). Among them, the object position obtaining module 32 obtains, for example, the screen currently displayed on the touch screen from the operating system of the electronic device or the application program currently being executed by the electronic device, and obtains windows, icons, options, buttons, etc. in the screen from it. The location of the object.

After obtaining the positions of the eyes and the object, the viewing angle calculation module 33 can calculate the viewing angle of the object viewed by the user's eyes (step S406 ). Taking FIG. 2 as an example, the viewing angle calculation module 33 can calculate the viewing angle θf of the user's eyes 26 and the object 244f according to the positions of the eyes 26 and the object 244f.

Then, the parallax calculation module 34 calculates the parallax of the user's eyes viewing the display object on the touch screen according to the aforementioned viewing angle and the thickness of the touch screen (step S408 ). Also taking FIG. 2 as an example, using the viewing angle θf and the thickness Ti of the touch screen, the parallax Df of the object 244f viewed by the user's eyes 22 can be calculated.

Finally, the position compensation module 35 can use the parallax to compensate the touch position of the user's finger touching the object displayed on the touch screen (step S410 ). Wherein, the position compensation module 35, for example, first detects the actual position where the finger touches the touch screen, and calculates the relative direction of the above-mentioned object position relative to the projected position of the eyes on the touch screen, and then moves the actual position touched by the finger toward The relative direction is moved by a distance equal to the parallax, and the moved position is used as the touch position of the finger touching the object displayed on the touch screen. Taking FIG. 2 as an example, the position compensation module 35 moves the touch position pt toward the center point pf of the object 244f by a distance equal to the parallax Df, thereby compensating the original touch position pt to the position pf. In this way, the user can correctly select the object 244f and perform operations.

Through the above method, the compensating device 30 can calculate the parallax of the object displayed on the screen by the user's eyes, and properly compensate the touch position where the user's finger touches the object, so as to more accurately recognize the action of the user operating the object. For example, the compensation device 30 will establish a parallax correspondence table for all objects displayed on the touch screen according to the above method, so that when the user touches the touch screen, the corresponding parallax can be directly found and the touch position can be determined. Compensation, improve the efficiency of compensation.

It should be noted that, in addition to using the position sensor to detect the position of the user's eyes, the present invention can further use sensors such as a gravity sensor, an electronic compass, and a gyroscope to measure the position of the touch screen in three-dimensional space , thereby assisting in judging the posture and angle of the user watching the touch screen, and improving the accuracy of touch position compensation.

For example, the above-mentioned eye position detection module 31 may also include a third position sensor, which, for example, uses a sensor hub (sensor hub) to connect the above-mentioned gravity sensor, electronic compass, gyroscope, etc. in series. The sensor is used to detect the normal vector of the touch screen in the three-dimensional space. The position calculation module 316 can use the above projection position, vertical distance and normal vector to calculate the eye position of the user's eyes relative to the touch screen in the three-dimensional space.

On the other hand, since the size of the user's finger will also affect its touch position on the touch screen, when the finger is thicker, the touch position deviation due to parallax will be more obvious when it touches the touch screen . In view of this, the present invention further detects the size of the user's finger, and calculates the tolerance value of the above-mentioned parallax accordingly, thereby improving the accuracy of touch position compensation.

Specifically, in one embodiment, the compensation device may further include a finger size detection module (not shown), which, for example, will detect the size of the finger according to the proportion of the finger in the image captured by the position sensor, or the finger touches the touch screen. The distribution of the generated multiple touch points, thereby judging the size of the finger. After obtaining the finger size, the finger size detection module can calculate the deviation value of the parallax, and add this deviation value into the calculation formula of the above parallax, so that the finally calculated parallax is more in line with the real situation of the user's finger touch. The relationship between the corrected parallax Di and the viewing angle θf, the thickness Ti of the touch panel 242 and the deviation To is as follows:

D _i =T _i ×tanθ _i ±To

To sum up, the touch position compensation method and device of the present invention calculates the parallax of each object viewed by the user by detecting the relative position between the user's eyes and the screen display objects when watching the touch screen, and uses In order to correct the touch position detected by the touch screen, the deviation of the touch position caused by the parallax can be compensated. In addition, the present invention also combines the three-dimensional space detection of the touch screen and the user's finger size detection to improve the accuracy of touch position compensation.

Although the present invention has been disclosed as above with the embodiments, it is not intended to limit the present invention, and any skilled in the art can make some changes and modifications without departing from the spirit and scope of the present invention, so the protection of the present invention The scope is determined by the scope of the claims.

Claims (14)

1. A touch position compensation method, applicable to an electronic device with a touch screen and a plurality of position sensors, the method comprising the following steps: detecting an eye position of a user's eye relative to the touch screen by using the position sensor; obtaining an object position of an object displayed on the touch screen; calculating a viewing angle at which the eye views the object based on the eye position and the object position; calculating a parallax for the eyes viewing the object according to the viewing angle and a thickness of the touch screen; and A touch position where a finger of the user touches the object displayed on the touch screen is compensated by using the parallax. 2. The touch position compensation method according to claim 1, wherein the step of using the position sensor to detect the eye position of the user's eye relative to the touch screen comprises: Using a first position sensor to detect a first distance between the eyes of the user and the first position sensor, a first elevation angle and a projected position of the eyes on the touch screen relative to the first position sensor a first relative direction of the position of a position sensor; Using a second position sensor to detect a second distance between the eyes of the user and the second position sensor, a second elevation angle and the projection position of the eyes on the touch screen relative to the first position sensor a second relative direction of the positions of the two position sensors; calculating a vertical distance between the eye and the touch screen using the first distance and the first elevation angle or the second distance and the second elevation angle; Calculate the projected position of the eye on the touch screen by using a disposition position of the first position sensor and the second position sensor on the touch screen and the first relative direction and the second relative direction ;as well as Using the projection position and the vertical distance, the eye position of the eye relative to the touch screen is obtained. 3. The touch position compensation method according to claim 2, wherein the step of using the parallax to compensate the touch position of the user's finger touching the object displayed on the touch screen comprises: detecting an actual position where the finger touches the touch screen; calculating a third relative direction of the object position relative to the projected position of the eye on the touch screen; and Moving the actual position toward the third relative direction by the parallax is used as the touch position where the finger touches the object displayed on the touch screen. 4. The touch position compensation method according to claim 2, wherein the step of using the position sensor to detect the eye position of the user's eye relative to the touch screen further comprises: using at least one third sensor to detect a normal vector of the touch screen in a three-dimensional space; and Using the projected position, the vertical distance and the normal vector, calculate the eye position of the eye relative to the touch screen in the three-dimensional space. 5. The touch position compensation method according to claim 1, wherein, according to the viewing angle and the thickness of the touch screen, the step of calculating the parallax when the eyes watch the object comprises: The thickness is multiplied by a tangent value of the viewing angle to be the parallax. 6. The touch position compensation method according to claim 1, further comprising: A size of the finger of the user is detected. 7. The touch position compensation method according to claim 6, wherein the step of calculating the parallax when the eyes watch the object according to the viewing angle and the thickness of the touch screen further comprises: A deviation value of the parallax is calculated according to the detected size of the finger of the user. 8. The touch position compensation method according to claim 6, wherein the step of detecting the size of the finger of the user comprises: The size of the finger is determined according to the proportion of the finger in an image captured by the position sensor or the distribution of a plurality of touch points generated by the finger touching the touch screen. 9. A touch position compensation device, comprising: An eye position detection module, using a plurality of position sensors to detect an eye position of a user's eye relative to a touch screen; An object position obtaining module, which obtains an object position of an object displayed on the touch screen; A viewing angle calculation module, which calculates a viewing angle of the object viewed by the eye according to the position of the eye and the position of the object; a parallax calculation module, which calculates a parallax when the eyes watch the object according to the viewing angle and a thickness of the touch screen; and A position compensation module uses the parallax to compensate a touch position where a finger of the user touches the object displayed on the touch screen. 10. The touch position compensation device according to claim 9, wherein the eye position detection module comprises: A first sensing module, using a first position sensor to detect a first distance between the user's eyes and the first position sensor, a first elevation angle and a position of the eyes on the touch screen a first relative direction of the projected position relative to the position of the first position sensor; A second sensing module, using a second position sensor to detect a second distance between the user's eyes and the second position sensor, a second elevation angle and the position of the eyes on the touch screen a second relative direction of the projected position relative to the position of the second position sensor; and A position calculation module, using the first distance and the first elevation angle or the second distance and the second elevation angle to calculate a vertical distance between the eye and the touch screen, using the first position sensor and the An arrangement position of the second position sensor on the touch screen and the first relative direction and the second relative direction are used to calculate the projected position of the eye on the touch screen, and use the projected position and the vertical distance, to obtain the eye position of the eye relative to the touch screen. 11. The touch position compensation device according to claim 10, wherein the position compensation module includes detecting an actual position where the finger touches the touch screen, and calculating the position of the object relative to the eyes in the touch position. A third relative direction of the projected position on the screen, and moving the actual position toward the third relative direction by the parallax are used as the touch position where the finger touches the object displayed on the touch screen. 12. The touch position compensation device according to claim 10, wherein the eye position detection module further comprises: A third position sensor, using at least one third sensor to detect a normal vector of the touch screen in a three-dimensional space, wherein the position calculation module uses the projected position, the vertical distance and the normal vector to calculate the eye The eye position relative to the touch screen in the three-dimensional space. 13 . The touch position compensation device according to claim 9 , wherein the parallax calculation module includes multiplying the thickness by a tangent of the viewing angle as the parallax. 14 . 14. The touch position compensation device according to claim 9, further comprising: A finger size detection module detects a size of the user's finger; wherein the parallax calculation module further includes calculating a deviation value of the parallax according to the size of the user's finger detected by the finger size detection module.

Images