TWI435251B - Method and system for estimating the tendency of pressure change on a touch panel - Google Patents

Description

Method and system for estimating pressure changes on a touch screen

The present invention relates to a method for estimating pressure changes; and more particularly to a method for estimating pressure changes on a touch screen.

With the rapid development of technology, more and more touch products are appearing in our daily lives. Looking at the smart phones, digital cameras, computers and TVs currently on the market, we do not feature touch functions. one. However, when the user touches the screen, there is often an expectation that the screen should be subjected to a specific physical reaction after being touched, for example, the screen will sink when pressed.

In order to solve this problem, in the past, visual or audible effects have been used to assist, for example, pressing a visual effect of a screen sag at the same time, or an audible effect of generating a button sound effect, so that the user can feel the feeling of interacting with the screen.

However, touch is a kind of touch action. Therefore, the most ideal method is to generate feedback effects that can be different according to different force levels. The "virtual touch" directly satisfies the user's expectation and allows the user to operate the operating system. Or the product can be directly felt. The key to providing a tactile effect is to distinguish the pressure exerted by the user on the touch screen. If the pressure is increased, the tactile effect will increase; if the pressure is small, the tactile effect will decrease.

In the prior art, an additional pressure sensor is generally used to detect changes in pressure, which requires an increase in the cost of the pressure sensor. Therefore, it is necessary to provide a method for estimating the pressure change of the touch screen through image data to solve the lack of prior art.

The primary object of the present invention is to provide a method of estimating the pressure change of a touch screen.

In order to achieve the above object, the present invention estimates a pressure change of a touch screen for an optical detection input image system, and the optical detection input image system includes a left image capturing device and a right image capturing device. In order to detect the user's position on the image screen, the method for estimating the pressure change of the touch screen includes the following steps: at the first time, the first left image data is obtained through the left image capturing device, and the image is captured through the right image. The first right image data is obtained by the device; the first estimated pressing area parameter is calculated according to the first left image data and the first right image data; and the second left image data is obtained by the left image capturing device at the second time, and Obtaining a second right image data through the right image capturing device; calculating a second estimated pressing area parameter according to the second left image data and the second right image data; and comparing the second estimated pressing area parameter with the first predetermined Estimating the pressing area parameter; by the above steps, if the second estimated pressing area parameter is greater than the first estimated pressing area parameter, it is speculated During the first time to the second time, the user's touch pressure on the image screen is increased. If the second estimated pressing area parameter is smaller than the first estimated pressing area parameter, it is presumed that the first time to the second time, The user's touch pressure on the image screen is reduced.

Another object of the present invention is to provide a system for estimating the pressure change of a touch screen to determine the change in the user's touch pressure on the image screen.

To achieve the above object, the system for estimating the pressure change of the touch screen includes a left image capturing device, a right image capturing device, and a processor. The left image capturing device is configured to obtain the first left image data at the first time and obtain the second left image data at the second time. The right image capturing device is configured to obtain the first right image data at the first time and obtain the second right image data at the second time. The processor is configured to calculate a first estimated pressing area parameter according to the first left image data and the first right image data; and calculate a second estimated pressing area parameter according to the second left image data and the second right image data; Comparing the second estimated pressing area parameter with the first estimated pressing area parameter to perform one of the following mechanisms: if the second estimated pressing area parameter is greater than the first estimated pressing area parameter, it is speculated that the first time is In the second time, the user's touch pressure on the image screen increases; or if the second estimated pressing area parameter is smaller than the first estimated pressing area parameter, it is presumed that the user is in the first time to the second time. The touch pressure on the image screen is reduced.

The above and other objects, features and advantages of the present invention will become more <

Please refer to FIG. 1 below for a schematic diagram of the application of the method for estimating the pressure change of the touch screen of the present invention. As shown in FIG. 1 , in an embodiment of the present invention, an optical detection input image system 10 includes a computer 90 , a projector 80 , a left image capturing device 11 , a right image capturing device 12 , and an image screen 13 . Feedback device 14. The computer 90 includes a memory 91, a processor 92, and an image interface 93 in which a computer program 100 is stored in the memory 91.

The projector 80 is connected to the image interface 93 of the computer 90, and the image is projected onto the image screen 13 (in the present embodiment, a projection screen commonly used in a general conference room), and is respectively installed on the upper left and upper right sides of the image screen 13. The left image capturing device 11 and the right image capturing device 12 (for example, a CCD/CMOS camera) detect the position touched by the user on the image screen 13.

The computer 90 can execute the computer program 100 in the memory 91 by the processor 92, implement the method for estimating the pressure change of the touch screen of the present invention, estimate the pressure change of the touch image screen 13, and finally provide the feedback signal to the feedback according to the pressure change. The device 14 (in this embodiment is a speaker) or the image screen 13.

It should be noted that the method for estimating the pressure change of the touch screen of the present invention is not limited to the above environment. For example, the optical detection input image system 10 does not require the projector 80, and the image screen 13 is a general display screen (such as an LCD screen). The image screen 13 is directly connected to the image interface 93 of the computer 90, and the left image is captured. The device 11 and the right image capturing device 12 are similarly mounted on both sides of the LCD screen.

Next, please refer to FIG. 2, which is a flow chart of the steps of the method for estimating the pressure change of the touch screen of the present invention; and please refer to FIG. 1 and FIG. 3 to FIG. 5 together.

First, proceed to step 201: obtaining the first left image data and the first right image data

Please refer to FIG. 3, which is a specific embodiment of obtaining the first left image data and the first right image data according to the present invention. At the first time, the user's finger 41a is pressed against the image screen 13 at or near the first coordinate position 41. The optical detection input image system 10 can pass the left image capturing device 11 and the right image capturing device 12 to obtain the first left image data 21 and the first right image data 31. The first left image data 21 includes a first left masking area 211, and the first right image data 31 includes a first right masking area 311. Since the two image capturing devices 11 and 12 are used to obtain the two image data 21 and 31, and the two image data 21 and 31 are included in the masking regions 211 and 311 by the finger 41a, they are all well-known technologies, and thus will not be described again.

Then proceed to step 202: calculate the first coordinate position

After acquiring the first left image data 21 and the first right image data 31, the first left image data 21 is transmitted to the computer 90, and the computer program 100 executes the computer program 100 to calculate the first coordinate position 41 where the finger 41a is located by using the masking areas 211 and 311. For example, how to calculate the exact first coordinate position 41 can be calculated by a method such as triangulation, but the invention is not limited thereto. Since the triangulation method is a conventional technique, it will not be described here.

Then proceed to step 203: obtaining the second left image data and the second right image data

Please refer to FIG. 4, which is a specific embodiment of obtaining a second left image data and a second right image data according to the present invention. At the second time, the user's finger 42a is pressed against the image screen 13 at or near the second coordinate position 42. Similarly, the optical detection input image system 10 obtains the second left image data 22 and the second right image data 32 through the left image capturing device 11 and the right image capturing device 12. The second left image data 22 includes a second left masking area 221, and the second right image data 32 includes a second right masking area 321 .

It should be noted that the two image capturing devices 11, 12 actually continuously transmit the left and right image data to the computer 90, and the computer 90 continuously calculates whether an object touches the screen and its coordinate position, for example, every 0.1 seconds. The second time and the time of the first time described in this specification are different by 0.1 second. In general, the calculation is performed between about 0.01 seconds and 1 second, so the time difference between the second time and the first time can be set to be between 0.01 seconds and 1 second, but the invention is not limited thereto.

Then proceed to step 204: calculate the second coordinate position

After obtaining the second left image data 22 and the second right image data 32, the computer transmits the second left image data 22 to the computer 90, and the computer program 100 executes the computer program 100 to calculate the second coordinate position 42.

Then proceeding to step 205: comparing whether the distance between the first coordinate position and the second coordinate position is within a preset tolerance distance

After calculating the first coordinate position 41 and the second coordinate position 42, the computer program 100 is executed by the computer 90, whether the distance between the two positions is within a predetermined tolerance distance, and if so, step 206 is performed. The preset allowable error distance is preferably set to 0 to 15 pixels. In the present embodiment, the preset allowable error distance is set to 8 pixels.

In this embodiment, the difference between the two coordinate positions 41 and 42 is 5 pixels, and within the preset tolerance distance, step 206 is continued. It should be noted that since the difference between the first coordinate position 41 and the second coordinate position 42 is calculated as a conventional technique, it will not be described here.

The purpose of step 205 is to detect whether the first time and the second time when the fingers 41a, 42a are pressed against the image screen 13 are the same or close to the same position, and if so, the pressure changes of the finger 41a, 42a pressing the image screen 13 are recalculated.

If the first time has a distance from the second time finger 41a, 42a, it means that the finger moves away from the second time (that is, outside the allowable error distance), and at this time, the finger 41a, 42a is not pushed to press the image screen. The pressure change of 13 is followed by a return to step 201.

Then proceed to step 206: calculating the first estimated pressing area parameter

After determining the phase difference distance within the preset tolerance error distance, the image area can be actually calculated, and the change of the image area can be used to judge the pressure change. Referring to FIG. 5, the first left image data 21 and the first right image data 31 obtained at the first time respectively include a first left shielding area 211 and a first right shielding area 311, wherein the first left shielding area 211 includes the first A left shielding area width 211w, the first right shielding area 311 includes a first right shielding area width 311w. In this embodiment, the product of the first left masking area width 211w and the first right masking area width 311w is used as an estimated value of the first estimated pressing area parameter, but the invention is not limited thereto. For example, the values of the first left masking area width 211w and the first right masking area width 311w may be substituted into other mathematical formulas to obtain a first estimated pressing area parameter. The first left masking area width 211w is 30 pixels, and the first right masking area width 311w is 25 pixels, so the first estimated pressing area parameter can be calculated as 750 pixels.

Then proceed to step 207: calculating the second estimated pressing area parameter

Similarly, the second left image data 22 and the second right image data 32 obtained at the second time respectively include a second left shielding area 221 and a second right shielding area 321 , wherein the second left shielding area 221 includes the second left The shielding area width 221w, and the second right shielding area 321 includes a second right shielding area width 321w. In this embodiment, the second left masking area width 221w is 50 pixels, and the second right masking area width 321w is 47 pixels, so the second estimated pressing area parameter can be calculated as 2350 pixels.

Then proceed to step 208: comparing the first estimated pressing area parameter and the second estimated pressing area parameter

After calculating the first estimated pressing area parameter and the second estimated pressing area parameter, the size of the two is compared. If the second estimated pressing area parameter is greater than the first estimated pressing area parameter, it is presumed that the user's touch pressure on the image screen 13 is increased from the first time to the second time, and the second estimated pressing area parameter is increased. If the parameter is smaller than the first estimated pressing area, it is presumed that the user's touch pressure on the image screen 13 is reduced from the first time to the second time. In this embodiment, the second estimated pressing area parameter is greater than the first estimated pressing area parameter, so it is presumed that the user's touch pressure on the image screen 13 is increased from the first time to the second time.

Finally, step 209 is performed: generating a feedback signal

After the user's pressure on the image screen 13 is changed, the computer 90 can execute the computer program 100 to generate a feedback signal, and the computer 90 can transmit the feedback signal to the feedback device 14 or the image screen 13 in response to the feedback signal. A feedback signal for hearing or tactile feedback. In the present embodiment, the feedback device 14 can be a horn. Because the touch pressure increases from the first time to the second time, the computer program 100 generates an audible feedback signal to cause the horn to emit a loud sound. Alternatively, a tactile feedback signal may be generated and transmitted to the image screen 13 to increase the amplitude of the vibration of the image screen 13 (the feedback device is mounted behind the screen); or generate a visual feedback signal, such as a game software application, The person presses a bug, so that the insects of the image screen 13 have different shapes or expressions due to the different pressures of the pressing, and of course, different sounds can be generated.

It should be noted here that the method for estimating the pressure change of the touch screen of the present invention is not limited to the above-described step sequence, and the order of the above steps may be changed as long as the object of the present invention can be achieved.

To sum up, the present invention, regardless of its purpose, means and efficacy, shows its distinctive features of the prior art. You are requested to review the examination and express the patent as soon as possible. It should be noted that the various embodiments described above are merely illustrative for ease of explanation, and the scope of the invention is intended to be limited by the scope of the claims.

10. . . Optical detection input imaging system

11. . . Left image capture device

12. . . Right image capture device

13. . . Video screen

14. . . Feedback device

twenty one. . . First left image data

211. . . First left masking area

211w. . . First left masking area width

twenty two. . . Second left image data

221. . . Second left masking area

221w. . . Second left masking area width

31. . . First right image data

311. . . First right shadow area

311w. . . First right masking area width

32. . . Second right image data

321. . . Second right shadow area

321w. . . Second right masking area width

41. . . First position

41a. . . finger

42. . . Second coordinate position

42a. . . finger

80. . . Projector

90. . . computer

91. . . Memory

92. . . processor

93. . . Image interface

100. . . Computer program

1 is a schematic diagram of the application of the method for estimating the pressure change of a touch screen of the present invention.

2 is a flow chart showing the steps of the method for estimating the pressure change of the touch screen of the present invention.

FIG. 3 is a specific embodiment of the first left image data and the first right image data obtained by the present invention.

FIG. 4 is a specific embodiment of the second left image data and the second right image data obtained by the present invention.

Figure 5 is a specific embodiment of the width of the shadow zone of the present invention.

Step 201: Obtain the first left image data and the first right image data

Step 202: Calculate the first coordinate position

Step 203: Acquire second second image data and second right image data

Step 204: Calculate the second coordinate position

Step 205: Align whether the distance between the first coordinate position and the second coordinate position is within an allowable error distance

Step 206: Calculate the first estimated pressing area parameter

Step 207: Calculate a second estimated pressing area parameter.

Step 208: Align the first estimated pressing area parameter and the second estimated pressing area parameter

Step 209: Generate a feedback signal

Claims (14)

A method for estimating pressure change of a touch screen is used for an optical detection input image system, the optical detection input image system includes a left image capturing device and a right image capturing device for detecting Detecting a user's position on an image screen, wherein the method includes: obtaining a first left image data through the left image capturing device at a first time, and obtaining a first image through the right image capturing device Right image data; calculating a first estimated pressing area parameter according to the first left image data and the first right image data; and obtaining a second left image data through the left image capturing device at a second time And obtaining a second right image data by using the right image capturing device; calculating a second estimated pressing area parameter according to the second left image data and the second right image data; Estimating the pressing area parameter and the first estimated pressing area parameter to perform one of the following steps: if the second estimated pressing area parameter is greater than the first estimated pressing For the first time to the second time, the user increases the touch pressure on one of the image screens; or if the second estimated pressed area parameter is smaller than the first estimated pressed area parameter, It is presumed that the user has reduced the touch pressure on one of the image screens from the first time to the second time. The method for estimating a pressure change of a touch screen as described in claim 1, wherein the first left image data has a first left masking area, and the first right image data has a first right masking area, The first estimated pressing area parameter is calculated according to the first left shielding area and the first right shielding area; and the second left image data has a second left shielding area, and the second right image data has a first In the second right shielding area, the second estimated pressing area parameter is calculated according to the second left shielding area and the second right shielding area. The method for estimating a pressure change of a touch screen as described in claim 2, wherein: the first left shielding area includes a first left shielding area width; and the first right shielding area includes a first right shielding area Width; the second left shielding area includes a second left shielding area width; the second right shielding area includes a second right shielding area width; and the first estimated pressing area parameter is based on the first left shielding area width Calculated by multiplying the width of the first right shielding area; and the second estimated pressing area parameter is calculated according to the width of the second left shielding area multiplied by the width of the second right shielding area. A method for estimating a pressure change of a touch screen as described in claim 3, wherein a time difference between the second time and the first time is between 0.01 seconds and 1 second. The method for estimating the pressure change of the touch screen as described in claim 4, wherein the method further comprises: calculating a first coordinate position according to the first left image data and the first right image data; Calculating a second coordinate position according to the second left image data and the second right image data. The method for estimating a pressure change of a touch screen as described in claim 5, wherein the method further comprises: comparing a distance between the first coordinate position and the second coordinate position by a predetermined tolerance distance If yes, the step of calculating the first estimated pressing area parameter and the second estimated pressing area parameter is performed. The method for estimating a pressure change of a touch screen as described in claim 6 of the patent application, wherein the preset allowable error distance is 0 to 15 pixels of the image screen. The method for estimating a pressure change of a touch screen as described in claim 7 of the patent application, wherein the method is more based on the comparison result after comparing the second estimated pressing area parameter with the first estimated pressing area parameter Including generating a feedback signal. The method for estimating a pressure change of a touch screen as described in claim 1, wherein the method is more based on the comparison result after comparing the second estimated pressing area parameter with the first estimated pressing area parameter Including generating a feedback signal. A method for estimating a pressure change of a touch screen as described in claim 9 wherein the time difference between the second time and the first time is between 0.01 seconds and 1 second. A system for estimating the pressure change of a touch screen for determining a change in the touch pressure of a user on an image screen, the system for estimating the pressure change of the touch screen includes: a left image capturing device for Obtaining a first left image data at a second time, and obtaining a second left image data at a second time; a right image capturing device configured to obtain a first right image data at the first time, and Obtaining a second right image data in a second time; and a processor, configured to calculate a first estimated pressing area parameter according to the first left image data and the first right image data; according to the second left image Data and the second right image data, calculating a second estimated pressing area parameter; and comparing the second estimated pressing area parameter with the first estimated pressing area parameter to perform one of the following mechanisms: The second estimated pressing area parameter is greater than the first estimated pressing area parameter, and it is presumed that the user increases the touch pressure on one of the image screens from the first time to the second time; or The second parameter is less than the projected area of the first pressing press area estimated parameter is estimated in the first time to the second time, the user reduces the image in one screen touch pressure. The system for estimating the pressure change of the touch screen as described in claim 11, wherein the first left image data has a first left shielding area, and the first left shielding area includes a first left shielding area width; The first right image data has a first right shielding area, and the first right shielding area includes a first right shielding area width; the first estimated pressing area parameter is multiplied by the first left shielding area width. a right masking area is calculated; and the second left image data has a second left masking area, the second left masking area includes a second left masking area width; the second right image data has a second right a shielding area, the second right shielding area includes a second right shielding area width; and the second estimated pressing area parameter is calculated according to the width of the second left shielding area multiplied by the width of the second right shielding area. The processor is further configured to calculate a first coordinate position according to the first left image data and the first right image data, according to the system for estimating the pressure change of the touch screen described in claim 11; Calculating a second coordinate position according to the second left image data and the second right image data; and comparing whether the distance between the first coordinate position and the second coordinate position is within a preset tolerance distance, if Then, a mechanism for calculating the first estimated pressing area parameter and the second estimated pressing area parameter is performed. The system for estimating the pressure change of the touch screen as described in claim 11 further includes: a feedback device for generating a feedback effect according to one of the feedback signals generated by the processor.