CN102033657B - Touch system, method for sensing height of referent and method for sensing coordinates of referent - Google Patents

Touch system, method for sensing height of referent and method for sensing coordinates of referent Download PDF

Info

Publication number
CN102033657B
CN102033657B CN200910178428.4A CN200910178428A CN102033657B CN 102033657 B CN102033657 B CN 102033657B CN 200910178428 A CN200910178428 A CN 200910178428A CN 102033657 B CN102033657 B CN 102033657B
Authority
CN
China
Prior art keywords
pixel
indicant
value
image
touch
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200910178428.4A
Other languages
Chinese (zh)
Other versions
CN102033657A (en
Inventor
苏宗敏
陈信嘉
吕志宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pixart Imaging Inc
Original Assignee
Pixart Imaging Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixart Imaging Inc filed Critical Pixart Imaging Inc
Priority to CN200910178428.4A priority Critical patent/CN102033657B/en
Publication of CN102033657A publication Critical patent/CN102033657A/en
Application granted granted Critical
Publication of CN102033657B publication Critical patent/CN102033657B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Position Input By Displaying (AREA)

Abstract

The invention provides a touch system, a method for sensing the coordinates of a referent and a method for sensing the height of the referent. The method for sensing the coordinates of the referent comprises the following steps of: capturing an image window crossing the surface of a panel by using at least one image sensor; identifying the height coordinates of the referent relative to the touch system according to the pixel variation value of each columns of pixels in the image window; and calculating the plane coordinates of the referent relative to the touch system according to the position of a shielding shadow in the image window. By adopting the touch system, the method for sensing the coordinates of the referent and the method for sensing the height of the referent, the image sensor can be controlled to execute different functions according to the sensed different height coordinates and plane coordinates of the referent relative to the touch system, wherein the functions include but are not limited to control the action, the writing or the drawing of a display cursor of an image display.

Description

Touch-control system and indicant height method for detecting thereof and indicant coordinate method for detecting
Technical field
The present invention relates to a kind of touch-control system, and relate in particular to a kind of touch-control system and indicant height method for detecting and indicant coordinate method for detecting.
Background technology
Please refer to shown in Fig. 1, it has shown a kind of schematic diagram of existing touch-control system 90.Described touch-control system 90 comprises touch surface 91, video camera 921~924, a plurality of light source 93 and processor 94; Wherein said touch surface 91 is reflective mirror.Video camera 921~924 is the image across this touch surface 91 along touch surface 91 surface acquisitions.When user 8 finger 81 comes close to or in contact with touch surface 91, video camera 921~924 captures respectively and comprises that pointing 81 tips covers the formed image form that covers shadow of pointing 81 mirror images in shadow and touch surface 91 that covers of described a plurality of light source 93.Processor 94 couples video camera 921~924, and processes the image form that each video camera captures, to judge whether finger 81 contacts touch surface 91.
Please refer to shown in Fig. 2 a~2c, it shows respectively the schematic diagram of the image form W that video camera 921~924 captures, and wherein DA is corresponding to background area, and it is dark areas in image form W; BA is corresponding to light source 93 or touch surface 91, and it is bright area in image form W.When user 8 does not utilize finger 81 to approach touch surface 91, the image form W that video camera 921~924 captures will be as shown in Figure 2 a, that is image form W does not comprise any indicant information.When user 8 utilizes finger 81 approach but do not contact touch surface 91, the image form W that video camera 921~924 captures will as shown in Figure 2 b, that is image form W comprise point 81 cover shadow I 81with finger mirror image cover shadow I 81'; When shadow I is covered in processor 94 identifications 81, I 81' between still there is bright pixel, judge that finger 81 approaches but do not contact touch surface 91.When user utilizes finger 81 contacts during touch surface 91, the image form W that video camera 921~924 captures will be as shown in Figure 2 c, that is cover shadow I in image form W 81, I 81' interconnect; When shadow I is covered in processor 94 identifications 81, I 81' between there is not bright pixel, judge that finger 81 has contacted touch surface 91.Whether above-mentioned judgement indicant contacts the detailed content of touch surface 91 for example can be with reference to United States Patent (USP) the 6th, disclosed content in 947, No. 032.
Yet whether described touch-control system 90 only can contact touch surface 91 by identification indicant, and cannot try to achieve the hoverheight of indicant.
Summary of the invention
In view of this, the object of the invention is to propose a kind of touch-control system and indicant height method for detecting and indicant coordinate method for detecting of detecting the three-dimensional coordinate of suspension indicant, it can pick out indicant with respect to hoverheight and the planimetric position of touch surface simultaneously.
The present invention proposes a kind of indicant height method for detecting of touch-control system, and the method comprises the following steps: to utilize at least one image sensor acquisition across the image form of panel surface; Calculate the pixel change value (variation) of each row pixel in described image form; And pixel change value and at least one threshold value of at least one row pixel of pixel change value minimum in described image form are compared to the height with indicant described in identification with respect to described panel surface.
The another indicant coordinate method for detecting that proposes a kind of touch-control system of the present invention, the method comprises the following steps: to utilize at least one image sensor acquisition across the image form of panel surface; According to the pixel change value of each row pixel in described image form, identification indicant is with respect to the height coordinate of described touch-control system; And according to the position of covering shadow of indicant described in described image form, calculate described indicant with respect to the planimetric coordinates of described touch-control system.
A kind of touch-control system of the another proposition of the present invention, this system comprises panel, at least one light source, at least one reflecting unit, at least one image sensor and processing unit.Described light source is along the panel surface of the described panel described panel that throws light on.Described reflecting unit is for reflecting the light of described light source.Described image sensor comprises that for capturing indicant covers the formed image form that covers shadow of described reflecting unit.Image form described in described processing unit processes, and according to the pixel change value of each row pixel in described image form, indicant is with respect to the height coordinate of described panel surface described in identification.
According to touch-control system of the present invention and indicant height method for detecting and indicant coordinate method for detecting, can be according to detected indicant differing heights coordinate and the planimetric coordinates with respect to touch-control system, control image sensor and carry out different functions, for example, but be not limited to, control image display display highlighting action, write or draw.
Accompanying drawing explanation
Fig. 1 has shown a kind of stereographic map of existing touch-control system;
Fig. 2 a~2c has shown that image sensor in the touch-control system of Fig. 1 captures the schematic diagram of image form;
Fig. 3 a has shown the stereographic map of the touch-control system of first embodiment of the invention;
Fig. 3 b~3c has shown the schematic diagram of the image form that the image sensor of Fig. 3 a captures;
Fig. 4 a has shown the operation chart of the touch-control system of first embodiment of the invention;
Fig. 4 b has shown the schematic diagram of the image form that the image sensor of Fig. 4 a captures;
Fig. 5 a has shown the stereographic map of the touch-control system of second embodiment of the invention;
Fig. 5 b has shown the schematic diagram of the image form that the image sensor of Fig. 5 a captures;
Fig. 6 a has shown the schematic diagram of the image form that the image sensor of the touch-control system of the embodiment of the present invention captures, and in wherein said image form, does not have the shadow of covering;
Fig. 6 b has shown the schematic diagram of a row pixel of the image form of Fig. 6 a;
Fig. 6 c has shown the schematic diagram of another image form that the image sensor of the touch-control system of the embodiment of the present invention captures, and in wherein said image form, has the shadow of covering; And
Fig. 6 d has shown the schematic diagram of multiple row pixel of the image form of Fig. 6 c.
Main element symbol description
1,1 ' touch-control system 10,10 ' light source
The first side of 11 panel 11a panels
The 3rd limit of the Second Edge 11c panel of 11b panel
The 4th limit 11d ' the 4th mirror image of 11d panel
11s panel surface 12 reflective mirrors
12a reflective mirror 131 first reflecting units
131 ' the second mirror image 132 second reflecting units
The 132 ' three mirror image 133 the 3rd reflecting unit
14,14 ' image sensor, 15 processing units
16 image display 160 cursors
H Touch Zone, VA visual field height
IS virtual image space, RS real image space
P 0the touch point P of indicant 0' first mirror picture
A 0the first included angle A 0the ' the second angle
D 1the distance D on first side and the 3rd limit 2the distance on touch point and the 4th limit
L 0the first sense path L 0the ' the second sense path
I 81, I 81', I covers shadow I p0, I p0' cover shadow
BA high light region, DA background area
P, a P ' row pixel W 14, W 14' image form
Z 0~Z 2the height coordinate W of indicant, W ' image form
8 user's 81 fingers
90 touch-control system 91 touch surface
921~924 video camera 93 light sources
94 processing units
Embodiment
For allow above and other object of the present invention, feature and advantage can be more obvious, below will coordinate appended diagram, be described in detail below.In addition, need to be predeclared at this, in explanation of the present invention, identical member represents the symbol with identical.
the first embodiment
Shown in Fig. 3 a to Fig. 3 c, Fig. 3 a has shown the stereographic map of the touch-control system 1 of first embodiment of the invention, and Fig. 3 b and 3c have shown the schematic diagram of the image form that the image sensor of Fig. 3 a captures.Touch-control system 1 comprises light source 10, panel 11, reflective mirror 12, the first reflecting unit 131, the second reflecting unit 132, image sensor 14, processing unit 15 and image display 16.
Described light source 10 is preferably disposed on the corner of panel 11.Light source 10 sends invisible light, and for example infrared light or ultraviolet light, reflect for reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132.Described light source 10 also can be arranged at other positions, so that its light sending can, by reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132 reflections, be not limited to shown in Fig. 3 a.
Described panel 11 comprises first side 11a, Second Edge 11b, the 3rd limit 11c, the 4th limit 11d and panel surface 11s.The embodiment of panel 11 comprises blank (white board) or Touch Screen (touchscreen).Described panel surface 11s can be reflective mirror or reflective surface.The region that panel surface 11s and top thereof are surrounded by reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132 is the Touch Zone of touch-control system 1, and it has height H, and wherein this height H can determine according to practice.
Described reflective mirror 12 is arranged at the first side 11a of panel 11, and from panel surface 11s towards the top of this panel surface 11s (direction of Touch Zone) extended height H.Reflective mirror 12 comprises reflective mirror 12a, and this reflective mirror 12a is towards the 3rd limit 11c of panel, the invisible light being sent with reflection source 10, and wherein said reflective mirror 12a can utilize suitable material to form.Described the first reflecting unit 131 is arranged at the Second Edge 11b of panel, and from panel surface 11s towards the top of this panel surface 11s extended height H, described the first reflecting unit 131 for example can be and utilizes the formed reflective fabric of suitable material, and the invisible light sending towards the 4th limit 11d reflection source 10 of panel.Described the second reflecting unit 132 is arranged at the 3rd limit 11c of panel, and from panel surface 11s towards the top of this panel surface 11s extended height H, described the second reflecting unit 132 for example can be and utilizes the formed reflective fabric of suitable material, and the invisible light sending towards the first side 11a reflection source 10 of panel.Be understandable that, the height of described reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132 can be not identical yet.
Described image sensor 14 is preferably disposed on the corner of panel 11, for example in this embodiment, image sensor 14 and light source 10 are arranged at the corner of the 3rd limit 11c and the 4th limit 11d intersection of panel, and described reflective mirror 12 can be arranged on the upper and non-conterminous limit of image sensor 14 of panel surface 11s, for example first side 11a or Second Edge 11b.Can be arranged to tilt towards panel surface 100s in the visual field of image sensor 14, with acquisition, across panel surface 11s and comprise the image of the Touch Zone that this panel surface 11s, reflective mirror 12, the first reflecting unit 131, the second reflecting unit 132 are surrounded, wherein longitudinal visual field of image sensor 14 is preferably greater than the height H of Touch Zone.As indicant (pointer), for example point 81, while approaching panel surface 11s, image sensor 14 fechtables comprise that pointing 81 tips covers reflective mirror 12 or the formed shadow I that covers of the first reflecting unit 131 81and/or in panel surface 11s, point 81 mirror image cover shadow I 81' image form W, as shown in Figure 3 b.In Fig. 3 b, because longitudinal visual field (image form height) of image sensor 14 is greater than the height H of Touch Zone, therefore image form W comprises BAHe background area, high light region DA, wherein the height of high light region BA is by panel surface 11s, reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132 DA that determines are the reflective mirror 12 that image sensor 14 captures, the first reflecting unit 131, background area beyond the second reflecting unit 132 and panel surface 11s, because there is not the element of the light sending for reflection source 10 in those regions, therefore present dead color (black).When the 11s of indicant touch panel surface, in Fig. 3 b, cover shadow I 81and I 81' be connected to each other.
In another kind of embodiment, described panel surface 11s also can be non-reflective mirror, and 14 of described image sensors are along panel surface 11s acquisition across this panel surface 11s and only comprise reflective mirror 12, the first reflecting unit 131, the second reflecting unit 132 and above background area thereof and do not comprise the image form of panel surface 11s.When finger 81 approaches panel surface 11s, image sensor 14 fechtables comprise that pointing 81 tips covers the formed shadow I that covers of reflective mirror 12, the first reflecting unit 131 or the second reflecting unit 132 81image form W, as shown in Figure 3 c, wherein BA represents high light region, its height by reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132, determined; DA represents background area, its reflective mirror capturing for image sensor 14 12, the first reflecting unit 131 and more than 132 background area of the second reflecting unit.When the 11s of indicant touch panel surface, in Fig. 3 c, cover shadow I 81be connected to the lower end of image form W.The embodiment of described image sensor 14 comprises ccd image sensor and cmos image sensor, but is not limited to this.Be understandable that, described indicant also can be replaced by other suitable objects, is not defined as finger.
Described processing unit 15 couples image sensor 14, the image form capturing for the treatment of image sensor 14, and according to the pixel change value of covering shadow and each row pixel of indicant in this image form, the mean value of the absolute value of the difference of the pixel value of each pixel and the average pixel value of this row pixel in pixel value standard deviation or a row pixel for example, to calculate indicant with respect to the three-dimensional coordinate of panel surface 11s, it comprises that indicant is with respect to the two dimensional surface coordinate of panel surface 11s and apart from the height coordinate of panel surface 11s.Processing unit 15 is realized difference in functionality according to height coordinate and two dimensional surface coordinate control touch-control system 1.
For example, when processing unit 15 pick out indicant near but contact (hovering) panel surface 11s while thering is the first height coordinate, processing unit 15 is according to the position of covering shadow of indicant in image form W, calculate indicant with respect to the two dimensional surface coordinate of panel surface 11s, and according to the variation of two dimensional surface coordinate in consecutive image form, control the action of the cursor 160 on image display 16; The two dimensional surface coordinate of wherein said panel surface 11s can be set the planimetric coordinates with respect to image display 16 display frames for.
For example, when processing unit 15 pick out indicant near but touch panel surface 11s while thering is the second height coordinate not, wherein more described the first height coordinate of this second height coordinate more approaches panel surface 11s, 15 of described processing units are according to the position of covering shadow of indicant in image form W, calculate indicant with respect to the two dimensional surface coordinate of panel surface 11s, and according to the variation of two dimensional surface coordinate in consecutive image form, control cursor 160 on image display 16 on the picture of this image display 16 such as writing (writing) or draw (drawing) etc.
For example, when processing unit 15 picks out indicant contact (touching) panel surface 11s, processing unit 15 is according to the position of covering shadow of indicant in image form W, calculate the two dimensional surface coordinate of indicant touch panel surface 11s, and according to the variation of two dimensional surface coordinate in consecutive image form, the cursor 160 of controlling on image display 16 is write or draws with different features on the picture of this image display 16, for example, but be not limited to, with thicker lines or different colors, write or draw.
In Fig. 3 a, be clear demonstration touch-control system 1 of the present invention, described panel 11 is independent of outside image display 16, but it is not intended to limit the present invention.In other embodiment, described panel 11 also can be incorporated on the display screen of image display 16.In addition, when panel 11 is Touch Screen, the display screen of image display 16 also can be used as panel 11, and described reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132 are arranged in the display screen surface of image display 16.
Be understandable that, although panel 11 described in Fig. 3 a is shown as three limits that rectangle and reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132 are shown as being arranged at panel 11 orthogonally, but it is only a kind of embodiment of the present invention, is not intended to limit the present invention.In other embodiment, described panel 11 can be made into other shapes; Described reflective mirror 12, the first reflecting unit 131 and the second reflecting unit 132 can be arranged on panel 11 with other spatial relationship.
Please refer to shown in Fig. 4 a and Fig. 4 b, Fig. 4 a has shown the operation chart of the touch-control system 1 of first embodiment of the invention, and Fig. 4 b has shown the schematic diagram of the image form W that the image sensor of Fig. 4 a captures.In this embodiment, the first reflecting unit 131 with respect to reflective mirror 12a map out the second mirror image 131 ', the second reflecting unit 132 with respect to reflective mirror 12a map out the 3rd mirror image 132 ', the 4th limit 11d of panel maps out the 4th mirror image 11d ' with respect to reflective mirror 12a; The 4th limit 11d of wherein said reflective mirror 12, the first reflecting unit 131, the second reflecting unit 132 and panel has defined real image space RS jointly; Described reflective mirror 12, the second mirror image 131 ', the 3rd mirror image 132 ' and the 4th mirror image 11d ' jointly defined virtual image space IS.
The horizontal visual field VA of described image sensor 14 is across panel surface 11s and at least comprise real image space RS and virtual image space IS, for example, for capturing the tip of indicant (pointing 81) that comprises real image space RS, virtual image space IS and be positioned at the Touch Zone of this real image space RS, hides worn-out reflective mirror 12, the first reflecting unit 131, the second reflecting unit 132 and/or the formed image form that covers shadow of panel surface 11s.In one embodiment, described image sensor 14 comprises lens (or lens combination), for adjusting the horizontal visual field VA of image sensor 14, so that image sensor 14 can capture the complete image of real image space RS and virtual image space IS.
Then, illustrate that described processing unit 15 calculates indicant with respect to a kind of embodiment of the two dimensional surface coordinate of panel surface 11s.Shown in Fig. 4 a, work as indicant, for example point 81, while entering Touch Zone, can form touch point P at real image space RS 0, indicant can map out first mirror as P by the reflective mirror 12a with respect to reflective mirror 12 in the IS of virtual image space 0'.Image sensor 14 is according to the first sensing route L 0the most advanced and sophisticated image of acquisition indicant, to form and to cover shadow I in image form W p0; And according to the second sensing route L 0' acquisition first mirror is as P 0' most advanced and sophisticated image, to form, cover shadow I in image form W p0', as shown in Figure 4 b.In this embodiment, in processing unit 15, store in advance the relativeness of covering shadow angle between the one dimension position of image form W and the 3rd limit 11c of sensing route and panel.Therefore,, while forming image form W when the most advanced and sophisticated image of image sensor 14 acquisition indicants and first mirror picture thereof, 15 of processing units can be obtained respectively the first included angle A according to the one dimension position of covering shadow in image form W 0with the second included angle A 0'.Then,, according to trigonometric function relation, processing unit 15 can be obtained indicant at the touch point P of Touch Zone 0two dimensional surface coordinate.
For example in one embodiment, described panel surface 11s form right angle coordinate system, the 3rd limit 11c is as the X-axis of this rectangular coordinate system, and the 4th limit 11d is as the Y-axis of this rectangular coordinate system, and usings image sensor 14 positions as initial point.Therefore, touch point P 0the coordinate that is positioned at rectangular coordinate system can be expressed as (with respect to the distance of the 4th limit 11d, with respect to the distance of the 3rd limit 11c).In addition, in processing unit 15, store in advance the first side 11a of panel and the distance D between the 3rd limit 11c 1.By this, processing unit 15 can be obtained the touch point P of indicant 81 according to the following step 0two dimensional surface coordinate: (a) processing unit 15 is obtained the first sensing route L 0and the first included angle A between the 3rd limit 11c of panel 0and the second sensing route L 0' and the 3rd limit 11c of panel between the second included angle A 0'; (b) according to equation D 2=2D 1/ (tanA 0+ tanA 0') obtain the touch point P of indicant 81 0and the distance D between the 4th limit 11d of panel 2; (c) according to D 2* tanA 0obtain contact point P 0y coordinate.Therefore, contact point P 0two dimensional surface coordinate can be expressed as (D 2, D 2* tanA 0).Be understandable that above-mentioned calculating touch point P 0the mode of two dimensional surface coordinate be only exemplary, be not intended to limit the present invention, also can utilize trigonometric function to try to achieve touch point P in other mode 0two dimensional surface coordinate.
the second embodiment
Please refer to shown in Fig. 5 a~5b, Fig. 5 a shown the touch-control system 1 of second embodiment of the invention ' stereographic map, Fig. 5 b has shown the image form that the image sensor of Fig. 5 a captures.The difference of the present embodiment and above-mentioned the first embodiment is, the reflective mirror 12 of the first embodiment is replaced by the 3rd reflecting unit 133 in this embodiment, and touch-control system 1 ' comprise two image sensors 14 and 14 '.In other embodiments, be to increase the reflective usefulness of reflecting unit 131~133, in the present embodiment, also can select separately to arrange secondary light source 10 ', for example can with image sensor 14 ' the be arranged at same corner of panel surface 11s.
In the second embodiment, described touch-control system 1 ' comprise panel 11, light source 10, the first reflecting unit 131, the second reflecting unit 132, the 3rd reflecting unit 133, two image sensors 14,14 ', processing unit 15 and image display 16.The first reflecting unit 131, the second reflecting unit 132 and the 3rd reflecting unit 133 are arranged at respectively Second Edge 11b, the 4th limit 11d and the first side 11a of panel, and towards the top of panel surface 11s extended height H, to define Touch Zone, wherein height H can determine according to practice.Reflecting unit 131~133 for example can be and utilizes the formed reflective fabric of suitable material, and the invisible light sending towards the Touch Zone reflection source 10 (10 ') of panel.In this embodiment, image sensor 14 is arranged at the 3rd limit 11c of panel and the intersection of the 4th limit 11d, and its visual field is across panel surface 11s, and can comprise or not comprise panel surface 11s.Image sensor 14 ' be arranged at the Second Edge 11b of panel and the intersection of the 3rd limit 11c, its visual field is across panel surface 11s, and can comprise or not comprise panel surface 11s, wherein said image sensor 14 and 14 ' longitudinal visual field be preferably greater than height H.Work as indicant, for example, point 81, while entering Touch Zone, what image sensor 14 acquisition comprised finger 81 tips covers shadow I 81image form W 14; And image sensor 14 ' acquisition comprises finger 81 tips, cover shadow I 81' image form W 14'.Be understandable that, in Fig. 5 b, only shown the high light region BA of image form and omitted background area DA.
Processing unit 15 couple image sensor 14 and 14 ', this processing unit 15 is for the treatment of the image form of image sensor 14 and 14 ' capture, and according to the shadow that covers of indicant in this image form, calculate indicant with respect to the three-dimensional coordinate of panel surface 11s, and control touch-control system 1 ' realize difference in functionality according to this three-dimensional coordinate; Wherein, touch point can calculate by trigonometric function equally with respect to the account form of the two dimensional surface coordinate of panel surface 11s, and its detailed account form is similar to the first embodiment, therefore repeat no more in this.
Please refer to shown in Fig. 6 a~6d, then illustrate in the present invention and calculate indicant with respect to the mode of the height coordinate of touch-control system 1 or 1 ' (panel surface 11s).Be understandable that, this account form is applicable to first and second embodiment of the invention described above simultaneously.
Fig. 6 a has shown the schematic diagram of the image form W that the image sensor of the touch-control system of the embodiment of the present invention captures, and wherein this image form W comprises BAHe background area, high light region DA, and each row pixel of image form W for example comprises N pixel.Now, because indicant does not enter Touch Zone, so image form W does not comprise any shield light shadow information.The present invention is worth by the pixel change of each row pixel in computed image form W, to calculate indicant with respect to the height coordinate of panel 11.
Fig. 6 b shows the row pixel P in Fig. 6 a, and now the standard deviation of this row pixel P can be expressed as,
σ b k = 1 N Σ i = 1 N ( x i k - x ‾ k ) 2 - - - ( 1 )
The mean value of the absolute value of the difference of the average pixel value of the pixel value of each pixel of this row pixel P and this row pixel P can be expressed as,
v b k = 1 N Σ i = 1 N | x i k - x ‾ k | - - - ( 2 )
X wherein i krepresent that k is listed as the pixel value of i pixel; x kthe average pixel value that represents k row pixel.Because the luminance difference of BAYu background area, high light region DA is large, thus when image form W do not comprise any while covering shadow, the pixel change value (standard deviation sigma of each row pixel b kor mean value v b k) be maximum.
Fig. 6 c has shown the schematic diagram of the image form W that the image sensor of the touch-control system of the embodiment of the present invention captures, and what wherein this image form W comprised indicant covers shadow I.Shown in Fig. 3 a and 5a, when indicant enters Touch Zone, indicant also can be subject to the illumination of light source 10, so in the image form W that captures of image sensor, the brightness meeting of covering shadow I of indicant is between the DA of BAYu background area, high light region; In other words, comprise each row pixel of covering shadow I pixel change value (suc as formula 1 or formula 2 shown in) will reduce.For example, in Fig. 6 d, be the schematic diagram that comprises the multiple row pixel of covering shadow I, wherein black part is divided and is represented background area, and grey color part represents to cover shadow I, and white portion represents high light region, and a row pixel P ' comprises a row pixel of covering shadow I.When indicant more close panel surface 11s, the pixel change value of this row pixel P ' will be lower, and when indicant touches panel surface 11s, the pixel change value of this row pixel P ' is minimum.Therefore, in the present invention, the threshold value (threshold) of default a plurality of pixel change values, and be stored in processing unit 15, processing unit 15 is when processing the image form W that image sensor captures, the pixel change value of at least one row pixel of pixel change value minimum in this image form W (for example, in Fig. 6 d, having the pixel change value minimum of two row pixels) is compared with described a plurality of threshold values, to judge the height coordinate of indicant.The establishing method of described threshold value is such as, but not limited to, a plurality of height unit of dividing into of the height equalization of high light region BA being usingd as threshold value, or with actual demand, sets the threshold value of different spacing.
Shown in Fig. 6 c and Fig. 6 d, for example in one embodiment, in processing unit 15, store image form do not comprise indicant cover shadow time each row pixel pixel change value and three threshold value Th1~Th3, for example, when image window dimension is 640 * 42, in processing unit 15, store 640 pixel change values and 3 threshold values.In a kind of embodiment, suppose Th1 < Th2 < Th3, when the pixel change value that therefore calculates at least one row pixel of pixel change value minimum in image form W when processing unit 15 is less than threshold value Th1, the height coordinate of identification indicant is Z 0; The pixel change value that calculates at least one row pixel of pixel change value minimum in image form W when processing unit 15 is between threshold value Th1 and Th2 time, and the height coordinate of identification indicant is Z 1; The pixel change value that calculates at least one row pixel of pixel change value minimum in image form W when processing unit 15 is between threshold value Th2 and Th3 time, and the height coordinate of identification indicant is Z 2; When the pixel change value that calculates at least one row pixel of pixel change value minimum in image form W when processing unit 15 is greater than threshold value Th3, identification does not start touch-control system without indicant enters Touch Zone.Should be noted that, above-mentioned calculating indicant is also applicable to the image form of Fig. 3 b with respect to the mode of the height coordinate of panel 11.The expression mode of described pixel change value is also not limited to shown in formula 1 and formula 2.
In addition, the present invention also can be set as in addition, when processing unit 15 process decision charts as form in the pixel change value of any at least one row pixel (at least one row pixel that comprises pixel change value minimum) while being less than the first threshold value, start touch-control system; When process decision chart as form in the pixel change value of any at least one row pixel while being less than the second threshold value, judge indicant touch panel surface 11s.
In a kind of mode, the height coordinate that picks out indicant when processing unit 15 is Z 2time, can be according to calculated indicant the two dimensional surface changes in coordinates in Touch Zone, control the action of the cursor on image display 16; The height coordinate that picks out indicant when processing unit 15 is Z 1time, 15 of processing units can be according to calculated indicant the two dimensional surface changes in coordinates in Touch Zone, the cursor of controlling on image display 16 is write or draws; The height coordinate that picks out indicant when processing unit 15 is Z 0time, 15 of processing units can be according to calculated indicant the two dimensional surface changes in coordinates in Touch Zone, control on image display 16 and show with different characteristic the lines that institute writes or draws.
Be understandable that, the number of above-mentioned threshold value can determine according to the actual requirements, and described processing unit 15 controls touch-control system 1 or 1 ' performed functions and also can carry out according to different set, is not limited to content disclosed herein.
As mentioned above, the hoverheight that cannot try to achieve indicant due to existing touch-control system has limited the operating function of touch-control system.A kind of touch-control system (Fig. 3 a and 5a) that calculates indicant three-dimensional coordinate of the another proposition of the present invention, it can change the different operating function of execution according to different height coordinate and planimetric coordinates.
Although the present invention is disclosed by above-described embodiment, yet above-described embodiment is not intended to limit the present invention, any the technical staff in the technical field of the invention, without departing from the spirit and scope of the present invention, should make various variations and modification.Therefore protection scope of the present invention should be as the criterion with the scope that appended claims was defined.

Claims (8)

1. an indicant height method for detecting for touch-control system, the method comprises the following steps:
Utilize at least one image sensor acquisition across the image form of panel surface;
Calculate the pixel change value of each row pixel in described image form, this pixel change value is the mean value of the absolute value of the difference of the pixel value of each pixel and the average pixel value of this row pixel in pixel value standard deviation or a row pixel; And
Pixel change value and at least one threshold value of at least one row pixel of pixel change value minimum in described image form are compared to the height with indicant described in identification with respect to described panel surface.
2. indicant height method for detecting according to claim 1, the method also comprises the following steps: according to the height of institute's identification, control image display and carry out corresponding function, wherein, described corresponding function comprise cursor action, write or draw.
3. indicant height method for detecting according to claim 1, the method also comprises the following steps:
When the described pixel change value of arbitrary row pixel is less than the first threshold value in described image form, start described touch-control system;
Process described image form, with at least one that detect indicant described in described image form, cover the position of shadow;
According to described position of covering shadow, calculate described indicant with respect to the planimetric coordinates of described panel surface; And
When the described pixel change value of arbitrary row pixel is less than the second threshold value in described image form, judge that described indicant contacts described panel surface, wherein, described the second threshold value is less than described the first threshold value.
4. indicant height method for detecting according to claim 1, the method also comprises the following steps: to provide at least one reflecting unit to reflect described image sensor required light when acquisition image, and longitudinal visual field of wherein said image sensor is greater than the height of described reflecting unit and comprises described panel surface.
5. an indicant coordinate method for detecting for touch-control system, the method comprises the following steps:
Utilize at least one image sensor acquisition across the image form of panel surface;
When the pixel change value of arbitrary row pixel is less than the first threshold value in described image form, start described touch-control system;
When in described image form, the pixel change value of arbitrary row pixel is less than the second threshold value, judge that described indicant contacts described panel surface, wherein, described the second threshold value is less than described the first threshold value, and described pixel change value is the mean value of the absolute value of the difference of the pixel value of each pixel and the average pixel value of this row pixel in pixel value standard deviation or a row pixel; And
According to the position of covering shadow of indicant described in described image form, calculate described indicant with respect to the planimetric coordinates of described touch-control system.
6. indicant coordinate method for detecting according to claim 5, the method also comprises the following steps: to provide reflecting unit and at least one reflective mirror, reflect described image sensor at acquisition required light during image, in wherein said image form, cover that shadow covers described reflective mirror by described indicant or described reflecting unit is formed.
7. a touch-control system, this system comprises:
Panel, this panel has panel surface;
At least one light source, this light source is along the described panel surface described panel that throws light on;
At least one reflecting unit, this reflecting unit is for reflecting the light of described light source;
At least one image sensor, this image sensor comprises that for capturing indicant covers the formed image form that covers shadow of described reflecting unit; And
Processing unit, image form described in this processing unit processes, and calculate the pixel change value of each row pixel in described image form, pixel change value and at least one threshold value of at least one row pixel of pixel change value minimum in described image form are compared, height coordinate with indicant described in identification with respect to described panel surface, wherein, described pixel change value is the mean value of the absolute value of the difference of the pixel value of each pixel and the average pixel value of this row pixel in pixel value standard deviation or a row pixel.
8. touch-control system according to claim 7, wherein, described image sensor is arranged at two corners that limit has a common boundary of described panel surface, and described touch-control system also comprises reflective mirror, this reflective mirror be arranged on described panel surface with the non-conterminous limit of described image sensor on.
CN200910178428.4A 2009-09-24 2009-09-24 Touch system, method for sensing height of referent and method for sensing coordinates of referent Expired - Fee Related CN102033657B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200910178428.4A CN102033657B (en) 2009-09-24 2009-09-24 Touch system, method for sensing height of referent and method for sensing coordinates of referent

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200910178428.4A CN102033657B (en) 2009-09-24 2009-09-24 Touch system, method for sensing height of referent and method for sensing coordinates of referent

Publications (2)

Publication Number Publication Date
CN102033657A CN102033657A (en) 2011-04-27
CN102033657B true CN102033657B (en) 2014-04-16

Family

ID=43886627

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200910178428.4A Expired - Fee Related CN102033657B (en) 2009-09-24 2009-09-24 Touch system, method for sensing height of referent and method for sensing coordinates of referent

Country Status (1)

Country Link
CN (1) CN102033657B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9229578B2 (en) * 2011-08-05 2016-01-05 Pixart Imaging Inc. Image sensor and optical touch system including the same
CN102981682B (en) * 2011-08-16 2016-12-21 原相科技股份有限公司 CIS and there is the optical touch control system of this CIS
TWI488093B (en) * 2013-03-19 2015-06-11 Au Optronics Corp Method for detecting touch position and optical touch apparatus using the same
CN105335016A (en) * 2014-06-13 2016-02-17 统晶光电科技股份有限公司 Suspension control input apparatus
TWI657357B (en) * 2017-03-17 2019-04-21 佳世達科技股份有限公司 Optical touch device and optical touch method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6947032B2 (en) * 2003-03-11 2005-09-20 Smart Technologies Inc. Touch system and method for determining pointer contacts on a touch surface
CN1825264A (en) * 2004-10-19 2006-08-30 株式会社华科姆 Three-dimensional-information detecting system and three-dimensional-information inputting device
TW200841227A (en) * 2007-04-03 2008-10-16 Pixart Imaging Inc Optical touch control apparatus
TW200842665A (en) * 2007-04-24 2008-11-01 Pixart Imaging Inc Cursor controlling device and method for image apparatus and image system
WO2009028892A2 (en) * 2007-08-30 2009-03-05 Lg Electronics Inc. A user interface for a mobile device using a user's gesture in the proximity of an electronic device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2396587T3 (en) * 2000-07-05 2013-02-22 Smart Technologies Ulc Touch camera method and device
US6930804B2 (en) * 2001-02-01 2005-08-16 Xerox Corporation System and method for automatically detecting edges of scanned documents
US6954197B2 (en) * 2002-11-15 2005-10-11 Smart Technologies Inc. Size/scale and orientation determination of a pointer in a camera-based touch system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6947032B2 (en) * 2003-03-11 2005-09-20 Smart Technologies Inc. Touch system and method for determining pointer contacts on a touch surface
CN1825264A (en) * 2004-10-19 2006-08-30 株式会社华科姆 Three-dimensional-information detecting system and three-dimensional-information inputting device
TW200841227A (en) * 2007-04-03 2008-10-16 Pixart Imaging Inc Optical touch control apparatus
TW200842665A (en) * 2007-04-24 2008-11-01 Pixart Imaging Inc Cursor controlling device and method for image apparatus and image system
WO2009028892A2 (en) * 2007-08-30 2009-03-05 Lg Electronics Inc. A user interface for a mobile device using a user's gesture in the proximity of an electronic device

Also Published As

Publication number Publication date
CN102033657A (en) 2011-04-27

Similar Documents

Publication Publication Date Title
TWI420357B (en) Touch system and pointer coordinate detecting method therefor
TWI501121B (en) Gesture recognition method and touch system incorporating the same
US10152177B2 (en) Manipulation detection apparatus, manipulation detection method, and projector
US8610670B2 (en) Imaging and display apparatus, information input apparatus, object detection medium, and object detection method
JP6723814B2 (en) Information processing apparatus, control method thereof, program, and storage medium
CN102033657B (en) Touch system, method for sensing height of referent and method for sensing coordinates of referent
US20150049063A1 (en) Touch Sensing Systems
EP1550940A2 (en) Pointer tracking across multiple overlapping coordinate input sub-regions defining a generally contiguous input region.
EP2284668A2 (en) Interactive input system and components therefor
MX2011008489A (en) Touch pointers disambiguation by active display feedback.
US20100188355A1 (en) Apparatus and method for detecting an object pointed by a user
KR20080104100A (en) Pointing device using camera and outputting mark
US20170024044A1 (en) Touch apparatus and operating method of touch apparatus
CN102063231A (en) Non-contact electronic whiteboard system and detection method based on image detection
CN102033656B (en) Gesture identification method and interaction system using same
CN102446034B (en) Optical touch control system and object sensing method thereof
WO2011047459A1 (en) Touch-input system with selectively reflective bezel
CN105807989A (en) Gesture touch method and system
JP2002351615A (en) Display device
CN101989150A (en) Gesture recognition method and touch system using same
KR101105872B1 (en) Method and apparatus for a hand recognition using an ir camera and monitor
US9489077B2 (en) Optical touch panel system, optical sensing module, and operation method thereof
KR20130136313A (en) Touch screen system using touch pen and touch recognition metod thereof
CN105278760B (en) Optical touch system
KR20090090980A (en) Pointing apparatus using image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140416

Termination date: 20170924