CN105094459B - A kind of optics multi-point touch locating method - Google Patents

A kind of optics multi-point touch locating method Download PDF

Info

Publication number
CN105094459B
CN105094459B CN201510121998.5A CN201510121998A CN105094459B CN 105094459 B CN105094459 B CN 105094459B CN 201510121998 A CN201510121998 A CN 201510121998A CN 105094459 B CN105094459 B CN 105094459B
Authority
CN
China
Prior art keywords
region
point
camera
touch
terrible
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510121998.5A
Other languages
Chinese (zh)
Other versions
CN105094459A (en
Inventor
张海艳
高尚兵
骆威
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huaiyin Institute of Technology
Original Assignee
Huaiyin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huaiyin Institute of Technology filed Critical Huaiyin Institute of Technology
Priority to CN201510121998.5A priority Critical patent/CN105094459B/en
Publication of CN105094459A publication Critical patent/CN105094459A/en
Application granted granted Critical
Publication of CN105094459B publication Critical patent/CN105094459B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention discloses a kind of large scale multiple point touching positioning system based on more optical imageries, the method includes:Entire touch panel is divided by several regions according to optical camera property first, and each region is limited using three groups of angle combinations, the invalid combination " terrible point " of half or so when can effectively eliminate multiple point touching positioning by this region segmentation;Then according to the distance of each region distance optical imaging apparatus, each region area threshold value is set, partial touch " terrible point " is effectively eliminated by the way that the threshold value is arranged;Matched method is finally carried out with each optical device imaging angle using remaining each point and further eliminates possible touch point, and it can judge that each touch point is blocked in those optical devices by this matching, triangulation location is carried out so as to efficiently use the optical device not blocked.The present invention can be accurately positioned in the application of more optical device multiple point touchings, and can be effectively eliminated since multiple point touching and multiple spot imaging say " terrible point " problem introduced.

Description

A kind of optics multi-point touch locating method
Technical field
The present invention relates to optical touch control technology and human-computer interaction technique fields more particularly to multiple point touching to interact skill Art.
Background technology
Fighter plane touch control technology keeps human-computer interaction more intuitive as a kind of novel computer input technology, by In giving bringing great convenience property of user, other than being applied to portable personal information products, application field has spread information man The every field such as electricity, public information, electronic game, business automation equipment.Common touch control technology includes capacitive touch Technology, resistive touch technology, infrared touch technology or optical touch technology etc. are touched, wherein optical imagery multiple point touching interacts Technology is always large scale interaction industrial hot spot technology, but the technology is by multiple point touching combination computation complexity high, " terrible point " The limitation of problem and positioning accuracy, computation complexity directly influence the real-time response of equipment, and " terrible point " causes to generate when touching False motion track, positioning accuracy directly influence touch effect, and exactly these reasons limit optical imagery multiple point touching The extensive use of interaction technique.However have structure, installation and debugging simple based on optical multiple point touching technology, and it is at low cost, it touches Size is touched without advantages such as limitations, there is huge potential market, so solving multiple point touching combination computation complexity height, eliminating " terrible point " and it is accurately positioned the great meaning of true touch point.
Invention content
Goal of the invention:Present invention mainly solves multiple point touching combination computation complexities high, " terrible point " elimination and actual touch Point is accurately positioned problem.
Scheme of the invention:The present invention is positioned using three optical cameras, and three optical cameras are respectively placed in Petting Area The upper left corner in domain(A), the upper right corner(C)And center of top(B), see that Fig. 2, each optical camera are synchronized with 120 frames/second speed Shooting, each touch point hot spot described in three optical camera A, B, C refers to imaging of the touch point in optical camera;The screening Gear refers to that the hot spot of at least one touch point is blocked in the imaging of same optical camera by the hot spot of another touch point;It is described " terrible point " refers to pseudo- touch point obtained from being calculated by related facula information faulty combination in three optical cameras, non-genuine to touch It touches a little;The hot spot triangle area refers to by calculating each touch point facula information in three optical cameras, obtaining The straight line intersected two-by-two to three groups then generates three intersection points, and hot spot triangle area refers to just three formed triangles of intersection point The area of shape;These three intersecting point coordinates are identical in the ideal case, then it is a point to degenerate.
Invention key step:
Step 1:Touch interaction area subregion:By optical lens physical characteristic, the angular range captured by camera lens is carried out Equalization divides;Fish eye lens A, C areas imaging positioned at the upper left corner, the upper right corner is 90 degree, is located at the flake mirror of center of top Head B areas imagings are that B is divided into 6 equal portions, each region accounts for 30 degree, after subregion by 180 degree so A, C are divided into 3 equal portions Touch interaction area such as Fig. 3, the angular range in each region is as follows:
Region 0:(π/3, pi/2,5 π/6, π, 5 π/6, π);
Region 1:(π/6, π/3,5 π/6, π, 5 π/6, π);
Region 2:(0, π/6,5 π/6, π, 5 π/6, π);
Region 3:(0, π/6,0, π/6,5 π/6, π);
Region 4:(0, π/6,0, π/6,2 π/3,5 π/6);
Region 5:(0, π/6,0, π/6, pi/2,2 π/3);
Region 6:(π/3, pi/2,2 π/3,5 π/6,5 π/6, π);
Region 7:(π/6, π/3,2 π/3,5 π/6,5 π/6, π);
Region 8:(0, π/6,2 π/3,5 π/6,5 π/6, π);
Region 9:(0, π/6, pi/2,2 π/3,5 π/6, π);
Region 10:(0, π/6, π/3, pi/2,5 π/6, π);
Region 11:(0, π/6, π/6, π/3,5 π/6, π);
Region 12:(0, π/6, π/6, π/3,2 π/3,5 π/6);
Region 13:(0, π/6, π/6, π/3, pi/2,2 π/3);
Region 14:(π/3, pi/2,2 π/3,5 π/6,2 π/3,5 π/6);
Region 15:(π/6, π/3, pi/2,2 π/3,5 π/6, π);
Region 16:(0, π/6, π/3, pi/2,2 π/3,5 π/6);
Region 17:(π/6, π/3, π/6, π/3, pi/2,2 π/3);
Region 18:(π/3, pi/2, pi/2,2 π/3,2 π/3,5 π/6);
Region 19:(π/6, π/3, pi/2,2 π/3,2 π/3,5 π/6);
Region 20:(π/6, π/3, π/3, pi/2,2 π/3,5 π/6);
Region 21:(π/6, π/3, π/3, pi/2, pi/2,2 π/3).
By subregion, it just can will touch that interaction area is complete to combine, and each region passes through three pairs of angle models It encloses and is defined;If there are touch point p in region 9, then the touch point corresponds to hot spot and is respectively present in optical lens A, B, C In following range:(0, π/6),(Pi/2,2 π/3),(5 π/6, π), be combined be region 9 angle control range; Further touch point p can limit p by combining as follows(), whereinFor p and A angulations, For p and B angulations,For p and C angulations.
Step 2 " terrible point " technology for eliminating
Through after step 1, there is its corresponding angle control range in the arbitrary touch point on touch area, we pass through Three kinds of technologies eliminate " terrible point " below:
1. the angle control combination of pair each touch point judges whether in effective regional perspective range, if so, Then retain;Otherwise it is judged to " terrible point ", and is rejected;
2. pair each region setting area threshold value calculates its hot spot triangle area to remaining each touch point, if its Area value is less than given area area threshold, then retains;Otherwise it is judged to " terrible point ", and is rejected;
3. pair remaining each touch point, searches for corresponding angle value in three optical cameras, detects whether respectively Identical value can be found, if can find same angular angle value in three optical cameras, is judged to " terrible point ";Otherwise it is judged to really touch It touches a little.
Step 3:True touch point location technology
Judge that with the presence or absence of blocking, triangulation location is carried out if not blocking using A, C camera for the touch point;If hair Life is blocked, then first judges have several optical lens to be blocked:If being only blocked there are one optical lens, remaining two are used Optical lens carries out triangulation location;If two optical lens are blocked, further judge whether B optical lens is blocked, if B It is not blocked, then triangulation location is calculated using B and A, C any combination;If B is blocked, three are being carried out using A, C optical lens Angle positions.
Invention effect:
The current multiple point touching technology based on optical imagery mostly uses three cameras and realizes, using four optical imageries There is also cost price is higher, and Processing Algorithm is increasingly complex, although in partial picture energy at present for the multiple point touching technology of equipment " terrible point " and occlusion issue are solved, but can not be fully solved.Multiple point touching technology based on three optical imaging apparatus, it is main at present Tracking is used to eliminate " terrible point " method, but there are computation complexity height, " terrible point " eradicating efficacy difference and actual touch for this method The problems such as positioning accuracy is low, the present invention are based on these problems and propose new solution.The present invention will touch hand over first Mutual region carries out subregion according to optical imaging apparatus characteristic, and each effective touch area is defined with angle control range, to It can effectively reduce to combine in multiple point touching and calculate, effectively rejecting can not possibly existing number of combinations;Three steps " ghost is used again Point " removing method effectively rejects obtained from being calculated because of combination " terrible point ", and then improves system stability;Finally judge light It learns camera lens to be blocked situation, according to the concrete condition that each optical lens is blocked, using different triangulation location methods, to carry High actual touch spot placement accuracy.The measured result of the present invention shows:The algorithm of exploitation can effectively reduce combination and calculate complexity Degree improves system and responds real-time;Combination can be effectively eliminated and calculate " terrible point ", ensure system run all right;To optical imagery The judgement that camera lens blocks can significantly improve touch positioning accuracy.
Description of the drawings:
The following further describes the present invention with reference to the drawings:
Fig. 1 is system execution flow chart;
Fig. 2 is to touch interactive device structure chart;
Fig. 3 is touch point hot spot schematic diagram;
Fig. 4 is to touch interaction area subregion schematic diagram;
Fig. 5 is " terrible point " schematic diagram;
Fig. 6 is that right camera is blocked schematic diagram;
Fig. 7 is three touch points while touching light path schematic diagram;
Fig. 8 is that touch point corresponds to light spot image schematic diagram in optical lens in Fig. 7.
Specific implementation mode
One embodiment of the present of invention is described further below in conjunction with the accompanying drawings:
The embodiment of the present invention is implemented on following hardware device, and the present embodiment is only an example of the invention, to this Invention does not generate any restriction effect, and any hardware configuration and software algorithm without essence modification are all in protection scope of the present invention It is interior.This example is positioned using three optical cameras, and three optical cameras are respectively placed in the upper left corner of touch area(A), The upper right corner(C)And center of top(B), see that Fig. 2, each optical camera synchronize shooting, each touch point with 120 frames/second speed Corresponding hot spot is respectively formed in three optical camera A, B, C, screen resolution is that 1920 × 1080. cameras obtain light Optical imagery is input in computer through USB after spot, carries out denoising, distortion correction to obtaining light spot image in a computer, Then touch point location is carried out using the developed algorithm of the present invention, touch is shown on touch panel eventually by display program Point.If there are three touch point a, b, c simultaneously touch on touch panel, as shown in fig. 6, Fig. 7 be its in each optical camera Corresponding light spot image is respectively a by can be calculated a, b, c angulation in optical camera A, B, C(),b(),c(), 18 can be obtained altogether by combining to calculate Kind combination, this available 27 kinds of combination, but due to, there are touch point circumstance of occlusion, number of combinations being caused to decline in B cameras.Through with Effective coverage combinations matches can further eliminate invalid number of combinations, finally obtain 10 kinds of combinations, finally obtained efficient combination It is as follows:
Combination 1:();
Combination 2:();
Combination 3:();
Combination 4:();
Combination 5:();
Combination 6:();
Combination 7:();
Combination 8:();
Combination 9:();
Combination 10:();
These combinations are located in region 7,15,21,8,13,9,11,12,13,14.It can be concluded that, with tactile Touch increasing for points, invalid combination number also increases therewith, in the case that unobstructed, use zone method can effectively reject half with On invalid combination, to which computation complexity directly reduced half.Obviously, there is false combination in remaining combination, just It is the presence of these falseness combinations, introduces so-called " terrible point ", part ghost can be further eliminated using region area threshold method Point.The setting of region area threshold value and imaging device precision, touch point and imaging device distance, touch point and camera lens optical axis institute at Corner dimension is related, and each region threshold setting is as follows in the present embodiment:
Region 0:800 regions 1:800 regions 2:800
Region 3:800 regions 4:800 regions 5:800
Region 6:200 regions 7:300 regions 8:200
Region 9:200 regions 10:200 regions 11:200
Region 12:100 regions 13:500 regions 14:200
Region 15:100 regions 16:100 regions 17:1000
Region 18:100 regions 19:100 regions 20:100
Region 21:500
It is final to reject 6 groups of falseness combinations by area threshold method, it is combined in residue 4, these four combinations are respectively:
Combination 1:();
Combination 3:();
Combination 5:();
Combination 10:().
These four combinations correspond to and 4 points of a, b, c, d in Fig. 6 respectively.It is described below and further eliminates " terrible point " method:? Global search is carried out in remaining combination, and judges the value of counter C, if C=3, shows that current search point is " terrible point ", If C=2 or C=1, show that it is true touch point, but or blocked by other true touch points, or blocked by " terrible point ", If C=0, show that the point is true touch point, and be not blocked.Example:If examining whether a is " terrible point ", initialization counter C = 0;Examine first other touch points in camera A angulation whether be, C=C+1 if having exits and works as Preceding cycle;Otherwise C is constant, continues search for, until all combinatorial search are completed;Next detects other touch points in camera In B angulation whether be, execute same flow;Finally detect other touch points in camera C angulation whether For, execute same flow;If last C=3, show that a is " terrible point ", otherwise a is true touch point.To b, c, d point Same global search is carried out, search result is as follows:
a: C = 1;
b: C = 2;
c: C = 2;
d: C = 3。
It is possible thereby to judge d for " terrible point ", a, b, c are true touch point.But still it can not determine the feelings that are blocked in a, b, c Condition.After rejecting " terrible point " c, same global search is carried out again, is obtained:
a: C = 0;
b: C = 1;
c: C = 1;
It understands that touch point a is not blocked, upper left corner camera A and upper right corner camera C can be used and carry out triangulation location;b It is blocked in a camera with c, by analysis data it is found that b and c is mutually blocked in camera C simultaneously, belongs to one A camera is blocked situation;So camera A and B, which may be used, carries out triangulation location.By surveying, what the present invention was developed Algorithm can effectively reduce combination computation complexity, improve system operation real-time, " terrible point " can be effectively rejected, to ensure system Operation stability, the judgement to camera lens circumstance of occlusion, further improves positioning accuracy.It states again, the present embodiment is only pair The simple application citing of the present invention, any algorithm without essence modification belong to the row of institute's protection domain of the present invention.

Claims (5)

1. a kind of camera type touch device localization method, by be placed on top two corners and intermediate fish-eye camera shooting at Picture, imaging region are limited on touch panel, and coordinate position of the touch point on touch panel is positioned by image, special Sign is:Specific steps include:
(1) according to the imaging property of fish-eye camera, region division is carried out to touch panel;
(2) according to touch point in each region at a distance from fish-eye camera and touch point with fish-eye camera camera lens optical axis institute at folder Angle determines the area threshold of each region touch point, and the terrible point in part is eliminated according to area threshold;
(3) angle number for being left each touch point in corresponding camera is calculated, and is further disappeared according to the number of the same angular number of degrees Except existing terrible point;
(4) according to the angle combinations in camera of remaining true touch point, each true touch point is calculated on touch panel Coordinate position, touch independent positioning method be:
(4.1) value that counter is corresponded to according to each point, judges the circumstance of occlusion of each point;
(4.2) if counter is 0, show that the point is not blocked, then use the camera of two corners to be positioned;
(4.3) if counter is 1, show that this o'clock is blocked in a camera, then using two cameras not blocking into Row positioning;
(4.4) if counter is 2, show that this o'clock is blocked in two cameras, then using the point not being blocked and any screening The camera of gear is positioned.
2. camera type touch device localization method according to claim 1, it is characterised in that:In the step (1), to touching Touch panel zone division the specific steps are:
(1.1) the first camera is divided into three angular ranges, each angular range is (0, π/6) (0, π/6), (π/6, π/3) (π/6, π/3), (π/3, pi/2) (π/3, pi/2);
(1.2) second camera is divided into six angular ranges, each angular range is (0, π/6) (0, π/6), (π/6, π/3) (π/6, π/3), (π/3, pi/2) (π/3, pi/2), (pi/2,2 π/3) (pi/2,2 π/3), (2 π/3,5 π/6) (2 π/3,5 π/6), (5 π/ 6, π) (5 π/6, π);
(1.3) third camera being divided into three angular ranges, each angular range is (pi/2,2 π/3) (pi/2,2 π/3), (2 π/ 3,5 π/6) (2 π/3,5 π/6), (5 π/6, π) (5 π/6, π);
(1.4) it is 22 regions by each camera angle segmentation Image Segmentation Methods Based on Features by touch panel whole region, each region is with three pairs Angular range controls, and an angular regions of the first camera, second camera and third camera are corresponded respectively to per a pair.
3. camera type touch device localization method according to claim 1, it is characterised in that:In the step (2), each area The area threshold setting in domain is as follows:Region 0:800, region 1:800, region 2:800, region 3:800, region 4:800, region 5: 800, region 6:200, region 7:300, region 8:200, region 9:200, region 10:200, region 11:200, region 12:100, Region 13:500, region 14:200, region 15:100, region 16:100, region 17:1000, region 18:100, region 19: 100, region 20:100, region 21:500.
4. camera type touch device localization method according to claim 1, it is characterised in that:In the step (2), eliminate Terrible point methods are:
(2.1) angle combinations of point to be determined are judged, so that it is determined that it is in which region;
(2.2) imaging angle according to touch point in three cameras generates three straight lines, then three straight lines are all by touching Point;
(2.3) judge the coordinate that three straight lines intersect two-by-two, obtain three coordinate points, and calculate according to these three coordinate positions The area of its triangle formed;
(2.4) threshold value for comparing the area and the region if less than thinking that the touch point is terrible point if threshold value, and is eliminated, otherwise, Retain.
5. camera type touch device localization method according to claim 1, it is characterised in that:In the step (3), eliminate Ghost point method be:
(3.1) an empty counter is set;
(3.2) angle value consistent with point to be determined is searched on three cameras respectively, counter adds one if finding;
(3.3) judge the value of counter, if counter is equal to three, this can determine whether that point to be determined is terrible point, otherwise, be touched to be formal Point.
CN201510121998.5A 2015-03-20 2015-03-20 A kind of optics multi-point touch locating method Active CN105094459B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510121998.5A CN105094459B (en) 2015-03-20 2015-03-20 A kind of optics multi-point touch locating method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510121998.5A CN105094459B (en) 2015-03-20 2015-03-20 A kind of optics multi-point touch locating method

Publications (2)

Publication Number Publication Date
CN105094459A CN105094459A (en) 2015-11-25
CN105094459B true CN105094459B (en) 2018-11-02

Family

ID=54575065

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510121998.5A Active CN105094459B (en) 2015-03-20 2015-03-20 A kind of optics multi-point touch locating method

Country Status (1)

Country Link
CN (1) CN105094459B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108536037B (en) * 2018-07-12 2023-08-11 四川虹美智能科技有限公司 Control equipment and method of intelligent household appliance and intelligent household appliance
CN110275645B (en) * 2019-06-12 2022-08-05 青岛海信商用显示股份有限公司 Touch point identification method, touch point identification device, storage medium and touch device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697105A (en) * 2009-10-26 2010-04-21 广东威创视讯科技股份有限公司 Camera type touch detection positioning method and camera type touch detection system
CN102419662A (en) * 2011-06-13 2012-04-18 北京汇冠新技术股份有限公司 Multipoint identification method and system for infrared touch screen
CN102662532A (en) * 2012-03-29 2012-09-12 广东威创视讯科技股份有限公司 Multipoint touch coordinates positioning method and device
CN103399674A (en) * 2013-08-01 2013-11-20 广东威创视讯科技股份有限公司 Method and device of multi-point touch detection

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697105A (en) * 2009-10-26 2010-04-21 广东威创视讯科技股份有限公司 Camera type touch detection positioning method and camera type touch detection system
CN102419662A (en) * 2011-06-13 2012-04-18 北京汇冠新技术股份有限公司 Multipoint identification method and system for infrared touch screen
CN102662532A (en) * 2012-03-29 2012-09-12 广东威创视讯科技股份有限公司 Multipoint touch coordinates positioning method and device
CN103399674A (en) * 2013-08-01 2013-11-20 广东威创视讯科技股份有限公司 Method and device of multi-point touch detection

Also Published As

Publication number Publication date
CN105094459A (en) 2015-11-25

Similar Documents

Publication Publication Date Title
TWI690842B (en) Method and apparatus of interactive display based on gesture recognition
EP3951721A1 (en) Method and apparatus for determining occluded area of virtual object, and terminal device
US20200073509A1 (en) Direction determination system and direction determination method
US8797271B2 (en) Input aggregation for a multi-touch device
US20190265841A1 (en) 3d touch interaction device, touch interaction method thereof, and display device
US20160282980A1 (en) Capacitive measurement processing for mode changes
JP5802247B2 (en) Information processing device
CN102096530A (en) Multi-touch trajectory tracking method
WO2012129973A1 (en) Method of identifying multi-touch scaling gesture and device using the same
CN103412720A (en) Method and device for processing touch-control input signals
CN101566898B (en) Positioning device of electronic display system and method
CN102364419B (en) Camera type touch control method and system thereof
CN103033145B (en) For identifying the method and system of the shape of multiple object
CN105094459B (en) A kind of optics multi-point touch locating method
US9122346B2 (en) Methods for input-output calibration and image rendering
CN102346605B (en) Photographing type touch control method and system
JP6207023B2 (en) Rotate objects on the screen
CN202443449U (en) Photographic multi-point touch system
CN102622140A (en) Image pick-up multi-point touch system
CN105653101B (en) Touch point sensing method and optical touch system
Cheng et al. Fingertip-based interactive projector–camera system
CN102479002B (en) Optical touch control system and sensing method thereof
CN102306070B (en) Camera shooting type touch control method and device
CN102323866B (en) Camera shooting type touch control method and device
CN102364418B (en) Optical touch-control positioning system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP02 Change in the address of a patent holder

Address after: 223200 Jiangsu province Huaian Huaian District bamboo Lane Street Huaiyin Institute of Technology Xiao Hu Campus

Patentee after: Huaijin Polytechnical College

Address before: 223003 Huaian City, Jiangsu Province, No. 1 East Road

Patentee before: Huaijin Polytechnical College

CP02 Change in the address of a patent holder
CP02 Change in the address of a patent holder

Address after: 223400 8th floor, Anton building, 10 Haian Road, Lianshui County, Jiangsu.

Patentee after: Huaijin Polytechnical College

Address before: 223200 Jiangsu province Huaian Huaian District bamboo Lane Street Huaiyin Institute of Technology Xiao Hu Campus

Patentee before: Huaijin Polytechnical College

CP02 Change in the address of a patent holder
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20151125

Assignee: Jiangsu Dengxiang Construction Co., Ltd

Assignor: Huaijin Polytechnical College

Contract record no.: X2019980000617

Denomination of invention: Optical multi-point touch positioning method

Granted publication date: 20181102

License type: Common License

Record date: 20191118

EE01 Entry into force of recordation of patent licensing contract