CN104331193A - Infrared precise multi-point touch platform - Google Patents

Infrared precise multi-point touch platform Download PDF

Info

Publication number
CN104331193A
CN104331193A CN201410709584.XA CN201410709584A CN104331193A CN 104331193 A CN104331193 A CN 104331193A CN 201410709584 A CN201410709584 A CN 201410709584A CN 104331193 A CN104331193 A CN 104331193A
Authority
CN
China
Prior art keywords
contact
image
module
gesture
infrared
Prior art date
Application number
CN201410709584.XA
Other languages
Chinese (zh)
Inventor
曾芝冰
张茹
孙帅
赵佳
刘琼
梁安琪
Original Assignee
湖北印象光电信息产业有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 湖北印象光电信息产业有限公司 filed Critical 湖北印象光电信息产业有限公司
Priority to CN201410709584.XA priority Critical patent/CN104331193A/en
Publication of CN104331193A publication Critical patent/CN104331193A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for entering handwritten data, e.g. gestures, text
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04808Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Abstract

The invention discloses an infrared precise multi-point touch platform, which comprises a hardware system part and a software system part, wherein the hardware system part comprises an infrared transmitting tube array, a touch screen, a camera, a computer and a projector; the software system part comprises a contact tracking module and a gesture recognition module; the contact tracking module comprises an image processing sub module, a contact profile extracting sub module and a contact tracking sub module; the gesture recognition module comprises a multi-point touch gesture analysis and definition sub module, a gesture recognition and judgment sub module and a gesture driving sub module. The touch platform disclosed by the invention can realize human-machine intelligent interaction by returning infrared variation caught by the special camera and then locating in the computer; on the aspect of hardware, the touch platform has advantages of high recognition precision, low cost, simple structure, convenience in updating and the like, and on the aspect of software, the touch platform is characterized by being concise and easy in understanding of program, easy to operate, easy to expand, strong in transplanting, strong in adaptability, etc. on the aspect of software; and the touch platform can guarantee smooth coordination between software and hardware systems, and is easy to implement.

Description

A kind of infrared accurate multi-point touch platform

Technical field

The invention belongs to infrared touch technical field, particularly relate to a kind of infrared accurate multi-point touch platform.

Background technology

Infrared multi-point touch system is utilize the infrared ray matrix that X, Y-direction are gathered detect and locate the electronic equipment of the touch gestures of people on hardware.Infrared touch panel installs a circuit board housing before display, and circuit board is at screen four limit arrangement infrared transmitting tube and infrared receiving tube, and one_to_one corresponding forms the infrared ray matrix anyhow intersected.Finger is when touch screen, and will block two infrared rays anyhow through this position, thus can judge the coordinate position of touch point at screen, any nontransparent object all can change the infrared ray on contact and realize touch screen operation.

Infrared multi-point touch system touches product relative to the one of single-point infrared screen and virtual 2 infrared screen, be a kind of technical renovation of infrared touch panel, its principle mainly solves the not interference problem of more than 2 touch operations simultaneously by the algorithm of software in firmware.The difference of true 2 and virtual 2 shows high stability and fast in response, can not hop, run the maloperations such as point.

Early stage infrared touch panel exists that resolution is low, touch manner is restricted and be subject to environmental interference and the technical limitation such as misoperation, market of thus once fading out.After this second generation infrared screen part solves the problem of anti-light interference, and the third generation and forth generation also improve to some extent in lifting resolution and stability.The clear superiority that infrared touch panel and capacitance resistance shield is not by electric current, voltage and electrostatic interference, suitable rugged environment condition.Infrared technology is the development trend of touch-screen product main flow, adopts the touch screen of acoustics and other materialogy technology to have it to be difficult to the barrier gone beyond, impaired, aging as single-sensor, and touch interface is afraid of contaminated, destructive use, safeguards the problems such as numerous and diverse.As long as infrared touch panel really achieves high stable performance and high resolving power, other technical products will be substituted and become the touch-screen market mainstream.

Along with the development of science and technology, multiple point touching technology has achieved huge development, people are more and more higher for the requirement touched, traditional infrared touch cannot meet the needs in market, and multiple point touching technology enters the real multiple point touching touch-control epoch from the two traditional touch epoch.

Infrared multi-point touch screen is little by means of its volume, stability is strong, light resistance is high and the favourable advantage of low cost, products can be integrated in easily, the infrared touch technology of comparing traditional, infrared multi-point touch screen can detect multiple touch point accurately, meet industry-by-industry, the different demands of various product, will replace traditional touching technique in the near future.

The generation of infrared multi-point touch screen and application, facilitate people the operation of digital living is used, really achieve a complete human-computer interaction system, infrared multi-point touch technology is shown one's talent among various touching technique, start the use replacing mouse, clipboard or even keyboard, become the direction of touch-screen market future development gradually.The development of infrared multi-point touch screen also more and more presents the trend such as diversification, specialization, simplification and giant-screen.

Along with development and the progress of science and technology, touching technique also obtain constantly brings forth new ideas and development, infrared touch screen technology also experienced by from single-point identification, to 2 identifications, multiple spot identification up till now again, but the product of existing Multi-point infrared touching technique in the market, also do not have one both can meet consumers' demand on hardware, also simple operation on software, the infrared accurate multi-point touch platform of high transplantability and high scalability occurs.

Summary of the invention

The object of the present invention is to provide a kind of infrared accurate multi-point touch platform, thus solve Problems existing in background technology.

Technical matters solved by the invention realizes by the following technical solutions:

A kind of infrared accurate multi-point touch platform, comprise hardware system part and software systems part, described hardware system part comprises infrared light emission pipe array, touch-screen, camera, computing machine and projector, described software systems part comprises contact tracing module and gesture recognition module, described contact tracing module comprises image procossing submodule, contact contours extract submodule and contact and follows the trail of submodule, and described gesture recognition module comprises multi-touch gesture analytic definition submodule, gesture identification judges submodule and gesture driven element module.

Described infrared light emission pipe array provides infrared light supply, described touch-screen is for receiving user's touch operation, described camera is for catching the infrared light image of finger reflection, described computing machine completes contact and follows the tracks of, the click of gesture identification and gesture operation screen object, amplification, reduction capability, described projector is then for showing final process result.

The function of described image procossing submodule carries out image pretreatment operation, comprise video flowing to catch, image color space conversion and image remove background process, then the foreground image comprising contact object is processed, comprise image smoothing, Fuzzy Processing, and morphological operation, make the annoyance level of non-main part in image reach minimum.

The function of described contact contours extract submodule extracts the outline of all contacts, calculates and preserve x coordinate and the y coordinate at each profile center, in the process according to the profile threshold size arranged, getting rid of invalid contact.

The function of described contact tracking submodule is the length according to contact center coordinate displacement in two continuous frames image, judge which contact is emerging contact, which is identical with the contact existed before, after tracking the contact object in image, also need to be normalized it, so conveniently be transplanted on the display device of other sizes, then encapsulation of data is TUIO packet and sends to gesture recognition module by Socket communication mode.

The function of described gesture recognition module is after being responsible for receiving packet that contact tracing module sends, the corresponding byte information of packet is analyzed according to TUIO protocol format, according to the status information of contact and the shape of coordinate set analysis contact running orbit, identify touch gestures, then mate gesture and complete corresponding operation.

 

Described image procossing submodule comprises pretreatment module, image enhancement module, morphological image processing module:

(1) image pre-processing module: be responsible for the pretreatment operation to image, comprise the acquisition procedure of video flowing, the process of image color space conversion and image background Transformatin, for removing the many background images of noise, for follow-up image processing operations provides the foreground image only comprising contact object;

(2) image increases module: be responsible for carrying out self-adaptation get threshold operation to removing the gray level image after background, and according to the appropriate threshold binary image found, and use median filter, high pass Fuzzy smooth image.The object using aforesaid operations to carry out image enhaucament is the quality in order to improve picture, as increased contrast, removes fuzzy and noise, Modified geometrical distortion.Image can be converted to the form being more suitable for people or equipment analysis by image enhaucament, has good application to the picture obtained under shooting condition limited circumstances;

(3) morphological image processing module: main realization uses etching operation and expansive working to carry out feature extraction and boundary detection operation to bianry image.This morphological operation can simplified image data, keep the shape facility that they are basic, and remove incoherent structure.After carrying out etching operation and expansive working to image, the profile border of contact is high-visible, and the noise on some profiles and incoherent structure are removed, and is easier to follow-up extraction contact profile operational like this.

Described contact contours extract submodule comprises profile extraction module, profile centre coordinate computing module and invalid contact and gets rid of module:

(1) profile extraction module: define value according to contour edge, extract the outline of all contacts and preserve related data in bianry image;

(2) profile centre coordinate computing module is according to the gray-scale value on contact profile and its x, y coordinate, calculates and stores the centre coordinate of contact profile;

(3) module is got rid of then according to the outer surface sum perimeter threshold extracted in invalid contact, carries out eliminating process to invalid finger contact.

Described gesture recognition module comprises multi-touch gesture analytic definition submodule, gesture identification judges submodule and gesture driven element module:

(1) described multi-touch gesture analytic definition submodule is responsible for deciding to exchange the method for gesture library from system platform and project task, respectively corresponding multiple interactive gesture and finger movement corresponding to gesture;

(2) described gesture identification judges that submodule is responsible for the packet received to analyze according to TUIO protocol format, takes out the corresponding information of contact, then the running orbit of contact, status information is saved with the form of object.Once touch screen is all left in contact, represent that touch gestures terminates, the data message at this moment started this contact object is preserved carries out analyzing and processing, and according to the contact number on current screen, and the actual motion trajectory shape of contact carries out gesture identification;

(3) described gesture driven element module in charge is according to the recognition result of gesture identification submodule, has carried out actual gesture business operation in conjunction with operation system demand.

The present invention has following beneficial effect:

The invention provides a kind of infrared accurate multi-point touch platform, that a kind of efficient and finger multiple point touching of practicality gathers, identifies, processing platform, feed back to again and position process inside computing machine by catching ultrared change with specific camera head and realize human-machine intelligence's interaction, when the hand of user touches on glass, just can replace mouse function by hand, have the function clicked and drag.The compatible Win7/WinXP system of the present invention, EMS memory occupation is low, hardware has the advantages such as accuracy of identification is high, cost is low, structure is simple, upgrading is convenient, software has program succinctly understandable, the features such as easy to operate, easy expansion, transplantability are strong, strong adaptability, can ensure that software and hardware system co-ordination runs smooth, realize simple.

Accompanying drawing explanation

Fig. 1 is Image semantic classification process flow diagram flow chart of the present invention;

Fig. 2 is image enhancement processes process flow diagram of the present invention;

Fig. 3 is contact of the present invention contours extract process flowchart.

Embodiment

The technological means realized to make the present invention, creation characteristic, reaching object and effect is easy to understand, below in conjunction with concrete diagram, setting forth the present invention further.

A kind of infrared accurate multi-point touch platform, comprise hardware system part and software systems part, the multiple point touching technology platform based on optics and computer vision that hardware system part adopts Rear-DI technology to build, the principle that realizes of platform uses infrared light supply to irradiate projection screen to form uniform radiation response, when there being finger touch screen, infrared light can be reflected to form shade, thus is caught by infrared camera.Comprise hardware system part and software systems part, hardware system part comprises infrared light emission pipe array, touch-screen, camera, computing machine and projector, wherein infrared light emission pipe array can provide infrared light supply, infrared touch panel catches the infrared light image of touch-screen left-hand seat digital reflex, contact tracing module identification infrared light image, extracts contact profile, and calculates profile centre coordinate, finally obtain the locus of finger touch point, follow the trail of the motion track of contact.The contact motion track information tracked, and the status information of contact can be sent to gesture recognition module.Gesture recognition module completes the identification mission to gesture, and complete predefined business operation according to the gesture identified, and by result through projector in touch screen, thus by hardware system and the software systems that are based upon on hardware system, realize multi-touch gesture direct control and control.

Software systems part comprises contact tracing module and gesture recognition module, contact tracing module comprises image procossing submodule, contact contours extract submodule and contact and follows the trail of submodule, and gesture recognition module comprises multi-touch gesture analytic definition submodule, gesture identification judges submodule and gesture driven element module; Contact contours extract submodule comprises profile extraction module, profile centre coordinate computing module and invalid contact and gets rid of module; Gesture recognition module comprises multi-touch gesture analytic definition submodule, gesture identification judges submodule and gesture driven element module.

Image processing module is responsible for first carrying out image pretreatment operation, comprise video flowing to catch, image color space conversion and image remove background process, then the foreground image comprising contact object is processed, comprise image smoothing, Fuzzy Processing, and the operation such as morphology, make the annoyance level of non-main part in image reach minimum.

Image procossing submodule has been responsible for the pretreatment operation to image, comprise the acquisition procedure of video flowing, the process of image color space conversion and image background Transformatin, for removing the many background images of noise, for follow-up image processing operations provides the foreground image only comprising contact object.

The process flow diagram of Image semantic classification as shown in Figure 1 can find out that first completing video flowing catches, and system uses video camera to catch finger manipulation video flowing, completes video flowing reading by calling OpenCV built-in function.First define for controlling camera and obtaining the CvCapture structure of video flowing, define the structure being used for depositing each two field picture of video again, then the window Video of display original video is created, and the window Foreground of Graphics Processing rear video, read camera video stream, each frame that circulation is read is set, if the first two field picture, then also need application internal memory carry out initialization, if not the first two field picture, then start to process image and follow the trail of the motion track of contact.After having read video flowing, destroy window and release graphics picture.Then carry out image color space conversion process, adopt the cvCvtColor () function that provides of OpenCV to realize image to carry out color space conversion in realization, then picture format is converted into after matrix format for subsequent operation.Finally carry out image background Transformatin, in the first frame of video image, time often finger contact does not also occur, preserving the first two field picture is background image, the gray matrix that each two field picture of later reading is background image does subtractive method process, result of calculation is zero place, then gray-scale value corresponding in matrix is herein set to 0; Subtracting each other the non-vanishing place of result, is then the absolute value subtracted each other after result by gray-scale value herein.

The realization of image enhancement module mainly uses OSTU algorithm to carry out self-adaptation to the gray level image after removal background and gets threshold operation, and according to the suitable threshold binarization image found, and use median filter, high pass Fuzzy smooth image.The object using these operations to carry out image enhaucament is the quality in order to improve picture, as increased contrast, removing fuzzy and noise, Modified geometrical distortion etc.Image can be converted to the form being more suitable for people or equipment analysis by image enhaucament, has good application to the picture obtained under shooting condition limited circumstances.

Image enhancement processes process flow diagram as shown in Figure 2, first specific implementation uses OSTU algorithm, according to the gray average in image and maximum between-cluster variance, find threshold value suitable in gray level image, then by function cvThreshold, gray-scale value dividing processing is carried out to image, the point of gray-scale value in image below threshold values is set to 0, otherwise be set to 255, the image black white contrast obtained is strong, except contact position is light tone, other positions are black without exception, are conducive to so clearly isolating contact object, extract the profile of contact.The smoothing processing of image, main function cvSmooth () that uses realizes median filter smoothness of image image and Gaussian Blur smoothed image, in order to remove noise in image and blurred portions, improves image definition.

Morphological image processing module mainly uses etching operation and expansive working to carry out the operation such as feature extraction and Boundary Detection to bianry image in realization.Morphological operation can simplified image data, keep the shape facility that they are basic, and remove incoherent structure.Use the Morphological scale-space of function cvErode () sum functions cvDilate () realization to bianry image of OpenCV.After carrying out etching operation and expansive working to image, the profile border of contact is high-visible, and the noise on some profiles and incoherent structure are removed, and is easy to follow-up extraction contact profile operational.

Contact contouring process, comprises contact contours extract, profile centre coordinate calculates and these three parts of process are got rid of in invalid contact.Contact contours extract defines value according to contour edge, extracts the outline of all contacts and preserve related data in bianry image.Profile centre coordinate computation process, according to the gray-scale value on contact profile and its x, y coordinate, calculates and stores the centre coordinate of contact profile.Invalid contact exclusion process, then according to the outer surface sum perimeter threshold extracted, carries out eliminating process to invalid finger contact.

Contact contours extract process flow diagram as shown in Figure 3, specific implementation use cvFindContours function can realize retrieving profile from bianry image, and return the number of the profile detected and the pointer of first profile, then the pointer contour of first outline in image can be obtained, algorithm uses h_next circulation to read each contact profile pointer, obtain each contact outline, then draw profile centre coordinate through zeroth order square formulae discovery.Then after the contour area getting contact and profile girth, need the area threshold according to arranging: 400-450 pixel and perimeter threshold: 80-100 pixel judges current contact profile whether within the scope of defined threshold, if do not exist, be considered as invalid contact profile, give up this contact; Otherwise be effective contact profile, continue to perform subsequent operation.

Contact is followed the trail of and is realized judging which contact is emerging contact, which is identical with the contact existed before, after tracking the contact object in image, also need to be normalized it, so conveniently be transplanted on the display device of other sizes, then encapsulation of data is TUIO packet and is sent by Socket communication mode.The implementation procedure of contact part is followed the trail of in contact, comprises data envelope process of assembling, the data communication protocol between contact tracing module and GIS gesture recognition module, and the status information of contact.

After gesture recognition module is responsible for receiving the packet that contact tracing module sends, the corresponding byte information of packet is analyzed according to TUIO protocol format, according to the status information of contact and the shape of coordinate set analysis contact running orbit, identify touch gestures, then mate gesture and complete corresponding operation.

Multi-touch gesture analytic definition submodule is responsible for deciding to exchange the method for gesture library from system platform and project task, respectively corresponding multiple interactive gesture and finger movement corresponding to gesture.The gesture analysis of touch multi-touch gesture of the present invention identification is realizing not having to adopt the direct mode selected from gesture library for gesture from general gestures analysis and designation framework, although because this mode is easy to use, practical, but its redundance is higher, gesture analysis of the present invention decides the selection in interactive storehouse from business task, can improve sensitivity and the real-time of system further.

Gesture identification judges that submodule is responsible for the packet received to analyze according to TUIO protocol format, takes out the corresponding information of contact, then the running orbit of contact, status information is saved with the form of object.Once touch screen is all left in contact, represent that touch gestures terminates, the data message at this moment started this contact object is preserved carries out analyzing and processing, and according to the contact number on current screen, and the actual motion trajectory shape of contact carries out gesture identification.Concrete in gesture identification realizes, first the mobile trajectory data of contact object is read, and to arrange effective residence time that contact stops in touch screen be 800-1200ms, whether the time then stopped on the touchscreen according to contact judges within effective time that whether contact is effective.For effective contact, according to contact displacement whether in threshold value s1(unit: pixel) be judged as that gesture is dynamic gesture or static gesture in scope.That is, if contact displacement is less than s1, be static gesture; Otherwise be dynamic gesture.For static gesture, the number according to rest(ing) contact judges gesture.If 1, then for singly to refer to touch gestures; If 2, be then two finger touch gestures.If more than 2, then it is invalid contact.For dynamic gesture, whether be greater than threshold value s2(unit according to relative motion distance between contact: pixel) judge whether relative movement.If relative motion distance is greater than threshold value s2, then for there being relative motion; Otherwise be without relative motion.

Gesture driven element module, according to the recognition result of gesture identification submodule, has carried out actual gesture business operation in conjunction with operation system demand.Specific implementation is use the built-in function in OpenCV identify valid function gesture in conjunction with gesture recognition process and drive completing of practical business action.

More than show and describe ultimate principle of the present invention and principal character and advantage of the present invention.The technician of the industry should understand; the present invention is not restricted to the described embodiments; what describe in above-described embodiment and instructions just illustrates principle of the present invention; without departing from the spirit and scope of the present invention; the present invention also has various changes and modifications, and these changes and improvements all fall in the claimed scope of the invention.Application claims protection domain is defined by appending claims and equivalent thereof.

Claims (8)

1. one kind infrared accurate multi-point touch platform, it is characterized in that: comprise hardware system part and software systems part, described hardware system part comprises infrared light emission pipe array, touch-screen, camera, computing machine and projector, described software systems part comprises contact tracing module and gesture recognition module, described contact tracing module comprises image procossing submodule, contact contours extract submodule and contact and follows the trail of submodule, and described gesture recognition module comprises multi-touch gesture analytic definition submodule, gesture identification judges submodule and gesture driven element module.
2. the infrared accurate multi-point touch platform of one according to claim 1, is characterized in that: described image procossing submodule comprises pretreatment module, image enhancement module, morphological image processing module.
3. the infrared accurate multi-point touch platform of one according to claim 1, is characterized in that: described contact contours extract submodule comprises profile extraction module, profile centre coordinate computing module and invalid contact and gets rid of module.
4. the infrared accurate multi-point touch platform of one according to claim 1, it is characterized in that: described infrared light emission pipe array provides infrared light supply, described touch-screen is for receiving user's touch operation, described camera is for catching the infrared light image of finger reflection, described computing machine completes contact and follows the tracks of, the click of gesture identification and gesture operation screen object, amplification, reduction capability, described projector is then for showing final process result.
5. the infrared accurate multi-point touch platform of one according to claim 1, it is characterized in that: described image procossing submodule carries out image pretreatment operation, comprise video flowing to catch, image color space conversion and image remove background process, then the foreground image comprising contact object is processed, comprise image smoothing, Fuzzy Processing, and morphological operation, make the annoyance level of non-main part in image reach minimum.
6. the infrared accurate multi-point touch platform of one according to claim 1, it is characterized in that: contact contours extract submodule extracts the outline of all contacts, calculate and preserve x coordinate and the y coordinate at each profile center, in the process according to the profile threshold size arranged, getting rid of invalid contact.
7. the infrared accurate multi-point touch platform of one according to claim 1, it is characterized in that: the length of submodule according to contact center coordinate displacement in two continuous frames image is followed the trail of in described contact, judge which contact is emerging contact, which is identical with the contact existed before, after tracking the contact object in image, also need to be normalized it, so conveniently be transplanted on the display device of other sizes, then encapsulation of data is TUIO packet and sends to gesture recognition module by Socket communication mode.
8. the infrared accurate multi-point touch platform of one according to claim 1, it is characterized in that: after described gesture recognition module is responsible for receiving the packet of contact tracing module transmission, the corresponding byte information of packet is analyzed according to TUIO protocol format, according to the status information of contact and the shape of coordinate set analysis contact running orbit, identify touch gestures, then mate gesture and complete corresponding operation.
CN201410709584.XA 2014-12-01 2014-12-01 Infrared precise multi-point touch platform CN104331193A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410709584.XA CN104331193A (en) 2014-12-01 2014-12-01 Infrared precise multi-point touch platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410709584.XA CN104331193A (en) 2014-12-01 2014-12-01 Infrared precise multi-point touch platform

Publications (1)

Publication Number Publication Date
CN104331193A true CN104331193A (en) 2015-02-04

Family

ID=52405932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410709584.XA CN104331193A (en) 2014-12-01 2014-12-01 Infrared precise multi-point touch platform

Country Status (1)

Country Link
CN (1) CN104331193A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104951687A (en) * 2015-07-21 2015-09-30 上海斐讯数据通信技术有限公司 Method and system of unlocking through fingerprint
CN105138169A (en) * 2015-08-26 2015-12-09 苏州市新瑞奇节电科技有限公司 Touch panel control device based on gesture recognition
CN105260021A (en) * 2015-10-15 2016-01-20 深圳市祈锦通信技术有限公司 Intelligent interactive projection system
CN105700748A (en) * 2016-01-13 2016-06-22 北京京东尚科信息技术有限公司 Touch control processing method and device
CN106375003A (en) * 2016-11-04 2017-02-01 上海迪璞电子科技股份有限公司 High-speed long-distance directional data infrared transmission device
CN106503722A (en) * 2016-12-21 2017-03-15 湖南文理学院 Operator's skeleton growth rings method based on touch trajectory image procossing
CN107728856A (en) * 2016-08-11 2018-02-23 中强光电股份有限公司 Optical projection system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201359720Y (en) * 2009-03-06 2009-12-09 成都趋势电子有限责任公司 Multi-point touch console
CN103064564A (en) * 2013-01-05 2013-04-24 万波 Multi-touch based geographic information system
CN103176667A (en) * 2013-02-27 2013-06-26 广东工业大学 Projection screen touch terminal device based on Android system
CN103914152A (en) * 2014-04-11 2014-07-09 周光磊 Recognition method and system for multi-point touch and gesture movement capturing in three-dimensional space

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201359720Y (en) * 2009-03-06 2009-12-09 成都趋势电子有限责任公司 Multi-point touch console
CN103064564A (en) * 2013-01-05 2013-04-24 万波 Multi-touch based geographic information system
CN103176667A (en) * 2013-02-27 2013-06-26 广东工业大学 Projection screen touch terminal device based on Android system
CN103914152A (en) * 2014-04-11 2014-07-09 周光磊 Recognition method and system for multi-point touch and gesture movement capturing in three-dimensional space

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
赵冬雪: "基于红外多点触摸的地理信息系统", 《中国优秀硕士论文全文库 基础科学辑》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104951687A (en) * 2015-07-21 2015-09-30 上海斐讯数据通信技术有限公司 Method and system of unlocking through fingerprint
CN105138169A (en) * 2015-08-26 2015-12-09 苏州市新瑞奇节电科技有限公司 Touch panel control device based on gesture recognition
CN105260021A (en) * 2015-10-15 2016-01-20 深圳市祈锦通信技术有限公司 Intelligent interactive projection system
CN105700748A (en) * 2016-01-13 2016-06-22 北京京东尚科信息技术有限公司 Touch control processing method and device
CN105700748B (en) * 2016-01-13 2019-06-04 北京京东尚科信息技术有限公司 A kind of method and apparatus of touch-control processing
CN107728856A (en) * 2016-08-11 2018-02-23 中强光电股份有限公司 Optical projection system
CN106375003A (en) * 2016-11-04 2017-02-01 上海迪璞电子科技股份有限公司 High-speed long-distance directional data infrared transmission device
CN106503722A (en) * 2016-12-21 2017-03-15 湖南文理学院 Operator's skeleton growth rings method based on touch trajectory image procossing
CN106503722B (en) * 2016-12-21 2019-09-24 湖南文理学院 Operator's skeleton growth rings method based on touch trajectory image procossing

Similar Documents

Publication Publication Date Title
US7643006B2 (en) Gesture recognition method and touch system incorporating the same
EP2511812B1 (en) Continuous recognition method of multi-touch gestures from at least two multi-touch input devices
US20110304541A1 (en) Method and system for detecting gestures
Licsár et al. User-adaptive hand gesture recognition system with interactive training
KR20100138602A (en) Apparatus and method for a real-time extraction of target's multiple hands information
US9628722B2 (en) Systems and methods for embedding a foreground video into a background feed based on a control input
JP5991041B2 (en) Virtual touch screen system and bidirectional mode automatic switching method
US8339359B2 (en) Method and system for operating electric apparatus
US8837780B2 (en) Gesture based human interfaces
US8970696B2 (en) Hand and indicating-point positioning method and hand gesture determining method used in human-computer interaction system
CN103098012B (en) For detecting the method that in multi-touch device, any amount touches
Kollorz et al. Gesture recognition with a time-of-flight camera
US9141196B2 (en) Robust and efficient learning object tracker
KR20100120456A (en) Method and apparatus for recognizing touch operation
CN102096530B (en) Multi-touch trajectory tracking method
JP2013531305A (en) Touch event determination method and touch sensitive device
WO2010135617A1 (en) Gesture recognition systems and related methods
JP5540002B2 (en) Method, system and related modules, and software components for providing an image sensor human machine interface
Hu et al. Extraction of parametric human model for posture recognition using genetic algorithm
US8286102B1 (en) System and method for image processing using multi-touch gestures
US20110199297A1 (en) Method and apparatus for drawing and erasing calligraphic ink objects on a display surface
US8963836B2 (en) Method and system for gesture-based human-machine interaction and computer-readable medium thereof
Zhou et al. A novel finger and hand pose estimation technique for real-time hand gesture recognition
US20130229375A1 (en) Contact Grouping and Gesture Recognition for Surface Computing
CN102854983A (en) Man-machine interaction method based on gesture recognition

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150204

WD01 Invention patent application deemed withdrawn after publication