CN112363644A - Infrared imaging device and gesture recognition method thereof - Google Patents

Infrared imaging device and gesture recognition method thereof Download PDF

Info

Publication number
CN112363644A
CN112363644A CN202011246797.5A CN202011246797A CN112363644A CN 112363644 A CN112363644 A CN 112363644A CN 202011246797 A CN202011246797 A CN 202011246797A CN 112363644 A CN112363644 A CN 112363644A
Authority
CN
China
Prior art keywords
touch area
infrared
imaging device
recognition method
gesture recognition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011246797.5A
Other languages
Chinese (zh)
Inventor
戴中荣
汤永长
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Xinjingteng Photoelectric Technology Co ltd
Original Assignee
Suzhou Xinjingteng Photoelectric Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Xinjingteng Photoelectric Technology Co ltd filed Critical Suzhou Xinjingteng Photoelectric Technology Co ltd
Priority to CN202011246797.5A priority Critical patent/CN112363644A/en
Publication of CN112363644A publication Critical patent/CN112363644A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses an infrared imaging device and a gesture recognition method thereof, comprising at least two infrared cameras, wherein the infrared cameras are respectively arranged at the corners of a product touch area, the product touch area is provided with a reflection strip along the side wall, an LED light source of the infrared camera faces the product touch area and emits onto the reflection strip opposite to the product touch area, the LED light source is reflected back to the infrared camera through the reflection strip, the product touch area is provided with a human-computer interface, the infrared camera transmits an observed signal to a control mainboard when a user touches the human-computer interface, the control mainboard is electrically connected with a PC end and can transmit information to the PC end, the PC end is provided with an application program interface, the application program interface is provided with a software user-defined command, and the software user-defined command can carry out image recognition operation on a touch area according to the setting, multiple man-machine interaction functions can be added according to user use habits and requirements, and interaction efficiency and user body feeling are improved.

Description

Infrared imaging device and gesture recognition method thereof
Technical Field
The invention relates to the technical field of communication, in particular to an infrared imaging device and a gesture recognition method thereof.
Background
The infrared image touch control mode has the advantages of simple structure, high response speed, high precision, no interference of touch control strength, current and voltage and the like, and is widely applied to the field of large-size infrared image devices such as interactive electronic whiteboards, projection televisions, advertisement all-in-one machines and the like.
When the traditional infrared imaging device operates, according to the length of a basic line between a reflection angle of each infrared camera receiving a touch point and an outer camera, coordinates of a touch position are obtained by utilizing a triangulation positioning principle, and then information is transmitted to a PC through a control mainboard. In a traditional mode, only the coordinate position of a touch point is usually calculated, and the size of the touch point is not calculated, so that only the functions of clicking and dragging are supported, and the user is very troublesome in operations such as interface erasing or document editing, and the interaction efficiency and the user feeling are influenced.
Disclosure of Invention
In order to overcome the defects, the invention aims to provide an infrared imaging device and a gesture recognition method thereof, which can be additionally provided with various man-machine interaction functions according to the use habits and requirements of users and improve the interaction efficiency and the user feeling.
In order to achieve the above purposes, the invention adopts the technical scheme that: an infrared imaging device and a gesture recognition method thereof comprise at least two infrared cameras which are respectively arranged at the corners of a product touch area, the product touch area is provided with a reflecting strip along the side wall, the LED light source of the infrared camera faces the product touch area and faces the reflecting strip opposite to the product touch area, the LED light source is reflected back to the infrared camera through the reflecting strip, the touch area of the product is provided with a human-computer interface, the infrared camera transmits an observed signal to the control main board when a user touches the human-computer interface, the control mainboard is electrically connected with the PC end and can transmit information to the PC end, the PC end is provided with an application program interface, the application program interface is provided with a software user self-defining command, and the software user self-defining command can carry out image identification operation on the touch area according to setting.
The invention provides an infrared imaging device and a gesture recognition method thereof, which have the beneficial effects that: the infrared camera is used for setting a position and a software user-defined command, the size of the reflection area of the received light in the product touch area with different gestures can be calculated, the finger, the palm or the fist can be judged through data analysis of the PC end, a shortcut menu of an application program interface can be set according to the use habits and requirements of a user, and operations such as blackboard writing erasing, document editing or video playing are achieved.
Further, the signals comprise touch point signals and touch area signals, the touch point signals are touch point coordinates obtained by utilizing a triangulation positioning principle according to the lengths of the first reflection angle and the second reflection angle of the product touch area to the infrared camera and the base line between the infrared cameras, and the touch area signals are touch area areas obtained by conversion according to the third reflection angle and the fourth reflection angle of the product touch area to the infrared camera, the width of the shielded position of the reflection strip and the relative distance between the shielded position of the reflection strip and the infrared camera.
Further, the software user-defined command includes setting single-point and multi-point gesture touch, and is used for bouncing or hiding the shortcut operation window.
Further, the software user-defined command includes different applications according to the size and the shape difference of the touch area.
Furthermore, the software user-defined command further comprises the number of single-point and multi-point gesture touches, and the number is used for bouncing or hiding the shortcut operation window.
Furthermore, the software user-defined command further comprises a gesture setting touch angle transformation for bouncing or hiding the shortcut operation window.
Furthermore, the software user-defined command further includes setting a single-hand gesture movement and a movement between two hands for performing actions such as page turning or zooming.
Furthermore, the software user-defined command further comprises a time for setting gesture touch parking, and the time is used for enabling the product touch area to exit the human-computer interface and enabling the shortcut operation window to bounce or hide.
Further, the dominant wavelength lambda of the LED light source ranges from 700nm to 1000 nm.
Drawings
FIG. 1 is a schematic structural diagram of a touch point signal;
fig. 2 is a schematic structural diagram when the signal is a touch area signal.
In the figure:
1-an infrared camera; 2-controlling the main board; 3-a product touch area; 4-reflection angle one; 5-reflection angle II; 6-base line; 7-reflection angle III; 8-reflection angle four; 9-touch points; 10-a touch area; 11-PC terminal.
Detailed Description
The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention easier to understand by those skilled in the art, and thus will clearly and clearly define the scope of the invention.
Referring to fig. 1 and 2, an infrared imaging device and a gesture recognition method thereof include at least two infrared cameras 1, wherein the infrared cameras 1 are respectively disposed at corners of a product touch area 3, the product touch area 3 is provided with a reflective strip along a sidewall, an LED light source of the infrared camera 1 faces the product touch area 3 and emits onto the reflective strip opposite to the product touch area, a dominant wavelength λ of the LED light source is preferably 850nm, the LED light source is reflected back to the infrared camera 1 by the reflective strip, when no object is operated in the product touch area 3, a light sensing chip of the infrared camera 1 receives reflected light emitted to each area on the reflective strip, when an object is operated in the product touch area 3, the reflected light of the product touch area 3 is blocked, the infrared camera 1 transmits an observed signal to a control motherboard 2, the signal includes a touch point 9 signal and a touch area 10 signal, the touch point 9 signal is according to the product touch-control district 3 to infrared camera 1 reflection angle 4, the length of base line 6 between reflection angle two 5 and the infrared camera 1, the touch point 9 coordinate that utilizes the triangulation theory to obtain, the regional 10 signal of touch-control is according to the product touch-control district 3 to infrared camera 1 reflection angle three 7, reflection angle four 8 and the width that the reflection strip was sheltered from the position and to infrared camera 1 relative distance, through the regional 10 areas of touch-control that the conversion obtained, thereby control mainboard 2 is connected with PC end 11 electricity and can carry out image recognition operation for PC end 11 with information transmission.
The product touch area 3 has a man-machine interface for directly performing click and drag operations, the PC terminal 11 has an application program interface provided with software user-defined commands, the software user-defined commands include different applications according to the area size and shape difference of the touch area 10, the software user-defined commands include setting single-point and multi-point gesture touch, the method is used for bouncing or hiding the shortcut operation window, and also comprises the steps of setting the number of single-point and multi-point gesture touch controls, used for bouncing or hiding the shortcut operation window, setting gesture touch angle transformation, used for bouncing or hiding the shortcut operation window, setting single-hand gesture movement and movement between two hands, the system is used for performing actions such as page turning or zooming, and also comprises setting gesture touch parking time which is used for enabling the product touch area 3 to exit a human-computer interface and enabling the shortcut operation window to bounce or hide;
the PC end 11 can judge the gesture (such as finger, palm, fist and the like) used by the operator according to the difference of the areas of the received light reflection during touch control, and the user can add a shortcut menu of an application program interface according to the use habit and the requirement to realize man-machine interaction such as blackboard writing erasing, document editing or video playing.
The above embodiments are merely illustrative of the technical concept and features of the present invention, and the present invention is not limited thereto, and any equivalent changes or modifications made according to the spirit of the present invention should be included in the scope of the present invention.

Claims (9)

1.一种红外影像装置及其手势识别方法，其特征在于：包括至少两个红外摄像头(1)，多个所述红外摄像头(1)分别设置于产品触控区(3)的边角处，所述产品触控区(3)沿侧壁设置有反射条，所述红外摄像头(1)的LED光源朝向产品触控区(3)并射向与其位置相对的反射条上，所述LED光源经反射条反射回红外摄像头(1)，所述产品触控区(3)具有人机界面，所述红外摄像头(1)在使用者与人机界面触碰时将观测到的信号传送至控制主板(2)，所述控制主板(2)与PC端(11)电连接并能将信息传送至PC端(11)，所述PC端(11)具有应用程序界面，所述应用程序界面设置有软体使用者自定义命令，所述软体使用者自定义命令能根据设定对触碰面积进行影像识别操作。1. An infrared imaging device and a gesture recognition method thereof, characterized in that: comprising at least two infrared cameras (1), and a plurality of said infrared cameras (1) are respectively arranged at the corners of the product touch area (3) , the product touch area (3) is provided with a reflective strip along the side wall, the LED light source of the infrared camera (1) faces the product touch area (3) and shoots on the reflective strip opposite to its position, the LED light source The light source is reflected back to the infrared camera (1) by the reflection strip, the product touch area (3) has a human-machine interface, and the infrared camera (1) transmits the observed signal when the user touches the human-machine interface to the human-machine interface. a control mainboard (2), the control mainboard (2) is electrically connected to the PC end (11) and can transmit information to the PC end (11), the PC end (11) has an application program interface, the application program interface A software user-defined command is provided, and the software user-defined command can perform image recognition operation on the touch area according to the setting. 2.根据权利要求1所述的一种红外影像装置及其手势识别方法，其特征在于：所述信号包括触控点信号和触控区域信号，所述触控点信号为根据产品触控区(3)到红外摄像头(1)的反射角度一(4)、反射角度二(5)和红外摄像头之间基础线(6)的长度，利用三角定位原理得到的触控点(9)坐标，所述触控区域信号为根据产品触控区(3)到红外摄像头(1)的反射角度三(7)、反射角度四(8)和反射条被遮挡位置的宽度以及至红外摄像头(1)的相对距离，通过换算得到的触控区域(10)面积。2 . An infrared imaging device and a gesture recognition method thereof according to claim 1 , wherein the signal comprises a touch point signal and a touch area signal, and the touch point signal is a touch area according to a product. 3 . (3) The length of the base line (6) between the reflection angle one (4), the reflection angle two (5) and the infrared camera to the infrared camera (1), the coordinates of the touch point (9) obtained by using the principle of triangulation, The touch area signal is based on the reflection angle three (7) and the reflection angle four (8) of the product touch area (3) to the infrared camera (1), the width of the position where the reflection strip is blocked, and the distance to the infrared camera (1) The relative distance of , and the area of the touch area (10) obtained by conversion. 3.根据权利要求1所述的一种红外影像装置及其手势识别方法，其特征在于：所述软体使用者自定义命令包括设定单点和多点手势触控，用于将快捷操作窗口弹起或隐藏。3 . An infrared imaging device and a gesture recognition method thereof according to claim 1 , wherein the software user-defined commands include setting single-point and multi-point gesture touches, which are used to display the shortcut operation window. 4 . pop up or hide. 4.根据权利要求3所述的一种红外影像装置及其手势识别方法，其特征在于：所述软体使用者自定义命令包括根据触控区域(10)面积大小和形态差异作不同应用。4 . The infrared imaging device and the gesture recognition method thereof according to claim 3 , wherein the software user-defined commands include different applications according to the area and shape differences of the touch area ( 10 ). 5 . 5.根据权利要求4所述的一种红外影像装置及其手势识别方法，其特征在于：所述软体使用者自定义命令还包括设定单点和多点手势触控的数量，用于将快捷操作窗口弹起或隐藏。5 . An infrared imaging device and a gesture recognition method thereof according to claim 4 , wherein the software user-defined command further comprises setting the number of single-point and multi-point gesture touches for The shortcut operation window pops up or hides. 6.根据权利要求4所述的一种红外影像装置及其手势识别方法，其特征在于：所述软体使用者自定义命令还包括设定手势触控角度变换，用于将快捷操作窗口弹起或隐藏。6 . An infrared imaging device and a gesture recognition method thereof according to claim 4 , wherein the software user-defined command further comprises setting a gesture touch angle change, for popping up the shortcut operation window. 7 . or hidden. 7.根据权利要求6所述的一种红外影像装置及其手势识别方法，其特征在于：所述软体使用者自定义命令还包括设定单手手势移动和双手之间的移动，用于进行翻页或缩等动作。7 . An infrared imaging device and a gesture recognition method thereof according to claim 6 , wherein the software user-defined command further comprises setting one-hand gesture movement and movement between two hands, for performing Page turning or zooming out. 8.根据权利要求1所述的一种红外影像装置及其手势识别方法，其特征在于：所述软体使用者自定义命令还包括设定手势触控停放的时间，用于使产品触控区(3)退出人机界面以及使快捷操作窗口弹起或隐藏。8 . An infrared imaging device and a gesture recognition method thereof according to claim 1 , wherein the software user-defined command further comprises setting a time for gesture touch and parking, so as to enable the product touch area to be touched. 9 . (3) Exit the man-machine interface and pop up or hide the shortcut operation window. 9.根据权利要求1所述的一种红外影像装置及其手势识别方法，其特征在于：所述LED光源的主波长λ范围为700nm-1000nm。9 . The infrared imaging device and the gesture recognition method thereof according to claim 1 , wherein the main wavelength λ of the LED light source ranges from 700 nm to 1000 nm. 10 .
CN202011246797.5A 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof Pending CN112363644A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011246797.5A CN112363644A (en) 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011246797.5A CN112363644A (en) 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof

Publications (1)

Publication Number Publication Date
CN112363644A true CN112363644A (en) 2021-02-12

Family

ID=74508615

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011246797.5A Pending CN112363644A (en) 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof

Country Status (1)

Country Link
CN (1) CN112363644A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080259053A1 (en) * 2007-04-11 2008-10-23 John Newton Touch Screen System with Hover and Click Input Methods
CN101930306A (en) * 2010-02-10 2010-12-29 陈伟山 Multi-touch device and detection method thereof
CN102033658A (en) * 2009-09-30 2011-04-27 北京汇冠新技术股份有限公司 Touch screen, touch system and positioning method thereof
CN102750042A (en) * 2011-04-20 2012-10-24 宏碁股份有限公司 Optical touch device and object identification method thereof
CN202976036U (en) * 2012-12-12 2013-06-05 锐达互动科技股份有限公司 Multi-point interaction video device integrating touching and photoelectric pen writing
CN104252270A (en) * 2010-06-25 2014-12-31 林卓毅 Electronic device
CN205581834U (en) * 2016-04-15 2016-09-14 北京道合互联科技有限公司 Multiple spot touch devices and display device
KR20160121963A (en) * 2015-04-13 2016-10-21 주식회사 아이카이스트 Infrared touch screen system that can be gesture recognition
CN106445248A (en) * 2016-12-08 2017-02-22 北京道合互联科技有限公司 Infrared touch control camera and non-fixed size area touch control system and method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080259053A1 (en) * 2007-04-11 2008-10-23 John Newton Touch Screen System with Hover and Click Input Methods
CN102033658A (en) * 2009-09-30 2011-04-27 北京汇冠新技术股份有限公司 Touch screen, touch system and positioning method thereof
CN101930306A (en) * 2010-02-10 2010-12-29 陈伟山 Multi-touch device and detection method thereof
CN104252270A (en) * 2010-06-25 2014-12-31 林卓毅 Electronic device
CN102750042A (en) * 2011-04-20 2012-10-24 宏碁股份有限公司 Optical touch device and object identification method thereof
CN202976036U (en) * 2012-12-12 2013-06-05 锐达互动科技股份有限公司 Multi-point interaction video device integrating touching and photoelectric pen writing
KR20160121963A (en) * 2015-04-13 2016-10-21 주식회사 아이카이스트 Infrared touch screen system that can be gesture recognition
CN205581834U (en) * 2016-04-15 2016-09-14 北京道合互联科技有限公司 Multiple spot touch devices and display device
CN106445248A (en) * 2016-12-08 2017-02-22 北京道合互联科技有限公司 Infrared touch control camera and non-fixed size area touch control system and method

Similar Documents

Publication Publication Date Title
CN105760019B (en) Touch operation method and system based on interactive electronic whiteboard
CN102362243B (en) Multi-telepointer, virtual object display device, and virtual object control method
US8614664B2 (en) Multi-touch multi-dimensional mouse
TWI423096B (en) Projecting system with touch controllable projecting picture
CN111752419A (en) Interactive control method, device, intelligent blackboard and storage medium of intelligent blackboard
TWI389014B (en) Touchpad detection method
CN102331884A (en) Projection system with touchable projection screen
WO2022257870A1 (en) Virtual scale display method and related device
CN103744542A (en) Hybrid pointing device
CN110851061B (en) Method for controlling terminal by ring type mouse
CN108027648A (en) The gesture input method and wearable device of a kind of wearable device
CN106648152A (en) Rotary angle and distance-based three-dimensional pen interaction interface zooming method
WO2021197487A1 (en) Method and apparatus for controlling terminal screen by means of mouse, mouse and storage medium
CN103365485A (en) Optical Touch Sensing Device
KR200477008Y1 (en) Smart phone with mouse module
WO2020047742A1 (en) Handwriting pad, handwriting pad apparatus and writing control method
CN101315587B (en) cursor control device
CN101866246A (en) Multi-touch optical input device
TW201037579A (en) Optical input device with multi-touch control
CN102467283A (en) Touch device with multi-touch function and touch operation method
WO2023065939A1 (en) Touch response method and apparatus, interactive panel, and storage medium
CN112363644A (en) Infrared imaging device and gesture recognition method thereof
KR102145824B1 (en) Inferface method of smart touch pad and device therefor
WO2023077292A1 (en) Method and apparatus for controlling terminal screen by means of trackpad, control device, and storage medium
TWM241746U (en) Touch-controlled input apparatus of electronic apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination