CN112363644A - Infrared imaging device and gesture recognition method thereof - Google Patents

Infrared imaging device and gesture recognition method thereof Download PDF

Info

Publication number
CN112363644A
CN112363644A CN202011246797.5A CN202011246797A CN112363644A CN 112363644 A CN112363644 A CN 112363644A CN 202011246797 A CN202011246797 A CN 202011246797A CN 112363644 A CN112363644 A CN 112363644A
Authority
CN
China
Prior art keywords
touch
touch area
infrared
imaging device
recognition method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011246797.5A
Other languages
Chinese (zh)
Inventor
戴中荣
汤永长
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Xinjingteng Photoelectric Technology Co ltd
Original Assignee
Suzhou Xinjingteng Photoelectric Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Xinjingteng Photoelectric Technology Co ltd filed Critical Suzhou Xinjingteng Photoelectric Technology Co ltd
Priority to CN202011246797.5A priority Critical patent/CN112363644A/en
Publication of CN112363644A publication Critical patent/CN112363644A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses an infrared imaging device and a gesture recognition method thereof, comprising at least two infrared cameras, wherein the infrared cameras are respectively arranged at the corners of a product touch area, the product touch area is provided with a reflection strip along the side wall, an LED light source of the infrared camera faces the product touch area and emits onto the reflection strip opposite to the product touch area, the LED light source is reflected back to the infrared camera through the reflection strip, the product touch area is provided with a human-computer interface, the infrared camera transmits an observed signal to a control mainboard when a user touches the human-computer interface, the control mainboard is electrically connected with a PC end and can transmit information to the PC end, the PC end is provided with an application program interface, the application program interface is provided with a software user-defined command, and the software user-defined command can carry out image recognition operation on a touch area according to the setting, multiple man-machine interaction functions can be added according to user use habits and requirements, and interaction efficiency and user body feeling are improved.

Description

Infrared imaging device and gesture recognition method thereof
Technical Field
The invention relates to the technical field of communication, in particular to an infrared imaging device and a gesture recognition method thereof.
Background
The infrared image touch control mode has the advantages of simple structure, high response speed, high precision, no interference of touch control strength, current and voltage and the like, and is widely applied to the field of large-size infrared image devices such as interactive electronic whiteboards, projection televisions, advertisement all-in-one machines and the like.
When the traditional infrared imaging device operates, according to the length of a basic line between a reflection angle of each infrared camera receiving a touch point and an outer camera, coordinates of a touch position are obtained by utilizing a triangulation positioning principle, and then information is transmitted to a PC through a control mainboard. In a traditional mode, only the coordinate position of a touch point is usually calculated, and the size of the touch point is not calculated, so that only the functions of clicking and dragging are supported, and the user is very troublesome in operations such as interface erasing or document editing, and the interaction efficiency and the user feeling are influenced.
Disclosure of Invention
In order to overcome the defects, the invention aims to provide an infrared imaging device and a gesture recognition method thereof, which can be additionally provided with various man-machine interaction functions according to the use habits and requirements of users and improve the interaction efficiency and the user feeling.
In order to achieve the above purposes, the invention adopts the technical scheme that: an infrared imaging device and a gesture recognition method thereof comprise at least two infrared cameras which are respectively arranged at the corners of a product touch area, the product touch area is provided with a reflecting strip along the side wall, the LED light source of the infrared camera faces the product touch area and faces the reflecting strip opposite to the product touch area, the LED light source is reflected back to the infrared camera through the reflecting strip, the touch area of the product is provided with a human-computer interface, the infrared camera transmits an observed signal to the control main board when a user touches the human-computer interface, the control mainboard is electrically connected with the PC end and can transmit information to the PC end, the PC end is provided with an application program interface, the application program interface is provided with a software user self-defining command, and the software user self-defining command can carry out image identification operation on the touch area according to setting.
The invention provides an infrared imaging device and a gesture recognition method thereof, which have the beneficial effects that: the infrared camera is used for setting a position and a software user-defined command, the size of the reflection area of the received light in the product touch area with different gestures can be calculated, the finger, the palm or the fist can be judged through data analysis of the PC end, a shortcut menu of an application program interface can be set according to the use habits and requirements of a user, and operations such as blackboard writing erasing, document editing or video playing are achieved.
Further, the signals comprise touch point signals and touch area signals, the touch point signals are touch point coordinates obtained by utilizing a triangulation positioning principle according to the lengths of the first reflection angle and the second reflection angle of the product touch area to the infrared camera and the base line between the infrared cameras, and the touch area signals are touch area areas obtained by conversion according to the third reflection angle and the fourth reflection angle of the product touch area to the infrared camera, the width of the shielded position of the reflection strip and the relative distance between the shielded position of the reflection strip and the infrared camera.
Further, the software user-defined command includes setting single-point and multi-point gesture touch, and is used for bouncing or hiding the shortcut operation window.
Further, the software user-defined command includes different applications according to the size and the shape difference of the touch area.
Furthermore, the software user-defined command further comprises the number of single-point and multi-point gesture touches, and the number is used for bouncing or hiding the shortcut operation window.
Furthermore, the software user-defined command further comprises a gesture setting touch angle transformation for bouncing or hiding the shortcut operation window.
Furthermore, the software user-defined command further includes setting a single-hand gesture movement and a movement between two hands for performing actions such as page turning or zooming.
Furthermore, the software user-defined command further comprises a time for setting gesture touch parking, and the time is used for enabling the product touch area to exit the human-computer interface and enabling the shortcut operation window to bounce or hide.
Further, the dominant wavelength lambda of the LED light source ranges from 700nm to 1000 nm.
Drawings
FIG. 1 is a schematic structural diagram of a touch point signal;
fig. 2 is a schematic structural diagram when the signal is a touch area signal.
In the figure:
1-an infrared camera; 2-controlling the main board; 3-a product touch area; 4-reflection angle one; 5-reflection angle II; 6-base line; 7-reflection angle III; 8-reflection angle four; 9-touch points; 10-a touch area; 11-PC terminal.
Detailed Description
The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention easier to understand by those skilled in the art, and thus will clearly and clearly define the scope of the invention.
Referring to fig. 1 and 2, an infrared imaging device and a gesture recognition method thereof include at least two infrared cameras 1, wherein the infrared cameras 1 are respectively disposed at corners of a product touch area 3, the product touch area 3 is provided with a reflective strip along a sidewall, an LED light source of the infrared camera 1 faces the product touch area 3 and emits onto the reflective strip opposite to the product touch area, a dominant wavelength λ of the LED light source is preferably 850nm, the LED light source is reflected back to the infrared camera 1 by the reflective strip, when no object is operated in the product touch area 3, a light sensing chip of the infrared camera 1 receives reflected light emitted to each area on the reflective strip, when an object is operated in the product touch area 3, the reflected light of the product touch area 3 is blocked, the infrared camera 1 transmits an observed signal to a control motherboard 2, the signal includes a touch point 9 signal and a touch area 10 signal, the touch point 9 signal is according to the product touch-control district 3 to infrared camera 1 reflection angle 4, the length of base line 6 between reflection angle two 5 and the infrared camera 1, the touch point 9 coordinate that utilizes the triangulation theory to obtain, the regional 10 signal of touch-control is according to the product touch-control district 3 to infrared camera 1 reflection angle three 7, reflection angle four 8 and the width that the reflection strip was sheltered from the position and to infrared camera 1 relative distance, through the regional 10 areas of touch-control that the conversion obtained, thereby control mainboard 2 is connected with PC end 11 electricity and can carry out image recognition operation for PC end 11 with information transmission.
The product touch area 3 has a man-machine interface for directly performing click and drag operations, the PC terminal 11 has an application program interface provided with software user-defined commands, the software user-defined commands include different applications according to the area size and shape difference of the touch area 10, the software user-defined commands include setting single-point and multi-point gesture touch, the method is used for bouncing or hiding the shortcut operation window, and also comprises the steps of setting the number of single-point and multi-point gesture touch controls, used for bouncing or hiding the shortcut operation window, setting gesture touch angle transformation, used for bouncing or hiding the shortcut operation window, setting single-hand gesture movement and movement between two hands, the system is used for performing actions such as page turning or zooming, and also comprises setting gesture touch parking time which is used for enabling the product touch area 3 to exit a human-computer interface and enabling the shortcut operation window to bounce or hide;
the PC end 11 can judge the gesture (such as finger, palm, fist and the like) used by the operator according to the difference of the areas of the received light reflection during touch control, and the user can add a shortcut menu of an application program interface according to the use habit and the requirement to realize man-machine interaction such as blackboard writing erasing, document editing or video playing.
The above embodiments are merely illustrative of the technical concept and features of the present invention, and the present invention is not limited thereto, and any equivalent changes or modifications made according to the spirit of the present invention should be included in the scope of the present invention.

Claims (9)

1. An infrared imaging device and a gesture recognition method thereof are characterized in that: comprises at least two infrared cameras (1), a plurality of infrared cameras (1) are respectively arranged at the corners of a product touch area (3), the product touch area (3) is provided with a reflecting strip along the side wall, the LED light source of the infrared camera (1) faces the product touch area (3) and emits onto the reflecting strip opposite to the product touch area, the LED light source is reflected back to the infrared camera (1) through the reflecting strip, the product touch area (3) is provided with a human-computer interface, the infrared camera (1) transmits an observed signal to the control main board (2) when a user touches the human-computer interface, the control mainboard (2) is electrically connected with the PC end (11) and can transmit information to the PC end (11), the PC end (11) is provided with an application program interface which is provided with a software user self-defined command, the software user-defined command can perform image recognition operation on the touch area according to the setting.
2. The infrared imaging device and the gesture recognition method thereof according to claim 1, wherein: the signal includes touch-control point signal and touch-control regional signal, the length of base line (6) between touch-control point signal for reflection angle (4) according to product touch-control district (3) to infrared camera (1), reflection angle two (5) and the infrared camera utilizes the touch-control point (9) coordinate that the triangulation locating principle obtained, the touch-control regional signal is according to product touch-control district (3) to infrared camera (1) reflection angle three (7), reflection angle four (8) and reflection strip sheltered from the width of position and to the relative distance of infrared camera (1), touch-control regional (10) area that obtains through the conversion.
3. The infrared imaging device and the gesture recognition method thereof according to claim 1, wherein: the software user-defined command comprises a single-point gesture and a multi-point gesture touch, and is used for bouncing or hiding the shortcut operation window.
4. The infrared imaging device and the gesture recognition method thereof according to claim 3, wherein: the software user-defined commands include different applications depending on the size and shape differences of the touch area (10).
5. The infrared imaging device and the gesture recognition method thereof according to claim 4, wherein: the software user-defined command further comprises the quantity of single-point and multi-point gesture touch controls, and the quantity is used for bouncing or hiding the shortcut operation window.
6. The infrared imaging device and the gesture recognition method thereof according to claim 4, wherein: the software user-defined command further comprises a set gesture touch angle transformation for bouncing or hiding the shortcut operation window.
7. The infrared imaging device and the gesture recognition method thereof according to claim 6, wherein: the software user-defined command also comprises the setting of single-hand gesture movement and movement between two hands, and is used for performing actions such as page turning or shrinking.
8. The infrared imaging device and the gesture recognition method thereof according to claim 1, wherein: the software user-defined command further comprises a time for setting gesture touch parking, and the time is used for enabling the product touch area (3) to exit a human-computer interface and enabling the shortcut operation window to bounce or hide.
9. The infrared imaging device and the gesture recognition method thereof according to claim 1, wherein: the dominant wavelength lambda range of the LED light source is 700nm-1000 nm.
CN202011246797.5A 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof Pending CN112363644A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011246797.5A CN112363644A (en) 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011246797.5A CN112363644A (en) 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof

Publications (1)

Publication Number Publication Date
CN112363644A true CN112363644A (en) 2021-02-12

Family

ID=74508615

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011246797.5A Pending CN112363644A (en) 2020-11-10 2020-11-10 Infrared imaging device and gesture recognition method thereof

Country Status (1)

Country Link
CN (1) CN112363644A (en)

Similar Documents

Publication Publication Date Title
CN105760019B (en) Touch operation method and system based on interactive electronic whiteboard
US8614664B2 (en) Multi-touch multi-dimensional mouse
CA2466951C (en) Focus management using in-air points
US20060028457A1 (en) Stylus-Based Computer Input System
CN103914143A (en) Control method of electronic device
KR20140114913A (en) Apparatus and Method for operating sensors in user device
US6466197B1 (en) Method and apparatus for driving pointing device of computer system
US20100271332A1 (en) Optical input device, electronic device, and optical input system
CN101533322B (en) Multi-point touch plate and multi-point touch positioning method
CN202120234U (en) Multipoint translation gesture recognition device for touch device
WO2018018624A1 (en) Gesture input method for wearable device, and wearable device
CN103686283A (en) Smart television remote controller man-machine interaction method
CN107656633A (en) Intelligent pen, control method, device, equipment and storage medium of intelligent pen
CN102467261A (en) Method of combining at least two touch control signals into a computer system, and computer mouse
WO2022257870A1 (en) Virtual scale display method and related device
KR101519225B1 (en) Method and system for transfering content among devices using mobile device sensor
KR200477008Y1 (en) Smart phone with mouse module
US20040004601A1 (en) Virtual position movement capturing apparatus
CN112639696A (en) Handwriting board, handwriting board device and writing control method
KR102145824B1 (en) Inferface method of smart touch pad and device therefor
CN112363644A (en) Infrared imaging device and gesture recognition method thereof
CN206674011U (en) A kind of rear shell has the smart mobile phone of touchpad operation function
CN113010130B (en) Remote large-screen interaction control method based on image stream
GB2377607A (en) Analysing and displaying motion of hand held instrument
JP4615178B2 (en) Information input / output system, program, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination