CN102156589A - Pulse modulation laser-based computer vision multipoint touch identifying method - Google Patents

Pulse modulation laser-based computer vision multipoint touch identifying method Download PDF

Info

Publication number
CN102156589A
CN102156589A CN2011100805187A CN201110080518A CN102156589A CN 102156589 A CN102156589 A CN 102156589A CN 2011100805187 A CN2011100805187 A CN 2011100805187A CN 201110080518 A CN201110080518 A CN 201110080518A CN 102156589 A CN102156589 A CN 102156589A
Authority
CN
China
Prior art keywords
laser
touch
computer
infrared
camera
Prior art date
Application number
CN2011100805187A
Other languages
Chinese (zh)
Inventor
吴伟
欧阳未
邬冠华
Original Assignee
南昌航空大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 南昌航空大学 filed Critical 南昌航空大学
Priority to CN2011100805187A priority Critical patent/CN102156589A/en
Publication of CN102156589A publication Critical patent/CN102156589A/en

Links

Abstract

The invention provides a pulse modulation laser-based computer vision multipoint touch identifying method. In the method, a pulse signal of which duty cycle is controlled by a touch key is used to control on and off of laser, so that whether the touch key is pressed or not is directly reflected by on and off of the laser; when the laser radiates a screen; and an image comprising touch points is processed and identified through a camera and a computer, and click operation of the touch key is analyzed according to the on and off state of specific touch points in the current image frame and previous frames, so that corresponding computer operation is generated. The method has the advantages that: the click and positioning of a laser touch pen is separated, movement of a touch point can be controlled after the power supply of the laser touch pen is turned on, no matter the touch key is pressed or not, and press and release of the touch key can be accurately detected, so that the advantage that the laser touch pen can perform non-contact long-distance operation is well used to complete multi-touch operation in a projection system.

Description

一种基于脉冲调制激光的计算机视觉多点触控识别方法 Pulsed laser light modulated based on multi-touch computer vision recognition

技术领域 FIELD

[0001] 本发明涉及一种触控识别方法,尤其涉及一种基于脉冲调制激光的计算机视觉多点触控识别方法。 [0001] The present invention relates to a touch recognition method, particularly to a pulse modulated laser based on multi-touch recognition in computer vision method.

背景技术 Background technique

[0002] 多点触控技术是一种新型的计算机的人机交互技术,使用该技术的触摸屏(屏幕, 桌面,墙壁等)或触控板,都能够同时接受来自屏幕上多个点进行计算机的人机交互操作。 [0002] The multi-touch technology is a new type of interactive computer technology, the use of touch screen technology (screen, table, wall, etc.) or a touch panel, capable of simultaneously receiving a plurality of points on a screen from a computer human-computer interaction. 多点触控是在同一显示界面上的多点或多用户的交互操作模式,摒弃了键盘、鼠标的单点操作方式。 It is a multi-touch or a multi-user interactive interface on the same mode of operation, abandoned keyboard, a mouse single-point operation. 根据触控输入介面的位置侦测原理不同,触控面板可分为电阻式、电容式、声波式、光学式及电磁感应式等。 Depending on the principle of position detection of the touch input interface, the touch panel may be divided into resistive, capacitive, acoustic, optical and electromagnetic induction type. 根据不同的光学感应原理,目前常见的多点触摸实现方式包括FTIR、DI、LLP等技术。 Depending on the principle of optical sensors, the current common implementations include multi-touch FTIR, DI, LLP techniques. 这几种技术都是通过计算机视觉的方法来识别触控点,但是由于这些技术都需要制作特殊触控面板,使得制作大尺寸便携的触控系统比较困难,而使用自发光的触控笔(如安装红色或红外LED)来显示触控点的移动轨迹可以简化触控面板结构,可以直接应用于普通的以墙壁或投影幕布为显示面的投影系统中。 These types of technologies are identified by the methods of computer vision touch point, but since these techniques require special touch panel production, so that production of large size of the portable touch system difficult, the use of self-luminous stylus ( mounting a red or infrared LED) to show the movement locus of the touch point of the touch panel can be simplified structure, it can be directly applied to an ordinary wall or projection screen as the projection system for displaying surfaces. 在这样一种系统中,操作者先将触控笔移至投影屏幕的操作点(如按钮)上,然后按下触控笔上光源的开关,通过连接至计算机的摄像头拍摄到含有该触控点的图像,经过图像处理、识别出该触控点的位置, 同时如果该触控点首次出现则对计算机操作系统触发“触控点按下事件”,计算机软件对该“事件”及其坐标进行同步处理与显示,同理,如果操作者移动触控笔或松开触控笔开关也将触发相应的“事件”。 In such a system, the operator moves the operating point of the stylus first projection screen (such as a button), and then press the switch on the stylus light, captured by a camera connected to the computer containing the touch image points, through image processing, identify the location of the touch point, and if the touch point for the first time the computer operating system triggers the "touch points press event", the computer software "events" and coordinate sync display with the same token, if the operator moves the stylus or stylus release switch will trigger a corresponding "event." 在大尺寸的投影系统(如多媒体教室)中,受制于手臂的长度无法直接通过触控笔操作屏幕的某些部位,需要使用激光作光源的触控笔(如红外激光笔)来代替LED触控笔来进行触控操作。 In the large-sized projection system (e.g., multimedia classrooms), the length of the arm can not be directly subject to certain parts of the operation screen stylus, it requires the use of a laser as a light source of the stylus (such as infrared laser pointer) instead of the LED to contact control pen to touch operation. 但激光是一种非接触式操作,操作者无法在按下激光触控笔开关之前确定激光打开后触控点位置,因而无法完成准确的触控点定位、点击操作。 However, the laser is a non-contact operation, the operator can not determine the touch point of the laser open position before pressing the stylus switch laser, and therefore can not complete an accurate positioning of the touch point, a click operation.

发明内容 SUMMARY

[0003] 本发明的目的在于提供了一种基于脉冲调制激光的计算机视觉多点触控识别方法,该方法解决激光触控笔在非接触式操作中的点击前定位问题,从而使得操作者在使用激光进行多点触控操作时可以准确定位。 [0003] The object of the present invention is to provide a computer vision multi-touch recognition method based on modulation of the laser pulse, the laser solutions prior to positioning of the stylus to tap on the non-contact operation, so that the operator when a laser positioning accuracy can be multi-touch operation.

[0004] 本发明是这样来实现的,实现该方法的装置包括计算机、投影仪、摄像头、红外发射模块、激光触控笔、投影幕布,计算机分别连接投影仪、摄像头和红外发射模块,红外发射模块信号连接激光触控笔,投影仪和摄像头分别对准投影幕布;所述激光触控笔包括壳体、红外接收模块、半导体激光器、开关,壳体内设有红外接收模块,红外接收模块连接半导体激光器,半导体激光器连接开关;其特征是方法为:使用占空比受触控按钮控制的脉冲信号控制激光的亮灭,这样,触控按钮是否按下将直接反映至激光的亮灭上,将这样一束激光照射到屏幕上,通过摄像头和计算机对包含触控点的图像进行处理与识别,同时根据当前图像帧中和前几帧中特定触控点的亮灭状态来解析出触控按钮的点击操作,从而生成相应的计算机操作。 [0004] The present invention is achieved, the device implementing the method includes a computer, a projector, a camera, infrared transmission module, laser stylus, projection screen, a computer connected to a projector, camera and infrared emission module, respectively, an infrared transmitter laser stylus module signal connection, the projector and camera are aligned projection screen; said laser comprises a stylus housing, the infrared receiving module, a semiconductor laser, a switch, equipped with an infrared receiver module housing, the infrared receiving module is connected semiconductor laser, a semiconductor laser, the connection switch; method wherein: a duty-controlled by the pulse signal of the touch buttons for controlling the laser light off, so that the touch button is pressed will be directly reflected onto the laser light off the such a laser beam is irradiated onto the screen, the image processing and recognition of the touch point by comprising a camera and a computer, and a touch button in the current image frame and a previous frame blinking state of a particular touch point according to parse click operation, thereby generating a corresponding computer operation. [0005] 本发明的优点是,将激光触控笔的点击与定位分离,激光触控笔电源打开后就可以控制触控点的移动,而不管触控键是否按下,同时,触控键的按下与抬起也可以准确的检测到。 [0005] The advantage of the invention is to separate the laser and positioning clicks the stylus, the stylus after the laser power is turned to control movement of the touch point, regardless of whether the touch key is pressed, while the touch key press and lift can be accurately detected. 这样就可以充分利用激光触控笔可以非接触长距离操作的优点,完成投影系统中多点触控操作。 This can take advantage of non-contact laser stylus advantages of long range operation, the projection system completed multi-touch operation.

附图说明 BRIEF DESCRIPTION

[0006] 图1为本发明的结构示意图。 [0006] FIG. 1 is a schematic structural diagram of the present invention.

[0007] 图2为本发明激光触控笔的结构示意图。 [0007] FIG. 2 is a structural diagram for a laser stylus.

[0008] 在图中,1、激光触控笔2、红外发射模块3、摄像头4、投影幕布5、计算机6、投影仪7、壳体8、红外接收模块9、半导体激光器10、开关。 [0008] In the drawings, 1, 2 touch stylus laser, infrared emission module 3, a camera 4, the projection screen 5, a computer 6, a projector 7, housing 8, the infrared receiving module 9, the semiconductor laser 10, a switch.

具体实施方式 Detailed ways

[0009] 如图1、图2所示,本发明是这样实现的,首先由计算机5控制红外发射模块2发射一定载波频率(如38kHz)的红外信号,当激光触控笔1对着屏幕时,激光触控笔1上的红外接收模块8将接收到红外信号并解调出计算机5的控制信号,当开关10未按下时,该信号将直接作用于半导体激光器9,从而发出闪烁的激光,而当开光10按下时,激光处于常亮状态。 [0009] As shown in FIG 1, FIG. 2, the present invention is achieved, first infrared emission module 2 emits a certain carrier frequency (e.g., 38kHz) infrared signal controlled by the computer 5, when a laser stylus 1 facing the screen laser stylus on the infrared receiving module 18 receives the infrared signal and a control signal demodulated computer 5, when the switch 10 is not pressed, the signal is directly applied to the semiconductor laser 9, a laser to emit blinking and when the opening 10 is pressed, the laser is in the steady state. 当激光打到投影幕布4上时,摄像头3拍摄到投影幕布4上包含激光触控点的图像,通过计算机5上的图像识别程序可以检测到光斑并获取其坐标位置,同时,计算机5可以根据控制信号处于低电平状态时光斑是否出现来判断激光器是否受控于计算机,从而获得按钮开关是否按下的信息,如果计算机5的控制信号是要让半导体激光器9熄灭,但图像上又显示该位置的光斑是亮的(即激光器不受计算机的控制),则可以断定开关10已经被按下,如果图像上检测出的光斑亮灭情况与计算机的控制信号一致(即激光器受控于计算机),则可以断定开关10没有被按下。 When the laser hit the projection screen 4, the image captured by the camera 3 includes a laser touch point on the projection screen 4, the light spot may be detected and the coordinate position which is acquired by the image recognition program on the computer 5, at the same time, the computer 5 can when the control signal is in a low state appears to determine whether the spot laser is computer controlled, thereby obtaining information of the push button switch is depressed, if the control signal from the computer 5 are turned off to make the semiconductor laser 9, but displays the image and bright spot positions (i.e. from the laser control computer), it can be concluded switch 10 has been pressed, if the detected bright spot on the image control signal is consistent with the case where the computer is off (i.e., a computer controlled laser) , it can be concluded switch 10 is not pressed. 得到开关10的状态后就可以让应用程序模拟鼠标的按下与抬起操作等,从而实现更为丰富的多点操作应用。 Obtained after the state of switch 10 allows the application of the simulated mouse and the pressing-up operation, so as to achieve a more extensive application of multi-point operation. 所述激光触控笔1上安装有半导体激光器9、红外接收模块8和开关10,当按开关10未按下时,半导体激光器9的亮灭受控于红外接收模块8收到的红外信号,当开关10按下时,半导体激光器8将直接点亮,操作时,使用占空比受触控按钮控制的脉冲信号控制激光的亮灭,这样,触控按钮是否按下将直接反映至激光的亮灭上,将这样一束激光照射到屏幕上,通过摄像头和计算机对包含触控点的图像进行处理与识别,同时根据当前图像帧中和前几帧中特定触控点的亮灭状态来解析出触控按钮的点击操作,从而生成相应的计算机操作。 The stylus is mounted on a laser with a semiconductor laser 9, the infrared receiving module 8 and the switch 10, when the press switch 10 is not pressed, the blinking of the semiconductor laser 9 is controlled by an infrared signal received by the infrared receiver module 8, when the switch 10 is pressed, the semiconductor laser 8 directly lit during operation, the duty cycle of the pulse signal by blinking the touch control button for controlling the laser, so that the touch button is pressed will be directly reflected to the laser beam the light off, so that the laser beam is irradiated onto the screen, the image processing and recognition of the touch point by comprising a camera and a computer, while according to the current image frame and a previous frame in a specific state of touch point blinking parsing the touch button click operation, thereby generating a corresponding computer operations.

Claims (1)

1. 一种基于脉冲调制激光的计算机视觉多点触控识别方法,实现该方法的装置包括计算机、投影仪、摄像头、红外发射模块、激光触控笔、投影幕布,计算机分别连接投影仪、摄像头和红外发射模块,红外发射模块信号连接激光触控笔,投影仪和摄像头分别对准投影幕布;所述激光触控笔包括壳体、红外接收模块、半导体激光器、开关,壳体内设有红外接收模块,红外接收模块连接半导体激光器,半导体激光器连接开关;其特征是方法为:使用占空比受触控按钮控制的脉冲信号控制激光的亮灭,这样,触控按钮是否按下将直接反映至激光的亮灭上,将这样一束激光照射到屏幕上,通过摄像头和计算机对包含触控点的图像进行处理与识别,同时根据当前图像帧中和前几帧中特定触控点的亮灭状态来解析出触控按钮的点击操作,从而生成相应的计算机 A computer vision pulse modulated laser beam based on the multi-touch recognition method, apparatus implementing the method comprises a computer, a projector, a camera, infrared transmission module, laser stylus, projection screen, a projector are connected to the computer, the camera and infrared emission module, an infrared signal transmitting module connected stylus laser projector and camera are aligned projection screen; said laser comprises a stylus housing, the infrared receiving module, a semiconductor laser, a switch, equipped with an infrared receiver housing module, an infrared receiving module connected to a semiconductor laser, a semiconductor laser, the connection switch; the method is characterized in that: the pulse signal by using the duty ratio of the touch control button for controlling the laser light off, so that the touch button is pressed will be directly reflected to the laser light off, so that the laser beam is irradiated onto the screen, and recognition processing on the image including the touch point through the camera and the computer, while the current image frame and a previous frame a particular touch point blinking parsing state touch button click operation, thereby generating a corresponding computer 作。 Make.
CN2011100805187A 2011-03-31 2011-03-31 Pulse modulation laser-based computer vision multipoint touch identifying method CN102156589A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011100805187A CN102156589A (en) 2011-03-31 2011-03-31 Pulse modulation laser-based computer vision multipoint touch identifying method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011100805187A CN102156589A (en) 2011-03-31 2011-03-31 Pulse modulation laser-based computer vision multipoint touch identifying method

Publications (1)

Publication Number Publication Date
CN102156589A true CN102156589A (en) 2011-08-17

Family

ID=44438105

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011100805187A CN102156589A (en) 2011-03-31 2011-03-31 Pulse modulation laser-based computer vision multipoint touch identifying method

Country Status (1)

Country Link
CN (1) CN102156589A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004086215A8 (en) * 2003-03-28 2005-02-24 Samsung Electronics Co Ltd Light pen
CN1746831A (en) * 2004-09-08 2006-03-15 上海迪比特实业有限公司 Interactive projection system
CN1952851A (en) * 2006-10-13 2007-04-25 广东威创日新电子有限公司 Electronic installation and method for realizing interactive display

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004086215A8 (en) * 2003-03-28 2005-02-24 Samsung Electronics Co Ltd Light pen
CN1746831A (en) * 2004-09-08 2006-03-15 上海迪比特实业有限公司 Interactive projection system
CN1952851A (en) * 2006-10-13 2007-04-25 广东威创日新电子有限公司 Electronic installation and method for realizing interactive display

Similar Documents

Publication Publication Date Title
JP5154446B2 (en) Interactive input system
US8902195B2 (en) Interactive input system with improved signal-to-noise ratio (SNR) and image capture method
US20020130850A1 (en) Coordinate input apparatus, control method therefor, and computer-readable memory
KR100464465B1 (en) Position determination of a laser pointer in a projection display system
CA2862446C (en) Interactive input system and method
US8614669B2 (en) Touchless tablet method and system thereof
US20030222849A1 (en) Laser-based user input device for electronic projection displays
JP4006290B2 (en) Coordinate input apparatus, a control method for a coordinate input device, the program
US20130055143A1 (en) Method for manipulating a graphical user interface and interactive input system employing the same
CN1220131C (en) Coordinate input device and its controlling method
US20110242054A1 (en) Projection system with touch-sensitive projection image
WO2011161312A1 (en) Apparatus and method for transferring information items between communications devices
US20130194173A1 (en) Touch free control of electronic systems and associated methods
WO2011075113A1 (en) Stylus for a touchscreen display
CN102216890A (en) Touch input with image sensor and signal processor
US20010022575A1 (en) Input device for a computer
CN102934057A (en) Interactive input system and method
US20020041325A1 (en) Interaction configuration
US20110109554A1 (en) Interactive display device and method, using a detection camera and optical pointer
CN101419513B (en) An infrared laser pointer virtual virtual point touch system
US9218124B2 (en) Information processing apparatus, information processing method, and program
WO2011085486A1 (en) Whiteboard with tool tray incorporating a processor
CN103914152A (en) Recognition method and system for multi-point touch and gesture movement capturing in three-dimensional space
EP2049979B1 (en) Multi-user pointing apparatus and method
CN101315586A (en) Electronic pen for interactive electronic white board and its interaction control method

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
WD01