CN102520830A - Virtual touch screen system based on image processing technology - Google Patents

Virtual touch screen system based on image processing technology Download PDF

Info

Publication number
CN102520830A
CN102520830A CN2011104439230A CN201110443923A CN102520830A CN 102520830 A CN102520830 A CN 102520830A CN 2011104439230 A CN2011104439230 A CN 2011104439230A CN 201110443923 A CN201110443923 A CN 201110443923A CN 102520830 A CN102520830 A CN 102520830A
Authority
CN
China
Prior art keywords
display screen
camera
image processing
infrared laser
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011104439230A
Other languages
Chinese (zh)
Inventor
谢巍
陈暑生
黄旭东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN2011104439230A priority Critical patent/CN102520830A/en
Publication of CN102520830A publication Critical patent/CN102520830A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Position Input By Displaying (AREA)

Abstract

The invention discloses a virtual touch screen system based on an image processing technology, which comprises a display screen, a camera, a linear infrared laser and a processor, wherein the camera is positioned above and in front of the display screen to make the display screen completely be within a framing range; infrared rays emitted by the linear infrared laser cover a part above the surface of the display screen in parallel; the camera is connected with the processor; and when a finger touches the display screen, the infrared rays emitted by the linear infrared laser are blocked to form a light spot, then an image acquired by the camera has an infrared bright speck, the specific position of the infrared bright speck is determined by an image processing technology, the triggered part of the display screen is further determined, and the processor identifies the operation, and converts the operation into corresponding instructions for execution, thereby finishing human-computer interactive operation.

Description

A kind of virtual touch screen system based on image processing techniques
Technical field
The present invention relates to field of human-computer interaction, particularly a kind of virtual touch screen system based on image processing techniques.The present invention is intended to utilize image processing techniques that any Daepori is held high office to show that utensil has touch screen functionality.
Background technology
At present; Common touch-screen mainly contains types such as infrared-type, resistance-type, surface acoustic wave type, condenser type; Yet the giant-screen of these types is jumbotron touch-screen product especially, all exist cost an arm and a leg, versatility is poor, the problem of poor stability, poor accuracy.
Chinese patent CN201251778 discloses a kind of virtual touch screen system based on image recognition; This utility model is made up of at least two one dimension image collecting devices, display screen and calculation elements; The one dimension image collecting device be arranged on virtual touch screen around, one dimension image that each one dimension image collecting device obtains place face and virtual touch screen are in same plane; A plurality of one dimension image collecting devices will be pointed position and click action on virtual touch screen and convert having or not of point and point in a plurality of one dimension images to; Calculation element is according to the bidimensional rectangular coordinate of information Recognition finger in virtual touch screen of said one dimension image mid point; And carry out corresponding operation, accomplish human-computer interaction function.The one dimension image collecting device that this utility model adopts is more, has the higher shortcoming of cost.
Chinese patent CN1912816 discloses a kind of virtual touch screen system based on camera, is intended to utilize computer vision technique that any Daepori is held high office and shows that utensil has touch screen functionality.This utility model has adopted a plurality of cameras to be used for images acquired, has the higher shortcoming of cost, and because the simple image processing techniques of leaning on, does not add other supplementary means, and stability is not high.
One Chinese patent application numbers 200820217299.6 discloses a kind of remote virtual touch system of infrared laser pen, it is characterized in that being made up of computer system, infrared laser pen, image acquiring device, image recognition locating module; Computer system comprises display device and main frame; The infrared laser pen has infrared laser emission button, can launch infrared laser and point to display screen; Image acquiring device is installed in display device the place ahead, and display screen is included in its viewfinder range fully, is used to obtain the display image of the infrared laser point that comprises that said infrared laser pen sends; The image recognition locating module infrared laser point and the position in display screen thereof according to the image recognition of obtaining; Time length and number of times according to infrared laser are distinguished the different operating that comprises that luminous point indication, luminous point move, click; And the control computer system generates luminous point on the correspondence position of display screen, and accomplishes respective operations.Its shortcoming is, need hand the infrared laser pen during use, and is long-range virtual touch, does not reach and depends merely on finger, need not the serious entity that additional device just can touch and test on screen.
Summary of the invention
The objective of the invention is to defective, a kind of virtual touch screen system based on image processing techniques is provided to the prior art existence.
The present invention adopts following technical scheme:
A kind of virtual touch screen system based on image processing techniques; Comprise display screen 3, camera 1, linear infrared laser 2, processor, camera 1 is installed in the place ahead on the display screen 3, and display screen 3 is in the viewfinder range of camera 1; Infrared ray 4 parallel being covered on display screen 3 surfaces that linear infrared laser 2 is launched; Camera 1 is connected with processor, and the hot spot that processor is caught through camera 1 is confirmed the coordinate of finger, operation command.
The both sides of said display screen 3 respectively are provided with a salient line 5, and said two salient lines 5 overlap with two sides of display screen 3 inward flanges, are used for the automatic location in display screen 3 zones.
The method that the present invention searches through profile utilizes the characteristic of vertical strip profile to find the salient line of display screen area both sides and then the zone of definite display screen; The infrared ray that linear infrared laser among the present invention is launched is parallel to be covered on the display screen; When the finger touches display screen, block infrared ray and produce hot spot; Camera is caught hot spot; Utilize the profile lookup method, accurately calculate the coordinate that finger produces hot spot, and utilize coordinate conversion formula to obtain touch location.
Beneficial effect of the present invention:
(1) the present invention is simple in structure, easy for installation, is easy to expand.
(2) image that arrives through camera collection uses image processing techniques to extract the profile of speck then, calculates its central point, confirms the particular location of speck through image rectification, and then confirms that which position is triggered, and algorithm is simple, realizes easily.
 
Description of drawings
Fig. 1 looks synoptic diagram for the master of system architecture of the present invention,
Fig. 2 is the schematic side view of Fig. 1,
Fig. 3 is a process flow diagram of the present invention,
Fig. 4 is the coordinate conversion figure of finger touch of the present invention.
Shown in the figure:
1-camera, 2-linear infrared laser, 3-display screen, 4-infrared ray, 5-salient line.
Embodiment
Like accompanying drawing 1, a kind of virtual touch screen system shown in 2 based on image processing techniques; Comprise display screen 3, camera 1, linear infrared laser 2, processor; Camera 1 is installed in the place ahead on the display screen 3; And display screen 3 is in the viewfinder range of camera 1, infrared ray 4 parallel being covered on display screen 3 surfaces that linear infrared laser 2 is launched, and camera 1 is connected with processor.Said processor can be a processor of treating that input equipment carries, also can be the outside microprocessor that increases.
The both sides of said display screen 3 respectively are provided with a salient line 5, and said two salient lines 5 overlap with two sides of display screen 3 inward flanges.
Workflow of the present invention shown in accompanying drawing 3: system initialization; Two salient lines 5 through detecting display screen 3 both sides are oriented display screen 3 zones; The infrared ray 4 of said linear infrared laser 2 emissions is radiated on the salient line 5 of display screen 3 and forms two white bright lines; Camera 1 collects the image that contains display screen 3 in real time and transfers back to processor; The method that the processor adopting profile is searched obtains coordinate, profile girth, the area of being had a few on each profile in the image, judges that whether profile meets the characteristic of two white bright lines, confirms the profile of two white bright lines with this; The coordinate mean value calculation of being had a few on the profile by white bright line obtains its centre coordinate, and relatively the magnitude relationship of the center horizontal ordinate of two bright lines is distinguished the salient line on left side and right side.Find out have a few on two white bright lines profile separately in the maximum and minimum point of ordinate, totally four points, then these four points have constituted the summit of display screen 3; Being characterized as of said two white bright lines: the area of profile is less and in the scope of setting divided by the ratio of girth; For example 10 to 20; The ratio that the variance of each point ordinate obtains divided by the variance of each point horizontal ordinate on the profile on the profile is big and in the scope of another setting, and for example 40 to 50, when finding standard compliant white bright line; Then can confirm the zone of display screen 3, otherwise continue to search;
When finger touches display screen 3, the infrared ray 4 of the emission of linear infrared laser 2 produces hot spot at finger fingertip, obtains the image that contains hot spot and passes to processor through camera 1, and processor positions hot spot, obtains its coordinate.Convert out its relative coordinate and then definite position by the coordinate of spot center at display screen 3; Duration through touch location and touch judges whether to be false triggering; If detect again for false triggering; The application programming interfaces of failing processor call operation system produce touch event and fill order, and display screen can be accomplished the same function of traditional touch screen.
The method that the location of said hot spot coordinate has adopted profile to search is found out light spot profile, and obtains its centre coordinate by the coordinate mean value calculation of being had a few on the profile.Specifically: earlier with image binaryzation, the hot spot place is designated as white, and all the other are regarded as background, are designated as black.Cut out internal point then, the determination methods of so-called internal point is: in the square of 3*3, when central point is a white point, and its 8 neighborhood points also are white point, and promptly central point is surrounded by white point, and then this central point is an internal point.From initial point,, profile is irised out afterwards, and write down the coordinate of each point on the profile through the search of eight directional.Said process also can be realized by the function cvFindContours () that OPENCV provides, and directly obtain profile number, the information such as coordinate of the coordinate of being had a few on the profile, area, girth, profile central point E.
The coordinate of said finger spot center is converted out its relative coordinates in display screen 3 zone and is adopted following algorithm, in the rectangular coordinate system that hereinafter relates to X axle positive dirction be level to the right, Y axle positive dirction is for straight down.Like the finger spot center point of E point in the accompanying drawing 4 for touching display screen 3, A ( X A , Y A ), B ( X B , Y B ), C ( X C , Y C ), D ( X D , Y D ) be four summits of display screen 3 regions, cross the E point and do the straight line that is parallel to the Y axle, meet at a F, G, then horizontal ordinate with AB, CD respectively , by slope
Figure 631584DEST_PATH_IMAGE002
,
Figure 473638DEST_PATH_IMAGE003
Can obtain the ordinate that F, G are ordered, promptly
Figure 868847DEST_PATH_IMAGE004
Figure 683219DEST_PATH_IMAGE005
In the following formula, X A , X B , X C , X D , X E , X F , X G Be respectively the horizontal ordinate of an A, B, C, D, E, F, G, Y A , Y B , Y C , Y D , Y E , Y F , Y G Be respectively the ordinate of an A, B, C, D, E, F, G.
The display screen height
Figure 835032DEST_PATH_IMAGE007
given in advance through formula can obtain in display screen 3, the relative ordinate of hot spot .
Point H, I are respectively at line segment AC, the last point of getting of BD, and some H, I make line segment AH, AC, FE, FG, BI, BD become following proportionate relationship:
Can calculate the coordinate of invocation point H, I thus through following relational expression:
Figure 702811DEST_PATH_IMAGE009
Figure 512821DEST_PATH_IMAGE011
Figure 249833DEST_PATH_IMAGE012
In the following formula, X A , X B , X C , X D , X E , X F , X G , X H , X I Be respectively the horizontal ordinate of an A, B, C, D, E, F, G, H, I, Y A , Y B , Y C , Y D , Y E , Y F , Y G , Y H , Y I Be respectively the ordinate of an A, B, C, D, E, F, G, H, I,
The display screen width
Figure 766844DEST_PATH_IMAGE014
given in advance by formula can obtain in display screen 3; The relative abscissa of hot spot
After obtaining the relative horizontal ordinate and relative ordinate of hot spot, the application programming interfaces of call operation system produce touch event.

Claims (2)

1. virtual touch screen system based on image processing techniques; It is characterized in that comprising display screen (3), camera (1), linear infrared laser (2), processor; Camera (1) is installed in display screen (3) and goes up the place ahead; And display screen (3) is in the viewfinder range of camera (1), and the infrared ray (4) that linear infrared laser (2) is launched is parallel to be covered on display screen (3) surface, and camera (1) is connected with processor.
2. a kind of virtual touch screen system according to claim 1 based on image processing techniques; The both sides that it is characterized in that said display screen (3) respectively are provided with a salient line (5), and said two salient lines (5) overlap with two sides of display screen (3) inward flange.
CN2011104439230A 2011-12-27 2011-12-27 Virtual touch screen system based on image processing technology Pending CN102520830A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011104439230A CN102520830A (en) 2011-12-27 2011-12-27 Virtual touch screen system based on image processing technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011104439230A CN102520830A (en) 2011-12-27 2011-12-27 Virtual touch screen system based on image processing technology

Publications (1)

Publication Number Publication Date
CN102520830A true CN102520830A (en) 2012-06-27

Family

ID=46291781

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011104439230A Pending CN102520830A (en) 2011-12-27 2011-12-27 Virtual touch screen system based on image processing technology

Country Status (1)

Country Link
CN (1) CN102520830A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017028360A1 (en) * 2015-08-19 2017-02-23 李江 Touch control system and touch control table
CN106468977A (en) * 2015-08-19 2017-03-01 李江 Contactor control device and touch control method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101887329A (en) * 2010-07-13 2010-11-17 世大光电(深圳)有限公司 Electronic equipment and optical positioning device thereof
CN102096527A (en) * 2010-12-18 2011-06-15 何晓 Indoor wireless audio and video holographic interactive rear projection integrated machine and implementation method
CN102103437A (en) * 2009-12-21 2011-06-22 原相科技股份有限公司 Optical touch device and positioning method thereof
CN102314301A (en) * 2010-06-30 2012-01-11 李子青 Virtual touch sensing system and method
CN202404557U (en) * 2011-12-27 2012-08-29 华南理工大学 Virtual touch screen system based on image processing technology

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102103437A (en) * 2009-12-21 2011-06-22 原相科技股份有限公司 Optical touch device and positioning method thereof
CN102314301A (en) * 2010-06-30 2012-01-11 李子青 Virtual touch sensing system and method
CN101887329A (en) * 2010-07-13 2010-11-17 世大光电(深圳)有限公司 Electronic equipment and optical positioning device thereof
CN102096527A (en) * 2010-12-18 2011-06-15 何晓 Indoor wireless audio and video holographic interactive rear projection integrated machine and implementation method
CN202404557U (en) * 2011-12-27 2012-08-29 华南理工大学 Virtual touch screen system based on image processing technology

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017028360A1 (en) * 2015-08-19 2017-02-23 李江 Touch control system and touch control table
CN106468977A (en) * 2015-08-19 2017-03-01 李江 Contactor control device and touch control method
CN106468976A (en) * 2015-08-19 2017-03-01 李江 Touch-control system and touch table

Similar Documents

Publication Publication Date Title
JP5991041B2 (en) Virtual touch screen system and bidirectional mode automatic switching method
US20200150822A1 (en) Pen differentiation for touch displays
CN101403951B (en) Multi-point positioning device and method for interactive electronic display system
CN102341814A (en) Gesture recognition method and interactive input system employing same
US9442607B2 (en) Interactive input system and method
TWI520036B (en) Object detection method and calibration apparatus of optical touch system
TW201112092A (en) Optical touch system and method thereof
CN102436327B (en) Screen input system and implementation method thereof
CN101930306A (en) Multi-touch device and detection method thereof
CN102622131B (en) Electronic equipment and positioning method
CN100478860C (en) Electronic plane display positioning system and positioning method
CN102508578A (en) Projection positioning device and method as well as interaction system and method
TW201113786A (en) Touch sensor apparatus and touch point detection method
CN104142739A (en) Laser point tracking system and method based on optical mouse sensing array
CN105511691B (en) Optical touch sensing device and touch signal judgment method thereof
US9886105B2 (en) Touch sensing systems
KR101756664B1 (en) Infrared light touch screen display device and method for determining touch point of the same
CN201628947U (en) Touch electronic device
CN102520830A (en) Virtual touch screen system based on image processing technology
CN202404557U (en) Virtual touch screen system based on image processing technology
CN102799344B (en) Virtual touch screen system and method
CN104571726A (en) Optical touch system, touch detection method and computer program product
CN109975769A (en) It is a kind of for showing interactive radar module and its display exchange method
CN101414224B (en) Apparatus and method for defining writing position
CN104375697A (en) Mobile device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20120627