A kind of back projection light source type touch recognition device and touch identification method thereof
Technical field
The present invention relates to touch screen technology, relate in particular to a kind of back projection light source type touch recognition device and touch identification method thereof.
Background technology
The touch-screen locating device of existing use camera; Through using two or more digital cameras to obtain target image continuously, utilize digital signal processor that each camera is obtained image then and handle, at last image is carried out synthesis analysis and calculate the Place object of object on screen; But this scheme; System architecture is complicated, needs a plurality of cameras to work simultaneously, needs to solve the image synchronization problem between the different cameras; And image processing algorithm and location algorithm be more complicated all, and cost is higher.
A kind of touch-screen locating device and localization method thereof are disclosed in the patent No. is 200610122463.0 application documents; This application file discloses a kind of device that adopts single camera or image inductor, monochromatic linear light source to realize touching the location; Simplified the structure of locating device, but the monochromatic linear light source that this structure adopts is installed in a side or arbitrary corner near screen edge of touch-screen, thereby can not always discerns multiple point touching; Two touch points on the projecting direction of source light for example; Wherein have one will be blocked, thereby this touch-screen locating device will lose efficacy, moreover; The light source that adopts the side to install also is difficult to the shape of recognizing touch operation thing, thereby has limited its range of application.In addition, in passive projection display screen (like the frosted glass screen) side power supply is installed, needing increases wiring, makes total structure succinct inadequately.
Summary of the invention
The purpose of this invention is to provide a kind of simple in structure, the back projection light source type touch recognition device that can discern multiple point touching and touch objects shape.
Another object of the present invention provide a kind of can integrated projection source, the back projection light source type touch recognition device of sensor and light source.
Another object of the present invention also provides a kind of touch identification method of back projection light source type.
For achieving the above object, the technical scheme of the embodiment of the invention provides a kind of back projection light source type touch recognition device, comprises display screen, imageing sensor and projector; Imageing sensor and projector are installed in a distance, display screen rear and can take or project to the entire display screen curtain; It is characterized in that; This device also comprises the monochromatic illumination light source; This monochromatic illumination light source is installed in the position of the certain distance at display screen rear, and this position is defined as the light that makes its all directions of sending can cover entire display screen curtain zone.
Wherein, said monochromatic illumination light source and projector are integrated in a kind of light path integrated morphology device.
Wherein, a kind of structure of said light path integrated morphology device is to be split as two parts to the optical projection system of projector, and a part is installed on the fuselage of projector, and another part constitutes a lens group; A single face catoptron is installed on the light path of said projector, and its reflecting surface is facing to the incident end of projector and said lens group; Said monochromatic illumination light source is installed in a side of single face catoptron transmission plane; Said projector is installed on the pairing direction of reflecting surface of said catoptron, and the light of monochromatic illumination light emitted sees through the incident end that the single face catoptron arrives lens group.
Wherein, said projector and imageing sensor are integrated in a kind of light path integrated morphology device.
Wherein, a kind of structure of said light path integrating device is to be split as two parts to the optical projection system of projector, and a part is installed on the fuselage of projector, and another part constitutes a lens group; A single face catoptron is installed on the light path of said projector, and its reflecting surface is facing to the incident end of the projected image of imageing sensor and said lens group; Imageing sensor is installed in reflecting surface one side of said single face catoptron; Said projector is installed in transmission plane one side of said catoptron.
Wherein, said projector and imageing sensor are integrated in a kind of light path linkage structure device.
The technical scheme of the embodiment of the invention also provides a kind of touch identification method that uses back projection light source type touch recognition device, may further comprise the steps:
A: raw data is read in the computer system initialization, and the monochromatic illumination light source irradiation of position of certain distance that is installed in the display screen rear is to the entire display screen curtain;
B: imageing sensor is that unit is taken projection screen continuously fully with the frame, and output image signal or data are in computing machine;
C: the data of computer system reads imageing sensor one frame;
D: image is handled, analyzed on the display screen whether the pixel of high bright reflection spot is arranged,, then return step c,, then write down its position, continue next step if having if do not have.
E: calculate the position coordinates of the pixel of each high bright reflection spot with respect to the pixel of display screen according to raw data;
F: output includes the data with respect to the position coordinates of the pixel of display screen of the pixel of above-mentioned each high bright reflection spot, turns back to the c step then.
Wherein, the raw data described in the said step a is the calibration data of computer system stores, or the curing data of projector and imageing sensor integrated morphology.
Wherein, said step e comprises that also the position of each high bright picture element that basis calculates concerns the step of the contour shape of judging touch objects and display screen contact portion.
Technique scheme only is an optimal technical scheme of the present invention, and have following advantage: the present invention has realized multiple point touching identification, and shape that can the recognizing touch operation thing.Power supply is installed all around owing to not be used in display screen by the present invention system, thereby makes system simpler, moreover, adopts projection source, imageing sensor to combine with projector or to integrate, and has simplified system especially.
Description of drawings
Fig. 1 is the overall construction drawing of touch recognition device of the present invention;
Fig. 2 is the light path integrated morphology synoptic diagram of back lighting of the present invention;
Fig. 3 is the integrated morphology synoptic diagram of projection of the present invention and shooting common optical pathways
Fig. 4 is the structural representation of projection of the present invention and shooting light path adjusted in concert;
Fig. 5 is the principle schematic of multiple spot identification of the present invention and the identification of touch objects profile;
Fig. 6 is the program flow diagram of recognizing touch operation thing of the present invention.
Among the figure: 101, projection screen; 102, touch objects; 103, projector; 104, imageing sensor (camera); 105, monochromatic illumination light source; 106, color filter; 107, the light and the projectional angle of projector's emission; 108, the light or the visual angle of imageing sensor reception; 109, the light of lighting source and projectional angle; 110, the light that touch objects reflected; 201, single face catoptron; 202, projector's fuselage; 203, projector lens group; 204, image light; 205, illuminating ray; 206, mix light; 207, throw light and projectional angle; 301, the illuminating ray of screen reflection; 302, the illumination reflection ray that converges through lens group; 303, incide the indirect illumination light of imageing sensor; 401, the lens group of imageing sensor; 402, linkage structure; 501, the display surface of projection screen; 502, the reflectance profile of writing brush; 503, the reflectance profile of general lettering pen; 504, the reflectance profile of finger.
Embodiment
Following examples are used to explain the present invention, but are not used for limiting scope of the present invention.
As shown in Figure 1; General structure of the present invention comprises projection screen 101, projector 103, imageing sensor (camera) 104 and monochromatic illumination light source 105; As can be seen from the figure; Monochromatic illumination light source 105 is placed in the certain distance at rear of projection screen 101; All be in the same area with projector 103, imageing sensor (camera) 104, projector 103, imageing sensor (camera) 104 are installed in the certain distance at projection screen 101 rears, so that can take or project on the position of whole screen.Line 107 and 108 expression projectors 103 and 104 ability projections of camera or the scope that photographs, 105 scopes that can shine of line 109 expression lighting sources, line 110 expression touch objects enter into camera 104 from 105 reflection rays of lighting source.
When touch objects 102 touch screen; The light that lighting source 105 at the screen rear the is throwed thing that is touched reflects; Image sensor or camera 104 will capture the light 110 that thing reflected that is touched; After the collection conversion through imageing sensor (camera), output image signal or data are handled to computing machine.Because lighting source 105 is not mounted in a side of screen, and be mounted in the certain distance at screen rear, this distance setting is the zone that light that lighting source is sent can cover whole screen; Therefore; Even a plurality of touch points are arranged, also can both shine by illuminated light source 105, simultaneously; The light that this a plurality of touch point is reflected also can both enter into camera 104, thereby the shape of touch point also can both be by camera 104 identification of catching.
If writing brush, lettering pen and finger touch projection screen simultaneously, the contact site of these objects and projection screen can light source for reflection illumination, and the high bright reflection spot of formation is caught by camera.But because different objects is different with soft or hard, the shape of the contact jaw of screen, so the contour pattern that the contact site is shown on screen is also different.As shown in Figure 5; Can find out reflectance profile 502 and the reflectance profile 503 of lettering pen and the shape difference of reflectance profile 504 on projection screen of finger of writing brush; Therefore by the high bright spot reflectance profile of the camera 104 multiple point touching thing that identifies of catching; After the IMAQ of process camera and the Flame Image Process of computing machine; Obtain the position coordinates of touch objects, even can also obtain the contour shape of touch point according to the feature contour data of the touch objects of the various character of storing in the computing machine with respect to display element.These data are sent to computer background and handle then, thereby can discern the character of judging touch point position, quantity and touch objects.Computing machine can be according to above-mentioned data, through coming the control display screen curtain to control accordingly like target programs such as control, drawing, literal inputs like this.Such as, be multiple point touching if identify, then call the handling procedure of multiple point touching; If the contour feature of recognizing touch operation thing is identical with the characteristic of writing brush in the database is writing brush, just can select the effect of brush writing automatically.
Projector 103 can be integrated in a kind of structure with monochromatic illumination light source 105, and is as shown in Figure 2, is the light path integrated mechanism synoptic diagram of projector 103 and monochromatic illumination light source 105.The optical projection system of projector 103 is split as two parts, and a part is installed on projector's fuselage 202, and another part constitutes a lens group 203; The a single face catoptron 201 (catoptron of single face described in the present invention also is installed on the light path of said projector; Be that an a kind of surface can reflection ray; Another surface can transmitted ray planar optical elements), its reflecting surface is facing to the incident end of projector and said lens group; Said monochromatic illumination light source is installed in the back side of single face catoptron, i.e. transmission plane one side.Like this, projected image is reflected to the incident end of lens group 203 through single face catoptron/diaphotoscope 201; 105 back sides from single face catoptron 201 of monochromatic illumination light source emit beam, through the incident end that also arrives lens group 203 behind this mirror.Not only can realize projecting function but also can realize illumination functions that present this integrated technology is very ripe, is not described further here through this integrated mechanism.The present invention adopts the integrated mechanism of projector 103 and lighting source 105; The range of exposures of lighting source is identical with the projection scope of projector; Therefore need not regulate illumination orientations, angle parameter and just can shine directly into the touch objects in projector 103 scope area of throwing; And around can not disturbing to the object of the light sensitive of this light source, the camera of using like security monitoring.
Likewise, as shown in Figure 3, according to the reversibility of optical path principle, projector 103 and imageing sensor (camera) 104 can adopt the integrated morphology of common optical pathways.Similar with the illuminator of top integrated morphology, the optical projection system of projector is split as two parts, and a part is installed on projector's fuselage 202, and another part constitutes a lens group 203.A single face catoptron 201 also is installed on the light path of said projector, and the back side that projector is installed in the single face catoptron is transmission plane, and projected image is transmitted to the incident end of lens group 203 through the single face catoptron; Imageing sensor (camera) is installed on the pairing direction of reflecting surface of said catoptron, and the touch image of returning through lens group 203 transmissions then is reflected on the camera lens of imageing sensor (camera).
In addition; According to the view finder of zoom paraxonic camera and the principle of taking lens synchronous interaction; Can also use the integrated mode of another kind of imageing sensor and projector system; As shown in Figure 4, projector 103 and imageing sensor (camera) 104 can also adopt the integrated morphology of light path adjusted in concert (light path interlock).Owing to adopt the structure that this light path is integrated or link, need not carry out the calibration of initialized location, the position of high bright pixel on the sensing chip of camera that just can directly form according to touch objects is through calculating the position coordinates that obtains touch objects.
Can expect the various piece of further combination system thus, can be integrated in monochromatic illumination light source and projector, image sensor in a kind of light path integrated morphology, so just more simplify the touch recognition system.
The lighting source that the present invention adopts is the monochromatic illumination light source; It can be the light source of infrared ray or other form; The same with prior art; In imageing sensor, use color filter 106, its effect is that the identical light of light color that only allows to send with light source gets into, eliminate the projected image of visible light section and on every side veiling glare to the interference of camera (imageing sensor) 104.
In the present invention; Imageing sensor 104, projector 103 and projection screen 101 all link to each other with computing machine; Behind the light that touch objects reflected that imageing sensor 104 captures; Be transferred to computing machine and carry out graphical analysis, obtain the data such as position of touch point with respect to display element, as shown in Figure 6.If also store the shape that various touch objects form images or the database of contour feature in the computing machine on display screen, just can be through the shape profile of relatively judging the recognizing touch operation thing of characteristic.If adopt shooting and projecting light path is integrated or during the integrated morphology of light path interlock, initial step 601 just need not read calibration data, but directly read the link curing data of integrated morphology of the integrated or light path of light path.Because it is identical that at this moment the visual angle of projectional angle and camera of projector can be set; Perhaps become a fixing ratio; So can set each number of picture elements and last each row of image sensor chip (CCD or CMOS chip) of camera and ratios of a row number of picture elements capable and row in the projector, thereby obtain the raw data of corresponding relation between the two.Here said calibration data is stored in the calibration data of computer system for the present invention; Be to use manual method; Be presented at a plurality of unique points specific on the screen 101 through touching computing machine through projector; Obtain these unique points pixel location on CCD or the CMOS induction chip in imageing sensor, the data that concern between the position of the pixel of position through calculating these pixels and display image then.The collimation technique of touch-screen also is a kind of mature technology very commonly used, just no longer specifies at this, can be with reference to the content of the patent documentation of front reference and inner related various patent documentations thereof.
Touch identification method generally speaking of the present invention is:
1) raw data is read in the computer system initialization, and the monochromatic illumination light source irradiation is to the entire display screen curtain, and high bright reflection spot appears in the pixel in touch objects and display screen contact site;
2) imageing sensor is that unit is taken projection screen continuously fully with the frame, and output image signal or data are in computing machine;
3) data of computer system reads imageing sensor one frame;
4) then image is handled, analyzed pixel brightness,, then analyze the pixel of high bright reflection spot on screen, write down its position, carry out next step,, then return step 3) if there is not touch objects on the screen if touch objects is arranged;
5) calculate the position coordinates of the pixel of each high bright reflection spot according to raw data with respect to the pixel of display screen;
6) output include above-mentioned each high bright reflection spot pixel with respect to the data of the position coordinates of the pixel of display screen to target program, turn back to the 3rd step then.
In the process of recognizing touch operation thing; Imageing sensor is that unit is taken projection screen continuously fully with the frame, if during such touch objects touch display screen curtain such as finger and the contact portion of display screen in a two field picture, all be photographed; Picture signal is transferred in the computer system like this; Through after handling, the feature contour data of the touch objects of the relevant various character of having stored according to computer system are differentiated the shape of this touch objects.Afterwards, touch recognition device of the present invention is proceeded the touch objects identification of next frame, quits work up to touch recognition device of the present invention.
Certainly, the step of judgement touch objects shape also can be put in the application program to be carried out, like paint program; Perhaps, call when needed as the sub program in the program circuit of realizing this method.Because the application program of not all use touch function all need be judged the character of touch objects, such as go up operation computing machine in demonstration " desktop ", just only need touch a function of clicking, and need not judge the shape or the character of touch objects.If at this moment judge the shape or the character of touch objects again, will take the system for computer resource, must reduce the work efficiency of computing machine.
The above is a kind of embodiment of the present invention, and protection scope of the present invention is not limited thereto.