CN100498675C - Photoelectric detection positioning system and method for touch panel of computer - Google Patents
Photoelectric detection positioning system and method for touch panel of computer Download PDFInfo
- Publication number
- CN100498675C CN100498675C CNB2003101129191A CN200310112919A CN100498675C CN 100498675 C CN100498675 C CN 100498675C CN B2003101129191 A CNB2003101129191 A CN B2003101129191A CN 200310112919 A CN200310112919 A CN 200310112919A CN 100498675 C CN100498675 C CN 100498675C
- Authority
- CN
- China
- Prior art keywords
- photoelectric
- data
- photosensor arrays
- micro controller
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Length Measuring Devices By Optical Means (AREA)
- Position Input By Displaying (AREA)
Abstract
This invention relates to computer touch screen photoelectron positioning system, which comprises at least two sets of optics elements fixed on the angle of surface to be measured, photoelectron sensor array, signal process circuit and micro controller system. Through separately testing the positions of the screen photoelectron sensor array, it uses principles of optics and geometry to get the line equation in reference coordinates system and solves the above equations to get the coordinates values in the coordinates system.
Description
The present invention relates to a kind of principle of the image that on a plurality of photodevice matrix, generates by the senses touch thing, determine the system and method for the position of touch objects on the touch-screen, belong to photoelectric technology and technical field of computer multimedia.It is the human-computer interaction interface of the digital information apparatus of core with the microprocessor that the present invention is applicable to various, especially is applied on the computing machine touch-screen as data acquisition system (DAS).
Along with the popularization and application of Computer Multimedia Technology, the writing technology in the computer media data input technology has also obtained developing rapidly, and various writing technologies competitively are generalizable.Wherein with writing technologies such as resistive film, electromagnetic induction, capacitance technology basic development maturation.But make a general survey of these existing writing technologies, we find that they have shortcoming more or less.At first, traditional resistive film, electric capacity, surface acoustic wave, infrared touch input technology all can't leave a screen or framework, the collection of the position coordinate data of touch objects all needs to rely on this piece screen or framework to finish, therefore its range of application has been subjected to the restriction of framework or screen naturally, can not arbitrarily adjust the size of screen, also be difficult to carry at any time and the use that matches with other surfaces that need touch input; Secondly, these technology all are not suitable for using on the giant-screen because of technology limitation own, especially are applied on the projection screen and various electronic whiteboard of rear-projection; Moreover these technology exist all also that the finished product rate is lower, serviceable life is short, the too high shortcoming of integrated cost.Though the ultrasound wave hand-writing technique that newly-developed gets up is fit to use on large-sized screen and the electronic whiteboard, but this technical requirement be used for hand-written pen be a special use, can launch the active writing pencil of ultrasound wave, utilize the method that detects the aerial travel-time of ultrasound wave, can realize acquisition tasks to the writing pencil position coordinate data, therefore applicability also has been subjected to considerable restraint, can't use means commonly used such as finger, teacher's pointer, blank pen, chalk to realize touching the purpose of input.In addition, ultrasound wave also is subjected to the interference of various noises easily, is not suitable for using under noisy environment.
Purpose of the present invention is exactly the defective at existing touch-screen or employed various positioning systems of electronic whiteboard and method, the mode of the photoelectric image sensing that a kind of integrated cost is low, applicability is wide is disclosed, realize the positioning system and the method for the position coordinates detection of touch objects or writing pencil, make it be applicable to multiple generic object, and adjust easily and be common to multiple touch or hand-written size as the location subject matter.
In order to realize the foregoing invention purpose, the present invention has adopted following technical scheme:
Whole photoelectric detecting and positioning system is made of optical element, photosensor arrays, photoelectric signal processing circuit, micro controller system etc.; Wherein photosensor arrays has two covers at least, is installed in respectively on two angles of display surface; At least include a linear array that Pixel Dimensions is known in every cover sensor, wherein include the servo circuit of built-in or external selection that is used for each pixel cell of array of controls and signal output, the input end of its signal output part and photoelectric signal processing circuit is of coupled connections; The optical element here is that the distance with the light-sensitive surface of photosensor arrays is the convex lens or the aperture of known number; Constituted photoelectric sensor system with each self-corresponding photosensor arrays combination, its position is known in reference coordinate system; Photoelectric signal processing circuit includes the A/D translation circuit, and the output terminal of its input end and photosensor arrays is of coupled connections, and its output terminal is connected with the I/O port of described micro controller system; This micro controller system is connected with the control input end of the sensor array, the control input end of A/D transducer respectively by control line simultaneously; And this micro controller system also has one and use the communication port of carrying out exchanges data between the host computer of this system.
And, at described micro controller system and use in the nonvolatile memory of host computer of this system, store a group system control routine, set of diagrams picture and handle code, one group of numerical evaluation code, a group communication control routine, and above-mentioned each known number; Here within system's control routine storage and the described micro controller system, be used to control photosensor arrays and the co-ordination of A/D transducer; The Flame Image Process code storage is within described micro controller system, include one section initialization data storage code, be used to obtain and store the background signal data that the self check stage obtains from each effective unit of photoelectric sensor, one piece of data is code relatively, be used for signal data with current output from each effective unit of above-mentioned photosensor arrays, compare with the described corresponding background data that is stored in the data-carrier store, thereby whether touch objects is arranged and when touch objects is arranged, the outline data of the image that on photoelectric sensor, forms of touch objects, and, obtain the geometric center point of described image according to the physical size of each valid pixel in the outline data of the touch objects that has obtained and the photosensor arrays; The numerical evaluation code storage is within the described micro controller system or within the described host computer, include one section straight-line equation generating code, be used for data, calculate by the center of optical element and the equation of the determined straight line of geometric center in reference coordinate system of touch objects according to the geometric center point of the distance of the light-sensitive surface of aforesaid optical element and described photosensor arrays and the image that obtained; One section coordinate figure Accounting Legend Code is used for basis from the straight-line equation that at least two described photoelectric sensor systems obtain, and calculates the coordinate of touch objects in reference coordinate system; Described communication control code, be stored within the described micro controller system, be used to control described communication port, receive the steering order of host computer, and the intermediate data that this sensing and detecting system is handled, calculated, the position coordinate data of the touch objects that perhaps finally obtains in reference frame is sent to host computer by communication port.
This system can be by the many covers of a micro controller system control photoelectric sensor system, A/D transducer, the data transfer channel that switches between each photoelectric sensor system and the microcontroller by analog switch or data latches constitutes, and also can be made of a plurality of subsystems.If be made of a plurality of subsystems, at this moment each subsystem all comprises at least one cover photoelectric sensor system, an A/D transducer and a microcontroller subsystem; Be connected by the intercommunication interface between each microcontroller subsystem; In the nonvolatile memory in each microcontroller subsystem, all also store the described intercommunicating code of control like this; And select one to include the communication port that described and host computer carry out exchanges data, and the subsystem of described communication control code is as primary module, unified and host computer communicate gets in touch and transmits data.Certainly, also can be the mixture of above-mentioned two kinds of basic structures.
This cover has adopted following method to realize the touch objects detection of coordinate for it according to the photoelectric detecting and positioning system that said structure makes up, and now is described as follows:
(A). after microcontroller starts, by control line control photosensor arrays and A/D transducer, read under the situation that does not have touch objects the currency of the output of each valid pixel in described each photoelectric sensing array one by one, data storage is got up as a setting, constitutes background database;
(B). repeating step (A), obtain the currency of the output of each valid pixel in every cover photoelectric sensing array once more, and call the background value of corresponding pixel in the background database, compare with the currency that obtains now, if the difference between two numerical value does not exceed predefined scope, then abandon currency, continue to read and more next pixel currency and background value poor; If described difference has exceeded predefined scope, then store the currency of this pixel in addition, then continue to read and more next pixel currency and background value poor, to the last a pixel; And the currency of each pixel of being stored has in addition constituted target database.
(C). the carries out image processing code, directly or by the data in the described communication port invocation target database carry out analytical calculation, obtain the image outline of target data, and then to obtain target be that touch objects is in the pixel at the central point place of described photoelectric sensing array epigraph and the position on sensor array thereof;
(D). carry out the numerical value Accounting Legend Code, according to the physical location of described image center place pixel and the distance value between optical element and the photosensor arrays light-sensitive surface, calculate by the center of optical element in this chosen photoelectric sensor system and the equation of the determined straight line of geometric center in reference coordinate system of touch objects;
(E). unite to resolve and obtain straight-line equation after every cover photoelectric sensor system has been finished the operation of above-mentioned steps, obtain the focus between each bar straight line, i.e. the coordinate figure of touch objects in described reference coordinate system;
(F). start communication port, above-mentioned coordinate figure is sent to host computer, program jumps to the next circulation of step (B) beginning then.
Each above-mentioned step, can all in microcontroller, finish, just will touch the coordinate figure of subject matter in reference frame at last is transferred in the host computer that uses this cover system, also can make full use of the host computer strong calculation function, giving host computer with the part calculation task finishes, to shorten the processing cycle of microcontroller, improve the response speed of system.Concrete condition need as requested system performance and the processing power of microcontroller determine whether giving host computer with the partial data Processing tasks finishes, and perhaps partly gives host computer with for which.
By top description, can see that the present invention has following advantage to technical scheme.At first, because system mainly uses the image sensor element of finished product and microcontroller to constitute, so simplified the production technology of product greatly, and the cost of these finished product components and parts is very cheap now, has therefore reduced the production and the maintenance cost of product significantly; Secondly, in certain range of size, the size that touch to detect is by the installation site decision of photoelectric sensor system in reference coordinate system, therefore can set sensing range by the setting of relevant coordinate figure, is very easy on the display of different size or blank general; The 3rd, because system determines the position of touch or hand-written subject matter by the mode of image sensing, therefore only require this touch objects to a certain extent reflection ray get final product, thereby can detect finger and most commonly used write, the position of marking tools, have very outstanding applicability.
Below with reference to the accompanying drawings, describe technical scheme of the present invention in detail in conjunction with concrete enforcement structure.
The mounting structure of Fig. 1 photoelectric image sensor-based system and detection principle schematic
A kind of geometric relationship synoptic diagram between the image of Fig. 2 photoelectric image sensor-based system and touch subject matter
Another geometric relationship synoptic diagram between the image of Fig. 3 photoelectric image sensor-based system and touch subject matter
The background data of Fig. 4 photoelectric sensor system output and the synoptic diagram of destination image data
A kind of structured flowchart of the hardware system of a kind of sub modular structure of Fig. 5
The schematic block diagram of another mixed structure of Fig. 6 hardware system
The workflow diagram of Fig. 7 system
The subroutine flow chart of Fig. 8 Data Detection
A kind of scheme of installation of Fig. 9 floor light element
The synoptic diagram of Figure 10 integrated optical circuit floor light structure
Electro-optical imaging sensors at the mounting structure of detected surface as shown in Figure 1 in the system.Here said detected surface 101 can be the apparent surface of a display, also can be the surface of a handwriting pad or electronic whiteboard.On two angles of this detected surface, the photoelectric image detection system that two covers are made of optical element 104, photosensor arrays 102 and optical element 105, photosensor arrays 103 respectively is installed.Here optical element 104, photosensor arrays 102 and optical element 105, the coordinate of photosensor arrays 103 in reference coordinate system XOY are known, so the distance between the light-sensitive surface of optical element and sensor array also is known.Here, the type of photoelectric sensor can be selected the photoelectric sensor of CCD, CMOS, CIS type for use without limits, generally selects the just passable of linear array structure.But also can use the photoelectric sensor of face battle array structure, at this moment only need a linear array in the selection face battle array to be used for sensing.Claim that at this these necessary pixels that are used for sensing are valid pixel.
If as shown in FIG., suppose the axially parallel of linear array image sensor 102,103 with reference coordinates plane X OY, and its normal 106,107 all with X-axis and Y-axis angle all at 45, as long as obtain so by touch subject matter 108 centers with two optical element central point straight lines 109 and 110 respectively with the angle α and the β of X-axis, just can obtain the equation of these two branch lines, by these two equations of simultaneous solution, promptly can obtain touching the coordinate figure of subject matter (touch objects) in reference coordinate system.The present invention utilizes the light of touch objects reflection to come straight line 109,110 in the alternate figures, thus by calculating obtain touch objects 108 the coordinate P in reference coordinate system XOY (x, y).
Fig. 2 and Fig. 3 have just disclosed the geometric relationship between the various piece among Fig. 1 more clearlyly.Since linear array image sensor 102,103 all with coordinate axis X and Y angle at 45, therefore can be easy to obtain the slope of straight line 109,110, and then obtain straight-line equation.Its mathematical model of following brief analysis.
In Fig. 2, the initial point (0,0) of center in reference frame XOY of optical element is set, from center touch objects reflection, that extend through the touch objects xsect and the light 109 of lens center, with the angle of coordinate system X-axis be α, with the intersecting point coordinate of linear array be B
0(x ', y '), and the distance that is provided with between the optical element line array sensor light-sensitive surface is D; The normal 106 and the linear array of the linear array by the optical element center intersects at the central point A of linear array
0, stipulate A simultaneously
0Think central point 0, with the distance of the direction of arrow stipulated in scheming, point to "+" symbol for just, B then
0With A
0Between apart from d
0, and the relation between above-mentioned each numerical value and the angle α has:
Therefore, can obtain by point (0,0) and touch objects the center (x, straight-line equation y), for
In like manner for Fig. 3, the coordinate of lens center in reference frame is set is (a, 0), other symbols or numerical value are still set according to the rule of Fig. 2, like this for reflection ray 110, angle β and the D and the d of itself and reference coordinate system X-axis
aBetween the pass be:
Therefore, can obtain straight-line equation by the center of point (a, 0) and touch objects, for
Simultaneous solution is by top two system of equations that straight-line equation constitutes
Can obtain touching subject matter P (x, y) coordinate figure in reference coordinate system.
Though system of equations (1) is to obtain in above-mentioned the setting, set-up mode or notation for other still can obtain identical result.Because this part content belongs to pure mathematical derivation, its related mathematical knowledge all is included within the content of elementary mathematics, does not therefore here just itemize and has illustrated.
Can see from top mathematical derivation, because the data such as distance between angle, optical element and the photosensor arrays of photosensor arrays and coordinate axis all are artificial the settings, therefore be known or as can be known, so obtain straight-line equation and then find the solution the key that obtains the touch objects position coordinates, be to obtain above-mentioned two " light " to list the position of imaging, i.e. d at sensor array
0And d
aValue.Software and hardware system of the present invention is set in order to obtain this value.As shown in Figure 4, set up rectangular coordinate system VOP, longitudinal axis V is the voltage of each pixel cell output, the orientation of transverse axis P remarked pixel unit, and mid point is made as A
0, thick black line 403 expression these sensing linear array and length thereof.If can access when in detected surface, not having touch objects, the background signal 401 of photoelectric sensor output, and then when obtaining touching subject matter photoelectric sensor output be superimposed upon live signal 402 on the background signal, these two signals so relatively just can access the image of touch objects.For a kind of photoelectric sensing linear array of specific model, the distance between its adjacent pixel unit is a fixed value as can be known, obtains the position B of picture centre so again according to the position of image border
0And just can access d on any one linear array
0And d
aValue, and then obtain the slope and the equation of straight line.In theory, the present invention only needs two cover photoelectric sensing (imaging) systems just can realize the purpose of inventing, and in actual applications, also can reach general accuracy requirement fully; But for high-precision requirement, had better increase by one to two cover photoelectric sensor system, be installed on one or two other angles of detected surface.Because near near the position the reference coordinate system X, the accuracy of detection on directions X can reduce in Fig. 1.Fig. 5 is exactly that other photoelectric sensor system is installed on remaining angle of detected surface shown among Fig. 1 111 according to the hardware system structure figure that realizes that above-mentioned degree of precision requirement makes up.
In Fig. 5, photoelectric sensor system still is made of optical element 104 and photoelectric sensing array 102.Here optical element can be convex lens or a convex lens group, also can use an aperture, utilizes the principle of pin-hole imaging to substitute convex lens, is that such sensitivity is low; And photoelectric sensing array 102 not only includes the Electrophotosensitive pixel cell, also should include built-in or external servo circuit, is used for the selection of each pixel cell of array of controls and the output of signal.For existing finished product photoelectric sensing array, this servo circuit all is integrated into a discrete component that can not be split with sensor array basically, does not therefore generally need additional in addition servo circuit.Even, technical manual is all arranged, on the data of optoelectronic sensor or the service manual so also need not explanation at this just in case need.The signal output part of photoelectric sensing array is coupled with the input end of photoelectric signal processing circuit 501 and is connected, the core of this photoelectric signal processing circuit is an A/D translation circuit, the characteristic that may also need the electric signal exported according to the photoelectric sensing array increases other auxiliary modulate circuits such as signal amplifier, sample-and-hold circuit.502 I/O port of the output terminal of A/D transducer and a micro controller system is connected; This micro controller system is connected with the control input end of the sensor array, the control input end of A/D transducer respectively by control line 504 simultaneously, is that controller just can synchro control photoelectric sensing array and A/D transducer operate as normal like this.Photoelectric sensing array and A/D translation circuit for different model; These ways of connecting are inequality, can only carry out the case design according to the technical manual of components and parts, also can't provide the unified structure form at this.Under this structure, each micro controller system is only controlled cover sensor-based system and an A/D transducer, so total system needs two cover subsystems of same structure to constitute at least, as the subsystem module 505 that comprises in the frame of broken lines among Fig. 5; If increase the quantity of sensor again for improving precision, then also will increase more subsystem, the module 507 shown in another frame of broken lines among the figure etc.At this moment, total system will inner communication interface 506, under the control of the intercommunication program of the internal non-volatile memory stored of microcontroller, is connected to each other the purpose with the synchronous working that realizes coordinating.In these subsystems, can choose or specify a subsystem wantonly is primary module, as chosen among the figure be the subsystem module that core makes up with microcontroller 502, opening up one and use all purpose communication port 503 that carries out exchanges data between the host computer of this system on this module, as the com port of standard, USB interface etc.Match with this structure, in the nonvolatile memory of this primary module inside, also will store, communicate by letter to finish, task such as more numerical evaluation with host computer than the more executable program of other modules.
Fig. 6 is a kind of mixed structure of other two kinds of versions of native system.506 boundary lines of one intercommunication interface, the first half are a kind of modes of utilizing multiway analog switch 601 with time-sharing multiplex, will overlap the input end that photoelectric sensor system is connected to the A/D transducer successively more, and other parts are identical with Fig. 5.The connected mode of this structure is that the signal output part with each cover photoelectric sensor system is connected respectively on each stationary contacts such as 602,603 of multiway analog switch, and moving contact 604 then links with the input end of A/D transducer.At this moment, the control line 605 of microcontroller also needs to link with the control input end of analog switch, controls itself and photoelectric sensor system and the work of A/D transducer synchronous coordination.At the other end of intercommunication interface 506, promptly the below of drawing then is to have used other a kind of structure to constitute multiplex system.
Here should to be be 3 attitudes output to the data output end of A/D transducer 606,607, by the chip selection signal in the control line 605, microcontroller and selected photoelectric sensor system of working and A/D transducer are linked the various piece co-ordination in the synchronization control module.Certainly, total system can select a kind of structure to make up in two kinds of forms in the drawings, and that also can anticipate just as shown in FIG. is such, is made of mixed structure.
Fig. 7 has provided the workflow diagram of Fig. 5 or system shown in Figure 6 realization the object of the invention.Why be called workflow diagram here and be not called program flow diagram,, also not necessarily in the microcontroller of system, finish fully because this workflow is not necessarily finished by a program.This is because by the Generalized Communication Interface between the host computer of system and using system, the intermediate value that obtains according to this process flow diagram work can be sent in the host computer, make full use of the strong data-handling capacity of host computer and finish part as data processing work such as numerical value calculating, thereby shorten the sense cycle of system of the present invention, improve reaction velocity.Therefore, realize the program code of above-mentioned workflow, both can all be stored in the nonvolatile memory of micro controller system, can a part be stored in the nonvolatile memory of micro controller system again, another part is stored in the nonvolatile memory of host computer, takes all factors into consideration according to the conditions such as response speed of the data-handling capacity of the employed microcontroller of system and requirement and determines concrete technical scheme.
But because microcontroller must finish some the most basic work, so some program code must be stored in the micro controller system, and these codes comprise system's control routine, are used to control photosensor arrays and the co-ordination of A/D transducer; The Flame Image Process code, wherein include one section initialization data storage code, be used to obtain and store the background signal data that the self check stage obtains from each effective unit of photoelectric sensor, also include relatively code of one piece of data, be used for signal data with current output from each effective unit of above-mentioned photosensor arrays, compare with the described corresponding background data that is stored in the data-carrier store, thereby whether touch objects is arranged and when touch objects is arranged, the outline data of the image that on photoelectric sensor, forms of touch objects, and, obtain the geometric center point of described image according to the physical size of each valid pixel in the outline data of the touch objects that has obtained and the photosensor arrays.Certainly this part code also can all or part ofly be stored in the host computer, finish identical work by host computer, but because the task amount of this part data processing is not very big, general microcontroller can be finished in a short period of time, therefore can give microcontroller and handle.Must be stored in addition in the microcontroller is communication control code, this part code is used to control described communication port, receive the steering order of host computer, and the intermediate data that this sensing and detecting system is handled, calculated, the position coordinate data of the touch objects that perhaps finally obtains in reference frame is sent to host computer by communication port.
The numerical evaluation code then can be stored within the described micro controller system, perhaps is stored within the host computer.This part code packages contains one section straight-line equation generating code, be used for data, calculate by the center of optical element and the equation of the determined straight line of geometric center in reference coordinate system of touch objects according to the geometric center point of the distance of the light-sensitive surface of aforesaid optical element and described photosensor arrays and the image that obtained; One section coordinate figure Accounting Legend Code is used for basis from the straight-line equation that at least two described photoelectric sensor systems obtain, and calculates the coordinate of touch objects in reference coordinate system.
Following index map 7 comes the workflow of illustrative system.What in fact, Fig. 7 provided also is the main program flow of all operating when all carrying out in micro controller system.After the system start-up, first step 701 is carried out operations such as self check, internal memory cleaning, begins step 702 after finishing, and obtains the data of the background signal of each photoelectric sensor system in this word modules, stores in the background database 703 in the buffer zone.The step that begins below is the current data that unit detects each valid pixel unit in every cover photoelectric sensor system with the frame exactly, finishes the operation 704 of obtaining target data, establishing target database 706.Every inswept pixel cell, flag of frame determining step 705 is judged the state of a frame end mark position, if this zone bit is 0, then returns scanning sample step 704; When a subsystem module has been finished once whole valid pixels unit, i.e. after the scanning of the frame output, the frame end mark in the register is put 1, and 705 control programs of determining step enter next procedure.Step subsequently is simple image processing operations: Target Recognition step 707 invocation target database 706, according to the output valve of the pixel cell of 706 stored, judge the position that obtains touch objects imaging on the photoelectric sensing array, and obtain the profile of this image; Further, the central point of getting image contour is " projection " point of touch objects institute reflection ray, and promptly extended line passes through the reflection ray at touch objects center by behind the optical element, with the intersection point of photoelectric sensing array.Like this, again according to known conditions, just can access d by step 708
0Perhaps d
aValue, utilize the geometric relationship that obtains previously, obtain aforesaid straight-line equation.In actual applications,, usually all can produce distortion certain, can be prefabricated,, just need do suitable compensation at this moment if obtain higher precision if optical element is made of lens or lens combination.Because this distortion is as can be known, therefore can be with reference to relevant optical principle, by table look-up, method such as calculating in real time compensates.Then, executable operations 709, judge whether this module is primary module, if primary module, then execution in step 711, that the cumulated volume module obtains and from other submodules by other straight-line equation intercommunication interface transmission, that obtain by other system, form with formula (1) makes up Simultaneous Equations, and find the solution and obtain touching the coordinate figure of (target) thing in reference coordinate system XOY, last communication step 712, above-mentioned coordinate figure is sent to host computer by Generalized Communication Interface 503, and program turns back to step 704, prepares next round-robin and begins.If this module is not a primary module, then execution in step 710, start intercom feature, and the straight-line equation that this module is obtained is sent to the primary module of setting by intercommunication interface 506, turns back to step 704 then, prepares next round-robin and begins.
If Fig. 7 is regarded as the workflow diagram of system, then need execution content and the performed action of host computer according to system of the present invention, between step 707 and 708, perhaps between 708 and 711, insert a determining step, judge whether the above-mentioned related data that system obtains is sent to the run time version of host computer.If this run time version is arranged, then with resulting before this determining step, relevant subject matter image and the preliminary result who resolves thereof of touching, be sent to host computer by Generalized Communication Interface 503, program turns back to step 704 and prepares the next circulation of beginning then; And other operations after this determining step are just transferred in the host computer and are carried out; Simultaneously, Fig. 7 kind judges whether it is the step 709 of primary module, also should transfer to and describedly before host computer transmission data, can both be sent to host computer, make host computer to finish whole data processing operations according to all the other steps of Fig. 7 to guarantee the resulting data of each submodule.Certainly, some master data, as the automatic physical size of monitoring or detect because of artificial interference each pixel cell in the background signal data that obtain, the distance D that relates to previously, the linear array in the back of starting shooting etc., only need transmission once get final product.
Fig. 8 is a kind of program flow diagram of realizing step 704 among Fig. 7, a subroutine in the promptly main working routine.Here adopted the mode of regularly interrupting to start the operation that target data is gathered.After microcontroller had responded the interrupt request 801 that timer sends, program jumped to this subroutine, at first start the counter 802 of pixel cell.Since master routine at initial phase with the pixel counter O reset, so at this moment in order to select first pixel cell in the photoelectric sensing array, counter need be added 1, then by the servo circuit in the control bus control photoelectric sensor system that illustrates previously, select first pixel the photosignal of its output to be delivered to the input end that outputs to the A/D transducer, and then hold A/D map function 803 by control bus, carry out the operation 804 of reading the real time data of this pixel after the A/D conversion by I/O subsequently.Being read this pixel cell that obtains is sent in the data comparator, after data compare operation 805, if the data that this pixel cell is exported are within the error setting value of setting, identical with the background data of this pixel in the background database, then thinking does not have the image of touch objects on this pixel, at this moment these data is abandoned not deal with; If the data of this element are outside certain error setting value in data that this pixel cell is exported and the background database 707, then thinking may have the reflection ray of touch objects on this pixel cell, and these data are delivered to target database 704.Microcontroller enters next determining step 806 then, judges whether the pixel counter has count down to the top.If the pixel counter falls to push up, then execution in step 807, with the pixel counter O reset, and at the built-in frame end mark 1 of the register cell of appointment, carry out then and interrupt returning step 807, with the pixel counter zero clearing, for next read operation is prepared, withdraw from then regularly and interrupt, turn back among the master routine; If this pixel counter does not arrive the top, then explanation also has pixel cell not by system acquisition, then directly carries out and interrupts returning step 808, and end interrupt turns back among the master routine.
Because electro-optical imaging sensors received is the reflection ray that touches subject matter institute, therefore the luminous flux by camera lens be determine can blur-free imaging key factor.Especially when the mode of using pinhole imaging system made up optical element, this problem was more outstanding.The scheme that solves has two: one is the photoelectric sensor of selecting for use sensitivity higher, and shortcoming is when surrounding environment is relatively darker, still is difficult to differentiate background and touch objects; Another is to increase lighting means.For this reason, it is selective that the present invention has also designed the technical scheme of a floor light, for selecting for use where necessary.Here two kinds of technical schemes have been announced, as Fig. 9 and shown in Figure 10.In Fig. 9, on the edge of detected surface, the light emitting diode 902 that is used for floor light is installed.901 and 902 is the photoelectric image sensor-based systems that are made of photoelectric sensing array and optical element among the figure.Second kind as shown in figure 10, is a kind of floor light scheme of light path integrated morphology.As shown in the figure, in the light-sensitive surface and the space between the optical element of the photosensor arrays in photoelectric sensor system, the prism that a cross section is installed is the right angle; A right angle face of this prism parallels with the light-sensitive surface of photosensor arrays, another right angle face is vertical with its light-sensitive surface, and the axis of this prism can parallel with the bearing of trend of photoelectric sensor linear array, axis as prism among the figure parallels with the arrangement bearing of trend of the pixel of photosensor arrays 102, also can be perpendicular with the arrangement bearing of trend of pixel.Illuminating light emitting diode is installed in prism right angle face one side vertical with light-sensitive surface, and its optical axis direction and described right angle face are perpendicular.The diode that floor light is used preferably uses infrarede emitting diode, in order to avoid the user is produced interference, and general photoelectric element is all to infrared ray responsive.And, if use infrared illumination, can also be on the mounted on surface of optical element infrared fileter, perhaps plate the infrared filtering film, so just can avoid the interference of visible light direct projection on every side or that object reflected to the detection generation.
Claims (10)
1. a photoelectric detecting and positioning system that is used for the computing machine touch-screen includes optical element, photosensor arrays, photoelectric signal processing circuit, micro controller system, it is characterized in that:
Described photosensor arrays has two covers at least, is installed in respectively on two angles of detected surface; At least include a linear array that Pixel Dimensions is known in every cover sensor array, wherein include the servo circuit of built-in or external selection that is used for each valid pixel unit of array of controls and signal output, the input end of its signal output part and photoelectric signal processing circuit is of coupled connections; Described optical element is that the distance with the light-sensitive surface of described photosensor arrays is the convex lens or the aperture of known constant; Described optical element and each self-corresponding photosensor arrays make up and have constituted photoelectric sensor system, and its position is known in reference coordinate system; Described photoelectric signal processing circuit includes the A/D translation circuit, and the input end of this A/D translation circuit and the output terminal of described photosensor arrays are of coupled connections, and its output terminal is connected with the I/O port of described micro controller system; This micro controller system is connected with the control input end of described sensor array, the control input end of A/D translation circuit respectively by control line simultaneously; And this micro controller system also has one and use the communication port of carrying out exchanges data between the host computer of this system;
At described micro controller system and use in the nonvolatile memory of host computer of this system, store a group system control routine, set of diagrams picture and handle code, one group of numerical evaluation code, a group communication control routine, and above-mentioned each known number;
Described system control routine be stored in described micro controller system within, be used to control photosensor arrays and the co-ordination of A/D translation circuit;
Described Flame Image Process code storage is within described micro controller system, include one section initialization data storage code, be used to obtain and store the background signal data that the self check stage obtains from each valid pixel unit of photosensor arrays, one piece of data is code relatively, be used for signal data with current output from each valid pixel unit of above-mentioned photosensor arrays, compare with the described corresponding background data that is stored in the data-carrier store, thereby whether touch objects is arranged and when touch objects is arranged, the outline data of the image that on photoelectric sensor, forms of touch objects, and, obtain the geometric center point of described image according to the physical size of each valid pixel in the outline data of the touch objects that has obtained and the photosensor arrays;
Described numerical evaluation code storage is within the described micro controller system or within the described host computer, include one section straight-line equation generating code, be used for data, calculate by the center of optical element and the equation of the determined straight line of geometric center in reference coordinate system of touch objects according to the geometric center point of the distance of the light-sensitive surface of aforesaid optical element and described photosensor arrays and the image that obtained; One section coordinate figure Accounting Legend Code is used for basis from the straight-line equation that at least two described photoelectric sensor systems obtain, and calculates the coordinate of touch objects in reference coordinate system;
Described communication control code, be stored within the described micro controller system, be used to control described communication port, receive the steering order of host computer, and the intermediate data that this sensing and detecting system is handled, calculated, the position coordinate data of the touch objects that perhaps finally obtains in reference coordinate system is sent to host computer by communication port.
2. photoelectric detecting and positioning system according to claim 1 is characterized in that: between described intrasystem photoelectric sensor system and the described A/D translation circuit, be of coupled connections by an analog switch; The signal output part of described every cover photoelectric sensor system is coupled with the stationary contact of analog switch and is connected, and the signal input part of A/D translation circuit and the moving contact of analog switch are of coupled connections; The control input end of analog switch is connected with the control line of described micro controller system.
3. photoelectric detecting and positioning system according to claim 1, it is characterized in that: coupled in series is connected between described intrasystem photoelectric sensor system and the described A/D translation circuit, the output port of A/D translation circuit has the data latches of 3 attitudes output, directly be connected with micro controller I/O port, and its sheet choosing end is connected with the control line of microcontroller.
4. photoelectric detecting and positioning system according to claim 1 is characterized in that: described system is made of a plurality of subsystems, and each subsystem comprises at least one cover photoelectric sensor system, an A/D translation circuit and a microcontroller subsystem; Be connected by the intercommunication interface between each microcontroller subsystem; In the nonvolatile memory in described each microcontroller subsystem, also store the described intercommunicating code of control; And at least one subsystem includes the communication port that described and host computer carry out exchanges data, and described communication control code.
5. photoelectric detecting and positioning system according to claim 1 is characterized in that: on the edge of detected surface, the light emitting diode that is used for floor light is installed also.
6. photoelectric detecting and positioning system according to claim 1 is characterized in that: in the light-sensitive surface and the space between the optical element of the photosensor arrays in described photoelectric sensor system, and the prism that a cross section is installed is the right angle; A right angle face of described prism parallels with the light-sensitive surface of photosensor arrays, and another right angle face is vertical with described light-sensitive surface, and the axis of this prism parallels with the bearing of trend of described photoelectric sensor linear array or vertical; In described prism right angle face one side vertical, light emitting diode is installed with described light-sensitive surface; This optical axis of LED direction and described right angle face are perpendicular.
7. according to claim 5 or 6 described photoelectric detecting and positioning systems, it is characterized in that: described light emitting diode is an infrarede emitting diode; And the surface at described optical element is equipped with infrared fileter, perhaps is coated with the infrared filtering film.
8. the employed Photoelectric Detection localization method of the photoelectric detecting and positioning system of a computing machine touch-screen, described photoelectric detecting and positioning system includes photosensor arrays, optical element, photoelectric signal processing circuit and micro controller system, described photosensor arrays has two covers at least, is installed in respectively on two angles of detected surface; At least include a linear array that Pixel Dimensions is known in every cover sensor array, wherein include the servo circuit of built-in or external selection that is used for each valid pixel unit of array of controls and signal output, the input end of its signal output part and photoelectric signal processing circuit is of coupled connections; Described optical element is that the distance with the light-sensitive surface of described photosensor arrays is the convex lens or the aperture of known constant; Described optical element and each self-corresponding photosensor arrays make up and have constituted photoelectric sensor system, and its position is known in reference coordinate system; Described photoelectric signal processing circuit includes the A/D translation circuit, and the input end of this A/D translation circuit and the output terminal of described photosensor arrays are of coupled connections, and its output terminal is connected with the I/O port of described micro controller system; This micro controller system is connected with the control input end of described sensor array, the control input end of A/D translation circuit respectively by control line simultaneously; And this micro controller system also has one and use the communication port of carrying out exchanges data between the host computer of this system; Described Photoelectric Detection localization method includes following steps:
(A). after microcontroller starts, by control line control photosensor arrays and A/D translation circuit, read under the situation that does not have touch objects the currency of the output of each valid pixel in described every cover photosensor arrays one by one, data storage is got up as a setting, constitutes background database;
(B). repeating step (A), obtain the currency of the output of each valid pixel in every cover photosensor arrays once more, and call the background value of corresponding pixel in the background database, compare with the currency that obtains now, if the difference between two numerical value does not exceed predefined scope, then abandon currency, continue to read and more next pixel currency and background value poor; If described difference has exceeded predefined scope, then store the currency of this pixel in addition, then continue to read and more next pixel currency and background value poor, to the last a pixel; And the currency of each pixel of being stored has in addition constituted target database.
(C). the carries out image processing code, directly or by the data in the described communication port invocation target database carry out analytical calculation, obtain the image outline of target data, and then to obtain target be that touch objects is in the pixel at the central point place of described photosensor arrays epigraph and the position on sensor array thereof;
(D). carry out the numerical value Accounting Legend Code, according to the physical location of described image center place pixel and the distance value between optical element and the photosensor arrays light-sensitive surface, calculate by the center of optical element in this chosen photoelectric sensor system and the equation of the determined straight line of geometric center in reference coordinate system of touch objects;
(E). obtain straight-line equation after uniting the every cover photoelectric sensing of parsing system, the operation of having finished above-mentioned steps of uniting, obtain the focus between each bar straight line, i.e. the coordinate figure of touch objects in described reference coordinate system;
(F). start communication port, above-mentioned coordinate figure is sent to host computer, program jumps to the next circulation of step (B) beginning then.
9. method according to claim 8, its feature also is also to include a step of regularly interrupting in step (B), this step starts the timer in the microcontroller, after timer reaches predetermined value, CPU to described microcontroller sends interrupt request, described CPU has no progeny in regularly and just begins other operations in the step (B) having responded this, and withdraws from interruption in that completing steps (B) is later.
10. method according to claim 8, its feature also are in step (C) and (D), perhaps in step (D) and (E), a step that judges whether the instruction of communicating by letter with described host computer are arranged; If described communication instruction is arranged, then start communication port, with the result who obtains after the rapid execution of corresponding previous step, and above-mentioned background database and described various known number, be sent to host computer, wherein background database and known number only transmit when transmitting for the first time, and program jumps to the next circulation of step (B) beginning then; If there is not above-mentioned communication instruction, then described microcontroller continues to carry out in order next procedure.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2003101129191A CN100498675C (en) | 2003-12-26 | 2003-12-26 | Photoelectric detection positioning system and method for touch panel of computer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2003101129191A CN100498675C (en) | 2003-12-26 | 2003-12-26 | Photoelectric detection positioning system and method for touch panel of computer |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1635541A CN1635541A (en) | 2005-07-06 |
| CN100498675C true CN100498675C (en) | 2009-06-10 |
Family
ID=34843361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2003101129191A Expired - Fee Related CN100498675C (en) | 2003-12-26 | 2003-12-26 | Photoelectric detection positioning system and method for touch panel of computer |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100498675C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101907966A (en) * | 2010-07-29 | 2010-12-08 | 薛家祥 | Touch screen correction method and touch screen human-computer interface system of digitized arc welding power supply |
Families Citing this family (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102007021537B4 (en) | 2006-12-13 | 2020-01-02 | Lg Display Co., Ltd. | Display unit with multi-touch detection function |
| CN101118314B (en) * | 2007-07-31 | 2010-08-11 | 北京汇冠新技术股份有限公司 | Light path system detecting touch article coordinate using MEMS microscope |
| CN101373416B (en) * | 2007-08-23 | 2012-04-18 | 介面光电股份有限公司 | Resistance type touching control panel controller structure and method for discriminating and operating multi-point coordinates |
| KR101365776B1 (en) * | 2008-04-08 | 2014-02-20 | 엘지디스플레이 주식회사 | Multi-touch system and driving method thereof |
| CN101344827A (en) * | 2008-08-22 | 2009-01-14 | 李兴文 | Optical touch screen and touch pen |
| TWI397846B (en) | 2008-09-30 | 2013-06-01 | Au Optronics Corp | Detecting method for a touch panel |
| WO2010072028A1 (en) * | 2008-12-24 | 2010-07-01 | Hong Kong Applied Science And Technology Research Institute Co. , Ltd | Touch surface and system and method of detecting touch input |
| CN104536621B (en) * | 2009-03-25 | 2018-01-23 | 上海聚然智能科技有限公司 | A kind of dual camera touch system and application thereof |
| CN101847058B (en) * | 2009-03-25 | 2015-03-25 | 上海本星电子科技有限公司 | Optical touch screen convenient for installation and application thereof |
| CN104536624B (en) * | 2009-03-25 | 2018-02-27 | 上海聚然智能科技有限公司 | Optical touch screen systems provided with calibration function |
| CN101847060B (en) | 2009-03-27 | 2012-10-10 | 联想(北京)有限公司 | Optical touch system and optical touch positioning method |
| CN101859189B (en) * | 2009-04-08 | 2012-05-09 | 联想(北京)有限公司 | Optical input system and method |
| CN103793108B (en) * | 2009-08-17 | 2017-05-31 | 上海科斗电子科技有限公司 | Touch-screen and supporting felt pen |
| CN103399671B (en) * | 2009-08-17 | 2017-11-21 | 上海科斗电子科技有限公司 | Double-camera touch screen system and its felt pen |
| CN103399672B (en) * | 2009-08-17 | 2016-10-05 | 上海科斗电子科技有限公司 | Optical touch screen system and felt pen combined system |
| CN103399673B (en) * | 2009-08-17 | 2016-12-28 | 上海科斗电子科技有限公司 | Contact felt pen and supporting touch-screen system thereof |
| CN103235656B (en) * | 2009-08-17 | 2016-01-20 | 上海聚然智能科技有限公司 | Remote touch pen and supporting touch-screen system thereof |
| TWM379764U (en) * | 2009-08-19 | 2010-05-01 | Pixart Imaging Inc | Light guide module and optical touch module |
| CN102023754B (en) * | 2009-09-11 | 2013-03-20 | 联想(北京)有限公司 | Electronic equipment |
| CN102073400B (en) * | 2009-11-23 | 2012-11-28 | 广达电脑股份有限公司 | Image-based coordinate input device and method by utilizing temporarily stored images |
| US8558804B2 (en) * | 2009-12-14 | 2013-10-15 | Silicon Motion, Inc. | Touch control apparatus and touch point detection method |
| CN102163106B (en) * | 2010-02-23 | 2015-05-20 | 慧荣科技股份有限公司 | Touch sensing device and touch point detection method |
| CN101882032B (en) * | 2010-07-02 | 2013-04-17 | 廖明忠 | Handwriting input method, device and system and receiver |
| US20120105373A1 (en) * | 2010-10-31 | 2012-05-03 | Chih-Min Liu | Method for detecting touch status of surface of input device and input device thereof |
| CN202275384U (en) * | 2011-04-08 | 2012-06-13 | 香港应用科技研究院有限公司 | Integrated sensing module |
| TWI461993B (en) * | 2012-05-25 | 2014-11-21 | Wistron Corp | Optical touch module and method for determining gestures thereof and computer-readable medium |
| CN103677436A (en) * | 2012-09-05 | 2014-03-26 | 原相科技股份有限公司 | Optical touch system and optical touch method |
| CN103294297B (en) * | 2012-10-11 | 2016-04-20 | 上海天马微电子有限公司 | Signal transacting and pre-amplification circuit and touch-screen |
| CN106095202B (en) * | 2016-08-23 | 2023-04-18 | 台州安奇灵智能科技有限公司 | Cloud plate for positioning pen point track by using two linear array type image sensors |
| CN109459854A (en) * | 2018-10-31 | 2019-03-12 | 歌尔科技有限公司 | For wearing the control method for showing equipment, device and wearing display equipment |
| CN112905064B (en) * | 2021-03-19 | 2022-10-11 | 四川仪岛科技有限公司 | Photoelectric touch positioning method, touch screen and application thereof |
-
2003
- 2003-12-26 CN CNB2003101129191A patent/CN100498675C/en not_active Expired - Fee Related
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101907966A (en) * | 2010-07-29 | 2010-12-08 | 薛家祥 | Touch screen correction method and touch screen human-computer interface system of digitized arc welding power supply |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1635541A (en) | 2005-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100498675C (en) | Photoelectric detection positioning system and method for touch panel of computer | |
| JP3148393U (en) | Optical movement trajectory detection module | |
| JP4442877B2 (en) | Coordinate input device and control method thereof | |
| CN1329805C (en) | Coordinate input apparatus and its control method | |
| CN101630213B (en) | Optical touch screen, optical touch screen light source and touch pen | |
| CN102169394B (en) | Multiple-input touch panel and method for gesture recognition | |
| CN101963848B (en) | Method for determining if target point belong to plane, mouse and touch screen | |
| WO2009121638A1 (en) | System and a method for tracking input devices on lc-displays | |
| US20110261016A1 (en) | Optical touch screen system and method for recognizing a relative distance of objects | |
| CN102063230B (en) | Optical imaging touch sensing system and imaging method | |
| CN102232209A (en) | Stereo optical sensors for resolving multi-touch in a touch detection system | |
| CN102184056A (en) | Method and device for identifying multiple touch points | |
| CN101763198B (en) | Back projection type multi-point touch positioning method | |
| CN202948405U (en) | Optical sensing type keyboard | |
| US20120138771A1 (en) | Reflecting optical detecting device and electronic apparatus provided with the same | |
| CN100590578C (en) | Human-machine interaction input device and input method | |
| CN101825970B (en) | Tracking method and tracking system of touch-control points | |
| CN103076925B (en) | Optical touch control system, optical sensing module and How It Works thereof | |
| CN102193687A (en) | Multipoint touch screen interactive system based on LABVIEW | |
| CN202995627U (en) | Optic sensing input device | |
| CN1674042A (en) | Contact screen information inputting positioning method based on image recognition | |
| CN101504580A (en) | Optical touch screen and its touch pen | |
| CN103064560B (en) | A kind of multi-point touch panel | |
| Hofer et al. | MightyTrace: multiuser tracking technology on lc-displays | |
| CN102298471A (en) | Optical touch screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP01 | Change in the name or title of a patent holder |
Address after: M8, building 4, block 1, Jiuxianqiao East Road, Chaoyang District, Beijing, Patentee after: Beijing UNITOP New Technology Co., Ltd. Address before: M8, building 4, block 1, Jiuxianqiao East Road, Chaoyang District, Beijing, Patentee before: UNITOP New Technology Co., Ltd. |
|
| DD01 | Delivery of document by public notice |
Addressee: Liu Jianjun Document name: Notice of termination of patent right |
|
| DD01 | Delivery of document by public notice | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090610 Termination date: 20201226 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |