CN101251784B - Laser pen indication and luminescent spot track recognizing method - Google Patents
Laser pen indication and luminescent spot track recognizing method Download PDFInfo
- Publication number
- CN101251784B CN101251784B CN2008100355446A CN200810035544A CN101251784B CN 101251784 B CN101251784 B CN 101251784B CN 2008100355446 A CN2008100355446 A CN 2008100355446A CN 200810035544 A CN200810035544 A CN 200810035544A CN 101251784 B CN101251784 B CN 101251784B
- Authority
- CN
- China
- Prior art keywords
- point
- luminous point
- track
- luminous
- straight line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The present invention discloses a laser pen indicating and light spot trajectory identification method which belongs to the interactive reorganization technical field. Step 1, according to laser pen indicating information, a user obtains video information of a display screen from a video input device; step 2, an embedded device extracts light spots from the acquired video information, and determines the positions of the light spots after a de-noising process; step 3, the position coordinates of the light spots are transmitted to a computer which controls a target screen; step 4, according to the position coordinates of the light spots, the computer which controls the target screen recognizes the light spot trajectory; with the specific light spot information, the trajectory information indicated by the user is obtained; when the recognition is succeeded, step 5 is carried out; step 5, after the trajectory recognition is succeeded, the trajectory of the recognition result of the original trajectory is optimized, so that a new trajectory is obtained; the optimized result is displayed with visually optimized effect on the target screen to replace the indication effect of the step 3. The method can be applied in various interactive recognition display circumstances so as to carry out highly effective light spot analysis and trajectory recognition.
Description
Technical field
What the present invention relates to is a kind of method of field of photoelectric technology, and specifically, what relate to is a kind of laser pen indication and luminescent spot track recognizing method.
Background technology
In recent years, continuous change along with teaching environment, the continuous expansion of scale, learning efficiency is under some influence, so the various technology that are applied in the fairly large teaching environment are suggested in succession, on teaching screen display effect, the various intellectualized technologies that are different from the physical equipment improvement also just are widely used, and are applied to various interactive identification display environments.
Find through literature search prior art, Chinese patent application numbers 200710026848.1, patent name is " method of photoelectronic trace input replacing key-press input ", and is a kind of by optics and electronic technology identification motion track and change into numeral or literal input by program and replace a kind of input method with the button input thereby this patent has proposed.But the target screen limited size of this method applicable object, can't reach the required precision of common projection screen size, and uncertainty because of controlling object, lack general applicability, also be subject to effects limit such as distance when in large-scale interactive identification environment, using, the above-mentioned deficiency of user easily caused the difficulty that is difficult to operate.
Summary of the invention
The present invention is directed to above-mentioned the deficiencies in the prior art, a kind of laser pen indication and luminescent spot track recognizing method are provided, adopt computing machine and the mutual method of embedded device, connect by wireless network, realize the mutual of laser pen, embedded device, computing machine three, connect video capture device, obtain the light spot position of laser pen by the monochrome information of the video that obtains by embedded device, be sent to then in the computing machine, by the latter to user's bandwagon effect.The present invention can adapt to large-scale target screen, can make recognition speed reach the frame per second upper limit of common camera again, and the present invention can successfully discern the trace information of luminous point, forms the bandwagon effect of different shape, letter, numeral etc.
The present invention is achieved by the following technical solutions, may further comprise the steps:
Step 1, the user indicates information to be expressed by laser pen on display screen, obtain the video information of display screen by video input apparatus, and the video information that collects is transferred to embedded device;
Described video input apparatus is meant: the input equipment commonly used of the complete collection target screen video information of energy, as it is first-class to make a video recording, it should have higher frequency acquisition, is per second 15 frame to 25 frames.
Described target screen is meant: be used to be shown to the user and feed back the display device that the user indicates purpose, as large-scale projection screen etc.
Step 2, embedded device extracts luminous point from the screen message that collects, by judging light spot position after the denoising Processing, obtain the relative position coordinates of luminous point on display screen;
Described embedded device, be meant: the mini-system that comprises ball bearing made using that uses hardware chip and various external unit module to build, external unit module wherein is used for communicating by letter with hardware chip, finish the module of various specific tasks, comprising: memory modules, video acquisition module, network communication module etc.
Described denoising Processing is meant: eliminate the wrong light spot position that external environment causes, get rid of irregular or undue occur continually and some mutual and close on noise spots, make the result more meet user's actual indicating positions.Noise spot is to produce owing to slight jitter that user's hand takes place, thereby locational deviation is relatively limited.
Described extraction luminous point, be to extract video by embedded device, the light spot position that the marking tools that utilizes monochrome information to extract user's use indicates on the target screen, specific as follows: to each frame in the video information, line by line scan, the bright spot in the evaluating objects screen and the continuity of bright spot, and by the comparison between the row adjacent to each other, adopt the method for stack, the bright spot in the vertical direction of adjacent lines is interosculated, constitute a bright spot collection,, then should set be alternative bright spot position by isolated if certain existing bright spot collection can not find adjacent point set on the vertical direction; After the been scanned, analyze the set of all bright spots, find out and on brightness and scope, meet the general luminous point size and the single or multiple set of shape most, as final light spot position.
To different embodiment, the requirement of brightness and scope has nothing in common with each other, and to different input equipments, on the luminous point basis for estimation, also slightly have any different, therefore need some parameters to be controlled in the analytic process, comprise: the scope of the lower limit of point brilliance, luminous point size, acquisition frame rate etc., these parameters are determined by environment, adopt the method for field test to determine its scope.
The described relative position coordinates of luminous point on display screen of obtaining is specially:
The screen message that collects of order is an absolute coordinate system, target screen position therein is by four rectangle summits decisions of target screen, establish four drift angles of screen and begin to be U, V, W, X by upper left in the direction of the clock,
And the absolute position of luminous point is S, and then light spot position is with respect to following the drawing of relative coordinate of target screen:
The intersection point of straight line UV and WX is designated as P; The intersection point of straight line UW and VX is designated as Q; The intersection point of straight line PS and UW, VX is designated as u, v; The intersection point of straight line QS and UV, WX is designated as w, x;
Obtain Su: uv, two ratios of Sw: wx.
Luminous point is made of X, Y two dimension in the relative coordinate of target screen, and directions X is the product of target screen directions X resolution and Su: uv, and the Y direction is the product of target screen Y directional resolution and Sw: wx.
Step 3 is sent to the computing machine place of controlled target screen with the light spot position coordinate, and shows the effect of indication on the target screen with the form of user's appointment.
The computing machine of described controlled target screen is meant: place, target screen content displayed source, as projection screen as the target screen, computer screen is projected on this target screen, then this computing machine is the computing machine of controlled target screen.
The form of described user's appointment comprises: form such as round dot mark, line, highlighted, screen response.
The response of described screen is meant because specific application environment, and the expressed information in the position of luminous point, and the various actions of the target screen that causes comprise: window ejection, feedback information, switch, close, the mouse action of computer screen.
Step 4 according to the light spot position coordinate, is discerned luminescent spot track by the computing machine of controlled target screen, in conjunction with concrete luminous point information, obtains the indicated trace information of user, when discerning successfully, enters step 5, then institute's end in steps during failure;
Described luminescent spot track is discerned, is specially:
The first step is cut apart the luminous point information that collects in a period of time or is divided into according to dividing with frame with the time, luminous point is showed with block form, is divided into the set that becomes complete trajectory;
Describedly be divided into foundation with the time, be specially: by time period of prior appointment foundation as grouping, time period length determine by concrete applied environment demand, generally 1 to 4 second, and under letter and the digit recognition pattern 2 to 8 seconds;
Described with frame for cutting apart foundation, be specially: appear on the target screen as the grouping opening flag with light spot position, the disappearance of light spot position is as the grouping end mark, and all light spot position information that collect are therebetween carried out track identification as a group.This scheme is applicable to simple graph identification and lowercase identification.
Second step, the prior intended trajectory type of user;
In the 3rd step, carry out track identification according to luminous point group result and type of gesture, and judge whether track identification is successful.
Describedly carry out track identification according to luminous point group result and type of gesture, specific as follows:
1. graphics track identification, at first according to geometrical property, the order of strokes observed in calligraphy rule of track, from the luminous point grouping that the first step obtains, obtain commit point or decision straight line, from this luminous point grouping, take out all luminous points then, calculate the relative position relation of this luminous point and commit point or decision straight line one by one, judge in view of the above whether this luminous point grouping has represented corresponding geometric configuration.
The geometrical property of described figure is by the distance expression of luminous point to commit point or decision straight line.
Whether the order of strokes observed in calligraphy rule of described figure is meant by writing rules and decides the element appearance successively order in the luminous point set reasonable.
Described writing rules is meant: the presentation direction of system's appointment or user's request, custom etc., and as clockwise drawing, drawing counterclockwise.
The relative position relation of described calculating luminous point and commit point or decision straight line, specific as follows:
For ellipse, two focuses are commit point, relative position relation be luminous point arrive bifocal apart from sum;
For circle, the center of circle is a commit point, and relative position relation is the distance of luminous point to the center of circle;
For straight line, starting point, terminal point are commit point, and the straight line at both line places is the decision straight line, and relative position relation is the distance that luminous point arrives this decision straight line;
For broken line, comprise starting point, terminal point and middle three commit points of flex point, starting point is the decision straight line to the line of flex point and the straight line at flex point line place to terminal, relative position relation is the distance that luminous point arrives these two decision straight lines;
For rectangle and triangle, the summit is a commit point, and the straight line at each place, limit is the decision straight line, and relative position relation is that luminous point is to the distance that respectively determines straight line.
Whether described appearance order is reasonable, and it is suitable as one of foundation of discerning to be meant whether the sequencing that luminous point in the track is occurred meets geometric pen.
2. literal track identification, type of gesture comprises English lowercase, English capitalization, numeral, and is specific as follows:
The identification of English lowercase, employing is the grouping scheme of cutting apart foundation with frame, every group member represents that the user need write single letter, adopt the reverse transmittance nerve network learning method, take out all luminous points in the luminous point grouping, first luminous point is decided to be first input block, is called starting point 1, and zequin 1 is to the direction of luminous point afterwards then, when bigger variation takes place this direction, surpass 30 degree if this directions of former and later two spot calculations differs, then starting point 1 is decided to be another input block to the direction of previous luminous point, be called direction 1, a back luminous point is decided to be starting point 2, zequin 2 obtains direction 2 to the direction of luminous point afterwards then, starting point 3, and method continues to obtain direction 3 according to this, starting point 4, direction 4, starting point 5, wherein starting point 5 is called as terminal point, as last input block, obtains whole 9 input blocks; Output has 26 unit, represents 26 letters respectively;
Described reverse transmittance nerve network learning method, be meant: the method in a kind of machine learning field, be used for unknown object is classified, unknown object refers to track among the present invention, classifying, which letter refers to what analyze the track representative be, this method is by many tracks of the known classification of study, discern the track of unknown classification represented be which letter.This method is by several input blocks, several output units of the prior appointment of user, and several temporary locations constitute.Input block is each key element as classification foundation, and output unit is used to distinguish classification results, and temporary location then comprises the many parameters that are used to calculate.When learning the track of known classification, this method is adjusted the parameter of temporary location with the input and output unit of these tracks, and when unknown track discerned, only provide input block, use through the parameter of adjusting and calculate, obtain output unit, thereby judge which kind of it belongs to, be i.e. which letter.
The uppercase identification of English, employing is divided into the grouping scheme of foundation with the time, the user has at the appointed time write a letter in the section, the waiting system response, could continue to write next letter and be adopted as the reverse transmittance nerve network learning method, take out all luminous points in the luminous point grouping, first luminous point is decided to be first input block, be called starting point 1, to luminous point afterwards, how many time order and functions that calculates their 2 appearance in front and back differs, when differing above 0.3 second, then claim in these 2 to occur early be terminal point 1, occur evening then as another input block, be called starting point 2, then to the luminous point between starting point 1 and the terminal point 1, judge that they belong to the capitalization stroke of which kind of type, and this type as an input block, be called Class1, method according to this continues to obtain the input block of type 2, continuing according to this then, method obtains starting point 3, type 3, starting point 4, type 4, obtain whole 8 input blocks, the above-mentioned type 1, type 2, type 3, type 4 belongs to one of following several types respectively: horizontal line in use, vertical line, oblique line left, oblique line to the right, curve; Output has 26 equally, represents 26 letters respectively;
The identification of numeral is more easily judged by accident because of itself and lowercase, so become one type separately, its method is consistent with the English lowercase, imports identically, but is output as 10, represents 10 numerals respectively.
Step 5 after track identification success, is carried out the track optimizing of recognition result to initial trace, obtains new track, and the result who optimizes is optimized the effect demonstration with vision on the target screen, thus the indicating effect of alternative steps three.
Described initial trace is meant the track by video acquisition and the light spot position that obtains.
The described track optimizing that carries out recognition result, be specially: after the track identification success, initial trace is performed an analysis, to in it and the bigger part of recognition result difference, make amendment according to recognition result, obtain new track, near the normalized form of recognition result, normalized form is meant the standard drafting form of graphics track, the block letter form or the handwritten form form of literal track on visual effect.
Compared with prior art, the present invention has following beneficial effect: the present invention can enrich teaching environment, offers the teaching pattern of a kind of renewal of teacher, can make teacher's teaching more coherent and free; In other environment, by long-range indication characteristic, various human-computer interaction devices can be modified to long-range indicative equipment, avoid the direct contact screen of manpower, improve equipment dependability.The present invention then uses these extras of camera, use embedded device and calculate light spot position, both costs are all relatively low, display device then there is not too much requirement, only needing to use laser pen to stay luminous point on equipment gets final product, can not produce extra consume to display device, employed in addition laser pen is very nearly the same with various writing pencils on cost, adds up overall cost and is less than 1/10th of touch equipment.
Description of drawings
Fig. 1 is the workflow diagram of the inventive method;
Fig. 2 is the enforcement scene graph of embodiments of the invention.
Embodiment
Below in conjunction with accompanying drawing embodiments of the invention are elaborated: present embodiment is being to implement under the prerequisite with the technical solution of the present invention, provided detailed embodiment and concrete operating process, but protection scope of the present invention is not limited to following embodiment.
Present embodiment is used to discern the teacher and indicates on display screen by laser pen.
As shown in Figure 1, present embodiment comprises the steps:
Step 1, user indicate light spot position by laser pen on display screen, and give expression to trace informations such as figure, literal by a plurality of light spot positions, obtain the video information of target screen by video input apparatus, and the video information that collects is transferred to embedded device;
Described laser pen, it is a kind of form of a stroke or a combination of strokes marking tools that can launch invisible light, it has a plurality of buttons for devices communicatings such as user and computing machines, infrared communication or twireless radio-frequency communication are used in this communication, the coverage of infrared communication is 15 meters, the coverage of twireless radio-frequency communication can surpass 25 meters, and the indication of invisible light distance is more than 200 meters.
Step 2, embedded device extract luminous point from the screen message that collects, by denoising Processing post analysis light spot position, finally obtain the relative position coordinates of luminous point on display screen;
The described luminous point that obtains, be meant: extract video by embedded device, the light spot position that the marking tools that utilizes monochrome information to extract user's use indicates on the target screen, specific as follows: to each frame in the video information, line by line scan, whether the brightness according to each picture element reaches lower limit, obtain the bright spot in the target screen and the continuity of bright spot, and by the comparison between the row adjacent to each other, adopt the method for stack, the bright spot in the vertical direction of adjacent lines is interosculated, constitute a bright spot collection, if certain existing bright spot collection can not find adjacent point set on such vertical direction, then should set be alternative bright spot position by isolated.After the been scanned, analyze all bright spot set, find out the single or multiple set that on scope, meet the parameter setting, as final light spot position.
In the present embodiment, the lower limit of point brilliance is set to 200, and unit is a gray scale, and the luminous point magnitude range is set to rectangular extent, and minimum is 3 * 3, is 15 * 15 to the maximum, and unit is a pixel.Test result shows, uses the video input apparatus of frequency acquisition per second 25 frames, and the process computing velocity of said extracted luminous point reaches more than per second 20 frames.
Step 3, the light spot position coordinate is sent to the computing machine place of controlled target screen, with the form expression effect of user's appointment, these effects mainly comprise on the target screen: use dot luminous point place mark, light spot position by successively with line connect, mouse moves to luminous point place, mouse fill order double click operation etc.
Step 4, luminescent spot track identification: according to 16 to 512 light spot position coordinates, the track on the simulated target screen, when discerning successfully, the indicating effect with track replacement step 3 does not then replace during failure.
Track on the described simulated target screen is meant: analyze the indicated trace information of user that draws the luminous point representative.Luminescent spot track identification comprises the steps:
The first step, the grouping of luminous point;
The grouping of described luminous point is meant that the luminous point information that will collect in a period of time was cut apart with the time or is divided into according to dividing with frame that luminous point is divided into becomes the set of complete trajectory.
Describedly be divided into foundation with the time, be specially: by time period of prior appointment foundation as grouping, time period length is determined by concrete applied environment demand, generally 1 to 4 second, following the 3rd the step in letter and the digit recognition pattern under 2 to 8 seconds, this scheme advantage is that the software resource occupancy is little;
Described with frame for cutting apart foundation, be specially: appear on the target screen as the grouping opening flag with light spot position, the disappearance of light spot position is as the grouping end mark, and all light spot position information that collect are therebetween carried out track identification as a group.In the present embodiment, this scheme is applicable to simple graph identification and the lowercase identification in following the 3rd step, and its advantage is that continuity is stronger, and is higher at continuity track identification rate.
Second step, the prior intended trajectory type of user.Can send the order of intended trajectory type to the computing machine of controlled target screen by the button on the laser pen.In the present embodiment test, specified type is than not improving nearly 30% accuracy rate under the specified type situation in advance in advance;
The 3rd step, the identification track: according to the type of gesture of the prior appointment of user, and the luminous point group result, analyze track, confirm whether to discern the track success.Described analysis track is meant: by software analysis, and the track of affirmation or basic confirmation luminous point set representative, or do not represent any track, specific as follows:
When 1. graphics track is discerned, the geometrical property of systematic analysis track, order of strokes observed in calligraphy rule, the figure of common its representative of decision, the geometrical property of figure is by the distance expression of luminous point to commit point or decision straight line, and whether the order of strokes observed in calligraphy rule of figure is meant by writing rules and decides the element appearance successively order in the luminous point set reasonable; System is at first by the geometrical property of shape, from the luminous point grouping that the first step obtains, obtain commit point or decision straight line, from this luminous point grouping, take out all luminous points then, calculate the relative position relation of they and commit point or decision straight line one by one, judge in view of the above whether this luminous point grouping has represented corresponding geometric configuration.
Described commit point or decision straight line, and relative position relation are meant:
Oval: two focuses are commit point, relative position relation: luminous point to bifocal apart from sum;
Circle: the center of circle is a commit point, relative position relation: luminous point is to the distance in the center of circle;
Straight line: starting point, terminal point are commit point, and the straight line at both line places is the decision straight line, relative position relation: luminous point is to the distance of this decision straight line;
Broken line: it comprises starting point, terminal point and middle three commit points of flex point, and starting point to the line of flex point and the straight line at flex point line place to terminal is the decision straight line, relative position relation: luminous point is to the distance of these two decision straight lines;
Rectangle and triangle: the summit is a commit point, and the straight line at each place, limit is the decision straight line, relative position relation: luminous point is to the distance of each decision straight line.
Described writing rules is meant: the presentation direction of system's appointment or user's request, custom etc., and as clockwise drawing, drawing counterclockwise.
Whether described appearance order is reasonable, and it is suitable as one of foundation of discerning to be meant whether the sequencing that luminous point in the track is occurred meets geometric pen.
2. during the literal track identification, because of the complicacy of literal, system decides identifying schemes by type of gesture, and common type of gesture and identifying schemes are specific as follows:
The identification of English lowercase, employing is the grouping scheme of cutting apart foundation with frame, every group member represents that the user need write single letter, identifying schemes is the reverse transmittance nerve network learning method, characteristic by lowercase, the input of this identifying schemes has 9, take out all luminous points in the luminous point grouping, first luminous point is decided to be first input block, is called starting point 1, and zequin 1 is to the direction of luminous point afterwards then, when bigger variation takes place this direction, for example this direction of former and later two spot calculations differs and surpasses 30 degree, then starting point 1 is decided to be another input block to the direction of previous luminous point, is called direction 1, a back luminous point is decided to be starting point 2, zequin 2 obtains direction 2 to the direction of luminous point afterwards then, starting point 3, and method continues to obtain direction 3 according to this, starting point 4, direction 4, starting point 5, wherein starting point 5 is called as terminal point, as last input block, obtains whole 9 input blocks like this; Output has 26 unit, represents 26 letters respectively.
The grouping scheme that is divided into foundation with the time is adopted in the uppercase identification of English, and the user has at the appointed time write a letter in the section, and the waiting system response could continue to write next letter.Identifying schemes also is the reverse transmittance nerve network learning method.According to uppercase characteristics, here regulation input has 8, takes out all luminous points in the luminous point grouping, and first luminous point is decided to be first input block, be called starting point 1, to luminous point afterwards, how many time order and functions that calculates their 2 appearance in front and back differs, when differing big, for example above 0.3 second, then claim in these 2 to occur early be terminal point 1, occur laterly then as another input block, be called starting point 2.To the luminous point between starting point 1 and the terminal point 1, judge that they belong to the capitalization stroke of which kind of type then, and this type as an input block, be called Class1.Method continues to obtain the input block that another is called type 2 according to this, continues then according to this that method obtains starting point 3, type 3, starting point 4, type 4, obtains whole 8 input blocks like this.Here the capitalization stroke type of being mentioned, i.e. Class1, type 2, type 3, type 4, they are judged as respectively in use and belong to one of following several types: horizontal line, vertical line, oblique line, oblique line, curve to the right left; Output has 26 equally, represents 26 letters respectively.
Through the test of 10 letters, when the user write size when reaching at least 64 * 64 screen pixel size, the test accuracy surpasses 95%.
The identification of numeral is more easily judged by accident because of itself and lowercase, so become one type separately, its method is consistent with the English lowercase, imports identically, but is output as 10, represents 10 numerals respectively.
Step 5, the track optimizing of recognition result: under the track identification case of successful, the result is optimized effect with vision show on the target screen, thus the indicating effect of alternative steps three.The track of finally finishing on the target screen shows, reaches the desirable indicating effect to the target screen of teacher, as punctuates, directly writes simple graph literal etc.
Described with the demonstration of vision optimization effect, be meant: after the track identification success, initial trace is performed an analysis, to in it and the bigger part of recognition result difference, make amendment according to recognition result, obtain new track, thus on visual effect near the normalized form of recognition result, wherein initial trace is meant the track by video acquisition and the light spot position that obtains, and normalized form is meant that the standard of graphics track draws the block letter form or the handwritten form form of form, literal track.
Said process was finished in 1 to 3 second time.
As shown in Figure 2, be the application of present embodiment in large-scale teaching environment, wherein use and meet the camera of per second 25 frame frequency acquisition requirements as video capture device, it connects embedded device, embedded device is responsible for obtaining the position that shows luminous point and being converted to screen coordinate, the teaching of use main frame of giving lessons is connected by wireless network with embedded device and communicates, track identification carried out by this main frame and effect screen shows, also be responsible for track optimizing simultaneously, this is given lessons and by projector screen message is projected to the target screen with main frame.Use laser pen as marking tools, laser pen also is connected by wireless network with embedded device, and the user can use startup, the termination of the button control total system on the laser pen, and button also is used for prior intended trajectory type.
The present embodiment method can make full use of the performance of existing video capture device, and analysis speed can reach the ordinary video collecting device recognition speed of high acquisition frame rate, and can overcome original marking tools can not remotely-indicated shortcoming; Under remotely-indicated demand, calculating the light spot position that obtains can accomplish: on each common display screen of about 2 meters of length and width, the position maximum disparity that light spot position that naked eyes are seen and calculating obtain is less than 5 centimetres, the mean difference distance is less than 3 centimetres, that is to say 1.5% of screen length and width, the sensation that does not have obvious deviation during use, and the speed of calculating can reach per second 20 to 25 frames, very smooth during use; Aspect track identification, all type of gesture are added up accuracy rate together: to the type of gesture of the prior appointment of user, if user's indication itself does not meet any track that this kind type of gesture is comprised, then the present embodiment method has the probability about 97% to assert that it does not meet track, if user's indication is judged a certain track that meets wherein from naked eyes, then the present embodiment method can assert under 95% situation that it meets track.
Claims (10)
1. a laser pen is indicated and luminescent spot track recognizing method, it is characterized in that, may further comprise the steps:
Step 1, the user indicates information to be expressed by laser pen on display screen, obtain the video information of display screen by video input apparatus, and the video information that collects is transferred to embedded device;
Step 2, embedded device extracts luminous point from the video information that collects, by judging light spot position after the denoising Processing, obtain the relative position coordinates of luminous point on display screen;
Step 3 is sent to the computing machine place of controlled target screen with the light spot position coordinate, and shows the effect of indication on the target screen with the form of user's appointment;
Step 4 according to the light spot position coordinate, is discerned luminescent spot track by the computing machine of controlled target screen, in conjunction with concrete luminous point information, obtains the indicated trace information of user, when discerning successfully, enters step 5, then institute's end in steps during failure;
Described luminescent spot track is discerned is meant:
The first step is cut apart the luminous point information that collects in a period of time or is divided into according to dividing with frame with the time, luminous point is showed with block form, is divided into the set of complete trajectory;
Second step, the prior intended trajectory type of user;
In the 3rd step, carry out track identification according to luminous point group result and type of gesture, and judge whether track identification is successful;
Step 5 after track identification success, is carried out the track optimizing of recognition result to initial trace, obtains new track, and the result who optimizes is optimized the effect demonstration with vision on the target screen, thus the indicating effect of alternative steps three.
2. laser pen indication according to claim 1 and luminescent spot track recognizing method, it is characterized in that, described extraction luminous point, be to extract video by embedded device, the light spot position that the marking tools that utilizes monochrome information to extract user's use indicates on the target screen, specific as follows: to each frame in the video information, line by line scan, the bright spot in the evaluating objects screen and the continuity of bright spot, and by the comparison between the row adjacent to each other, adopt the method for stack, the bright spot in the vertical direction of adjacent lines is interosculated, constitute a bright spot collection, if certain existing bright spot collection can not find the adjacent point set on the vertical direction, then this bright spot collection is isolated and is alternative bright spot position; After the been scanned, analyze the set of all bright spots, find out and on brightness and scope, meet the general luminous point size and the single or multiple set of shape most.
3. laser pen indication according to claim 1 and luminescent spot track recognizing method is characterized in that described denoising Processing is meant: eliminate the wrong light spot position that external environment causes, the noise spot that eliminating is produced by the slight jitter of user's hand generation.
4. laser pen indication according to claim 1 and luminescent spot track recognizing method is characterized in that the described relative position coordinates of luminous point on display screen of obtaining is specially:
The screen message that collects of order is an absolute coordinate system, target screen position therein is by four rectangle summits decisions of target screen, establish four drift angles of screen and begin to be U, V, W, X by upper left in the direction of the clock,
And the absolute position of luminous point is S, and then light spot position is with respect to following the drawing of relative coordinate of target screen:
The intersection point of straight line UV and WX is designated as P; The intersection point of straight line UW and VX is designated as Q; The intersection point of straight line PS and UW, VX is designated as u, v; The intersection point of straight line QS and UV, WX is designated as w, x;
Obtain Su: uv, two ratios of Sw: wx,
Luminous point is made of X, Y two dimension in the relative coordinate of target screen, and directions X is the product of target screen directions X resolution and Su: uv, and the Y direction is the product of target screen Y directional resolution and Sw: wx.
5. laser pen according to claim 1 indication and luminescent spot track recognizing method is characterized in that, describedly are divided into foundation with the time, are specially: by time period of prior appointment foundation as the luminous point grouping, time period length is determined by concrete applied environment demand.
6. laser pen indication according to claim 5 and luminescent spot track recognizing method is characterized in that, time period length is replaced by by concrete applied environment demand decision, is 2 seconds to 8 seconds under English capitalization and the digit recognition pattern.
7. laser pen indication according to claim 1 and luminescent spot track recognizing method, it is characterized in that, described with frame for cutting apart foundation, be specially: appear on the target screen as the grouping opening flag with light spot position, the disappearance of light spot position is as the grouping end mark, all light spot position information that collect are therebetween carried out track identification as a group, are used for simple graph identification and lowercase identification.
8. laser pen according to claim 1 indication and luminescent spot track recognizing method is characterized in that, describedly carry out track identification according to luminous point group result and type of gesture, and be specific as follows:
1. graphics track identification, at first according to geometrical property, the order of strokes observed in calligraphy rule of track, from the luminous point grouping that the first step obtains, obtain commit point or decision straight line, from this luminous point grouping, take out all luminous points then, calculate the relative position relation of this luminous point and commit point or the relative position relation of luminous point and decision straight line one by one, judge the geometric configuration of this luminous point grouping in view of the above;
2. literal track identification, type of gesture comprises English lowercase, English capitalization and numeral, it is the grouping scheme of cutting apart foundation that the identification of English lowercase is adopted with frame, the grouping scheme that is divided into foundation with the time is adopted in the uppercase identification of English, and the identification of numeral is identical with the English lowercase.
9. laser pen indication according to claim 8 and luminescent spot track recognizing method is characterized in that, the relative position relation of the relative position relation of described calculating luminous point and commit point or luminous point and decision straight line is specific as follows:
For ellipse, two focuses are commit point, relative position relation be luminous point arrive bifocal apart from sum;
For circle, the center of circle is a commit point, and relative position relation is the distance of luminous point to the center of circle;
For straight line, starting point, terminal point are commit point, and the straight line at both line places is the decision straight line, and relative position relation is the distance that luminous point arrives this decision straight line;
For broken line, comprise starting point, terminal point and middle three commit points of flex point, starting point is respectively the decision straight line to the line of flex point and the straight line at flex point line place to terminal, and relative position relation is that luminous point arrives the distance of starting point to the line of flex point and luminous point to flex point line to terminal;
For rectangle and triangle, the summit is a commit point, and the straight line at each place, limit is the decision straight line, and relative position relation is that luminous point is to the distance that respectively determines straight line.
10. laser pen indication according to claim 8 and luminescent spot track recognizing method is characterized in that the literal track identification is meant:
The identification of English lowercase, employing is the grouping scheme of cutting apart foundation with frame, every group member represents that the user need write single letter, adopt the reverse transmittance nerve network learning method, take out all luminous points in the luminous point grouping, first luminous point is decided to be first input block, is called starting point 1, and zequin 1 is to the direction of luminous point afterwards then, when bigger variation takes place this direction, surpass 30 degree if this directions of former and later two spot calculations differs, then starting point 1 is decided to be another input block to the direction of previous luminous point, be called direction 1, a back luminous point is decided to be starting point 2, zequin 2 obtains direction 2 to the direction of luminous point afterwards then, starting point 3, and method continues to obtain direction 3 according to this, starting point 4, direction 4, starting point 5, wherein starting point 5 is called as terminal point, as last input block, obtains whole 9 input blocks; Output has 26 unit, represents 26 letters respectively;
The uppercase identification of English, employing is divided into the grouping scheme of foundation with the time, the user has at the appointed time write a letter in the section, the waiting system response, could continue to write next letter, be adopted as the reverse transmittance nerve network learning method, take out all luminous points in the luminous point grouping, first luminous point is decided to be first input block, be called starting point 1, to luminous point afterwards, how many time order and functions that calculates their 2 appearance in front and back differs, when differing above 0.3 second, then claim in these 2 to occur early be terminal point 1, occur evening then as another input block, be called starting point 2, then to the luminous point between starting point 1 and the terminal point 1, judge that they belong to the capitalization stroke of which kind of type, and this type as an input block, be called Class1, method according to this, continue to obtain the input block of type 2, continuing according to this then, method obtains starting point 3, type 3, starting point 4, type 4 obtains whole 8 input blocks, the above-mentioned type 1, type 2, type 3, type 4 belongs to one of following several types respectively: horizontal line in use, vertical line, oblique line left, oblique line to the right, curve; Output has 26 equally, represents 26 letters respectively;
The identification of numeral, its recognition methods is identical with the English lowercase, imports also identically, is output as 10, represents 10 numerals respectively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100355446A CN101251784B (en) | 2008-04-03 | 2008-04-03 | Laser pen indication and luminescent spot track recognizing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100355446A CN101251784B (en) | 2008-04-03 | 2008-04-03 | Laser pen indication and luminescent spot track recognizing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101251784A CN101251784A (en) | 2008-08-27 |
| CN101251784B true CN101251784B (en) | 2010-06-30 |
Family
ID=39955191
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008100355446A Expired - Fee Related CN101251784B (en) | 2008-04-03 | 2008-04-03 | Laser pen indication and luminescent spot track recognizing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101251784B (en) |
Families Citing this family (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101937286B (en) * | 2009-06-29 | 2013-01-02 | 比亚迪股份有限公司 | Light pen track identification system and method |
| CN101604222A (en) * | 2009-07-17 | 2009-12-16 | 程宇航 | A kind of input equipment of computer graphic user interface and method |
| CN102279668B (en) * | 2010-06-08 | 2014-12-10 | 株式会社理光 | Information interaction method and system |
| CN102455825B (en) * | 2010-10-25 | 2016-03-30 | 中山市云创知识产权服务有限公司 | Multimedia brief report indication system and method |
| CN103443756A (en) * | 2011-03-09 | 2013-12-11 | 国誉株式会社 | Presentation system |
| CN102184053A (en) * | 2011-04-15 | 2011-09-14 | 深圳市华测检测技术股份有限公司 | Novel projector unit |
| CN102760011B (en) * | 2011-04-28 | 2016-06-29 | 东友科技股份有限公司 | The interactive approach of interactive projection system and optical projection system |
| CN102937831A (en) * | 2011-08-15 | 2013-02-20 | 王秉劼 | Interactive electronic sand table gesture recognition method |
| CN102612205B (en) | 2011-12-31 | 2014-12-31 | 华为技术有限公司 | Method for controlling visual light sources, terminals and video conference system |
| CN102707817B (en) * | 2012-04-24 | 2015-09-30 | 广州市唯昕电子科技有限公司 | Laser inscription system |
| CN102789335B (en) * | 2012-07-11 | 2015-07-08 | 广东威创视讯科技股份有限公司 | Processing method of touch writing track |
| CN103049105A (en) * | 2012-11-26 | 2013-04-17 | 苏州佳世达光电有限公司 | Optical pen and interactive projection system utilizing same |
| CN103076969A (en) * | 2012-12-27 | 2013-05-01 | 天津三星通信技术研究有限公司 | Input system for mobile terminal display screen and control method thereof |
| KR101258910B1 (en) * | 2013-02-07 | 2013-04-29 | (주)유한프리젠 | Method of writing on screen by laser pointer in presentation system |
| CN103268170A (en) * | 2013-04-26 | 2013-08-28 | 国家电网公司 | Positioning device and positioning method for forming and outputting continuous coordinates by aid of pointed positions of image identification laser pointer |
| CN103488355B (en) * | 2013-10-16 | 2016-08-17 | 广东威创视讯科技股份有限公司 | A kind of video window deployment method and system, laser pen |
| CN104898824B (en) * | 2014-03-07 | 2018-07-06 | 联想(北京)有限公司 | A kind of method and multimedia equipment in localizing emission source |
| CN104346126B (en) * | 2014-10-31 | 2017-04-05 | 京东方科技集团股份有限公司 | Method, method for displaying image and system that image is shown in real time with mobile spot |
| CN104464448B (en) * | 2015-01-06 | 2016-11-30 | 京东方科技集团股份有限公司 | Laser pen track record drive circuit and method, display device and driving method thereof, laser pen track record control system and method |
| CN105808023B (en) * | 2016-03-14 | 2019-01-29 | 青岛海信电器股份有限公司 | A kind of recognition methods of touch point and infrared touch device |
| CN106095139B (en) * | 2016-05-30 | 2018-10-12 | 安徽慧视金瞳科技有限公司 | A method of it promoting lines in projecting interactive system and draws speed |
| CN106446222B (en) * | 2016-09-29 | 2019-07-09 | 南京仁光电子科技有限公司 | The method of token name is reused in touch-control system |
| CN106598288A (en) * | 2016-11-22 | 2017-04-26 | 张新民 | Positioning system and method for laser pen mouse |
| CN106951891B (en) * | 2017-03-21 | 2020-04-24 | 北京中安未来科技有限公司 | Light spot detection method and device |
| CN107256631A (en) * | 2017-08-08 | 2017-10-17 | 南京英斯特网络科技有限公司 | A kind of track of vehicle data aggregate operation method |
| CN107589930A (en) * | 2017-09-05 | 2018-01-16 | 北京仁光科技有限公司 | Multi-screen control system and method |
| CN107894421B (en) * | 2017-10-25 | 2020-07-03 | 共享铸钢有限公司 | Method for detecting and marking defects of castings by combining photogrammetric system and light pen measuring system |
| CN108415587B (en) * | 2018-04-04 | 2021-05-11 | 新昌县水帘峡市政园林有限公司 | Remote control device for drawing line and drawing line generating method |
| CN108941942B (en) * | 2018-09-06 | 2023-09-22 | 广西中科蓝谷半导体科技有限公司 | Use method of small workpiece fixture of photoetching machine |
| DE102018125266B3 (en) * | 2018-10-12 | 2019-11-28 | Fachhochschule Bielefeld | Method and robot system for entering a workspace |
| CN110059760B (en) * | 2019-04-25 | 2021-04-30 | 北京工业大学 | Geometric figure recognition method based on topological structure and CNN |
| CN110030932B (en) * | 2019-05-24 | 2020-12-15 | 广东嘉腾机器人自动化有限公司 | AGV deviation measurement method and AGV deviation measurement device |
| CN110556030B (en) * | 2019-09-05 | 2022-06-10 | 百度在线网络技术（北京）有限公司 | Reading control method, device, equipment and computer readable storage medium |
| CN112684922B (en) * | 2021-03-11 | 2021-07-23 | 广东小天才科技有限公司 | Handwriting synchronization method, device, system, terminal equipment and storage medium |
| CN114025076B (en) * | 2022-01-10 | 2022-03-18 | 济南和普威视光电技术有限公司 | Web-based laser lens synchronous data online editing method and device |
| CN114995739A (en) * | 2022-06-15 | 2022-09-02 | 北京理工大学 | Man-machine interaction system based on laser pen track recognition and design method |
-
2008
- 2008-04-03 CN CN2008100355446A patent/CN101251784B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN101251784A (en) | 2008-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101251784B (en) | Laser pen indication and luminescent spot track recognizing method | |
| CN103809880B (en) | Man-machine interaction system and method | |
| CN104199550B (en) | Virtual keyboard operation device, system and method | |
| CN106598227A (en) | Hand gesture identification method based on Leap Motion and Kinect | |
| CN103207709A (en) | Multi-touch system and method | |
| CN103164022B (en) | Many fingers touch method and device, portable terminal | |
| CN103226387A (en) | Video fingertip positioning method based on Kinect | |
| CN103136986A (en) | Sign language identification method and sign language identification system | |
| CN102436327B (en) | Screen input system and implementation method thereof | |
| CN203012636U (en) | Man-machine interactive system based on laser projection positioning | |
| CN102819567B (en) | A kind of associated person information search method of electronic equipment and system | |
| CN102184053A (en) | Novel projector unit | |
| CN102822862A (en) | Computing device interface | |
| CN101510121A (en) | Interface roaming operation method and apparatus based on gesture identification | |
| CN102426509A (en) | Method, device and system for displaying hand input | |
| US10401947B2 (en) | Method for simulating and controlling virtual sphere in a mobile device | |
| CN104991684A (en) | Touch control device and working method therefor | |
| CN104777908A (en) | Device and method for synchronously positioning a plurality of persons | |
| Alam et al. | Implementation of a character recognition system based on finger-joint tracking using a depth camera | |
| CN103473572A (en) | Method for evaluating attractiveness of handwritten Chinese characters | |
| US11551480B2 (en) | Handwriting input apparatus, handwriting input method, program, and input system | |
| CN108628455B (en) | Virtual sand painting drawing method based on touch screen gesture recognition | |
| US9524031B2 (en) | Apparatus and method for recognizing spatial gesture | |
| CN100435075C (en) | Touch projection screen system and its realization | |
| CN107562205B (en) | Projection keyboard of intelligent terminal and operation method of projection keyboard |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100630 Termination date: 20130403 |