CN1687869A - Digital ink producing method and system for laser pen - Google Patents
Digital ink producing method and system for laser pen Download PDFInfo
- Publication number
- CN1687869A CN1687869A CN 200510069577 CN200510069577A CN1687869A CN 1687869 A CN1687869 A CN 1687869A CN 200510069577 CN200510069577 CN 200510069577 CN 200510069577 A CN200510069577 A CN 200510069577A CN 1687869 A CN1687869 A CN 1687869A
- Authority
- CN
- China
- Prior art keywords
- laser beam
- trajectory
- projection screen
- digital ink
- document
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Position Input By Displaying (AREA)
Abstract
The invention is a method and system for producing the digital ink of a laser pen, adopting a camera to capture the laser beam the laser pen emits on a projection screen, then storing these track patterns of laser beam in a mode of digital ink and inserting the track patterns in a projecting document, and finally real-timely displaying the obtained digital ink on the projection screen. The hardware of the invention comprises laser pen, camera, computer, projector and projection screen. The invention adopts a computer visual technique to detect, locate, track and obtain the tracks and shapes of the laser beam on the projection screen, adopts a document analysis algorithm and a digital ink technique to further make accurate location and shape decoration on these tracks and shapes and converts them into digital ink to insert them in the projecting document in a color transparent mode. The system can record these tracks for a long time and also store these tracks in the projecting document.
Description
Technical field
The present invention relates to a kind of digital ink generation method and generation system (10) of laser pen, it adopts a camera (11), utilize computer vision technique to catch laser pen and be transmitted in laser beam on the projection screen, preserve the track of these laser beam then with the form of digital ink, and be embedded in the used document of projection, at last the digital ink that obtains is presented at above the projection screen in real time.
Background technology
Laser pen plays important effect in activities such as electronics speech, multimedia teaching.The user in order to emphasize main points and key content, carries out corresponding mouse and keyboard operation on the computing machine of having no progeny in need not when making a speech freely; Only need to use laser pen, in projection, utilize laser to iris wipe corresponding area part and get final product.Regrettably, in actual use, those laser traces of irising wipe main points and key content are fleeting, do not stay least bit vestige; Like this, when the recipient of content did not also understand fully, what can not find keynote message in projection had emphasized the signal vestige.
In order to overcome this problem, general disposal route is, in document, the content that requires emphasis is irised wipe in advance, yet, can not reach the effect that the scene is emphasized like this; Another method, utilizing computer pen to go up at specific medium (writing board for computer and ultrasonic unit etc.) exactly irises wipe the content that requires emphasis, yet, the speaker can only be on specific medium next door, operation on one side, explanation on one side, this has limited speaker's activity, can not bring into play on-the-spot effect of freely giving a lecture.
Therefore, need a kind of technology and system, can be retained in laser pen institute emitted laser beam trajectory for a long time on the projected document, do not limit the free movable of speaker again, thereby reach the effect of on-the-spot speech.
Summary of the invention
Adopt computer vision technique to detect, locate, follow the tracks of and obtain track and the shape of laser pen institute emitted laser bundle on projection screen.Adopt document analysis algorithm and digital-ink technology, these tracks and shape are carried out further accurately location and shape modification, and be converted into digital ink, embed in used WORD of projection and the PPT document in the colourful transparent mode.This system is the recording laser track of institute's emitted laser bundle on projection screen for a long time, also can be saved in these tracks in the used document of projection simultaneously.
First general aspect, the invention provides a kind of digital ink generation method and generation system (10) of laser pen, comprising: be used to produce the method for catching (11) of having represented laser pen institute emitted laser bundle vision signal of track on projection screen.
Second general aspect, the invention provides a kind of method, comprising: trajectory of the laser beam video capture, trajectory of the laser beam computer vision technique coarse positioning; And the generation method of trajectory of the laser beam figure.
The 3rd general aspect, the invention provides a kind of method, for position and the shape of laser beam on projection screen, utilize the document of analyzing on the local computer that is used for projection to carry out further location positioning and graphics process, comprising: trajectory of the laser beam document analysis technology accurate positioning method; And the trajectory of the laser beam figure method of modifying that utilizes the relevant documentation analytical technology.
Description of drawings
Fig. 1 has shown the digital ink generation system according to the representative laser pen of the embodiment of the invention;
Fig. 2 has shown the process flow diagram according to the digital ink generation system of the laser pen shown in Figure 1 of the embodiment of the invention;
Fig. 3 has shown the process flow diagram of trajectory of the laser beam computer vision technique rough localization method among the present invention;
Fig. 4 has shown that trajectory of the laser beam figure among the present invention is converted into the process flow diagram of digital ink method.
Embodiment
The invention discloses a kind of digital ink generation method and generation system (10) of laser pen.Adopt computer vision technique to detect, locate, follow the tracks of and obtain track and the shape of laser pen institute emitted laser bundle on projection screen.Adopt document analysis algorithm and digital-ink technology, these tracks and shape are carried out further accurately location and shape modification, and be converted into digital ink, embed in used WORD of projection and the PPT document in the colourful transparent mode.This system is the recording laser track of institute's emitted laser bundle on projection screen for a long time, also can be saved in these tracks in the used document of projection simultaneously.
Referring now to accompanying drawing,, wherein shown a kind of digital ink generation system (10) of representational laser pen and from Fig. 1.The digital ink generation system hardware of laser pen comprises a camera, a projector, a projection screen, and a computing machine.Briefly, in processing procedure, the digital ink generation system (10) of laser pen carries out video capture by camera to the trajectory of the laser beam that is presented on the projection screen.At first carry out the coarse positioning of trajectory of the laser beam by the vision signal of catching.Utilize then projection used deposit on computers document, trajectory of the laser beam document analysis technology is accurately located; Based on document knowledge, to the processing of making amendment of trajectory of the laser beam figure.Generate interface by general digital ink, generate the digital ink of trajectory of the laser beam figure.At last, digital ink is embedded in the document that projection uses, and carries out real-time Projection Display.
11 is common camera; And laser pen, projector and projection screen also are common.Generate interface by general digital ink the trajectory of the laser beam figure is converted to digital ink, also can be converted into common digital picture, be embedded into again in used WORD of projection and the PPT document, on projection screen, show in real time.
Seeing also shown in Figure 2ly, is the functional flow diagram of the digital ink generation system of laser pen of the present invention.Comprise: utilize the CCD camera to take the track of laser pen institute's emitted laser bundle on projection screen, and be converted into vision signal (21); Trajectory of the laser beam computer vision technique coarse positioning, and generate trace graphics (22); The trace graphics of laser beam is converted into digital ink (23); Digital ink is embedded the method for the used document of projection, and, is presented at four steps such as (24) on the projection screen in real time, now each step is described as follows by projector:
(a), a CCD camera is installed in the dead ahead of projection screen; Utilize this camera, the place is taken to projection screen, and all optical signals at whole projection screen place (comprising the track of laser beam on projection screen) are carried out video capture, forms vision signal.
(b) the projection screen place is carried out dynamic modeling, utilize subtractive method and background model to subtract each other, and set up the trajectory of the laser beam judgement rule behind the image subtraction, carry out the location of trajectory of the laser beam; According to the position of projection screen in the video, extract trajectory of the laser beam; Then the projection screen image in the video being carried out projection proofreaies and correct; Again according to the position corresponding relation in the projection screen upper left corner and the used document of the projection upper left corner, the trajectory of the laser beam with respect to the projection screen position is converted to trajectory of the laser beam with respect to the document upper left corner.
(c) utilize the knowledge characteristics of the used document of projection in the local computer, rather than the file and picture on the projection screen in the video, the trajectory of the laser beam of above-mentioned coarse positioning is positioned on the document, and layout informations such as the character row in the analytical documentation carry out accurately locating once more of trajectory of the laser beam; And then, track is carried out processing such as translation and rotation according to the layout information of track place document, make track more can show the information that the speaker emphasizes; Digital ink interface by general in the .net of the Microsoft technology is converted to digital ink to these tracks.
(d) WORD and the PPT programming api function that utilizes Microsoft to provide is embedded into the trajectory of the laser beam digital ink that obtains by above-mentioned steps in used WORD of projection and the PPT document in the colourful transparent mode, and shows on projection screen in real time.
For the trajectory of the laser beam computer vision technique rough localization method in the above-mentioned steps (b), its idiographic flow as shown in Figure 3.Comprise: the trajectory of the laser beam (31) in tracking and the positioning video; Extract trajectory of the laser beam (32); Projection screen image in the video is carried out projection proofread and correct (33); Trajectory of the laser beam with respect to the projection screen position is converted to trajectory of the laser beam four steps such as (34) with respect to the document upper left corner, existing each step is described as follows:
(1) projection screen place background is carried out dynamic modeling, utilize subtractive method and the last period video subtract each other, to remove the interference of background and display document, the trajectory of the laser beam of setting up behind the image subtraction is judged rule, and the dynamic perfromance of reservation laser beam, the trajectory of the laser beam in tracking and the positioning video.
Projection screen for no trajectory of the laser beam carries out the mean filter background modeling, establish the projection screen place background model that obtains and be B (x, y), (x, y) be in the projection screen place background image certain a bit, establish F
t(x, y) be constantly two field picture point of t in the vision signal (x, the brightness value of y) locating, if,
|F
t(x，y)-B(x，y)|＞THRES
F is then arranged
t(x y) is the trajectory of the laser beam point, and wherein THRES is a detection threshold.
Simultaneously, projector is changed a display frame at every turn, and background model is dynamically updated; Promptly again new projection screen background is carried out the mean filter modeling.
(2) according to the position of projection screen in the video, extract trajectory of the laser beam.
The present invention with certain hour at interval inner laser institute's emitted laser bundle represent a trajectory of the laser beam unit handling.According to the detection of above-mentioned steps (1), from t=0, during to T two field picture (t=T-1), this moment trajectory of the laser beam be,
E
Laser＝{(x，y)，|F
t(x，y)-B(x，y)|＞THRES，0≤t＜T}
At this moment, E
LaserThe laser pen institute emitted laser beam trajectory that expression extracts.
(3) the projection screen image in the video being carried out projection proofreaies and correct.
Utilize camera to catch the image that obtains, be easy to generate projective deformation.We adopt a kind of fast algorithm that the projection screen image is carried out projection and proofread and correct.
At first utilize the Hough conversion, find the four edges of projector projection quadrilateral area, the straight-line equation of establishing upper and lower two limits is T
LineAnd B
Line, the straight-line equation on left and right two limits is L
LineAnd R
LineTry to achieve straight line T then
LineAnd B
LineIntersection point, be the horizontal end point P in the projective transformation
Hor_vTry to achieve straight line L again
LineAnd R
LineIntersection point, be the vertical end point P in the projective transformation
Ver_vAt last, utilize this two end point P
Hor_vAnd P
Ver_vProofreaied and correct with regard to easily image being carried out projection.
(4), the trajectory of the laser beam with respect to the projection screen position is converted to trajectory of the laser beam with respect to the document upper left corner according to the position corresponding relation in the projection screen upper left corner and the used document of the projection upper left corner.
Be converted into the digital ink process for the trace graphics laser beam in the digital ink generation system step (c), its idiographic flow as shown in Figure 4.Comprise: the accurate localization process of trajectory of the laser beam document analysis technology (41); The trajectory of the laser beam figure is modified and is handled (42); Utilize the digital ink SDK in the .net of the Microsoft technology, the trajectory of the laser beam figure be converted to digital ink three steps such as (43), now each step is described as follows:
(1) utilizes the layout structure of the used document of projection in the local computer, rather than the file and picture on the projection screen in the video, layout informations such as the character row in the analytical documentation carry out accurately locating once more of trajectory of the laser beam, make trajectory of the laser beam be positioned at above the indicated character row.
Step (4) by in the trajectory of the laser beam computer vision technique rough localization method can obtain the trajectory of the laser beam with respect to the document upper left corner; Calculate the line position information of the used current page document of projection, and calculate trajectory of the laser beam and the corresponding position of each line of text relation, carry out the accurate location of trajectory of the laser beam.
(2) utilize the layout structure of the used document of projection in the local computer, rather than the file and picture on the projection screen in the video, according to the layout information of track place document, trace graphics is rotated and processing such as translation.
The upper left corner with the used current page document of projection is true origin, and horizontal direction is the x axle, is to the right positive dirction, and vertical direction is the y axle, is downwards positive dirction.Then trajectory of the laser beam is expressed as E
Laser=(x, y) }, and x is arranged
Start≤ x≤x
EndAnd y
Start≤ y≤y
End, wherein, x
StartBe the most left x axial coordinate of trajectory of the laser beam point in-scope, x
EndBe the rightest x axial coordinate, y
StartGo up most y axial coordinate, y for trajectory of the laser beam point in-scope
EndFor descending most the y axial coordinate.
Calculate trajectory of the laser beam at the axial center line of x.Promptly, calculate { (x along the x axle
i, y
i),
for(x
i＝x
start；x
i≤x
end；x
i++)
{
}
Wherein, C
iExpression meets (x
i, y
k) ∈ E
LaserThe number of point.
Then by match point set { (x
i, y
i) obtain the central line L of horizontal direction.The rotary laser beam trajectory makes straight line L parallel with the x axle again.At this moment, then finished the rotary manipulation of trajectory of the laser beam figure.
Following mask body is introduced the translation of trajectory of the laser beam.
At first calculate the closed contour of trajectory of the laser beam, and calculate the number { N of included zone of this closed contour and the overlapping point of each line of text
i, 1≤i≤C}, wherein C represents the line number of the document page or leaf Chinese version.If,
Then the trajectory of the laser beam figure is carried out the vertical direction translation, make the capable text center of the center of gravity of trace graphics after the translation and k on a horizontal linear.
(3) utilize digital ink SDK in the .net of the Microsoft technology, the trajectory of the laser beam figure is converted to digital ink.
In sum,, can utilize computer vision technique and document analysis technology, and software and hardware combining is become independently the digital ink generation method and the generation system of laser pen by method of the present invention.So the present invention meets the application for a patent for invention important document fully,, please also ratify to grant patent by detailed survey, to ensure inventor's rights and interests so propose application for a patent for invention in accordance with the law.
Though introduced embodiments of the invention here for the purpose of illustration, it will be apparent to those skilled in the art that and to carry out many modifications and variations to it.Therefore, the claims expection has comprised all such modifications and the variation that belongs in spirit of the present invention and the scope.
Claims (6)
1. the digital ink generation method of a laser pen and generation system is characterized in that the computer vision and the image processing system that adopt laser pen, CCD camera, projector, projection screen and PC computing machine to constitute, and concrete treatment step is as follows:
(a) place a CCD camera in projecting apparatus screen the place ahead, utilize this camera to take the track of laser pen institute's emitted laser bundle on projection screen, and be converted into vision signal;
(b) trajectory of the laser beam computer vision technique coarse positioning, and generate trace graphics;
(c) trace graphics of laser beam is converted into digital ink;
(d) digital ink is embedded the method for used WORD of projection and PPT document, and, be presented on the projection screen in real time by projector.
2. method and system according to claim 1, wherein, described trajectory of the laser beam computer vision technique coarse positioning further comprises step:
(a) projection screen place background is carried out dynamic modeling, utilize subtractive method and background model to subtract each other, the trajectory of the laser beam of setting up behind the image subtraction is judged rule, and keeps the dynamic perfromance of laser beam, follow the tracks of with positioning video in trajectory of the laser beam;
(b) according to the position of projection screen in the video, extract trajectory of the laser beam;
(c) the projection screen image in the video being carried out projection proofreaies and correct;
(d), the trajectory of the laser beam with respect to the projection screen position is converted to trajectory of the laser beam with respect to the document upper left corner according to the position corresponding relation in the projection screen upper left corner and the used document of the projection upper left corner.
3. method and system according to claim 1, wherein, described trajectory of the laser beam figure is converted into digital ink and further comprises step:
(a) the accurate localization process of trajectory of the laser beam document analysis technology;
(b) the trajectory of the laser beam figure is modified and is handled;
(c) utilize digital ink SDK in the .net of the Microsoft technology, the trajectory of the laser beam figure is converted to digital ink.
4. method and system according to claim 1, wherein, the accurate localization process of described trajectory of the laser beam document analysis technology is represented, utilize the layout structure of the used document of projection in the local computer, rather than the file and picture on the projection screen in the video, layout informations such as the character row in the analytical documentation carry out accurately locating once more of trajectory of the laser beam, make trajectory of the laser beam be positioned at above the indicated character row.
5. method and system according to claim 1, wherein, described trajectory of the laser beam figure is modified and is handled expression, utilize the layout structure that shows used document in the local computer, rather than the file and picture on the projection screen in the video, according to the layout information of track place document, trace graphics is carried out processing such as translation and rotation.
6. method and system according to claim 1 is characterized in that, has comprised the trajectory of the laser beam figure is converted into the ordinary numbers picture, and digital picture is embedded into used WORD of projection and PPT document, and by projector, is presented on the projection screen in real time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510069577 CN1687869A (en) | 2005-05-17 | 2005-05-17 | Digital ink producing method and system for laser pen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510069577 CN1687869A (en) | 2005-05-17 | 2005-05-17 | Digital ink producing method and system for laser pen |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1687869A true CN1687869A (en) | 2005-10-26 |
Family
ID=35305911
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200510069577 Pending CN1687869A (en) | 2005-05-17 | 2005-05-17 | Digital ink producing method and system for laser pen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1687869A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007087752A1 (en) * | 2006-01-26 | 2007-08-09 | Jbc Photonix Inc. | Input method and input apparatus for prejection display, projection display system having same apparatus |
| CN102279668A (en) * | 2010-06-08 | 2011-12-14 | 株式会社理光 | Information interaction method and system |
| CN103116684A (en) * | 2013-03-19 | 2013-05-22 | 中国农业银行股份有限公司 | Method and system for generating product appearance prototype |
| CN103278094A (en) * | 2013-06-25 | 2013-09-04 | 东莞理工学院 | Laser position measuring device and laser position measuring method |
| CN104575120A (en) * | 2015-01-09 | 2015-04-29 | 代四广 | Display system for aided teaching |
| WO2015184841A1 (en) * | 2014-11-12 | 2015-12-10 | 中兴通讯股份有限公司 | Method and apparatus for controlling projection display |
| CN110148119A (en) * | 2019-04-25 | 2019-08-20 | 北京恒图科技有限公司 | A kind of signal system and method |
-
2005
- 2005-05-17 CN CN 200510069577 patent/CN1687869A/en active Pending
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007087752A1 (en) * | 2006-01-26 | 2007-08-09 | Jbc Photonix Inc. | Input method and input apparatus for prejection display, projection display system having same apparatus |
| CN102279668A (en) * | 2010-06-08 | 2011-12-14 | 株式会社理光 | Information interaction method and system |
| CN102279668B (en) * | 2010-06-08 | 2014-12-10 | 株式会社理光 | Information interaction method and system |
| CN103116684A (en) * | 2013-03-19 | 2013-05-22 | 中国农业银行股份有限公司 | Method and system for generating product appearance prototype |
| CN103116684B (en) * | 2013-03-19 | 2016-06-29 | 中国农业银行股份有限公司 | A kind of method and system generating product appearance prototype |
| CN103278094A (en) * | 2013-06-25 | 2013-09-04 | 东莞理工学院 | Laser position measuring device and laser position measuring method |
| WO2015184841A1 (en) * | 2014-11-12 | 2015-12-10 | 中兴通讯股份有限公司 | Method and apparatus for controlling projection display |
| CN104575120A (en) * | 2015-01-09 | 2015-04-29 | 代四广 | Display system for aided teaching |
| CN104575120B (en) * | 2015-01-09 | 2017-02-22 | 代四广 | Display system for aided teaching |
| CN110148119A (en) * | 2019-04-25 | 2019-08-20 | 北京恒图科技有限公司 | A kind of signal system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Karambakhsh et al. | Deep gesture interaction for augmented anatomy learning | |
| WO2019029100A1 (en) | Multi-interaction implementation method for mining operation based on virtual reality and augmented reality | |
| CN1687869A (en) | Digital ink producing method and system for laser pen | |
| RU2669717C2 (en) | Handbook input / output system, digital ink sheet, information intake system and sheet supporting information input | |
| CN111881310B (en) | Chinese character hard-stroke writing intelligent guidance and scoring method and guidance scoring system | |
| CN109684803B (en) | Man-machine verification method based on gesture sliding | |
| WO2021051024A1 (en) | Editable notetaking resource with optional overlay | |
| CN102880360B (en) | Infrared type multi-point interaction electric whiteboard system and blank Projection surveying method | |
| AU2004242566B2 (en) | Local localization using fast image match | |
| CN111242962A (en) | Method, device and equipment for generating remote training video and storage medium | |
| KR20060049081A (en) | Parsing hierarchicahl lists and outlines | |
| CN113950822A (en) | Virtualization of a physical active surface | |
| RU2347271C2 (en) | Global localisation by prompt coordination of images | |
| Saoji et al. | Air canvas application using Opencv and numpy in python | |
| WO2022237117A1 (en) | Touch control method and system for interactive electronic whiteboard, and readable medium | |
| Vajda et al. | A method for camera-based interactive whiteboard reading | |
| CN112764530A (en) | Ammunition identification method based on touch handle and augmented reality glasses | |
| Wang | Illustration Art Based on Visual Communication in Digital Context | |
| CN107102781A (en) | A kind of tagging stylus and multipoint touch interactive system | |
| CN111354018A (en) | Object identification method, device and system based on image | |
| Rafique et al. | Employing automatic content recognition for teaching methodology analysis in classroom videos | |
| Robertson et al. | Live paper: video augmentation to simulate interactive paper | |
| CN112764531A (en) | Augmented reality ammunition identification method | |
| Heath | Drawing out interaction: Lines around shared space | |
| Rebelo et al. | Using computer vision techniques for moving poster design |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |