CN101840062A - Interactive projection system and interactive method - Google Patents
Interactive projection system and interactive method Download PDFInfo
- Publication number
- CN101840062A CN101840062A CN201010143267A CN201010143267A CN101840062A CN 101840062 A CN101840062 A CN 101840062A CN 201010143267 A CN201010143267 A CN 201010143267A CN 201010143267 A CN201010143267 A CN 201010143267A CN 101840062 A CN101840062 A CN 101840062A
- Authority
- CN
- China
- Prior art keywords
- control device
- image
- harvester
- transformation matrix
- view field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to an interactive projection system, comprising a control device, a projection device, an acquisition device and an interactive pen; firstly, the control device controls the projection device to lead a calibrated picture to be projected to a projection area, and then acquisition is carried out by the acquisition device, and the control device works out the projection transformation matrix according to the collected calibrated image and the original calibrated picture in the control device, so as to realize simple and rapid calibration of the system; when interactive operation is carried out, LED is triggered and gives out infrared light when the LED interactive pen is contacted with a screen, and capture is carried out by the image acquisition device in a real time manner; in addition, the software is tested by the developed interactive pen to realize location of the LED interactive pen; according to the obtained projection transformation matrix by calibration, the position information of the projection transformation matrix is transformed into mouse position information in the control device and is projected out by the projection device, thereby realizing interactive operation on the projection screen.
Description
[technical field]
Originally be that invention relates to a kind of optical projection system, especially relate to a kind of interactive projection system and exchange method thereof.
[background technology]
The many employings of traditional interactive projection system are just being thrown or the rear-projection mode, the projection screen that needs special substance, as pressure-sensitive, magnetic induction type, perhaps be equipped with the projection screen of ultrasonic and infrared probe, realizing detection and the location of lettering pen on projection screen, owing to be subjected to the projection screen material and processing technology is limit, thereby system cost is very high and can't accomplish the jumbotron demonstration.
In the employed a kind of interactive operation system of tradition based on visual manner, adopt projector and photodetector head assembly placed apart, the separation of optical axis makes the image that detects produce bigger distortion, the distortion of this distortion and camera lens itself merges, be difficult to correct, the existence of distortion and distortion directly has influence on the bearing accuracy of lettering pen.So just adopt a side that spectroscope is set at projection display screen, realize photodetector and projection lens common optical axis, thereby eliminate photodetector from the detection image distortion that axle produces, carry out system calibrating.Above-mentioned interactive projection system adopts photodetector that the output signal of lettering pen is surveyed, and cost is higher.Adopt spectroscope to realize that photodetector and projection lens common optical axis carry out system calibrating, at first very high to the requirement of spectroscopical positioning requirements and spectroscope itself, and the method for this system calibrating is adjusted until adjusting to projector body and photodetector head assembly common optical axis the spectroscope position artificially, its bearing accuracy is limited, and can't proofread and correct adjustment to the distortion of projector body and photodetector head assembly itself, thereby this system calibrating efficient and interaction pen bearing accuracy are lower.
[summary of the invention]
Based on this, be necessary to provide a kind of demarcation simple interactive projection system.
In addition, also be necessary to provide a kind of exchange method of realizing that bearing accuracy is higher.
A kind of interactive projection system, comprise: control device, the projection arrangement and the harvester that are connected with the control device communication, be provided with the source images of uncalibrated image in the described control device, described control device control projection arrangement is projected to after the view field source images of uncalibrated image by being transferred to control device after the harvester collection, and described control device concerns according to the position of the source images of uncalibrated image in the projected image of the uncalibrated image of the view field of harvester collection and the control device and calculates projective transformation matrix and carry out system calibrating according to projective transformation matrix.
Further, described uncalibrated image is N * M cross-hatch pattern picture, the corner location of the tessellated source images of N * M that is provided with in the corner location of the tessellated projected image of N * M of the view field that the corner location of projected image that described control device extracts the N * M cross-hatch pattern picture of the view field that described harvester the gathers line ordering of going forward side by side, described control device are gathered according to harvester and the control device concerns and calculates projective transformation matrix and carry out system calibrating according to projective transformation matrix.
Further, described interactive projection system also comprises interaction pen, described control device control harvester acquisition of image data and according to the sub-pixel positioning information of the image data acquisition interaction pen output signal of harvester collection and calculate described interaction pen according to described sub-pixel positioning information and described projective transformation matrix and be preset in position in the original image in the control device at the projected image of described collection before projection.
Further, described control device is found out above the light emitting pixel point set of the described interaction pen of threshold value and the center of calculating described pixel point set according to harvester acquisition of image data and preset threshold value.
Further, described interaction pen output infrared signal is equiped with the narrow band pass filter that the infrared signal spectrum with interaction pen output adapts on the described harvester, and described harvester is a camera.
Further, control device comprises processor module, the acquisition module that is connected with processor module, is connected and is used for the memory module of storing data information with processor module,
Acquisition module is used to receive handles the data message that harvester is gathered, and the data information transfer that harvester is gathered is handled to processor module,
Described memory module stores the tessellated source images of N * M,
Described processor module comprises system calibrating unit and target following unit,
Described processor module unified management acquisition module and memory module are also controlled acquisition module and the operation of memory module,
The tessellated source images of storing in the described system calibrating cell call memory module of N * M, and the driving projection arrangement projects view field with the tessellated source images of the N * M that is called, driving the harvester collection simultaneously is incident upon the tessellated projected image of N * M of view field and is transferred to processor module by acquisition module, the system calibrating unit extracts corner location in the tessellated projected image of N * M in the view field line ordering of going forward side by side, the system calibrating unit goes out projective transformation matrix according to the corner location information calculations in angle point in the tessellated source images of the N * M that stores in the memory module of being called and the tessellated projected image of N * M in the view field that passes through the harvester collection that the system calibrating unit extracts, and the quick demarcation of the system of realization.
Further, the projected image in described target following unit drives harvester acquired projections zone also is transferred to processor module, the pixel point set that surpasses threshold value in the projected image that is collected is found out in the target following unit according to preset threshold value, and the center of calculating pixel point set, the projective transformation matrix that target following cell call system calibrating unit is calculated, the output signal that described target following unit calculates interaction pen according to projective transformation matrix is preset in the position in the original image in the control device before projection device, drive projection arrangement again and be incident upon view field and show output and follow the tracks of the movement locus of interaction pen output signal.
A kind of exchange method comprises the step of following system calibrating:
I. uncalibrated image is projected to view field;
II. gather the projected image of the uncalibrated image that is incident upon view field;
III. the position relation according to the source images of the projected image of the uncalibrated image of the view field of being gathered and the uncalibrated image before the projection calculates projective transformation matrix and carries out system calibrating according to projective transformation matrix.
Further, described uncalibrated image is N * M gridiron pattern, and Step II I also comprises:
A. the corner location of extracting the tessellated projected image of N * M of the view field the gathered line ordering of going forward side by side;
B. the corner location relation according to the tessellated source images of N * M before the corner location of the tessellated projected image of N * M of the view field of being gathered and the projection calculates projective transformation matrix and carries out system calibrating according to projective transformation matrix.
Further, above-mentioned exchange method also comprises the step of following target following:
1.. images acquired;
2.. extract sub-pixel positioning information;
3.. the sub-pixel positioning information translation is become the locating information in the original image of institute's images acquired according to described projective transformation matrix, and be converted to mouse message.
Further, 2. described step also comprises the steps: to find out the pixel point set that surpasses threshold value in the projected image of being gathered, the center of calculating described pixel point set according to preset threshold value; 3. described step also comprises the steps: to calculate the image coordinate of center in the original image of institute's images acquired of seeking described pixel point set, and is incident upon view field's demonstration output; Conversion of signals with described pixel point set becomes mouse signal simultaneously, follows the tracks of pixel and concentrates the motion of the heart and be converted to mouse movement information.
Further, described step uses thresholding method to find out pixel point set above threshold value and the center of using weighting algorithm calculating pixel point set according to preset threshold value in 2..
Above-mentioned interactive projection system and exchange method by the acquired projections zone uncalibrated image and the position relation of the source images of the uncalibrated image before the projection calculate projective transformation matrix, thereby realization system calibrating, this method is controlled automatically by control device and is carried out, can finish system calibrating in the extremely short time, simple to operate, the stated accuracy height.
[description of drawings]
Fig. 1 is the annexation synoptic diagram of interactive projection system one embodiment of the present invention;
Fig. 2 is the structural representation of interaction pen of the present invention;
The spectrum that Fig. 3 is passed through for the output infrared spectrum and the narrow band pass filter of the interaction pen of interactive projection system one embodiment of the present invention concern synoptic diagram;
Fig. 4 is the system calibrating process synoptic diagram of interactive projection system one embodiment of the present invention;
Fig. 5 is the annexation synoptic diagram between each functional module of control device of interactive projection system one embodiment of the present invention;
Fig. 6 is the process flow diagram of the system calibrating method of exchange method one embodiment of the present invention;
Fig. 7 is the process flow diagram of the method for tracking target of exchange method one embodiment of the present invention.
[embodiment]
Be further detailed below in conjunction with accompanying drawing.
As shown in Figure 1, the interactive projection system of one embodiment of the invention comprises: projection arrangement 1, interaction pen 2, harvester 3 and control device 4.Described projection arrangement 1 and harvester 3 are connected with control device 4 communications, can adopt wire communication to be connected between projection arrangement 1 and control device 4 and harvester 3 and the control device 4, also can adopt wireless telecommunications to connect.Control device 4 drives and control projection arrangement 1 and harvester 3 work.
Harvester 3 is used for image data information and handles to control device 4 data information transfer that is collected in optical projection system.The data message that harvester 3 is gathered in the present embodiment comprises the light beam information that projected image that projection arrangement 1 produces in view field's 5 projections and interaction pen 2 send.Harvester 3 is a camera, and camera can adopt charge-coupled image sensor (Charge Coupled Device is called for short CCD), complementary metal oxide semiconductor (CMOS) (Complementary Metal Oxide Semiconductor is called for short CMOS) etc.The resolution that harvester 3 adopts in the present embodiment is 320 * 240 pixels or 640 * 480 pixels, and speed is that shooting or the photography components and parts of 30 frame/seconds describe.Harvester adopts charge-coupled image sensor (Charge Coupled Device is called for short CCD) in the present embodiment, adopts the CCD device to describe below.If use the shooting of 640 * 480 pixels or photography components and parts bearing accuracy can reach 0.1 pixel, the resolution that promptly reaches is 6400 * 4800DPI.
For the raising system anti-interference of light to external world, be equiped with narrow band pass filter on the harvester 3, by narrow band pass filter to external world light filter.Because interaction pen 2 adopts infrared signal and harvester to carry out communication in the present embodiment.As shown in Figure 3, the infrared signal spectrum of spectral signal that narrow band pass filter passed through that adopts on the harvester 3 and interaction pen 2 outputs adapts.Narrow band pass filter adopts the narrow band pass filter with the corresponding to 850nm infrared band of LED lamp in the present embodiment, can significantly reduce the interference of extraneous light like this, improves the bearing accuracy and the image processing speed of interaction pen 2.And because harvester 3 is equiped with narrow band pass filter, harvester adopts common apparatus for making a video recording such as common camera or camera to get final product, and need not adopt expensive thermal camera.
Projection arrangement 1 is for adopting the projection display equipment of projection theory.Projection arrangement 1 can adopt the pre-projecting type projection arrangement, also can adopt rear projection type projector.Projection arrangement 1 adopts projector to describe in the present embodiment.
Projection arrangement 1 is projected to view field 5 with data message as default image, literal etc.View field 5 need not specific (special) requirements, does not also need specific setting, can set arbitrarily as required or adjust.Present embodiment can adopt common blank to show output to view field's 5 no specific (special) requirements, also can adopt screen to show output, also can use metope, floor or large screen display etc. to show output.
Control device 4 links to each other with projection arrangement 1 and harvester 3.Be provided with uncalibrated image in the control device 4, control device 4 control projection arrangements 1 are transferred to control device 4 after uncalibrated image is projected to view field's 5 projected images of back by harvester 3 acquired projections zones 5, and the position of the source images of uncalibrated image concerns and calculates projective transformation matrix and carry out system calibrating according to projective transformation matrix in the projected image of the view field 5 that control device 4 is gathered according to harvester 3 and the control device.The purpose of carrying out system calibrating is to determine the corresponding relation of each pixel in projected image and the uncalibrated image, thereby determines the position of each pixel in uncalibrated image in the projected image.Control device 4 carries out after the system calibrating, obtains the position that interaction pen 2 sends light beam in the projected image that harvester 3 gathers, and according to this position analog mouse incident.
Be stored in the uncalibrated image (as N * M gridiron pattern) that control device internal system or control device call in the present embodiment and adopt the source images of uncalibrated image (as N * M gridiron pattern) to describe, the uncalibrated image (as N * M gridiron pattern) that is projected in view field adopts the projected image of uncalibrated image (as N * M gridiron pattern) to describe; Other images that are stored in the control device internal system adopt original image to describe, and other images that are projected in view field adopt projected image to describe.
As shown in Figure 4, uncalibrated image adopts N * M gridiron pattern to describe in the present embodiment.Be stored in the N control device internal system or that control device calls * M gridiron pattern before the projection and adopt the tessellated source images of N * M to describe, the N * M gridiron pattern that is projected in view field adopts the tessellated projected image of N * M to describe.
As shown in Figure 5, control device 4 comprises processor module, acquisition module, memory module in the present embodiment.Control device can adopt controlling parts such as desk-top computer, notebook computer, embedded system to carry out data processing and program run, and control device 4 adopts desk-top computer to describe in the present embodiment.Interactive projection system of the present invention can be widely used in various occasions such as teaching, training, amusement, meeting, can be equipped with display simultaneously and be used for teaching courseware, conference content etc. is operated.
Acquisition module, memory module are connected with the processor module communication in the present embodiment.Processor module unified management acquisition module, and memory module and control acquisition module and the operation of memory module.Processor module comprises system calibrating unit and target following unit.
Acquisition module is used to receive to be handled data message that harvester gathers and data information transfer is handled to data processor module.
Memory module is used for storing data information.Memory module institute data information stored comprises N * M gridiron pattern view data, other view data and other data.Other view data comprise the default view data that image, lteral data and control device received.Default image, lteral data can be teaching courseware, conference content, minutes or other text files or image file etc.Other data comprise image threshold information, operational formula, transformation matrix, working procedure and other information etc. that prestore.The output information of interaction pen can store in the memory module after handling by processor module in the present embodiment.
System calibrating of the present invention unit operational process is as follows: processor module receives log-on message, the tessellated view data of N * M of storing in the system calibrating cell call memory module, system calibrating unit drives projector projects view field with the tessellated source images of the N * M that is called and forms the tessellated projected image of N * M.Projected image is subjected to the influence of projector or camera putting position, can produce certain deformation, for example forms deformation pattern as shown in Figure 3.Acquisition module is gathered and be transferred to system calibrating unit drives harvester to the tessellated projected image of the N * M that is incident upon view field, acquisition module is transferred to processor module with the tessellated projected image of the N * M of reception, the position that the system calibrating unit extracts angle point 302 in the tessellated projected image of N * M in the view field line ordering of going forward side by side, the system calibrating unit goes out projective transformation matrix according to the positional information calculation of angle point 302 corresponding in the position of the angle point 302 in the tessellated source images of the N * M that stores in the memory module of being called and the tessellated projected image of N * M in the view field of system calibrating unit extraction.As shown in Figure 3, deformation pattern can be corrected according to this projective transformation matrix is correcting image, thereby the position of the corresponding pixel 306 in correcting image of the pixel 304 in the acquisition deformation pattern, thereby the corresponding relation of the pixel in the source images of pixel in the projected image of realization uncalibrated image and uncalibrated image.
System calibrating of the present invention unit carries out scaling method, be that deviation between the tessellated source images of N * M that prestores in the tessellated projected image of N * M of the view field of gathering by harvester and the control device system is demarcated rectification, no matter be projector or the anamorphose that projects to view field that harvester (as CCD) is subjected to displacement or other reasons causes, can both demarcate the unit by operational system and can finish system in the extremely short time (as 0.1 second) and demarcate again, enter duty.The image of distortion is exported the image after correcting after correcting by control device by projector's projection, and this system calibrating method operation is simple.
Target following of the present invention unit operational process is as follows: interaction pen sends infrared signal, the collection of processor module driving harvester is obtained a two field picture and is transferred to acquisition module, the two field picture that acquisition module will receive is transferred to processor module, target following unit passing threshold split plot design is found out the pixel point set above predetermined threshold value, pass through the center of weighting algorithm calculating pixel point set again, thereby extract the sub-pixel positioning information of interaction pen 2, the projective transformation matrix that target following cell call system calibrating unitary operation goes out, processor module is converted to image coordinate corresponding in control device 4 inside or the projection arrangement 1 and shows output according to the position of projective transformation matrix with the infrared signal of interaction pen output, the infrared signal of the interaction pen output that target following unit extraction harvester is gathered is also followed the tracks of the movement locus of the infrared signal of interaction pen output, infrared signal with interaction pen output converts mouse message to simultaneously, the analog mouse incident, thus realize interaction pen in view field mouse action or draw, write operation.
After the target following unit converted the infrared signal of interaction pen output to mouse message, interaction pen 2 can analog mouse carries out that document is opened and closed, operation such as page turning, shutdown up and down.When the infrared signal of interaction pen 2 output touched the operation push-button of the control device built-in system that is projected in view field or document or icon, harvester 3 was gathered the infrared signal of interaction pens 2 outputs and is converted into mouse message by control device 4 and carries out mouse action.As want to open certain teaching PPT shelves as the operator, use interaction pen 2 as operation left mouse button, if interaction pen 2 use touch-switchs are then clicked the PPT shelves that will open continuously twice, then interaction pen 2 position and the track of clicking the infrared signal of being sent for twice continuously gathered by harvester 3, and control device 4 is converted into mouse signal with the infrared signal of interaction pen 2 outputs and realizes mouse action; In the time of will closing certain document equally, if interaction pen 2 use touch-switchs then operating interactive pen 2 click and close the icon position and send infrared signal, then the position of the infrared signal that interaction pen 2 sent and track are gathered by harvester 3, and control device 4 is converted into mouse signal realization mouse action with the infrared signal of interaction pen 2 outputs; When the interaction pen 2 in the same use present embodiment shuts down, the button that uses interaction pen 2 to touch the beginning icon sends infrared signal, then the position of the infrared signal that interaction pen 2 sent and track are gathered by harvester 3, and control device 4 is converted into mouse signal realization mouse action with the infrared signal of interaction pen 2 outputs.
Extremely shown in Figure 7 as Fig. 6, the exchange method process flow diagram of above-mentioned interactive system.
As shown in Figure 6, the exchange method of above-mentioned interactive projection system comprises the step of system calibrating:
I. uncalibrated image is projected to view field;
II. gather the view data of the uncalibrated image that is incident upon view field;
III. the position relation according to the source images of the projected image of the uncalibrated image of the view field of being gathered and the uncalibrated image before the projection calculates projective transformation matrix and carries out system calibrating according to projective transformation matrix.
Above-mentioned uncalibrated image can adopt N * M gridiron pattern, and Step II I also comprises:
A. the corner location of extracting the tessellated projected image of N * M of the view field the gathered line ordering of going forward side by side;
B. the corner location relation according to the tessellated source images of N * M before the corner location of the tessellated projected image of N * M of the view field of being gathered and the projection calculates projective transformation matrix and carries out system calibrating according to projective transformation matrix.
As shown in Figure 7, the exchange method of above-mentioned interactive projection system also comprises the step of target following:
1.. images acquired;
2.. extract sub-pixel positioning information;
3.. the sub-pixel positioning information translation is become the locating information in the original image of institute's images acquired according to described projective transformation matrix, and the analog mouse incident.
2. above-mentioned steps also comprises the steps: to find out the pixel point set that surpasses threshold value in the projected image of being gathered, the center of calculating described pixel point set according to preset threshold value.
3. above-mentioned steps also comprises the steps: to calculate the image coordinate of center in the original image of institute's images acquired of seeking described pixel point set, and is incident upon view field's demonstration output; Conversion of signals with described pixel point set becomes mouse signal simultaneously, follows the tracks of the movement locus analog mouse incident of pixel point set.
Step is found out above the pixel centralized procurement of threshold value according to preset threshold value in 2. and is realized with thresholding method, adopts the weighting algorithm to realize in the center present embodiment of calculating pixel point set.
Step is found out in the projected image of being gathered the pixel point set that surpasses threshold value according to preset threshold value in 2., and the center of calculating described pixel point set is the step of the sub-pixel positioning information of extracting interaction pen 2.
When carrying out target following in the present embodiment, gather a two field picture by harvester and can realize.What step calculated that image coordinate in the original image of center before projection of described pixel point set realizes according to described projective transformation matrix in 3. is that the infrared signal of the interaction pen 2 of view field that harvester 3 is gathered is converted to image coordinate in control device 4 internal system or the projection arrangement 1 by transformation matrix.
The working procedure of the exchange method of present embodiment is carried on the ordinary PC, and processing speed can reach for 200 frame/seconds even higher, and operation works together very smooth.
The above embodiment has only expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to claim of the present invention.Should be pointed out that for the person of ordinary skill of the art without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.
Claims (12)
1. interactive projection system, comprise: control device, the projection arrangement and the harvester that are connected with the control device communication, it is characterized in that: the source images that is provided with uncalibrated image in the described control device, described control device control projection arrangement is projected to after the view field source images of uncalibrated image by being transferred to control device after the harvester collection, and described control device concerns according to the position of the source images of uncalibrated image in the projected image of the uncalibrated image of the view field of harvester collection and the control device and calculates projective transformation matrix and carry out system calibrating according to projective transformation matrix.
2. interactive projection system as claimed in claim 1, it is characterized in that: described uncalibrated image is N * M cross-hatch pattern picture, the corner location of the tessellated source images of N * M that is provided with in the corner location of the tessellated projected image of N * M of the view field that the corner location of projected image that described control device extracts the N * M cross-hatch pattern picture of the view field that described harvester the gathers line ordering of going forward side by side, described control device are gathered according to harvester and the control device concerns and calculates projective transformation matrix and carry out system calibrating according to projective transformation matrix.
3. interactive projection system as claimed in claim 1 or 2, it is characterized in that: described interactive projection system also comprises interaction pen, described control device control harvester acquisition of image data and according to the sub-pixel positioning information of the image data acquisition interaction pen output signal of harvester collection and calculate described interaction pen according to described sub-pixel positioning information and described projective transformation matrix and be preset in position in the original image in the control device at the projected image of described collection before projection.
4. interactive projection system as claimed in claim 3 is characterized in that: described control device is found out above the light emitting pixel point set of the described interaction pen of threshold value and the center of calculating described pixel point set according to harvester acquisition of image data and preset threshold value.
5. interactive projection system as claimed in claim 3 is characterized in that: described interaction pen output infrared signal, be equiped with the narrow band pass filter that the infrared signal spectrum with interaction pen output adapts on the described harvester, and described harvester is a camera.
6. interactive projection system as claimed in claim 1 is characterized in that: control device comprises processor module, the acquisition module that is connected with processor module, is connected and is used for the memory module of storing data information with processor module,
Acquisition module is used to receive handles the data message that harvester is gathered, and the data information transfer that harvester is gathered is handled to processor module,
Described memory module stores the tessellated source images of N * M,
Described processor module comprises system calibrating unit and target following unit,
Described processor module unified management acquisition module and memory module are also controlled acquisition module and the operation of memory module,
The tessellated source images of storing in the described system calibrating cell call memory module of N * M, and the driving projection arrangement projects view field with the tessellated source images of the N * M that is called, driving the harvester collection simultaneously is incident upon the tessellated projected image of N * M of view field and is transferred to processor module by acquisition module, the system calibrating unit extracts corner location in the tessellated projected image of N * M in the view field line ordering of going forward side by side, and the system calibrating unit goes out projective transformation matrix and carries out system calibrating according to described projective transformation matrix according to the corner location information calculations in the tessellated projected image of N * M in the angle point in the tessellated source images of the N * M that stores in the memory module of being called and passing through of extracting through the system calibrating unit view field that harvester gathers.
7. interactive projection system as claimed in claim 6, it is characterized in that: the projected image in described target following unit drives harvester acquired projections zone also is transferred to processor module, the pixel point set that surpasses threshold value in the projected image that is collected is found out in the target following unit according to preset threshold value, and the center of calculating pixel point set, the projective transformation matrix that target following cell call system calibrating unit is calculated, the output signal that described target following unit calculates interaction pen according to projective transformation matrix is preset in the position in the original image in the control device before projection device, drive projection arrangement again and be incident upon view field and show output and follow the tracks of the movement locus of interaction pen output signal.
8. exchange method is characterized in that: the step that comprises following system calibrating:
I. uncalibrated image is projected to view field;
II. gather the projected image of the uncalibrated image that is incident upon view field;
III. the position relation according to the source images of the projected image of the uncalibrated image of the view field of being gathered and the uncalibrated image before the projection calculates projective transformation matrix and carries out system calibrating according to projective transformation matrix.
9. exchange method as claimed in claim 8 is characterized in that: described uncalibrated image is N * M gridiron pattern, and Step II I also comprises:
A. the corner location of extracting the tessellated projected image of N * M of the view field the gathered line ordering of going forward side by side;
B. the corner location relation according to the tessellated source images of N * M before the corner location of the tessellated projected image of N * M of the view field of being gathered and the projection calculates projective transformation matrix and carries out system calibrating according to projective transformation matrix.
10. exchange method as claimed in claim 8 is characterized in that, also comprises the step of following target following:
1.. images acquired;
2.. extract the sub-pixel positioning information in institute's images acquired;
3.. the sub-pixel positioning information translation is become the locating information in the original image of institute's images acquired according to described projective transformation matrix, and be converted to mouse message.
11. exchange method as claimed in claim 10 is characterized in that: 2. described step also comprises the steps: to find out the pixel point set that surpasses threshold value in the projected image of being gathered, the center of calculating described pixel point set according to preset threshold value; 3. described step also comprises the steps: to calculate the image coordinate of center in the original image of institute's images acquired of seeking described pixel point set, and is incident upon view field's demonstration output; Concentrate the positional information of the heart to convert mouse signal to described pixel simultaneously, follow the tracks of pixel and concentrate the movement locus of the heart and be converted to mouse message.
12. exchange method as claimed in claim 11 is characterized in that: described step uses thresholding method to find out pixel point set above threshold value and the center of using weighting algorithm calculating pixel point set according to preset threshold value in 2..
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010143267A CN101840062A (en) | 2009-08-21 | 2010-03-03 | Interactive projection system and interactive method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910109398.1 | 2009-08-21 | ||
| CN201010143267A CN101840062A (en) | 2009-08-21 | 2010-03-03 | Interactive projection system and interactive method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101840062A true CN101840062A (en) | 2010-09-22 |
Family
ID=42743546
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010143267A Pending CN101840062A (en) | 2009-08-21 | 2010-03-03 | Interactive projection system and interactive method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101840062A (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101980299A (en) * | 2010-11-24 | 2011-02-23 | 河海大学 | Chessboard calibration-based camera mapping method |
| CN102156379A (en) * | 2011-03-22 | 2011-08-17 | 上海学舟信息技术有限公司 | Novel interactive recording and playing curriculum system |
| CN102253763A (en) * | 2011-01-12 | 2011-11-23 | 南昊（北京）科技有限公司 | Wireless interaction system and method |
| CN102253761A (en) * | 2011-01-12 | 2011-11-23 | 南昊（北京）科技有限公司 | Operating method of interactive system |
| CN102298786A (en) * | 2010-06-22 | 2011-12-28 | 上海科技馆 | Virtual drawing implementation device and method for the same |
| CN102323868A (en) * | 2011-10-26 | 2012-01-18 | 中国人民解放军国防科学技术大学 | Man-machine multipoint interaction method and device based on infrared image |
| CN102445998A (en) * | 2011-09-16 | 2012-05-09 | 海信集团有限公司 | Method to obtain projection position of remote-control light spot and interactive projection system |
| CN102541417A (en) * | 2010-12-30 | 2012-07-04 | 株式会社理光 | Multi-object tracking method and system in virtual touch screen system |
| CN103096007A (en) * | 2013-01-07 | 2013-05-08 | 苏州佳世达光电有限公司 | Interactive projection system and correcting method thereof |
| CN103116889A (en) * | 2013-02-05 | 2013-05-22 | 海信集团有限公司 | Positioning method and electronic device |
| CN103677240A (en) * | 2012-09-24 | 2014-03-26 | 株式会社理光 | Virtual touch interaction method and equipment |
| CN104501001A (en) * | 2014-11-28 | 2015-04-08 | 广景科技有限公司 | Intelligent projection bulb and interaction and intelligent projection method thereof |
| CN104915024A (en) * | 2014-03-10 | 2015-09-16 | 联想(北京)有限公司 | Control operation method, intelligent input pen and electronic device |
| CN105547188A (en) * | 2015-12-07 | 2016-05-04 | 中国科学院地球环境研究所 | Three-dimensional scanning system and three-dimensional scanning method for measuring volume of loose sediment block sample |
| CN105787913A (en) * | 2014-12-19 | 2016-07-20 | 宁波舜宇光电信息有限公司 | Calibration method of projection module set |
| CN103327310B (en) * | 2013-07-12 | 2016-11-02 | 浙江宇视科技有限公司 | A kind of monitoring followed the tracks of based on mouse track and cruise method |
| CN106961590A (en) * | 2017-03-23 | 2017-07-18 | 联想(北京)有限公司 | Control method and electronic equipment |
| CN107823883A (en) * | 2017-11-21 | 2018-03-23 | 河南黄烨科技有限公司 | Aiming point screen coordinate acquisition methods based on image recognition and laser positioning |
| CN109782962A (en) * | 2018-12-11 | 2019-05-21 | 中国科学院深圳先进技术研究院 | A kind of projection interactive method, device, system and terminal device |
| CN109814770A (en) * | 2018-12-17 | 2019-05-28 | 中国科学院深圳先进技术研究院 | Cursor positioning method, alternative projection device and educational system |
| CN109917974A (en) * | 2019-03-20 | 2019-06-21 | 安徽慧视金瞳科技有限公司 | A kind of non-linear coordinate mapping method of interactive projection system |
| CN110267020A (en) * | 2018-03-12 | 2019-09-20 | 郑州工业应用技术学院 | A kind of interactive system and its exchange method based on more projection arrangements |
| CN110310336A (en) * | 2019-06-10 | 2019-10-08 | 青岛小鸟看看科技有限公司 | A kind of touch control projection system and image processing method |
| CN113391732A (en) * | 2021-05-18 | 2021-09-14 | 杭州易现先进科技有限公司 | Interaction method and system of projector and computer readable storage medium |
| WO2022036481A1 (en) * | 2020-08-17 | 2022-02-24 | 南京智导智能科技有限公司 | Correction and interaction technology for mobile projection |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1270352A (en) * | 1999-03-31 | 2000-10-18 | 精工爱普生株式会社 | Method and device for calibrating project image from computer |
| US6798926B2 (en) * | 2000-02-22 | 2004-09-28 | Seiko Epson Corporation | System and method of pointed position detection, presentation system, and program |
| CN1945511A (en) * | 2005-10-09 | 2007-04-11 | 深圳市巨龙科教高技术股份有限公司 | Computer projection auxiliary positioning method and interactive demonstration system using said method |
| CN100449459C (en) * | 2006-12-27 | 2009-01-07 | 北京航空航天大学 | Calibrating method for single camera virtual mouse system |
-
2010
- 2010-03-03 CN CN201010143267A patent/CN101840062A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1270352A (en) * | 1999-03-31 | 2000-10-18 | 精工爱普生株式会社 | Method and device for calibrating project image from computer |
| US6798926B2 (en) * | 2000-02-22 | 2004-09-28 | Seiko Epson Corporation | System and method of pointed position detection, presentation system, and program |
| CN1945511A (en) * | 2005-10-09 | 2007-04-11 | 深圳市巨龙科教高技术股份有限公司 | Computer projection auxiliary positioning method and interactive demonstration system using said method |
| CN100449459C (en) * | 2006-12-27 | 2009-01-07 | 北京航空航天大学 | Calibrating method for single camera virtual mouse system |
Non-Patent Citations (2)
| Title |
|---|
| 《中国图象图形学报》 20031130 刘芳等 基于激光笔的远程人机交互技术 1356-1360 1-10 第8卷, 第11期 2 * |
| 《吉林大学学报（工学版）》 20070331 林慧英等 基于图像畸变矫正的摄像机标定方法 433-437 1-10 第37卷, 第2期 2 * |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298786A (en) * | 2010-06-22 | 2011-12-28 | 上海科技馆 | Virtual drawing implementation device and method for the same |
| CN102298786B (en) * | 2010-06-22 | 2015-09-02 | 上海科技馆 | The devices and methods therefor that a kind of virtual drawing realizes |
| CN101980299B (en) * | 2010-11-24 | 2013-01-02 | 河海大学 | Chessboard calibration-based camera mapping method |
| CN101980299A (en) * | 2010-11-24 | 2011-02-23 | 河海大学 | Chessboard calibration-based camera mapping method |
| CN102541417B (en) * | 2010-12-30 | 2014-02-26 | 株式会社理光 | Multi-object tracking method and system in virtual touch screen system |
| CN102541417A (en) * | 2010-12-30 | 2012-07-04 | 株式会社理光 | Multi-object tracking method and system in virtual touch screen system |
| CN102253763A (en) * | 2011-01-12 | 2011-11-23 | 南昊（北京）科技有限公司 | Wireless interaction system and method |
| CN102253761A (en) * | 2011-01-12 | 2011-11-23 | 南昊（北京）科技有限公司 | Operating method of interactive system |
| CN102253763B (en) * | 2011-01-12 | 2017-04-05 | 北京南昊科技股份有限公司 | Wireless interaction system and method |
| CN102156379A (en) * | 2011-03-22 | 2011-08-17 | 上海学舟信息技术有限公司 | Novel interactive recording and playing curriculum system |
| CN102445998A (en) * | 2011-09-16 | 2012-05-09 | 海信集团有限公司 | Method to obtain projection position of remote-control light spot and interactive projection system |
| CN102323868B (en) * | 2011-10-26 | 2013-07-31 | 中国人民解放军国防科学技术大学 | Man-machine multipoint interaction method and device based on infrared image |
| CN102323868A (en) * | 2011-10-26 | 2012-01-18 | 中国人民解放军国防科学技术大学 | Man-machine multipoint interaction method and device based on infrared image |
| CN103677240A (en) * | 2012-09-24 | 2014-03-26 | 株式会社理光 | Virtual touch interaction method and equipment |
| CN103096007A (en) * | 2013-01-07 | 2013-05-08 | 苏州佳世达光电有限公司 | Interactive projection system and correcting method thereof |
| CN103116889A (en) * | 2013-02-05 | 2013-05-22 | 海信集团有限公司 | Positioning method and electronic device |
| CN103327310B (en) * | 2013-07-12 | 2016-11-02 | 浙江宇视科技有限公司 | A kind of monitoring followed the tracks of based on mouse track and cruise method |
| CN104915024A (en) * | 2014-03-10 | 2015-09-16 | 联想(北京)有限公司 | Control operation method, intelligent input pen and electronic device |
| CN104915024B (en) * | 2014-03-10 | 2018-01-23 | 联想(北京)有限公司 | Method, intelligent input pen and the electronic equipment of control operation |
| CN104501001B (en) * | 2014-11-28 | 2016-11-23 | 广景科技有限公司 | A kind of intelligence projection bulb and interactive and intelligence projecting method thereof |
| CN104501001A (en) * | 2014-11-28 | 2015-04-08 | 广景科技有限公司 | Intelligent projection bulb and interaction and intelligent projection method thereof |
| CN105787913A (en) * | 2014-12-19 | 2016-07-20 | 宁波舜宇光电信息有限公司 | Calibration method of projection module set |
| CN105547188A (en) * | 2015-12-07 | 2016-05-04 | 中国科学院地球环境研究所 | Three-dimensional scanning system and three-dimensional scanning method for measuring volume of loose sediment block sample |
| CN106961590A (en) * | 2017-03-23 | 2017-07-18 | 联想(北京)有限公司 | Control method and electronic equipment |
| CN107823883A (en) * | 2017-11-21 | 2018-03-23 | 河南黄烨科技有限公司 | Aiming point screen coordinate acquisition methods based on image recognition and laser positioning |
| CN110267020A (en) * | 2018-03-12 | 2019-09-20 | 郑州工业应用技术学院 | A kind of interactive system and its exchange method based on more projection arrangements |
| CN109782962A (en) * | 2018-12-11 | 2019-05-21 | 中国科学院深圳先进技术研究院 | A kind of projection interactive method, device, system and terminal device |
| CN109814770A (en) * | 2018-12-17 | 2019-05-28 | 中国科学院深圳先进技术研究院 | Cursor positioning method, alternative projection device and educational system |
| CN109917974A (en) * | 2019-03-20 | 2019-06-21 | 安徽慧视金瞳科技有限公司 | A kind of non-linear coordinate mapping method of interactive projection system |
| CN109917974B (en) * | 2019-03-20 | 2022-03-22 | 安徽慧视金瞳科技有限公司 | Non-linear point coordinate mapping method for interactive projection system |
| CN110310336A (en) * | 2019-06-10 | 2019-10-08 | 青岛小鸟看看科技有限公司 | A kind of touch control projection system and image processing method |
| CN110310336B (en) * | 2019-06-10 | 2021-08-06 | 青岛小鸟看看科技有限公司 | Touch projection system and image processing method |
| WO2022036481A1 (en) * | 2020-08-17 | 2022-02-24 | 南京智导智能科技有限公司 | Correction and interaction technology for mobile projection |
| CN113391732A (en) * | 2021-05-18 | 2021-09-14 | 杭州易现先进科技有限公司 | Interaction method and system of projector and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101840062A (en) | Interactive projection system and interactive method | |
| CN101907954B (en) | Interactive projection system and interactive projection method | |
| WO2019232806A1 (en) | Navigation method, navigation system, mobile control system, and mobile robot | |
| Kemp et al. | A point-and-click interface for the real world: laser designation of objects for mobile manipulation | |
| CN102622108B (en) | A kind of interactive projection system and its implementation | |
| CN100590577C (en) | Touch screen positioning device and method thereof | |
| CA2378154A1 (en) | Computer presentation system and method with optical tracking of wireless pointer | |
| CN106843602B (en) | Large-screen remote control interaction system and interaction method thereof | |
| CN102945091B (en) | A kind of man-machine interaction method based on laser projection location and system | |
| CN102662498A (en) | Wireless control method and system for projection demonstration | |
| CN103150020A (en) | Three-dimensional finger control operation method and system | |
| CN206960095U (en) | A kind of multispectral more optical axis automated calibration systems | |
| WO2009148444A1 (en) | System and method for remote control of a computer | |
| CN100527783C (en) | Method of direct screen writing for television system distant end | |
| US20230090916A1 (en) | Display apparatus and processing method for display apparatus with camera | |
| CN203966055U (en) | Wireless interaction optical projection system | |
| CN103546679B (en) | Device and method for reducing separation of shot object from shooting window | |
| CN201854361U (en) | TV set | |
| CN101888495A (en) | Method and system for controlling operating conditions of TV set and TV set | |
| CN1299192C (en) | Remote-wireless controller for computer | |
| CN202058115U (en) | Mouse controlling means based on mouse laser pen | |
| CN110737338A (en) | Holographic projection method and system for special effects to automatically follow roles | |
| KR100660137B1 (en) | Input apparatus using a raser pointer and system for offering presentation using the apparatus | |
| US20040027328A1 (en) | Presentation system | |
| CN1292287C (en) | Projection system with image pickup device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20100922 |