CN103365617B - One kind projection control system, device and method for controlling projection - Google Patents
One kind projection control system, device and method for controlling projection Download PDFInfo
- Publication number
- CN103365617B CN103365617B CN201210094380.0A CN201210094380A CN103365617B CN 103365617 B CN103365617 B CN 103365617B CN 201210094380 A CN201210094380 A CN 201210094380A CN 103365617 B CN103365617 B CN 103365617B
- Authority
- CN
- China
- Prior art keywords
- hot spot
- image
- movement locus
- light
- operational controls
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses one kind projection control system, device and method for controlling projection.The system includes：Terminal, projection arrangement, light-emitting device and camera device, wherein, terminal exports the information currently shown to projection device, receive the image that camera device sequentially exports, after hot spot is included in identifying image, the movement locus vector of hot spot is obtained, inquires about the operational controls of the spot motion track vector mapping pre-set, triggers and performs operation according to the operational controls of the spot motion track vector mapping of acquisition；The light irradiation that light-emitting device makes to send projects thing and forms hot spot on perspective plane；The photaesthesia that camera device is launched light-emitting device, the view field in perspective plane is imaged, form image, export to terminal.Using the present invention, can meet the needs of user's variation manipulation, reduce system cost.
Description
Technical field
The present invention relates to Computer Control Technology, more particularly to a kind of projection control system, device and method for controlling projection.
Background technology
At present, projector equipment is widely used in conference centre, office and family, is often joined especially for needs
The people for adding meeting and often going on business, by the portable terminal of carrying, it is used cooperatively with projector equipment, product can be carried out
Sale publicity or the brief description of product.For example, by the way that terminal is connected with projector equipment, will can be opened up in terminal display
The content shown is projected on the projection surface by projector equipment, in projection process, user can by the mouse in terminal,
Keyboard etc. is controlled to the picture of projection, for example, skipping, moving, scaling.
In projection process, in order to increase spot effect, user usually requires to illustrate or explain before perspective plane, and
Perspective plane position generally has a certain distance with user terminal position, so, when user is carried out before perspective plane
During explanation, in order to manipulate (control) perspective plane, it is necessary to move back and forth between perspective plane position and terminal position, make
It is extremely inconvenient to obtain the operation of user, projects the less efficient of control.
In order to solve the above technical problems, prior art proposes a kind of new projection control system, user can directly exist
Perspective plane is manipulated before perspective plane, for example, the receiving terminal of wireless Pen for turning page by wireless Pen for turning page, can be inserted to the USB of terminal
Interface, nextpage control button is provided with wireless Pen for turning page, when user needs to carry out page turning to perspective plane, press button,
Signal is passed back terminal by USB interface, so as to which simulating keyboard, mouse show to manipulate in the terminal display for needing to project
Content, this projection control mode, because wireless Pen for turning page only has simply upper nextpage control button, it is impossible to meet user
Variation manipulation, for example, scaling, mobile, rotation demand.
In order to meet the needs of user's variation manipulation, with the development of touching technique, by the way that perspective plane is arranged into tactile
Screen to be touched, can be touched in touch-screen, touch-screen is by user touch location information transfer to terminal, after terminal is analyzed,
Terminal display region corresponding to touch location is determined, obtains the operation control included in the content of display screen region displaying
Part, and operated according to the operational controls, so as to manipulate the content in the terminal for needing to project, but the program before perspective plane
Because projection Touch Screen size is larger, the cost that touching technique is realized is big so that projection control system cost is very expensive.
The content of the invention
In view of this, it is a primary object of the present invention to propose a kind of projection control system, user's variation manipulation is met
Demand, reduce system cost.
Another object of the present invention is to propose a kind of projection control, meet the needs of user's variation manipulation, drop
Low system cost.
Another object of the present invention is to propose a kind of method for controlling projection meet the needs of user's variation manipulation, drop
Low system cost.
To reach above-mentioned purpose, the invention provides one kind to project control system, and the system includes：Terminal, projection arrangement,
Light-emitting device and camera device, wherein,
Terminal, the information for display screen currently to be shown are exported to projection arrangement；Camera device is received sequentially to export
Image, in identifying image include hot spot after, obtain the movement locus vector of hot spot, inquire about the spot motion pre-set
The operational controls of track vector mapping, trigger and perform operation according to the operational controls of the spot motion track vector mapping of acquisition；
Projection arrangement, for the information of receiving terminal output, projected on the projection surface；
Light-emitting device, the light irradiation projection thing for making to send form hot spot on perspective plane；
Camera device, to the photaesthesia of light-emitting device transmitting, for being imaged to perspective plane, image is formed, output is extremely
Terminal；
The terminal is used for after the hot spot number included in judging image is more than one, the image received according to order, obtains
The movement locus vector of each hot spot in image is taken, from the movement locus vector storehouse pre-set, obtains the fortune with the hot spot
The movement locus vector of dynamic rail mark vectors match, and the operational controls of the movement locus vector mapping of the matching are obtained, according to
The operational controls of acquisition, triggering perform corresponding operation；
The system further comprises：
Light-emitting device survey meter, in the reflected light for receiving the illumination that light-emitting device sends and being mapped to projection thing and being formed
Afterwards, trigger camera device and start shooting；After not receiving the illumination that light-emitting device sends and being mapped to the reflected light that projection thing is formed,
Trigger camera device and stop shooting.
A kind of projection control, the device include：Message output module and hot spot processing module, wherein,
Message output module, the information for display screen currently to be shown are exported to projection arrangement；
Hot spot processing module, for receiving the image of camera device output, after hot spot is included in identifying image, obtain
The movement locus vector of hot spot, the operational controls of the spot motion track vector mapping pre-set are inquired about, are triggered according to acquisition
Spot motion track vector mapping operational controls perform operation；
The hot spot processing module is used for after the hot spot number included in judging image is more than one, is received according to order
Image, the movement locus vector of each hot spot in image is obtained, from the movement locus vector storehouse pre-set, obtained and the light
The movement locus vector that the movement locus vector of spot matches, and obtain the operation control of the movement locus vector mapping of the matching
Part, according to the operational controls of acquisition, triggering performs corresponding operation；
Described device further comprises：Light-emitting device survey meter, for being mapped to receiving the illumination that light-emitting device sends
After projecting the reflected light that thing is formed, trigger the camera device and start shooting；In the light irradiation for not receiving light-emitting device and sending
After the reflected light formed to projection thing, trigger the camera device and stop shooting.
A kind of method for controlling projection, this method include：
The information that terminal display is currently shown is exported to projection arrangement；
The image that camera device sequentially exports is received, after hot spot is included in identifying image, obtains the motion rail of hot spot
Mark vector, the operational controls of the spot motion track vector mapping pre-set are inquired about, trigger the spot motion rail according to acquisition
The operational controls of mark vector mapping perform operation, and the hot spot is that the illumination that light-emitting device is sent is mapped to the projection thing on perspective plane
Formed, the photaesthesia that the camera device is launched light-emitting device；
The operational controls for inquiring about the spot motion track vector mapping pre-set include：
From the movement locus vector storehouse pre-set, obtain and match with the movement locus vector of hot spot described in image
Movement locus vector, and obtain the matching movement locus vector mapping operational controls；
It is described in identifying image include hot spot after, obtain the movement locus vector of hot spot, inquire about the light pre-set
The operational controls of spot movement locus vector mapping, trigger and performed according to the operational controls of the spot motion track vector mapping of acquisition
Operation includes：
If the hot spot number included in the image identified is more than one, the image received according to order, obtain in image
The movement locus vector of each hot spot；
From the movement locus vector storehouse pre-set, obtain what is matched with the movement locus vector of each hot spot in image
Movement locus vector, and obtain the operational controls of the movement locus vector mapping of the matching；
According to the operational controls of acquisition, triggering performs corresponding operation；
Wherein, methods described further comprises：
When light-emitting device survey meter, which receives the illumination that light-emitting device sends, is mapped to the reflected light that projection thing is formed, triggering
The camera device starts shooting；Projection thing is mapped to when the light-emitting device survey meter does not receive the illumination that light-emitting device sends
During the reflected light of formation, trigger the camera device and stop shooting.
As seen from the above technical solutions, a kind of projection control system, device and method for controlling projection provided by the invention,
The information that terminal currently shows display screen is exported to projection arrangement, is received the image that camera device sequentially exports, is being identified
Go out in image after including hot spot, obtain the movement locus vector of hot spot, inquire about the spot motion track vector mapping pre-set
Operational controls, trigger according to acquisition spot motion track vector mapping operational controls perform operation；Projection arrangement receives
The information of terminal output, is projected on the projection surface；The light irradiation that light-emitting device makes to send projects thing and forms light on perspective plane
Spot；The photaesthesia that camera device is launched light-emitting device, the view field in perspective plane is imaged, form image, output
To terminal.So, perspective plane is touched by projecting thing, the light irradiation for sending light-emitting device forms hot spot, and terminal is according to hair
The image of the camera device shooting for the photaesthesia that electro-optical device is sent, after hot spot is included in identifying image, obtains the fortune of hot spot
Dynamic track vector, the operational controls mapped according to the spot motion track vector of acquisition perform operation, so as to realize that user is long-range
At low cost to projecting the demand of diversified touch-control, and project control system and formed using common component, cost is relatively low.
Brief description of the drawings
Fig. 1 is the structural representation that the embodiment of the present invention projects control system.
Fig. 2 is the structural representation of projection control of the embodiment of the present invention.
Fig. 3 is the method for controlling projection schematic flow sheet of the embodiment of the present invention.
Fig. 4 is the schematic flow sheet that the embodiment of the present invention obtains the location coordinate information of hot spot in image.
Fig. 5 is the schematic flow sheet that the embodiment of the present invention sets conversion scale.
Embodiment
It is right below in conjunction with the accompanying drawings and the specific embodiments to make the object, technical solutions and advantages of the present invention clearer
The present invention is described in further detail.
It is existing to use touch-screen, by way of the content in the terminal that touch control needs project, the cost of touch-screen
It is very expensive.In the embodiment of the present invention, a kind of new projection control system is proposed, using common light-emitting device, camera device
It is used cooperatively with terminal and projection arrangement, to meet the needs of user's variation manipulation, while reduces whole projection control
The cost of system.
Fig. 1 is the structural representation that the embodiment of the present invention projects control system.Referring to Fig. 1, the system includes：Terminal, throwing
Image device, light-emitting device and camera device, wherein,
Projection arrangement and camera device are connected with terminal respectively, and connected mode can be connected by transmission line, to pass
The mode of defeated line communication protocol carries out the transmission of data or signal or by being wirelessly connected, for example, bluetooth, infrared etc.,
The transmission of data or signal is carried out by wireless communication protocol；Light-emitting device is installed on the direction parallel with perspective plane, and can protect
View field in the light scattering face covering perspective plane that the light that sends of card light-emitting device is formed, and produced by making illuminated projection thing
Reflected light back to camera device.
In the embodiment of the present invention, projection arrangement can be projector, and light-emitting device can be laser generator, camera device
It can be camera.
Terminal, the information for display screen currently to be shown are exported to projection arrangement；Camera device is received sequentially to export
Image, in identifying image include hot spot after, obtain the movement locus vector of hot spot, inquire about the spot motion pre-set
The operational controls of track vector mapping, trigger and perform operation according to the operational controls of the spot motion track vector mapping of acquisition；
In the embodiment of the present invention, perspective plane is shot using the camera device of the photaesthesia sent to light-emitting device,
So, reflex reflexting device that camera device photographs can be caused to send the image in the region of light, relative to perspective plane its
The image that his region photographs, by the analyzing and processing of terminal control software, easily difference.
Projection arrangement, for the information of receiving terminal output, projected on the projection surface；
In the embodiment of the present invention, terminal exports the data message that own display screen curtain is currently shown to projection arrangement, throws
Image device projects data message according to the data message of reception in the view field on perspective plane.
Light-emitting device, light (light beam) the irradiation projection thing for making to send form hot spot on perspective plane；
In the embodiment of the present invention, light-emitting device covers view field by built-in grating scattering smooth surface.When user needs
When manipulating perspective plane, with finger or other modes on perspective plane area touch perspective plane, invisible laser that light-emitting device is sent
It is irradiated on the finger of user, forms the hot spot illuminated, and produce reflection, inputs to camera device.
It is preferred that light-emitting device, which launches invisible laser, forms laser solar flare, for example, infrared light, what is sent is invisible sharp
Light is parallel with perspective plane or less parallel, and photophore is installed on so that the light scattering face covering that the light that photophore is sent is formed is thrown
The position in shadow face, the installation site of light-emitting device how is adjusted, made in the light scattering face covering perspective plane that the light sent is formed
View field, see the relevant technical literature for details, will not be repeated here.
Camera device, to the photaesthesia of light-emitting device transmitting, for being imaged to the view field in perspective plane, formed
Image, export to terminal.
In the embodiment of the present invention, the invisible laser light wave that camera device is launched light-emitting device is sensitive, and camera device is pressed
Perspective plane is shot according to the time cycle of setting.Due to the invisible laser-sensitive that camera device is launched light-emitting device, so,
On perspective plane area touch perspective plane, the invisible laser that light-emitting device is sent is irradiated to user for user's finger or other modes
Finger on and after reflexing to camera device, camera device is shot in obtained image, and the image of hot spot corresponding region is compared with other
Image corresponding to region, its brightness and contrast's difference is obvious, i.e. camera device is only capable of shooting hot spot after parameter regulation.
Exported by the image to terminal, preassembled control software is assured that out in image whether include light in terminal
Spot, after comprising hot spot, the movement locus vector of hot spot can be obtained, so as to trigger the spot motion track vector according to acquisition
The operational controls of mapping perform operation.
Certainly, in practical application, the projection control system can further include：
Light-emitting device survey meter, in the reflected light for receiving the illumination that light-emitting device sends and being mapped to projection thing and being formed
Afterwards, trigger camera device and start shooting；After not receiving the illumination that light-emitting device sends and being mapped to the reflected light that projection thing is formed,
Trigger camera device and stop shooting.So, the data volume of camera device transmission can be saved, it is possibility to have effect, which reduces terminal, to be needed
The data volume of processing.
In the embodiment of the present invention, light-emitting device survey meter can be arranged in camera device.
Fig. 2 is the structural representation of projection control of the embodiment of the present invention.Referring to Fig. 2, the projection control is eventually
End, including：Message output module and hot spot processing module, wherein,
Message output module, the information for display screen currently to be shown are exported to projection arrangement；
Hot spot processing module, for receiving the image of camera device output, after hot spot is included in identifying image, obtain
The movement locus of hot spot, the operational controls of the spot motion trajectory map pre-set are inquired about, trigger the hot spot fortune according to acquisition
The operational controls of dynamic trajectory map perform operation.
Wherein,
Hot spot processing module includes：Hot spot processing unit, position coordinates scaling unit and trigger element, wherein,
Hot spot processing unit, for receiving the image of camera device output, if a hot spot is included in image, by image
Export to position coordinates scaling unit；
Position coordinates scaling unit, for obtaining the location coordinate information of hot spot in image, if the hot spot is in each image
In track do not change, the location coordinate information of the hot spot of acquisition is multiplied with the conversion scale pre-set, is scaled
Location coordinate information corresponding to terminal display, triggering information is exported to trigger element；
Trigger element, information is triggered for receiving, triggering mouse is in position corresponding to the obtained terminal display of conversion
Place performs clicking operation.
Wherein, position coordinates scaling unit can also be further used for it is determined that track of the hot spot in each image changes
After change, the movement locus vector of hot spot is obtained, triggers what is currently shown according to the movement locus vector moving display screen curtain of hot spot
Information, and the information after movement is exported to projection arrangement.
It is preferred that hot spot processing module can also include：Movement locus vector acquiring unit, movement locus vector matching are single
Member and operational controls execution unit, wherein,
Hot spot processing unit, it is further used for after the hot spot number included in judging image is more than one, image is exported
To movement locus acquiring unit；
Movement locus vector acquiring unit, for according to order receive image, obtain image in each hot spot motion rail
Mark vector, export to movement locus vector matching unit；
In the embodiment of the present invention, the position coordinates by previous image hot spot of movement locus vector is pointed in latter image
At the position coordinates of same hot spot.Can be by obtaining first image comprising hot spot and last figure comprising hot spot
Picture, according to the position coordinates of hot spot in two images, obtain the movement locus vector of each hot spot in image.
Movement locus vector matching unit, for from the movement locus vector storehouse pre-set, obtaining the fortune with receiving
The movement locus vector of dynamic rail mark vectors match, and obtain the operational controls of movement locus vector mapping；
In the embodiment of the present invention, in movement locus vector storehouse, various movement locus vectors and every kind of fortune are previously stored with
The operational controls of dynamic track vector mapping.
Operational controls execution unit, for the operational controls according to acquisition, triggering performs corresponding operation.
In the embodiment of the present invention, for example, assuming that the hot spot number included in image is two, and first hot spot exists
The left side of second hot spot, if the movement locus vector of first hot spot (represents that the hot spot is transported to the left in a coordinate system to be negative
It is dynamic), the movement locus vector of second hot spot is just (represents that the hot spot moves right in a coordinate system), and what is prestored is somebody's turn to do
The operational controls of movement locus vector mapping are amplification, then triggering is on the basis of the center of two hot spot initial positions, to current aobvious
Show that region is amplified processing.Certainly, in practical application, perspective plane can also be touched by more fingers, it is more to simulate
Touch effect, according to its movement locus vector, the multipoint operation control pre-set is mapped as after being matched.
From above-mentioned, the projection control system of the embodiment of the present invention, it is used cooperatively in existing terminal and projection arrangement
On the basis of, analysis and Control software is set in the terminal, with reference to common light-emitting device and the photaesthesia sent to light-emitting device
Camera device so that the cost of whole projection control system is relatively low；In use, when user's finger touches perspective plane
Afterwards, the invisible laser that light-emitting device is sent is irradiated in user's finger, is formed hot spot and is reflexed to camera device so as to hair
The camera device for the photaesthesia that electro-optical device is sent is shot in obtained image, and image corresponding to spot area is corresponding compared with other regions
Image difference it is obvious, exported by the image to terminal, terminal in identifying image include hot spot after, obtain hot spot
Movement locus, the operational controls of the spot motion trajectory map pre-set are inquired about, obtain the behaviour of the spot motion trajectory map
Make control, trigger and perform operation according to the operational controls of acquisition, so as to realize user at low cost to the long-range touch-control work(of projection
Can, move back and forth without user between perspective plane and terminal, and can meet the needs of user's variation manipulation and with can
Autgmentability.
Fig. 3 is the method for controlling projection schematic flow sheet of the embodiment of the present invention.Referring to Fig. 3, the flow includes：
Step 301, information terminal display currently shown is exported to projection arrangement, so that projection arrangement is projecting
Face projects；
In this step, the information of projection arrangement receiving terminal output, projection on the projection surface, forms view field.
Step 302, the image that camera device sequentially exports is received, after hot spot is included in identifying image, obtains hot spot
Movement locus vector；
In this step, the image that the analysis and Control software in terminal is shot to camera device is analyzed, to determine image
In whether the location coordinate information comprising hot spot and hot spot, hot spot is obtained according to the location coordinate information of hot spot in each image
Movement locus vector.
Fig. 4 is the schematic flow sheet that the embodiment of the present invention obtains the location coordinate information of hot spot in image., should referring to Fig. 4
Flow includes：
Step 401, gray proces are carried out to the image of reception, obtains the image value of gray level image and gray level image；
In this step, gray proces can be binary conversion treatment.
Step 402, gray level image is progressively scanned or region segmentation scan process, obtains image value and be more than and sets in advance
The region for the image threshold put, the region are spot area；
Binary conversion treatment and scan process, it is prior art in above-mentioned steps, see the relevant technical literature for details,
It will not be repeated here.The setting of image threshold can determine according to being actually needed.
Step 403, the location coordinate information of spot area is calculated according to the coordinate system pre-set.
In this step, the location coordinate information of spot area can be represented by the centre coordinate information of spot area,
It can also be represented by the coordinate information of spot area scope.In the embodiment of the present invention, entered using center position coordinates information
Row calculates.
Step 303, the operational controls of the spot motion track vector mapping pre-set are inquired about, trigger the light according to acquisition
The operational controls of spot movement locus vector mapping perform operation, and the hot spot is when projection thing touches throwing in the range of perspective plane
Shadow face, the illumination that light-emitting device is sent are mapped to the projection thing and formed, the photaesthesia that the camera device is launched light-emitting device.
In this step, by setting light-emitting device, the light irradiation that sends is projected thing and form hot spot on perspective plane, and make by
Reflected light back is imaged to camera device by camera device caused by irradiation projection thing.Certainly, in practical application,
For example, by increasing appropriate lens group, projection thing can be imaged by camera device, as long as taking the photograph by other means
As device can image to the hot spot that projection thing is formed on the projection surface.
After the movement locus vector of hot spot is obtained, the operational controls of the spot motion trajectory map pre-set are inquired about,
The operational controls of spot motion trajectory map are obtained, triggers and performs operation according to the operational controls of acquisition.
Wherein, in step 302 and step 303, after hot spot is included in identifying image, the movement locus arrow of hot spot is obtained
Amount, the operational controls of the spot motion track vector mapping pre-set are inquired about, trigger the spot motion track arrow according to acquisition
The operational controls of amount mapping, which perform operation, to be included：
If including a hot spot in A1, the image identified, the location coordinate information of hot spot in image is obtained；
A2, determine that track of the hot spot in each image does not change, the location coordinate information of the hot spot of acquisition is changed
Calculate as location coordinate information corresponding to terminal display；
In this step, determine track of the hot spot in each image do not change including：
Obtain the first position coordinate information of hot spot in the image comprising first hot spot；
Obtain the second place coordinate information of hot spot in the image comprising last hot spot；
Calculate the distance between first position coordinate information and second place coordinate information；
Whether the distance for judging to calculate is no more than the distance threshold pre-set, if it is, rail of the hot spot in each image
Mark does not change.
In the embodiment of the present invention, further, after the distance for judging to calculate is more than the distance threshold pre-set, obtain
The movement locus vector of hot spot, the information currently shown according to the movement locus vector moving display screen curtain of hot spot is triggered, and will
Information after movement is exported to projection arrangement, in this manner it is achieved that the mobile control on perspective plane.Wherein, movement locus vector is
Second place coordinate information is pointed to by first position coordinate information.
Fig. 5 is the schematic flow sheet that the embodiment of the present invention sets conversion scale.Referring to Fig. 5, the flow includes：
Step 501, coordinate system is established with first object point in terminal display, obtains the diagonal with first object point
The coordinate information of two target points；
In this step, first object point and the second target point are set in terminal display, established with first object point
Coordinate system, and make first object point and the second target point difference in a reference axis, i.e., the second target point in coordinate system and
One target point forms diagonal relationship, for example, character of the first object point for certain a line in displaying content, the second target point is displaying
The character do not gone together with different lines with first object point in content, so in order to calculating conversion scale.It is preferred that set the first mesh
(position) coordinate information of punctuate is (0,0), and the coordinate information of the second target point is (a0x,b0y)。
Step 502, according to establishing coordinate system identical mode in terminal display, coordinate is established in perspective plane
System, obtain the coordinate information of the second target point on the projection surface；
This step is optional, and for calculating projective amplification coefficient, the perspective plane that projection arrangement is formed on perspective plane should include
The full content shown in terminal display.If the coordinate information of the second target point obtained on the projection surface is (a1x,
b1y)。
Step 503, according to establishing coordinate system identical mode in terminal display, in the image of video camera shooting
In establish coordinate system, obtain coordinate information of second target point on image；
In this step, the image of video camera shooting should include the perspective plane that projection arrangement is formed on perspective plane.If obtain
Coordinate information (a of second target point on image2x,b2y)。
Step 504, coordinate information and second target point of second target point on terminal display are calculated on image
Coordinate information ratio, as conversion scale.
In this step, the calculation formula of conversion scale is：
In formula,
βxFor abscissa conversion scale；
βyFor ordinate conversion scale.
A3, triggering mouse perform clicking operation in opening position corresponding to the obtained terminal display of conversion.
In this step, triggering mouse performs clicking operation in the corresponding opening position to be included：
If the opening position of terminal display corresponding to hot spot is operational controls region, for example, amplify, reduce, skipping,
The operational controls such as mobile, rotation, then operational controls corresponding to acquisition, and projection arrangement is adjusted the output to according to the operational controls
Information.For example, if the opening position of terminal display corresponding to hot spot is next page operations control, mouse point is triggered
Next page operations control is hit, the data that terminal display is currently shown replace with the data of lower one page, and this is next
The data output of page is to projection arrangement.If the opening position of terminal display corresponding to hot spot is not operation control regions,
Trigger mouse and perform the clicking operation without practical significance in the corresponding opening position.
After hot spot is included in identifying image, the movement locus vector of hot spot is obtained, inquires about the hot spot fortune pre-set
The operational controls of dynamic track vector mapping, trigger and perform operation according to the operational controls of the spot motion track vector mapping of acquisition
It can also include：
If the hot spot number included in the image identified is more than one, the image received according to order, obtain in image
The movement locus vector of each hot spot；
In this step, according to the image of order reception, the movement locus vector for obtaining each hot spot in image can be passed through
First image comprising hot spot and last image comprising hot spot are obtained, is sat according to the position of hot spot in two images
Mark, obtain the movement locus vector of each hot spot in image.
From the movement locus vector storehouse pre-set, obtain what is matched with the movement locus vector of each hot spot in image
Movement locus vector, and obtain the operational controls of the movement locus vector mapping to match；
In this step, operational controls corresponding to multiple point touching can be set, controlled with extended projection, meet user's variation
Manipulation demand.
According to the operational controls of acquisition, triggering performs corresponding operation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Within the spirit and principles in the present invention, any modification, equivalent substitution and improvement for being made etc., the guarantor of the present invention should be included in
Within the scope of shield.
Claims (17)
1. one kind projection control system, it is characterised in that the system includes：Terminal, projection arrangement, light-emitting device and shooting dress
Put, wherein,
Terminal, the information for display screen currently to be shown are exported to projection arrangement；Receive the figure that camera device sequentially exports
Picture, after hot spot is included in identifying image, the movement locus vector of hot spot is obtained, inquires about the spot motion track pre-set
The operational controls of vector mapping, trigger and perform operation according to the operational controls of the spot motion track vector mapping of acquisition；
Projection arrangement, for the information of receiving terminal output, projected on the projection surface；
Light-emitting device, the light irradiation projection thing for making to send form hot spot on perspective plane；
Camera device, to the photaesthesia of light-emitting device transmitting, for being imaged to perspective plane, image is formed, is exported to terminal；
The terminal is used for after the hot spot number included in judging image is more than one, the image received according to order, obtains figure
The movement locus vector of each hot spot as in, from the movement locus vector storehouse pre-set, obtain the motion rail with the hot spot
The movement locus vector of mark vectors match, and the operational controls of the movement locus vector mapping of the matching are obtained, according to acquisition
Operational controls, triggering performs corresponding operation；
The system further comprises：
Light-emitting device survey meter, for after receiving the illumination that light-emitting device sends and being mapped to the reflected light that projection thing is formed, touching
Send out camera device and start shooting；After not receiving the illumination that light-emitting device sends and being mapped to the reflected light that projection thing is formed, triggering
Camera device stops shooting.
2. the system as claimed in claim 1, it is characterised in that photophore is installed on so that what the light that photophore is sent was formed
Light scattering face covers the position on perspective plane.
3. system as claimed in claim 1 or 2, it is characterised in that the terminal includes：At message output module and hot spot
Module is managed, wherein,
Message output module, the information for display screen currently to be shown are exported to projection arrangement；
Hot spot processing module, the image sequentially exported for receiving camera device, after hot spot is included in identifying image, obtain
The movement locus vector of hot spot, the operational controls of the spot motion track vector mapping pre-set are inquired about, are triggered according to acquisition
Spot motion track vector mapping operational controls perform operation.
4. system as claimed in claim 3, it is characterised in that the hot spot processing module includes：Hot spot processing unit, position
Coordinate transformation unit and trigger element, wherein,
Hot spot processing unit, for receiving the image of camera device output, if including a hot spot in image, image is exported
To position coordinates scaling unit；
Position coordinates scaling unit, for obtaining the location coordinate information of hot spot in image, if the hot spot is in each image
Movement locus is not changed, and the location coordinate information of the hot spot of acquisition is multiplied with the conversion scale pre-set, is scaled
Location coordinate information corresponding to terminal display, triggering information is exported to trigger element；
Trigger element, information is triggered for receiving, triggering mouse is held in opening position corresponding to the obtained terminal display of conversion
Row clicking operation.
5. system as claimed in claim 4, it is characterised in that the hot spot processing module further comprises：Movement locus is sweared
Acquiring unit, movement locus vector matching unit and operational controls execution unit are measured, wherein,
Hot spot processing unit, it is further used for after the hot spot number included in judging image is more than one, image is exported to fortune
Dynamic rail mark acquisition module；
Movement locus vector acquiring unit, for the image received according to order, the movement locus for obtaining each hot spot in image is sweared
Amount, is exported to movement locus vector matching unit；
Movement locus vector matching unit, for from the movement locus vector storehouse pre-set, obtaining the motion rail with receiving
The movement locus vector of mark vectors match, and obtain the operational controls of the movement locus vector mapping of the matching；
Operational controls execution unit, for the operational controls according to acquisition, triggering performs corresponding operation.
6. the system as claimed in claim 1, it is characterised in that the light of the light-emitting device transmitting is invisible laser.
7. a kind of projection control, it is characterised in that the device includes：Message output module and hot spot processing module, its
In,
Message output module, the information for display screen currently to be shown are exported to projection arrangement；
Hot spot processing module, for receiving the image of camera device output, after hot spot is included in identifying image, obtain hot spot
Movement locus vector, inquire about pre-set spot motion track vector mapping operational controls, trigger the light according to acquisition
The operational controls of spot movement locus vector mapping perform operation；
The hot spot processing module is used for after the hot spot number included in judging image is more than one, the figure received according to order
Picture, the movement locus vector of each hot spot in image is obtained, from the movement locus vector storehouse pre-set, obtained and the hot spot
The movement locus vector that matches of movement locus vector, and obtain the operational controls of the movement locus vector mapping of the matching,
According to the operational controls of acquisition, triggering performs corresponding operation；
Described device further comprises：Light-emitting device survey meter, for being mapped to projection receiving the illumination that light-emitting device sends
After the reflected light that thing is formed, trigger the camera device and start shooting；Throwing is mapped to not receiving the illumination that light-emitting device sends
After the reflected light that shadow thing is formed, trigger the camera device and stop shooting.
8. device as claimed in claim 7, it is characterised in that the hot spot processing unit includes：Hot spot processing unit, position
Coordinate transformation unit and trigger element, wherein,
Hot spot processing unit, for receiving the image of camera device output, if including a hot spot in image, image is exported
To position coordinates scaling unit；
Position coordinates scaling unit, for obtaining the location coordinate information of hot spot in image, if the hot spot is in each image
Movement locus is not changed, and the location coordinate information of the hot spot of acquisition is multiplied with the conversion scale pre-set, is scaled
Location coordinate information corresponding to terminal display, triggering information is exported to trigger element；
Trigger element, information is triggered for receiving, triggering mouse is held in opening position corresponding to the obtained terminal display of conversion
Row clicking operation.
9. device as claimed in claim 8, it is characterised in that the hot spot processing module further comprises：Movement locus is sweared
Acquiring unit, movement locus vector matching unit and operational controls execution unit are measured, wherein,
Hot spot processing module, it is further used for after the hot spot number included in judging image is more than one, image is exported to fortune
Dynamic rail mark acquiring unit；
Movement locus vector acquiring unit, for the image received according to order, the movement locus for obtaining each hot spot in image is sweared
Amount, is exported to movement locus vector matching unit；
Movement locus vector matching unit, for from the movement locus vector storehouse pre-set, obtaining the motion rail with receiving
The movement locus vector of mark vectors match, and obtain the operational controls of the movement locus vector mapping of the matching；
Operational controls execution unit, for the operational controls according to acquisition, triggering performs corresponding operation.
10. device as claimed in claim 8 or 9, it is characterised in that the position coordinates conversion module is further used for true
Determine after track of the hot spot in each image change, to obtain the movement locus vector of hot spot, trigger the motion rail according to hot spot
The information that mark vector moving display screen curtain is currently shown, and the information after movement is exported to projection arrangement.
11. a kind of method for controlling projection, it is characterised in that this method includes：
The information that terminal display is currently shown is exported to projection arrangement；
The image that camera device sequentially exports is received, after hot spot is included in identifying image, obtains the movement locus arrow of hot spot
Amount, the operational controls of the spot motion track vector mapping pre-set are inquired about, trigger the spot motion track arrow according to acquisition
The operational controls of amount mapping perform operation, and the hot spot is mapped to projection thing for the illumination that light-emitting device is sent and formed on perspective plane,
The photaesthesia that the camera device is launched light-emitting device；
The operational controls for inquiring about the spot motion track vector mapping pre-set include：
From the movement locus vector storehouse pre-set, the fortune to match with the movement locus vector of hot spot described in image is obtained
Dynamic track vector, and obtain the operational controls of the movement locus vector mapping of the matching；
It is described to obtain the movement locus vector of hot spot after hot spot is included in identifying image, inquire about the hot spot fortune pre-set
The operational controls of dynamic track vector mapping, trigger and perform operation according to the operational controls of the spot motion track vector mapping of acquisition
Including：
If the hot spot number included in the image identified is more than one, the image received according to order, each light in image is obtained
The movement locus vector of spot；
From the movement locus vector storehouse pre-set, the motion to match with the movement locus vector of each hot spot in image is obtained
Track vector, and obtain the operational controls of the movement locus vector mapping of the matching；
According to the operational controls of acquisition, triggering performs corresponding operation；
Wherein, methods described further comprises：
When light-emitting device survey meter, which receives the illumination that light-emitting device sends, is mapped to the reflected light that projection thing is formed, described in triggering
Camera device starts shooting；Formed when the light-emitting device survey meter does not receive the illumination that light-emitting device sends and is mapped to projection thing
Reflected light when, trigger the camera device and stop shooting.
12. method as claimed in claim 11, it is characterised in that it is described after hot spot is included in identifying image, obtain light
The movement locus vector of spot, the operational controls of the spot motion track vector mapping pre-set are inquired about, are triggered according to acquisition
The operational controls of spot motion track vector mapping, which perform operation, to be included：
If including a hot spot in the image identified, the location coordinate information of hot spot in image is obtained；
Determine that track of the hot spot in each image does not change, the location coordinate information of the hot spot of acquisition is scaled terminal
Location coordinate information corresponding to display screen；
Triggering mouse performs clicking operation in opening position corresponding to the obtained terminal display of conversion.
13. method as claimed in claim 12, it is characterised in that the location coordinate information bag for obtaining hot spot in image
Include：
Gray proces are carried out to the image of reception, obtain the image value of gray level image and gray level image；
Gray level image is progressively scanned or region segmentation scan process, acquisition image value are more than the image threshold pre-set
Region, the region is spot area；
Coordinate system according to pre-setting calculates the location coordinate information of spot area.
14. method as claimed in claim 12, it is characterised in that do not send out the track for determining the hot spot in each image
Raw change includes：
Obtain the first position coordinate information of hot spot in the image comprising first hot spot；
Obtain the second place coordinate information of hot spot in the image comprising last hot spot；
Calculate the distance between first position coordinate information and second place coordinate information；
Whether the distance for judging to calculate is no more than the distance threshold pre-set, if it is, track of the hot spot in each image is not
Change.
15. method as claimed in claim 14, it is characterised in that further comprise：
After the distance for judging to calculate is more than the distance threshold pre-set, the movement locus vector of hot spot is obtained, is triggered according to light
The information that the movement locus vector moving display screen curtain of spot is currently shown, and the information after movement is exported to projection arrangement.
16. method as claimed in claim 12, it is characterised in that obtaining the conversion scale of the execution conversion includes：
Coordinate system is established with first object point in terminal display, obtains the seat of second target point diagonal with first object point
Mark information；
According to establishing coordinate system identical mode in terminal display, coordinate is established in the image of video camera shooting
System, obtain coordinate information of second target point on image；
Calculate coordinate information and second target point coordinate information on image of second target point on terminal display
Ratio, as conversion scale.
17. method as claimed in claim 12, it is characterised in that the triggering mouse performs click in the corresponding opening position
Operation includes：
If the opening position of terminal display corresponding to hot spot is operational controls region, operational controls corresponding to acquisition, and root
The information of projection arrangement is adjusted the output to according to the operational controls；
If the opening position of terminal display corresponding to hot spot is not operation control regions, triggering mouse is in the corresponding position
Put place and perform clicking operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210094380.0A CN103365617B (en) | 2012-04-01 | 2012-04-01 | One kind projection control system, device and method for controlling projection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210094380.0A CN103365617B (en) | 2012-04-01 | 2012-04-01 | One kind projection control system, device and method for controlling projection |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103365617A CN103365617A (en) | 2013-10-23 |
| CN103365617B true CN103365617B (en) | 2018-01-05 |
Family
ID=49367071
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210094380.0A Active CN103365617B (en) | 2012-04-01 | 2012-04-01 | One kind projection control system, device and method for controlling projection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103365617B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104133599A (en) * | 2014-08-01 | 2014-11-05 | 上海斐讯数据通信技术有限公司 | Terminal device and method allowing projection surface to be operated |
| CN104656902A (en) * | 2015-02-26 | 2015-05-27 | 华南理工大学 | Method and system for visual processing human-machine interactive projection based on Android |
| CN105030495B (en) * | 2015-06-26 | 2017-07-28 | 福建工程学院 | A kind of inexpensive multidimensional vision eye training guided ware |
| CN105573493B (en) * | 2015-11-27 | 2020-08-25 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| TWI636381B (en) * | 2017-10-19 | 2018-09-21 | 財團法人工業技術研究院 | Interactive display system and controlling method of interactive display |
| CN107889317B (en) * | 2017-12-12 | 2024-04-23 | 广东工业大学 | System, controller and method for tracking target by spotlight |
| CN111752377B (en) * | 2019-03-29 | 2022-04-12 | 福建天泉教育科技有限公司 | Gesture detection method and system |
| CN114598850B (en) * | 2020-11-19 | 2023-09-29 | 成都极米科技股份有限公司 | Projection control identification method, device and control equipment |
| CN112822468B (en) * | 2020-12-31 | 2023-02-17 | 成都极米科技股份有限公司 | Projection control method and device, projection equipment and laser controller |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1299987A (en) * | 2001-01-17 | 2001-06-20 | 上海交通大学 | Interactive projecting display system with laser remote controller |
| CN101587404A (en) * | 2009-04-08 | 2009-11-25 | 广东威创视讯科技股份有限公司 | Post-positioning device and method based on pick-up head and application thereof |
| CN102096527A (en) * | 2010-12-18 | 2011-06-15 | 何晓 | Indoor wireless audio and video holographic interactive rear projection integrated machine and implementation method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201638188U (en) * | 2010-01-19 | 2010-11-17 | 上海第二工业大学 | Super-large-screen infrared touch screen device |
-
2012
- 2012-04-01 CN CN201210094380.0A patent/CN103365617B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1299987A (en) * | 2001-01-17 | 2001-06-20 | 上海交通大学 | Interactive projecting display system with laser remote controller |
| CN101587404A (en) * | 2009-04-08 | 2009-11-25 | 广东威创视讯科技股份有限公司 | Post-positioning device and method based on pick-up head and application thereof |
| CN102096527A (en) * | 2010-12-18 | 2011-06-15 | 何晓 | Indoor wireless audio and video holographic interactive rear projection integrated machine and implementation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103365617A (en) | 2013-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103365617B (en) | One kind projection control system, device and method for controlling projection | |
| JP5567206B2 (en) | Computing device interface | |
| JP6372487B2 (en) | Information processing apparatus, control method, program, and storage medium | |
| CN103914152B (en) | Multi-point touch and the recognition methods and system that catch gesture motion in three dimensions | |
| JP6539816B2 (en) | Multi-modal gesture based interactive system and method using one single sensing system | |
| US20130135199A1 (en) | System and method for user interaction with projected content | |
| CN105229582A (en) | Based on the gestures detection of Proximity Sensor and imageing sensor | |
| CN102541256A (en) | Position aware gestures with visual feedback as input method | |
| CN104281276B (en) | Information processing unit, operation input detection method, program and storage medium | |
| TW201426413A (en) | Three-dimensional interactive device and operation method thereof | |
| CN102253737A (en) | Screen-vision mouse system and realizing method thereof | |
| US20140333585A1 (en) | Electronic apparatus, information processing method, and storage medium | |
| KR20100109420A (en) | Large scale interactive display system based multi touch and method of the same | |
| JP2004246578A (en) | Interface method and device using self-image display, and program | |
| CN105593786A (en) | Gaze-assisted touchscreen inputs | |
| US20100153457A1 (en) | Gestural Interface Device and Method | |
| CN104407696A (en) | Virtual ball simulation and control method of mobile device | |
| TWI486815B (en) | Display device, system and method for controlling the display device | |
| KR20140057150A (en) | System and method for transfering content among devices using touch command and unusual touch | |
| TW201624196A (en) | A re-anchorable virtual panel in 3D space | |
| WO2021004413A1 (en) | Handheld input device and blanking control method and apparatus for indication icon of handheld input device | |
| CN108227923A (en) | A kind of virtual touch-control system and method based on body-sensing technology | |
| Park et al. | Interactive display of image details using a camera-coupled mobile projector | |
| TWI666580B (en) | Virtual input system | |
| Candela et al. | HumanTop: A multi-object tracking tabletop |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |