CN102253737B - Realizing method of screen-vision mouse system - Google Patents
Realizing method of screen-vision mouse system Download PDFInfo
- Publication number
- CN102253737B CN102253737B CN2011101446088A CN201110144608A CN102253737B CN 102253737 B CN102253737 B CN 102253737B CN 2011101446088 A CN2011101446088 A CN 2011101446088A CN 201110144608 A CN201110144608 A CN 201110144608A CN 102253737 B CN102253737 B CN 102253737B
- Authority
- CN
- China
- Prior art keywords
- screen
- operated
- infrared
- module
- pen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Position Input By Displaying (AREA)
Abstract
The invention discloses a screen-vision mouse system and a realizing method thereof, belonging to the technical field of computer input equipment. The screen-vision mouse system comprises a laser control pen and an integrate receiving device, wherein the laser control pen is provided with function buttons, a radio-frequency emission module and a double-wavelength laser emission module; the integrate receiving device comprises a camera module group, a radio-frequency receiving module and a signal processing module for processing information acquired by the camera module and the radio-frequencyreceiving module, an output end of the signal processing module is provided with a connector which is used for communicating with a computer mainframe; and a plurality of infrared receiving tubes arearranged around a nib of the laser control pen, and the infrared receiving tubes are connected with the radio-frequency emission module. The screen-vision mouse system and the realizing method thereof provided by the invention are simple in structure and low in cost, can realize both the remote non-contact control and the close-range screen direct input, and also can magnify object images on the screen.
Description
Technical field
The invention belongs to computer entry device technical field, and in particular to a kind of implementation method of screen-vision mouse system.
Background technology
With the development of digital technology, the input technology in man-machine interaction just develops into diversified input mode from traditional mouse, keyboard entry method.Such as with the prevalence of smart mobile phone and panel computer, the direct screen gesture input method of more hommization has been widely used, newest Windows7 formally supports gesture input mode, this make it that input can be carried out directly on the screen of output image, i.e. screen is directly inputted, without external connection keyboard and mouse.On the other hand, in the input of the large-screens such as teaching, exhibition, amusement, operator is often inputted away from screen by the way of remote control or line.In recent years wide variety of laser pen, RF remote-controlled and camera and image processing techniques so that contactless screen input is possibly realized.
Touch-screen input is by installing specific position detecting device on screen（Such as capactive film, resistive film, infrared electro matrix）To realize, produce signal conversion in touch screen surface touching by user's finger and realize control operation, contact gesture input can be realized by using special touch-screen or electronic whiteboard, can directly on screen writing words, move mouse pointer etc..
The mode directly inputted on screen is the direction of future development, small-sized electronic product can directly touch-screen input, it is very low compared with hour cost in input area, it is widely used, but then there are problems in the field such as common computer screen and giant-screen displaying, Entertainment in touch screen technology.
1. touch-screen input needs to use special equipment, this is accomplished by that liquid crystal display will be currently being widely used and CRT monitor is replaced with touch-screen display, and wide variety of projection screen then needs to be replaced by electronic whiteboard in teaching, exhibition, amusement.Not only price is higher for electronic whiteboard, laser projection system, and space-consuming, the independently installed wiring of needs, in addition, the positioning calibration operation of screen is relatively complicated.
2. current gesture input be contact input, that is, must reach over to or very close to screen carry out, so there are problems that screen abrasion and, more than also contact gesture input is realized in inconvenience on the large-scale projection screen of physical activity scope.
Although 3. remote control mouse laser pen can realize Untouched control, but mouse pointer still needs installs button or trace ball operation on tiny laser pen, operation convenience is restricted, and user is difficult to the operating experience obtained, and laser pen can not be write on ordinary screen.
The content of the invention
In order to solve the above problems, the present invention provide it is a kind of it is simple in construction, with low cost, can not only realize Remote Non-touch control but also can realize the implementation method of the closely screen-vision mouse system that screen is directly inputted.
A kind of screen-vision mouse system, including laser manipulation pen and integrated reception apparatus；
Laser manipulation pen is provided with function button, the radiofrequency emitting module for launching the control signal of function button, and to the dual-wavelength laser emitting mould train of screen emissions visible ray to be operated and infrared light；
The integrated reception apparatus includes obtaining the camera module of the image information of screen to be operated, the signal processing module for the information that Receiver Module, processing camera module and the Receiver Module of the transmission signal for receiving the radiofrequency emitting module are obtained；The signal processing module output end is provided with sets up the connector communicated with host computer；Be provided with outside the camera module it is moveable, the infrared filter of visible ray can be filtered；
The infrared receiving tube of multiple infrared lights that can be received and be closely reflected back from object is installed, the infrared acceptor is connected with the radiofrequency emitting module around the nib of the laser manipulation pen.
Wherein, the screen-vision mouse system also includes infrared writing pen, and the infrared writing pen includes that the dual wavelength light emitting diode of visible ray and infrared light can be sent, and controls the spring contact device of dual wavelength light emitting diode.
Wherein, the connector is integrated reception apparatus described in wired connection and host computer, the cable with USB plug, or is integrated reception apparatus described in wireless connection and the transmitter and wireless receiver of host computer.
Wherein, the integrated reception apparatus also includes the shell with transparent window, and the shell is provided with the positioning hole of fixed integrated reception apparatus.
Wherein, the function button includes left mouse button, right mouse button, keyboard PageUp keys, keyboard PageDown keys.
Wherein, the laser manipulation pen is additionally provided with the laser switch that control visible ray respectively and infrared light are opened and closed.
A kind of implementation method of screen-vision mouse system, including the remote control method away from screen operator to be operated, and the touch screen control method with screen close contact to be operated；
The step of remote control method, includes：
A. integrated reception apparatus is installed on screen oblique upper to be operated, left side or the back side, camera module is calibrated automatically；
Automatically calibration refers to the camera module：
Standard checker image is shown on screen to be operated, camera module obtains the checker image on screen to be operated, and contrasted with standard checker image, the matrix mapping transformation parameter of camera point and actual screen point is calculated and stored, finally shows that calibration is completed on screen；
B. laser manipulates pen to screen emissions dual-wavelength laser beam to be operated, and the camera module formed on screen to be operated in visible luminous point, integrated reception apparatus obtains the infrared optical image of the luminous point；
C. the signal processing module in integrated reception apparatus is filtered identification dot pattern picture coordinate after denoising Processing to the infrared optical image that camera module is obtained, corresponding screen actual coordinate is obtained after being calculated with matrix mapping transformation parameter, the screen actual coordinate data enter track data queue；
D. the cursor that the screen actual coordinate of luminous point is sent on host computer, host computer control screen to be operated by connector is moved to the coordinate position of luminous point；
E. the radiofrequency emitting module clicked on the function button on laser manipulation pen, laser manipulation pen launches the control signal of the function button；
F. the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module is sent, and send it to signal processing module, signal processing module carries out decoding to the control signal and is converted to control instruction, the control instruction is sent to host computer by connector, and host computer performs the control instruction and is shown on screen to be operated；
The step of touch screen control method, includes：
Step one：Integrated reception apparatus is installed on screen oblique upper to be operated, left side or the back side, camera module is calibrated automatically；
Automatically calibration refers to the camera module：
Standard checker image is shown on screen to be operated, camera module obtains the checker image on screen to be operated, and contrasted with standard checker image, the matrix mapping transformation parameter of camera point and actual screen point is calculated and stored, finally shows that calibration is completed on screen；
Step 2：Laser manipulates pen to screen emissions dual-wavelength laser beam to be operated, visible luminous point is formed on screen to be operated, a laser manipulation nib is touched into screen, when nib is less than 5mm apart from screen, the infrared receiving tube on laser manipulation pen receives the infrared light reflected from screen；
Step 3：The control signal of left mouse button is pressed in the radiofrequency emitting module transmitting for the infrared optical drive laser manipulation pen that infrared receiving tube is received；
Step 4：The Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module is sent, and send it to signal processing module, signal processing module carries out decoding to the control signal and is converted to control instruction, the control instruction is sent to host computer by connector, and host computer performs left mouse button control instruction and includes result on screen to be operated；
Step 5：The application software writing function on pen click screen to be operated is manipulated with laser, into writing state；
Step 6：Laser manipulation pen is moved on screen to be operated, and the light spot position being incident upon on screen to be operated also changes therewith, and the camera module in integrated reception apparatus obtains the infrared optical image of the luminous point；
Step 7：Signal processing module in integrated reception apparatus is filtered identification dot pattern picture coordinate after denoising Processing to the infrared optical image that camera module is obtained, corresponding screen actual coordinate is obtained after being calculated with matrix mapping transformation parameter, the screen actual coordinate data enter track data queue；
Step 8：The screen actual coordinate of luminous point is sent to host computer by connector, and host computer controls the mouse pointer on screen to be operated to be moved to the coordinate position of luminous point, occurs the track of laser manipulation pen movement on the position of mouse pointer process, screen to be operated；
Step 9：By the nib of laser manipulation pen away from screen to be operated, when nib is more than or equal to 5mm apart from screen, the infrared signal that infrared receiving tube is received disappears, and radiofrequency emitting module stops emission signal, mouse pointer reduction, terminates track drafting.
Wherein, the touch screen control method also includes many people's input modes recognized based on many luminous points：Step 10：Laser manipulation pen irradiates one luminous point of formation on screen to be operated, the nib of infrared writing pen is pressed into screen, the spring contact device of infrared writing pen connects dual wavelength LED power source, send visible ray and infrared light, the infrared writing pen camera module that irradiation is formed in another luminous point, integrated reception apparatus on screen to be operated obtains the infrared optical image of two luminous points；
Step 11：Signal processing module in integrated reception apparatus moves trajectory extraction to the infrared optical image that camera module is obtained, and by the information transmission of extraction to host computer, host computer, which is made, to be responded and be shown on screen to be operated accordingly.
Wherein, the remote control method also includes many people's input modes recognized based on many luminous points：G. laser manipulation pen irradiates one luminous point of formation on screen to be operated, the nib of infrared writing pen is pressed into screen, the spring contact device of infrared writing pen connects dual wavelength LED power source, send visible ray and infrared light, the infrared writing pen camera module that irradiation is formed in another luminous point, integrated reception apparatus on screen to be operated obtains the infrared optical image of two luminous points；
H. the signal processing module in integrated reception apparatus moves trajectory extraction to the infrared optical image that camera module is obtained, and by the information transmission of extraction to host computer, host computer, which is made, to be responded and be shown on screen to be operated accordingly.
Wherein, the step A and calculating in step one and store the matrix mapping transformation parameter of camera point and actual screen point and specifically refer to：
The four angular coordinate of checker is extracted in the image that signal processing module is absorbed from camera module（X1, y1）、（X2, y2）、（X3, y3）With（X4, y4）, the actual coordinate of combined standard checker figure（X1, Y1）、（X2, Y2）、（X3, Y3）With（X4, Y4）, calibration parameter A, B, C, D, E, F, G, H are calculated by following equations group：
Signal processing module solves equation group by Gaussian elimination method, and then A, B, C, D, E, F, G, H value are stored in Flash internal memories；
A, B, C, D, E, F, G, H value are read from internal memory, coordinate will be imaged by following formula（x,y）It is mapped to screen actual coordinate（X, Y）：
X=(A*x+B*y+C)/(x+G*y+H); Y=(D*x+E*y+F)/(x+G*y+H)。
The beneficial effects of the invention are as follows：1. the screen-vision mouse system of the present invention combines photoelectricity positioning and RF remote-controlled technology, coordinate to move and click on mouse with infrared photography and radio-frequency communication.Screen long distance positioning preferably is realized with the highly directive feature of laser, while realized with radio frequency non-directive feature comprehensive without dead angle remote control again.
Can be that dual wavelength light emitting diode is installed on dual-wavelength laser pipe, infrared writing pen 2. being provided with dual-wavelength laser emitting mould train on laser manipulation pen.Visible ray, which is incident upon on screen, forms luminous point, plays the indicating effect of common laser pen, and infrared light is prevented effectively from the interference of visible ray by being used for positioning by camera intake after filter.
3. the visible light part of laser manipulation pen is not used in identification, flexibly configurable.Both can also be able to be green, blue laser from red laser.Operator only can realize the screen interaction without visible point of light by a transmitting infrared portions, can also only transmitting visible light part and ignore and interacted with screen.
4. laser manipulation pen is realized close to automatically clicking left mouse button during screen with light reflection proximity switch principle.Multiple infrared receiving tubes are housed i.e. around nib, for whether measuring nib close to screen, when nib is write close to screen, infrared receiving tube can receive the infrared light being reflected back from screen, equivalent to left mouse button is pressed, clicking, double-clicking, dragging and writing function on screen is can be achieved with the case where being not required to button.Multiple infrared receiving tubes are designed on pen, when can ensure that nib with any posture close to screen, the light reflected can be all received.
5. being provided with radiofrequency emitting module on laser manipulation pen, mouse or keyboard signal can be launched.
6. the screen-vision mouse system of the present invention have also been devised a kind of practical dual wavelength infrared writing pen of with low cost, structure, it can be used cooperatively with laser manipulation pen, realize that screen gesture is operated, can also realize many people screen writing simultaneously.
7. the screen-vision mouse system of the present invention can be installed on different sizes, the computer of material screen, it can be applied to include any display screens such as common display screen, curtain, wall curtain, LED array.System is calibrated automatically by the comparison of standard picture and intake image, is not required to human assistance, is not influenceed by screen resolution.
8. the reception device of the screen-vision mouse system of the present invention incorporates camera module, Receiver Module and signal processing module, the USB interface that host computer need to be taken as generic USB mouse is connected with computer, but realize the irrealizable multiple spot screen interactive function of common mouse, it can also be connected using wireless mouse mode, without wiring.
Brief description of the drawings
Fig. 1 is screen-vision mouse system remote control implement scene figure of the invention.
Fig. 2 manipulates implement scene figure for the screen-vision mouse system touch screen of the present invention.
Fig. 3 is Fig. 2 many people's input mode implement scene figures.
Fig. 4 is the schematic flow sheet of the screen-vision mouse system remote control of the present invention.
The schematic flow sheet that Fig. 5 manipulates for the screen-vision mouse system touch screen of the present invention.
Embodiment
In order that the object, technical solution and advantage of invention are more clearly understood, below in conjunction with drawings and Examples, the present invention will be described in further detail.
Specific embodiment：
Referring to Fig. 1 to Fig. 5, a kind of screen-vision mouse system, including laser manipulation pen and integrated reception apparatus；
Laser manipulation pen is provided with function button, the radiofrequency emitting module for launching the control signal of function button, and to the dual-wavelength laser emitting mould train of screen emissions visible ray to be operated and infrared light；
The integrated reception apparatus includes obtaining the camera module of the image information of screen to be operated, the signal processing module for the information that Receiver Module, processing camera module and the Receiver Module of the transmission signal for receiving the radiofrequency emitting module are obtained；The signal processing module output end is provided with sets up the connector communicated with host computer；Be provided with outside the camera module it is moveable, the infrared filter of visible ray can be filtered；The infrared filter is configured to that part or manual moving parts can be automatically moved；
The infrared receiving tube of multiple infrared lights that can be received and be closely reflected back from object, and related nib light channel structure are installed, the infrared acceptor is connected with the radiofrequency emitting module around the nib of the laser manipulation pen.
Wherein, the screen-vision mouse system also includes infrared writing pen, and the infrared writing pen includes that the dual wavelength light emitting diode of visible ray and infrared light can be sent, and controls the spring contact device of dual wavelength light emitting diode.
Wherein, the connector is integrated reception apparatus described in wired connection and host computer, the cable with USB plug, or is integrated reception apparatus described in wireless connection and the transmitter and wireless receiver of host computer.
Wherein, the integrated reception apparatus also includes the shell with transparent window, and the shell is provided with the positioning hole of fixed integrated reception apparatus.
Wherein, the function button includes left mouse button, right mouse button, keyboard PageUp keys, keyboard PageDown keys.
Wherein, the laser manipulation pen is additionally provided with the laser switch that control laser is opened and closed.
Wherein, the radiofrequency emitting module is NRF24L01 radiofrequency emitting modules.
The signal processing module of integrated reception apparatus is equipped with microprocessor, the microprocessor uses a piece of STM32F103 enhanced high-speeds 32-bit microprocessor, the image passed back to camera module is quickly handled, quickly recognize one or more infrared light spot positions, one group of data input of the processor is connected with the digital output end of camera module, and another group of data input is connected with the data output end of Receiver Module.The method of microprocessor identification light spot position is that video frame images are progressively scanned, and the amount of pixels in clear zone of adding up then thinks that the position has luminous point when amount of pixels reaches setting value.When scanning reaches setting value to the cumulative amount of pixels in another clear zone, then it is assumed that have more than one luminous point（I.e. branched light pen）.
A kind of implementation method of screen-vision mouse system, including the remote control method away from screen operator to be operated, and the touch screen control method with screen close contact to be operated；
The step of remote control method, includes：
A. integrated reception apparatus is installed on screen oblique upper to be operated, left side or the back side, camera module is calibrated automatically；
Automatically calibration refers to the camera module：
Standard checker image is shown on screen to be operated, camera module obtains the checker image on screen to be operated, and contrasted with standard checker image, the matrix mapping transformation parameter of camera point and actual screen point is calculated and stored, finally shows that calibration is completed on screen；
B. laser manipulates pen to screen emissions dual-wavelength laser beam to be operated, and the camera module formed on screen to be operated in visible luminous point, integrated reception apparatus obtains the infrared optical image of the luminous point；
C. the signal processing module in integrated reception apparatus is filtered identification dot pattern picture coordinate after denoising Processing to the infrared optical image that camera module is obtained, corresponding screen actual coordinate is obtained after being calculated with calibration parameter, the screen actual coordinate data enter track data queue；
D. the cursor that the screen actual coordinate of luminous point is sent on host computer, host computer control screen to be operated by connector is moved to the coordinate position of luminous point；Host computer projects image onto screen to be operated by equipment such as projecting apparatus；
E. the radiofrequency emitting module clicked on the function button on laser manipulation pen, laser manipulation pen launches the control signal of the function button；
F. the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module is sent, and send it to signal processing module, signal processing module carries out decoding to the control signal and is converted to control instruction, the control instruction is sent to host computer by connector, and host computer performs the control instruction and is shown on screen to be operated；Integrated reception apparatus receives the luminous point of screen, and producing similar common optical mouse by signal processing module detects the mouse mobile data that luminous point is moved, and the mouse mobile data is sent to host computer, can produce common mouse movement identical effect；
The step of touch screen control method, includes：
Step one：Integrated reception apparatus is installed on screen oblique upper to be operated, left side or the back side, camera module is calibrated automatically；
Automatically calibration refers to the camera module：
Standard checker image is shown on screen to be operated, camera module obtains the checker image on screen to be operated, and contrasted with standard checker image, the matrix mapping transformation parameter of camera point and actual screen point is calculated and stored, finally shows that calibration is completed on screen；
Step 2：Laser manipulates pen to screen emissions dual-wavelength laser beam to be operated, visible luminous point is formed on screen to be operated, a laser manipulation nib is touched into screen, when nib is less than 5mm apart from screen, the infrared receiving tube on laser manipulation pen receives the infrared light reflected from screen；
Step 3：The control signal of left mouse button is pressed in the radiofrequency emitting module transmitting for the infrared optical drive laser manipulation pen that infrared receiving tube is received；
Step 4：The Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module is sent, and send it to signal processing module, signal processing module carries out decoding to the control signal and is converted to control instruction, the control instruction is sent to host computer by connector, and host computer performs left mouse button control instruction and includes result on screen to be operated；
Step 5：The application software writing function on pen click screen to be operated is manipulated with laser, into writing state；
Step 6：Laser manipulation pen is moved on screen to be operated, and the light spot position being incident upon on screen to be operated also changes therewith, and the camera module in integrated reception apparatus obtains the infrared optical image of the luminous point；
Step 7：Signal processing module in integrated reception apparatus is filtered identification dot pattern picture coordinate after denoising Processing to the infrared optical image that camera module is obtained, corresponding screen actual coordinate is obtained after being calculated with matrix mapping transformation parameter, the screen actual coordinate data enter track data queue；
Step 8：The screen actual coordinate of luminous point is sent to host computer by connector, and host computer controls the mouse pointer on screen to be operated to be moved to the coordinate position of luminous point, occurs the track of laser manipulation pen movement on the position of mouse pointer process, screen to be operated；
Step 9：By the nib of laser manipulation pen away from screen to be operated, when nib is more than or equal to 5mm apart from screen, the infrared signal that infrared receiving tube is received disappears, and radiofrequency emitting module stops emission signal, mouse pointer reduction, terminates track drafting.
Wherein, the touch screen control method also includes many people's input modes recognized based on many luminous points：Step 10：Laser manipulation pen irradiates one luminous point of formation on screen to be operated, the nib of infrared writing pen is pressed into screen, the spring contact device of infrared writing pen connects dual wavelength LED power source, send visible ray and infrared light, the infrared writing pen camera module that irradiation is formed in another luminous point, integrated reception apparatus on screen to be operated obtains the infrared optical image of two luminous points；
Step 11：Signal processing module in integrated reception apparatus moves trajectory extraction to the infrared optical image that camera module is obtained, and by the information transmission of extraction to host computer, host computer, which is made, to be responded and be shown on screen to be operated accordingly.
Wherein, the remote control method also includes many people's input modes recognized based on many luminous points：G. laser manipulation pen irradiates one luminous point of formation on screen to be operated, the nib of infrared writing pen is pressed into screen, the spring contact device of infrared writing pen connects dual wavelength LED power source, send visible ray and infrared light, the infrared writing pen camera module that irradiation is formed in another luminous point, integrated reception apparatus on screen to be operated obtains the infrared optical image of two luminous points；
H. the signal processing module in integrated reception apparatus moves trajectory extraction to the infrared optical image that camera module is obtained, and by the information transmission of extraction to host computer, host computer, which is made, to be responded and be shown on screen to be operated accordingly.
Wherein, the step A and calculating in step one and store the matrix mapping transformation parameter of camera point and actual screen point and specifically refer to：
The four angular coordinate of checker is extracted in the image that signal processing module is absorbed from camera module（X1, y1）、（X2, y2）、（X3, y3）With（X4, y4）, the actual coordinate of combined standard checker figure（X1, Y1）、（X2, Y2）、（X3, Y3）With（X4, Y4）, calibration parameter A, B, C, D, E, F, G, H are calculated by following equations group：
Signal processing module solves equation group by Gaussian elimination method, and then A, B, C, D, E, F, G, H value are stored in Flash internal memories；
A, B, C, D, E, F, G, H value are read from internal memory, coordinate will be imaged by following formula（x,y）It is mapped to screen actual coordinate（X, Y）：
X=(A*x+B*y+C)/(x+G*y+H); Y=(D*x+E*y+F)/(x+G*y+H)。
Material object can also be amplified to screen shows by the screen-vision mouse system of the present invention（Which can make screen have the function of projector for real object）：Set host computer software to enter objects projection amplification mode, the infrared fileter of camera module is removed, absorb visible ray screen image, and show in the screen picture lower left corner one white material object capture area；
The material object projected will be needed to amplify（The printed matters such as books paper, student's exercises etc.）It is fixed on the capture zone position in kind of screen；
Camera module extracts the image in capture area in kind from the screen image of intake, image is filtered and contrast enhancing, is then amplified to full screen and shows（The white capture region of the full-screen image not cover screen）.
The beneficial effect of screen-vision mouse system of the present invention is：1. the screen-vision mouse system of the present invention combines photoelectricity positioning and RF remote-controlled technology, coordinate to move and click on mouse with infrared photography and radio-frequency communication.Screen long distance positioning preferably is realized with the highly directive feature of laser, while realized with radio frequency non-directive feature comprehensive without dead angle remote control again.
Can be that dual wavelength light emitting diode is installed on dual-wavelength laser pipe, infrared writing pen 2. being provided with dual-wavelength laser emitting mould train on laser manipulation pen.The visible ray of 660nm wavelength, which is incident upon on screen, forms luminous point, the indicating effect of common laser pen is played, while the infrared light of 780nm wavelength is prevented effectively from the interference of visible ray by being used for positioning by camera intake after filter.
3. the visible light part of laser manipulation pen is not used in identification, flexibly configurable.Both can also be able to be green, blue laser from red laser.Operator only can realize the screen interaction without visible point of light by a transmitting infrared portions, can also only transmitting visible light part and ignore and interacted with screen.
4. laser manipulation pen is realized close to automatically clicking left mouse button during screen with light reflection proximity switch principle.Multiple infrared receiving tubes are housed i.e. around nib, for whether measuring nib close to screen, when nib is write close to screen, infrared receiving tube can receive the infrared light being reflected back from screen, equivalent to left mouse button is pressed, clicking, double-clicking, dragging and writing function on screen is can be achieved with the case where being not required to button.Multiple infrared receiving tubes are designed on pen, when can ensure that nib with any posture close to screen, the light reflected can be all received.
5. being provided with radiofrequency emitting module on laser manipulation pen, mouse or keyboard signal can be launched.
6. the screen-vision mouse system of the present invention have also been devised a kind of practical dual wavelength infrared writing pen of with low cost, structure, it can be used cooperatively with laser manipulation pen, realize that screen gesture is operated, can also realize many people screen writing simultaneously.
7. the screen-vision mouse system of the present invention can be installed on different sizes, the computer of material screen, it can be applied to include any display screens such as common display screen, curtain, wall curtain, LED array.System is calibrated automatically by the comparison of standard picture and intake image, is not required to human assistance, is not influenceed by screen resolution.
8. the reception device of the screen-vision mouse system of the present invention incorporates camera module, Receiver Module and signal processing module, the USB interface that host computer need to be taken as generic USB mouse is connected with computer, but realize the irrealizable multiple spot screen interactive function of common mouse, it can also be connected using wireless mouse mode, without wiring.
Above content is only presently preferred embodiments of the present invention, for one of ordinary skill in the art, according to the thought of the present invention, be will change in specific embodiments and applications, this specification content should not be construed as limiting the invention.
Claims (2)
1. a kind of implementation method of screen-vision mouse system, the screen-vision mouse system includes laser and manipulates pen and integrated reception apparatus；
Laser manipulation pen is provided with function button, the radiofrequency emitting module for launching the control signal of function button, and to the dual-wavelength laser emitting mould train of screen emissions visible ray to be operated and infrared light；
The integrated reception apparatus includes obtaining the camera module of the image information of screen to be operated, the signal processing module for the information that Receiver Module, processing camera module and the Receiver Module of the transmission signal for receiving the radiofrequency emitting module are obtained；The signal processing module output end is provided with sets up the connector communicated with host computer；Be provided with outside the camera module it is moveable, the infrared filter of visible ray can be filtered；
The infrared receiving tube of multiple infrared lights that can be received and be closely reflected back from object is installed, the infrared acceptor is connected with the radiofrequency emitting module around the nib of the laser manipulation pen；It is characterized in that：Including the remote control method away from screen operator to be operated, and the touch screen control method with screen close contact to be operated；
The step of remote control method, includes：
A. integrated reception apparatus is installed on screen oblique upper to be operated, left side or the back side, camera module is calibrated automatically；
Automatically calibration refers to the camera module：
Standard checker image is shown on screen to be operated, camera module obtains the checker image on screen to be operated, and contrasted with standard checker image, the matrix mapping transformation parameter of camera point and actual screen point is calculated and stored, finally shows that calibration is completed on screen；
B. laser manipulates pen to screen emissions dual-wavelength laser beam to be operated, and the camera module formed on screen to be operated in visible luminous point, integrated reception apparatus obtains the infrared optical image of the luminous point；
C. the signal processing module in integrated reception apparatus is filtered identification dot pattern picture coordinate after denoising Processing to the infrared optical image that camera module is obtained, corresponding screen actual coordinate is obtained after being calculated with calibration parameter, the screen actual coordinate data enter track data queue；
D. the cursor that the screen actual coordinate of luminous point is sent on host computer, host computer control screen to be operated by connector is moved to the coordinate position of luminous point；
E. the radiofrequency emitting module clicked on the function button on laser manipulation pen, laser manipulation pen launches the control signal of the function button；
F. the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module is sent, and send it to signal processing module, signal processing module carries out decoding to the control signal and is converted to control instruction, the control instruction is sent to host computer by connector, and host computer performs the control instruction and is shown on screen to be operated；
The step of touch screen control method, includes：
Step one：Integrated reception apparatus is installed on screen oblique upper to be operated, left side or the back side, camera module is calibrated automatically；
Automatically calibration refers to the camera module：
Standard checker image is shown on screen to be operated, camera module obtains the checker image on screen to be operated, and contrasted with standard checker image, the matrix mapping transformation parameter of camera point and actual screen point is calculated and stored, finally shows that calibration is completed on screen；
Step 2：Laser manipulates pen to screen emissions dual-wavelength laser beam to be operated, visible luminous point is formed on screen to be operated, a laser manipulation nib is touched into screen, when nib is less than 5mm apart from screen, the infrared receiving tube on laser manipulation pen receives the infrared light reflected from screen；
Step 3：The control signal of left mouse button is pressed in the radiofrequency emitting module transmitting for the infrared optical drive laser manipulation pen that infrared receiving tube is received；
Step 4：The Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module is sent, and send it to signal processing module, signal processing module carries out decoding to the control signal and is converted to control instruction, the control instruction is sent to host computer by connector, and host computer performs left mouse button control instruction and includes result on screen to be operated；
Step 5：The application software writing function on pen click screen to be operated is manipulated with laser, into writing state；
Step 6：Laser manipulation pen is moved on screen to be operated, and the light spot position being incident upon on screen to be operated also changes therewith, and the camera module in integrated reception apparatus obtains the infrared optical image of the luminous point；
Step 7：Signal processing module in integrated reception apparatus is filtered identification dot pattern picture coordinate after denoising Processing to the infrared optical image that camera module is obtained, corresponding screen actual coordinate is obtained after being calculated with matrix mapping transformation parameter, the screen actual coordinate data enter track data queue；
Step 8：The screen actual coordinate of luminous point is sent to host computer by connector, and host computer controls the mouse pointer on screen to be operated to be moved to the coordinate position of luminous point, occurs the track of laser manipulation pen movement on the position of mouse pointer process, screen to be operated；
Step 9：By the nib of laser manipulation pen away from screen to be operated, when nib is more than or equal to 5mm apart from screen, the infrared signal that infrared receiving tube is received disappears, and radiofrequency emitting module stops emission signal, mouse pointer reduction, terminates track drafting；
The step A and calculating in step one simultaneously store the matrix mapping transformation parameter of camera point and actual screen point and specifically referred to：
The four angular coordinate of checker is extracted in the image that signal processing module is absorbed from camera module（X1, y1）、（X2, y2）、（X3, y3）With（X4, y4）, the actual coordinate of combined standard checker figure（X1, Y1）、（X2, Y2）、（X3, Y3）With（X4, Y4）, calibration parameter A, B, C, D, E, F, G, H are calculated by following equations group：
Signal processing module solves equation group by Gaussian elimination method, and then A, B, C, D, E, F, G, H value are stored in Flash internal memories；
A, B, C, D, E, F, G, H value are read from internal memory, coordinate will be imaged by following formula（x,y）It is mapped to screen actual coordinate（X, Y）：
X=(A*x+B*y+C)/(x+G*y+H); Y=(D*x+E*y+F)/(x+G*y+H)。
2. a kind of implementation method of screen-vision mouse system according to claim 1, it is characterised in that：The touch screen control method also includes many people's input modes recognized based on many luminous points：Step 10：Laser manipulation pen irradiates one luminous point of formation on screen to be operated, the nib of infrared writing pen is pressed into screen, the spring contact device of infrared writing pen connects dual wavelength LED power source, send visible ray and infrared light, the infrared writing pen camera module that irradiation is formed in another luminous point, integrated reception apparatus on screen to be operated obtains the infrared optical image of two luminous points；
Step 11：Signal processing module in integrated reception apparatus moves trajectory extraction to the infrared optical image that camera module is obtained, and by the information transmission of extraction to host computer, host computer, which is made, to be responded and be shown on screen to be operated accordingly.
3. a kind of implementation method of screen-vision mouse system according to claim 1, it is characterised in that：The remote control method also includes many people's input modes recognized based on many luminous points：G. laser manipulation pen irradiates one luminous point of formation on screen to be operated, the nib of infrared writing pen is pressed into screen, the spring contact device of infrared writing pen connects dual wavelength LED power source, send visible ray and infrared light, the infrared writing pen camera module that irradiation is formed in another luminous point, integrated reception apparatus on screen to be operated obtains the infrared optical image of two luminous points；
H. the signal processing module in integrated reception apparatus moves trajectory extraction to the infrared optical image that camera module is obtained, and by the information transmission of extraction to host computer, host computer, which is made, to be responded and be shown on screen to be operated accordingly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101446088A CN102253737B (en) | 2011-05-31 | 2011-05-31 | Realizing method of screen-vision mouse system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101446088A CN102253737B (en) | 2011-05-31 | 2011-05-31 | Realizing method of screen-vision mouse system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102253737A CN102253737A (en) | 2011-11-23 |
| CN102253737B true CN102253737B (en) | 2013-07-17 |
Family
ID=44981034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011101446088A Expired - Fee Related CN102253737B (en) | 2011-05-31 | 2011-05-31 | Realizing method of screen-vision mouse system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102253737B (en) |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102622108B (en) * | 2012-01-18 | 2015-11-04 | 深圳市中科睿成智能科技有限公司 | A kind of interactive projection system and its implementation |
| CN102662498B (en) * | 2012-04-16 | 2015-09-30 | 中科华核电技术研究院有限公司 | A kind of wireless control method of projection demonstration and system |
| CN102819327A (en) * | 2012-07-26 | 2012-12-12 | 郑州信大捷安信息技术股份有限公司 | Interactive projection system of infrared positioning wireless control and realizing method thereof |
| CN102945091B (en) * | 2012-11-20 | 2015-11-18 | 深圳市中科睿成智能科技有限公司 | A kind of man-machine interaction method based on laser projection location and system |
| WO2014078973A1 (en) * | 2012-11-21 | 2014-05-30 | Tsao Yung Hsin | Method for executing virtual touch control using infrared rays and infrared positioning stylus |
| CN103135805B (en) * | 2013-02-05 | 2016-01-06 | 深圳市中科睿成智能科技有限公司 | A kind of switched system of project near point control and Long-distance Control and method |
| CN103268170A (en) * | 2013-04-26 | 2013-08-28 | 国家电网公司 | Positioning device and positioning method for forming and outputting continuous coordinates by aid of pointed positions of image identification laser pointer |
| CN103294196A (en) * | 2013-05-15 | 2013-09-11 | 陈创举 | Head-operated mouse |
| CN103760998A (en) * | 2014-02-19 | 2014-04-30 | 赵威 | Method for achieving laser pen ultra-bright cursor identification with CCD sensor over exposure |
| CN104898956B (en) * | 2014-03-07 | 2019-10-29 | 联想(北京)有限公司 | Information processing method, input equipment and electronic equipment |
| CN104615273A (en) * | 2014-12-08 | 2015-05-13 | 沈阳工业大学 | Wearable remote wireless controller |
| CN106445090B (en) * | 2015-08-12 | 2021-02-23 | 中兴通讯股份有限公司 | Method and device for controlling cursor and input equipment |
| CN105607785B (en) | 2016-01-04 | 2019-11-12 | 京东方科技集团股份有限公司 | Touch control display system and touch control operation device |
| CN105843426A (en) * | 2016-03-19 | 2016-08-10 | 广州能欣计算机技术有限公司 | Vision based multi-laser-mouse-pen pointing, locating and interaction method |
| CN105786224A (en) * | 2016-03-29 | 2016-07-20 | 电子科技大学 | Universal laser pointer and computer operation method |
| CN106550108B (en) * | 2016-09-08 | 2020-01-10 | 珠海格力电器股份有限公司 | Device and method for realizing mouse function by using mobile phone and mobile phone with device |
| CN106843602B (en) * | 2016-10-11 | 2022-01-28 | 南京仁光电子科技有限公司 | Large-screen remote control interaction system and interaction method thereof |
| CN108021243B (en) * | 2016-10-31 | 2020-11-06 | 中国移动通信有限公司研究院 | Method, device and system for determining position of virtual mouse |
| CN106775025A (en) * | 2017-01-25 | 2017-05-31 | 王正贤 | Distance type optical mouse and application method |
| CN107170326B (en) * | 2017-07-03 | 2020-11-24 | 如东道博智能设备有限公司 | Method for facilitating student to feed back understanding situation of teaching to teacher |
| CN109407859A (en) * | 2017-08-15 | 2019-03-01 | 北京仁光科技有限公司 | Based on man-machine interaction method, equipment and system in kind |
| CN107823883B (en) * | 2017-11-21 | 2020-12-29 | 河南黄烨科技有限公司 | Aiming point screen coordinate obtaining method based on image recognition and laser positioning |
| CN110244835A (en) * | 2018-03-08 | 2019-09-17 | 北京仁光科技有限公司 | Based on man-machine interaction method, device, equipment, medium and system in kind |
| CN108595026A (en) * | 2018-03-28 | 2018-09-28 | 中山大学 | A kind of new infrared laser pen for realizing mouse function |
| CN109144375B (en) * | 2018-10-09 | 2022-08-19 | 中天智领（北京）科技有限公司 | Screen control method and device |
| CN109712559B (en) * | 2019-01-14 | 2020-05-15 | 浙江大学 | Non-sensing LED dot matrix screen display interaction device and method |
| CN112328158A (en) * | 2020-07-23 | 2021-02-05 | 深圳Tcl新技术有限公司 | Interactive method, display device, transmitting device, interactive system and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1534544A (en) * | 2003-04-01 | 2004-10-06 | 中国科学院电子学研究所 | Large screen non contact type control mode |
| CN1687886A (en) * | 2005-04-08 | 2005-10-26 | 清华大学 | Remote-wireless controller for computer |
| CN1746831A (en) * | 2004-09-08 | 2006-03-15 | 上海迪比特实业有限公司 | Interactive projection system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100060611A1 (en) * | 2008-09-05 | 2010-03-11 | Sony Ericsson Mobile Communication Ab | Touch display with switchable infrared illumination for touch position determination and methods thereof |
-
2011
- 2011-05-31 CN CN2011101446088A patent/CN102253737B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1534544A (en) * | 2003-04-01 | 2004-10-06 | 中国科学院电子学研究所 | Large screen non contact type control mode |
| CN1746831A (en) * | 2004-09-08 | 2006-03-15 | 上海迪比特实业有限公司 | Interactive projection system |
| CN1687886A (en) * | 2005-04-08 | 2005-10-26 | 清华大学 | Remote-wireless controller for computer |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102253737A (en) | 2011-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102253737B (en) | Realizing method of screen-vision mouse system | |
| CN102436327B (en) | Screen input system and implementation method thereof | |
| JP5567206B2 (en) | Computing device interface | |
| CN102880360B (en) | Infrared type multi-point interaction electric whiteboard system and blank Projection surveying method | |
| US20120249422A1 (en) | Interactive input system and method | |
| CN103365549B (en) | Input unit, display system and input method | |
| CN101963871A (en) | Optical touch control system based on infrared spotlight recognition and realization method thereof | |
| US20140062863A1 (en) | Method and apparatus for setting electronic blackboard system | |
| CN101859210A (en) | Interactive projection system and implementation method thereof | |
| TW201426413A (en) | Three-dimensional interactive device and operation method thereof | |
| CN102713809A (en) | Whiteboard with tool tray incorporating a processor | |
| CN102662498A (en) | Wireless control method and system for projection demonstration | |
| CN103609093B (en) | A kind of interactive mobile phone | |
| CN100478860C (en) | Electronic plane display positioning system and positioning method | |
| JP2009140498A (en) | Information input/output device and information input/output method | |
| CN102722254A (en) | Method and system for location interaction | |
| CN202110500U (en) | Visual mouse system of screen | |
| CN107682595B (en) | interactive projection method, system and computer readable storage medium | |
| US11907466B2 (en) | Apparatus and method which displays additional information along with a display component in response to the display component being selected | |
| CN202257528U (en) | Screen input system | |
| CN201369027Y (en) | Remote finger virtual touch system with infrared laser pen | |
| CN102915126A (en) | Method, device and system of light ray remote-control positioning | |
| CN202049451U (en) | Novel optical touch pen and optical touch system | |
| CN203606780U (en) | Multi-touch and gesture recognition fusion system | |
| WO2014181587A1 (en) | Portable terminal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130717 Termination date: 20150531 |
|
| EXPY | Termination of patent right or utility model |