CN102253737A - Screen-vision mouse system and realizing method thereof - Google Patents
Screen-vision mouse system and realizing method thereof Download PDFInfo
- Publication number
- CN102253737A CN102253737A CN2011101446088A CN201110144608A CN102253737A CN 102253737 A CN102253737 A CN 102253737A CN 2011101446088 A CN2011101446088 A CN 2011101446088A CN 201110144608 A CN201110144608 A CN 201110144608A CN 102253737 A CN102253737 A CN 102253737A
- Authority
- CN
- China
- Prior art keywords
- screen
- laser
- pen
- module
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Position Input By Displaying (AREA)
Abstract
The invention discloses a screen-vision mouse system and a realizing method thereof, belonging to the technical field of computer input equipment. The screen-vision mouse system comprises a laser control pen and an integrate receiving device, wherein the laser control pen is provided with function buttons, a radio-frequency emission module and a double-wavelength laser emission module; the integrate receiving device comprises a camera module group, a radio-frequency receiving module and a signal processing module for processing information acquired by the camera module and the radio-frequency receiving module, an output end of the signal processing module is provided with a connector which is used for communicating with a computer mainframe; and a plurality of infrared receiving tubes are arranged around a nib of the laser control pen, and the infrared receiving tubes are connected with the radio-frequency emission module. The screen-vision mouse system and the realizing method thereof provided by the invention are simple in structure and low in cost, can realize both the remote non-contact control and the close-range screen direct input, and also can magnify object images on the screen.
Description
Technical field
The invention belongs to the computer entry device technical field, be specifically related to a kind of screen vision mouse system and its implementation.
Background technology
Along with the development of digital technology, the input technology in the man-machine interaction just develops into diversified input mode from traditional mouse, keyboard entry method.Popular as along with smart mobile phone and panel computer, the direct screen gesture input method of hommization is widely used more, up-to-date Windows7 formally supports the gesture input mode, this feasible input can directly be carried out on the screen of output image, be that screen is directly imported, thereby need not external connection keyboard and mouse.On the other hand, in the input of large-screen such as teaching, exhibition, amusement, the operator often adopts the mode of remote control or line to import away from screen.The laser pen of widespread use in recent years, RF remote-controlled and camera and image processing techniques make contactless screen input become possibility.
Touch-screen input is to realize by certain location pick-up unit (as capactive film, resistive film, infrared electro matrix etc.) is installed on screen, produce signal transformation by user's finger in the touch screen surface touching and realize control operation, can realize the input of contact gesture, directly writing words, rolling mouse pointer etc. on screen by using special touch-screen or electronic whiteboard.
The mode of directly importing on screen is the direction of future development, directly touch-screen input of small-sized electronic product, the input area when less cost very low, be widely used, but then there are problems in the touch screen technology in fields such as common computer screen and giant-screen displaying, Entertainments.
1. touch-screen input need be adopted special equipment, and this just needs current widely used LCD and CRT monitor are replaced with touch-screen display, and the projection screen of widespread use then needs to be replaced by electronic whiteboard in teaching, exhibition, amusement.Electronic whiteboard, laser projection system not only price are higher, and take up room, need independent installation wiring, and in addition, the location calibration operation of screen is comparatively loaded down with trivial details.
2. the input of present gesture is the contact input, promptly must contact or carries out near screen very much, has problems such as screen wearing and tearing and health like this, greater than on the large-scale projection screen of physical activity scope also inconvenience realization contact gesture import.
3. though the remote control mouse laser pen can be realized contactless control, but mouse pointer still need be installed the operation of button or trace ball on tiny laser pen, operation convenience is restricted, the operating experience that the user is difficult to obtain, and laser pen can't be write on ordinary screen.
Summary of the invention
In order to address the above problem, the invention provides a kind of simple in structure, with low cost, not only can realize long-range contactless control but also can realize closely screen directly screen vision mouse system and its implementation of input.
A kind of screen vision mouse system, comprise laser control the pen and integrated reception apparatus;
Described laser is controlled the radiofrequency emitting module that pen is equipped with function button, the control signal of function button is launched, and to the dual-wavelength laser emitting mould train for the treatment of function screen visible emitting and infrared light;
Described integrated reception apparatus comprises the signal processing module of the information that the camera module that obtains the image information for the treatment of function screen, the Receiver Module that transmits that receives described radiofrequency emitting module, processing camera module and Receiver Module obtain; Described signal processing module output terminal is provided with host computer and sets up the connector of communicating by letter; Described camera module is equipped with movably, can filters the infrared filter of visible light outward;
Described laser is equipped with a plurality of can the reception from the object infrared receiving tube of the infrared light of reflected back closely around controlling the nib of pen, and described infrared light receiving tube is connected with described radiofrequency emitting module.
Wherein, described screen vision mouse system also comprises infrared lettering pen, and described infrared lettering pen comprises the dual wavelength light emitting diode that can send visible light and infrared light, and the spring contact device of control dual wavelength light emitting diode.
Wherein, described connector is described integrated reception apparatus of wired connection and host computer, has the cable of USB plug, perhaps is the transmitter and the wireless receiver of described integrated reception apparatus of wireless connections and host computer.
Wherein, described integrated reception apparatus also comprises the shell that has transparent window, and described shell is provided with the fixedly pilot hole of integrated reception apparatus.
Wherein, described function button comprises left mouse button, right mouse button, keyboard PageUp key, keyboard PageDown key.
Wherein, described laser is controlled pen and also is provided with the laser switch of controlling visible light and infrared light opening and closing respectively.
A kind of implementation method of screen vision mouse system comprises away from the remote control method for the treatment of function screen operation, and with the touch screen control method for the treatment of the function screen close contact;
The step of described remote control method comprises:
A. integrated reception apparatus is installed on and treats function screen oblique upper, left side or the back side, the camera module is calibrated automatically;
Described camera module calibration automatically is meant:
Treat display standard checker image on the function screen, the camera module obtains the checker image for the treatment of on the function screen, and compare with standard checker image, calculate and the matrix mapping transformation parameter of storage camera point and actual screen point, demonstration is calibrated and is finished on screen at last;
B. laser is controlled pen to treating function screen emission dual-wavelength laser bundle, treats to form visible luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of this luminous point;
C. the infrared light image that the camera module is obtained of the signal processing module in the integrated reception apparatus carries out identification luminous point image coordinate after the filtering denoising Processing, through with matrix mapping transformation calculation of parameter after obtain corresponding screen actual coordinate, these screen actual coordinate data enter the track data formation;
D. the screen actual coordinate of luminous point is sent to host computer by connector, and host computer control treats that the cursor on the function screen moves to the coordinate position of luminous point;
E. click laser and control function button on the pen, the radiofrequency emitting module that laser is controlled on the pen is launched the control signal of this function button;
F. the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module sends, and send it to signal processing module, signal processing module is decoded to this control signal and is converted to steering order, connector is sent to host computer with this steering order, and host computer is carried out this steering order and is presented at and treats on the function screen;
The step of described touch screen control method comprises:
Step 1: integrated reception apparatus is installed on treats function screen oblique upper, left side or the back side, the camera module is calibrated automatically;
Described camera module calibration automatically is meant:
Treat display standard checker image on the function screen, the camera module obtains the checker image for the treatment of on the function screen, and compare with standard checker image, calculate and the matrix mapping transformation parameter of storage camera point and actual screen point, demonstration is calibrated and is finished on screen at last;
Step 2: laser is controlled pen to treating function screen emission dual-wavelength laser bundle, treat to form on the function screen visible luminous point, laser is controlled a nib touches screen, when nib apart from screen during less than 5mm, the infrared receiving tube that laser is controlled on the pen receives the infrared light that reflects from screen;
Step 3: the infrared light driving laser that infrared receiving tube receives is controlled the radiofrequency emitting module emission of pen and is pressed the control signal of left mouse button;
Step 4: the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module sends, and send it to signal processing module, signal processing module is decoded to this control signal and is converted to steering order, connector is sent to host computer with this steering order, and host computer is carried out the left mouse button steering order and the result is presented at and treats on the function screen;
Step 5: control pen with laser and click the application software writing function for the treatment of on the function screen, enter the state of writing;
Step 6: laser is controlled pen and is moved treating on the function screen, is incident upon the light spot position for the treatment of on the function screen and also changes thereupon, and the camera module in the integrated reception apparatus obtains the infrared light image of this luminous point;
Step 7: the infrared light image that the signal processing module in the integrated reception apparatus obtains the camera module carries out discerning the luminous point image coordinate after the filtering denoising Processing, through with matrix mapping transformation calculation of parameter after obtain corresponding screen actual coordinate, these screen actual coordinate data enter the track data formation;
Step 8: the screen actual coordinate of luminous point is sent to host computer by connector, host computer control treats that the mouse pointer on the function screen moves to the coordinate position of luminous point, in the position of mouse pointer process, treat to occur on the function screen laser and control the track that pen moves;
Step 9: the nib that laser is controlled pen is away from treating function screen, when nib apart from screen during more than or equal to 5mm, the infrared signal that infrared receiving tube receives disappears, radiofrequency emitting module stops emission signal, the mouse pointer reduction finishes track and draws.
Wherein, described touch screen control method also comprises the many people input mode based on many luminous point identifications: step 10: laser is controlled pen and is being treated that irradiation forms a luminous point on the function screen, the nib of infrared lettering pen is pressed screen, the spring contact device of infrared lettering pen is connected the dual wavelength LED power source, send visible light and infrared light, infrared lettering pen is treating that irradiation forms another luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of two luminous points;
Step 11: the infrared light image that the signal processing module in the integrated reception apparatus obtains the camera module carries out motion track and extracts, and the information of extracting is sent to host computer, and host computer is made corresponding response and is presented at and treats on the function screen.
Wherein, described remote control method also comprises the many people input mode based on many luminous point identifications: G. laser is controlled pen and is being treated that irradiation forms a luminous point on the function screen, the nib of infrared lettering pen is pressed screen, the spring contact device of infrared lettering pen is connected the dual wavelength LED power source, send visible light and infrared light, infrared lettering pen is treating that irradiation forms another luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of two luminous points;
H. the infrared light image that the camera module is obtained of the signal processing module in the integrated reception apparatus carries out motion track and extracts, and the information of extracting is sent to host computer, and host computer is made corresponding response and is presented at and treats on the function screen.
Wherein, the matrix mapping transformation parameter of the calculating in described steps A and the step 1 and storage camera point and actual screen point specifically is meant:
Signal processing module extracts the four angular coordinate (x1 of checker from the image of camera module picked-up, y1), (x2, y2), (x3, y3) and (x4, y4), actual coordinate (the X1 of combined standard checker figure, Y1), (X2, Y2), (X3, Y3) and (X4, Y4), calculate calibration parameter A, B, C, D, E, F, G, H by following system of equations:
Signal processing module is by Gaussian elimination method solving equation group, and the value with A, B, C, D, E, F, G, H is stored in the Flash internal memory then;
From internal memory, read the value of A, B, C, D, E, F, G, H, by following formula will make a video recording coordinate (x, y) be mapped to the screen actual coordinate (X, Y):
X=(A*x+B*y+C)/(x+G*y+H); Y=(D*x+E*y+F)/(x+G*y+H)。
The invention has the beneficial effects as follows: 1. screen vision mouse system of the present invention combines photoelectricity location and RF remote-controlled technology, and utilization infrared photography and radio-frequency communication cooperate to move and click the mouse.Use the highly directive characteristics realization screen of laser to locate at a distance preferably, used radio frequency non-directive characteristics to realize comprehensive no dead angle remote control again simultaneously.
2. laser is controlled the dual-wavelength laser emitting mould train is installed on the pen, can be the dual-wavelength laser pipe, and the dual wavelength light emitting diode is installed on the infrared lettering pen.Visible light is incident upon and forms luminous point on the screen, plays the indicating effect of common laser pen, and infrared light is used for effectively avoiding the interference of visible light in the location by camera picked-up after by filter.
Laser control the pen visible light partly be not used in identification, but flexible configuration.Both can select red laser for use also can be green, blue laser.The operator can only launch infrared light, and partly to realize not having the screen of visible point of light mutual, also can a visible emitting part and ignore mutual with screen.
4. automatically clicking left mouse button when laser is controlled the reflection of pen utilization light and realized near screen near on-off principle.A plurality of infrared receiving tubes promptly are housed around nib, whether be used to measure nib near screen, when nib is write near screen, infrared receiving tube can be received the infrared light of reflected back from the screen, be equivalent to press left mouse button, under the situation that does not need button, just can be implemented in clicking, double-click, dragging and writing function on the screen.The a plurality of infrared receiving tubes of design on pen, can guarantee nib with any posture when the screen, the light that is reflected all can be received.
5. laser is controlled radiofrequency emitting module is installed on the pen, can launch mouse or keyboard signal.
6. screen vision mouse system of the present invention has also designed the infrared lettering pen of a kind of dual wavelength with low cost, that structure is practical, can control pen with laser and be used, and realizes the screen gesture operation, also can realize many people simultaneously screens write.
7. screen vision mouse system of the present invention can be installed on the computing machine of different size, material screen, can be applicable to comprise any display screens such as common display screen, curtain, wall curtain, led array.System calibrates automatically by the comparison of standard picture and pickup image, does not need artificial assisting, and not influenced by screen resolution.
8. the receiving trap of screen vision mouse system of the present invention has been integrated camera module, Receiver Module and signal processing module, the USB interface that the same with the generic USB mouse need take host computer is connected with computer, but realized the irrealizable multiple spot screen of common mouse interactive function, also can adopt the wireless mouse mode to connect, need not wiring.
Description of drawings
Fig. 1 is that screen vision mouse system remote control of the present invention is implemented scene graph.
Fig. 2 controls the enforcement scene graph for screen vision mouse system touch screen of the present invention.
Fig. 3 is that many people input mode of Fig. 2 is implemented scene graph.
Fig. 4 is the schematic flow sheet of screen vision mouse system remote control of the present invention.
The schematic flow sheet that Fig. 5 controls for screen vision mouse system touch screen of the present invention.
Embodiment
For the purpose, technical scheme and the advantage that make invention is clearer,, the present invention is further elaborated below in conjunction with drawings and Examples.
Specific embodiment:
Referring to Fig. 1 to Fig. 5, a kind of screen vision mouse system, comprise laser control the pen and integrated reception apparatus;
Described laser is controlled the radiofrequency emitting module that pen is equipped with function button, the control signal of function button is launched, and to the dual-wavelength laser emitting mould train for the treatment of function screen visible emitting and infrared light;
Described integrated reception apparatus comprises the signal processing module of the information that the camera module that obtains the image information for the treatment of function screen, the Receiver Module that transmits that receives described radiofrequency emitting module, processing camera module and Receiver Module obtain; Described signal processing module output terminal is provided with host computer and sets up the connector of communicating by letter; Described camera module is equipped with movably, can filters the infrared filter of visible light outward; This infrared filter is configured to moving-member or manually moving-member automatically;
Described laser is equipped with a plurality of can the reception from the object infrared receiving tube of the infrared light of reflected back closely around controlling the nib of pen, and relevant nib light channel structure, and described infrared light receiving tube is connected with described radiofrequency emitting module.
Wherein, described screen vision mouse system also comprises infrared lettering pen, and described infrared lettering pen comprises the dual wavelength light emitting diode that can send visible light and infrared light, and the spring contact device of control dual wavelength light emitting diode.
Wherein, described connector is described integrated reception apparatus of wired connection and host computer, has the cable of USB plug, perhaps is the transmitter and the wireless receiver of described integrated reception apparatus of wireless connections and host computer.
Wherein, described integrated reception apparatus also comprises the shell that has transparent window, and described shell is provided with the fixedly pilot hole of integrated reception apparatus.
Wherein, described function button comprises left mouse button, right mouse button, keyboard PageUp key, keyboard PageDown key.
Wherein, described laser is controlled the laser switch that pen also is provided with the opening and closing of control laser.
Wherein, described radiofrequency emitting module is the NRF24L01 radiofrequency emitting module.
The signal processing module of integrated reception apparatus is equipped with microprocessor, described microprocessor adopts a slice STM32F103 enhanced high-speed 32-bit microprocessor, the image that the camera module is passed back carries out fast processing, the one or more infrared light spots of quick identification position, one group of data input of this processor links to each other with the digital output end of camera module, and another group data input links to each other with the data output end of Receiver Module.The method of microprocessor identification light spot position is that video frame images is lined by line scan, and the amount of pixels in the clear zone of adding up thinks then that when amount of pixels reaches setting value there is luminous point in this position.Add up amount of pixels when reaching setting value when scanning another clear zone, and then thinking has more than one luminous point (being many light pens).
A kind of implementation method of screen vision mouse system comprises away from the remote control method for the treatment of function screen operation, and with the touch screen control method for the treatment of the function screen close contact;
The step of described remote control method comprises:
A. integrated reception apparatus is installed on and treats function screen oblique upper, left side or the back side, the camera module is calibrated automatically;
Described camera module calibration automatically is meant:
Treat display standard checker image on the function screen, the camera module obtains the checker image for the treatment of on the function screen, and compare with standard checker image, calculate and the matrix mapping transformation parameter of storage camera point and actual screen point, demonstration is calibrated and is finished on screen at last;
B. laser is controlled pen to treating function screen emission dual-wavelength laser bundle, treats to form visible luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of this luminous point;
C. the infrared light image that the camera module is obtained of the signal processing module in the integrated reception apparatus carries out identification luminous point image coordinate after the filtering denoising Processing, obtain corresponding screen actual coordinate after calculating with calibration parameter, these screen actual coordinate data enter the track data formation;
D. the screen actual coordinate of luminous point is sent to host computer by connector, and host computer control treats that the cursor on the function screen moves to the coordinate position of luminous point; Host computer projects image onto by equipment such as projector and treats function screen;
E. click laser and control function button on the pen, the radiofrequency emitting module that laser is controlled on the pen is launched the control signal of this function button;
F. the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module sends, and send it to signal processing module, signal processing module is decoded to this control signal and is converted to steering order, connector is sent to host computer with this steering order, and host computer is carried out this steering order and is presented at and treats on the function screen; Integrated reception apparatus receives the luminous point of screen, produces similar common optical mouse by signal processing module and detects the mouse mobile data that luminous point moves, and this mouse mobile data sends to host computer, can produce common mouse mobile phase effect together;
The step of described touch screen control method comprises:
Step 1: integrated reception apparatus is installed on treats function screen oblique upper, left side or the back side, the camera module is calibrated automatically;
Described camera module calibration automatically is meant:
Treat display standard checker image on the function screen, the camera module obtains the checker image for the treatment of on the function screen, and compare with standard checker image, calculate and the matrix mapping transformation parameter of storage camera point and actual screen point, demonstration is calibrated and is finished on screen at last;
Step 2: laser is controlled pen to treating function screen emission dual-wavelength laser bundle, treat to form on the function screen visible luminous point, laser is controlled a nib touches screen, when nib apart from screen during less than 5mm, the infrared receiving tube that laser is controlled on the pen receives the infrared light that reflects from screen;
Step 3: the infrared light driving laser that infrared receiving tube receives is controlled the radiofrequency emitting module emission of pen and is pressed the control signal of left mouse button;
Step 4: the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module sends, and send it to signal processing module, signal processing module is decoded to this control signal and is converted to steering order, connector is sent to host computer with this steering order, and host computer is carried out the left mouse button steering order and the result is presented at and treats on the function screen;
Step 5: control pen with laser and click the application software writing function for the treatment of on the function screen, enter the state of writing;
Step 6: laser is controlled pen and is moved treating on the function screen, is incident upon the light spot position for the treatment of on the function screen and also changes thereupon, and the camera module in the integrated reception apparatus obtains the infrared light image of this luminous point;
Step 7: the infrared light image that the signal processing module in the integrated reception apparatus obtains the camera module carries out discerning the luminous point image coordinate after the filtering denoising Processing, through with matrix mapping transformation calculation of parameter after obtain corresponding screen actual coordinate, these screen actual coordinate data enter the track data formation;
Step 8: the screen actual coordinate of luminous point is sent to host computer by connector, host computer control treats that the mouse pointer on the function screen moves to the coordinate position of luminous point, in the position of mouse pointer process, treat to occur on the function screen laser and control the track that pen moves;
Step 9: the nib that laser is controlled pen is away from treating function screen, when nib apart from screen during more than or equal to 5mm, the infrared signal that infrared receiving tube receives disappears, radiofrequency emitting module stops emission signal, the mouse pointer reduction finishes track and draws.
Wherein, described touch screen control method also comprises the many people input mode based on many luminous point identifications: step 10: laser is controlled pen and is being treated that irradiation forms a luminous point on the function screen, the nib of infrared lettering pen is pressed screen, the spring contact device of infrared lettering pen is connected the dual wavelength LED power source, send visible light and infrared light, infrared lettering pen is treating that irradiation forms another luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of two luminous points;
Step 11: the infrared light image that the signal processing module in the integrated reception apparatus obtains the camera module carries out motion track and extracts, and the information of extracting is sent to host computer, and host computer is made corresponding response and is presented at and treats on the function screen.
Wherein, described remote control method also comprises the many people input mode based on many luminous point identifications: G. laser is controlled pen and is being treated that irradiation forms a luminous point on the function screen, the nib of infrared lettering pen is pressed screen, the spring contact device of infrared lettering pen is connected the dual wavelength LED power source, send visible light and infrared light, infrared lettering pen is treating that irradiation forms another luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of two luminous points;
H. the infrared light image that the camera module is obtained of the signal processing module in the integrated reception apparatus carries out motion track and extracts, and the information of extracting is sent to host computer, and host computer is made corresponding response and is presented at and treats on the function screen.
Wherein, the matrix mapping transformation parameter of the calculating in described steps A and the step 1 and storage camera point and actual screen point specifically is meant:
Signal processing module extracts the four angular coordinate (x1 of checker from the image of camera module picked-up, y1), (x2, y2), (x3, y3) and (x4, y4), actual coordinate (the X1 of combined standard checker figure, Y1), (X2, Y2), (X3, Y3) and (X4, Y4), calculate calibration parameter A, B, C, D, E, F, G, H by following system of equations:
Signal processing module is by Gaussian elimination method solving equation group, and the value with A, B, C, D, E, F, G, H is stored in the Flash internal memory then;
From internal memory, read the value of A, B, C, D, E, F, G, H, by following formula will make a video recording coordinate (x, y) be mapped to the screen actual coordinate (X, Y):
X=(A*x+B*y+C)/(x+G*y+H); Y=(D*x+E*y+F)/(x+G*y+H)。
Screen vision mouse system of the present invention can also be amplified to material object screen shows (this mode can make screen have the function of projector for real object): host computer software is set enters projection amplification mode in kind, the infrared fileter of camera module is removed, picked-up visible light screen image, and in white capture in kind district of screen picture lower left corner demonstration;
The material object (printed matter, student's exercises etc. such as books paper) that needs enlarging projection is fixed on the capture zone position in kind of screen;
The camera module extracts the image in capture in kind district from the screen image of picked-up, image is carried out filtering and contrast enhancing, is amplified to full screen then and shows (this full-screen image is the white capture zone of cover screen not).
The beneficial effect of screen vision mouse system of the present invention is: 1. screen vision mouse system of the present invention combines photoelectricity location and RF remote-controlled technology, and utilization infrared photography and radio-frequency communication cooperate to move and click the mouse.Use the highly directive characteristics realization screen of laser to locate at a distance preferably, used radio frequency non-directive characteristics to realize comprehensive no dead angle remote control again simultaneously.
2. laser is controlled the dual-wavelength laser emitting mould train is installed on the pen, can be the dual-wavelength laser pipe, and the dual wavelength light emitting diode is installed on the infrared lettering pen.The visible light of 660nm wavelength is incident upon and forms luminous point on the screen, plays the indicating effect of common laser pen, and simultaneously the infrared light of 780nm wavelength is used for effectively avoiding the interference of visible light in the location by the camera picked-up after by filter.
Laser control the pen visible light partly be not used in identification, but flexible configuration.Both can select red laser for use also can be green, blue laser.The operator can only launch infrared light, and partly to realize not having the screen of visible point of light mutual, also can a visible emitting part and ignore mutual with screen.
4. automatically clicking left mouse button when laser is controlled the reflection of pen utilization light and realized near screen near on-off principle.A plurality of infrared receiving tubes promptly are housed around nib, whether be used to measure nib near screen, when nib is write near screen, infrared receiving tube can be received the infrared light of reflected back from the screen, be equivalent to press left mouse button, under the situation that does not need button, just can be implemented in clicking, double-click, dragging and writing function on the screen.The a plurality of infrared receiving tubes of design on pen, can guarantee nib with any posture when the screen, the light that is reflected all can be received.
5. laser is controlled radiofrequency emitting module is installed on the pen, can launch mouse or keyboard signal.
6. screen vision mouse system of the present invention has also designed the infrared lettering pen of a kind of dual wavelength with low cost, that structure is practical, can control pen with laser and be used, and realizes the screen gesture operation, also can realize many people simultaneously screens write.
7. screen vision mouse system of the present invention can be installed on the computing machine of different size, material screen, can be applicable to comprise any display screens such as common display screen, curtain, wall curtain, led array.System calibrates automatically by the comparison of standard picture and pickup image, does not need artificial assisting, and not influenced by screen resolution.
8. the receiving trap of screen vision mouse system of the present invention has been integrated camera module, Receiver Module and signal processing module, the USB interface that the same with the generic USB mouse need take host computer is connected with computer, but realized the irrealizable multiple spot screen of common mouse interactive function, also can adopt the wireless mouse mode to connect, need not wiring.
Above content is preferred embodiment of the present invention only, and for those of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, this description should not be construed as limitation of the present invention.
Claims (10)
1. screen vision mouse system is characterized in that: comprise that laser controls pen and integrated reception apparatus;
Described laser is controlled the radiofrequency emitting module that pen is equipped with function button, the control signal of function button is launched, and to the dual-wavelength laser emitting mould train for the treatment of function screen visible emitting and infrared light;
Described integrated reception apparatus comprises the signal processing module of the information that the camera module that obtains the image information for the treatment of function screen, the Receiver Module that transmits that receives described radiofrequency emitting module, processing camera module and Receiver Module obtain; Described signal processing module output terminal is provided with host computer and sets up the connector of communicating by letter; Described camera module is equipped with movably, can filters the infrared filter of visible light outward;
Described laser is equipped with a plurality of can the reception from the object infrared receiving tube of the infrared light of reflected back closely around controlling the nib of pen, and described infrared light receiving tube is connected with described radiofrequency emitting module.
2. a kind of screen vision mouse system according to claim 1, it is characterized in that: described screen vision mouse system also comprises infrared lettering pen, described infrared lettering pen comprises the dual wavelength light emitting diode that can send visible light and infrared light, and the spring contact device of control dual wavelength light emitting diode.
3. a kind of screen vision mouse system according to claim 1, it is characterized in that: described connector is described integrated reception apparatus of wired connection and host computer, has the cable of USB plug, perhaps is the transmitter and the wireless receiver of described integrated reception apparatus of wireless connections and host computer.
4. a kind of screen vision mouse system according to claim 1, it is characterized in that: described integrated reception apparatus also comprises the shell that has transparent window, described shell is provided with the fixedly pilot hole of integrated reception apparatus.
5. a kind of screen vision mouse system according to claim 1 is characterized in that: described function button comprises left mouse button, right mouse button, keyboard PageUp key, keyboard PageDown key.
6. a kind of screen vision mouse system according to claim 1 is characterized in that: described laser is controlled pen and also is provided with the laser switch of controlling visible light and infrared light opening and closing respectively.
7. implementation method as claim 1 to 6 screen vision mouse system as described in each is characterized in that: comprise away from the remote control method for the treatment of the function screen operation, and with the touch screen control method for the treatment of the function screen close contact;
The step of described remote control method comprises:
A. integrated reception apparatus is installed on and treats function screen oblique upper, left side or the back side, the camera module is calibrated automatically;
Described camera module calibration automatically is meant:
Treat display standard checker image on the function screen, the camera module obtains the checker image for the treatment of on the function screen, and compare with standard checker image, calculate and the matrix mapping transformation parameter of storage camera point and actual screen point, demonstration is calibrated and is finished on screen at last;
B. laser is controlled pen to treating function screen emission dual-wavelength laser bundle, treats to form visible luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of this luminous point;
C. the infrared light image that the camera module is obtained of the signal processing module in the integrated reception apparatus carries out identification luminous point image coordinate after the filtering denoising Processing, obtain corresponding screen actual coordinate after calculating with calibration parameter, these screen actual coordinate data enter the track data formation;
D. the screen actual coordinate of luminous point is sent to host computer by connector, and host computer control treats that the cursor on the function screen moves to the coordinate position of luminous point;
E. click laser and control function button on the pen, the radiofrequency emitting module that laser is controlled on the pen is launched the control signal of this function button;
F. the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module sends, and send it to signal processing module, signal processing module is decoded to this control signal and is converted to steering order, connector is sent to host computer with this steering order, and host computer is carried out this steering order and is presented at and treats on the function screen;
The step of described touch screen control method comprises:
Step 1: integrated reception apparatus is installed on treats function screen oblique upper, left side or the back side, the camera module is calibrated automatically;
Described camera module calibration automatically is meant:
Treat display standard checker image on the function screen, the camera module obtains the checker image for the treatment of on the function screen, and compare with standard checker image, calculate and the matrix mapping transformation parameter of storage camera point and actual screen point, demonstration is calibrated and is finished on screen at last;
Step 2: laser is controlled pen to treating function screen emission dual-wavelength laser bundle, treat to form on the function screen visible luminous point, laser is controlled a nib touches screen, when nib apart from screen during less than 5mm, the infrared receiving tube that laser is controlled on the pen receives the infrared light that reflects from screen;
Step 3: the infrared light driving laser that infrared receiving tube receives is controlled the radiofrequency emitting module emission of pen and is pressed the control signal of left mouse button;
Step 4: the Receiver Module of integrated reception apparatus receives the control signal that radiofrequency emitting module sends, and send it to signal processing module, signal processing module is decoded to this control signal and is converted to steering order, connector is sent to host computer with this steering order, and host computer is carried out the left mouse button steering order and the result is presented at and treats on the function screen;
Step 5: control pen with laser and click the application software writing function for the treatment of on the function screen, enter the state of writing;
Step 6: laser is controlled pen and is moved treating on the function screen, is incident upon the light spot position for the treatment of on the function screen and also changes thereupon, and the camera module in the integrated reception apparatus obtains the infrared light image of this luminous point;
Step 7: the infrared light image that the signal processing module in the integrated reception apparatus obtains the camera module carries out discerning the luminous point image coordinate after the filtering denoising Processing, through with matrix mapping transformation calculation of parameter after obtain corresponding screen actual coordinate, these screen actual coordinate data enter the track data formation;
Step 8: the screen actual coordinate of luminous point is sent to host computer by connector, host computer control treats that the mouse pointer on the function screen moves to the coordinate position of luminous point, in the position of mouse pointer process, treat to occur on the function screen laser and control the track that pen moves;
Step 9: the nib that laser is controlled pen is away from treating function screen, when nib apart from screen during more than or equal to 5mm, the infrared signal that infrared receiving tube receives disappears, radiofrequency emitting module stops emission signal, the mouse pointer reduction finishes track and draws.
8. the implementation method of a kind of screen vision mouse system according to claim 7, it is characterized in that: described touch screen control method also comprises the many people input mode based on many luminous point identifications: step 10: laser is controlled pen and is being treated that irradiation forms a luminous point on the function screen, the nib of infrared lettering pen is pressed screen, the spring contact device of infrared lettering pen is connected the dual wavelength LED power source, send visible light and infrared light, infrared lettering pen is treating that irradiation forms another luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of two luminous points;
Step 11: the infrared light image that the signal processing module in the integrated reception apparatus obtains the camera module carries out motion track and extracts, and the information of extracting is sent to host computer, and host computer is made corresponding response and is presented at and treats on the function screen.
9. the implementation method of a kind of screen vision mouse system according to claim 7, it is characterized in that: described remote control method also comprises the many people input mode based on many luminous point identifications: G. laser is controlled pen and is being treated that irradiation forms a luminous point on the function screen, the nib of infrared lettering pen is pressed screen, the spring contact device of infrared lettering pen is connected the dual wavelength LED power source, send visible light and infrared light, infrared lettering pen is treating that irradiation forms another luminous point on the function screen, and the camera module in the integrated reception apparatus obtains the infrared light image of two luminous points;
H. the infrared light image that the camera module is obtained of the signal processing module in the integrated reception apparatus carries out motion track and extracts, and the information of extracting is sent to host computer, and host computer is made corresponding response and is presented at and treats on the function screen.
10. the implementation method of a kind of screen vision mouse system according to claim 7 is characterized in that: the matrix mapping transformation parameter of the calculating in described steps A and the step 1 and storage camera point and actual screen point specifically is meant:
Signal processing module extracts the four angular coordinate (x1 of checker from the image of camera module picked-up, y1), (x2, y2), (x3, y3) and (x4, y4), actual coordinate (the X1 of combined standard checker figure, Y1), (X2, Y2), (X3, Y3) and (X4, Y4), calculate calibration parameter A, B, C, D, E, F, G, H by following system of equations:
Signal processing module is by Gaussian elimination method solving equation group, and the value with A, B, C, D, E, F, G, H is stored in the Flash internal memory then;
From internal memory, read the value of A, B, C, D, E, F, G, H, by following formula will make a video recording coordinate (x, y) be mapped to the screen actual coordinate (X, Y):
X=(A*x+B*y+C)/(x+G*y+H); Y=(D*x+E*y+F)/(x+G*y+H)。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101446088A CN102253737B (en) | 2011-05-31 | 2011-05-31 | Realizing method of screen-vision mouse system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101446088A CN102253737B (en) | 2011-05-31 | 2011-05-31 | Realizing method of screen-vision mouse system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102253737A true CN102253737A (en) | 2011-11-23 |
| CN102253737B CN102253737B (en) | 2013-07-17 |
Family
ID=44981034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011101446088A Expired - Fee Related CN102253737B (en) | 2011-05-31 | 2011-05-31 | Realizing method of screen-vision mouse system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102253737B (en) |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102622108A (en) * | 2012-01-18 | 2012-08-01 | 深圳市中科睿成智能科技有限公司 | Interactive projecting system and implementation method for same |
| CN102662498A (en) * | 2012-04-16 | 2012-09-12 | 中科华核电技术研究院有限公司 | Wireless control method and system for projection demonstration |
| CN102819327A (en) * | 2012-07-26 | 2012-12-12 | 郑州信大捷安信息技术股份有限公司 | Interactive projection system of infrared positioning wireless control and realizing method thereof |
| CN102945091A (en) * | 2012-11-20 | 2013-02-27 | 深圳市中科睿成智能科技有限公司 | Method and system for man-machine interaction and based on laser projection location |
| CN103135805A (en) * | 2013-02-05 | 2013-06-05 | 深圳市中科睿成智能科技有限公司 | Projection near-point control and remote control switching system and method |
| CN103268170A (en) * | 2013-04-26 | 2013-08-28 | 国家电网公司 | Positioning device and positioning method for forming and outputting continuous coordinates by aid of pointed positions of image identification laser pointer |
| CN103294196A (en) * | 2013-05-15 | 2013-09-11 | 陈创举 | Head-operated mouse |
| CN103760998A (en) * | 2014-02-19 | 2014-04-30 | 赵威 | Method for achieving laser pen ultra-bright cursor identification with CCD sensor over exposure |
| WO2014078973A1 (en) * | 2012-11-21 | 2014-05-30 | Tsao Yung Hsin | Method for executing virtual touch control using infrared rays and infrared positioning stylus |
| CN104615273A (en) * | 2014-12-08 | 2015-05-13 | 沈阳工业大学 | Wearable remote wireless controller |
| CN104898956A (en) * | 2014-03-07 | 2015-09-09 | 联想(北京)有限公司 | Information processing method, input equipment and electronic equipment |
| CN105607785A (en) * | 2016-01-04 | 2016-05-25 | 京东方科技集团股份有限公司 | Touch display system and touch operating device |
| CN105786224A (en) * | 2016-03-29 | 2016-07-20 | 电子科技大学 | Universal laser pointer and computer operation method |
| CN105843426A (en) * | 2016-03-19 | 2016-08-10 | 广州能欣计算机技术有限公司 | Vision based multi-laser-mouse-pen pointing, locating and interaction method |
| CN106445090A (en) * | 2015-08-12 | 2017-02-22 | 中兴通讯股份有限公司 | Cursor control method and apparatus, and input device |
| CN106550108A (en) * | 2016-09-08 | 2017-03-29 | 珠海格力电器股份有限公司 | Device, method and the mobile phone with the device of mouse function are realized with mobile phone |
| CN106775025A (en) * | 2017-01-25 | 2017-05-31 | 王正贤 | Distance type optical mouse and application method |
| CN106843602A (en) * | 2016-10-11 | 2017-06-13 | 南京仁光电子科技有限公司 | A kind of giant-screen remote control interactive system and its exchange method |
| CN107170326A (en) * | 2017-07-03 | 2017-09-15 | 徐志强 | It is easy to student to feed back the method to the understanding situation of teaching to teacher |
| CN107823883A (en) * | 2017-11-21 | 2018-03-23 | 河南黄烨科技有限公司 | Aiming point screen coordinate acquisition methods based on image recognition and laser positioning |
| CN108021243A (en) * | 2016-10-31 | 2018-05-11 | 中国移动通信有限公司研究院 | A kind of virtual mouse method for determining position, apparatus and system |
| CN108595026A (en) * | 2018-03-28 | 2018-09-28 | 中山大学 | A kind of new infrared laser pen for realizing mouse function |
| CN109144375A (en) * | 2018-10-09 | 2019-01-04 | 中天智领（北京）科技有限公司 | A kind of screen control method and device |
| CN109407859A (en) * | 2017-08-15 | 2019-03-01 | 北京仁光科技有限公司 | Based on man-machine interaction method, equipment and system in kind |
| CN109712559A (en) * | 2019-01-14 | 2019-05-03 | 浙江大学 | It is a kind of to show interactive device and method without sensing LED dot matrix screen |
| CN110244835A (en) * | 2018-03-08 | 2019-09-17 | 北京仁光科技有限公司 | Based on man-machine interaction method, device, equipment, medium and system in kind |
| CN112328158A (en) * | 2020-07-23 | 2021-02-05 | 深圳Tcl新技术有限公司 | Interactive method, display device, transmitting device, interactive system and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1534544A (en) * | 2003-04-01 | 2004-10-06 | 中国科学院电子学研究所 | Large screen non contact type control mode |
| CN1687886A (en) * | 2005-04-08 | 2005-10-26 | 清华大学 | Remote-wireless controller for computer |
| CN1746831A (en) * | 2004-09-08 | 2006-03-15 | 上海迪比特实业有限公司 | Interactive projection system |
| US20100060611A1 (en) * | 2008-09-05 | 2010-03-11 | Sony Ericsson Mobile Communication Ab | Touch display with switchable infrared illumination for touch position determination and methods thereof |
-
2011
- 2011-05-31 CN CN2011101446088A patent/CN102253737B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1534544A (en) * | 2003-04-01 | 2004-10-06 | 中国科学院电子学研究所 | Large screen non contact type control mode |
| CN1746831A (en) * | 2004-09-08 | 2006-03-15 | 上海迪比特实业有限公司 | Interactive projection system |
| CN1687886A (en) * | 2005-04-08 | 2005-10-26 | 清华大学 | Remote-wireless controller for computer |
| US20100060611A1 (en) * | 2008-09-05 | 2010-03-11 | Sony Ericsson Mobile Communication Ab | Touch display with switchable infrared illumination for touch position determination and methods thereof |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102622108A (en) * | 2012-01-18 | 2012-08-01 | 深圳市中科睿成智能科技有限公司 | Interactive projecting system and implementation method for same |
| CN102622108B (en) * | 2012-01-18 | 2015-11-04 | 深圳市中科睿成智能科技有限公司 | A kind of interactive projection system and its implementation |
| CN102662498A (en) * | 2012-04-16 | 2012-09-12 | 中科华核电技术研究院有限公司 | Wireless control method and system for projection demonstration |
| CN102819327A (en) * | 2012-07-26 | 2012-12-12 | 郑州信大捷安信息技术股份有限公司 | Interactive projection system of infrared positioning wireless control and realizing method thereof |
| CN102945091B (en) * | 2012-11-20 | 2015-11-18 | 深圳市中科睿成智能科技有限公司 | A kind of man-machine interaction method based on laser projection location and system |
| CN102945091A (en) * | 2012-11-20 | 2013-02-27 | 深圳市中科睿成智能科技有限公司 | Method and system for man-machine interaction and based on laser projection location |
| WO2014078973A1 (en) * | 2012-11-21 | 2014-05-30 | Tsao Yung Hsin | Method for executing virtual touch control using infrared rays and infrared positioning stylus |
| CN103135805A (en) * | 2013-02-05 | 2013-06-05 | 深圳市中科睿成智能科技有限公司 | Projection near-point control and remote control switching system and method |
| CN103135805B (en) * | 2013-02-05 | 2016-01-06 | 深圳市中科睿成智能科技有限公司 | A kind of switched system of project near point control and Long-distance Control and method |
| CN103268170A (en) * | 2013-04-26 | 2013-08-28 | 国家电网公司 | Positioning device and positioning method for forming and outputting continuous coordinates by aid of pointed positions of image identification laser pointer |
| CN103294196A (en) * | 2013-05-15 | 2013-09-11 | 陈创举 | Head-operated mouse |
| CN103760998A (en) * | 2014-02-19 | 2014-04-30 | 赵威 | Method for achieving laser pen ultra-bright cursor identification with CCD sensor over exposure |
| CN104898956A (en) * | 2014-03-07 | 2015-09-09 | 联想(北京)有限公司 | Information processing method, input equipment and electronic equipment |
| CN104898956B (en) * | 2014-03-07 | 2019-10-29 | 联想(北京)有限公司 | Information processing method, input equipment and electronic equipment |
| CN104615273A (en) * | 2014-12-08 | 2015-05-13 | 沈阳工业大学 | Wearable remote wireless controller |
| CN106445090A (en) * | 2015-08-12 | 2017-02-22 | 中兴通讯股份有限公司 | Cursor control method and apparatus, and input device |
| US10209799B2 (en) | 2016-01-04 | 2019-02-19 | Boe Technology Group Co., Ltd. | Touch display system and touch operation device |
| CN105607785A (en) * | 2016-01-04 | 2016-05-25 | 京东方科技集团股份有限公司 | Touch display system and touch operating device |
| CN105607785B (en) * | 2016-01-04 | 2019-11-12 | 京东方科技集团股份有限公司 | Touch control display system and touch control operation device |
| CN105843426A (en) * | 2016-03-19 | 2016-08-10 | 广州能欣计算机技术有限公司 | Vision based multi-laser-mouse-pen pointing, locating and interaction method |
| CN105786224A (en) * | 2016-03-29 | 2016-07-20 | 电子科技大学 | Universal laser pointer and computer operation method |
| CN106550108A (en) * | 2016-09-08 | 2017-03-29 | 珠海格力电器股份有限公司 | Device, method and the mobile phone with the device of mouse function are realized with mobile phone |
| CN106843602A (en) * | 2016-10-11 | 2017-06-13 | 南京仁光电子科技有限公司 | A kind of giant-screen remote control interactive system and its exchange method |
| CN108021243B (en) * | 2016-10-31 | 2020-11-06 | 中国移动通信有限公司研究院 | Method, device and system for determining position of virtual mouse |
| CN108021243A (en) * | 2016-10-31 | 2018-05-11 | 中国移动通信有限公司研究院 | A kind of virtual mouse method for determining position, apparatus and system |
| CN106775025A (en) * | 2017-01-25 | 2017-05-31 | 王正贤 | Distance type optical mouse and application method |
| CN107170326A (en) * | 2017-07-03 | 2017-09-15 | 徐志强 | It is easy to student to feed back the method to the understanding situation of teaching to teacher |
| CN109407859A (en) * | 2017-08-15 | 2019-03-01 | 北京仁光科技有限公司 | Based on man-machine interaction method, equipment and system in kind |
| CN107823883A (en) * | 2017-11-21 | 2018-03-23 | 河南黄烨科技有限公司 | Aiming point screen coordinate acquisition methods based on image recognition and laser positioning |
| CN107823883B (en) * | 2017-11-21 | 2020-12-29 | 河南黄烨科技有限公司 | Aiming point screen coordinate obtaining method based on image recognition and laser positioning |
| CN110244835A (en) * | 2018-03-08 | 2019-09-17 | 北京仁光科技有限公司 | Based on man-machine interaction method, device, equipment, medium and system in kind |
| CN108595026A (en) * | 2018-03-28 | 2018-09-28 | 中山大学 | A kind of new infrared laser pen for realizing mouse function |
| CN109144375A (en) * | 2018-10-09 | 2019-01-04 | 中天智领（北京）科技有限公司 | A kind of screen control method and device |
| CN109712559B (en) * | 2019-01-14 | 2020-05-15 | 浙江大学 | Non-sensing LED dot matrix screen display interaction device and method |
| CN109712559A (en) * | 2019-01-14 | 2019-05-03 | 浙江大学 | It is a kind of to show interactive device and method without sensing LED dot matrix screen |
| CN112328158A (en) * | 2020-07-23 | 2021-02-05 | 深圳Tcl新技术有限公司 | Interactive method, display device, transmitting device, interactive system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102253737B (en) | 2013-07-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102253737B (en) | Realizing method of screen-vision mouse system | |
| JP5567206B2 (en) | Computing device interface | |
| CN102436327B (en) | Screen input system and implementation method thereof | |
| EP2919104B1 (en) | Information processing device, information processing method, and computer-readable recording medium | |
| US20140247216A1 (en) | Trigger and control method and system of human-computer interaction operation command and laser emission device | |
| US20140300542A1 (en) | Portable device and method for providing non-contact interface | |
| CN102934057A (en) | Interactive input system and method | |
| US11244511B2 (en) | Augmented reality method, system and terminal device of displaying and controlling virtual content via interaction device | |
| CN101375297A (en) | Interactive input system | |
| CN100478860C (en) | Electronic plane display positioning system and positioning method | |
| CN202110500U (en) | Visual mouse system of screen | |
| CN102945091A (en) | Method and system for man-machine interaction and based on laser projection location | |
| US8289295B2 (en) | Wireless multi-user touch control system | |
| US11907466B2 (en) | Apparatus and method which displays additional information along with a display component in response to the display component being selected | |
| CN202257528U (en) | Screen input system | |
| CN104914985A (en) | Gesture control method and system and video flowing processing device | |
| CN110620955B (en) | Live broadcasting system and live broadcasting method thereof | |
| CN201945948U (en) | Non-contact gesture page-turning demonstration system based on image detection | |
| CN107452288A (en) | Electronic device and electronic advertisement playing and interaction method | |
| CN203606780U (en) | Multi-touch and gesture recognition fusion system | |
| CN102645975A (en) | Handwriting input device, remote control device, intelligent interactive system and handwriting processing method | |
| CN111913560A (en) | Virtual content display method, device, system, terminal equipment and storage medium | |
| CN202443415U (en) | Handwriting input device, remote control device and intelligent interactive system | |
| Kudale et al. | Human computer interaction model based virtual whiteboard: A review | |
| WO2019100547A1 (en) | Projection control method, apparatus, projection interaction system, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130717 Termination date: 20150531 |
|
| EXPY | Termination of patent right or utility model |