CN104699228A - Mouse realization method and system for intelligent TV screen terminal - Google Patents
Mouse realization method and system for intelligent TV screen terminal Download PDFInfo
- Publication number
- CN104699228A CN104699228A CN201310643751.0A CN201310643751A CN104699228A CN 104699228 A CN104699228 A CN 104699228A CN 201310643751 A CN201310643751 A CN 201310643751A CN 104699228 A CN104699228 A CN 104699228A
- Authority
- CN
- China
- Prior art keywords
- mouse
- terminal
- intelligent
- displacement
- button
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses a mouse realization method and system for an intelligent TV screen terminal. The method comprises the following steps: obtaining the inclination of a gyroscope in a hand-held terminal; judging whether the inclination is greater than the critical value or not, if yes, obtaining the continuous image of a camera of the hand-held terminal, obtaining the relative displacement of the image and taking the relative displacement as the mouse displacement; reading a mouse interface button on the screen of the hand-held terminal as a mouse key value; sending the mouse displacement and the mouse key value to the intelligent TV screen terminal as the mouse input value for processing mouse events. The intelligent TV screen terminal device is flexibly controlled, the use is convenient and the cost is low.
Description
Technical field
The present invention relates to field of three-network convergence, particularly relate to a kind of intelligent TV and shield terminal mouse implementation method and system.
Background technology
Intelligence TV shields the feature that terminal software system possesses technology, opening up, application is enriched, and function has great lifting compared with the terminal of former generation, and the business development for operator provides strong technical support.
On Intelligent set top box equipment, the operation of user is mainly based on telepilot, and when UI interface is complicated, operating process is tediously long, affects the experience of user, is unfavorable for that the scope of business is expanded.
Traditional mouse must slide and produce as moving on some surfaces, is detected and change into the movement of cursor by computer.The appearance of empty mouse can allow user no longer be confined to some planes use mouse, and utilize gyroscope principle design, user can hold use mouse, is realized the function of mouse by the gyroscope of inside and the change of G-SENSOR induction gesture.But the special empty mouse cost based on gyroscope or gravity sensing is higher, and larger by user's hand positions stability influence.
Summary of the invention
In view of more than, the present invention proposes a kind of intelligent TV and shields terminal mouse implementation method and system.To solve at least one problem that prior art exists.
According to an aspect of the present invention, propose a kind of intelligent TV and shield terminal mouse implementation method, comprising:
Obtain gyrostatic degree of tilt in handheld terminal;
Judge whether this degree of tilt is greater than critical value, if so, then obtain the consecutive image of the camera of handheld terminal, obtain the relative displacement of image, it can be used as mouse displacement;
Mouse interface button on the screen of reading handheld terminal is as mousebutton value;
Mouse displacement and mouse button key assignments are sent to intelligent TV and shield terminal, carry out mouse event process as mouse input value.
Further, the relative displacement of image refers to the X of handheld terminal and/or the relative displacement of Y-direction.
Further, mouse button key assignments comprises left button, middle key, right button and pulley.
Further, mouse displacement and mouse button key assignments are sent to intelligent TV by infrared, WIFI or Bluetooth channels and shield terminal.
Further, carrying out mouse event process at least comprises one of following: the display position upgrading cursor of mouse.
According to an aspect of the present invention, propose a kind of intelligent TV screen terminal mouse and realize system, comprise handheld terminal, this handheld terminal comprises gyroscope, camera, control module and the first communication unit, wherein:
Control module, obtains gyrostatic degree of tilt, and judges whether this degree of tilt is greater than critical value, if so, then obtains the consecutive image of the camera of handheld terminal, obtains the relative displacement of image, it can be used as mouse displacement; And the mouse interface button read on the screen of handheld terminal is as mousebutton value;
First communication unit, is sent to intelligent TV and shields terminal, carry out mouse event process as mouse input value by mouse displacement and mouse button key assignments.
Further, the relative displacement of image refers to the X of handheld terminal and/or the relative displacement of Y-direction.
Further, mouse button key assignments comprises left button, middle key, right button and pulley.
Further, mouse displacement and mouse button key assignments are sent to intelligent TV by infrared, WIFI or Bluetooth channels and shield terminal.
Further, carrying out mouse event process at least comprises one of following: the display position upgrading cursor of mouse.
The present invention can realize the function of empty mouse by installation process software on handheld terminal, and user can realize the flexible manipulation of intelligent TV being shielded to terminal device by the simple cooperation of wrist, arm, finger, and easy to use, cost is low.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms a part of the present invention, and schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Figure 1 shows that a kind of intelligent TV in one embodiment of the invention shields the structural representation that terminal mouse realizes system.
Figure 2 shows that a kind of intelligent TV in one embodiment of the invention shields the schematic flow sheet of terminal mouse implementation method.
Embodiment
Various exemplary embodiment of the present invention is described in detail now with reference to accompanying drawing.It should be noted that: unless specifically stated otherwise, otherwise the positioned opposite and numerical value of the parts of setting forth in these embodiments and step does not limit the scope of the invention.
Meanwhile, it should be understood that for convenience of description, the size of the various piece shown in accompanying drawing is not draw according to the proportionate relationship of reality.
Illustrative to the description only actually of at least one exemplary embodiment below, never as any restriction to the present invention and application or use.
May not discuss in detail for the known technology of person of ordinary skill in the relevant, method and apparatus, but in the appropriate case, described technology, method and apparatus should be regarded as a part of authorizing instructions.
In all examples with discussing shown here, any occurrence should be construed as merely exemplary, instead of as restriction.Therefore, other example of exemplary embodiment can have different values.
It should be noted that: represent similar terms in similar label and letter accompanying drawing below, therefore, once be defined in an a certain Xiang Yi accompanying drawing, then do not need to be further discussed it in accompanying drawing subsequently.
Figure 1 shows that a kind of intelligent TV in one embodiment of the invention shields the structural representation that terminal mouse realizes system.This system comprises handheld terminal and intelligent TV shields terminal.
The present invention utilizes camera, gyroscope and touch-screen equipment on handheld terminal, move as mouse Mobile data by measuring handheld terminal camera image, and the key information on the intelligent terminal position information coordinating gyroscope to obtain, touch screen, produce mouse related data, realize empty mouse function.
For making the object, technical solutions and advantages of the present invention clearly understand, below in conjunction with specific embodiment, and with reference to accompanying drawing, the present invention is described in more detail.
As shown in Figure 1, handheld terminal comprises gyroscope, camera, control module and the first communication unit, wherein:
Control module, obtains gyrostatic degree of tilt, and judges whether this degree of tilt is greater than critical value, if so, then obtains the consecutive image of the camera of handheld terminal, obtains the relative displacement of image, it can be used as mouse displacement; And the mouse interface button read on the screen of handheld terminal is as mousebutton value.
First communication unit, is sent to intelligent TV and shields terminal, carry out mouse event process as mouse input value by mouse displacement and mouse button key assignments.
Wherein, control module obtains the consecutive image of camera, here refer to the image sequence that the highest sampling that digitization system is supported exports continuously.Only have and process is carried out to sequence image could obtain displacement information.The relative displacement of image refers to the X of handheld terminal and/or the relative displacement of Y-direction.
Wherein, the mouse button key assignments that control module reads can comprise left button, middle key, right button and pulley, owing to being the empty mouse of simulation, therefore, has the correlation function of sky mouse.It will be understood by those skilled in the art that just citing here, should not be construed as limitation of the present invention.
Wherein, mouse displacement and mouse button key assignments can be sent to intelligent TV by infrared, WIFI or Bluetooth channels and shield terminal by the first communication unit.It will be understood by those skilled in the art that just citing here, should not be construed as limitation of the present invention.Those skilled in the art can also transmit mouse displacement and mouse button key assignments by other communication mode.
Wherein, carrying out mouse event process at least comprises one of following: upgrade the display position of cursor of mouse, perform the mouse events such as determination operation.It will be understood by those skilled in the art that just citing here, should not be construed as limitation of the present invention.
As shown in Figure 1, intelligent TV shields terminal and comprises second communication unit and virtual mouse driving.
Mouse displacement and mouse button key assignments are sent to the virtual mouse driving that intelligent TV shields terminal by second communication unit.
Virtual mouse drives generation operating system mouse event data to be sent to application program, is gone to determine how to react, this is consistent with the process of mouse by these application programs.Here virtual mouse drives what refer to that it processes to be not real mouse hardware, but the mouse of being simulated by other things.Virtual mouse drives the processing procedure after simulating hardware to be the standard procedure of operating system.
The present invention can realize the function of empty mouse by installation process software on handheld terminal, and user can realize the flexible manipulation of intelligent TV being shielded to terminal device by the simple cooperation of wrist, arm, finger, and easy to use, cost is low.
Below in conjunction with specific embodiment, system of the present invention is described further.It will be understood by those skilled in the art that here just for illustrating, should not be construed as limitation of the present invention.
In this embodiment, system comprises handheld terminal and intelligent TV shields terminal.Wherein, handheld terminal comprises gyroscope, camera, touch-screen, control module and the first communication unit, and intelligent TV shields terminal and comprises second communication unit and virtual mouse driving.
Control module obtains gyrostatic degree of tilt, and judges that degree of tilt is greater than critical value, then obtain the consecutive image of the camera of handheld terminal, obtains the relative displacement of image, it can be used as mouse displacement.Control module also reads mouse interface button on the screen of handheld terminal as mousebutton value.By the first communication unit, mouse displacement and mouse button key assignments are sent to intelligent TV and shield terminal, carry out mouse event process as mouse input value.
Mouse displacement and mouse button key assignments are sent to the virtual mouse driving of intelligent TV screen terminal by the second communication unit of intelligence TV screen terminal, generation operating system mouse event data are driven to be sent to application program by virtual mouse, gone to determine how to react, this is consistent with the process of mouse by these application programs.Here virtual mouse drives what refer to that it processes to be not real mouse hardware, but the mouse of being simulated by other things.Virtual mouse drives the processing procedure after simulating hardware to be the standard procedure of operating system.
Figure 2 shows that a kind of intelligent TV in one embodiment of the invention shields the schematic flow sheet of terminal mouse implementation method.The method comprises the following steps:
Step 21, obtains gyrostatic degree of tilt in handheld terminal.
Step 22, judges whether this degree of tilt is greater than critical value, if so, then performs step 23, otherwise, continue to perform step 21.
Step 23, obtains the consecutive image of the camera of handheld terminal, obtains the relative displacement of image, it can be used as mouse displacement.
Wherein, obtain the consecutive image of camera, here refer to the image sequence that the highest sampling that digitization system is supported exports continuously.Only have and process is carried out to sequence image could obtain displacement information.The relative displacement of image refers to the X of handheld terminal and/or the relative displacement of Y-direction.
Step 24, the mouse interface button on the screen of reading handheld terminal is as mousebutton value.
Here be a readjustment process, i.e. system call call back function when a button is pressed, this call back function can process associative operation.
The mouse button key assignments read can comprise left button, middle key, right button and pulley, owing to being the empty mouse of simulation, therefore, has the correlation function of sky mouse.It will be understood by those skilled in the art that just citing here, should not be construed as limitation of the present invention.
Step 25, is sent to intelligent TV and shields terminal by mouse displacement and mouse button key assignments,
Mouse event process is carried out as mouse input value.
Wherein, mouse displacement and mouse button key assignments can be sent to intelligent TV by infrared, WIFI or Bluetooth channels and shield terminal.It will be understood by those skilled in the art that just citing here, should not be construed as limitation of the present invention.Those skilled in the art can also transmit mouse displacement and mouse button key assignments by other communication mode.
Wherein, carrying out mouse event process at least comprises one of following: upgrade the display position of cursor of mouse, perform the mouse events such as determination operation.It will be understood by those skilled in the art that just citing here, should not be construed as limitation of the present invention.
Below in conjunction with specific embodiment, method of the present invention is described further.It will be understood by those skilled in the art that here just for illustrating, should not be construed as limitation of the present invention.
Show a mouse interface at screen of handheld terminal during system initialization, comprise the button interfaces such as left button, middle key, right button and pulley, and initialization gyroscope, first-class equipment of making a video recording.
The position information of handheld terminal is read, i.e. gyrostatic degree of tilt from gyroscope.
Judge whether the position information of handheld terminal is greater than the inclination critical point of setting, as 30 degree, if so, obtain the consecutive image of camera and obtain the relative displacement of image, obtaining the X of handheld terminal or the relative displacement X of Y-direction, as mouse displacement information.
Mouse interface button on reading screen is as mousebutton value.
Mouse displacement X and mouse button key assignments are sent to intelligent TV and shield terminal, carry out mouse event process as mouse input value.Wherein, button value refers to the button information of similar mouse, as left button, right button, middle key, runner.These can be simulated with mouse interface button control.The virtual mouse driving that intelligence TV shields terminal will export an X displacement can upgrade cursor of mouse display position to the GUI of operating system, GUI.
The present invention utilizes camera, gyroscope and touch-screen equipment on handheld terminal, move as mouse Mobile data by measuring handheld terminal camera image, and the key information on the intelligent terminal position information coordinating gyroscope to obtain, touch screen, produce mouse related data, realize empty mouse function.User can realize the flexible manipulation of intelligent TV being shielded to terminal device by the simple cooperation of wrist, arm, finger, and easy to use, cost is low, improves the customer service experience that intelligent TV shields terminal.
So far, the present invention is described in detail.In order to avoid covering design of the present invention, details more known in the field are not described.Those skilled in the art, according to description above, can understand how to implement technical scheme disclosed herein completely.
Method of the present invention and device may be realized in many ways.Such as, any combination by software, hardware, firmware or software, hardware, firmware realizes method of the present invention and device.Said sequence for the step of described method is only to be described, and the step of method of the present invention is not limited to above specifically described order, unless specifically stated otherwise.In addition, in certain embodiments, can be also record program in the recording medium by the invention process, these programs comprise the machine readable instructions for realizing according to method of the present invention.Thus, the present invention also covers the recording medium stored for performing the program according to method of the present invention.
Although be described in detail specific embodiments more of the present invention by example, it should be appreciated by those skilled in the art, above example is only to be described, instead of in order to limit the scope of the invention.It should be appreciated by those skilled in the art, can without departing from the scope and spirit of the present invention, above embodiment be modified.Scope of the present invention is limited by claims.
Claims (10)
1. intelligent TV shields a terminal mouse implementation method, it is characterized in that, comprising:
Obtain gyrostatic degree of tilt in handheld terminal;
Judge whether this degree of tilt is greater than critical value, if so, then obtain the consecutive image of the camera of handheld terminal, obtain the relative displacement of image, it can be used as mouse displacement;
Mouse interface button on the screen of reading handheld terminal is as mousebutton value;
Mouse displacement and mouse button key assignments are sent to intelligent TV and shield terminal, carry out mouse event process as mouse input value.
2. intelligent TV shields terminal mouse implementation method according to claim 1, it is characterized in that:
The relative displacement of image refers to the X of handheld terminal and/or the relative displacement of Y-direction.
3. intelligent TV shields terminal mouse implementation method according to claim 1, it is characterized in that:
Mouse button key assignments comprises left button, middle key, right button and pulley.
4. intelligent TV shields terminal mouse implementation method according to claim 1, it is characterized in that:
Mouse displacement and mouse button key assignments are sent to intelligent TV by infrared, WIFI or Bluetooth channels and shield terminal.
5. intelligent TV shields terminal mouse implementation method according to claim 1, it is characterized in that:
Carrying out mouse event process at least comprises one of following: the display position upgrading cursor of mouse.
6. intelligent TV screen terminal mouse realizes a system, and it is characterized in that, comprise handheld terminal, this handheld terminal comprises gyroscope, camera, control module and the first communication unit, wherein:
Control module, obtains gyrostatic degree of tilt, and judges whether this degree of tilt is greater than critical value, if so, then obtains the consecutive image of the camera of handheld terminal, obtains the relative displacement of image, it can be used as mouse displacement; And the mouse interface button read on the screen of handheld terminal is as mousebutton value;
First communication unit, is sent to intelligent TV and shields terminal, carry out mouse event process as mouse input value by mouse displacement and mouse button key assignments.
7. intelligent TV screen terminal mouse realizes system according to claim 6, it is characterized in that:
The relative displacement of image refers to the X of handheld terminal and/or the relative displacement of Y-direction.
8. intelligent TV screen terminal mouse realizes system according to claim 6, it is characterized in that:
Mouse button key assignments comprises left button, middle key, right button and pulley.
9. intelligent TV screen terminal mouse realizes system according to claim 6, it is characterized in that:
Mouse displacement and mouse button key assignments are sent to intelligent TV by infrared, WIFI or Bluetooth channels and shield terminal.
10. intelligent TV screen terminal mouse realizes system according to claim 6, it is characterized in that:
Carrying out mouse event process at least comprises one of following: the display position upgrading cursor of mouse.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310643751.0A CN104699228B (en) | 2013-12-04 | 2013-12-04 | A kind of intelligence TV screen terminal mouse method and systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310643751.0A CN104699228B (en) | 2013-12-04 | 2013-12-04 | A kind of intelligence TV screen terminal mouse method and systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104699228A true CN104699228A (en) | 2015-06-10 |
| CN104699228B CN104699228B (en) | 2018-09-14 |
Family
ID=53346443
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310643751.0A Active CN104699228B (en) | 2013-12-04 | 2013-12-04 | A kind of intelligence TV screen terminal mouse method and systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104699228B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867657A (en) * | 2016-03-24 | 2016-08-17 | 青岛职业技术学院 | Method for remotely controlling computer mouse on the basis of mobile phone sensor |
| CN107820110A (en) * | 2017-10-31 | 2018-03-20 | 北京四达时代软件技术股份有限公司 | A kind of method, client and the server of flying squirrel remote control |
| WO2021164756A1 (en) * | 2020-02-20 | 2021-08-26 | 深圳市万普拉斯科技有限公司 | Input method and apparatus for smart television, computer device, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080030470A1 (en) * | 2007-01-25 | 2008-02-07 | Microsoft Corporation | Automatic mode determination for an input device |
| CN101634907A (en) * | 2008-07-21 | 2010-01-27 | 鼎亿数码科技(上海)有限公司 | Air mouse and control method thereof |
| CN102360251A (en) * | 2011-10-08 | 2012-02-22 | 张伟明 | Air mouse, air mouse control system and method for realizing control |
| CN102376295A (en) * | 2010-08-10 | 2012-03-14 | 联想（新加坡）私人有限公司 | Assisted zoom |
| CN102595224A (en) * | 2011-11-01 | 2012-07-18 | 华为技术有限公司 | Remote control method, remote controller, remote control response method and set top box |
| CN102662473A (en) * | 2012-04-16 | 2012-09-12 | 广东步步高电子工业有限公司 | Device and method for implementation of man-machine information interaction based on eye motion recognition |
| CN103200327A (en) * | 2013-04-08 | 2013-07-10 | 上海斐讯数据通信技术有限公司 | Method for achieving mouse function on mobile phone |
-
2013
- 2013-12-04 CN CN201310643751.0A patent/CN104699228B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080030470A1 (en) * | 2007-01-25 | 2008-02-07 | Microsoft Corporation | Automatic mode determination for an input device |
| CN101634907A (en) * | 2008-07-21 | 2010-01-27 | 鼎亿数码科技(上海)有限公司 | Air mouse and control method thereof |
| CN102376295A (en) * | 2010-08-10 | 2012-03-14 | 联想（新加坡）私人有限公司 | Assisted zoom |
| CN102360251A (en) * | 2011-10-08 | 2012-02-22 | 张伟明 | Air mouse, air mouse control system and method for realizing control |
| CN102595224A (en) * | 2011-11-01 | 2012-07-18 | 华为技术有限公司 | Remote control method, remote controller, remote control response method and set top box |
| CN102662473A (en) * | 2012-04-16 | 2012-09-12 | 广东步步高电子工业有限公司 | Device and method for implementation of man-machine information interaction based on eye motion recognition |
| CN103200327A (en) * | 2013-04-08 | 2013-07-10 | 上海斐讯数据通信技术有限公司 | Method for achieving mouse function on mobile phone |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867657A (en) * | 2016-03-24 | 2016-08-17 | 青岛职业技术学院 | Method for remotely controlling computer mouse on the basis of mobile phone sensor |
| CN107820110A (en) * | 2017-10-31 | 2018-03-20 | 北京四达时代软件技术股份有限公司 | A kind of method, client and the server of flying squirrel remote control |
| WO2021164756A1 (en) * | 2020-02-20 | 2021-08-26 | 深圳市万普拉斯科技有限公司 | Input method and apparatus for smart television, computer device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104699228B (en) | 2018-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105302285B (en) | Multi-display method, equipment and system | |
| KR101872426B1 (en) | Depth-based user interface gesture control | |
| EP2779598B1 (en) | Method and apparatus for operating electronic device with cover | |
| CN102830926B (en) | Mobile terminal and operational approach thereof | |
| EP2372513A2 (en) | Touch-sensitive electric apparatus and window operation method thereof | |
| CN108845782A (en) | It connects the method for mobile terminal and external display and realizes the device of this method | |
| US20140354553A1 (en) | Automatically switching touch input modes | |
| KR20130088104A (en) | Mobile apparatus and method for providing touch-free interface | |
| CN110989881B (en) | Icon arrangement method and electronic equipment | |
| US20110250929A1 (en) | Cursor control device and apparatus having same | |
| KR20150031986A (en) | Display apparatus and control method thereof | |
| CN113396378A (en) | System and method for a multipurpose input device for two-dimensional and three-dimensional environments | |
| CN105247463B (en) | The painting canvas environment of enhancing | |
| KR102272343B1 (en) | Method and Electronic Device for operating screen | |
| US9880733B2 (en) | Multi-touch remote control method | |
| JP2013012158A (en) | Electronic apparatus and control method | |
| CN104699228A (en) | Mouse realization method and system for intelligent TV screen terminal | |
| CN104142736B (en) | Video monitoring equipment control method and device | |
| CN103472931A (en) | Method for operating simulation touch screen by mouse | |
| CN106033286A (en) | A projection display-based virtual touch control interaction method and device and a robot | |
| CN105373329A (en) | Interactive method and system for display and booth | |
| TWI468989B (en) | Input command based on hand gesture | |
| TWI547862B (en) | Multi - point handwriting input control system and method | |
| KR20120030644A (en) | System and method for equipment control using remote controller of touch display same to the equipment monitor display | |
| CN103543824A (en) | Gesture input system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |