CN102685581B - Multi-hand control system for intelligent television - Google Patents
Multi-hand control system for intelligent television Download PDFInfo
- Publication number
- CN102685581B CN102685581B CN201210163613.8A CN201210163613A CN102685581B CN 102685581 B CN102685581 B CN 102685581B CN 201210163613 A CN201210163613 A CN 201210163613A CN 102685581 B CN102685581 B CN 102685581B
- Authority
- CN
- China
- Prior art keywords
- gesture
- trail
- intelligent television
- control system
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The invention discloses a multi-hand control system for an intelligent television. The system provided by the invention is used for controlling only through three gestures: activation, tracking and operation, wherein the activation gesture has the function of activating gesture operation; the tracking gesture controls the movement of a tracking terminal by the assistance of the activation gesture; and the operating gesture controls the tracking terminal to perform multiple operating orders such as confirmation, movement, amplification and the like. The multi-hand control system has the characteristics that the control scheme is simple and can be mastered by a user easily, the operating efficiency is high, the control can be conducted by two hands of one person or more than two hands of a multiple persons, and the like.
Description
Technical field
The present invention relates to intelligent TV set control field, especially relate to the system that the many people of a kind of intelligent TV set carry out gesture control.
Background technology
Intelligent television is as smart mobile phone, there is full open model platform, carry operating system, can be by user's program that the third party service provider such as installation and uninstall, game provides voluntarily, constantly the function of TV is expanded by this class method, and can realize by netting twine, wireless network the general name of such class TV of surfing the web, it is the main trend of following Polarizations for Target Discrimination in Clutter.
Oneself cannot meet increasing content choice and mode of operation demand by warp traditional button remote control mode, and obviously uses inconvenience in family's intelligent television field for the control of key mouse and the touch control manner of present comparative maturity, cannot promote.In order to address the above problem, the present invention proposes a kind of many people manual control system based on machine vision.
Summary of the invention
The object of the invention is to have proposed a kind of system that can realize many people and carry out gesture control for the deficiency of existing intelligent television control mode, use this system to control complicated intelligent television operation interface by extremely simple gesture.
For realizing its object, the present invention by the following technical solutions:
A kind of many people of intelligent television manual control system, it is made up of the matching module of making a video recording, tracing module and operational module.It is characterized in that comprising the following steps:
1) user provides activation gesture in TV high-pixel camera head effective range, the match is successful for matching module, video screen provides multiple controllable control ends, can operate by personal two hands simultaneously, also can multiple control people independently carry out respectively all operations simultaneously;
2) activate gesture and transfer tracking gesture to, tracing module starts, and just move and can select it to the direction of your needed control end, at this moment the movement that this control end starts to follow the trail of specific finger, in tracing process, if need to readjust the position of following the trail of gesture, can transfer activation gesture to by following the trail of gesture, at this moment tracing module is still being followed the trail of, but it is motionless to control terminal position, when user's hand moves to behind suitable position, activate gesture and transfer tracking gesture to, following the trail of end starts again to follow the trail of, move in the command icon of wanting to operate in the guidance panel of screen ejection controlling end by the movement of following the trail of gesture,
3) follow the trail of gesture and transfer operating gesture to, operational module starts, and controls to follow the trail of end and carry out the various operational orders such as user's confirmation of sending, movement, amplification.
In concrete use procedure, reach user's object by the mutual conversion of these three kinds of gestures.
The camera of the high pixel described in step 1 is arranged on the top of TV, and its quantity according to the actual requirements, can be 1 to 3, and the mobile accuracy a that can differentiate in its effective range should be not more than 10mm, is recommended as 1mm to 3mm.But less resolving accuracy requires to increase to camera and system processing power, and this will select according to actual cost.And the precision that user should can differentiate it according to the operating habit of controlling oneself within the specific limits arranges.
This system only has three kinds of gestures: activate gesture, follow the trail of gesture and operating gesture.Activate gesture and be defaulted as the palm of opening, follow the trail of gesture and be defaulted as the Eight characters gesture of thumb and forefinger composition, operating gesture is defaulted as the gesture that stoops thumb and only have forefinger.
Multiple control ends described in step 1, can many people control, each is separate operation, in order to facilitate user to operate, make the more flexible of its change, activation gesture, tracking gesture and the operating gesture of its correspondence all can oneself define in gesture matching module, and the handicapped personage of this opponent also can conveniently control.
Tracing module described in step 2, it carries out IMAQ and tracking by certain frequency f to staff after startup.Tracing step comprises:
1) high-pixel camera head gathers the amount of movement Δ S of staff, and is translated into the pixel changes delta P on CCD or COMS, by internal image processing unit by Δ P be converted to two-dimensional coordinate pixel value conversion (Δ x, Δ y);
2) tracing module by the conversion of image pixel value under two-dimensional coordinate of user finger (Δ x, Δ y), be converted to control end corresponding pixel value on video screen conversion (k Δ x, k Δ y);
3) control the pixel value that moves up two of video screen corresponding sides of end and be respectively that (k Δ x, k Δ y).
The conversion of the two-dimensional coordinate pixel value described in step 1 is the conversion of horizontal Δ x and pixel value on vertical Δ y both direction.
K described in step 2 and step 3 is the ratio of controlling the amount of movement of end pixel on video screen and user and point the amount of movement in the pixel of CCD or CMOS, and its big or small user can arrange according to operating habit.K value affects user to controlling end control precision and effect together with above-mentioned resolving accuracy a.
Accompanying drawing explanation
The manual system block diagram of the many people of Fig. 1 intelligent television;
Tri-kinds of control gestures of Fig. 2;
Fig. 3 points the conversion of mobile corresponding pixel changes delta P under two-dimensional coordinate;
Many people of Fig. 4 intelligent television manual control system x direction is followed the trail of schematic diagram.
Embodiment
Fig. 1 is the manual system block diagrams of the many people of intelligent television.Shooting matching module is constantly carrying out work, in the time detecting that user provides activation gesture in TV high-pixel camera head effective range, video screen provides multiple controllable control ends, can operate by personal two hands simultaneously, also can multiple control people independently carry out respectively all operations simultaneously, in the time that activation gesture transfers tracking gesture to, start tracing module, and just move and can select it to the direction of your needed control end, at this moment the movement that this control end starts to follow the trail of specific finger, in tracing process, if need to readjust the position of following the trail of gesture, can transfer activation gesture to by following the trail of gesture, at this moment tracing module is still being followed the trail of, but it is motionless to control terminal position, when user's hand moves to behind suitable position, activate gesture and transfer tracking gesture to, following the trail of end starts again to follow the trail of, move in the command icon of wanting to operate in the guidance panel of screen ejection controlling end by the movement of following the trail of gesture, follow the trail of gesture and transfer operating gesture to, operational module starts, and controls to follow the trail of end and carry out the various operational orders such as user's confirmation of sending, movement, amplification.The working method of this system make user in the time of operative intelligence TV just as by mouse action computer, corresponding movement is carried out in the orientation that the arrow of desktop moves by mouse; As operative intelligence mobile phone, simple and reliable again, can complete complicated order.
Fig. 2 is three kinds and controls gesture.A is for activating gesture, and it is defaulted as the palm of opening; B is for following the trail of gesture, and it is defaulted as the Eight characters gesture of thumb and forefinger composition; C is operating gesture, and it is defaulted as the gesture that stoops thumb and only have forefinger.In order to facilitate user to operate, make the more flexible of its change, these three kinds of gestures all can oneself define in gesture matching module, and this is mainly to consider that different people has different operating habits, or the handicapped people of hand can not provide acquiescence gesture.
As shown in Figure 3, the conversion of the pixel changes delta P that finger is mobile corresponding under the two-dimensional coordinate of parallel horizontal and vertical direction composition relevant to TV plane.High-pixel camera head gathers the amount of movement Δ S of staff, and be translated into the pixel changes delta P on CCD or COMS, by internal image processing unit, Δ P is converted to conversion (the Δ x of two-dimensional coordinate pixel value, Δ y), then tracing module is worth according to this, (k Δ x, k Δ y) to make to control the corresponding movement of end.
Fig. 4 is that many people of intelligent television manual control system x direction is followed the trail of schematic diagram.Because finger is in the movement in space, can be decomposed into the movement of x direction and y direction, because the tracking principle of two directions is identical, so this figure only carries out labor to the tracing process of x direction.As shown in the figure, the amount of movement of establishing x direction is AB, and its picture on lens imaging face is A ' B ', the also i.e. described Δ x of upper figure, and tracing module makes to control the corresponding mobile A of end " B " according to A ' B ', also the i.e. described k Δ of upper figure x.Therefore, in the time of the mobile AB of finger x direction, control end will be on video screen corresponding mobile A " B ", in like manner, y direction is also like this.So finger is in the space of effect scope, any movement in the plane substantially parallel with TV plane, can be controlled end and be followed the trail of, and then has realized the control to TV by simple three control gestures.
Claims (5)
1. many people of intelligent television manual control system, is characterized in that comprising the following steps:
(1) user provides activation gesture in TV high-pixel camera head effective range, the match is successful for matching module, video screen provides multiple controllable control ends, can operate by personal two hands simultaneously, also can multiple control people independently carry out respectively all operations simultaneously;
(2) activate gesture and transfer tracking gesture to, tracing module starts, and just move and can select it to the direction of your needed control end, at this moment the movement that this control end starts to follow the trail of specific finger, in tracing process, if need to readjust the position of following the trail of gesture, can transfer activation gesture to by following the trail of gesture, at this moment tracing module is still being followed the trail of, but it is motionless to control terminal position, when user's hand moves to behind suitable position, activate gesture and transfer tracking gesture to, following the trail of end starts again to follow the trail of, move in the command icon of wanting to operate in the guidance panel of screen ejection controlling end by the movement of following the trail of gesture,
(3) follow the trail of gesture and transfer operating gesture to, operational module starts, and controls to follow the trail of end and carry out the various operational orders such as user's confirmation of sending, movement, amplification.
2. many people of intelligent television manual control system according to claim 1, it is characterized in that: the camera of the high pixel described in step 1 is installed on TV, its quantity is 1 to 3, and the mobile accuracy a that can differentiate in its effective range should be not more than 10mm, and can arrange.
3. according to many people of the said intelligent television of claim 1 manual control system, it is characterized in that: activate gesture and be defaulted as the palm of opening, follow the trail of gesture and be defaulted as the Eight characters gesture of thumb and forefinger composition, operating gesture is defaulted as the gesture that stoops thumb and only have forefinger.
4. many people of intelligent television manual control system according to claim 1, it is characterized in that: the multiple control ends described in step 1, can many people control simultaneously, each is separate operation, and activation gesture, tracking gesture and the operating gesture of its correspondence all can oneself define in gesture matching module.
5. many people of intelligent television manual control system according to claim 1, is characterized in that: the tracing module described in step 2, and its tracing step comprises:
(1) high-pixel camera head gathers the amount of movement Δ S of staff, and is translated into the pixel changes delta P on CCD or COMS, by internal image processing unit by Δ P be converted to pixel value in horizontal and vertical directions conversion (Δ x, Δ y);
(2) tracing module by the conversion of image pixel value under two-dimensional coordinate of user finger (Δ x, Δ y), be converted to control end corresponding pixel value on video screen conversion (k Δ x, y), the described big or small user of k value can arrange k Δ;
(3) (k Δ x, k Δ y) respectively for the pixel value that control end moves on the both direction of video screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210163613.8A CN102685581B (en) | 2012-05-24 | 2012-05-24 | Multi-hand control system for intelligent television |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210163613.8A CN102685581B (en) | 2012-05-24 | 2012-05-24 | Multi-hand control system for intelligent television |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102685581A CN102685581A (en) | 2012-09-19 |
| CN102685581B true CN102685581B (en) | 2014-05-21 |
Family
ID=46816842
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210163613.8A Expired - Fee Related CN102685581B (en) | 2012-05-24 | 2012-05-24 | Multi-hand control system for intelligent television |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102685581B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139627A (en) * | 2013-02-07 | 2013-06-05 | 上海集成电路研发中心有限公司 | Intelligent television and gesture control method thereof |
| CN104866081A (en) * | 2014-02-25 | 2015-08-26 | 中兴通讯股份有限公司 | Terminal operation method and device as well as terminal |
| CN105302404A (en) * | 2014-07-25 | 2016-02-03 | 深圳Tcl新技术有限公司 | Method and system for quickly moving mouse pointer |
| CN105681859A (en) * | 2016-01-12 | 2016-06-15 | 东华大学 | Man-machine interaction method for controlling smart TV based on human skeletal tracking |
| CN106681496A (en) * | 2016-12-07 | 2017-05-17 | 南京仁光电子科技有限公司 | Control method and device based on multiple detecting faces |
| CN109143875B (en) * | 2018-06-29 | 2021-06-15 | 广州市得腾技术服务有限责任公司 | Gesture control smart home method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1517779A (en) * | 2003-01-21 | 2004-08-04 | 惠普开发有限公司 | Interactive display equipment |
| WO2007017782A2 (en) * | 2005-08-11 | 2007-02-15 | Koninklijke Philips Electronics N.V. | Method of determining the motion of a pointing device |
| CN102449580A (en) * | 2009-05-18 | 2012-05-09 | 日本电气株式会社 | Mobile terminal device, and control method and storage medium for mobile terminal device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8599132B2 (en) * | 2008-06-10 | 2013-12-03 | Mediatek Inc. | Methods and systems for controlling electronic devices according to signals from digital camera and sensor modules |
-
2012
- 2012-05-24 CN CN201210163613.8A patent/CN102685581B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1517779A (en) * | 2003-01-21 | 2004-08-04 | 惠普开发有限公司 | Interactive display equipment |
| WO2007017782A2 (en) * | 2005-08-11 | 2007-02-15 | Koninklijke Philips Electronics N.V. | Method of determining the motion of a pointing device |
| CN102449580A (en) * | 2009-05-18 | 2012-05-09 | 日本电气株式会社 | Mobile terminal device, and control method and storage medium for mobile terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102685581A (en) | 2012-09-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102685581B (en) | Multi-hand control system for intelligent television | |
| CN102111582B (en) | Remote control device for television, television and remote control method | |
| CN101655751A (en) | Method and device for realizing touch control | |
| CN112486386A (en) | Screen projection method, screen projection device, electronic equipment and readable storage medium | |
| CN204536788U (en) | Based Intelligent Control bracelet | |
| CN102736726A (en) | Stealth technology for keyboard and mouse | |
| CN102929547A (en) | Intelligent terminal contactless interaction method | |
| CN107992191A (en) | A kind of electronic equipment and its control method, camera of electronic equipment module | |
| CN103200327A (en) | Method for achieving mouse function on mobile phone | |
| CN105681859A (en) | Man-machine interaction method for controlling smart TV based on human skeletal tracking | |
| US20190286255A1 (en) | Electronic whiteboard, image display method, and recording medium | |
| KR101233793B1 (en) | Virtual mouse driving method using hand motion recognition | |
| CN101882010A (en) | Device and method for inputting graphical user interface | |
| CN110519517B (en) | Copy guiding method, electronic device and computer readable storage medium | |
| CN104506909A (en) | Screen capturing remote-control method and screen capturing remote-control device | |
| CN104914985A (en) | Gesture control method and system and video flowing processing device | |
| CN102929405B (en) | A kind of remote control equipment of novel manipulation intelligent video terminal and implementation method | |
| CN103902202B (en) | A kind of information processing method and electronic equipment | |
| JP5396332B2 (en) | Information input device, method and program using gesture | |
| CN104035560A (en) | Human-computer real-time interaction method based on camera | |
| CN103902045A (en) | Method and device for operating wallpaper via non-contact postures | |
| CN103135806A (en) | Overhead mouse used for intelligent television | |
| CN202443415U (en) | Handwriting input device, remote control device and intelligent interactive system | |
| CN113010130A (en) | Remote large-screen interaction control method based on image stream | |
| CN202512514U (en) | Mobile terminal with gesture recognition function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140521 Termination date: 20190524 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |