CN102495674A - Infrared human-computer interaction method and device - Google Patents
Infrared human-computer interaction method and device Download PDFInfo
- Publication number
- CN102495674A CN102495674A CN2011103972336A CN201110397233A CN102495674A CN 102495674 A CN102495674 A CN 102495674A CN 2011103972336 A CN2011103972336 A CN 2011103972336A CN 201110397233 A CN201110397233 A CN 201110397233A CN 102495674 A CN102495674 A CN 102495674A
- Authority
- CN
- China
- Prior art keywords
- infrared
- telepilot
- intelligent television
- gesture
- led
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses an infrared human-computer interaction method and an infrared human-computer interaction device. The infrared human-computer interaction device comprises a remote controller and an intelligent television. The method comprises the following steps of: shooting images, and acquiring a plurality of infrared light spot images on the remote controller which is provided with infrared light emitting diodes (LED); processing the images, and determining the spatial position and attitude of the remote controller according to the position and arrangement of the infrared LED light spot images; and controlling the cursor position of the intelligent television according to the spatial position of the remote controller, and making a corresponding gesture by the intelligent television according to the attitude of the remote controller. The infrared human-computer interaction device comprises an image shooting and processing device which is arranged on one side of the intelligent television; at least three infrared LEDs are arranged on the top of the remote controller and staggered at intervals two by two; and the image shooting and processing device comprises an image shooting module, an image processing module, a gesture processing module and an interface module. By the invention, the cursor position of the intelligent television can be accurately controlled, and gesture identification operation such as rotation and scaling can be quite conveniently accomplished.
Description
Technical field
The present invention relates to the field of human-computer interaction of intelligent television, particularly a kind of infrared man-machine interaction method and device.
Background technology
Existing on the market at present similar products are like the UWAND of Philips company, the WII of Nintendo company, the MOVE of Sony company.UWAND wherein, WII adopt on telepilot/handle to adorn a camera head, and televisor one is sidelong and is put a plurality of infrared LEDs, after telepilot/handle end arithmetic element receives the image that camera head obtains, through calculating the motion state that obtains current telepilot.The MOVE of Sony adopts spheroid of sending out infrared light of handle end band, and the camera head that utilizes televisor to survey is taken this infrared photosphere, then through the size of identification ball, the coordinate that the position obtains handle etc.In addition, WII, MOVE also sensor of extra band to obtain the current position state and the motion of handle.
In realizing process of the present invention, the inventor finds that there is following shortcoming at least in prior art:
1) in the scheme of the WII of the scheme of the UWAND of Philips company and Nintendo company, the coordinate that obtain need be informed the image-display units of TV set terminal through wireless transmission means such as RF, therefore than the extra interlock circuit that increased of traditional remote controller.
2) because the camera head power consumption is bigger, therefore generally need charging circuit, can't reach the low energy consumption of traditional remote controller.
And the MOVE scheme of Sony company: because sizable ball of handle leading portion band, if use shape more strange as telepilot, the profile that can't accomplish traditional telepilot.
Summary of the invention
In order to realize the low power consumption of camera head, practice thrift improvement cost, make the simple of package unit change, the embodiment of the invention provides a kind of infrared man-machine interaction method and device.Said technical scheme is following:
On the one hand, a kind of infrared man-machine interaction method is provided, said method comprises:
Shooting, and obtain a plurality of infrared light spot images that have on the infrared LED telepilot;
Flame Image Process is according to the position of infrared LED dot pattern picture and the locus and the attitude of arranging definite telepilot;
According to the cursor position of the locus of telepilot control intelligent television, and make intelligent television make corresponding gesture according to the attitude of telepilot.
The concrete grammar of confirming said telepilot locus comprises:
Set up the space plane of each infrared LED;
Confirm the line of camera point with each infrared LED, each line forms intersection point with said space plane;
When each intersection point satisfied the spacing of each infrared LED that sets, each intersection point was the position of each infrared LED in the space.
The corresponding gesture that described intelligent television is made according to the variation of remote controller position and attitude specifically comprises:
Rotate gesture, telepilot are chosen corresponding rotatablely moving of making behind certain object of intelligent television;
Amplify gesture, telepilot is chosen the corresponding motion of making towards intelligent television behind certain object of intelligent television;
Dwindle gesture; Telepilot is chosen the corresponding motion of making away from intelligent television behind certain object of intelligent television.
On the other hand, a kind of infrared human-computer interaction device is provided, said device comprises:
The top of said telepilot is provided with at least 3 infrared LEDs, and each infrared LED is the interleaved setting in twos;
One side of said intelligent television is provided with shooting and image processing apparatus, and said shooting and image processing apparatus comprise:
Photographing module is used to obtain the infrared LED dot pattern picture on said telepilot top;
Image processing module connects with said photographing module, is used to receive and handle the signal of said photographing module, confirms the volume coordinate position of said telepilot;
The gesture processing module connects with said image processing module, and its processing signals according to the said image processing module that is received is provided with the operating gesture of said intelligent television;
Interface module, its signal input part connects with said gesture processing module, and its signal output part connects with the signal input part of said intelligent television.
At least be provided with a location LED in a plurality of said infrared LEDs, the brightness of said location LED is higher than the brightness of all the other each infrared LEDs.
Preferably, said infrared LED is provided with 3, and 3 said infrared LEDs are triangularly arranged.
Wherein, the spectrum of said infrared LED adopts 850nm～940nm.
The beneficial effect of the technical scheme that the embodiment of the invention provides is:
A. photographing module is placed on the intelligent television side, avoids the high power consumption of telepilot.
B. only need do change seldom to traditional remote controller, make that outward appearance need not to change basically, and improvement cost be very low.
C. can accomplish various gestures, such as furthering and zoom out the amplification of accomplishing the intelligent television picture successively and dwindle processing according to telepilot.
Description of drawings
In order to be illustrated more clearly in the technical scheme in the embodiment of the invention; The accompanying drawing of required use is done to introduce simply in will describing embodiment below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is an infrared man-machine interaction method block diagram provided by the present invention;
Fig. 2 is the synoptic diagram of image processing module identification remote controller position, attitude among the present invention.
Fig. 3 is the whole structure drawing of device that the embodiment of the invention provides;
Fig. 4 is the infrared LED position view on the telepilot that is arranged at shown in Fig. 3;
Fig. 5 is shooting shown in Fig. 3 and image processing apparatus structural representation.
Among the figure:
1-intelligent television 2-shooting and image processing apparatus 3-telepilot 4-mouse luminous point
5-infrared LED 6-photographing module.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, will combine accompanying drawing that embodiment of the present invention is done to describe in detail further below.
As shown in Figure 1, the invention provides a kind of infrared man-machine interaction method, method wherein mainly comprises:
[101] shooting, and obtain a plurality of infrared light spot images that have on the infrared LED telepilot.
[102] Flame Image Process is according to the position of infrared LED dot pattern picture and the locus and the attitude of arranging definite telepilot.
As shown in Figure 2, confirm that the concrete grammar of said telepilot locus comprises:
Set up the space plane of each infrared LED;
Confirm the line of camera point with each infrared LED, each line forms intersection point with said space plane;
When each intersection point satisfied the spacing of each infrared LED that sets, each intersection point was the position of each infrared LED in the space.
[103] confirm the cursor position of intelligent television according to the locus of telepilot, and make intelligent television make corresponding gesture according to the attitude of telepilot.
The corresponding gesture that described intelligent television is made according to the variation of remote controller position and attitude specifically comprises:
Rotate gesture, telepilot are chosen corresponding rotatablely moving of making behind certain object of intelligent television;
Amplify gesture, telepilot is chosen the corresponding motion of making towards intelligent television behind certain object of intelligent television;
Dwindle gesture; Telepilot is chosen the corresponding motion of making away from intelligent television behind certain object of intelligent television.
The present invention also provides a kind of infrared human-computer interaction device, like Fig. 3,4, shown in 5:
The top of said telepilot is provided with at least 3 infrared LEDs, and each infrared LED is the interleaved setting in twos, and a plurality of infrared LEDs here can not be arranged in a line, and per two infrared LED placements spaced apart are as shown in Figure 4.
One side of said intelligent television is provided with shooting and image processing apparatus, and said shooting and image processing apparatus comprise:
Photographing module is used to obtain the infrared LED dot pattern picture on said telepilot top;
Image processing module connects with said photographing module, is used to receive and handle the signal of said photographing module, confirms the volume coordinate position of said telepilot;
The gesture processing module connects with said image processing module, and its processing signals according to the said image processing module that is received is provided with the operating gesture of said intelligent television;
Interface module, its signal input part connects with said gesture processing module, and its signal output part connects with the signal input part of said intelligent television.
At least be provided with a location LED in a plurality of said infrared LEDs, wherein have a LEDs different as location LED and other LED working conditions, such as brightness far above other LED; Perhaps necessarily modulate work, such as being operated under the same frequency with photographing module, a frame picture is bright, a frame picture goes out.
Preferably, said infrared LED is provided with 3, and 3 said infrared LEDs are triangularly arranged.
In order to reduce the interference of surround lighting to this device, the spectrum of infrared LED preferably adopts 850nm～940nm.
This scheme fundamental mode is: shooting and image processing apparatus are connected through interfaces such as USB or RS232 with intelligent television; And take the picture on opposite; When the telepilot of band infrared LED is lighted infrared LED; Shooting and image processing apparatus will detect infrared LED, and through the position of plurality of LEDs and the locus and the attitude of arranging definite telepilot, further change providing corresponding gesture through recognizing site and attitude:
When the selected back rotation of certain object telepilot, the corresponding rotation gesture
Telepilot moves towards TV after certain object is selected, the corresponding gesture of amplifying
Telepilot moves back to TV after certain object is selected, and correspondence is dwindled gesture
Shooting and image processing apparatus all send the locus of telepilot, attitude, gesture to intelligent television through USB or RS232 or other interfaces, when transmitting through USB, can also can be other equipment for the HID equipment of standard.
Wherein image processing module identification remote controller position, attitude can adopt the whole bag of tricks in shooting and the image processing apparatus, and a kind of typical method is specially:
After photographing module photographs a plurality of LED, confirm location LED earlier, confirm other LED then successively.Can only confirm the line at space plane this time, adopt a plane and each bar straight line to intersect afterwards from photographing module and each LED, when distance between its intersection point satisfy each LED of setting apart from the time, each intersection point is the position of each LED in the space.This plane is the plane of LED lamp.Thereby can confirm the position and the attitude of telepilot.
Human-computer interaction device of the present invention need not extra arithmetic element, and all calculate in this device and accomplish.
In conjunction with above-mentioned means, human-computer interaction device of the present invention can be realized:
A) can control the cursor position of intelligent television accurately;
Head 3 d space coordinate of living in and the telepilot of the telepilot attitude (the telepilot angle is vertical with 3 infrared LED planes) in the space can be confirmed in line through shooting and image processing apparatus and 3 infrared LED lamps and the plane of calculating 3 infrared LEDs of gained.After the user presses " click " button; 3 infrared LEDs will be lighted; After this moment, certain moving took place in telepilot; Just can obtain its concrete motion track on space plane, after carrying out projection process on the intelligent television, just can control the variation of intelligent television cursor position this track.
B) speed that moves of cursor does not change along with the distance of telepilot and TV;
Because what the present invention obtained is 3 dimension coordinates of telepilot in the space; No matter therefore how many telepilot and TV distances is; The telepilot shift position that this shooting and image processing apparatus obtain behind user's mobile remote control device all is consistent with actual shift position; So the speed that cursor moves is also consistent therewith, thereby the speed that cursor moves does not change along with the distance of telepilot and TV.
C) this telepilot can also be discerned the distance between itself and the intelligent television to a certain extent;
Because what this device detected is the coordinate of telepilot in 3 dimension spaces, therefore shooting and image processing apparatus can be discerned the distance between telepilot and the intelligent television, thereby can better support man-machine interactive class recreation.
D) this telepilot can also be accomplished gesture identification work such as rotation, convergent-divergent very easily.
Need to prove: get each module in shooting that the foregoing description provides and the image processing apparatus and only be illustrated with the division of above-mentioned each functional module; In the practical application; Can as required the above-mentioned functions distribution be accomplished by different functional; The inner structure of the equipment of being about to is divided into different functional, to accomplish all or part of function of above description.In addition, the infrared human-computer interaction device that the foregoing description provides and the embodiment of infrared man-machine interaction method belong to same design, and its concrete implementation procedure sees method embodiment for details, repeats no more here.
The invention described above embodiment sequence number is not represented the quality of embodiment just to description.
All or part of step in the embodiment of the invention can utilize software to realize that corresponding software programs can be stored in the storage medium that can read, like CD or hard disk etc.
The above is merely preferred embodiment of the present invention, and is in order to restriction the present invention, not all within spirit of the present invention and principle, any modification of being done, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (7)
1. an infrared man-machine interaction method comprises telepilot and intelligent television, it is characterized in that, said method specifically comprises:
The a plurality of infrared light spot images that have on the infrared LED telepilot are obtained in shooting;
Flame Image Process is according to the position of infrared LED dot pattern picture and the locus and the attitude of arranging definite telepilot;
According to the cursor position of the locus of telepilot control intelligent television, and make intelligent television make corresponding gesture according to the attitude of telepilot.
2. infrared man-machine interaction method according to claim 1 is characterized in that,
The concrete grammar of confirming said telepilot locus comprises:
Set up the space plane of each infrared LED;
Confirm the line of camera point with each infrared LED, each line forms intersection point with said space plane;
When each intersection point satisfied the spacing of each infrared LED that sets, each intersection point was the position of each infrared LED in the space.
3. infrared man-machine interaction method according to claim 1 is characterized in that,
The corresponding gesture that described intelligent television is made according to the variation of remote controller position and attitude specifically comprises:
Rotate gesture, telepilot are chosen corresponding rotatablely moving of making behind certain object of intelligent television;
Amplify gesture, telepilot is chosen the corresponding motion of making towards intelligent television behind certain object of intelligent television;
Dwindle gesture; Telepilot is chosen the corresponding motion of making away from intelligent television behind certain object of intelligent television.
4. an infrared human-computer interaction device comprises telepilot and intelligent television, it is characterized in that:
The top of said telepilot is provided with at least 3 infrared LEDs, and each infrared LED is the interleaved setting in twos;
One side of said intelligent television is provided with shooting and image processing apparatus, and said shooting and image processing apparatus comprise:
Photographing module is used to obtain the infrared LED dot pattern picture on said telepilot top;
Image processing module connects with said photographing module, is used to receive and handle the signal of said photographing module, confirms the volume coordinate position of said telepilot;
The gesture processing module connects with said image processing module, and its processing signals according to the said image processing module that is received is provided with the operating gesture of said intelligent television;
Interface module, its signal input part connects with said gesture processing module, and its signal output part connects with the signal input part of said intelligent television.
5. infrared human-computer interaction device according to claim 4 is characterized in that,
At least be provided with a location LED in a plurality of said infrared LEDs, the brightness of said location LED is higher than the brightness of all the other each infrared LEDs.
6. infrared human-computer interaction device according to claim 5 is characterized in that,
Said infrared LED is provided with 3, and 3 said infrared LEDs are triangularly arranged.
7. according to the arbitrary described infrared human-computer interaction device of claim 4-6, it is characterized in that,
The spectrum of said infrared LED adopts 850nm～940nm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103972336A CN102495674A (en) | 2011-12-05 | 2011-12-05 | Infrared human-computer interaction method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103972336A CN102495674A (en) | 2011-12-05 | 2011-12-05 | Infrared human-computer interaction method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102495674A true CN102495674A (en) | 2012-06-13 |
Family
ID=46187503
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103972336A Pending CN102495674A (en) | 2011-12-05 | 2011-12-05 | Infrared human-computer interaction method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102495674A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013104312A1 (en) * | 2012-01-09 | 2013-07-18 | 西安智意能电子科技有限公司 | System for use in remote controlling controlled device |
| CN103686283A (en) * | 2013-12-12 | 2014-03-26 | 成都优芯微电子技术有限公司 | Smart television remote controller man-machine interaction method |
| WO2014059810A1 (en) * | 2012-10-15 | 2014-04-24 | 腾讯科技（深圳）有限公司 | Human-computer interaction method and related device and system |
| CN103808322A (en) * | 2014-03-04 | 2014-05-21 | 韩涛 | Compound type six degrees of freedom input method and system in inertia measurement LED (light-emitting diode) detection |
| CN103974003A (en) * | 2013-02-06 | 2014-08-06 | 瀚宇彩晶股份有限公司 | Remote control method and remote control module |
| WO2015101108A1 (en) * | 2013-12-31 | 2015-07-09 | 京东方科技集团股份有限公司 | Method for detecting angle of rotation of remote control in television system, and television system |
| CN105302404A (en) * | 2014-07-25 | 2016-02-03 | 深圳Tcl新技术有限公司 | Method and system for quickly moving mouse pointer |
| CN105718038A (en) * | 2014-12-05 | 2016-06-29 | 北京蚁视科技有限公司 | Gesture posture recognition device for near eye display device |
| CN108479057A (en) * | 2018-03-26 | 2018-09-04 | 郑州轻工业学院 | A kind of animated stories performance system based on natural human-computer interaction |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070060336A1 (en) * | 2003-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | Methods and systems for enabling depth and direction detection when interfacing with a computer program |
| WO2009133412A1 (en) * | 2008-05-02 | 2009-11-05 | University Of Teesside | Computer input device |
| CN201576260U (en) * | 2010-01-13 | 2010-09-08 | 北京视博数字电视科技有限公司 | Cursor control system |
-
2011
- 2011-12-05 CN CN2011103972336A patent/CN102495674A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070060336A1 (en) * | 2003-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | Methods and systems for enabling depth and direction detection when interfacing with a computer program |
| WO2009133412A1 (en) * | 2008-05-02 | 2009-11-05 | University Of Teesside | Computer input device |
| CN201576260U (en) * | 2010-01-13 | 2010-09-08 | 北京视博数字电视科技有限公司 | Cursor control system |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013104312A1 (en) * | 2012-01-09 | 2013-07-18 | 西安智意能电子科技有限公司 | System for use in remote controlling controlled device |
| WO2014059810A1 (en) * | 2012-10-15 | 2014-04-24 | 腾讯科技（深圳）有限公司 | Human-computer interaction method and related device and system |
| CN103974003A (en) * | 2013-02-06 | 2014-08-06 | 瀚宇彩晶股份有限公司 | Remote control method and remote control module |
| CN103686283A (en) * | 2013-12-12 | 2014-03-26 | 成都优芯微电子技术有限公司 | Smart television remote controller man-machine interaction method |
| CN103686283B (en) * | 2013-12-12 | 2016-10-05 | 成都优芯微电子技术有限公司 | A kind of smart television remote controller man-machine interaction method |
| WO2015101108A1 (en) * | 2013-12-31 | 2015-07-09 | 京东方科技集团股份有限公司 | Method for detecting angle of rotation of remote control in television system, and television system |
| US9445033B2 (en) | 2013-12-31 | 2016-09-13 | Boe Technology Group Co., Ltd. | Method for detecting rotation angle of remote controller in television system and television system |
| CN103808322A (en) * | 2014-03-04 | 2014-05-21 | 韩涛 | Compound type six degrees of freedom input method and system in inertia measurement LED (light-emitting diode) detection |
| CN105302404A (en) * | 2014-07-25 | 2016-02-03 | 深圳Tcl新技术有限公司 | Method and system for quickly moving mouse pointer |
| CN105718038A (en) * | 2014-12-05 | 2016-06-29 | 北京蚁视科技有限公司 | Gesture posture recognition device for near eye display device |
| CN105718038B (en) * | 2014-12-05 | 2018-10-19 | 北京蚁视科技有限公司 | A kind of gesture gesture recognition equipment for near-eye display device |
| CN108479057A (en) * | 2018-03-26 | 2018-09-04 | 郑州轻工业学院 | A kind of animated stories performance system based on natural human-computer interaction |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102495674A (en) | Infrared human-computer interaction method and device | |
| CN102253737B (en) | Realizing method of screen-vision mouse system | |
| CN102682589B (en) | System for distant control of controlled device | |
| US9301372B2 (en) | Light control method and lighting device using the same | |
| CN102331884A (en) | Projecting system with touch control projecting images | |
| US20130307772A1 (en) | Interactive projection system with light spot identification and control method thereof | |
| CN202435502U (en) | Remote controller and remote control system | |
| CN101847316A (en) | Infrared remote control system and remote control method for network television | |
| CN102662498A (en) | Wireless control method and system for projection demonstration | |
| CN101963846B (en) | Optical pen | |
| US9007349B2 (en) | Writing device having light emitting diode display panel | |
| CN1952851A (en) | Electronic installation and method for realizing interactive display | |
| CN101882012A (en) | Pen type interactive system based on projection tracking | |
| CN100527783C (en) | Method of direct screen writing for television system distant end | |
| CN102436327A (en) | Screen input system and implementation method thereof | |
| WO2013142024A1 (en) | Controlling a device with visible light | |
| CN104978079B (en) | Bi-directional display method and bi-directional display device | |
| US20170168592A1 (en) | System and method for optical tracking | |
| CN202110500U (en) | Visual mouse system of screen | |
| CN202257528U (en) | Screen input system | |
| CN209044429U (en) | A kind of equipment | |
| CN101620485B (en) | Device and method for positioning light source | |
| CN102707795A (en) | Display system | |
| CN201698582U (en) | Infrared remote control system for network television | |
| CN103049105A (en) | Optical pen and interactive projection system utilizing same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120613 |