CN104333794A - Channel selection method based on depth gestures - Google Patents
Channel selection method based on depth gestures Download PDFInfo
- Publication number
- CN104333794A CN104333794A CN201410658224.1A CN201410658224A CN104333794A CN 104333794 A CN104333794 A CN 104333794A CN 201410658224 A CN201410658224 A CN 201410658224A CN 104333794 A CN104333794 A CN 104333794A
- Authority
- CN
- China
- Prior art keywords
- gesture
- depth
- sequence
- depth camera
- microprocessor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010187 selection method Methods 0.000 title abstract 4
- 238000000034 method Methods 0.000 claims description 17
- 230000007613 environmental effect Effects 0.000 claims description 3
- 239000000203 mixture Substances 0.000 claims description 2
- 230000003993 interaction Effects 0.000 abstract description 3
- 238000013500 data storage Methods 0.000 description 6
- 210000000352 storage cell Anatomy 0.000 description 6
- 238000000605 extraction Methods 0.000 description 4
- 230000010365 information processing Effects 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000013011 mating Effects 0.000 description 2
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4223—Cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
- H04N21/4383—Accessing a communication channel
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a channel selection method based on depth gestures, and belongs to the field of computer vision and human-computer interaction. The channel selection method includes the following steps of: 1, extracting a gesture sequence by a depth camera; 2, receiving the gesture sequence extracted by the depth camera and comparing the gesture sequence with a stored sequence template by a microprocessor so as to identify correct gesture information; 3, constituting the index values of channels by different gesture information; 4, transmitting corresponding control signals according to the index values by the microprocessor; 5, controlling a television to select the channels by the control signals. According to the channel selection method based on the depth gestures, channel selection of the television can be completed by only using the gestures without a controller.
Description
Technical field
The invention belongs to computer vision and field of human-computer interaction, be specifically related to a kind of band selecting method based on degree of depth gesture.
Background technology
Along with the development of science and technology, the development of man-machine interaction is particularly rapid, the microminiaturization of " the eye mark " that control with eyes, the voice system controlled with sound, computer, to change with oneself, people also no longer meet the control mode of traditional use peripheral hardware, so acoustic control, the method also phase supervention exhibition that gesture control etc. are novel.
At present, in daily life, although use the user of TV to realize broken away from wired constraint but still do not broken away from for the constraint of remote controller, depend on peripheral hardware, bring inconvenience to a certain extent to user, the loss of such as remote controller, lack battery, damage and cause insensitive etc.So wish to find a kind of novel control method thoroughly to break away from the constraint of the peripheral hardwares such as remote controller.
Summary of the invention
Only use gesture under the object of the invention is to realize not needing the condition of controller the channel selection that can complete television set, provides a kind of band selecting method based on depth camera.
Concrete scheme of the present invention is as follows:
Based on a band selecting method for degree of depth gesture, comprise the steps:
Step one, adopts depth camera to extract gesture sequence; Step 2, the template sequence of this gesture sequence and storage is also compared by the gesture sequence that microprocessor reception depth camera is extracted, thus identifies correct gesture information; Step 3, by the index value of different gesture informations composition channel; Step 4, microprocessor sends corresponding control signal according to index value; Step 5, control signal controls television set and carries out channel selection.
As improvement, described step one also comprises and filters out other environmental information and retain gesture information with depth information.
Further improvement, the depth camera that described step one adopts is kinect, after depth camera kinect collects colored and depth data, the gesture tracking module in the sdk of kinect is utilized to extract palm real-time spatial position coordinate (x, y, z), the gesture velocity characteristic (dx needed for then extracting according to this coordinate, dy, dz).
Further improve, also comprise data storing step, be specially: store the predefined gesture template of user in the microprocessor; Store the gesture sequence collected by depth camera kinect simultaneously.
The invention has the beneficial effects as follows: achieve the channel selection that can complete television set that only to use gesture under not needing the condition of controller.
Accompanying drawing explanation
Fig. 1 is a kind of band selecting method information process schematic diagram based on degree of depth gesture of the present invention.
Embodiment
A kind of band selecting method based on depth camera of the present invention, its hardware configuration part is depth camera, microprocessor and television set.Depth camera has the characteristic that can experience 1.2-3.5 rice Object Depth and the resolution of its color reaction is 640X480,30 frames per second.Depth camera also has the horizontal view angle of 57 ° and the vertical angle of view of 43 °.Depth camera turns USB interface by aux port and connects with microprocessor, and television set can be connected with microprocessor by HDMI or USB interface.Need the driving and the gesture identification mounting software that install depth camera in the microprocessor in advance.Gesture identification mounting software and image processing module, comprise gesture feature extraction module and gesture information processing unit and data storage cell.Feed back to microprocessor by the extraneous degree of depth gesture image sequence information of depth camera collection, microprocessor carries out mating after obtaining this gesture sequence and processes, compare with the template in processor, when there being the gesture met to occur, microprocessor produces corresponding control signal carries out channel switching to television set again.Channel selection system based on degree of depth gesture gathers gesture information by depth camera, and microprocessor carries out process and sends control signal, only can use gesture and can realize the channel selection of television set under the condition not needing controller.
Depth camera can extract depth of view information, filters out other environmental information and retains gesture information with depth information, and extracts human hands and carry out recognition and tracking.And microprocessor can receive the gesture sequence of being returned by depth camera collection and use DTW (dynamic time warping) algorithm and the template that self stores to carry out match cognization, when gathered gesture information sequence is consistent with the template sequence of storage, namely think and identify correct gesture information, then the index value of channel is constituted by different gesture informations, when identify determine signal time described microprocessor will send corresponding control signal according to index value, control signal controls television set and carries out the selection of channel.
In channel selection process, user need face depth camera, then adjusts video camera to a suitable angle, position, is convenient to draw the gesture of user and carries out better Tracking Recognition.Settle rationally with hand-written go out channel for selecting, system and identifiable design gesture also produce corresponding control signal to television set thus realize the selection of channel, and such user can select channel easily without the need to controller.
Microprocessor needs deal with data, and needs the driver etc. of fitting depth video camera, can adopt small-sized industrial computer.And software aspect, mainly contain image processing module, it comprises gesture feature extraction module and gesture information processing unit and data storage cell, as shown in Figure 1.Gesture feature extraction module is used for the garbage such as elimination background from depth information, and useful gesture information is extracted, and carries out tracking and make it to become a continuous print sequence.Gesture information processing unit, for the treatment of gesture vector, uses algorithm to carry out mating thus processing and identification gesture with the template stored mutually.Data storage cell is for storing the information such as gesture template and corresponding control table.
After depth camera kinect collects colored and depth data, the gesture tracking module in the sdk of kinect can be utilized to extract palm real-time spatial position coordinate (taking kinect as space coordinates initial point), the gesture velocity characteristic needed for then can extracting according to this coordinate: the present frame space coordinates of palm position deducts the space coordinates of former frame.After obtaining gesture feature, this processing unit can utilize WDTW algorithm to mate with the gesture template in data storage cell, obtains the gesture information of user for expressing.
In the present invention, adopt storage element to store data, data storage cell is used for storing the gesture result of gesture template required for gesture information processing unit and identification.Before system cloud gray model, need to store the predefined gesture template of user in the microprocessor.User according to the demand of oneself, hobby, can create various gesture, and after user determines gesture template, kinect can be utilized to be beforehand with a gesture, and then gesture feature extraction module can extract gesture template characteristic, is stored in data storage cell.
Depth camera opens the gesture catching user, user write in depth camera field range for select channel digit and confirm after, depth camera passes to microprocessor after capturing gesture sequence, microprocessor processes this gesture sequence, obtain user be intended to for the gesture expressed and be transferred to television set, the selection result of television set display user: channel selection or switching.
Claims (4)
1. based on a band selecting method for degree of depth gesture, it is characterized in that, comprise the steps:
Step one, adopts depth camera to extract gesture sequence; Step 2, the template sequence of this gesture sequence and storage is also compared by the gesture sequence that microprocessor reception depth camera is extracted, thus identifies correct gesture information; Step 3, by the index value of different gesture informations composition channel; Step 4, microprocessor sends corresponding control signal according to index value; Step 5, control signal controls television set and carries out channel selection.
2. a kind of band selecting method based on degree of depth gesture as claimed in claim 1, is characterized in that, described step one also comprises and filters out other environmental information and retain gesture information with depth information.
3. a kind of band selecting method based on degree of depth gesture as claimed in claim 1 or 2, it is characterized in that, the depth camera that described step one adopts is kinect, after depth camera kinect collects colored and depth data, the gesture tracking module in the sdk of kinect is utilized to extract palm real-time spatial position coordinate (x, y, z), then the gesture velocity characteristic (dx, dy, dz) needed for extracting according to this coordinate.
4. a kind of band selecting method based on degree of depth gesture as claimed in claim 3, is characterized in that, also comprise data storing step, be specially: store the predefined gesture template of user in the microprocessor; Store the gesture sequence collected by depth camera kinect simultaneously.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410658224.1A CN104333794A (en) | 2014-11-18 | 2014-11-18 | Channel selection method based on depth gestures |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410658224.1A CN104333794A (en) | 2014-11-18 | 2014-11-18 | Channel selection method based on depth gestures |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104333794A true CN104333794A (en) | 2015-02-04 |
Family
ID=52408431
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410658224.1A Pending CN104333794A (en) | 2014-11-18 | 2014-11-18 | Channel selection method based on depth gestures |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104333794A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105224214A (en) * | 2015-08-26 | 2016-01-06 | 广东欧珀移动通信有限公司 | A kind of method for controlling dialing and intelligent watch |
| CN105930785A (en) * | 2016-04-15 | 2016-09-07 | 丁盛 | Intelligent concealed-type interaction system |
| WO2017028070A1 (en) * | 2015-08-14 | 2017-02-23 | 郭子明 | Method and television system for prompting information when displaying hidden channel on basis of specific hand gesture |
| WO2017035846A1 (en) * | 2015-09-06 | 2017-03-09 | 何兰 | Method and remote control system for prompting information when hand gesture matches channel grouping |
| CN112492211A (en) * | 2020-12-01 | 2021-03-12 | 咪咕文化科技有限公司 | Shooting method, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101437124A (en) * | 2008-12-17 | 2009-05-20 | 三星电子（中国）研发中心 | Method for processing dynamic gesture identification signal facing (to)television set control |
| CN102801924A (en) * | 2012-07-20 | 2012-11-28 | 合肥工业大学 | Television program host interaction system based on Kinect |
| CN102968178A (en) * | 2012-11-07 | 2013-03-13 | 电子科技大学 | Gesture-based PPT (Power Point) control system |
| CN103294996A (en) * | 2013-05-09 | 2013-09-11 | 电子科技大学 | 3D gesture recognition method |
| CN103353935A (en) * | 2013-07-19 | 2013-10-16 | 电子科技大学 | 3D dynamic gesture identification method for intelligent home system |
| CN103501445A (en) * | 2013-10-12 | 2014-01-08 | 青岛旲天下智能科技有限公司 | Gesture-based interaction two-way interactive digital TV box system and implementation method |
-
2014
- 2014-11-18 CN CN201410658224.1A patent/CN104333794A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101437124A (en) * | 2008-12-17 | 2009-05-20 | 三星电子（中国）研发中心 | Method for processing dynamic gesture identification signal facing (to)television set control |
| CN102801924A (en) * | 2012-07-20 | 2012-11-28 | 合肥工业大学 | Television program host interaction system based on Kinect |
| CN102968178A (en) * | 2012-11-07 | 2013-03-13 | 电子科技大学 | Gesture-based PPT (Power Point) control system |
| CN103294996A (en) * | 2013-05-09 | 2013-09-11 | 电子科技大学 | 3D gesture recognition method |
| CN103353935A (en) * | 2013-07-19 | 2013-10-16 | 电子科技大学 | 3D dynamic gesture identification method for intelligent home system |
| CN103501445A (en) * | 2013-10-12 | 2014-01-08 | 青岛旲天下智能科技有限公司 | Gesture-based interaction two-way interactive digital TV box system and implementation method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017028070A1 (en) * | 2015-08-14 | 2017-02-23 | 郭子明 | Method and television system for prompting information when displaying hidden channel on basis of specific hand gesture |
| CN105224214A (en) * | 2015-08-26 | 2016-01-06 | 广东欧珀移动通信有限公司 | A kind of method for controlling dialing and intelligent watch |
| WO2017035846A1 (en) * | 2015-09-06 | 2017-03-09 | 何兰 | Method and remote control system for prompting information when hand gesture matches channel grouping |
| CN105930785A (en) * | 2016-04-15 | 2016-09-07 | 丁盛 | Intelligent concealed-type interaction system |
| CN112492211A (en) * | 2020-12-01 | 2021-03-12 | 咪咕文化科技有限公司 | Shooting method, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6968154B2 (en) | Control systems and control processing methods and equipment | |
| US20200310532A1 (en) | Systems, apparatuses, and methods for gesture recognition and interaction | |
| CN103353935B (en) | A kind of 3D dynamic gesture identification method for intelligent domestic system | |
| CN104333794A (en) | Channel selection method based on depth gestures | |
| CN103295028B (en) | gesture operation control method, device and intelligent display terminal | |
| CN106020478B (en) | A kind of intelligent terminal control method, device and intelligent terminal | |
| CN103970264B (en) | Gesture recognition and control method and device | |
| US20130169532A1 (en) | System and Method of Moving a Cursor Based on Changes in Pupil Position | |
| CN104102336A (en) | Portable device and method for providing non-contact interface | |
| CN102662473A (en) | Device and method for implementation of man-machine information interaction based on eye motion recognition | |
| CN103295029A (en) | Interaction method and device of gesture control terminal | |
| CN105518579A (en) | Information processing device and information processing method | |
| WO2016070688A1 (en) | Remote control method and system for virtual operation interface | |
| KR20140055819A (en) | Appparatus and method for face recognition | |
| CN105988566B (en) | A kind of information processing method and electronic equipment | |
| CN103605466A (en) | Facial recognition control terminal based method | |
| CN111047511A (en) | Image processing method and electronic equipment | |
| CN104035656A (en) | User interface and method | |
| CN102929547A (en) | Intelligent terminal contactless interaction method | |
| US20170140215A1 (en) | Gesture recognition method and virtual reality display output device | |
| WO2021170062A1 (en) | Method for adjusting air gesture and terminal | |
| CN102207822A (en) | Method and device for man-machine interaction | |
| CN103000054B (en) | Intelligent teaching machine for kitchen cooking and control method thereof | |
| CN104598027A (en) | Somatosensory control multi-media training system based on user behavior analysis | |
| CN202058090U (en) | Non-contact control system based on gesture recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150204 |
|
| WD01 | Invention patent application deemed withdrawn after publication |