CN102902356A - Gesture control system and control method thereof - Google Patents
Gesture control system and control method thereof Download PDFInfo
- Publication number
- CN102902356A CN102902356A CN2012103502528A CN201210350252A CN102902356A CN 102902356 A CN102902356 A CN 102902356A CN 2012103502528 A CN2012103502528 A CN 2012103502528A CN 201210350252 A CN201210350252 A CN 201210350252A CN 102902356 A CN102902356 A CN 102902356A
- Authority
- CN
- China
- Prior art keywords
- gesture
- operating interface
- dimensional operating
- projection
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a gesture control system comprising two gesture capturing sensors with clock synchronization, a processor and two three-dimensional projectors, wherein one of the gesture capturing sensors is used for capturing the front-back movement of the gesture of an operator and the other one is used for capturing the front-back movement and the left-right movement of the gesture of the operator; the processor is used for analyzing the image sequence captured by the gesture capturing sensors, obtaining the location information of the gesture in each frame of image of the image sequence and the velocity information of the current gesture movement and dividing the interface needed to be projected into a left projection area and a right projection area according to the obtained operating information; and the two three-dimensional projectors are oppositely arranged in the left front and the right front of the gesture capturing sensors and respectively used for receiving data of the left projection area and the right projection area and projecting. The invention also discloses a control method of the system. Compared with the prior art, the gesture control system disclosed by the invention is simpler and more convenient for operation, simple and natural in gesture and low in error recognition rate.
Description
Technical field
The present invention relates to the human-computer interactive control field, particularly gesture control system and control method thereof.
Background technology
In the non-contact type human-machine interaction system, the man-machine interaction of controlling based on gesture is an important link.Man-machine interaction based on gesture control has simply and easily characteristics, and its mode of operation commonly used is the gesture roaming.The gesture roaming refers to the Motion mapping of gesture in physical space realize the operation to quilt control object in the interface of being controlled object.Existing gesture motion mapping mode is mainly two dimensional motion, draws track as using mouse at screen, and with operational applications, this kind mode and human custom at three-dimensional space motion be difference to some extent, and the direct feel of man-machine interaction is lower.Even if the three-dimensional manipulating application system of utilizing degree of depth camera that some are novel, its operating process meets human three-dimensional space motion characteristics, but operation is also comparatively slowly complicated, and the processing time is more of a specified duration, is difficult to control, makes user's susceptible tired.
Summary of the invention
In order to overcome the deficiencies in the prior art, the object of the present invention is to provide a kind of gesture control system of three-dimensional operating interface, operate easier.
Another object of the present invention is to provide the gesture control method of above-mentioned gesture control system.
Purpose of the present invention is achieved through the following technical solutions:
A kind of gesture control system comprises
Two gesture capture sensors with clock synchronous, wherein seesawing for the gesture of catching the operator; Another is for the side-to-side movement of the gesture of catching the operator;
A processor, be used for analyzing the image sequence that the gesture capture sensor captures, draw the positional information of gesture in each two field picture of image sequence and the velocity information of current gesture motion, and according to the operation information that obtains, the interface of need projection is divided into left projection in zone and right projection in zone;
Two three-dimensional projectors place left front and the right front of gesture capture sensor relatively; Be respectively applied to receive left projection in zone data and right projection in zone data, and carry out projection.
Described gesture capture sensor is colour imagery shot or degree of depth camera.
The gesture control method of above-mentioned gesture control system may further comprise the steps:
(1) after the start-up system, two gesture capture sensors with clock synchronous catch operator's gesture synchronously, and the image sequence that captures is transferred to processor;
(2) processor is analyzed image sequence, draws the positional information of gesture in each two field picture of image sequence and the velocity information of current gesture motion, according to the operation information that obtains, the interface of need projection is divided into left projection in zone and right projection in zone;
(3) two three-dimensional projectors receive respectively left projection in zone data and right projection in zone data, carry out projection, and three-dimensional operating interface is operated.
Step (3) is described to be operated three-dimensional operating interface, is specially:
Three-dimensional operating interface is magic cube structure, and the length and width height is 60cm * 60cm * 60cm, and its one side is over against the operator, and the center is vacated, and around each operational module places, centers on the center with lineament;
When gesture for swinging palm left, then three-dimensional operating interface overturns left;
When gesture for swinging palm to the right, then three-dimensional operating interface overturns to the right;
When gesture for upwards swinging palm, then upwards upset of three-dimensional operating interface;
When gesture is that then three-dimensional operating interface overturns downwards to the lower swing palm;
When gesture for moving forward palm, then three-dimensional operating interface amplifies;
When gesture is mobile palm backward, then three-dimensional operating interface dwindles;
When gesture for stretching out one's hand crawl, then three-dimensional operating interface in operational module crawled;
When gesture is that two palms merge, then three-dimensional operating interface is closed;
When operational module was crawled, this operational module was shrunk to circle around the center;
When operational module was selected, this operational module was exaggerated;
Crawled and when being moved to the center of three-dimensional operating interface when operational module, this operational module starts.
Step (3) is described carries out in the operating process three-dimensional operating interface, system reminds the operator to operate in the mode of prompt tone, and the gesture to the operator detects behind prompt tone, a kind of gesture of input behind each prompt tone, after detecting successfully three-dimensional operating interface is operated, stand-by period is sent prompt tone prompting operation person conversion gesture after finishing, if the unsuccessful prompt tone that then only sends; Do not operate if surpass 1 minute operator, system will produce prompt tone again.
Compared with prior art, the present invention has the following advantages and beneficial effect:
(1) the space gesture language of the present invention by nature carries out three-dimensional operating interface and operates, and solved the complicated factitious problem of existing three-dimension gesture method of operating gesture;
(2) the present invention makes the operation interface easy to understand by the design of three-dimensional operating interface, and the user can use fast;
(3) the present invention's camera of being provided with respectively clock synchronous by the place ahead and a side the operator, need not adopt degree of depth camera, the treated device of image sequence is processed synchronously, carries out identifying operation, has solved the three-dimensional space direction identification problem of existing three-dimension gesture method of operating.
(4) the present invention is by arranging prompt tone, and only inputs a kind of gesture within detection time, reduced false recognition rate.
Description of drawings
Fig. 1 is the composition schematic diagram of the gesture control system of embodiments of the invention.
Fig. 2 is the process flow diagram of the gesture control method of embodiments of the invention.
Fig. 3 is the three-dimensional operating interface schematic diagram of operational module when maximum.
Fig. 4 is three-dimensional operating interface schematic diagram generally speaking.
The gesture that Fig. 5 overturns left for the control three-dimensional operating interface.
The gesture that Fig. 6 overturns to the right for the control three-dimensional operating interface.
Fig. 7 is the resupinate gesture of control three-dimensional operating interface.
The gesture that Fig. 8 overturns downwards for the control three-dimensional operating interface.
The gesture that Fig. 9 amplifies for the control three-dimensional operating interface.
The gesture that Figure 10 dwindles for the control three-dimensional operating interface.
Figure 11 is the gesture of crawl.
The gesture that Figure 12 closes for the control three-dimensional operating interface.
Signal when Figure 13 is three-dimensional operating interface without operation.
Figure 14 is the schematic diagram of operational module when selected.
Figure 15 is the schematic diagram of operational module when crawled.
Figure 16 is the schematic diagram of a plurality of operational modules when minimizing.
Embodiment
Below in conjunction with embodiment and accompanying drawing, the present invention is described in further detail, but embodiments of the present invention are not limited to this.
Embodiment
As shown in Figure 1, gesture control system of the present invention comprises two colour imagery shots with clock synchronous, a processor and two three-dimensional projectors.
Wherein, colour imagery shot 103 seesawing for the gesture 101 of catching the operator; Colour imagery shot device 102 is for the side-to-side movement of the gesture of catching the operator;
Processor is used for analyzing the image sequence that the gesture capture sensor captures, draw the positional information of gesture in each two field picture of image sequence and the velocity information of current gesture motion, and according to the operation information that obtains, the interface of need projection is divided into left projection in zone and right projection in zone;
Three-dimensional projector 105 and 106 places left front and the right front of colour imagery shot 102 ~ 103 relatively; Be respectively applied to receive left projection in zone data and right projection in zone data, and carry out projection.
As shown in Figure 2, the gesture control method of above-mentioned gesture control system may further comprise the steps:
(1) after the start-up system, two gesture capture sensors with clock synchronous catch operator's gesture synchronously, and the image sequence that captures is transferred to processor.
(2) processor is analyzed image sequence, draws the positional information of gesture in each two field picture of image sequence and the velocity information of current gesture motion; And according to the operation information that obtains, the interface of need projection is divided into left projection in zone and right projection in zone.
(3) two stereoscopic three-dimensional projector receive respectively left projection in zone data and right projection in zone data, carry out projection, and three-dimensional operating interface is operated, and are specially:
Shown in Fig. 3 ~ 4, three-dimensional operating interface is magic cube structure, and the length and width height is 60cm * 60cm * 60cm, and its one side is over against the operator, and the center is vacated, and around each operational module places, centers on the center with lineament; Wherein Fig. 3 is the three-dimensional operating interface of operational module when maximum; Fig. 4 is three-dimensional operating interface generally speaking.
When gesture for swinging palm (as shown in Figure 5) left, then three-dimensional operating interface overturns left;
When gesture for swinging palm (as shown in Figure 6) to the right, then three-dimensional operating interface overturns to the right;
When gesture for upwards swinging palm (as shown in Figure 7), then upwards upset of three-dimensional operating interface;
When gesture is that then three-dimensional operating interface overturns downwards to lower swing palm (as shown in Figure 8);
When gesture for moving forward palm (as shown in Figure 9), then three-dimensional operating interface amplifies;
When gesture is mobile palm (as shown in figure 10) backward, then three-dimensional operating interface dwindles;
When gesture for stretching out one's hand crawl (as shown in figure 11), then three-dimensional operating interface in operational module crawled;
When gesture is that two palms merge (as shown in figure 12), then three-dimensional operating interface is closed.
During to left and right, upper and lower upset, the interface is around middle shaft rotation; Amplify, during reduction operation, the interface is amplified take barycenter as initial point and is dwindled.
Schematic diagram when Figure 13 is the interface without operation, a wherein, b, c, d, e, f, g, h are operational module.
As shown in figure 14, when operational module was selected, this operational module was exaggerated, and all the other operational modules dwindle;
As shown in figure 15, when operational module was crawled, this operational module was shrunk to circle around the center.
Figure 16 shows that the schematic diagram when a plurality of operational modules minimize.
Crawled and when being moved to the center of three-dimensional operating interface when operational module, this operational module starts.
Three-dimensional operating interface is carried out in the operating process, system reminds the operator to operate in the mode of prompt tone, and the gesture to the operator detects behind prompt tone, a kind of gesture of input behind each prompt tone, after detecting successfully three-dimensional operating interface is operated, stand-by period is sent prompt tone prompting operation person conversion gesture after finishing, if the unsuccessful prompt tone that then only sends; Do not operate if surpass 1 minute operator, system will produce prompt tone again.
Above-described embodiment is the better embodiment of the present invention; but embodiments of the present invention are not limited by the examples; as colour imagery shot also replaceable for degree of depth shooting first-class; other any do not deviate from change, the modification done under Spirit Essence of the present invention and the principle, substitutes, combination, simplify; all should be the substitute mode of equivalence, be included within protection scope of the present invention.
Claims (5)
1. a gesture control system is characterized in that, comprises
Two gesture capture sensors with clock synchronous, wherein seesawing for the gesture of catching the operator; Another is for the side-to-side movement of the gesture of catching the operator;
A processor, be used for analyzing the image sequence that the gesture capture sensor captures, draw the positional information of gesture in each two field picture of image sequence and the velocity information of current gesture motion, and according to the operation information that obtains, the interface of need projection is divided into left projection in zone and right projection in zone;
Two three-dimensional projectors place left front and the right front of gesture capture sensor relatively; Be respectively applied to receive left projection in zone data and right projection in zone data, and carry out projection.
2. gesture control system according to claim 1 is characterized in that, described gesture capture sensor is colour imagery shot or degree of depth camera.
3. the gesture control method of gesture control system as claimed in claim 1 is characterized in that, may further comprise the steps:
(1) after the start-up system, two gesture capture sensors with clock synchronous catch operator's gesture synchronously, and the image sequence that captures is transferred to processor;
(2) processor is analyzed image sequence, draws the positional information of gesture in each two field picture of image sequence and the velocity information of current gesture motion, according to the operation information that obtains, the interface of need projection is divided into left projection in zone and right projection in zone;
(3) two three-dimensional projectors receive respectively left projection in zone data and right projection in zone data, carry out projection, and three-dimensional operating interface is operated.
4. gesture control method according to claim 3 is characterized in that, step (3) is described to be operated three-dimensional operating interface, is specially:
Three-dimensional operating interface is magic cube structure, and the length and width height is 60cm * 60cm * 60cm, and its one side is over against the operator, and the center is vacated, and around each operational module places, centers on the center with lineament;
When gesture for swinging palm left, then three-dimensional operating interface overturns left;
When gesture for swinging palm to the right, then three-dimensional operating interface overturns to the right;
When gesture for upwards swinging palm, then upwards upset of three-dimensional operating interface;
When gesture is that then three-dimensional operating interface overturns downwards to the lower swing palm;
When gesture for moving forward palm, then three-dimensional operating interface amplifies;
When gesture is mobile palm backward, then three-dimensional operating interface dwindles;
When gesture for stretching out one's hand crawl, then three-dimensional operating interface in operational module crawled;
When gesture is that two palms merge, then three-dimensional operating interface is closed;
When operational module was crawled, this operational module was shrunk to circle around the center;
When operational module was selected, this operational module was exaggerated;
Crawled and when being moved to the center of three-dimensional operating interface when operational module, this operational module starts.
5. gesture control method according to claim 3, it is characterized in that, step (3) is described carries out in the operating process three-dimensional operating interface, system reminds the operator to operate in the mode of prompt tone, and the gesture to the operator detects behind prompt tone, inputs a kind of gesture behind each prompt tone, detects successfully afterwards three-dimensional operating interface to be operated, stand-by period is sent prompt tone prompting operation person conversion gesture after finishing, if the unsuccessful prompt tone that then only sends; Do not operate if surpass 1 minute operator, system will produce prompt tone again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210350252.8A CN102902356B (en) | 2012-09-18 | 2012-09-18 | A kind of gestural control system and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210350252.8A CN102902356B (en) | 2012-09-18 | 2012-09-18 | A kind of gestural control system and control method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102902356A true CN102902356A (en) | 2013-01-30 |
| CN102902356B CN102902356B (en) | 2015-08-26 |
Family
ID=47574644
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210350252.8A Active CN102902356B (en) | 2012-09-18 | 2012-09-18 | A kind of gestural control system and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102902356B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104699377A (en) * | 2013-12-04 | 2015-06-10 | 联想(北京)有限公司 | Control method and electronic equipment |
| CN104932691A (en) * | 2015-06-19 | 2015-09-23 | 中国航天员科研训练中心 | Real-time gesture interaction system with tactile perception feedback |
| CN105607407A (en) * | 2015-12-31 | 2016-05-25 | 苏州佳世达光电有限公司 | Projection device and control method for projection device |
| CN105824399A (en) * | 2015-01-06 | 2016-08-03 | 中兴通讯股份有限公司 | Control method, system and apparatus for projection equipment |
| CN107367966A (en) * | 2017-07-14 | 2017-11-21 | 深圳凌触科技有限公司 | Man-machine interaction method and device |
| CN107998670A (en) * | 2017-12-13 | 2018-05-08 | 哈尔滨拓博科技有限公司 | Remote-control toy control system based on plane gesture identification |
| CN110018738A (en) * | 2019-03-04 | 2019-07-16 | 华南理工大学 | A kind of emotion converting system based on real scene emotional expression |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520700A (en) * | 2008-12-31 | 2009-09-02 | 广东威创视讯科技股份有限公司 | Camera-based three-dimensional positioning touch device and positioning method thereof |
| CN101807114A (en) * | 2010-04-02 | 2010-08-18 | 浙江大学 | Natural interactive method based on three-dimensional gestures |
| WO2012011044A1 (en) * | 2010-07-20 | 2012-01-26 | Primesense Ltd. | Interactive reality augmentation for natural interaction |
-
2012
- 2012-09-18 CN CN201210350252.8A patent/CN102902356B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520700A (en) * | 2008-12-31 | 2009-09-02 | 广东威创视讯科技股份有限公司 | Camera-based three-dimensional positioning touch device and positioning method thereof |
| CN101807114A (en) * | 2010-04-02 | 2010-08-18 | 浙江大学 | Natural interactive method based on three-dimensional gestures |
| WO2012011044A1 (en) * | 2010-07-20 | 2012-01-26 | Primesense Ltd. | Interactive reality augmentation for natural interaction |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104699377A (en) * | 2013-12-04 | 2015-06-10 | 联想(北京)有限公司 | Control method and electronic equipment |
| CN105824399A (en) * | 2015-01-06 | 2016-08-03 | 中兴通讯股份有限公司 | Control method, system and apparatus for projection equipment |
| CN104932691A (en) * | 2015-06-19 | 2015-09-23 | 中国航天员科研训练中心 | Real-time gesture interaction system with tactile perception feedback |
| CN105607407A (en) * | 2015-12-31 | 2016-05-25 | 苏州佳世达光电有限公司 | Projection device and control method for projection device |
| CN105607407B (en) * | 2015-12-31 | 2018-05-11 | 苏州佳世达光电有限公司 | A kind of control method of projection arrangement and projection arrangement |
| CN107367966A (en) * | 2017-07-14 | 2017-11-21 | 深圳凌触科技有限公司 | Man-machine interaction method and device |
| CN107367966B (en) * | 2017-07-14 | 2020-09-04 | 深圳凌触科技有限公司 | Man-machine interaction method and device |
| CN107998670A (en) * | 2017-12-13 | 2018-05-08 | 哈尔滨拓博科技有限公司 | Remote-control toy control system based on plane gesture identification |
| CN110018738A (en) * | 2019-03-04 | 2019-07-16 | 华南理工大学 | A kind of emotion converting system based on real scene emotional expression |
| CN110018738B (en) * | 2019-03-04 | 2021-09-21 | 华南理工大学 | Emotion conversion system based on real scene emotion expression |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102902356B (en) | 2015-08-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102902356A (en) | Gesture control system and control method thereof | |
| Berman et al. | Sensors for gesture recognition systems | |
| CN102221887B (en) | Interactive projection system and method | |
| KR101815020B1 (en) | Apparatus and Method for Controlling Interface | |
| CN107291221B (en) | Across screen self-adaption accuracy method of adjustment and device based on natural gesture | |
| TWI528224B (en) | 3d gesture manipulation method and apparatus | |
| US9417706B2 (en) | Three dimensional user interface session control using depth sensors | |
| TW201539305A (en) | Controlling a computing-based device using gestures | |
| CN102831380A (en) | Body action identification method and system based on depth image induction | |
| JP2013250882A5 (en) | ||
| KR101794233B1 (en) | Realistic game content providing system using motion recognition and special effect control technique | |
| JP2011022945A5 (en) | Interactive operation device | |
| CN103501869A (en) | Manual and camera-based game control | |
| JPWO2014208168A1 (en) | Information processing apparatus, control method, program, and storage medium | |
| CN103500335A (en) | Photo shooting and browsing method and photo shooting and browsing device based on gesture recognition | |
| JPWO2013114806A1 (en) | Biometric authentication device and biometric authentication method | |
| CN102736728A (en) | Control method and system for three-dimensional virtual object and processing device for three-dimensional virtual object | |
| KR101169583B1 (en) | Virture mouse driving method | |
| WO2018006481A1 (en) | Motion-sensing operation method and device for mobile terminal | |
| JP2012181646A (en) | Data processor, data processing system, and program | |
| CN102253718B (en) | Three-dimensional hand-written inputting method | |
| JP6467039B2 (en) | Information processing device | |
| CN102411426A (en) | Operating method of electronic device | |
| Cadena et al. | Fingertip detection approach on depth image sequences for interactive projection system | |
| CN112529770A (en) | Image processing method, image processing device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |