CN104063039A - Human-computer interaction method of wearable computer intelligent terminal - Google Patents
Human-computer interaction method of wearable computer intelligent terminal Download PDFInfo
- Publication number
- CN104063039A CN104063039A CN201310085860.5A CN201310085860A CN104063039A CN 104063039 A CN104063039 A CN 104063039A CN 201310085860 A CN201310085860 A CN 201310085860A CN 104063039 A CN104063039 A CN 104063039A
- Authority
- CN
- China
- Prior art keywords
- computer
- intelligent terminal
- video eyeglasses
- human
- wearable computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention belongs to the technical field of human-computer interaction, and particularly relates to a human-computer interaction method of a wearable computer intelligent terminal. The method comprises steps as follows: wearing wearable intelligent glasses, implementing an augmented reality technology, performing gesture recognition and performing voice recognition. According to the human-computer interaction method, interaction between a human body and a computer is realized instead of dependence of a mouse and a keyboard; and meanwhile, movability of the computer is improved, and particularly, the human-computer interaction is more convenient under the outdoor environment and the like, so that the computer can be more widely applied to fields about production, work and the like.
Description
Technical field
The invention belongs to computer man-machine interacting technical field, specifically, relate to a kind of man-machine interaction method of wearable computer intelligent terminal.
Background technology
Computer man-machine interacting technology, refers to by computer input, output device, realizes the technology of people and computer dialog in effective mode.It comprises that machine provides in a large number for information about to people by output or display device and prompting is asked for instructions etc., people by input equipment to machine input for information about and prompting ask for instructions etc., people inputs for information about to machine by input equipment, answers a question etc.Human-computer interaction technology is one of important content in computer user interface design.The ambits such as it and cognitive science, ergonomics, psychology have close contacting.
In existing multimedia human-computer interaction method, input method has:
Keyboard input: traditional approach
Mouse input: the important input mode of graphic user interface
Handwriting input: handwritten Kanji recognition, panel computer
Phonetic entry
Touch-screen input
Digitizer input: be applicable to CAD/CAM system
Scanning input: bar code, scanner, optophone
Three-dimensional input: data glove, 3D mouse, forceball etc.
Vision input: picture pick-up device
All these input modes all need to input in the situation of user's direct control existing equipment, and use occasion has significant limitation, and ease of use is not strong, also can need to train the using method of professional input equipment
Summary of the invention
In order to solve prior art problem, for the drawback of above input method, the invention provides one more convenient, little input method affected by environment.
The man-machine interaction method of a kind of wearable computer intelligent terminal provided by the invention, comprises wearable intelligent glasses, augmented reality, gesture identification, speech recognition, specific as follows:
(1) wear video eyeglasses: user can wear half-penetration type, closed or projection-type video's glasses;
(2) augmented reality: use augmented reality system operation interface to be incorporated in user's the visual field;
(3) gesture identification: by the gesture of the camera identification user on video eyeglasses, in order to complete button click, drag graphical window etc.;
(4) speech recognition: input difficult content for gesture identification, as: Word message, uses voice recognition mode to carry out typing;
In the present invention, the video eyeglasses using in step (1) has various ways, wherein fully closed video eyeglasses, and camera not only will be identified gesture, environment outdoor scene can also be presented in the screen of video eyeglasses simultaneously.
In invention, in step (3), gesture identification is in order to analogy mouse function.
In the present invention, owing to having used gesture identification to carry out analog mouse operation, so be not subject to the impact of environment factor.Owing to being wearable computer intelligent terminal, so can use, greatly expanded the use scenes of computing machine in the environment such as manufacture production, field simultaneously.
Brief description of the drawings
Fig. 1 is man-machine interaction schematic diagram in embodiment 1 in the present invention.
Number in the figure: 1, eyes; 2, Wearable glasses; 3, camera; 4, hand; 5, the image in augmented reality.
Embodiment
Below in conjunction with drawings and Examples, the present invention is described in further detail.
embodiment 1
In the present invention, man-machine interaction method completes the step of three-dimensional picture design in conjunction with augmented reality by gesture identification.
It is as follows that user uses gesture identification method to carry out three-dimensional picture design:
1) first slip-stick artist wears video eyeglasses (label 2 in legend) in the time that three-dimensional picture designs;
2) three-dimensional picture is showed slip-stick artist by video eyeglasses;
3) slip-stick artist reaches out one's hands, and intelligent terminal system identifies slip-stick artist's gesture (label 4 in legend) by camera (label 3 in legend), and slip-stick artist realizes any rotation, convergent-divergent three-dimensional model;
4) function menu that slip-stick artist clicks Three-dimensional Design Software by gesture calls three-dimensional design function (label 5 in legend);
5) slip-stick artist completes three-dimensional picture design as requested;
After three-dimensional picture has designed, slip-stick artist under the help of video eyeglasses, preview three-dimensional model.
embodiment 2
In the present invention, man-machine interaction method completes the step of engine maintenance in conjunction with augmented reality by gesture identification.
It is as follows that user uses gesture identification method to carry out engine maintenance:
1) first slip-stick artist wears video eyeglasses in the time of service engine;
2) video eyeglasses by engines three-dimensional schematic diagram shows to slip-stick artist;
3) slip-stick artist, according to engine mockup, by gesture drags, amplifies, launches find corresponding damage position in the 3-D view of showing at video eyeglasses;
4) slip-stick artist clicks pathfinder by gesture, and maintenance step is showed slip-stick artist by video eyeglasses;
5) slip-stick artist fixes over an engine according to pathfinder;
After engine overhaul completes, slip-stick artist's starting engine, and read engine parameter by video eyeglasses, to judge whether maintenance completes.
Claims (3)
1. a man-machine interaction method for wearable computer intelligent terminal, is characterized in that as follows:
User wears video eyeglasses, and this video eyeglasses is a kind of wearable computer or intelligent terminal;
On video eyeglasses, there is minisize pick-up head, for catching user's gesture;
On video eyeglasses, there is microphone, for identifying user's voice command;
After the system identification user gesture of video eyeglasses, executive system operation, similar mouse action;
Video eyeglasses can be by microphone or other transmission sound technology identification user voice command;
Video eyeglasses uses augmented reality, and virtual image is combined with visions of reality.
2. the man-machine interaction method of wearable computer intelligent terminal according to claim 1, is characterized in that: the video eyeglasses that wearable computer intelligent terminal adopts, the method for its augmented reality has half-penetration type, closed or projection.
3. the man-machine interaction method of wearable computer intelligent terminal according to claim 1, is characterized in that: the method for man-machine interaction has gesture identification, speech recognition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310085860.5A CN104063039A (en) | 2013-03-18 | 2013-03-18 | Human-computer interaction method of wearable computer intelligent terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310085860.5A CN104063039A (en) | 2013-03-18 | 2013-03-18 | Human-computer interaction method of wearable computer intelligent terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104063039A true CN104063039A (en) | 2014-09-24 |
Family
ID=51550793
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310085860.5A Pending CN104063039A (en) | 2013-03-18 | 2013-03-18 | Human-computer interaction method of wearable computer intelligent terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104063039A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104410883A (en) * | 2014-11-29 | 2015-03-11 | 华南理工大学 | Mobile wearable non-contact interaction system and method |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
| CN105652451A (en) * | 2016-04-15 | 2016-06-08 | 深圳市智能体科技有限公司 | Intelligent glasses |
| CN105691405A (en) * | 2014-12-11 | 2016-06-22 | 现代自动车株式会社 | Vehicle for recognizing driver using mobile device and control method ther |
| CN105867640A (en) * | 2016-05-12 | 2016-08-17 | 上海擎感智能科技有限公司 | Smart glasses and control method and control system of smart glasses |
| CN105892050A (en) * | 2015-01-02 | 2016-08-24 | 靳卫强 | Augmented reality intelligent glasses |
| CN106155311A (en) * | 2016-06-28 | 2016-11-23 | 努比亚技术有限公司 | AR helmet, AR interactive system and the exchange method of AR scene |
| CN106331806A (en) * | 2016-08-23 | 2017-01-11 | 青岛海信电器股份有限公司 | Realization method for virtual remote controller and devices |
| CN106502424A (en) * | 2016-11-29 | 2017-03-15 | 上海小持智能科技有限公司 | Based on the interactive augmented reality system of speech gestures and limb action |
| CN107025690A (en) * | 2015-10-27 | 2017-08-08 | Sk普兰尼特有限公司 | For the method and apparatus for the information for building the position on shown commodity |
| WO2018113740A1 (en) * | 2016-12-21 | 2018-06-28 | Zyetric Technologies Limited | Combining virtual reality and augmented reality |
| CN109271064A (en) * | 2016-07-29 | 2019-01-25 | 三星显示有限公司 | Display device |
| US10262197B2 (en) | 2015-11-17 | 2019-04-16 | Huawei Technologies Co., Ltd. | Gesture-based object measurement method and apparatus |
| CN109725717A (en) * | 2018-11-30 | 2019-05-07 | 成都理想境界科技有限公司 | Image processing method and AR equipment applied to AR equipment |
| CN110061755A (en) * | 2019-04-30 | 2019-07-26 | 徐州重型机械有限公司 | Operation householder method and system, wearable device and engineering truck |
| CN110531847A (en) * | 2019-07-26 | 2019-12-03 | 中国人民解放军军事科学院国防科技创新研究院 | A kind of novel social contact method and system based on augmented reality |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101512632A (en) * | 2006-09-27 | 2009-08-19 | 索尼株式会社 | Display apparatus and display method |
| US20110214082A1 (en) * | 2010-02-28 | 2011-09-01 | Osterhout Group, Inc. | Projection triggering through an external marker in an augmented reality eyepiece |
| CN102779000A (en) * | 2012-05-03 | 2012-11-14 | 乾行讯科（北京）科技有限公司 | User interaction system and method |
| CN102945564A (en) * | 2012-10-16 | 2013-02-27 | 上海大学 | True 3D modeling system and method based on video perspective type augmented reality |
-
2013
- 2013-03-18 CN CN201310085860.5A patent/CN104063039A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101512632A (en) * | 2006-09-27 | 2009-08-19 | 索尼株式会社 | Display apparatus and display method |
| US20110214082A1 (en) * | 2010-02-28 | 2011-09-01 | Osterhout Group, Inc. | Projection triggering through an external marker in an augmented reality eyepiece |
| CN102779000A (en) * | 2012-05-03 | 2012-11-14 | 乾行讯科（北京）科技有限公司 | User interaction system and method |
| CN102945564A (en) * | 2012-10-16 | 2013-02-27 | 上海大学 | True 3D modeling system and method based on video perspective type augmented reality |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104410883A (en) * | 2014-11-29 | 2015-03-11 | 华南理工大学 | Mobile wearable non-contact interaction system and method |
| CN104410883B (en) * | 2014-11-29 | 2018-04-27 | 华南理工大学 | The mobile wearable contactless interactive system of one kind and method |
| CN105691405A (en) * | 2014-12-11 | 2016-06-22 | 现代自动车株式会社 | Vehicle for recognizing driver using mobile device and control method ther |
| CN105691405B (en) * | 2014-12-11 | 2020-04-21 | 现代自动车株式会社 | Vehicle for identifying driver using mobile device and control method thereof |
| CN105892050A (en) * | 2015-01-02 | 2016-08-24 | 靳卫强 | Augmented reality intelligent glasses |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
| CN107025690A (en) * | 2015-10-27 | 2017-08-08 | Sk普兰尼特有限公司 | For the method and apparatus for the information for building the position on shown commodity |
| US10262197B2 (en) | 2015-11-17 | 2019-04-16 | Huawei Technologies Co., Ltd. | Gesture-based object measurement method and apparatus |
| CN105652451A (en) * | 2016-04-15 | 2016-06-08 | 深圳市智能体科技有限公司 | Intelligent glasses |
| CN105867640A (en) * | 2016-05-12 | 2016-08-17 | 上海擎感智能科技有限公司 | Smart glasses and control method and control system of smart glasses |
| CN106155311A (en) * | 2016-06-28 | 2016-11-23 | 努比亚技术有限公司 | AR helmet, AR interactive system and the exchange method of AR scene |
| CN109271064A (en) * | 2016-07-29 | 2019-01-25 | 三星显示有限公司 | Display device |
| US11500496B2 (en) | 2016-07-29 | 2022-11-15 | Samsung Display Co., Ltd. | Display device |
| US10541279B2 (en) | 2016-07-29 | 2020-01-21 | Samsung Display Co., Ltd. | Display device |
| US11861117B2 (en) | 2016-07-29 | 2024-01-02 | Samsung Display Co., Ltd. | Display device |
| CN106331806B (en) * | 2016-08-23 | 2019-11-19 | 青岛海信电器股份有限公司 | A kind of implementation method and equipment of virtual remote controller |
| CN106331806A (en) * | 2016-08-23 | 2017-01-11 | 青岛海信电器股份有限公司 | Realization method for virtual remote controller and devices |
| CN106502424A (en) * | 2016-11-29 | 2017-03-15 | 上海小持智能科技有限公司 | Based on the interactive augmented reality system of speech gestures and limb action |
| US10488941B2 (en) | 2016-12-21 | 2019-11-26 | Zyetric Technologies Limited | Combining virtual reality and augmented reality |
| WO2018113740A1 (en) * | 2016-12-21 | 2018-06-28 | Zyetric Technologies Limited | Combining virtual reality and augmented reality |
| CN109725717A (en) * | 2018-11-30 | 2019-05-07 | 成都理想境界科技有限公司 | Image processing method and AR equipment applied to AR equipment |
| CN110061755A (en) * | 2019-04-30 | 2019-07-26 | 徐州重型机械有限公司 | Operation householder method and system, wearable device and engineering truck |
| CN110061755B (en) * | 2019-04-30 | 2021-04-16 | 徐州重型机械有限公司 | Operation assisting method and system, wearable device and engineering vehicle |
| CN110531847A (en) * | 2019-07-26 | 2019-12-03 | 中国人民解放军军事科学院国防科技创新研究院 | A kind of novel social contact method and system based on augmented reality |
| CN110531847B (en) * | 2019-07-26 | 2020-07-14 | 中国人民解放军军事科学院国防科技创新研究院 | Social contact method and system based on augmented reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104063039A (en) | Human-computer interaction method of wearable computer intelligent terminal | |
| Garg et al. | Vision based hand gesture recognition | |
| Rautaray | Real time hand gesture recognition system for dynamic applications | |
| CN103440033B (en) | A kind of method and apparatus realizing man-machine interaction based on free-hand and monocular cam | |
| CN109145802B (en) | Kinect-based multi-person gesture man-machine interaction method and device | |
| KR20130006186A (en) | Method, terminal, and computer readable recording medium for controlling content by detecting gesture of head and gesture of hand | |
| CN102520793A (en) | Gesture identification-based conference presentation interaction method | |
| Vivek Veeriah et al. | Robust hand gesture recognition algorithm for simple mouse control | |
| WO2020216106A1 (en) | Wearable computing device and human-computer interaction method | |
| Gajjar et al. | Hand gesture real time paint tool-box: Machine learning approach | |
| Ismail et al. | Vision-based technique and issues for multimodal interaction in augmented reality | |
| Sugiura et al. | A natural click interface for AR systems with a single camera | |
| CN107391015B (en) | Control method, device and equipment of intelligent tablet and storage medium | |
| US10095308B2 (en) | Gesture based human machine interface using marker | |
| CN106547339B (en) | Control method and device of computer equipment | |
| JP2018005663A (en) | Information processing unit, display system, and program | |
| CN101446859B (en) | Machine vision based input method and system thereof | |
| CN109857244B (en) | Gesture recognition method and device, terminal equipment, storage medium and VR glasses | |
| Machidori et al. | Implementation of multi-modal interface for VR application | |
| Manresa-Yee et al. | Towards hands-free interfaces based on real-time robust facial gesture recognition | |
| Dadiz et al. | Go-Mo (Go-Motion): An android mobile application detecting motion gestures for generating basic mobile phone commands utilizing KLT algorithm | |
| Lu et al. | Classification, application, challenge, and future of midair gestures in augmented reality | |
| Jiang et al. | A brief analysis of gesture recognition in VR | |
| Lee et al. | Mouse operation on monitor by interactive analysis of intuitive hand motions | |
| CN112612358A (en) | Human and large screen multi-mode natural interaction method based on visual recognition and voice recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140924 |
|
| WD01 | Invention patent application deemed withdrawn after publication |