CN109144235B - 基于头手协同动作的人机交互方法与系统 - Google Patents
基于头手协同动作的人机交互方法与系统 Download PDFInfo
- Publication number
- CN109144235B CN109144235B CN201710465189.5A CN201710465189A CN109144235B CN 109144235 B CN109144235 B CN 109144235B CN 201710465189 A CN201710465189 A CN 201710465189A CN 109144235 B CN109144235 B CN 109144235B
- Authority
- CN
- China
- Prior art keywords
- control
- user
- hand
- menu
- cursor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 91
- 238000000034 method Methods 0.000 title claims abstract description 62
- 230000002079 cooperative effect Effects 0.000 title abstract description 3
- 230000004044 response Effects 0.000 claims abstract description 54
- 230000009471 action Effects 0.000 claims abstract description 47
- 210000003128 head Anatomy 0.000 claims description 53
- 230000001960 triggered effect Effects 0.000 claims description 24
- 239000013598 vector Substances 0.000 claims description 17
- 238000013459 approach Methods 0.000 claims description 8
- 210000001747 pupil Anatomy 0.000 claims description 8
- 230000004886 head movement Effects 0.000 claims description 4
- 239000007787 solid Substances 0.000 claims description 4
- 210000000887 face Anatomy 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 239000011521 glass Substances 0.000 claims 3
- 230000000875 corresponding effect Effects 0.000 abstract description 35
- 230000010365 information processing Effects 0.000 description 32
- 230000000007 visual effect Effects 0.000 description 16
- 230000006870 function Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 210000003811 finger Anatomy 0.000 description 12
- 238000001514 detection method Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 210000003813 thumb Anatomy 0.000 description 3
- 210000004247 hand Anatomy 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000007639 printing Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 241000203475 Neopanax arboreus Species 0.000 description 1
- 235000008331 Pinus X rigitaeda Nutrition 0.000 description 1
- 235000011613 Pinus brutia Nutrition 0.000 description 1
- 241000018646 Pinus brutia Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 210000004932 little finger Anatomy 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710465189.5A CN109144235B (zh) | 2017-06-19 | 2017-06-19 | 基于头手协同动作的人机交互方法与系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710465189.5A CN109144235B (zh) | 2017-06-19 | 2017-06-19 | 基于头手协同动作的人机交互方法与系统 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109144235A CN109144235A (zh) | 2019-01-04 |
CN109144235B true CN109144235B (zh) | 2024-01-23 |
Family
ID=64804272
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710465189.5A Active CN109144235B (zh) | 2017-06-19 | 2017-06-19 | 基于头手协同动作的人机交互方法与系统 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109144235B (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3851939A1 (en) * | 2020-01-14 | 2021-07-21 | Apple Inc. | Positioning a user-controlled spatial selector based on extremity tracking information and eye tracking information |
CN115097995A (zh) * | 2022-06-23 | 2022-09-23 | 京东方科技集团股份有限公司 | 界面交互方法、界面交互装置以及计算机存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102819315A (zh) * | 2012-07-23 | 2012-12-12 | 中兴通讯股份有限公司 | 一种3d人机交互方法及系统 |
CN106249882A (zh) * | 2016-07-26 | 2016-12-21 | 华为技术有限公司 | 一种应用于vr设备的手势操控方法与装置 |
CN106354259A (zh) * | 2016-08-30 | 2017-01-25 | 同济大学 | 基于Soli和Tobii的汽车HUD眼动辅助手势交互系统及其装置 |
CN106527722A (zh) * | 2016-11-08 | 2017-03-22 | 网易(杭州)网络有限公司 | 虚拟现实中的交互方法、系统及终端设备 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9852546B2 (en) * | 2015-01-28 | 2017-12-26 | CCP hf. | Method and system for receiving gesture input via virtual control objects |
US9588593B2 (en) * | 2015-06-30 | 2017-03-07 | Ariadne's Thread (Usa), Inc. | Virtual reality system with control command gestures |
-
2017
- 2017-06-19 CN CN201710465189.5A patent/CN109144235B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102819315A (zh) * | 2012-07-23 | 2012-12-12 | 中兴通讯股份有限公司 | 一种3d人机交互方法及系统 |
CN106249882A (zh) * | 2016-07-26 | 2016-12-21 | 华为技术有限公司 | 一种应用于vr设备的手势操控方法与装置 |
CN106354259A (zh) * | 2016-08-30 | 2017-01-25 | 同济大学 | 基于Soli和Tobii的汽车HUD眼动辅助手势交互系统及其装置 |
CN106527722A (zh) * | 2016-11-08 | 2017-03-22 | 网易(杭州)网络有限公司 | 虚拟现实中的交互方法、系统及终端设备 |
Also Published As
Publication number | Publication date |
---|---|
CN109144235A (zh) | 2019-01-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7465952B2 (ja) | 三次元環境と相互作用するためのデバイス、方法、及びグラフィカルユーザインタフェース | |
US11048333B2 (en) | System and method for close-range movement tracking | |
US11003253B2 (en) | Gesture control of gaming applications | |
JP6382261B2 (ja) | 高度なカメラをベースとした入力 | |
JP5900393B2 (ja) | 情報処理装置、操作制御方法及びプログラム | |
CN117032519A (zh) | 用于与三维环境进行交互的设备、方法和图形用户界面 | |
EP3527121B1 (en) | Gesture detection in a 3d mapping environment | |
CN107665042B (zh) | 增强的虚拟触摸板和触摸屏 | |
US9910498B2 (en) | System and method for close-range movement tracking | |
CN115167676A (zh) | 用于在三维环境中显示应用程序的设备和方法 | |
JP2023515525A (ja) | ウェアラブルシステムのための手のジェスチャ入力 | |
CN115280262A (zh) | 用于提供计算机生成的体验的设备、方法和图形用户界面 | |
TW202046085A (zh) | 基於捏合和拉放手勢偵測人工實境系統中的輸入 | |
CN107918482B (zh) | 沉浸式vr系统中避免过度刺激的方法与系统 | |
KR20220032059A (ko) | 증강 현실 시스템용 터치프리 인터페이스 | |
CN107918481B (zh) | 基于手势识别的人机交互方法与系统 | |
CN108536273A (zh) | 基于手势的人机菜单交互方法与系统 | |
US20180032139A1 (en) | Interactive system control apparatus and method | |
TW202105129A (zh) | 具有用於閘控使用者介面元件的個人助理元件之人工實境系統 | |
JP2004078977A (ja) | インターフェイス装置 | |
CN108459702B (zh) | 基于手势识别与视觉反馈的人机交互方法与系统 | |
JP6841232B2 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
CN109144235B (zh) | 基于头手协同动作的人机交互方法与系统 | |
CN110717993A (zh) | 一种分体式ar眼镜系统的交互方法、系统及介质 | |
US20240103629A1 (en) | Control device and control method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20191126 Address after: 300450 room 203b-3, building 3, No.4, Haitai development road 2, Huayuan Industrial Zone (outside the ring), Binhai high tech Zone, Binhai New Area, Tianjin Applicant after: TIANJIN SHARPNOW TECHNOLOGY Co.,Ltd. Address before: 518000 A2, Shenzhen City, Guangdong Province, the 12 building of Kang Jia R & D building, south of science and technology south twelve Applicant before: TIANJIN FENGSHI HUDONG TECHNOLOGY Co.,Ltd. SHENZHEN BRANCH |
|
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20210120 Address after: 518000 B1018, 99 Dahe Road, Runcheng community, Guanhu street, Longhua District, Shenzhen City, Guangdong Province Applicant after: Shenzhen laimile Intelligent Technology Co.,Ltd. Address before: Room 203b-3, building 3, No.4, Haitai development road 2, Huayuan Industrial Zone, Binhai high tech Zone, Binhai New Area, Tianjin 300450 Applicant before: Tianjin Sharpnow Technology Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20210924 Address after: 518000 509, xintengda building, building M8, Maqueling Industrial Zone, Maling community, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province Applicant after: Shenzhen qiaoniu Technology Co.,Ltd. Address before: 518000 B1018, 99 Dahe Road, Runcheng community, Guanhu street, Longhua District, Shenzhen City, Guangdong Province Applicant before: Shenzhen laimile Intelligent Technology Co.,Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant |