WO2016097841A3 - Methods and apparatus for high intuitive human-computer interface - Google Patents

Methods and apparatus for high intuitive human-computer interface Download PDF

Info

Publication number
WO2016097841A3
WO2016097841A3 PCT/IB2015/002356 IB2015002356W WO2016097841A3 WO 2016097841 A3 WO2016097841 A3 WO 2016097841A3 IB 2015002356 W IB2015002356 W IB 2015002356W WO 2016097841 A3 WO2016097841 A3 WO 2016097841A3
Authority
WO
WIPO (PCT)
Prior art keywords
human
wearable
input
computer interface
methods
Prior art date
Application number
PCT/IB2015/002356
Other languages
French (fr)
Other versions
WO2016097841A2 (en
Inventor
Quan Xiao
Original Assignee
Quan Xiao
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Quan Xiao filed Critical Quan Xiao
Priority to EP15869412.5A priority Critical patent/EP3234742A4/en
Priority to CN201580069328.1A priority patent/CN107209582A/en
Publication of WO2016097841A2 publication Critical patent/WO2016097841A2/en
Publication of WO2016097841A3 publication Critical patent/WO2016097841A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Methods of multi-mode (intuitive) UI input or gesture recognition, general human-computer interface relating to input and output/ feedback (such as but not limited to tactile signal), and integration/simulation of input methods are provided. Human centered hyper UI is also provided. It might be cross-platform or cross-device and using a "feel-able" method to improve user interaction with computer systems, especially for objects/widgets/controls that have a visual representation (with graphical user interface). Also, wearable human-computer interface is provided as below: human centric wearable interface that can use possible context aware gesture input, and optionally a wearable dynamic pattern display system that provides physical effects (such as tactile pressure/ vibration, airflow/wind, temperature change/humidity change) to wearer ('s skin). Or, optionally it has other ways of feedback, such as visual channel on the wearable human-computer interface and etc.
PCT/IB2015/002356 2014-12-16 2015-12-16 Methods and apparatus for high intuitive human-computer interface and human centric wearable "hyper" user interface that could be cross-platform / cross-device and possibly with local feel-able/tangible feedback WO2016097841A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP15869412.5A EP3234742A4 (en) 2014-12-16 2015-12-16 Methods and apparatus for high intuitive human-computer interface
CN201580069328.1A CN107209582A (en) 2014-12-16 2015-12-16 The method and apparatus of high intuitive man-machine interface

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201462092710P 2014-12-16 2014-12-16
US62/092,710 2014-12-16
US201562099915P 2015-01-05 2015-01-05
US62/099,915 2015-01-05
US201562110403P 2015-01-18 2015-01-18
US62/110,403 2015-01-18

Publications (2)

Publication Number Publication Date
WO2016097841A2 WO2016097841A2 (en) 2016-06-23
WO2016097841A3 true WO2016097841A3 (en) 2016-08-11

Family

ID=56127780

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2015/002356 WO2016097841A2 (en) 2014-12-16 2015-12-16 Methods and apparatus for high intuitive human-computer interface and human centric wearable "hyper" user interface that could be cross-platform / cross-device and possibly with local feel-able/tangible feedback

Country Status (3)

Country Link
EP (1) EP3234742A4 (en)
CN (1) CN107209582A (en)
WO (1) WO2016097841A2 (en)

Families Citing this family (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU186397U1 (en) * 2017-06-07 2019-01-17 Федоров Александр Владимирович VIRTUAL REALITY GLOVE
DE102017122377A1 (en) * 2017-09-27 2019-03-28 Deutsches Zentrum für Luft- und Raumfahrt e.V. Glove-type input / output device and method for outputting thermo-receptive information via a force
CN111052047B (en) * 2017-09-29 2022-04-19 苹果公司 Vein scanning device for automatic gesture and finger recognition
WO2019067144A1 (en) * 2017-09-29 2019-04-04 Apple Inc. Imu-based glove
KR101937686B1 (en) 2017-10-27 2019-01-14 박재홍 Wearable control device
RU2670649C9 (en) * 2017-10-27 2018-12-11 Федоров Александр Владимирович Method of manufacturing virtual reality gloves (options)
SG11202005537XA (en) * 2017-12-22 2020-07-29 Ultrahaptics Ip Ltd Human interactions with mid-air haptic systems
CN108205373B (en) * 2017-12-25 2021-08-13 北京致臻智造科技有限公司 Interaction method and system
CN109992093B (en) * 2017-12-29 2024-05-03 博世汽车部件(苏州)有限公司 Gesture comparison method and gesture comparison system
US10617942B2 (en) 2017-12-29 2020-04-14 Microsoft Technology Licensing, Llc Controller with haptic feedback
WO2019142525A1 (en) * 2018-01-19 2019-07-25 ソニー株式会社 Wearable device and mounting fixture
US10914567B2 (en) 2018-02-23 2021-02-09 Apple Inc. Magnetic sensor based proximity sensing
KR102095639B1 (en) * 2018-04-30 2020-03-31 한국과학기술원 Method of outputting tactile pattern and apparatuses performing the same
CN108803872B (en) * 2018-05-08 2021-07-27 上海嘉奥信息科技发展有限公司 Plug-in system for invoking force feedback hardware in illusion engine
TR201806590A2 (en) * 2018-05-09 2018-07-23 Havelsan Hava Elektronik Sanayi Ve Ticaret Anonim Sirketi EXPLOSIVE TRAINING SIMULATOR EQUIPMENT
US10540016B1 (en) * 2018-06-08 2020-01-21 Jeffrey Thomas Johnson Unlimited reach and touch tablet
CN109032343B (en) * 2018-07-04 2022-02-11 青岛理工大学 Industrial man-machine interaction system and method based on vision and haptic augmented reality
CN109276881A (en) * 2018-08-31 2019-01-29 努比亚技术有限公司 A kind of game control method, equipment
CN109512457B (en) * 2018-10-15 2021-06-29 东软医疗系统股份有限公司 Method, device and equipment for adjusting gain compensation of ultrasonic image and storage medium
US10860065B2 (en) * 2018-11-15 2020-12-08 Dell Products, L.P. Multi-form factor information handling system (IHS) with automatically reconfigurable hardware keys
US11294463B2 (en) 2018-12-03 2022-04-05 Microsoft Technology Licensing, Llc Augmenting the functionality of user input devices using a digital glove
US11199901B2 (en) * 2018-12-03 2021-12-14 Microsoft Technology Licensing, Llc Augmenting the functionality of non-digital objects using a digital glove
US11314409B2 (en) 2018-12-03 2022-04-26 Microsoft Technology Licensing, Llc Modeless augmentations to a virtual trackpad on a multiple screen computing device
US11137905B2 (en) 2018-12-03 2021-10-05 Microsoft Technology Licensing, Llc Modeless augmentations to a virtual trackpad on a multiple screen computing device
CN109697013A (en) * 2018-12-26 2019-04-30 北京硬壳科技有限公司 Control light calibration method, cursor control and cursor control device
CN109771905A (en) * 2019-01-25 2019-05-21 北京航空航天大学 Virtual reality interactive training restoring gloves based on touch driving
US11137908B2 (en) * 2019-04-15 2021-10-05 Apple Inc. Keyboard operation with head-mounted device
CN110236559A (en) * 2019-05-30 2019-09-17 南京航空航天大学 The multi-modal feature extracting method of inertia gloves towards piano playing
US20210089131A1 (en) * 2019-09-23 2021-03-25 Apple Inc. Finger-Mounted Input Devices
CN110434882B (en) * 2019-09-26 2024-05-24 滁州职业技术学院 Three finger holders of imitative people finger inflatable software
CN111158476B (en) * 2019-12-25 2023-05-23 中国人民解放军军事科学院国防科技创新研究院 Key recognition method, system, equipment and storage medium of virtual keyboard
CN111601129B (en) * 2020-06-05 2022-04-01 北京字节跳动网络技术有限公司 Control method, control device, terminal and storage medium
CN111724487B (en) * 2020-06-19 2023-05-16 广东浪潮大数据研究有限公司 Flow field data visualization method, device, equipment and storage medium
DE102020116536A1 (en) * 2020-06-23 2021-12-23 Otto Bock Healthcare Products Gmbh Prosthetic device with a prosthetic hand and method for operating a prosthetic device
CN112114663B (en) * 2020-08-05 2022-05-17 北京航空航天大学 Implementation method of virtual reality software framework suitable for visual and tactile fusion feedback
CN112450995B (en) * 2020-10-28 2022-05-10 杭州无创光电有限公司 Situation simulation endoscope system
CN113220117B (en) * 2021-04-16 2023-12-29 邬宗秀 Device for human-computer interaction
CN113589923B (en) * 2021-06-28 2023-04-07 深圳先进技术研究院 Gesture control-oriented human-computer interaction system and method
CN114083544B (en) * 2022-01-21 2022-04-12 成都市皓煊光电新材料科技研发中心有限公司 Method and device for controlling movement of hand-shaped equipment, hand-shaped equipment and storage medium
CN114816625B (en) * 2022-04-08 2023-06-16 郑州铁路职业技术学院 Automatic interaction system interface design method and device
WO2023197475A1 (en) * 2022-04-15 2023-10-19 深圳波唯科技有限公司 Control method and control apparatus for electric apparatus, and sensor
CN115016635A (en) * 2022-04-18 2022-09-06 深圳原宇科技有限公司 Target control method and system based on motion recognition
CN114976595A (en) * 2022-05-17 2022-08-30 南昌黑鲨科技有限公司 Intelligent antenna system
US11874964B1 (en) 2022-12-02 2024-01-16 Htc Corporation Glove

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070113207A1 (en) * 2005-11-16 2007-05-17 Hillcrest Laboratories, Inc. Methods and systems for gesture classification in 3D pointing devices
EP2365421A2 (en) * 2010-03-12 2011-09-14 Broadcom Corporation Tactile communication system
US20130265229A1 (en) * 2012-04-09 2013-10-10 Qualcomm Incorporated Control of remote device based on gestures
CN104137034A (en) * 2011-11-30 2014-11-05 惠普发展公司，有限责任合伙企业 Input mode based on location of hand gesture
CN203941498U (en) * 2014-02-21 2014-11-12 上海市七宝中学 A kind of sensor glove for drawing three-dimensional model

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004513443A (en) * 2000-11-02 2004-04-30 エッセンシャル　リアリティー，インコーポレイティド Electronic user mounting interface device and method using the same
AU2003243003A1 (en) * 2003-06-20 2005-01-04 Nadeem Mohammad Qadir Human-assistive wearable audio-visual inter-communication apparatus.
CN101581990B (en) * 2008-05-13 2011-12-07 联想(北京)有限公司 Electronic equipment as well as wearable pointing device and method applied to same
US20130021374A1 (en) * 2011-07-20 2013-01-24 Google Inc. Manipulating And Displaying An Image On A Wearable Computing System
EP2613223A1 (en) * 2012-01-09 2013-07-10 Softkinetic Software System and method for enhanced gesture-based interaction
US9411423B2 (en) * 2012-02-08 2016-08-09 Immersion Corporation Method and apparatus for haptic flex gesturing
US20130249793A1 (en) * 2012-03-22 2013-09-26 Ingeonix Corporation Touch free user input recognition
US20140198130A1 (en) * 2013-01-15 2014-07-17 Immersion Corporation Augmented reality user interface with haptic feedback
WO2014144015A2 (en) * 2013-03-15 2014-09-18 Keller Eric Jeffrey Computing interface system
CN104007844B (en) * 2014-06-18 2017-05-24 原硕朋 Electronic instrument and wearable type input device for same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070113207A1 (en) * 2005-11-16 2007-05-17 Hillcrest Laboratories, Inc. Methods and systems for gesture classification in 3D pointing devices
EP2365421A2 (en) * 2010-03-12 2011-09-14 Broadcom Corporation Tactile communication system
CN104137034A (en) * 2011-11-30 2014-11-05 惠普发展公司，有限责任合伙企业 Input mode based on location of hand gesture
US20130265229A1 (en) * 2012-04-09 2013-10-10 Qualcomm Incorporated Control of remote device based on gestures
CN203941498U (en) * 2014-02-21 2014-11-12 上海市七宝中学 A kind of sensor glove for drawing three-dimensional model

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3234742A4 *

Also Published As

Publication number Publication date
WO2016097841A2 (en) 2016-06-23
EP3234742A2 (en) 2017-10-25
CN107209582A (en) 2017-09-26
EP3234742A4 (en) 2018-08-08

Similar Documents

Publication Publication Date Title
WO2016097841A3 (en) Methods and apparatus for high intuitive human-computer interface
WO2016189372A3 (en) Method and apparatus for human centric architechture
WO2019067901A3 (en) Gaze-based user interactions
BR112018012102A2 (en) Flexible electronic device and method of operation
GB2515436A (en) Virtual hand based on combined data
AU360961S (en) Display screen with graphical user interface
MX364899B (en) Display apparatus and displaying method thereof.
MX353242B (en) Method for controlling display of multiple objects depending on input related to operation of mobile terminal, and mobile terminal therefor.
GB201304615D0 (en) User interface navigation utilizing pressure-sensitive touch
WO2016148875A3 (en) Touch input cursor manipulation
GB201304997D0 (en) Adjustment mechanisms for virtual knobs on a touchscreen interface
WO2014135709A3 (en) Fitness watch case
MX2015016067A (en) User interface elements for multiple displays.
WO2014078341A3 (en) Automatically rendering web or hybrid applications natively
WO2013162908A3 (en) Headset computer (hsc) as auxiliary display with asr and ht input
EP4332725A3 (en) Context sensitive actions in response to touch input
WO2010044579A3 (en) A method for providing a user interface using three-dimensional gestures and an apparatus using the same
WO2016072823A3 (en) Loop-shaped tactile multi-touch input device and gestures, and method therefor
MX368817B (en) Interface display method and apparatus.
EP2955594A3 (en) Watch type mobile terminal and control method for the mobile terminal
PH12016500348A1 (en) Program for program editing
WO2019027919A3 (en) Touchscreen user interface for interacting with a virtual model
MX353569B (en) Handling overloaded gestures.
WO2019045491A3 (en) Electronic apparatus and control method thereof
EP3907590A3 (en) Information processing device, information processing method, and computer program

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2015869412

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15869412

Country of ref document: EP

Kind code of ref document: A2