EP2435986A4 - MULTIMODAL SPACE CONTROL DEVICE - Google Patents

MULTIMODAL SPACE CONTROL DEVICE

Info

Publication number
EP2435986A4
EP2435986A4 EP10781229.9A EP10781229A EP2435986A4 EP 2435986 A4 EP2435986 A4 EP 2435986A4 EP 10781229 A EP10781229 A EP 10781229A EP 2435986 A4 EP2435986 A4 EP 2435986A4
Authority
EP
European Patent Office
Prior art keywords
spatial
control device
operating system
modal control
modal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP10781229.9A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2435986A2 (en
Inventor
John S Underkoffler
Carlton Sparrell
Harald Belker
Kwindla Hultman Kramer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oblong Industries Inc
Original Assignee
Oblong Industries Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/553,845 external-priority patent/US8531396B2/en
Application filed by Oblong Industries Inc filed Critical Oblong Industries Inc
Publication of EP2435986A2 publication Critical patent/EP2435986A2/en
Publication of EP2435986A4 publication Critical patent/EP2435986A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Position Input By Displaying (AREA)
EP10781229.9A 2009-05-27 2010-05-27 MULTIMODAL SPACE CONTROL DEVICE Withdrawn EP2435986A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US18162109P 2009-05-27 2009-05-27
US12/553,845 US8531396B2 (en) 2006-02-08 2009-09-03 Control system for navigating a principal dimension of a data space
PCT/US2010/036440 WO2010138743A2 (en) 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system

Publications (2)

Publication Number Publication Date
EP2435986A2 EP2435986A2 (en) 2012-04-04
EP2435986A4 true EP2435986A4 (en) 2015-04-22

Family

ID=43223365

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10781229.9A Withdrawn EP2435986A4 (en) 2009-05-27 2010-05-27 MULTIMODAL SPACE CONTROL DEVICE

Country Status (5)

Country Link
EP (1) EP2435986A4 (enExample)
JP (1) JP5782431B2 (enExample)
KR (1) KR101705924B1 (enExample)
CN (1) CN102460510B (enExample)
WO (1) WO2010138743A2 (enExample)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011017305A1 (de) * 2011-04-15 2012-10-18 Abb Technology Ag Bedien- und Beobachtungssystem für technische Anlagen
US9571816B2 (en) 2012-11-16 2017-02-14 Microsoft Technology Licensing, Llc Associating an object with a subject
US9251701B2 (en) 2013-02-14 2016-02-02 Microsoft Technology Licensing, Llc Control device with passive reflector
JP6177872B2 (ja) 2013-02-19 2017-08-09 ミラマ サービス インク 入出力装置、入出力プログラム、および入出力方法
WO2014128750A1 (ja) 2013-02-19 2014-08-28 株式会社ブリリアントサービス 入出力装置、入出力プログラム、および入出力方法
JP6333801B2 (ja) 2013-02-19 2018-05-30 ミラマ サービス インク 表示制御装置、表示制御プログラム、および表示制御方法
US10295826B2 (en) 2013-02-19 2019-05-21 Mirama Service Inc. Shape recognition device, shape recognition program, and shape recognition method
WO2014128748A1 (ja) 2013-02-19 2014-08-28 株式会社ブリリアントサービス キャリブレーション装置、キャリブレーションプログラム、およびキャリブレーション方法
US10373304B2 (en) * 2014-11-05 2019-08-06 Illinois Tool Works Inc. System and method of arranging welding device markers
CN107110537B (zh) * 2014-12-22 2021-02-02 特灵国际有限公司 利用移动设备的占体感应和建筑物控制
JP5988286B1 (ja) * 2016-04-01 2016-09-07 株式会社Ｃｙｇａｍｅｓ プログラム及び画像処理装置
US10522251B2 (en) 2016-07-08 2019-12-31 International Business Machines Corporation Infrared detectors and thermal tags for real-time activity monitoring
US10311273B2 (en) * 2016-10-18 2019-06-04 International Business Machines Corporation Thermal tags for real-time activity monitoring and methods for detecting the same
JP6227213B1 (ja) 2017-03-15 2017-11-08 三菱電機株式会社 タッチジェスチャ判定装置、タッチジェスチャ判定方法、タッチジェスチャ判定プログラム、及びタッチパネル入力装置
CN111104091B (zh) * 2019-12-12 2021-11-26 北京科技大学 一种动态浮点误差分析中精度特定计算的检测和转换方法
CN112549010B (zh) * 2020-12-22 2022-11-08 南昌大学 基于改进Serpenoid曲线的多关节蛇形机器人自适应轨迹跟踪控制器设计方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030103091A1 (en) * 2001-11-30 2003-06-05 Wong Yoon Kean Orientation dependent functionality of an electronic device
US20070021208A1 (en) * 2002-07-27 2007-01-25 Xiadong Mao Obtaining input for controlling execution of a game program
WO2010030822A1 (en) * 2008-09-10 2010-03-18 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3421167B2 (ja) * 1994-05-03 2003-06-30 アイティユー リサーチ インコーポレイテッド 接触式制御用入力機器
US20030062889A1 (en) * 1996-12-12 2003-04-03 Synaptics (Uk) Limited Position detector
JP2001216069A (ja) * 2000-02-01 2001-08-10 Toshiba Corp 操作入力装置および方向検出方法
US7445550B2 (en) * 2000-02-22 2008-11-04 Creative Kingdoms, Llc Magical wand and interactive play experience
SE0000850D0 (sv) * 2000-03-13 2000-03-13 Pink Solution Ab Recognition arrangement
CA2524031C (en) * 2003-05-20 2015-07-07 Interlego Ag Method and system for manipulating a digital representation of a three-dimensional object
SG115546A1 (en) * 2003-06-23 2005-10-28 Affineon Technologies Pte Ltd Computer input device tracking six degrees of freedom
US7545362B2 (en) * 2004-02-26 2009-06-09 Microsoft Corporation Multi-modal navigation in a graphical user interface computing system
US20050212753A1 (en) * 2004-03-23 2005-09-29 Marvit David L Motion controlled remote controller
KR101192514B1 (ko) * 2004-04-30 2012-10-17 힐크레스트 래보래토리스, 인크. 틸트 보상과 향상된 사용성을 갖는 3ｄ 포인팅 장치
CN101536494B (zh) * 2005-02-08 2017-04-26 奥布隆工业有限公司 用于基于姿势的控制系统的系统和方法
EP1877889A2 (en) * 2005-03-04 2008-01-16 Apple Inc. Multi-functional hand-held device
WO2006138437A2 (en) * 2005-06-16 2006-12-28 Wabash Technologies, Inc. Pedal assembly having a hysteresis mechanism

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030103091A1 (en) * 2001-11-30 2003-06-05 Wong Yoon Kean Orientation dependent functionality of an electronic device
US20070021208A1 (en) * 2002-07-27 2007-01-25 Xiadong Mao Obtaining input for controlling execution of a game program
WO2010030822A1 (en) * 2008-09-10 2010-03-18 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2010138743A2 *

Also Published As

Publication number Publication date
WO2010138743A2 (en) 2010-12-02
JP5782431B2 (ja) 2015-09-24
WO2010138743A3 (en) 2011-03-10
CN102460510A (zh) 2012-05-16
JP2012528405A (ja) 2012-11-12
KR101705924B1 (ko) 2017-02-10
CN102460510B (zh) 2016-04-20
KR20120034672A (ko) 2012-04-12
EP2435986A2 (en) 2012-04-04

Similar Documents

Publication Publication Date Title
EP2435986A4 (en) MULTIMODAL SPACE CONTROL DEVICE
GB201013128D0 (en) Maintence control system
GB2483960B (en) Control device
EP2311705A4 (en) CONTROL DEVICE
EP2392994A4 (en) ACTIVE TOUCH CONTROL SYSTEM
EP2484986A4 (en) Control device
ZA201202727B (en) Integrated,extendable anesthesia system
GB201002315D0 (en) Control system
GB2484847B (en) Fluid control system
EP2570320A4 (en) VEHICLE CONTROL DEVICE
EP2543563A4 (en) TURN CONTROL DEVICE FOR A VEHICLE
EP2415646A4 (en) BRAKE CONTROL DEVICE
TWM389063U (en) Vehicle mobile device control system
GB0914700D0 (en) Location system
TWM401808U (en) Manipulation control device
GB0807629D0 (en) Control system
GB201007026D0 (en) en Wang, Hsiang-Yun Illuminating device structure
GB201012442D0 (en) System control
EP2543565A4 (en) TURN CONTROL DEVICE FOR A VEHICLE
EP2520787A4 (en) START CLUTCH CONTROL
GB2465285B (en) Control system
EP2594107A4 (en) Improved system for device state transition control
GB0907441D0 (en) Vehicle control system
EP2458184A4 (en) CONTROL DEVICE FOR VEHICLE
GB0905636D0 (en) Braking control system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20111221

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/03 20060101ALI20141127BHEP

Ipc: G06F 3/0346 20130101ALI20141127BHEP

Ipc: G09G 5/00 20060101ALI20141127BHEP

Ipc: G06T 7/20 20060101AFI20141127BHEP

Ipc: G06F 3/01 20060101ALI20141127BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20150323

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 7/20 20060101AFI20150317BHEP

Ipc: G09G 5/00 20060101ALI20150317BHEP

Ipc: G06F 3/03 20060101ALI20150317BHEP

Ipc: G06F 3/0346 20130101ALI20150317BHEP

Ipc: G06F 3/01 20060101ALI20150317BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20181201