JP5782431B2 - 空間動作システムと共に用いるための空間マルチモード制御デバイス - Google Patents

空間動作システムと共に用いるための空間マルチモード制御デバイス Download PDF

Info

Publication number
JP5782431B2
JP5782431B2 JP2012513264A JP2012513264A JP5782431B2 JP 5782431 B2 JP5782431 B2 JP 5782431B2 JP 2012513264 A JP2012513264 A JP 2012513264A JP 2012513264 A JP2012513264 A JP 2012513264A JP 5782431 B2 JP5782431 B2 JP 5782431B2
Authority
JP
Japan
Prior art keywords
input
input device
data
mode
gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2012513264A
Other languages
English (en)
Japanese (ja)
Other versions
JP2012528405A5 (enExample
JP2012528405A (ja
Inventor
アンダーコフラー，ジョン・エス
スパレル，カールトン
ベルカー，ハラルド
クレーマー，クウィンドラ・ハルトマン
Original Assignee
オブロング・インダストリーズ・インコーポレーテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/553,845 external-priority patent/US8531396B2/en
Application filed by オブロング・インダストリーズ・インコーポレーテッド filed Critical オブロング・インダストリーズ・インコーポレーテッド
Publication of JP2012528405A publication Critical patent/JP2012528405A/ja
Publication of JP2012528405A5 publication Critical patent/JP2012528405A5/ja
Application granted granted Critical
Publication of JP5782431B2 publication Critical patent/JP5782431B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Position Input By Displaying (AREA)
JP2012513264A 2009-05-27 2010-05-27 空間動作システムと共に用いるための空間マルチモード制御デバイス Expired - Fee Related JP5782431B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US18162109P 2009-05-27 2009-05-27
US61/181,621 2009-05-27
US12/553,845 2009-09-03
US12/553,845 US8531396B2 (en) 2006-02-08 2009-09-03 Control system for navigating a principal dimension of a data space
PCT/US2010/036440 WO2010138743A2 (en) 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system

Publications (3)

Publication Number Publication Date
JP2012528405A JP2012528405A (ja) 2012-11-12
JP2012528405A5 JP2012528405A5 (enExample) 2013-07-11
JP5782431B2 true JP5782431B2 (ja) 2015-09-24

Family

ID=43223365

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012513264A Expired - Fee Related JP5782431B2 (ja) 2009-05-27 2010-05-27 空間動作システムと共に用いるための空間マルチモード制御デバイス

Country Status (5)

Country Link
EP (1) EP2435986A4 (enExample)
JP (1) JP5782431B2 (enExample)
KR (1) KR101705924B1 (enExample)
CN (1) CN102460510B (enExample)
WO (1) WO2010138743A2 (enExample)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011017305A1 (de) * 2011-04-15 2012-10-18 Abb Technology Ag Bedien- und Beobachtungssystem für technische Anlagen
US9571816B2 (en) 2012-11-16 2017-02-14 Microsoft Technology Licensing, Llc Associating an object with a subject
US9251701B2 (en) 2013-02-14 2016-02-02 Microsoft Technology Licensing, Llc Control device with passive reflector
JP6177872B2 (ja) 2013-02-19 2017-08-09 ミラマ サービス インク 入出力装置、入出力プログラム、および入出力方法
WO2014128750A1 (ja) 2013-02-19 2014-08-28 株式会社ブリリアントサービス 入出力装置、入出力プログラム、および入出力方法
JP6333801B2 (ja) 2013-02-19 2018-05-30 ミラマ サービス インク 表示制御装置、表示制御プログラム、および表示制御方法
US10295826B2 (en) 2013-02-19 2019-05-21 Mirama Service Inc. Shape recognition device, shape recognition program, and shape recognition method
WO2014128748A1 (ja) 2013-02-19 2014-08-28 株式会社ブリリアントサービス キャリブレーション装置、キャリブレーションプログラム、およびキャリブレーション方法
US10373304B2 (en) * 2014-11-05 2019-08-06 Illinois Tool Works Inc. System and method of arranging welding device markers
CN107110537B (zh) * 2014-12-22 2021-02-02 特灵国际有限公司 利用移动设备的占体感应和建筑物控制
JP5988286B1 (ja) * 2016-04-01 2016-09-07 株式会社Ｃｙｇａｍｅｓ プログラム及び画像処理装置
US10522251B2 (en) 2016-07-08 2019-12-31 International Business Machines Corporation Infrared detectors and thermal tags for real-time activity monitoring
US10311273B2 (en) * 2016-10-18 2019-06-04 International Business Machines Corporation Thermal tags for real-time activity monitoring and methods for detecting the same
JP6227213B1 (ja) 2017-03-15 2017-11-08 三菱電機株式会社 タッチジェスチャ判定装置、タッチジェスチャ判定方法、タッチジェスチャ判定プログラム、及びタッチパネル入力装置
CN111104091B (zh) * 2019-12-12 2021-11-26 北京科技大学 一种动态浮点误差分析中精度特定计算的检测和转换方法
CN112549010B (zh) * 2020-12-22 2022-11-08 南昌大学 基于改进Serpenoid曲线的多关节蛇形机器人自适应轨迹跟踪控制器设计方法

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3421167B2 (ja) * 1994-05-03 2003-06-30 アイティユー リサーチ インコーポレイテッド 接触式制御用入力機器
US20030062889A1 (en) * 1996-12-12 2003-04-03 Synaptics (Uk) Limited Position detector
JP2001216069A (ja) * 2000-02-01 2001-08-10 Toshiba Corp 操作入力装置および方向検出方法
US7445550B2 (en) * 2000-02-22 2008-11-04 Creative Kingdoms, Llc Magical wand and interactive play experience
SE0000850D0 (sv) * 2000-03-13 2000-03-13 Pink Solution Ab Recognition arrangement
US7159194B2 (en) * 2001-11-30 2007-01-02 Palm, Inc. Orientation dependent functionality of an electronic device
US7854655B2 (en) * 2002-07-27 2010-12-21 Sony Computer Entertainment America Inc. Obtaining input for controlling execution of a game program
CA2524031C (en) * 2003-05-20 2015-07-07 Interlego Ag Method and system for manipulating a digital representation of a three-dimensional object
SG115546A1 (en) * 2003-06-23 2005-10-28 Affineon Technologies Pte Ltd Computer input device tracking six degrees of freedom
US7545362B2 (en) * 2004-02-26 2009-06-09 Microsoft Corporation Multi-modal navigation in a graphical user interface computing system
US20050212753A1 (en) * 2004-03-23 2005-09-29 Marvit David L Motion controlled remote controller
KR101192514B1 (ko) * 2004-04-30 2012-10-17 힐크레스트 래보래토리스, 인크. 틸트 보상과 향상된 사용성을 갖는 3ｄ 포인팅 장치
CN101536494B (zh) * 2005-02-08 2017-04-26 奥布隆工业有限公司 用于基于姿势的控制系统的系统和方法
EP1877889A2 (en) * 2005-03-04 2008-01-16 Apple Inc. Multi-functional hand-held device
WO2006138437A2 (en) * 2005-06-16 2006-12-28 Wabash Technologies, Inc. Pedal assembly having a hysteresis mechanism
WO2010030822A1 (en) * 2008-09-10 2010-03-18 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems

Also Published As

Publication number Publication date
WO2010138743A2 (en) 2010-12-02
EP2435986A4 (en) 2015-04-22
WO2010138743A3 (en) 2011-03-10
CN102460510A (zh) 2012-05-16
JP2012528405A (ja) 2012-11-12
KR101705924B1 (ko) 2017-02-10
CN102460510B (zh) 2016-04-20
KR20120034672A (ko) 2012-04-12
EP2435986A2 (en) 2012-04-04

Similar Documents

Publication Publication Date Title
JP5782431B2 (ja) 空間動作システムと共に用いるための空間マルチモード制御デバイス
US9823747B2 (en) Spatial, multi-modal control device for use with spatial operating system
US8669939B2 (en) Spatial, multi-modal control device for use with spatial operating system
US8665213B2 (en) Spatial, multi-modal control device for use with spatial operating system
US10255489B2 (en) Adaptive tracking system for spatial input devices
JP5698733B2 (ja) 三空間入力の検出、表現、および解釈：自由空間、近接、および表面接触モードを組み込むジェスチャ連続体
US8941590B2 (en) Adaptive tracking system for spatial input devices
JP5806615B2 (ja) データ空間の主要次元をナビゲートするための制御システム
CN103930944B (zh) 用于空间输入装置的自适应跟踪系统
JP5805537B2 (ja) マルチプロセス・インタラクティブ・システムおよび方法
US8941589B2 (en) Adaptive tracking system for spatial input devices
US8941588B2 (en) Fast fingertip detection for initializing a vision-based hand tracker
US20190187801A1 (en) Detecting, representing, and interpreting three-space input: gestural continuum subsuming freespace, proximal, and surface-contact modes
US20150371083A1 (en) Adaptive tracking system for spatial input devices
US20130076616A1 (en) Adaptive tracking system for spatial input devices
JP2015525381A (ja) 相互ユーザ手追跡および形状認識ユーザ・インターフェース

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130527

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20130527

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20140214

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20140327

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20140626

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20140703

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140929

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20141118

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20150217

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150515

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20150619

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20150717

R150 Certificate of patent or registration of utility model

Ref document number: 5782431

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees