WO2008078603A1 - ユーザインターフェイス装置 - Google Patents

ユーザインターフェイス装置 Download PDF

Info

Publication number
WO2008078603A1
WO2008078603A1 PCT/JP2007/074300 JP2007074300W WO2008078603A1 WO 2008078603 A1 WO2008078603 A1 WO 2008078603A1 JP 2007074300 W JP2007074300 W JP 2007074300W WO 2008078603 A1 WO2008078603 A1 WO 2008078603A1
Authority
WO
WIPO (PCT)
Prior art keywords
section
hand shape
gui
user interface
operator
Prior art date
Application number
PCT/JP2007/074300
Other languages
English (en)
French (fr)
Inventor
Tomohiro Terada
Atsushi Yamashita
Takuya Hirai
Nobuyuki Nakano
Original Assignee
Panasonic Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corporation filed Critical Panasonic Corporation
Priority to JP2008551041A priority Critical patent/JP5179378B2/ja
Priority to US12/519,869 priority patent/US8284168B2/en
Priority to CN2007800472532A priority patent/CN101563666B/zh
Priority to EP07850786A priority patent/EP2124139A4/en
Publication of WO2008078603A1 publication Critical patent/WO2008078603A1/ja

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/60—Static or dynamic means for assisting the user to position a body part for biometric acquisition
    • G06V40/67—Static or dynamic means for assisting the user to position a body part for biometric acquisition by interactive indications to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G06V40/113—Recognition of static hand signs
    • E—FIXED CONSTRUCTIONS
    • E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05F—DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
    • E05F15/00—Power-operated mechanisms for wings
    • E—FIXED CONSTRUCTIONS
    • E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05Y—INDEXING SCHEME RELATING TO HINGES OR OTHER SUSPENSION DEVICES FOR DOORS, WINDOWS OR WINGS AND DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION, CHECKS FOR WINGS AND WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
    • E05Y2400/00—Electronic control; Power supply; Power or signal transmission; User interfaces
    • E05Y2400/80—User interfaces
    • E05Y2400/85—User input means
    • E05Y2400/852—Sensors
    • E—FIXED CONSTRUCTIONS
    • E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05Y—INDEXING SCHEME RELATING TO HINGES OR OTHER SUSPENSION DEVICES FOR DOORS, WINDOWS OR WINGS AND DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION, CHECKS FOR WINGS AND WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
    • E05Y2400/00—Electronic control; Power supply; Power or signal transmission; User interfaces
    • E05Y2400/80—User interfaces
    • E05Y2400/85—User input means
    • E05Y2400/852—Sensors
    • E05Y2400/856—Actuation thereof
    • E05Y2400/858—Actuation thereof by body parts
    • E05Y2400/86—Actuation thereof by body parts by hand

Abstract

　手の動きに応じて機器を操作するための各機能を指先に割り当て、指先への各機能の割り当てを操作者が直感的に把握できるユーザインタフェイス装置を提供する。接触位置取得部が操作者の操作面への接触を検知したときに、手形状取得部が取得した手形状の各指先にＧＵＩ釦データ記憶部から読み出したＧＵＩ釦を一旦割り当てた後、手形状の方向の変化に従って、当該手形状の各指先に当該ＧＵＩ釦を割り当て直すＧＵＩ釦割り当て部と、ＧＵＩ釦割り当て部が割り当てたＧＵＩ釦の画像と手形状の画像との合成画像を作成する重畳表示映像作成部と、重畳表示映像作成部が作成したＧＵＩ釦の画像と手形状の画像との合成画像を表示する表示部とを備える。
PCT/JP2007/074300 2006-12-22 2007-12-18 ユーザインターフェイス装置 WO2008078603A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2008551041A JP5179378B2 (ja) 2006-12-22 2007-12-18 ユーザインターフェイス装置
US12/519,869 US8284168B2 (en) 2006-12-22 2007-12-18 User interface device
CN2007800472532A CN101563666B (zh) 2006-12-22 2007-12-18 用户界面装置
EP07850786A EP2124139A4 (en) 2006-12-22 2007-12-18 USER INTERFACE DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2006345520 2006-12-22
JP2006-345520 2006-12-22

Publications (1)

Publication Number Publication Date
WO2008078603A1 true WO2008078603A1 (ja) 2008-07-03

Family

ID=39562396

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2007/074300 WO2008078603A1 (ja) 2006-12-22 2007-12-18 ユーザインターフェイス装置

Country Status (5)

Country Link
US (1) US8284168B2 (ja)
EP (1) EP2124139A4 (ja)
JP (1) JP5179378B2 (ja)
CN (1) CN101563666B (ja)
WO (1) WO2008078603A1 (ja)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011013980A (ja) * 2009-07-02 2011-01-20 Sony Corp 情報処理装置および情報処理方法
US20110029185A1 (en) * 2008-03-19 2011-02-03 Denso Corporation Vehicular manipulation input apparatus
JP2011054138A (ja) * 2009-09-04 2011-03-17 Hyundai Motor Co Ltd 車両用操作装置
JP2012168595A (ja) * 2011-02-10 2012-09-06 Meijo University 統合入力インターフェース
WO2013080425A1 (ja) * 2011-12-01 2013-06-06 パナソニック株式会社 入力装置、情報端末、入力制御方法、および入力制御プログラム
JP2013140358A (ja) * 2012-12-26 2013-07-18 Denso Corp 画像表示装置及び指示体画像の表示方法
JP2014179097A (ja) * 2013-03-13 2014-09-25 Honda Motor Co Ltd ポインティングによる情報クエリ
US9251722B2 (en) 2009-07-03 2016-02-02 Sony Corporation Map information display device, map information display method and program
JP2017529024A (ja) * 2014-06-30 2017-09-28 ザ ビデオ コール センター，エルエルシー ビデオ通話センター
WO2019142621A1 (ja) * 2018-01-18 2019-07-25 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
JP2020086998A (ja) * 2018-11-27 2020-06-04 ローム株式会社 入力デバイス、自動車
WO2023140340A1 (ja) * 2022-01-19 2023-07-27 メタマティクス プライベート リミテッド 指識別に基づくユーザー・インターフェースを実現するためのシステム、方法及びそのためのプログラム

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4853507B2 (ja) * 2008-10-30 2012-01-11 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
US20110227831A1 (en) * 2010-03-21 2011-09-22 Andrew Jesse Mills Determining Properties of Fingers via Keystroke Dynamics
US8818027B2 (en) * 2010-04-01 2014-08-26 Qualcomm Incorporated Computing device interface
US9542032B2 (en) * 2010-04-23 2017-01-10 Handscape Inc. Method using a predicted finger location above a touchpad for controlling a computerized system
WO2012061141A2 (en) * 2010-10-25 2012-05-10 Uico, Inc. Control system with solid state touch sensor for complex surface geometry
US8593421B2 (en) * 2011-03-22 2013-11-26 Adobe Systems Incorporated Local coordinate frame user interface for multitouch-enabled devices
US8553001B2 (en) 2011-03-22 2013-10-08 Adobe Systems Incorporated Methods and apparatus for determining local coordinate frames for a human hand
US10621410B2 (en) * 2011-06-20 2020-04-14 Benjamin Zimchoni Method and system for operating a keyboard with multi functional keys, using fingerprints recognition
US20130002602A1 (en) * 2011-06-28 2013-01-03 Suzana Apelbaum Systems And Methods For Touch Screen Image Capture And Display
US9671954B1 (en) * 2011-07-11 2017-06-06 The Boeing Company Tactile feedback devices for configurable touchscreen interfaces
US20130057515A1 (en) * 2011-09-07 2013-03-07 Microsoft Corporation Depth camera as a touch sensor
JP5624530B2 (ja) * 2011-09-29 2014-11-12 株式会社東芝 コマンド発行装置、方法及びプログラム
TW201335833A (zh) * 2012-02-29 2013-09-01 Hon Hai Prec Ind Co Ltd 電子設備編輯工具變更方法及系統
DE102012011177A1 (de) * 2012-06-06 2013-12-24 GM Global Technology Operations LLC (n. d. Ges. d. Staates Delaware) Verfahren zur Bedienung von Funktionen einesFahrzeuges sowie entsprechende Vorrichtung
DE102012219736A1 (de) * 2012-10-29 2014-04-30 Bayerische Motoren Werke Aktiengesellschaft Verfahren und Vorrichtung zum Betreiben einer Eingabevorrichtung
TWI475422B (zh) * 2012-10-31 2015-03-01 Wistron Corp 手勢辨識方法與電子裝置
GB2524442A (en) * 2013-02-08 2015-09-23 Motorola Solutions Inc Method and apparatus for managing user interface elements on a touch-screen device
US9841815B2 (en) * 2013-09-09 2017-12-12 Samsung Electronics Co., Ltd. Method for differentiation of touch input and visualization of pending touch input
US9875019B2 (en) * 2013-12-26 2018-01-23 Visteon Global Technologies, Inc. Indicating a transition from gesture based inputs to touch surfaces
JP2015170102A (ja) * 2014-03-06 2015-09-28 トヨタ自動車株式会社 情報処理装置
KR102305114B1 (ko) * 2014-03-07 2021-09-27 삼성전자주식회사 데이터 처리 방법 및 그 전자 장치
CN108349388B (zh) * 2015-11-20 2021-06-22 哈曼国际工业有限公司 动态可重配置显示旋钮
US10185400B2 (en) * 2016-01-11 2019-01-22 Antimatter Research, Inc. Gesture control device with fingertip identification
DE102016003072A1 (de) 2016-03-12 2017-09-14 Audi Ag Bedienvorrichtung und Verfahren zum Erfassen einer Benutzerauswahl zumindest einer Bedienfuktion der Bedienvorrichtung
CN107203320A (zh) * 2016-03-18 2017-09-26 大陆汽车投资（上海）有限公司 基于多点触摸的用户界面控制方法
US10719232B2 (en) * 2016-06-08 2020-07-21 Qualcomm Incorporated Providing virtual buttons in a handheld device
DE102017201799A1 (de) * 2017-02-06 2018-08-09 Volkswagen Aktiengesellschaft Anwenderschnittstelle, Fortbewegungsmittel und Verfahren zur Anwenderunterscheidung
DE102017213435A1 (de) * 2017-08-02 2019-02-07 Audi Ag Verfahren und Vorrichtung zur Bedienung einer Bedienvorrichtung in Fahrzeugen
US10140502B1 (en) 2018-02-13 2018-11-27 Conduit Ltd Selecting data items using biometric features

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003300444A (ja) * 2002-04-11 2003-10-21 Hitachi Ltd 移動体の運転支援装置
JP2005254851A (ja) * 2004-03-09 2005-09-22 Nissan Motor Co Ltd コマンド入力装置
WO2006027924A1 (ja) 2004-09-03 2006-03-16 Matsushita Electric Industrial Co., Ltd. 入力装置
WO2006104132A1 (ja) 2005-03-28 2006-10-05 Matsushita Electric Industrial Co., Ltd. ユーザインタフェイスシステム

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4928170A (en) * 1988-06-21 1990-05-22 Visualtek, Inc. Automatic focus control for an image magnification system
EP0554492B1 (en) * 1992-02-07 1995-08-09 International Business Machines Corporation Method and device for optical input of commands or data
US5835079A (en) * 1996-06-13 1998-11-10 International Business Machines Corporation Virtual pointing device for touchscreens
JPH10269012A (ja) 1997-03-28 1998-10-09 Yazaki Corp タッチパネルコントローラ及びこれを用いた情報表示装置
DE10120067C1 (de) * 2001-04-24 2002-06-13 Siemens Ag Mobiles Kommunikationsendgerät

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003300444A (ja) * 2002-04-11 2003-10-21 Hitachi Ltd 移動体の運転支援装置
JP2005254851A (ja) * 2004-03-09 2005-09-22 Nissan Motor Co Ltd コマンド入力装置
WO2006027924A1 (ja) 2004-09-03 2006-03-16 Matsushita Electric Industrial Co., Ltd. 入力装置
WO2006104132A1 (ja) 2005-03-28 2006-10-05 Matsushita Electric Industrial Co., Ltd. ユーザインタフェイスシステム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2124139A4

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110029185A1 (en) * 2008-03-19 2011-02-03 Denso Corporation Vehicular manipulation input apparatus
JP2011013980A (ja) * 2009-07-02 2011-01-20 Sony Corp 情報処理装置および情報処理方法
EP2270642A3 (en) * 2009-07-02 2013-12-11 Sony Corporation Processing apparatus and information processing method
US10755604B2 (en) 2009-07-03 2020-08-25 Sony Corporation Map information display device, map information display method and program
US9251722B2 (en) 2009-07-03 2016-02-02 Sony Corporation Map information display device, map information display method and program
KR101470031B1 (ko) * 2009-09-04 2014-12-05 현대자동차일본기술연구소 차량용 조작 장치
JP2011054138A (ja) * 2009-09-04 2011-03-17 Hyundai Motor Co Ltd 車両用操作装置
US8849506B2 (en) 2009-09-04 2014-09-30 Hyundai Motor Japan R&D Center, Inc. Operation system for vehicle
JP2012168595A (ja) * 2011-02-10 2012-09-06 Meijo University 統合入力インターフェース
WO2013080425A1 (ja) * 2011-12-01 2013-06-06 パナソニック株式会社 入力装置、情報端末、入力制御方法、および入力制御プログラム
JP2013140358A (ja) * 2012-12-26 2013-07-18 Denso Corp 画像表示装置及び指示体画像の表示方法
JP2014179097A (ja) * 2013-03-13 2014-09-25 Honda Motor Co Ltd ポインティングによる情報クエリ
JP2017529024A (ja) * 2014-06-30 2017-09-28 ザ ビデオ コール センター，エルエルシー ビデオ通話センター
WO2019142621A1 (ja) * 2018-01-18 2019-07-25 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
JP2020086998A (ja) * 2018-11-27 2020-06-04 ローム株式会社 入力デバイス、自動車
JP7280032B2 (ja) 2018-11-27 2023-05-23 ローム株式会社 入力デバイス、自動車
WO2023140340A1 (ja) * 2022-01-19 2023-07-27 メタマティクス プライベート リミテッド 指識別に基づくユーザー・インターフェースを実現するためのシステム、方法及びそのためのプログラム

Also Published As

Publication number Publication date
US8284168B2 (en) 2012-10-09
EP2124139A1 (en) 2009-11-25
CN101563666A (zh) 2009-10-21
CN101563666B (zh) 2012-05-02
JP5179378B2 (ja) 2013-04-10
JPWO2008078603A1 (ja) 2010-04-22
US20090309848A1 (en) 2009-12-17
EP2124139A4 (en) 2013-01-09

Similar Documents

Publication Publication Date Title
WO2008078603A1 (ja) ユーザインターフェイス装置
US10795460B2 (en) Dynamic visual indications for input devices
WO2008085770A3 (en) Portable multifunction device, method and graphical user interface for interpreting a finger swipe
WO2006003588A3 (en) Multi-layered display of a graphical user interface
ATE497204T1 (de) Haptische anzeige für ein elektronisches handgerät
WO2009111329A3 (en) Enhanced gesture-based image manipulation
WO2006003586A3 (en) Zooming in 3-d touch interaction
IT201600097954A1 (it) Dispositivo aptico, particolarmente per l’interazione con sistemi di realtà virtuale o realtà aumentata
TW200741515A (en) Pointing device for navigating three dimentional space using multiple finger actuated sensors
JP2021507357A (ja) アクティブスタイラス
US10126835B2 (en) Contact interface input device
JP3169021U (ja) タッチパネルを有するマウス
JP2010108464A (ja) 携帯機器
CN108139793A (zh) 手指激活鼠标设备/开关设备
WO2019157387A3 (en) Media capture lock affordance for graphical user interface
EP3177983B1 (en) Determining a position of an input object
KR101473113B1 (ko) 터치 펜
EP2298425A3 (en) Operation device
JP2007068705A (ja) ゲームコントローラ
NL2007302C2 (en) Thimble for operating touchscreens.
CN202649949U (zh) 一种触控清洁二用笔
WO2010096152A3 (en) One-handed computer interface device
KR20120036478A (ko) 착용식 터치펜
CN104688148A (zh) 多功能电脑清洁工具
JP4936143B2 (ja) コンピュータ用マウス

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200780047253.2

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07850786

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2008551041

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 12519869

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2007850786

Country of ref document: EP