JP6428020B2 - Gui装置 - Google Patents
Gui装置 Download PDFInfo
- Publication number
- JP6428020B2 JP6428020B2 JP2014150487A JP2014150487A JP6428020B2 JP 6428020 B2 JP6428020 B2 JP 6428020B2 JP 2014150487 A JP2014150487 A JP 2014150487A JP 2014150487 A JP2014150487 A JP 2014150487A JP 6428020 B2 JP6428020 B2 JP 6428020B2
- Authority
- JP
- Japan
- Prior art keywords
- aerial
- screen
- icon
- unit
- line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3147—Multi-projection systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04801—Cursor retrieval aid, i.e. visual aspect modification, blinking, colour changes, enlargement or other visual cues, for helping user do find the cursor in graphical user interfaces
Description
この構成を採用することにより、いずれの空中画面が選択されているかを認識することが容易になる。
この構成を採用することにより、空中画面の選択が容易になる。
1.概要
図1に本発明の一実施形態としてのGUI装置1を示す。GUI装置1は、プリンター、スキャナー、固定電話機等の設置型の装置でも、スマートフォン、タブレットPC(Personal Computer)、腕時計型PC、眼鏡型PC等の携帯型の装置でも良い。GUI装置1は、ユーザーの視線方向に少なくとも一部が互いに重なる複数の空中画面P1、P2、P3にアイコンを含む画像を投写する。ユーザーは指Uの先端を空中画面P1、P2、P3に投写されたアイコンの領域に動かすことにより、アイコンに対応する処理を起動することができる。空中画面P1、P2、P3が視線方向に重なっていても、GUI装置1は、視線方向における指Uの位置を検出するため、いずれの空中画面に属するアイコンが選択されたかを特定することができる。また、ユーザーは空中画面のうちアイコンが表示されていない領域で指Uの先端を動かすことで別の空中画面に切り替えることができる。このような機能を実現するため、GUI装置1は、第一投写部11、第二投写部12、第三投写部13、位置センサー20および制御部30を備えている。
第一投写部11、第二投写部12および第三投写部13は、空中画面P1、P2、P3に画像を投写する装置である。空中画面P1、P2、P3は、第一投写部11、第二投写部12および第三投写部13が画像を投写する空中の平面領域である。空中画面P1、P2、P3のそれぞれは平面でも曲面でもよい。空中に画像を表示する原理と装置の構成は、特開2003−233339号公報、特開2007−206588号公報等に開示されているように公知であるため、説明を省略する。
次に図2および図3に基づいてGUI装置1の作動を説明する。図2は、視線方向に見た空中画面P1、P2、P3を表している。
次に制御部30は、指Uの先端が空中画面の選択領域にあるか否かを判定する(S2)。空中画面の選択領域は、各空中画面の領域にその周辺領域を加えて設定すればよい。本実施形態では、間隔2dで設定される空中画面P1、P2、P3のそれぞれについて、画面の垂直方向に画面から距離d未満であり、画面に対して平行な方向において画面の表示領域と一致する領域を選択領域とする。各空中画面を中央(基準)とする奥行き2dの領域が選択領域になるため、例えば指Uの先端が図1に示す位置にある場合、制御部30は指Uの先端が空中画面P2の選択領域にあると判定する。
尚、本発明の技術的範囲は、上述した実施形態に限定されるものではなく、本発明の要旨を逸脱しない範囲内において種々変更を加え得ることは勿論である。
Claims (3)
- 所定の視線方向に重なる複数の空中画面に画像を投写する投写部と、
空中における指示部の位置を検出する検出部と、
検出される前記指示部の前記視線方向の動きに応じて前記複数の空中画面のいずれかを操作対象として選択する画面選択部と、
操作対象として選択された前記空中画面に表示されているアイコンを、検出される前記指示部の動きに応じて選択するアイコン選択部と、
を備え、
前記画面選択部が前記空中画面が選択されたと判断する前記指示部の前記視線方向の位置の範囲よりも、前記アイコン選択部が前記アイコンが選択されたと判断する前記指示部の前記視線方向の位置の範囲が狭い、
GUI装置。 - 所定の視線方向に重なる複数の空中画面に画像を投写する投写部と、
空中における指示部の位置を検出する検出部と、
検出される前記指示部の前記空中画面の垂直方向の動きに応じて前記複数の空中画面のいずれかを操作対象として選択する画面選択部と、
操作対象として選択された前記空中画面に表示されているアイコンを、検出される前記指示部の動きに応じて選択するアイコン選択部と、
を備え、
前記画面選択部が前記空中画面が選択されたと判断する前記指示部の前記垂直方向の位置の範囲よりも、前記アイコン選択部が前記アイコンが選択されたと判断する前記指示部の前記垂直方向の位置の範囲が狭い、
GUI装置。 - 前記アイコン選択部は、前記空中画面の手前側の第1領域及び前記空中画面の奥側の第2領域における前記指示部の動きに応じて前記アイコンを選択し、
前記第1領域は前記第2領域よりも前記視線方向又は前記垂直方向に広い、
請求項1又は2に記載のGUI装置。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014150487A JP6428020B2 (ja) | 2014-07-24 | 2014-07-24 | Gui装置 |
US14/795,492 US20160026244A1 (en) | 2014-07-24 | 2015-07-09 | Gui device |
CN201510431387.0A CN105278807B (zh) | 2014-07-24 | 2015-07-21 | Gui装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014150487A JP6428020B2 (ja) | 2014-07-24 | 2014-07-24 | Gui装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2016024752A JP2016024752A (ja) | 2016-02-08 |
JP6428020B2 true JP6428020B2 (ja) | 2018-11-28 |
Family
ID=55147912
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2014150487A Active JP6428020B2 (ja) | 2014-07-24 | 2014-07-24 | Gui装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20160026244A1 (ja) |
JP (1) | JP6428020B2 (ja) |
CN (1) | CN105278807B (ja) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SG11201701283TA (en) * | 2014-09-30 | 2017-03-30 | Philip Morris Products Sa | Method for the production of homogenized tobacco material |
US20180217671A1 (en) * | 2016-02-23 | 2018-08-02 | Sony Corporation | Remote control apparatus, remote control method, remote control system, and program |
EP3486751A1 (en) * | 2016-07-12 | 2019-05-22 | FUJIFILM Corporation | Image display system, head-mounted display control device, and operating method and operating program for same |
JP6958141B2 (ja) * | 2017-09-05 | 2021-11-02 | 富士フイルムビジネスイノベーション株式会社 | 情報処理装置、画像形成装置、および、プログラム |
JP7424047B2 (ja) | 2019-12-25 | 2024-01-30 | 富士フイルムビジネスイノベーション株式会社 | 情報処理装置及びプログラム |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6031519A (en) * | 1997-12-30 | 2000-02-29 | O'brien; Wayne P. | Holographic direct manipulation interface |
WO2002033657A2 (en) * | 2000-10-20 | 2002-04-25 | Robert Batchko | Combinatorial optical processor |
US8339379B2 (en) * | 2004-04-29 | 2012-12-25 | Neonode Inc. | Light-based touch screen |
KR100800859B1 (ko) * | 2004-08-27 | 2008-02-04 | 삼성전자주식회사 | Hmd 정보 단말기에서 키를 입력하는 장치 및 방법 |
US20100066662A1 (en) * | 2006-10-02 | 2010-03-18 | Pioneer Corporation | Image display device |
US8726194B2 (en) * | 2007-07-27 | 2014-05-13 | Qualcomm Incorporated | Item selection using enhanced control |
EP2188737A4 (en) * | 2007-09-14 | 2011-05-18 | Intellectual Ventures Holding 67 Llc | PROCESSING BREAKFAST USER INTERACTIONS |
US7881901B2 (en) * | 2007-09-18 | 2011-02-01 | Gefemer Research Acquisitions, Llc | Method and apparatus for holographic user interface communication |
JP4793422B2 (ja) * | 2008-10-10 | 2011-10-12 | ソニー株式会社 | 情報処理装置、情報処理方法、情報処理システムおよび情報処理用プログラム |
JP5262681B2 (ja) * | 2008-12-22 | 2013-08-14 | ブラザー工業株式会社 | ヘッドマウントディスプレイ及びそのプログラム |
US9569001B2 (en) * | 2009-02-03 | 2017-02-14 | Massachusetts Institute Of Technology | Wearable gestural interface |
JP5439977B2 (ja) * | 2009-06-24 | 2014-03-12 | 富士ゼロックス株式会社 | 動作判定システム、動作判定装置およびプログラム |
US8819591B2 (en) * | 2009-10-30 | 2014-08-26 | Accuray Incorporated | Treatment planning in a virtual environment |
US20110107216A1 (en) * | 2009-11-03 | 2011-05-05 | Qualcomm Incorporated | Gesture-based user interface |
KR101114750B1 (ko) * | 2010-01-29 | 2012-03-05 | 주식회사 팬택 | 다차원 영상을 이용한 사용자 인터페이스 장치 |
KR101719979B1 (ko) * | 2010-02-05 | 2017-03-27 | 엘지전자 주식회사 | Ui 제공 방법 및 디지털 방송 수신기 |
US20120005624A1 (en) * | 2010-07-02 | 2012-01-05 | Vesely Michael A | User Interface Elements for Use within a Three Dimensional Scene |
US8643569B2 (en) * | 2010-07-14 | 2014-02-04 | Zspace, Inc. | Tools for use within a three dimensional scene |
JP2012033104A (ja) * | 2010-08-02 | 2012-02-16 | Olympus Imaging Corp | 表示装置及び撮像装置 |
JP5300825B2 (ja) * | 2010-11-17 | 2013-09-25 | シャープ株式会社 | 指示受付装置、指示受付方法、コンピュータプログラム及び記録媒体 |
CN103460256B (zh) * | 2011-03-29 | 2016-09-14 | 高通股份有限公司 | 在扩增现实系统中将虚拟图像锚定到真实世界表面 |
TW201248452A (en) * | 2011-05-30 | 2012-12-01 | Era Optoelectronics Inc | Floating virtual image touch sensing apparatus |
US8454775B2 (en) * | 2011-07-29 | 2013-06-04 | United Technologies Corporation | Bond and stitch repair for delaminated composite |
CN102981743B (zh) * | 2011-09-05 | 2016-05-25 | 联想(北京)有限公司 | 控制操作对象的方法及电子设备 |
JP2013186827A (ja) * | 2012-03-09 | 2013-09-19 | Konica Minolta Inc | 操作装置 |
US20130328925A1 (en) * | 2012-06-12 | 2013-12-12 | Stephen G. Latta | Object focus in a mixed reality environment |
-
2014
- 2014-07-24 JP JP2014150487A patent/JP6428020B2/ja active Active
-
2015
- 2015-07-09 US US14/795,492 patent/US20160026244A1/en not_active Abandoned
- 2015-07-21 CN CN201510431387.0A patent/CN105278807B/zh active Active
Also Published As
Publication number | Publication date |
---|---|
CN105278807B (zh) | 2019-05-10 |
JP2016024752A (ja) | 2016-02-08 |
CN105278807A (zh) | 2016-01-27 |
US20160026244A1 (en) | 2016-01-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10591729B2 (en) | Wearable device | |
JP6551502B2 (ja) | ヘッドマウントディスプレイ、情報処理方法、及びプログラム | |
US10416835B2 (en) | Three-dimensional user interface for head-mountable display | |
US20190250714A1 (en) | Systems and methods for triggering actions based on touch-free gesture detection | |
KR20220030294A (ko) | 인공 현실 환경들에서 주변 디바이스를 사용하는 가상 사용자 인터페이스 | |
JP6428020B2 (ja) | Gui装置 | |
JP6288084B2 (ja) | 表示制御装置、表示制御方法および記録媒体 | |
WO2014188798A1 (ja) | 表示制御装置、表示制御方法および記録媒体 | |
JP6508280B2 (ja) | 制御装置、検出装置、表示システム、電子機器、及びプログラム | |
CN106066537B (zh) | 头戴式显示器和头戴式显示器的控制方法 | |
US10642348B2 (en) | Display device and image display method | |
US20170038838A1 (en) | Information processing system and information processing method | |
KR20150025115A (ko) | 증강현실 이미지를 디스플레이하는 포터블 디바이스 및 그 제어 방법 | |
KR20140070326A (ko) | 3차원 인터페이스를 제공하는 모바일 장치 및 그것의 제스처 제어 방법 | |
US20150302653A1 (en) | Augmented Digital Data | |
KR102197964B1 (ko) | 포터블 디바이스 및 그 제어 방법 | |
KR20150096948A (ko) | 증강 현실 사진 촬영 가이드를 디스플레이 하는 헤드 마운티드 디스플레이 디바이스 및 그 제어 방법 | |
JP6805524B2 (ja) | 入力装置、入力プログラム、及び入力方法 | |
KR20160027732A (ko) | 디스플레이 디바이스 및 그 제어 방법 | |
KR101708455B1 (ko) | 핸드 플로트 입체 메뉴 시스템 | |
EP3109734A1 (en) | Three-dimensional user interface for head-mountable display | |
JP2016126687A (ja) | ヘッドマウントディスプレイ、操作受付方法および操作受付プログラム | |
WO2021089910A1 (en) | Display apparatus and method for generating and rendering composite images | |
WO2014041759A1 (en) | Information processing apparatus, information processing method, and computer program product | |
JP2012103980A5 (ja) |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
RD04 | Notification of resignation of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7424 Effective date: 20160617 |
|
RD03 | Notification of appointment of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7423 Effective date: 20160628 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20170512 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20180130 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20180131 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20180305 |
|
A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20180817 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20180905 |
|
A911 | Transfer to examiner for re-examination before appeal (zenchi) |
Free format text: JAPANESE INTERMEDIATE CODE: A911 Effective date: 20180912 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20181002 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20181015 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6428020 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |