JP2020515923A - 仮想現実の入力の実行 - Google Patents
仮想現実の入力の実行 Download PDFInfo
- Publication number
- JP2020515923A JP2020515923A JP2019523053A JP2019523053A JP2020515923A JP 2020515923 A JP2020515923 A JP 2020515923A JP 2019523053 A JP2019523053 A JP 2019523053A JP 2019523053 A JP2019523053 A JP 2019523053A JP 2020515923 A JP2020515923 A JP 2020515923A
- Authority
- JP
- Japan
- Prior art keywords
- virtual
- computer
- eir
- virtual element
- interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
- G06F3/0236—Character input methods using selection techniques to select from displayed items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Developing Agents For Electrophotography (AREA)
- Prostheses (AREA)
Abstract
Description
本出願は、2016年10月26日に出願された、中国特許出願201610951000.9と、2017年10月24日に出願された米国特許出願15/792,628の優先権を主張するものであり、その全体が参照により組み込まれる。
220 有効インタラクション領域
230 動作フォーカスの軌跡
330 動作フォーカスの軌跡
420 支払い/購入
430 ユーザビュー
500 ユーザビュー
904 インターフェース
905 プロセッサ
906 データベース
907 メモリ
908 アプリケーション
909 コンピュータ
913 サービスレイヤ
914 電源
930 ネットワーク
Claims (20)
- 仮想現実(VR)デバイスによって、VRアプリケーションのVRシナリオに仮想要素を提示するステップと、
前記仮想要素が有効に相互作用できる前記仮想要素の有効インタラクション領域(EIR)を決定するステップと、
前記VRデバイスによって感知された動きに基づいて、前記VRアプリケーションの動作フォーカスの軌跡を決定するステップと、
前記動作フォーカスの軌跡と前記EIRとの間の相互作用が仮想ボタンの選択イベントをトリガするための1つまたは複数の条件を満たす場合に、前記仮想要素を選択するステップと
を含む、コンピュータ実施方法。 - 前記EIRが前記仮想要素のエリアの少なくとも一部と重なる、請求項1に記載のコンピュータ実施方法。
- 前記VRデバイスによって感知された前記動きが、頭の動きまたは手の動きの少なくとも1つを含む、請求項1に記載のコンピュータ実施方法。
- 前記仮想要素が、ユーザ入力を実行するために提示された仮想ボタンまたは仮想キーである、請求項1に記載のコンピュータ実施方法。
- 前記動作フォーカスが、仮想シナリオに提示されたカーソルであるとともに、VRデバイスのユーザの視覚的なフォーカス、頭の位置、または手の位置に基づいて決定される、請求項1に記載のコンピュータ実施方法。
- 前記相互作用の前記1つまたは複数の条件が、前記軌跡が前記EIRの1つまたは複数の境界と少なくとも2回交差することを含む、請求項1に記載のコンピュータ実施方法。
- 前記相互作用の前記1つまたは複数の条件が、前記動作フォーカスの軌跡が前記EIRに囲いを形成することを含む、請求項1に記載のコンピュータ実施方法。
- 前記囲いのエリアが、前記EIRのエリアの所定の割合より大きい、請求項7に記載のコンピュータ実施方法。
- 前記相互作用の前記1つまたは複数の条件が、前記相互作用が所定のタイムリミット以下の期間で実行されることを含む、請求項1に記載のコンピュータ実施方法。
- 動作を実行するためのコンピュータシステムによって実行可能な1つまたは複数の命令を記憶した非一時的コンピュータ可読記憶媒体であって、前記動作が、
仮想現実(VR)デバイスによって、VRアプリケーションのVRシナリオに仮想要素を提示するステップと、
前記仮想要素が有効に相互作用できる前記仮想要素の有効インタラクション領域(EIR)を決定するステップと、
前記VRデバイスによって感知された動きに基づいて、前記VRアプリケーションの動作フォーカスの軌跡を決定するステップと、
前記動作フォーカスの軌跡と前記EIRとの間の相互作用が仮想ボタンの選択イベントをトリガするための1つまたは複数の条件を満たす場合に、前記仮想要素を選択するステップと
を含む、非一時的コンピュータ可読記憶媒体。 - 前記EIRが前記仮想要素のエリアの少なくとも一部と重なる、請求項10に記載の非一時的コンピュータ可読記憶媒体。
- 前記VRデバイスによって感知された前記動きが、頭の動きまたは手の動きの少なくとも1つを含む、請求項10に記載の非一時的コンピュータ可読記憶媒体。
- 前記仮想要素が、ユーザ入力を実行するために提示された仮想ボタンまたは仮想キーである、請求項10に記載の非一時的コンピュータ可読記憶媒体。
- 前記動作フォーカスが、仮想シナリオに提示されたカーソルであるとともに、VRデバイスのユーザの視覚的なフォーカス、頭の位置、または手の位置に基づいて決定される、請求項10に記載の非一時的コンピュータ可読記憶媒体。
- 前記相互作用の前記1つまたは複数の条件が、前記軌跡が前記EIRの1つまたは複数の境界と少なくとも2回交差することを含む、請求項10に記載の非一時的コンピュータ可読記憶媒体。
- 前記相互作用の前記1つまたは複数の条件が、前記動作フォーカスの軌跡が前記EIRに囲いを形成することを含む、請求項10に記載の非一時的コンピュータ可読記憶媒体。
- 前記囲いのエリアが、前記EIRのエリアの所定の割合より大きい、請求項16に記載の非一時的コンピュータ可読記憶媒体。
- 前記相互作用の前記1つまたは複数の条件が、前記相互作用が所定のタイムリミット以下の期間で実行されることを含む、請求項10に記載の非一時的コンピュータ可読記憶媒体。
- 1つまたは複数のコンピュータと、
前記1つまたは複数のコンピュータに相互運用可能に結合されるとともに、1つまたは複数の命令を記憶した有形の、非一時的機械記憶媒体を有する1つまたは複数のコンピュータメモリデバイスとを具備するコンピュータ実施システムであって、前記1つまたは複数の命令が、前記1つまたは複数のコンピュータによって実行されるとき動作を実行し、前記動作は、
仮想現実(VR)デバイスによって、VRアプリケーションのVRシナリオに仮想要素を提示するステップと、
前記仮想要素が有効に相互作用できる前記仮想要素の有効インタラクション領域(EIR)を決定するステップと、
前記VRデバイスによって感知された動きに基づいて、前記VRアプリケーションの動作フォーカスの軌跡を決定するステップと、
前記動作フォーカスの軌跡と前記EIRとの間の相互作用が仮想ボタンの選択イベントをトリガするための1つまたは複数の条件を満たす場合に、前記仮想要素を選択するステップと
を含む、コンピュータ実施システム。 - 前記仮想要素が、ユーザ入力を実行するために提示された仮想ボタンまたは仮想キーである、請求項19に記載のコンピュータ実施システム。
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610951000.9 | 2016-10-26 | ||
CN201610951000.9A CN107024981B (zh) | 2016-10-26 | 2016-10-26 | 基于虚拟现实的交互方法及装置 |
US15/792,628 | 2017-10-24 | ||
US15/792,628 US10509535B2 (en) | 2016-10-26 | 2017-10-24 | Performing virtual reality input |
PCT/US2017/058520 WO2018081418A1 (en) | 2016-10-26 | 2017-10-26 | Performing virtual reality input |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2020515923A true JP2020515923A (ja) | 2020-05-28 |
JP6980012B2 JP6980012B2 (ja) | 2021-12-15 |
Family
ID=59524133
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019523053A Active JP6980012B2 (ja) | 2016-10-26 | 2017-10-26 | 仮想現実の入力の実行 |
Country Status (10)
Country | Link |
---|---|
US (2) | US10509535B2 (ja) |
EP (1) | EP3533046B1 (ja) |
JP (1) | JP6980012B2 (ja) |
KR (1) | KR102278822B1 (ja) |
CN (2) | CN107024981B (ja) |
MY (1) | MY195722A (ja) |
PH (1) | PH12019500945A1 (ja) |
SG (1) | SG11201903551RA (ja) |
TW (1) | TW201816554A (ja) |
WO (1) | WO2018081418A1 (ja) |
Families Citing this family (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107024981B (zh) | 2016-10-26 | 2020-03-20 | 阿里巴巴集团控股有限公司 | 基于虚拟现实的交互方法及装置 |
CN107977083B (zh) * | 2017-12-20 | 2021-07-23 | 北京小米移动软件有限公司 | 基于vr系统的操作执行方法及装置 |
CN108304127A (zh) * | 2017-12-22 | 2018-07-20 | 阿里巴巴集团控股有限公司 | 一种信息输入的方法及装置 |
CN110196629A (zh) * | 2018-02-27 | 2019-09-03 | 优酷网络技术(北京)有限公司 | 虚拟现实界面展示控制方法及装置 |
US10860113B2 (en) * | 2018-05-30 | 2020-12-08 | Atheer, Inc. | Augmented reality head gesture recognition systems |
CN109407935A (zh) * | 2018-09-14 | 2019-03-01 | 歌尔科技有限公司 | 一种虚拟现实显示控制方法、装置和系统 |
CN109302602A (zh) * | 2018-10-11 | 2019-02-01 | 广州土圭垚信息科技有限公司 | 一种基于视焦点预测的自适应vr无线传输方法 |
CN109613975A (zh) * | 2018-11-13 | 2019-04-12 | 宁波视睿迪光电有限公司 | 虚拟现实的操作方法及装置 |
US11189099B2 (en) | 2019-09-20 | 2021-11-30 | Facebook Technologies, Llc | Global and local mode virtual object interactions |
US11086406B1 (en) | 2019-09-20 | 2021-08-10 | Facebook Technologies, Llc | Three-state gesture virtual controls |
US10802600B1 (en) * | 2019-09-20 | 2020-10-13 | Facebook Technologies, Llc | Virtual interactions at a distance |
US11170576B2 (en) | 2019-09-20 | 2021-11-09 | Facebook Technologies, Llc | Progressive display of virtual objects |
US11176745B2 (en) | 2019-09-20 | 2021-11-16 | Facebook Technologies, Llc | Projection casting in virtual environments |
US10991163B2 (en) | 2019-09-20 | 2021-04-27 | Facebook Technologies, Llc | Projection casting in virtual environments |
US11086476B2 (en) * | 2019-10-23 | 2021-08-10 | Facebook Technologies, Llc | 3D interactions with web content |
US11175730B2 (en) | 2019-12-06 | 2021-11-16 | Facebook Technologies, Llc | Posture-based virtual space configurations |
CN111028633A (zh) * | 2019-12-16 | 2020-04-17 | 深圳供电局有限公司 | 基于虚拟现实的电网系统培训方法、装置和计算机设备 |
US11475639B2 (en) | 2020-01-03 | 2022-10-18 | Meta Platforms Technologies, Llc | Self presence in artificial reality |
CN111522930A (zh) * | 2020-04-22 | 2020-08-11 | 深圳创维-Rgb电子有限公司 | 一种场景减压数据处理方法、显示设备及存储介质 |
US11257280B1 (en) | 2020-05-28 | 2022-02-22 | Facebook Technologies, Llc | Element-based switching of ray casting rules |
US11256336B2 (en) | 2020-06-29 | 2022-02-22 | Facebook Technologies, Llc | Integration of artificial reality interaction modes |
CN112068757B (zh) * | 2020-08-03 | 2022-04-08 | 北京理工大学 | 一种用于虚拟现实的目标选择方法及系统 |
US11467403B2 (en) * | 2020-08-20 | 2022-10-11 | Htc Corporation | Operating method and electronic system |
US11227445B1 (en) | 2020-08-31 | 2022-01-18 | Facebook Technologies, Llc | Artificial reality augments and surfaces |
US11176755B1 (en) | 2020-08-31 | 2021-11-16 | Facebook Technologies, Llc | Artificial reality augments and surfaces |
US11178376B1 (en) | 2020-09-04 | 2021-11-16 | Facebook Technologies, Llc | Metering for display modes in artificial reality |
US11119570B1 (en) | 2020-10-29 | 2021-09-14 | XRSpace CO., LTD. | Method and system of modifying position of cursor |
CN113763567A (zh) * | 2020-11-17 | 2021-12-07 | 北京沃东天骏信息技术有限公司 | 一种基于虚拟现实技术的数据展示方法和装置 |
US11113893B1 (en) | 2020-11-17 | 2021-09-07 | Facebook Technologies, Llc | Artificial reality environment with glints displayed by an extra reality device |
US11409405B1 (en) | 2020-12-22 | 2022-08-09 | Facebook Technologies, Llc | Augment orchestration in an artificial reality environment |
US11461973B2 (en) | 2020-12-22 | 2022-10-04 | Meta Platforms Technologies, Llc | Virtual reality locomotion via hand gesture |
US11294475B1 (en) | 2021-02-08 | 2022-04-05 | Facebook Technologies, Llc | Artificial reality multi-modal input switching model |
US11295503B1 (en) | 2021-06-28 | 2022-04-05 | Facebook Technologies, Llc | Interactive avatars in artificial reality |
US11762952B2 (en) | 2021-06-28 | 2023-09-19 | Meta Platforms Technologies, Llc | Artificial reality application lifecycle |
US12008717B2 (en) | 2021-07-07 | 2024-06-11 | Meta Platforms Technologies, Llc | Artificial reality environment control through an artificial reality environment schema |
CN113490063B (zh) * | 2021-08-26 | 2023-06-23 | 上海盛付通电子支付服务有限公司 | 一种用于直播互动的方法、设备、介质及程序产品 |
WO2023055346A1 (en) * | 2021-09-28 | 2023-04-06 | Hewlett-Packard Development Company, L.P. | Key selection for an extended reality keyboard |
US11798247B2 (en) | 2021-10-27 | 2023-10-24 | Meta Platforms Technologies, Llc | Virtual object structures and interrelationships |
US11748944B2 (en) | 2021-10-27 | 2023-09-05 | Meta Platforms Technologies, Llc | Virtual object structures and interrelationships |
US20230135974A1 (en) * | 2021-11-04 | 2023-05-04 | Microsoft Technology Licensing, Llc | Multi-factor intention determination for augmented reality (ar) environment control |
CN114397961A (zh) * | 2021-12-28 | 2022-04-26 | 杭州灵伴科技有限公司 | 头戴式显示设备控制方法、头戴式显示设备组件和介质 |
US12026527B2 (en) | 2022-05-10 | 2024-07-02 | Meta Platforms Technologies, Llc | World-controlled and application-controlled augments in an artificial-reality environment |
CN115793848B (zh) * | 2022-11-04 | 2023-11-24 | 浙江舜为科技有限公司 | 虚拟现实信息交互方法、虚拟现实设备和存储介质 |
US11947862B1 (en) | 2022-12-30 | 2024-04-02 | Meta Platforms Technologies, Llc | Streaming native application content to artificial reality devices |
US11991222B1 (en) | 2023-05-02 | 2024-05-21 | Meta Platforms Technologies, Llc | Persistent call control user interface element in an artificial reality environment |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010015553A (ja) * | 2008-06-03 | 2010-01-21 | Shimane Pref Gov | 画像認識装置および操作判定方法並びにプログラム |
JP2013120487A (ja) * | 2011-12-07 | 2013-06-17 | Denso Corp | 入力装置 |
JP2014186361A (ja) * | 2013-03-21 | 2014-10-02 | Sony Corp | 情報処理装置、操作制御方法及びプログラム |
WO2014181380A1 (ja) * | 2013-05-09 | 2014-11-13 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置およびアプリケーション実行方法 |
WO2015030264A1 (ja) * | 2013-08-30 | 2015-03-05 | 国立大学法人山梨大学 | クリック動作検出装置,方法およびプログラム |
JP2016081508A (ja) * | 2014-10-14 | 2016-05-16 | 株式会社エヌ・ティ・ティ・データ | 認証システム、及び入力装置 |
US20160249043A1 (en) * | 2013-08-30 | 2016-08-25 | Beijing Boe Optoelectronics Technology Co., Ltd. | Three dimensional (3d) glasses, 3d display system and 3d display method |
Family Cites Families (62)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5612719A (en) * | 1992-12-03 | 1997-03-18 | Apple Computer, Inc. | Gesture sensitive buttons for graphical user interfaces |
US5737533A (en) * | 1995-10-26 | 1998-04-07 | Wegener Internet Projects Bv | System for generating a virtual reality scene in response to a database search |
US6154723A (en) | 1996-12-06 | 2000-11-28 | The Board Of Trustees Of The University Of Illinois | Virtual reality 3D interface system for data creation, viewing and editing |
US6195104B1 (en) | 1997-12-23 | 2001-02-27 | Philips Electronics North America Corp. | System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs |
US6842175B1 (en) * | 1999-04-22 | 2005-01-11 | Fraunhofer Usa, Inc. | Tools for interacting with virtual environments |
US6480207B1 (en) * | 1999-08-30 | 2002-11-12 | International Business Machines Corporation | Method, apparatus and computer program product for implementing graphical user interface (GUI) window control |
US6938222B2 (en) * | 2002-02-08 | 2005-08-30 | Microsoft Corporation | Ink gestures |
US7050078B2 (en) * | 2002-12-19 | 2006-05-23 | Accenture Global Services Gmbh | Arbitrary object tracking augmented reality applications |
JP4111897B2 (ja) * | 2003-09-16 | 2008-07-02 | 日立ソフトウエアエンジニアリング株式会社 | ウインドウの制御方法 |
DE10343968A1 (de) * | 2003-09-19 | 2005-05-04 | Icido Ges Fuer Innovative Info | Verfahren und Vorrichtung zur Steuerung eines Graphiksystems der virtuellen Realität mittels Interaktionen |
US7561143B1 (en) * | 2004-03-19 | 2009-07-14 | The University of the Arts | Using gaze actions to interact with a display |
US20110061078A1 (en) * | 2005-05-10 | 2011-03-10 | Reagan Inventions, Llc | System and method for controlling a plurality of electronic devices |
WO2006137078A1 (en) * | 2005-06-20 | 2006-12-28 | Hewlett-Packard Development Company, L.P. | Method, article, apparatus and computer system for inputting a graphical object |
CN101228570B (zh) * | 2005-07-22 | 2010-05-19 | 马特·帕尔拉科夫 | 可用拇指操作的触摸屏用户界面的系统和方法 |
US7523418B2 (en) * | 2006-03-15 | 2009-04-21 | International Business Machines Corporation | Techniques for choosing a position on a display having a cursor |
WO2008010432A1 (fr) * | 2006-07-20 | 2008-01-24 | Sharp Kabushiki Kaisha | dispositif d'interface utilisateur, programme informatique et son support d'enregistrement |
WO2008047552A1 (en) * | 2006-09-28 | 2008-04-24 | Kyocera Corporation | Portable terminal and method for controlling the same |
US7877707B2 (en) * | 2007-01-06 | 2011-01-25 | Apple Inc. | Detecting and interpreting real-world and security gestures on touch and hover sensitive devices |
KR101436091B1 (ko) * | 2007-08-28 | 2014-09-01 | 삼성전자 주식회사 | 포인터의 연속 궤적에 의한 버튼 선택 장치 및 방법 |
KR101569427B1 (ko) * | 2008-10-02 | 2015-11-16 | 삼성전자주식회사 | 휴대 단말기의 터치 입력 장치 및 그의 운영 방법 |
US20100194694A1 (en) * | 2009-01-30 | 2010-08-05 | Nokia Corporation | Method and Apparatus for Continuous Stroke Input |
EP2539759A1 (en) * | 2010-02-28 | 2013-01-02 | Osterhout Group, Inc. | Local advertising content on an interactive head-mounted eyepiece |
US8458615B2 (en) * | 2010-04-07 | 2013-06-04 | Apple Inc. | Device, method, and graphical user interface for managing folders |
JP5581817B2 (ja) * | 2010-06-03 | 2014-09-03 | ソニー株式会社 | 制御システム、制御装置、ハンドヘルド装置、制御方法及びプログラム。 |
KR101701932B1 (ko) * | 2010-07-22 | 2017-02-13 | 삼성전자 주식회사 | 입력 디바이스와 이의 제어 방법 |
JP2012103914A (ja) * | 2010-11-10 | 2012-05-31 | Sony Corp | 表示装置、表示用プログラム、および表示方法 |
JP4908626B1 (ja) * | 2010-12-28 | 2012-04-04 | 株式会社東芝 | 表示制御装置および表示制御方法 |
JP5697521B2 (ja) * | 2011-04-07 | 2015-04-08 | 京セラ株式会社 | 文字入力装置、文字入力制御方法および文字入力プログラム |
KR20130023954A (ko) * | 2011-08-30 | 2013-03-08 | 삼성전자주식회사 | 휴대용 단말기에서 아이콘 편집 과정을 수행하기 위한 장치 및 방법 |
JP5527304B2 (ja) * | 2011-10-17 | 2014-06-18 | 株式会社デンソー | 入力装置 |
US10025381B2 (en) * | 2012-01-04 | 2018-07-17 | Tobii Ab | System for gaze interaction |
US9235324B2 (en) * | 2012-05-04 | 2016-01-12 | Google Inc. | Touch interpretation for displayed elements |
US20140002443A1 (en) | 2012-06-29 | 2014-01-02 | Blackboard Inc. | Augmented reality interface |
US20140059455A1 (en) * | 2012-08-22 | 2014-02-27 | Sap Ag | System and method for efficiently selecting data entities represented in a graphical user interface |
US8836768B1 (en) * | 2012-09-04 | 2014-09-16 | Aquifi, Inc. | Method and system enabling natural user interface gestures with user wearable glasses |
CN102855066B (zh) * | 2012-09-26 | 2017-05-17 | 东莞宇龙通信科技有限公司 | 终端和终端操控方法 |
JP2014092940A (ja) * | 2012-11-02 | 2014-05-19 | Sony Corp | 画像表示装置及び画像表示方法、並びにコンピューター・プログラム |
US9996150B2 (en) * | 2012-12-19 | 2018-06-12 | Qualcomm Incorporated | Enabling augmented reality using eye gaze tracking |
KR20140138424A (ko) | 2013-05-23 | 2014-12-04 | 삼성전자주식회사 | 제스쳐를 이용한 사용자 인터페이스 방법 및 장치 |
US9286763B2 (en) * | 2013-06-17 | 2016-03-15 | Bally Gaming, Inc. | Methods of administering a wagering game based on comparison of straights |
US10025378B2 (en) | 2013-06-25 | 2018-07-17 | Microsoft Technology Licensing, Llc | Selecting user interface elements via position signal |
KR102173123B1 (ko) * | 2013-11-22 | 2020-11-02 | 삼성전자주식회사 | 전자장치에서 이미지 내의 특정 객체를 인식하기 위한 방법 및 장치 |
JP6255954B2 (ja) * | 2013-12-03 | 2018-01-10 | 富士通株式会社 | 動作入力装置、動作入力プログラム及び動作入力方法 |
US9740296B2 (en) * | 2013-12-16 | 2017-08-22 | Leap Motion, Inc. | User-defined virtual interaction space and manipulation of virtual cameras in the interaction space |
US20150185825A1 (en) | 2013-12-30 | 2015-07-02 | Daqri, Llc | Assigning a virtual user interface to a physical object |
US9201578B2 (en) * | 2014-01-23 | 2015-12-01 | Microsoft Technology Licensing, Llc | Gaze swipe selection |
AU2015244158A1 (en) * | 2014-04-08 | 2016-09-15 | Eon Reality, Inc. | Interactive virtual reality systems and methods |
US9829979B2 (en) * | 2014-04-28 | 2017-11-28 | Ford Global Technologies, Llc | Automotive touchscreen controls with simulated texture for haptic feedback |
US9990774B2 (en) * | 2014-08-08 | 2018-06-05 | Sony Interactive Entertainment Inc. | Sensory stimulus management in head mounted display |
US10152227B2 (en) * | 2014-08-26 | 2018-12-11 | International Business Machines Corporation | Free form user-designed single-handed touchscreen keyboard |
US9823764B2 (en) * | 2014-12-03 | 2017-11-21 | Microsoft Technology Licensing, Llc | Pointer projection for natural user input |
CN104360751B (zh) * | 2014-12-05 | 2017-05-10 | 三星电子(中国)研发中心 | 一种实现智能控制的方法和设备 |
CN104506951B (zh) * | 2014-12-08 | 2018-09-04 | 青岛海信电器股份有限公司 | 一种文字输入方法、装置及智能终端 |
EP3234732B1 (en) * | 2014-12-19 | 2021-11-24 | Hewlett-Packard Development Company, L.P. | Interaction with 3d visualization |
CN105094335B (zh) * | 2015-08-04 | 2019-05-10 | 天津锋时互动科技有限公司 | 场景提取方法、物体定位方法及其系统 |
US20170068416A1 (en) * | 2015-09-08 | 2017-03-09 | Chian Chiu Li | Systems And Methods for Gesture Input |
CN105224084B (zh) | 2015-09-30 | 2018-04-24 | 深圳多新哆技术有限责任公司 | 确定虚拟物件在虚拟空间中位置的方法及装置 |
CN105429860A (zh) * | 2015-12-15 | 2016-03-23 | 浙江吉利控股集团有限公司 | 一种即时通讯的装置及方法 |
CN105955461A (zh) * | 2016-04-25 | 2016-09-21 | 乐视控股(北京)有限公司 | 一种交互界面管理方法和系统 |
CN105955471A (zh) * | 2016-04-26 | 2016-09-21 | 乐视控股(北京)有限公司 | 虚拟现实交互的方法及装置 |
CN107024981B (zh) | 2016-10-26 | 2020-03-20 | 阿里巴巴集团控股有限公司 | 基于虚拟现实的交互方法及装置 |
JP2019083402A (ja) * | 2017-10-30 | 2019-05-30 | キヤノン株式会社 | 画像処理装置、画像処理システム、画像処理方法、及びプログラム |
-
2016
- 2016-10-26 CN CN201610951000.9A patent/CN107024981B/zh active Active
- 2016-10-26 CN CN202010378848.3A patent/CN111610858B/zh active Active
-
2017
- 2017-08-04 TW TW106126427A patent/TW201816554A/zh unknown
- 2017-10-24 US US15/792,628 patent/US10509535B2/en active Active
- 2017-10-26 WO PCT/US2017/058520 patent/WO2018081418A1/en unknown
- 2017-10-26 EP EP17864668.3A patent/EP3533046B1/en active Active
- 2017-10-26 MY MYPI2019001781A patent/MY195722A/en unknown
- 2017-10-26 JP JP2019523053A patent/JP6980012B2/ja active Active
- 2017-10-26 KR KR1020197014965A patent/KR102278822B1/ko active IP Right Grant
- 2017-10-26 SG SG11201903551RA patent/SG11201903551RA/en unknown
-
2019
- 2019-04-25 PH PH12019500945A patent/PH12019500945A1/en unknown
- 2019-11-27 US US16/697,974 patent/US10908770B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010015553A (ja) * | 2008-06-03 | 2010-01-21 | Shimane Pref Gov | 画像認識装置および操作判定方法並びにプログラム |
JP2013120487A (ja) * | 2011-12-07 | 2013-06-17 | Denso Corp | 入力装置 |
JP2014186361A (ja) * | 2013-03-21 | 2014-10-02 | Sony Corp | 情報処理装置、操作制御方法及びプログラム |
WO2014181380A1 (ja) * | 2013-05-09 | 2014-11-13 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置およびアプリケーション実行方法 |
WO2015030264A1 (ja) * | 2013-08-30 | 2015-03-05 | 国立大学法人山梨大学 | クリック動作検出装置,方法およびプログラム |
US20160249043A1 (en) * | 2013-08-30 | 2016-08-25 | Beijing Boe Optoelectronics Technology Co., Ltd. | Three dimensional (3d) glasses, 3d display system and 3d display method |
JP2016081508A (ja) * | 2014-10-14 | 2016-05-16 | 株式会社エヌ・ティ・ティ・データ | 認証システム、及び入力装置 |
Also Published As
Publication number | Publication date |
---|---|
JP6980012B2 (ja) | 2021-12-15 |
EP3533046A1 (en) | 2019-09-04 |
US20200097156A1 (en) | 2020-03-26 |
US10509535B2 (en) | 2019-12-17 |
EP3533046A4 (en) | 2019-10-16 |
TW201816554A (zh) | 2018-05-01 |
CN107024981B (zh) | 2020-03-20 |
US10908770B2 (en) | 2021-02-02 |
MY195722A (en) | 2023-02-07 |
CN111610858A (zh) | 2020-09-01 |
PH12019500945A1 (en) | 2019-12-02 |
CN107024981A (zh) | 2017-08-08 |
US20180113599A1 (en) | 2018-04-26 |
SG11201903551RA (en) | 2019-05-30 |
KR20190068617A (ko) | 2019-06-18 |
EP3533046B1 (en) | 2021-12-08 |
CN111610858B (zh) | 2023-09-19 |
WO2018081418A1 (en) | 2018-05-03 |
KR102278822B1 (ko) | 2021-07-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6980012B2 (ja) | 仮想現実の入力の実行 | |
KR102220084B1 (ko) | 가상 현실을 사용한 사용자 신원 인증 | |
US11054912B2 (en) | Three-dimensional graphical user interface for informational input in virtual reality environment | |
JP6773901B2 (ja) | 仮想現実に基づくサービス制御およびユーザ識別認証 | |
JP6896853B2 (ja) | 仮想現実環境における情報入力のためのユーザインターフェース | |
KR20170058996A (ko) | 복수의 장치 상에 분할된 애플리케이션 제시 | |
US10846901B2 (en) | Conversion of 2D diagrams to 3D rich immersive content | |
US10572231B1 (en) | Component grouping for application development | |
KR20230050857A (ko) | 가상 현실 환경에서의 정보 입력을 위한 3차원 그래피컬 사용자 인터페이스 | |
US20220028168A1 (en) | Mobile device based vr control |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20190603 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190603 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200831 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20200924 |
|
A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20201228 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20210322 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20210519 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20211108 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20211116 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6980012 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |