JP7094280B2 - 客体の制御を支援するための方法、システムおよび非一過性のコンピュータ読み取り可能な記録媒体 - Google Patents
客体の制御を支援するための方法、システムおよび非一過性のコンピュータ読み取り可能な記録媒体 Download PDFInfo
- Publication number
- JP7094280B2 JP7094280B2 JP2019521658A JP2019521658A JP7094280B2 JP 7094280 B2 JP7094280 B2 JP 7094280B2 JP 2019521658 A JP2019521658 A JP 2019521658A JP 2019521658 A JP2019521658 A JP 2019521658A JP 7094280 B2 JP7094280 B2 JP 7094280B2
- Authority
- JP
- Japan
- Prior art keywords
- control
- coordinate system
- vector
- user
- target object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 24
- 230000001052 transient effect Effects 0.000 title claims description 9
- 239000013598 vector Substances 0.000 claims description 150
- 238000013507 mapping Methods 0.000 claims description 30
- 238000004590 computer program Methods 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 32
- 230000006870 function Effects 0.000 description 28
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 21
- 230000003190 augmentative effect Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 4
- 230000015654 memory Effects 0.000 description 4
- 230000036544 posture Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000004984 smart glass Substances 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
- G05B19/409—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/269—Analysis of motion using gradient-based methods
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/35—Nc in input of data, input till input file format
- G05B2219/35444—Gesture interface, controlled machine observes operator, executes commands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30241—Trajectory
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Manufacturing & Machinery (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
Description
200:客体制御支援システム
210:空間情報管理部
220:客体制御管理部
230:データベース
240:通信部
250:制御部
Claims (7)
- 客体の制御を支援するための方法であって、
使用者が行うジェスチャーまたは操作に対応する制御ベクター(vector)を実世界の座標系で特定する段階、
前記制御ベクターによって指示される客体を前記使用者が行うジェスチャーまたは操作によって制御される対象客体として決定する段階、
対象客体基準座標系で前記制御ベクターの大きさまたは方向に対応する制御座標を特定するマッピング(mapping)を遂行する段階、および
前記マッピングによって特定される制御座標を参照して前記対象客体に対して適用される制御命令を決定する段階を含み、
前記対象客体基準座標系は、基準点により定義される0次元対象客体基準座標系、基準線により定義される1次元対象客体基準座標系、基準領域により定義される2次元対象客体基準座標系、及び、基準空間により定義される3次元対象客体基準座標系を含み、前記対象客体に加えられ得るジェスチャーまたは操作に関連した属性に応じて、前記基準点、前記基準線、前記基準領域及び前記基準空間のいずれか1つが選択的に設定され、設定された前記基準点、前記基準線、前記基準領域又は前記基準空間により、前記0次元対象客体基準座標系、前記1次元対象客体基準座標系、前記2次元対象客体基準座標系、及び前記3次元対象客体基準座標系のいずれか1つが前記対象客体に対して選択的に定義され、
前記制御座標は、前記制御ベクターと前記基準点、前記基準線、前記基準領域または前記基準空間の間の関係に基づいて特定される方法。 - 前記制御ベクターは、前記使用者の目の位置を始点とし、前記使用者の他の身体部位の位置を終点とするベクターである、請求項1に記載の方法。
- 前記制御ベクターは、前記操作の対象となるベクター制御手段の姿勢または前記ベクター制御手段によって発生する制御信号の方向に基づいて特定されるベクターである、請求項1に記載の方法。
- 前記客体は、前記使用者の周辺に存在する実物客体であるか仮想客体である、請求項1に記載の方法。
- 前記対象客体決定段階において、
前記使用者および前記客体に関する空間情報を参照して、前記実世界の座標系で前記制御ベクターまたは前記制御ベクターの延長線と交差するか最も近接する客体を前記対象客体として決定する、請求項1に記載の方法。 - 請求項1に記載された方法を遂行するためのコンピュータプログラムを記録した,非一過性のコンピュータ読み取り可能な記録媒体。
- 客体の制御を支援するためのシステムであって、
使用者が行うジェスチャーまたは操作に対応する制御ベクター(vector)を実世界の座標系で特定し、前記制御ベクターによって指示される客体を前記使用者が行うジェスチャーまたは操作によって制御される対象客体として決定し、対象客体基準座標系で前記制御ベクターの大きさまたは方向に対応する制御座標を特定するマッピング(mapping)を遂行し、前記マッピングによって特定される制御座標を参照して前記対象客体に対して適用される制御命令を決定する客体制御管理部と、
前記使用者および前記客体に関する空間情報を保存する空間情報管理部とを含み、
前記対象客体基準座標系は、基準点により定義される0次元対象客体基準座標系、基準線により定義される1次元対象客体基準座標系、基準領域により定義される2次元対象客体基準座標系、及び、基準空間により定義される3次元対象客体基準座標系を含み、前記対象客体に加えられ得るジェスチャーまたは操作に関連した属性に応じて、前記基準点、前記基準線、前記基準領域及び前記基準空間のいずれか1つが選択的に設定され、設定された前記基準点、前記基準線、前記基準領域又は前記基準空間により、前記0次元対象客体基準座標系、前記1次元対象客体基準座標系、前記2次元対象客体基準座標系、及び前記3次元対象客体基準座標系のいずれか1つが前記対象客体に対して選択的に定義され、
前記制御座標は、前記制御ベクターと前記基準点、前記基準線、前記基準領域または前記基準空間の間の関係に基づいて特定されるシステム。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2016-0138662 | 2016-10-24 | ||
KR1020160138662A KR101937823B1 (ko) | 2016-10-24 | 2016-10-24 | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능한 기록 매체 |
PCT/KR2017/011788 WO2018080142A1 (ko) | 2016-10-24 | 2017-10-24 | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능한 기록 매체 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2019536140A JP2019536140A (ja) | 2019-12-12 |
JP7094280B2 true JP7094280B2 (ja) | 2022-07-01 |
Family
ID=62023803
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019521658A Active JP7094280B2 (ja) | 2016-10-24 | 2017-10-24 | 客体の制御を支援するための方法、システムおよび非一過性のコンピュータ読み取り可能な記録媒体 |
Country Status (6)
Country | Link |
---|---|
US (1) | US10948995B2 (ja) |
EP (1) | EP3531242A4 (ja) |
JP (1) | JP7094280B2 (ja) |
KR (1) | KR101937823B1 (ja) |
CN (1) | CN109891370B (ja) |
WO (1) | WO2018080142A1 (ja) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102155378B1 (ko) * | 2018-09-19 | 2020-09-14 | 주식회사 브이터치 | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체 |
JP7091983B2 (ja) * | 2018-10-01 | 2022-06-28 | トヨタ自動車株式会社 | 機器制御装置 |
US11474690B2 (en) * | 2020-08-14 | 2022-10-18 | VTouch Co., Ltd. | Method, system and non-transitory computer-readable recording medium for non-contact control |
KR102477006B1 (ko) * | 2020-08-14 | 2022-12-14 | 주식회사 브이터치 | 객체 제어를 지원하는 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체 |
CN114546210A (zh) * | 2022-01-28 | 2022-05-27 | 联想(北京)有限公司 | 一种映射方法以及增强现实设备 |
US20230409122A1 (en) * | 2022-06-21 | 2023-12-21 | Apple Inc. | Hand-Gesture Activation of Actionable Items |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140184499A1 (en) | 2011-07-11 | 2014-07-03 | VTouch Co., Ltd. | Remote manipulation device and method using a virtual touch of a three-dimensionally modeled electronic device |
Family Cites Families (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005069734A (ja) * | 2003-08-20 | 2005-03-17 | Tokyo Univ Of Marine Science & Technology | 指さし行為による物体の空間位置の教示方法 |
KR20060070280A (ko) * | 2004-12-20 | 2006-06-23 | 한국전자통신연구원 | 손 제스처 인식을 이용한 사용자 인터페이스 장치 및 그방법 |
JP2006268209A (ja) * | 2005-03-23 | 2006-10-05 | Akinori Yoshino | ユーザの身体動作による遠隔命令入力装置 |
JP4516042B2 (ja) * | 2006-03-27 | 2010-08-04 | 株式会社東芝 | 機器操作装置および機器操作方法 |
JP5207513B2 (ja) * | 2007-08-02 | 2013-06-12 | 公立大学法人首都大学東京 | 制御機器操作ジェスチャ認識装置、制御機器操作ジェスチャ認識システムおよび制御機器操作ジェスチャ認識プログラム |
CA2748037C (en) * | 2009-02-17 | 2016-09-20 | Omek Interactive, Ltd. | Method and system for gesture recognition |
US8253746B2 (en) * | 2009-05-01 | 2012-08-28 | Microsoft Corporation | Determine intended motions |
KR101585466B1 (ko) * | 2009-06-01 | 2016-01-15 | 엘지전자 주식회사 | 움직임 검출에 의한 전자장치 동작 제어방법 및 이를 채용하는 전자장치 |
KR101334107B1 (ko) * | 2010-04-22 | 2013-12-16 | 주식회사 굿소프트웨어랩 | 차량용 멀티미디어 제어를 위한 사용자 인터페이스 장치 및 방법 |
JP5256265B2 (ja) * | 2010-09-17 | 2013-08-07 | 株式会社ソニー・コンピュータエンタテインメント | コンピュータシステム、コンピュータシステムの制御方法、プログラム及び情報記憶媒体 |
KR101795574B1 (ko) * | 2011-01-06 | 2017-11-13 | 삼성전자주식회사 | 모션에 의해 제어되는 전자기기 및 그 제어 방법 |
KR101151962B1 (ko) * | 2011-02-16 | 2012-06-01 | 김석중 | 포인터를 사용하지 않는 가상 터치 장치 및 방법 |
KR101381928B1 (ko) * | 2011-02-18 | 2014-04-07 | 주식회사 브이터치 | 포인터를 사용하지 않는 가상 터치 장치 및 방법 |
JP6074170B2 (ja) * | 2011-06-23 | 2017-02-01 | インテル・コーポレーション | 近距離動作のトラッキングのシステムおよび方法 |
JP2013205983A (ja) * | 2012-03-27 | 2013-10-07 | Sony Corp | 情報入力装置及び情報入力方法、並びにコンピューター・プログラム |
US9477303B2 (en) * | 2012-04-09 | 2016-10-25 | Intel Corporation | System and method for combining three-dimensional tracking with a three-dimensional display for a user interface |
KR101343748B1 (ko) * | 2012-04-23 | 2014-01-08 | 주식회사 브이터치 | 포인터를 표시하지 않는 투명 디스플레이 가상 터치 장치 |
KR101533320B1 (ko) * | 2012-04-23 | 2015-07-03 | 주식회사 브이터치 | 포인터가 불필요한 3차원 객체 정보 획득 장치 |
KR101334585B1 (ko) * | 2012-05-29 | 2013-12-05 | 주식회사 브이터치 | 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치 및 방법 |
KR101441882B1 (ko) * | 2012-11-12 | 2014-09-22 | 주식회사 브이터치 | 포인터를 사용하지 않는 가상 터치 장치에서의 디스플레이 표시면 둘레의 가상 평면을 사용하여 전자기기를 제어하는 방법 |
US20190265802A1 (en) * | 2013-06-20 | 2019-08-29 | Uday Parshionikar | Gesture based user interfaces, apparatuses and control systems |
WO2015008164A2 (en) * | 2013-06-27 | 2015-01-22 | Eyesight Mobile Technologies Ltd. | Systems and methods of direct pointing detection for interaction with a digital device |
JP6079614B2 (ja) * | 2013-12-19 | 2017-02-15 | ソニー株式会社 | 画像表示装置及び画像表示方法 |
KR101533319B1 (ko) * | 2014-02-22 | 2015-07-03 | 주식회사 브이터치 | 카메라 중심의 가상터치를 이용한 원격 조작 장치 및 방법 |
US10203762B2 (en) * | 2014-03-11 | 2019-02-12 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
US10852838B2 (en) * | 2014-06-14 | 2020-12-01 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
KR20160024272A (ko) * | 2014-08-25 | 2016-03-04 | 엘지전자 주식회사 | 이동 단말기 및 그 제어 방법 |
US10088971B2 (en) * | 2014-12-10 | 2018-10-02 | Microsoft Technology Licensing, Llc | Natural user interface camera calibration |
KR101630153B1 (ko) * | 2014-12-10 | 2016-06-24 | 현대자동차주식회사 | 제스처 인식 장치, 그를 가지는 차량 및 차량의 제어 방법 |
US10013808B2 (en) * | 2015-02-03 | 2018-07-03 | Globus Medical, Inc. | Surgeon head-mounted display apparatuses |
PL411339A1 (pl) * | 2015-02-23 | 2016-08-29 | Samsung Electronics Polska Spółka Z Ograniczoną Odpowiedzialnością | Sposób sterowania urządzeniem za pomocą gestów i system do sterowania urządzeniem za pomocą gestów |
JP2018528551A (ja) * | 2015-06-10 | 2018-09-27 | ブイタッチ・コーポレーション・リミテッド | ユーザー基準空間座標系上におけるジェスチャー検出方法および装置 |
KR20170124104A (ko) * | 2016-04-29 | 2017-11-09 | 주식회사 브이터치 | 동작-음성의 다중 모드 명령에 기반한 최적 제어 방법 및 이를 적용한 전자 장치 |
US10299032B2 (en) * | 2017-09-11 | 2019-05-21 | Apple Inc. | Front port resonator for a speaker assembly |
KR102463712B1 (ko) * | 2017-11-24 | 2022-11-08 | 현대자동차주식회사 | 가상 터치 인식 장치 및 그의 인식 오류 보정 방법 |
-
2016
- 2016-10-24 KR KR1020160138662A patent/KR101937823B1/ko active IP Right Grant
-
2017
- 2017-10-24 WO PCT/KR2017/011788 patent/WO2018080142A1/ko unknown
- 2017-10-24 JP JP2019521658A patent/JP7094280B2/ja active Active
- 2017-10-24 CN CN201780067468.4A patent/CN109891370B/zh active Active
- 2017-10-24 EP EP17865786.2A patent/EP3531242A4/en active Pending
-
2019
- 2019-04-23 US US16/391,721 patent/US10948995B2/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140184499A1 (en) | 2011-07-11 | 2014-07-03 | VTouch Co., Ltd. | Remote manipulation device and method using a virtual touch of a three-dimensionally modeled electronic device |
Also Published As
Publication number | Publication date |
---|---|
KR20180044757A (ko) | 2018-05-03 |
US10948995B2 (en) | 2021-03-16 |
KR101937823B1 (ko) | 2019-01-14 |
EP3531242A1 (en) | 2019-08-28 |
US20190250716A1 (en) | 2019-08-15 |
WO2018080142A1 (ko) | 2018-05-03 |
CN109891370B (zh) | 2023-07-07 |
CN109891370A (zh) | 2019-06-14 |
JP2019536140A (ja) | 2019-12-12 |
EP3531242A4 (en) | 2020-06-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7094280B2 (ja) | 客体の制御を支援するための方法、システムおよび非一過性のコンピュータ読み取り可能な記録媒体 | |
US11157168B2 (en) | Method and apparatus for controlling a plurality of internet of things devices | |
US20190129607A1 (en) | Method and device for performing remote control | |
KR102471977B1 (ko) | 복수의 전자장치 사이에서 가상 객체를 표시하는 방법 및 이를 지원하는 전자 장치 | |
US10397643B2 (en) | Electronic device for identifying peripheral apparatus and method thereof | |
US9329716B2 (en) | System for projecting content to a display surface having user-controlled size, shape and location/direction and apparatus and methods useful in conjunction therewith | |
US20130024819A1 (en) | Systems and methods for gesture-based creation of interactive hotspots in a real world environment | |
JP6602045B2 (ja) | ディスプレイを用いる入力処理方法及び装置 | |
KR102481486B1 (ko) | 오디오 제공 방법 및 그 장치 | |
JP7062833B2 (ja) | 客体の制御を支援するための方法、システムおよび非一過性のコンピュータ読み取り可能記録媒体 | |
Kang et al. | Minuet: Multimodal interaction with an internet of things | |
US20140009407A1 (en) | Display device including touchscreen and method for controlling the same | |
US20190035152A1 (en) | Augmented reality sensor | |
KR20150092962A (ko) | 입력 처리 방법 및 그 전자 장치 | |
US20230066318A1 (en) | Handcrafted augmented reality effort evidence | |
KR101968547B1 (ko) | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체 | |
US20230062366A1 (en) | Handcrafted augmented reality experiences | |
WO2024061163A1 (zh) | 人机交互方法、显示方法、装置、设备 | |
US11863963B2 (en) | Augmented reality spatial audio experience | |
US20230066686A1 (en) | Augmented reality prop interactions | |
US20230162450A1 (en) | Connecting Spatially Distinct Settings | |
US20240077934A1 (en) | Virtual ar interfaces for controlling iot devices using mobile device orientation sensors | |
WO2024049597A1 (en) | Virtual interfaces for controlling iot devices |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20190614 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190614 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20200722 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200908 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20201207 |
|
A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20210406 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20210604 |
|
C60 | Trial request (containing other claim documents, opposition documents) |
Free format text: JAPANESE INTERMEDIATE CODE: C60 Effective date: 20210604 |
|
A911 | Transfer to examiner for re-examination before appeal (zenchi) |
Free format text: JAPANESE INTERMEDIATE CODE: A911 Effective date: 20210614 |
|
C21 | Notice of transfer of a case for reconsideration by examiners before appeal proceedings |
Free format text: JAPANESE INTERMEDIATE CODE: C21 Effective date: 20210615 |
|
A912 | Re-examination (zenchi) completed and case transferred to appeal board |
Free format text: JAPANESE INTERMEDIATE CODE: A912 Effective date: 20210625 |
|
C211 | Notice of termination of reconsideration by examiners before appeal proceedings |
Free format text: JAPANESE INTERMEDIATE CODE: C211 Effective date: 20210629 |
|
C22 | Notice of designation (change) of administrative judge |
Free format text: JAPANESE INTERMEDIATE CODE: C22 Effective date: 20211012 |
|
C22 | Notice of designation (change) of administrative judge |
Free format text: JAPANESE INTERMEDIATE CODE: C22 Effective date: 20220104 |
|
C13 | Notice of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: C13 Effective date: 20220125 |
|
C22 | Notice of designation (change) of administrative judge |
Free format text: JAPANESE INTERMEDIATE CODE: C22 Effective date: 20220412 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220420 |
|
C23 | Notice of termination of proceedings |
Free format text: JAPANESE INTERMEDIATE CODE: C23 Effective date: 20220510 |
|
C03 | Trial/appeal decision taken |
Free format text: JAPANESE INTERMEDIATE CODE: C03 Effective date: 20220607 |
|
C30A | Notification sent |
Free format text: JAPANESE INTERMEDIATE CODE: C3012 Effective date: 20220607 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20220621 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7094280 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |