JP2022543556A - インタラクティブな仮想現実環境のためのオーサリングシステム - Google Patents

インタラクティブな仮想現実環境のためのオーサリングシステム Download PDF

Info

Publication number
JP2022543556A
JP2022543556A JP2022505558A JP2022505558A JP2022543556A JP 2022543556 A JP2022543556 A JP 2022543556A JP 2022505558 A JP2022505558 A JP 2022505558A JP 2022505558 A JP2022505558 A JP 2022505558A JP 2022543556 A JP2022543556 A JP 2022543556A
Authority
JP
Japan
Prior art keywords
trigger
objects
processor
computer
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022505558A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022543556A5 (enExample
Inventor
ザビエル ザ・サード ケルバー、ウィリアム
ジョーン ソ、ヨーン
リム チョイ、ジェ
Original Assignee
ヒューマン モード、エルエルシー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=74499335&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=JP2022543556(A) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by ヒューマン モード、エルエルシー filed Critical ヒューマン モード、エルエルシー
Publication of JP2022543556A publication Critical patent/JP2022543556A/ja
Publication of JP2022543556A5 publication Critical patent/JP2022543556A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/65—Updates
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Computer Security & Cryptography (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2022505558A 2019-08-07 2020-08-07 インタラクティブな仮想現実環境のためのオーサリングシステム Pending JP2022543556A (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962884020P 2019-08-07 2019-08-07
US62/884,020 2019-08-07
US16/549,609 US11977725B2 (en) 2019-08-07 2019-08-23 Authoring system for interactive virtual reality environments
US16/549,609 2019-08-23
PCT/US2020/045344 WO2021026422A1 (en) 2019-08-07 2020-08-07 Authoring system for interactive virtual reality environments

Publications (2)

Publication Number Publication Date
JP2022543556A true JP2022543556A (ja) 2022-10-13
JP2022543556A5 JP2022543556A5 (enExample) 2024-12-24

Family

ID=74499335

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022505558A Pending JP2022543556A (ja) 2019-08-07 2020-08-07 インタラクティブな仮想現実環境のためのオーサリングシステム

Country Status (6)

Country Link
US (2) US11977725B2 (enExample)
JP (1) JP2022543556A (enExample)
AU (1) AU2020327007A1 (enExample)
CA (1) CA3148784A1 (enExample)
GB (1) GB2600850A (enExample)
WO (1) WO2021026422A1 (enExample)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113412471B (zh) * 2019-02-08 2024-11-26 苹果公司 三维内容中的对象定位和移动
US11977725B2 (en) * 2019-08-07 2024-05-07 Human Mode, LLC Authoring system for interactive virtual reality environments
JP7408710B2 (ja) * 2022-03-25 2024-01-05 株式会社バーチャルキャスト 仮想アイテム制御システム、仮想アイテム制御方法、および仮想アイテム制御プログラム
US20240176596A1 (en) * 2022-11-30 2024-05-30 International Business Machines Corporation Virtual-reality-based software development
US12667786B2 (en) * 2022-12-23 2026-06-30 Discord Inc. Game designer tool for scripting complex gameplay actions

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998033148A1 (en) * 1997-01-24 1998-07-30 Sony Corporation Pattern data generator, pattern data generating method and its medium
JP2008516642A (ja) * 2004-08-31 2008-05-22 インフォメーション イン プレース インク オブジェクト指向の複合現実感及びビデオゲームのオーサリングツール・システム及び方法
US20170228130A1 (en) * 2016-02-09 2017-08-10 Unity IPR ApS Systems and methods for a virtual reality editor
CN109725782A (zh) * 2017-10-27 2019-05-07 腾讯科技（深圳）有限公司 一种实现虚拟现实的方法、装置及智能设备、存储介质

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031549A (en) * 1995-07-19 2000-02-29 Extempo Systems, Inc. System and method for directed improvisation by computer controlled characters
US6552722B1 (en) 1998-07-17 2003-04-22 Sensable Technologies, Inc. Systems and methods for sculpting virtual objects in a haptic virtual reality environment
US6629065B1 (en) 1998-09-30 2003-09-30 Wisconsin Alumni Research Foundation Methods and apparata for rapid computer-aided design of objects in virtual reality and other environments
AU2382300A (en) 1998-12-23 2000-07-12 National Institute Of Standards And Technology ("Nist") Method and system for a virtual assembly design environment
US7019743B1 (en) * 2001-05-18 2006-03-28 Autodesk, Inc. Performing operations using drag and drop features
US7269632B2 (en) 2001-06-05 2007-09-11 Xdyne, Inc. Networked computer system for communicating and operating in a virtual reality environment
US7046151B2 (en) 2003-07-14 2006-05-16 Michael J. Dundon Interactive body suit and interactive limb covers
EP1922614A2 (en) * 2005-08-15 2008-05-21 Koninklijke Philips Electronics N.V. System, apparatus, and method for augmented reality glasses for end-user programming
US8589874B2 (en) * 2007-06-11 2013-11-19 Microsoft Corporation Visual interface to represent scripted behaviors
US20110028194A1 (en) * 2009-07-31 2011-02-03 Razer (Asia-Pacific) Pte Ltd System and method for unified-context mapping of physical input device controls to application program actions
US20130022947A1 (en) * 2011-07-22 2013-01-24 Muniz Simas Fernando Moreira Method and system for generating behavioral studies of an individual
US9383895B1 (en) 2012-05-05 2016-07-05 F. Vinayak Methods and systems for interactively producing shapes in three-dimensional space
EA032658B1 (ru) 2013-07-15 2019-06-28 Вр Электроникс Лимитид Способ интерактивной физиологической синхронизации пользователя с виртуальной средой
US20160342318A1 (en) * 2014-11-25 2016-11-24 Wakingapp Ltd. Platform for developing immersive reality-virtuality continuum-based environment and methods thereof
US10235807B2 (en) 2015-01-20 2019-03-19 Microsoft Technology Licensing, Llc Building holographic content using holographic tools
US9857939B2 (en) * 2015-02-27 2018-01-02 Accenture Global Services Limited Three-dimensional virtualization
US10101803B2 (en) * 2015-08-26 2018-10-16 Google Llc Dynamic switching and merging of head, gesture and touch input in virtual reality
US20170084084A1 (en) * 2015-09-22 2017-03-23 Thrillbox, Inc Mapping of user interaction within a virtual reality environment
WO2018047102A1 (en) 2016-09-09 2018-03-15 Ecole Polytechnique Federale De Lausanne (Epfl) Jacket for embodied interaction with virtual or distal robotic device
JP6774367B2 (ja) * 2017-04-11 2020-10-21 富士フイルム株式会社 ヘッドマウントディスプレイの制御装置とその作動方法および作動プログラム、並びに画像表示システム
US20190370544A1 (en) * 2017-05-30 2019-12-05 Ptc Inc. Object Initiated Communication
US10417810B2 (en) * 2017-05-31 2019-09-17 Verizon Patent And Licensing Inc. Methods and systems for rendering virtual reality content based on two-dimensional (“2D”) captured imagery of a three-dimensional (“3D”) scene
EP3635538A4 (en) 2017-06-05 2021-03-10 Umajin Inc. PROCEDURES AND SYSTEMS FOR AN APPLICATION SYSTEM
US10739861B2 (en) * 2018-01-10 2020-08-11 Facebook Technologies, Llc Long distance interaction with artificial reality objects using a near eye display interface
US10650610B2 (en) * 2018-05-04 2020-05-12 Microsoft Technology Licensing, Llc Seamless switching between an authoring view and a consumption view of a three-dimensional scene
US10751612B1 (en) * 2019-04-05 2020-08-25 Sony Interactive Entertainment LLC Media multi-tasking using remote device
US11977725B2 (en) * 2019-08-07 2024-05-07 Human Mode, LLC Authoring system for interactive virtual reality environments

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998033148A1 (en) * 1997-01-24 1998-07-30 Sony Corporation Pattern data generator, pattern data generating method and its medium
JP2008516642A (ja) * 2004-08-31 2008-05-22 インフォメーション イン プレース インク オブジェクト指向の複合現実感及びビデオゲームのオーサリングツール・システム及び方法
US20170228130A1 (en) * 2016-02-09 2017-08-10 Unity IPR ApS Systems and methods for a virtual reality editor
CN109725782A (zh) * 2017-10-27 2019-05-07 腾讯科技（深圳）有限公司 一种实现虚拟现实的方法、装置及智能设备、存储介质

Also Published As

Publication number Publication date
GB202201295D0 (en) 2022-03-16
WO2021026422A1 (en) 2021-02-11
US20250036273A1 (en) 2025-01-30
GB2600850A (en) 2022-05-11
US11977725B2 (en) 2024-05-07
CA3148784A1 (en) 2021-02-11
AU2020327007A1 (en) 2022-02-24
US20210042023A1 (en) 2021-02-11

Similar Documents

Publication Publication Date Title
US20250036273A1 (en) Authoring system for interactive virtual reality environments
Linowes Unity 2020 virtual reality projects: Learn VR development by building immersive applications and games with Unity 2019.4 and later versions
McCaffrey Unreal Engine VR cookbook: Developing virtual reality with UE4
JP2017526030A (ja) 仮想環境内の相互作用を提供するための方法とシステム
Cárcamo et al. Collaborative design model review in the AEC industry
Seth et al. A desktop networked haptic VR interface for mechanical assembly
CN113412471B (zh) 三维内容中的对象定位和移动
Juang et al. Using game engines for physical based simulations a forklift
Onyesolu et al. A survey of some virtual reality tools and resources
Moshayedi et al. Unity in Embedded System Design and Robotics: A Step-by-Step Guide
Faust et al. A video game-based mobile robot simulation environment
Cruz Virtual reality in the architecture, engineering and construction industry proposal of an interactive collaboration application
CN119540414A (zh) 虚拟现实中的动画化头发的自动创建
Karaoğlu et al. Vr based visualization of robotic workcells using cryengine
CN116824040A (zh) 元宇宙悬浮空间构建方法、装置、计算机设备及存储介质
Coppens Integrating Immersive Technologies for Algorithmic Design in Architecture
Elmqvist et al. 3d schematics of modelica models and gamification
Jana et al. HoloLens blueprints
Satō et al. Particle System Parametrization with Bimanual Hand Gestures
Medellín-Castillo et al. Development of haptic-enabled virtual reality applications for engineering, medicine and art
Kaarlela et al. Digital Twins Utilizing XR-Technology as Robotic Training Tools. Machines 2023, 11, 13
Anagnostopoulos et al. An industrial simulator utilizing a gaming platform
Pereira Development of a Harvester Machine Simulator in Virtual Reality
Westerlund Mixed Reality Visualization of 3D-CAD Assemblies for Rapid Prototyping: a description of the current state of Mixed Reality visualization
Thompson et al. Tele-immersive product evaluation: a review and an implementation framework

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230804

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240712

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240723

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20241022

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20241212

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20250204