JP6798010B2 - 感覚式アイウェア - Google Patents

感覚式アイウェア Download PDF

Info

Publication number
JP6798010B2
JP6798010B2 JP2019512813A JP2019512813A JP6798010B2 JP 6798010 B2 JP6798010 B2 JP 6798010B2 JP 2019512813 A JP2019512813 A JP 2019512813A JP 2019512813 A JP2019512813 A JP 2019512813A JP 6798010 B2 JP6798010 B2 JP 6798010B2
Authority
JP
Japan
Prior art keywords
user
wearable
text
gesture
sign language
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019512813A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019535059A (ja
JP2019535059A5 (enExample
Inventor
エリック ブロウィ，
エリック ブロウィ，
マイケル ヤヌシュ ウッズ，
マイケル ヤヌシュ ウッズ，
アンドリュー ラビノビッチ，
アンドリュー ラビノビッチ，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2019535059A publication Critical patent/JP2019535059A/ja
Publication of JP2019535059A5 publication Critical patent/JP2019535059A5/ja
Application granted granted Critical
Publication of JP6798010B2 publication Critical patent/JP6798010B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1688—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being integrated loudspeakers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29—Geographical information databases
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Remote Sensing (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Business, Economics & Management (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Analysis (AREA)
  • Reciprocating, Oscillating Or Vibrating Motors (AREA)
  • Materials For Photolithography (AREA)
  • Machine Translation (AREA)
  • Document Processing Apparatus (AREA)
JP2019512813A 2016-09-13 2017-09-12 感覚式アイウェア Active JP6798010B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662394013P 2016-09-13 2016-09-13
US62/394,013 2016-09-13
US201662440320P 2016-12-29 2016-12-29
US62/440,320 2016-12-29
PCT/US2017/051173 WO2018052901A1 (en) 2016-09-13 2017-09-12 Sensory eyewear

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2020191518A Division JP7200195B2 (ja) 2016-09-13 2020-11-18 感覚式アイウェア

Publications (3)

Publication Number Publication Date
JP2019535059A JP2019535059A (ja) 2019-12-05
JP2019535059A5 JP2019535059A5 (enExample) 2020-10-22
JP6798010B2 true JP6798010B2 (ja) 2020-12-09

Family

ID=61560263

Family Applications (4)

Application Number Title Priority Date Filing Date
JP2019512813A Active JP6798010B2 (ja) 2016-09-13 2017-09-12 感覚式アイウェア
JP2020191518A Active JP7200195B2 (ja) 2016-09-13 2020-11-18 感覚式アイウェア
JP2022177129A Withdrawn JP2023016806A (ja) 2016-09-13 2022-11-04 感覚式アイウェア
JP2024078580A Pending JP2024107011A (ja) 2016-09-13 2024-05-14 感覚式アイウェア

Family Applications After (3)

Application Number Title Priority Date Filing Date
JP2020191518A Active JP7200195B2 (ja) 2016-09-13 2020-11-18 感覚式アイウェア
JP2022177129A Withdrawn JP2023016806A (ja) 2016-09-13 2022-11-04 感覚式アイウェア
JP2024078580A Pending JP2024107011A (ja) 2016-09-13 2024-05-14 感覚式アイウェア

Country Status (9)

Country Link
US (6) US10580213B2 (enExample)
EP (2) EP3513242B1 (enExample)
JP (4) JP6798010B2 (enExample)
KR (4) KR20210060676A (enExample)
CN (2) CN113467089A (enExample)
AU (2) AU2017328161B2 (enExample)
CA (1) CA3036208A1 (enExample)
IL (3) IL312096A (enExample)
WO (1) WO2018052901A1 (enExample)

Families Citing this family (183)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
EP4138075B1 (en) 2013-02-07 2025-06-11 Apple Inc. Voice trigger for a digital assistant
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
JP7036711B2 (ja) 2015-08-18 2022-03-15 マジック リープ， インコーポレイテッド 仮想および拡張現実システムならびに方法
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US12197817B2 (en) 2016-06-11 2025-01-14 Apple Inc. Intelligent device arbitration and control
WO2018052901A1 (en) 2016-09-13 2018-03-22 Magic Leap, Inc. Sensory eyewear
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US10169973B2 (en) 2017-03-08 2019-01-01 International Business Machines Corporation Discontinuing display of virtual content and providing alerts based on hazardous physical obstructions
US11393352B2 (en) * 2017-03-23 2022-07-19 Hello Clover , Llc Reading and contingent response educational and entertainment method and apparatus
CN108229277B (zh) * 2017-03-31 2020-05-01 北京市商汤科技开发有限公司 手势识别、手势控制及多层神经网络训练方法、装置及电子设备
US20180329877A1 (en) * 2017-05-09 2018-11-15 International Business Machines Corporation Multilingual content management
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
US20180336275A1 (en) 2017-05-16 2018-11-22 Apple Inc. Intelligent automated assistant for media exploration
US10528794B2 (en) * 2017-06-05 2020-01-07 Motorola Solutions, Inc. System and method for tailoring an electronic digital assistant inquiry response as a function of previously detected user ingestion of related video information
US11861255B1 (en) 2017-06-16 2024-01-02 Apple Inc. Wearable device for facilitating enhanced interaction
US10540778B2 (en) * 2017-06-30 2020-01-21 Intel Corporation System for determining anatomical feature orientation
US11301734B2 (en) * 2017-07-12 2022-04-12 Lenovo (Singapore) Pte. Ltd. Object association determination
US10691945B2 (en) 2017-07-14 2020-06-23 International Business Machines Corporation Altering virtual content based on the presence of hazardous physical obstructions
DE102017216843B4 (de) * 2017-09-22 2024-03-21 Audi Ag Verfahren und System zum Anzeigen zumindest eines Raumausschnitts, wobei der Raumausschnitt abhängig von einer Augenposition einer Person angezeigt wird
US10593101B1 (en) * 2017-11-01 2020-03-17 Facebook Technologies, Llc Marker based tracking
US11263409B2 (en) * 2017-11-03 2022-03-01 Board Of Trustees Of Michigan State University System and apparatus for non-intrusive word and sentence level sign language translation
WO2019094618A1 (en) * 2017-11-08 2019-05-16 Signall Technologies Zrt Computer vision based sign language interpreter
US10990755B2 (en) * 2017-12-21 2021-04-27 International Business Machines Corporation Altering text of an image in augmented or virtual reality
US11095913B2 (en) 2018-01-17 2021-08-17 Twentieth Century Fox Film Corporation Sign language video encoding for digital cinema
CN111869205B (zh) 2018-01-19 2022-06-10 Pcms控股公司 具有变化位置的多焦平面
US10304208B1 (en) 2018-02-12 2019-05-28 Avodah Labs, Inc. Automated gesture identification using neural networks
US10289903B1 (en) * 2018-02-12 2019-05-14 Avodah Labs, Inc. Visual sign language translation training device and method
WO2019157344A1 (en) 2018-02-12 2019-08-15 Avodah Labs, Inc. Real-time gesture recognition method and apparatus
US10735649B2 (en) 2018-02-22 2020-08-04 Magic Leap, Inc. Virtual and augmented reality systems and methods using display system control information embedded in image data
US10728518B2 (en) 2018-03-22 2020-07-28 Microsoft Technology Licensing, Llc Movement detection in low light environments
US10944957B2 (en) * 2018-03-22 2021-03-09 Microsoft Technology Licensing, Llc Active stereo matching for depth applications
US10643341B2 (en) 2018-03-22 2020-05-05 Microsoft Technology Licensing, Llc Replicated dot maps for simplified depth computation using machine learning
US11477434B2 (en) * 2018-03-23 2022-10-18 Pcms Holdings, Inc. Multifocal plane based method to produce stereoscopic viewpoints in a DIBR system (MFP-DIBR)
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10565720B2 (en) * 2018-03-27 2020-02-18 Microsoft Technology Licensing, Llc External IR illuminator enabling improved head tracking and surface reconstruction for virtual reality
US10872470B2 (en) 2018-04-05 2020-12-22 Lenovo (Singapore) Pte. Ltd. Presentation of content at headset display based on other display not being viewable
US10922862B2 (en) * 2018-04-05 2021-02-16 Lenovo (Singapore) Pte. Ltd. Presentation of content on headset display based on one or more condition(s)
CN118824259A (zh) 2018-04-11 2024-10-22 杜比国际公司 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN108549489B (zh) * 2018-04-27 2019-12-13 哈尔滨拓博科技有限公司 一种基于手部形态、姿态、位置及运动特征的手势控制方法和系统
US10885320B2 (en) 2018-05-03 2021-01-05 Microsoft Technology Licensing, Llc Enhanced accessibility in mixed reality experience for collaboration tools
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
US10635895B2 (en) 2018-06-27 2020-04-28 Facebook Technologies, Llc Gesture-based casting and manipulation of virtual content in artificial-reality environments
US10783712B2 (en) * 2018-06-27 2020-09-22 Facebook Technologies, Llc Visual flairs for emphasizing gestures in artificial-reality environments
US10712901B2 (en) 2018-06-27 2020-07-14 Facebook Technologies, Llc Gesture-based content sharing in artificial reality environments
US11816886B1 (en) * 2018-06-28 2023-11-14 Meta Platforms Technologies, Llc Apparatus, system, and method for machine perception
WO2020010018A1 (en) * 2018-07-05 2020-01-09 Pcms Holdings, Inc. Method and system for near-eye focal plane overlays for 3d perception of content on 2d displays
US10969763B2 (en) * 2018-08-07 2021-04-06 Embodied, Inc. Systems and methods to adapt and optimize human-machine interaction using multimodal user-feedback
US10996846B2 (en) 2018-09-28 2021-05-04 Snap Inc. Neural network system for gesture, wear, activity, or carry detection on a wearable or mobile device
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US10679042B2 (en) * 2018-10-09 2020-06-09 Irene Rogan Shaffer Method and apparatus to accurately interpret facial expressions in American Sign Language
KR102374448B1 (ko) * 2018-11-02 2022-03-15 서울대학교산학협력단 사용자의 의도 예측 방법 및 이를 수행하기 위한 장치
US20200143773A1 (en) * 2018-11-06 2020-05-07 Microsoft Technology Licensing, Llc Augmented reality immersive reader
US11557297B2 (en) 2018-11-09 2023-01-17 Embodied, Inc. Systems and methods for adaptive human-machine interaction and automatic behavioral assessment
US10776617B2 (en) 2019-02-15 2020-09-15 Bank Of America Corporation Sign-language automated teller machine
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11045705B2 (en) * 2019-03-19 2021-06-29 NEX Team Inc. Methods and systems for 3D ball trajectory reconstruction
CN109977906B (zh) * 2019-04-04 2021-06-01 睿魔智能科技（深圳）有限公司 手势识别方法及系统、计算机设备及存储介质
EP3956717B1 (en) 2019-04-15 2024-10-09 Magic Leap, Inc. Sensor fusion for electromagnetic tracking
US11301672B2 (en) * 2019-04-16 2022-04-12 The Board Of Trustees Of The University Of Alabama Radar-based methods and apparatus for communication and interpretation of sign languages
US11023690B2 (en) * 2019-04-30 2021-06-01 Microsoft Technology Licensing, Llc Customized output to optimize for user preference in a distributed system
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
JP2021005157A (ja) * 2019-06-25 2021-01-14 株式会社ソニー・インタラクティブエンタテインメント 画像処理装置および画像処理方法
US11263634B2 (en) 2019-08-16 2022-03-01 Advanced New Technologies Co., Ltd. Payment method and device
CN110444211A (zh) * 2019-08-23 2019-11-12 青岛海信电器股份有限公司 一种语音识别方法及设备
WO2021049445A1 (ja) * 2019-09-10 2021-03-18 日本電気株式会社 言語推定装置、言語推定方法、およびプログラム
EP4031956A1 (en) * 2019-09-20 2022-07-27 InterDigital CE Patent Holdings, SAS Device and method for hand-based user interaction in vr and ar environments
US11275453B1 (en) 2019-09-30 2022-03-15 Snap Inc. Smart ring for manipulating virtual objects displayed by a wearable device
US11430414B2 (en) 2019-10-17 2022-08-30 Microsoft Technology Licensing, Llc Eye gaze control of magnification user interface
EP3809186B1 (en) * 2019-10-18 2022-12-07 HTC Corporation Head-mounted display device and adjusting method
CN110850977B (zh) * 2019-11-06 2023-10-31 成都威爱新经济技术研究院有限公司 一种基于6dof头戴式显示器的立体图像交互方法
US11481563B2 (en) * 2019-11-08 2022-10-25 Adobe Inc. Translating texts for videos based on video context
JP2021090136A (ja) * 2019-12-03 2021-06-10 富士フイルムビジネスイノベーション株式会社 情報処理システム及びプログラム
EP4070286A4 (en) * 2019-12-06 2023-01-18 Magic Leap, Inc. VIRTUAL, AMPLIFIED AND MIXED REALITY SYSTEMS AND METHODS
US11687778B2 (en) 2020-01-06 2023-06-27 The Research Foundation For The State University Of New York Fakecatcher: detection of synthetic portrait videos using biological signals
CN111228777B (zh) * 2020-02-27 2021-04-16 东北石油大学 智能篮球裁判处理方法和装置
US12307066B2 (en) * 2020-03-16 2025-05-20 Apple Inc. Devices, methods, and graphical user interfaces for providing computer-generated experiences
CN111443613A (zh) * 2020-03-27 2020-07-24 珠海格力电器股份有限公司 一种电器设备的控制方法、装置、存储介质及电器设备
US11277597B1 (en) 2020-03-31 2022-03-15 Snap Inc. Marker-based guided AR experience
US20210321169A1 (en) * 2020-04-10 2021-10-14 Sony Corporation Smart glasses closed captioning
US11798429B1 (en) 2020-05-04 2023-10-24 Snap Inc. Virtual tutorials for musical instruments with finger tracking in augmented reality
CN111562815B (zh) * 2020-05-04 2021-07-13 北京花兰德科技咨询服务有限公司 无线头戴装置及语言翻译系统
US12301635B2 (en) 2020-05-11 2025-05-13 Apple Inc. Digital assistant hardware abstraction
US11520399B2 (en) 2020-05-26 2022-12-06 Snap Inc. Interactive augmented reality experiences using positional tracking
US12136433B2 (en) * 2020-05-28 2024-11-05 Snap Inc. Eyewear including diarization
US11302077B2 (en) 2020-05-29 2022-04-12 Snap Inc. Augmented reality guidance that generates guidance markers
US11990129B2 (en) * 2020-06-29 2024-05-21 Innovega, Inc. Display eyewear with auditory enhancement
CN115735175A (zh) * 2020-06-29 2023-03-03 美国斯耐普公司 可共享注视响应观看的眼戴器
US11995774B2 (en) * 2020-06-29 2024-05-28 Snap Inc. Augmented reality experiences using speech and text captions
US11869156B2 (en) 2020-06-30 2024-01-09 Snap Inc. Augmented reality eyewear with speech bubbles and translation
CN111967306B (zh) * 2020-07-02 2021-09-14 广东技术师范大学 目标远程监控方法、装置、计算机设备及存储介质
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones
CN111814433B (zh) * 2020-08-20 2022-02-18 北京智源人工智能研究院 一种维吾尔语实体识别的方法、装置和电子设备
US11686927B2 (en) * 2020-08-26 2023-06-27 Electronics And Telecommunications Research Institute Slim immersive display device and slim visualization device
EP4211896A4 (en) * 2020-09-09 2024-10-02 ARRIS Enterprises LLC SYSTEM AND METHOD FOR INCLUSIVE VIDEO CONFERENCE
US11925863B2 (en) 2020-09-18 2024-03-12 Snap Inc. Tracking hand gestures for interactive game control in augmented reality
US11546505B2 (en) 2020-09-28 2023-01-03 Snap Inc. Touchless photo capture in response to detected hand gestures
WO2022132381A1 (en) * 2020-12-16 2022-06-23 Snap Inc. Eyewear including sign language to speech translation
CN112541501B (zh) * 2020-12-18 2021-09-07 北京中科研究院 一种基于视觉语言建模网络的场景文字识别方法
CN112738499A (zh) * 2020-12-25 2021-04-30 京东方科技集团股份有限公司 基于ar的信息显示方法、装置、ar设备、电子设备及介质
US12086324B2 (en) 2020-12-29 2024-09-10 Snap Inc. Micro hand gestures for controlling virtual and graphical elements
WO2022146673A1 (en) 2020-12-30 2022-07-07 Snap Inc. Augmented reality precision tracking and display
US11740313B2 (en) 2020-12-30 2023-08-29 Snap Inc. Augmented reality precision tracking and display
KR102580559B1 (ko) * 2021-01-08 2023-09-21 한국전자통신연구원 시각적 정보를 이용한 통역 결과 제공 방법, 장치 및 시스템
US11531402B1 (en) 2021-02-25 2022-12-20 Snap Inc. Bimanual gestures for controlling virtual and graphical elements
US12353632B2 (en) 2021-04-08 2025-07-08 Snap Inc. Bimanual interactions between mapped hand regions for controlling virtual and graphical elements
WO2022225761A1 (en) 2021-04-19 2022-10-27 Snap Inc. Hand gestures for animating and controlling virtual and graphical elements
US11817126B2 (en) 2021-04-20 2023-11-14 Micron Technology, Inc. Converting sign language
WO2022235831A1 (en) * 2021-05-05 2022-11-10 Disney Enterprises, Inc. Distribution of sign language enhanced content
US12395690B2 (en) 2021-05-05 2025-08-19 Disney Enterprises, Inc. Accessibility enhanced content delivery
WO2022235416A1 (en) * 2021-05-05 2022-11-10 Disney Enterprises, Inc. Emotion-based sign language enhancement of content
US12205211B2 (en) 2021-05-05 2025-01-21 Disney Enterprises, Inc. Emotion-based sign language enhancement of content
US11729573B2 (en) * 2021-05-18 2023-08-15 Snap Inc. Audio enhanced augmented reality
IT202100013235A1 (it) * 2021-05-21 2022-11-21 Dico Tech S R L Sistema e metodo per la comunicazione non verbale
US12307764B2 (en) * 2021-05-26 2025-05-20 International Business Machines Corporation Augmented reality translation of sign language classifier constructions
JP2022187072A (ja) * 2021-06-07 2022-12-19 矢崎総業株式会社 ウェアラブル機器
WO2022266209A2 (en) * 2021-06-16 2022-12-22 Apple Inc. Conversational and environmental transcriptions
JP2023004849A (ja) * 2021-06-25 2023-01-17 株式会社Ｊｖｃケンウッド 画像処理装置、画像処理方法、プログラム
CN113468616B (zh) * 2021-06-28 2023-03-24 重庆金康特智能穿戴技术研究院有限公司 可穿戴设备的表盘显示方法、系统及可读存储介质
KR102718791B1 (ko) * 2021-06-28 2024-10-17 고려대학교 세종산학협력단 Ar 글래스를 활용한 실시간 수화 통역 장치 및 수화 통역 방법
US12008717B2 (en) 2021-07-07 2024-06-11 Meta Platforms Technologies, Llc Artificial reality environment control through an artificial reality environment schema
CN113239903B (zh) * 2021-07-08 2021-10-01 中国人民解放军国防科技大学 一种跨模态唇读的对抗性双重对比自监督学习方法
CN113609922B (zh) * 2021-07-13 2022-05-13 中国矿业大学 基于模态匹配的连续手语语句识别方法
DE102022208822A1 (de) * 2021-08-30 2023-03-02 Apple Inc. Anzeigen von bilddaten basierend auf umgebungslicht
CN115809672A (zh) * 2021-09-14 2023-03-17 北京小米移动软件有限公司 翻译方法、装置、ar眼镜、存储介质及计算机程序产品
US20230077446A1 (en) * 2021-09-16 2023-03-16 International Business Machines Corporation Smart seamless sign language conversation device
US12190886B2 (en) * 2021-09-27 2025-01-07 International Business Machines Corporation Selective inclusion of speech content in documents
US11977853B2 (en) 2021-09-27 2024-05-07 International Business Machines Corporation Aggregating and identifying new sign language signs
US20230104182A1 (en) * 2021-10-06 2023-04-06 Daniel Torres Hinojosa Smart Wearable Sensor-Based Bi-Directional Assistive Device
US20230128422A1 (en) * 2021-10-27 2023-04-27 Meta Platforms, Inc. Voice Command Integration into Augmented Reality Systems and Virtual Reality Systems
KR20230088100A (ko) 2021-12-10 2023-06-19 삼성전자주식회사 가상 입력 장치를 이용하기 위한 전자 장치 및 그 전자 장치에서의 동작 방법
US20230215295A1 (en) * 2021-12-31 2023-07-06 T-Mobile Innovations Llc Spatially accurate sign language choreography in multimedia translation systems
US20230229388A1 (en) * 2022-01-18 2023-07-20 Torrey Pines Logic, Inc. Scope with text and speech communication system
US20230252822A1 (en) * 2022-02-04 2023-08-10 Meta Platforms Technologies, Llc Sign language detection for smart glasses
TW202347267A (zh) * 2022-02-04 2023-12-01 美商元平台技術有限公司 用於智慧眼鏡之手語偵測
US12159412B2 (en) 2022-02-14 2024-12-03 Snap Inc. Interactively defining an object segmentation
US12067688B2 (en) 2022-02-14 2024-08-20 Meta Platforms Technologies, Llc Coordination of interactions of virtual objects
EP4478159A4 (en) * 2022-03-31 2025-05-07 Samsung Electronics Co., Ltd. METHOD FOR PROVIDING INFORMATION AND ELECTRONIC DEVICE FOR SUPPORTING SAME
US12265663B2 (en) 2022-04-04 2025-04-01 Snap Inc. Gesture-based application invocation
US12282607B2 (en) * 2022-04-27 2025-04-22 Snap Inc. Fingerspelling text entry
WO2023211858A1 (en) * 2022-04-28 2023-11-02 Universal City Studios Llc Systems and methods for providing a show effect using a detectable marker
US11822736B1 (en) * 2022-05-18 2023-11-21 Google Llc Passive-accessory mediated gesture interaction with a head-mounted device
CN114822172A (zh) * 2022-06-23 2022-07-29 北京亮亮视野科技有限公司 基于ar眼镜的文字显示方法及装置
CN115294554A (zh) * 2022-07-15 2022-11-04 熵基科技股份有限公司 用于识别穿戴物体属性的方法及装置
CN115410575A (zh) * 2022-08-10 2022-11-29 湖北星纪时代科技有限公司 手语信息显示方法、介质及可穿戴设备
US20240056563A1 (en) * 2022-08-12 2024-02-15 Apple Inc. Transparent Display with Blur Effect for Physical Objects
US12346495B2 (en) 2022-09-16 2025-07-01 Sesame Ai, Inc. Tracking system using a differential camera with a co-aligned light source assembly
US11747912B1 (en) * 2022-09-22 2023-09-05 Snap Inc. Steerable camera for AR hand tracking
US12333265B2 (en) 2022-10-17 2025-06-17 Snap Inc. Sign language interpretation with collaborative agents
US12444152B1 (en) 2022-10-21 2025-10-14 Meta Platforms Technologies, Llc Application multitasking in a three-dimensional environment
US11868736B1 (en) * 2022-11-09 2024-01-09 Moonbeam, Inc. Approaches to deriving and surfacing insights into conversations in virtual environments and systems for accomplishing the same
US20240201776A1 (en) * 2022-12-16 2024-06-20 Apple Inc. Electronic Device with Centralized User Experience Manager
US11947862B1 (en) * 2022-12-30 2024-04-02 Meta Platforms Technologies, Llc Streaming native application content to artificial reality devices
US20240242541A1 (en) * 2023-01-13 2024-07-18 Zsófia Jáger Eyewear processing sign language to issue commands
WO2024176836A1 (ja) * 2023-02-20 2024-08-29 京セラ株式会社 電子機器、電子機器の制御方法、及びプログラム
CN116229974A (zh) * 2023-03-07 2023-06-06 北京字跳网络技术有限公司 声音处理方法、装置、设备、存储介质及程序产品
US20240331264A1 (en) * 2023-03-28 2024-10-03 SoftWeir Inc. Systems, Devices, and Methods for Generating a Display
US20240335737A1 (en) * 2023-04-05 2024-10-10 Sony Interactive Entertainment Inc. Gesture translation with modification based on game context
US12434137B2 (en) 2023-05-01 2025-10-07 Sony Interactive Entertainment Inc. Dynamic in-game refinement of calibration of user input
US12465859B2 (en) 2023-05-09 2025-11-11 Sony Interactive Entertainment Inc. Systems and methods for artificial intelligence (AI)-assisted temporal context processing in support of hand-gesture communication in video gaming
GB2641146A (en) * 2023-05-15 2025-11-19 Apple Inc Head mountable display
GB2638041A (en) * 2023-05-15 2025-08-13 Apple Inc Head mountable display
US20240404429A1 (en) * 2023-05-31 2024-12-05 International Business Machines Corporation Artificial intelligence virtual sign language avatar interpreter
US11838587B1 (en) * 2023-05-31 2023-12-05 Maris Jacob Ensing System and method of providing customized media content
US20240420426A1 (en) * 2023-06-13 2024-12-19 Qualcomm Incorporated Managing augmented content position and transition states
WO2024259497A1 (en) * 2023-06-21 2024-12-26 Tepy Communication expression user interface
US20250005785A1 (en) * 2023-06-30 2025-01-02 Rockwell Collins, Inc. Online correction for context-aware image analysis for object classification
US20250069443A1 (en) * 2023-08-22 2025-02-27 Lenovo (Singapore) Pte. Ltd. Sign language recognition using parameter keypoints
US20250078575A1 (en) * 2023-09-01 2025-03-06 Lenovo (Singapore) Pte. Ltd. Object identification and labeling with sign language
WO2025059512A1 (en) * 2023-09-15 2025-03-20 Thales Avionics, Inc. Sign language cabin notification system
US20250103831A1 (en) * 2023-09-21 2025-03-27 Meta Platforms, Inc. Bilingual multitask machine translation model for live translation on artificial reality devices
JP2025049227A (ja) * 2023-09-21 2025-04-03 ソフトバンクグループ株式会社 システム
US11908446B1 (en) * 2023-10-05 2024-02-20 Eunice Jia Min Yong Wearable audiovisual translation system
US20250182410A1 (en) * 2023-12-05 2025-06-05 Meta Platforms, Inc. Methods, apparatuses and computer program products for facilitating actions based on text captured by head mounted devices
EP4664245A1 (en) 2024-06-11 2025-12-17 FUJIFILM Business Innovation Corp. Information processing system, program, and information processing method

Family Cites Families (103)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
JPH09179062A (ja) * 1995-12-25 1997-07-11 Canon Inc コンピュータシステム
JPH10133840A (ja) 1996-11-01 1998-05-22 Olympus Optical Co Ltd 情報処理用システム装置
JP2002207732A (ja) * 2001-01-10 2002-07-26 Hiroshi Ono 翻訳装置
JP2004254218A (ja) * 2003-02-21 2004-09-09 Seiko Epson Corp 携帯電話、通信方法および通信プログラム
US7565295B1 (en) * 2003-08-28 2009-07-21 The George Washington University Method and apparatus for translating hand gestures
JP4755813B2 (ja) 2003-11-14 2011-08-24 日立公共システムエンジニアリング株式会社 クライアント端末
JP2005197889A (ja) * 2004-01-05 2005-07-21 Mitsubishi Electric Corp 携帯電話及び手話通信システム
USD514570S1 (en) 2004-06-24 2006-02-07 Microsoft Corporation Region of a fingerprint scanning device with an illuminated ring
JP2006139138A (ja) * 2004-11-12 2006-06-01 Matsushita Electric Ind Co Ltd 情報端末及び基地局
JP3956971B2 (ja) * 2004-12-13 2007-08-08 富士ゼロックス株式会社 情報処理装置、情報処理方法および記録媒体
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
JP2007172251A (ja) * 2005-12-21 2007-07-05 Konica Minolta Photo Imaging Inc 表示装置
JP4730083B2 (ja) 2005-12-22 2011-07-20 コニカミノルタホールディングス株式会社 表示装置
JP2008083289A (ja) 2006-09-27 2008-04-10 Sony Corp 撮像表示装置、撮像表示方法
JP5228310B2 (ja) 2006-11-06 2013-07-03 コニカミノルタ株式会社 映像表示装置
EP3515063A1 (en) * 2007-04-02 2019-07-24 Esight Corp. A method for augmenting sight
US20100277428A1 (en) * 2007-08-31 2010-11-04 Itsuo Kumazawa Touch panel input assisting device, computer operating method using the device, and tactile sense interlocking program
US9001036B2 (en) * 2007-12-20 2015-04-07 University Of Central Florida Research Foundation, Inc. Systems and methods of camera-based fingertip tracking
JP5620651B2 (ja) 2009-06-26 2014-11-05 キヤノン株式会社 再生装置、撮像装置、及びその制御方法
CN102104670B (zh) 2009-12-17 2014-03-05 深圳富泰宏精密工业有限公司 手语识别系统及方法
US20130278631A1 (en) * 2010-02-28 2013-10-24 Osterhout Group, Inc. 3d positioning of augmented reality information
US20120249797A1 (en) * 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
JP2011186636A (ja) * 2010-03-05 2011-09-22 Sony Corp 情報処理装置および方法、並びにプログラム
US8493174B2 (en) 2010-03-24 2013-07-23 Dharma P. Agrawal Apparatus for instantaneous translation of sign language
US8751215B2 (en) * 2010-06-04 2014-06-10 Microsoft Corporation Machine based sign language interpreter
US8775156B2 (en) 2010-08-05 2014-07-08 Google Inc. Translating languages in response to device motion
US9348141B2 (en) 2010-10-27 2016-05-24 Microsoft Technology Licensing, Llc Low-latency fusing of virtual and real content
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
CN107179607B (zh) 2010-12-24 2019-12-13 奇跃公司 人体工程学头戴式显示设备和光学系统
US20120215520A1 (en) * 2011-02-23 2012-08-23 Davis Janel R Translation System
BR112013034009A2 (pt) 2011-05-06 2017-02-07 Magic Leap Inc mundo de presença digital remota simultânea massiva
JP5846552B2 (ja) * 2011-06-03 2016-01-20 国立大学法人九州工業大学 手話認識方法及びその装置
US9092674B2 (en) * 2011-06-23 2015-07-28 International Business Machines Corportion Method for enhanced location based and context sensitive augmented reality translation
US8842909B2 (en) * 2011-06-30 2014-09-23 Qualcomm Incorporated Efficient blending methods for AR applications
AU2011204946C1 (en) 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
TWI484450B (zh) * 2011-08-23 2015-05-11 Hon Hai Prec Ind Co Ltd 手語翻譯系統、手語翻譯裝置及手語翻譯方法
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
EP3974041B1 (en) 2011-10-28 2024-07-10 Magic Leap, Inc. System and method for augmented and virtual reality
WO2013067513A1 (en) * 2011-11-04 2013-05-10 Massachusetts Eye & Ear Infirmary Contextual image stabilization
KR102440195B1 (ko) 2011-11-23 2022-09-02 매직 립, 인코포레이티드 3차원 가상 및 증강 현실 디스플레이 시스템
GB2500417B8 (en) 2012-03-21 2017-06-07 Sony Computer Entertainment Europe Ltd Camera device, system and method of imaging
EP3608717B1 (en) 2012-04-05 2023-09-27 Magic Leap, Inc. Wide-field of view (fov) imaging devices with active foveation capability
US9210413B2 (en) 2012-05-15 2015-12-08 Imagine Mobile Augmented Reality Ltd System worn by a moving user for fully augmenting reality by anchoring virtual objects
US9934614B2 (en) * 2012-05-31 2018-04-03 Microsoft Technology Licensing, Llc Fixed size augmented reality objects
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
NZ702897A (en) 2012-06-11 2017-03-31 Magic Leap Inc Multiple depth plane three-dimensional display using a wave guide reflector array projector
CA2884663A1 (en) 2012-09-11 2014-03-20 Magic Leap, Inc. Ergonomic head mounted display device and optical system
US9966075B2 (en) 2012-09-18 2018-05-08 Qualcomm Incorporated Leveraging head mounted displays to enable person-to-person interactions
JP6040715B2 (ja) * 2012-11-06 2016-12-07 ソニー株式会社 画像表示装置及び画像表示方法、並びにコンピューター・プログラム
US9037450B2 (en) * 2012-12-14 2015-05-19 Microsoft Technology Licensing, Llc Text overlay techniques in realtime translation
NZ710096A (en) 2013-01-15 2018-11-30 Magic Leap Inc Ultra-high resolution scanning fiber display
EP2967322A4 (en) 2013-03-11 2017-02-08 Magic Leap, Inc. System and method for augmented and virtual reality
WO2014162211A2 (en) * 2013-03-15 2014-10-09 Translate Abroad, Inc. Systems and methods for displaying foreign character sets and their translations in real time on resource-constrained mobile devices
CN105229719B (zh) 2013-03-15 2018-04-27 奇跃公司 显示系统和方法
US9280972B2 (en) * 2013-05-10 2016-03-08 Microsoft Technology Licensing, Llc Speech to text conversion
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US20140129207A1 (en) * 2013-07-19 2014-05-08 Apex Technology Ventures, LLC Augmented Reality Language Translation
JP6225612B2 (ja) * 2013-09-30 2017-11-08 富士通株式会社 プログラム、情報処理装置、および方法
JP6293449B2 (ja) * 2013-10-10 2018-03-14 みずほ情報総研株式会社 コミュニケーション支援システム、コミュニケーション支援方法及びコミュニケーション支援プログラム
IL295157B2 (en) 2013-10-16 2023-10-01 Magic Leap Inc An augmented or virtual reality head device with intrapupillary distance adjustment
US9558756B2 (en) * 2013-10-29 2017-01-31 At&T Intellectual Property I, L.P. Method and system for adjusting user speech in a communication session
US9547644B2 (en) * 2013-11-08 2017-01-17 Google Inc. Presenting translations of text depicted in images
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
KR102268462B1 (ko) * 2013-11-27 2021-06-22 매직 립, 인코포레이티드 가상 및 증강 현실 시스템들 및 방법들
US10007355B2 (en) 2013-12-18 2018-06-26 Apple Inc. Gesture-based information exchange between devices in proximity
EP3100098B8 (en) 2014-01-31 2022-10-05 Magic Leap, Inc. Multi-focal display system and method
KR102177133B1 (ko) 2014-01-31 2020-11-10 매직 립, 인코포레이티드 멀티-포컬 디스플레이 시스템 및 방법
JP2015169814A (ja) * 2014-03-07 2015-09-28 サカタインクス株式会社 意思疎通支援方法および意思疎通支援システム
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
WO2015143114A1 (en) * 2014-03-21 2015-09-24 Thomson Licensing Sign language translation apparatus with smart glasses as display featuring a camera and optionally a microphone
US9672210B2 (en) 2014-04-25 2017-06-06 Osterhout Group, Inc. Language translation with head-worn computing
JP6550460B2 (ja) 2014-05-09 2019-07-24 グーグル エルエルシー 眼信号を識別するためのシステムおよび方法、ならびに連続バイオメトリック認証
USD759657S1 (en) 2014-05-19 2016-06-21 Microsoft Corporation Connector with illumination region
CA2950432C (en) 2014-05-30 2022-01-04 Magic Leap, Inc. Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
USD752529S1 (en) 2014-06-09 2016-03-29 Comcast Cable Communications, Llc Electronic housing with illuminated region
US9740687B2 (en) * 2014-06-11 2017-08-22 Facebook, Inc. Classifying languages for objects and entities
CN112651288B (zh) * 2014-06-14 2022-09-20 奇跃公司 用于产生虚拟和增强现实的方法和系统
US9436682B2 (en) * 2014-06-24 2016-09-06 Google Inc. Techniques for machine language translation of text from an image based on non-textual context information from the image
JP6476643B2 (ja) 2014-08-11 2019-03-06 セイコーエプソン株式会社 頭部装着型表示装置、情報システム、頭部装着型表示装置の制御方法、および、コンピュータープログラム
US9798143B2 (en) 2014-08-11 2017-10-24 Seiko Epson Corporation Head mounted display, information system, control method for head mounted display, and computer program
US20160062987A1 (en) * 2014-08-26 2016-03-03 Ncr Corporation Language independent customer communications
JP6325401B2 (ja) * 2014-09-17 2018-05-16 株式会社東芝 情報処理装置、画像変更方法及びプログラム
US10725533B2 (en) 2014-09-26 2020-07-28 Intel Corporation Systems, apparatuses, and methods for gesture recognition and interaction
JP2016095819A (ja) * 2014-11-17 2016-05-26 道芳 永島 音声表示装置
CN204242466U (zh) * 2014-12-08 2015-04-01 安徽工程大学 手语互译装置
NZ773842A (en) 2015-03-16 2022-07-01 Magic Leap Inc Methods and systems for diagnosing and treating health ailments
USD758367S1 (en) 2015-05-14 2016-06-07 Magic Leap, Inc. Virtual reality headset
US10204451B2 (en) * 2015-11-30 2019-02-12 Microsoft Technology Licensing, Llc Multi-optical surface optical design
US9697648B1 (en) * 2015-12-23 2017-07-04 Intel Corporation Text functions in augmented reality
CN105630021B (zh) * 2015-12-31 2018-07-31 歌尔股份有限公司 一种智能终端的触觉振动控制系统和方法
US10317678B2 (en) * 2016-02-08 2019-06-11 Nvidia Corporation Catadioptric on-axis virtual/augmented reality glasses system and method
KR102450803B1 (ko) * 2016-02-11 2022-10-05 한국전자통신연구원 양방향 수화 번역 장치 및 장치가 수행하는 양방향 수화 번역 방법
USD805734S1 (en) 2016-03-04 2017-12-26 Nike, Inc. Shirt
USD794288S1 (en) 2016-03-11 2017-08-15 Nike, Inc. Shoe with illuminable sole light sequence
US9875238B2 (en) * 2016-03-16 2018-01-23 Vonage America Inc. Systems and methods for establishing a language translation setting for a telephony communication
WO2018052901A1 (en) 2016-09-13 2018-03-22 Magic Leap, Inc. Sensory eyewear
JP2019008570A (ja) * 2017-06-26 2019-01-17 ソニー株式会社 情報処理装置、情報処理方法及びプログラム

Also Published As

Publication number Publication date
US20220375177A1 (en) 2022-11-24
IL304038B1 (en) 2024-05-01
JP2019535059A (ja) 2019-12-05
IL265120B1 (en) 2023-08-01
IL304038A (en) 2023-08-01
US20240061243A1 (en) 2024-02-22
KR102257181B1 (ko) 2021-05-27
CN109923462A (zh) 2019-06-21
US12055719B2 (en) 2024-08-06
AU2017328161B2 (en) 2022-02-17
US20180075659A1 (en) 2018-03-15
KR102576135B1 (ko) 2023-09-06
EP3513242A4 (en) 2020-05-13
US20240353680A1 (en) 2024-10-24
EP3513242B1 (en) 2021-12-01
IL265120B2 (en) 2023-12-01
US20200380793A1 (en) 2020-12-03
EP3979050A1 (en) 2022-04-06
US11410392B2 (en) 2022-08-09
JP2021047419A (ja) 2021-03-25
JP2024107011A (ja) 2024-08-08
IL312096A (en) 2024-06-01
AU2022201504A1 (en) 2022-03-24
KR20230003667A (ko) 2023-01-06
CA3036208A1 (en) 2018-03-22
KR20230130773A (ko) 2023-09-12
KR20210060676A (ko) 2021-05-26
JP7200195B2 (ja) 2023-01-06
IL304038B2 (en) 2024-09-01
IL265120A (enExample) 2019-04-30
JP2023016806A (ja) 2023-02-02
US11747618B2 (en) 2023-09-05
WO2018052901A1 (en) 2018-03-22
US10580213B2 (en) 2020-03-03
KR20190051028A (ko) 2019-05-14
EP3513242A1 (en) 2019-07-24
US10769858B2 (en) 2020-09-08
US20200193714A1 (en) 2020-06-18
AU2017328161A1 (en) 2019-04-11
CN109923462B (zh) 2021-07-09
KR102737708B1 (ko) 2024-12-02
CN113467089A (zh) 2021-10-01

Similar Documents

Publication Publication Date Title
JP7200195B2 (ja) 感覚式アイウェア
JP7483798B2 (ja) ワードフロー注釈
NZ792193A (en) Sensory eyewear
KR102892155B1 (ko) 단어 흐름 주석
NZ792186A (en) Sensory eyewear

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200911

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200911

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20200911

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20201006

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20201019

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20201118

R150 Certificate of patent or registration of utility model

Ref document number: 6798010

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250