CN115176285B - 利用缓冲的交叉现实系统用于定位精度 - Google Patents

利用缓冲的交叉现实系统用于定位精度 Download PDF

Info

Publication number
CN115176285B
CN115176285B CN202180017052.8A CN202180017052A CN115176285B CN 115176285 B CN115176285 B CN 115176285B CN 202180017052 A CN202180017052 A CN 202180017052A CN 115176285 B CN115176285 B CN 115176285B
Authority
CN
China
Prior art keywords
map
feature set
image
maps
tracking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202180017052.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN115176285A (zh
Inventor
A·沙阿罗克尼
K-S·林
X·赵
C·I·R·摩尔
A·斯瓦米纳坦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Priority to CN202310695366.4A priority Critical patent/CN116721235A/zh
Publication of CN115176285A publication Critical patent/CN115176285A/zh
Application granted granted Critical
Publication of CN115176285B publication Critical patent/CN115176285B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/20Processor architectures; Processor configuration, e.g. pipelining
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/52Network services specially adapted for the location of the user terminal
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30244Camera pose
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/61Scene description

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Digital Computer Display Output (AREA)
CN202180017052.8A 2020-02-26 2021-02-25 利用缓冲的交叉现实系统用于定位精度 Active CN115176285B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310695366.4A CN116721235A (zh) 2020-02-26 2021-02-25 利用缓冲的交叉现实系统用于定位精度

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062981961P 2020-02-26 2020-02-26
US62/981,961 2020-02-26
PCT/US2021/019716 WO2021173862A1 (en) 2020-02-26 2021-02-25 Cross reality system with buffering for localization accuracy

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202310695366.4A Division CN116721235A (zh) 2020-02-26 2021-02-25 利用缓冲的交叉现实系统用于定位精度

Publications (2)

Publication Number Publication Date
CN115176285A CN115176285A (zh) 2022-10-11
CN115176285B true CN115176285B (zh) 2023-07-25

Family

ID=77366367

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202180017052.8A Active CN115176285B (zh) 2020-02-26 2021-02-25 利用缓冲的交叉现实系统用于定位精度
CN202310695366.4A Pending CN116721235A (zh) 2020-02-26 2021-02-25 利用缓冲的交叉现实系统用于定位精度

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202310695366.4A Pending CN116721235A (zh) 2020-02-26 2021-02-25 利用缓冲的交叉现实系统用于定位精度

Country Status (5)

Country Link
US (2) US11557099B2 (enExample)
EP (1) EP4111368A4 (enExample)
JP (1) JP7586918B2 (enExample)
CN (2) CN115176285B (enExample)
WO (1) WO2021173862A1 (enExample)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7602560B2 (ja) * 2020-06-12 2024-12-18 ユニバーシティ オブ ワシントン 接眼ディスプレイ内での眼追跡
KR20230057372A (ko) * 2020-08-27 2023-04-28 삼성전자주식회사 증강 현실 미디어 오브젝트들에 대한 앵커 기반 렌더링을 수행하는 방법 및 장치
US11823339B2 (en) 2021-04-06 2023-11-21 Apple Inc. Localization accuracy response
CN113870379B (zh) * 2021-09-15 2025-07-11 北京易航远智科技有限公司 地图生成方法、装置、电子设备及计算机可读存储介质
US12367603B2 (en) * 2021-09-24 2025-07-22 Apple Inc. Localization based on detected spatial features
US20230222679A1 (en) * 2022-01-07 2023-07-13 Htc Corporation Indoor space positioning method and indoor space positioning system
US20230386093A1 (en) * 2022-05-26 2023-11-30 Apple Inc. Changing Locked Modes Associated with Display of Computer-Generated Content
US12112431B2 (en) * 2022-05-27 2024-10-08 Quantarium Group, LLC Three dimensional mapping
CN115082959B (zh) * 2022-06-16 2025-07-25 海信视像科技股份有限公司 一种显示设备及图像处理方法
US12190545B2 (en) * 2022-10-26 2025-01-07 Chengdu Qinchuan Iot Technology Co., Ltd. Intelligent manufacturing industrial internet of things with front split service platform, control method and medium thereof
US12423474B2 (en) * 2023-10-03 2025-09-23 Htc Corporation Data processing method, electronic device and non-transitory computer readable storage medium
US20250200794A1 (en) * 2023-12-14 2025-06-19 Htc Corporation Spatial map information generating apparatus, method, and coordinate system integrating apparatus

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107646126A (zh) * 2015-07-16 2018-01-30 谷歌有限责任公司 用于移动设备的相机姿态估计
CN109923867A (zh) * 2016-09-14 2019-06-21 皇家Kpn公司 流式传输虚拟现实视频
CN110249317A (zh) * 2017-01-25 2019-09-17 微软技术许可有限责任公司 用于实时图像变换的无未命中高速缓存结构
CN110378965A (zh) * 2019-05-21 2019-10-25 北京百度网讯科技有限公司 确定坐标系转换参数的方法、装置、设备和存储介质

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0907145A3 (en) * 1997-10-03 2003-03-26 Nippon Telegraph and Telephone Corporation Method and equipment for extracting image features from image sequence
US20020180793A1 (en) 2001-05-31 2002-12-05 International Business Machines Corporation Dynamic buffering of graphic images by a platform independent application program interface
JP4127546B2 (ja) 2003-04-15 2008-07-30 富士通株式会社 画像照合装置、画像照合方法、及び画像照合プログラム
US8970690B2 (en) * 2009-02-13 2015-03-03 Metaio Gmbh Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
WO2014201176A1 (en) * 2013-06-11 2014-12-18 Qualcomm Incorporated Interactive and automatic 3-d object scanning method for the purpose of database creation
US11003961B2 (en) 2014-06-03 2021-05-11 Nec Corporation Image processing system, image processing method, and program storage medium
JP6759550B2 (ja) 2015-03-04 2020-09-23 ソニー株式会社 情報処理装置、プログラム、情報処理方法及び観察システム
EP3384468A4 (en) 2015-12-04 2019-01-30 Magic Leap, Inc. RELOCALIZATION SYSTEMS AND METHODS
US20170169617A1 (en) * 2015-12-14 2017-06-15 II Jonathan M. Rodriguez Systems and Methods for Creating and Sharing a 3-Dimensional Augmented Reality Space
KR102298378B1 (ko) * 2016-04-18 2021-09-07 소니그룹주식회사 정보 처리 장치, 정보 처리 방법, 및 프로그램
US11227435B2 (en) * 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107646126A (zh) * 2015-07-16 2018-01-30 谷歌有限责任公司 用于移动设备的相机姿态估计
CN109923867A (zh) * 2016-09-14 2019-06-21 皇家Kpn公司 流式传输虚拟现实视频
CN110249317A (zh) * 2017-01-25 2019-09-17 微软技术许可有限责任公司 用于实时图像变换的无未命中高速缓存结构
CN110378965A (zh) * 2019-05-21 2019-10-25 北京百度网讯科技有限公司 确定坐标系转换参数的方法、装置、设备和存储介质

Also Published As

Publication number Publication date
US20220406024A1 (en) 2022-12-22
JP2023515523A (ja) 2023-04-13
JP7586918B2 (ja) 2024-11-19
CN115176285A (zh) 2022-10-11
EP4111368A1 (en) 2023-01-04
EP4111368A4 (en) 2023-08-16
US11557099B2 (en) 2023-01-17
CN116721235A (zh) 2023-09-08
WO2021173862A1 (en) 2021-09-02
US20210264674A1 (en) 2021-08-26
US12002170B2 (en) 2024-06-04

Similar Documents

Publication Publication Date Title
JP7665839B2 (ja) Wifi/gpsベースのマップマージを伴うクロスリアリティシステム
EP4104145B1 (en) Cross reality system with prioritization of geolocation information for localization
CN115398314B (zh) 使用多分辨率帧描述符进行地图处理的交叉现实系统
CN115176285B (zh) 利用缓冲的交叉现实系统用于定位精度
JP7653982B2 (ja) 無線フィンガプリントを用いたクロスリアリティシステム
JP7772975B2 (ja) 大規模環境再構築のためのクロスリアリティシステム
CN115380264A (zh) 用于大规模环境的交叉现实系统
JP2025013609A (ja) 位置特定サービスを伴うクロスリアリティシステム
CN115427758A (zh) 具有精确共享地图的交叉现实系统
CN115461787A (zh) 具有快速定位的交叉现实系统
CN115803788A (zh) 用于大规模环境的交叉现实系统

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant