CN110313021B - 增强现实提供方法、装置以及计算机可读记录介质 - Google Patents

增强现实提供方法、装置以及计算机可读记录介质 Download PDF

Info

Publication number
CN110313021B
CN110313021B CN201780086884.9A CN201780086884A CN110313021B CN 110313021 B CN110313021 B CN 110313021B CN 201780086884 A CN201780086884 A CN 201780086884A CN 110313021 B CN110313021 B CN 110313021B
Authority
CN
China
Prior art keywords
plane
information
augmented reality
terminal
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780086884.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN110313021A (zh
Inventor
崔相祚
朴熙喆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aiwanwai Co ltd
From Zhongzhong Global Co ltd
Original Assignee
Line Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Line Corp filed Critical Line Corp
Priority to CN202310837824.3A priority Critical patent/CN116863107A/zh
Publication of CN110313021A publication Critical patent/CN110313021A/zh
Application granted granted Critical
Publication of CN110313021B publication Critical patent/CN110313021B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/42—Simultaneous measurement of distance and other co-ordinates
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P13/00—Indicating or recording presence, absence, or direction, of movement
    • G01P13/02—Indicating direction only, e.g. by weather vane
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P15/00—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
    • G01P15/18—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration in two or more dimensions
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4802—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/02—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
    • G01S15/06—Systems determining the position data of a target
    • G01S15/08—Systems for measuring distance only
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/008—Cut plane or projection plane definition

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
CN201780086884.9A 2017-03-06 2017-03-06 增强现实提供方法、装置以及计算机可读记录介质 Active CN110313021B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310837824.3A CN116863107A (zh) 2017-03-06 2017-03-06 增强现实提供方法、装置以及非暂时性计算机可读介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2017/002373 WO2018164287A1 (ko) 2017-03-06 2017-03-06 증강현실 제공 방법, 장치 및 컴퓨터 프로그램

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202310837824.3A Division CN116863107A (zh) 2017-03-06 2017-03-06 增强现实提供方法、装置以及非暂时性计算机可读介质

Publications (2)

Publication Number Publication Date
CN110313021A CN110313021A (zh) 2019-10-08
CN110313021B true CN110313021B (zh) 2023-07-25

Family

ID=63448162

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201780086884.9A Active CN110313021B (zh) 2017-03-06 2017-03-06 增强现实提供方法、装置以及计算机可读记录介质
CN202310837824.3A Pending CN116863107A (zh) 2017-03-06 2017-03-06 增强现实提供方法、装置以及非暂时性计算机可读介质

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202310837824.3A Pending CN116863107A (zh) 2017-03-06 2017-03-06 增强现实提供方法、装置以及非暂时性计算机可读介质

Country Status (5)

Country Link
US (2) US11120629B2 (enExample)
EP (1) EP3594906B1 (enExample)
JP (1) JP6980802B2 (enExample)
CN (2) CN110313021B (enExample)
WO (1) WO2018164287A1 (enExample)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110930488B (zh) * 2019-11-15 2023-06-06 深圳市瑞立视多媒体科技有限公司 鱼体行为模拟方法、装置、设备及存储介质
US12385944B1 (en) * 2020-03-17 2025-08-12 Apple Inc. Plane extraction and localization
US12112574B2 (en) 2020-03-24 2024-10-08 Magic Leap, Inc. Systems and methods for virtual and augmented reality
CN111582418B (zh) * 2020-05-20 2022-03-08 郝杰 一种ar虚拟说明书的滑动展示方法
KR102840430B1 (ko) * 2020-06-24 2025-07-29 삼성전자주식회사 영상에서 평면을 검출하는 전자 장치 및 그 동작 방법
WO2025093904A1 (en) * 2023-10-31 2025-05-08 Beam Cross Realities Gmbh Image synthesis method, apparatus, computer program and computer-readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0518940A (ja) * 1991-07-09 1993-01-26 Aloka Co Ltd 超音波三次元画像表示装置
KR20130025200A (ko) * 2011-09-01 2013-03-11 에스케이텔레콤 주식회사 증강 현실을 이용하여 실내 위치 기반 서비스를 제공하는 단말기 및 컴퓨터로 읽을 수 있는 기록매체
JP2013512480A (ja) * 2009-09-21 2013-04-11 インテル・コーポレーション 端末の角度に応じて互いに異なる映像情報を提供するための方法、端末およびコンピュータ読取可能な記録媒体
CN103080933A (zh) * 2010-06-30 2013-05-01 诺基亚公司 用于提供增强现实中恒定水平的信息的方法、装置和计算机程序产品
KR20140001167A (ko) * 2012-06-26 2014-01-06 한국과학기술원 웨어러블 증강현실 환경에서 증강현실 서비스 제공 방법 및 장치

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0998323A (ja) * 1995-09-29 1997-04-08 Matsushita Electric Ind Co Ltd ビデオカメラ
JP2004192653A (ja) * 1997-02-28 2004-07-08 Toshiba Corp マルチモーダルインタフェース装置およびマルチモーダルインタフェース方法
JP2002366976A (ja) * 2001-06-08 2002-12-20 Fujitsu Ltd オブジェクト表示プログラムおよびオブジェクト表示装置
US8970690B2 (en) * 2009-02-13 2015-03-03 Metaio Gmbh Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
US20120019441A1 (en) * 2009-03-26 2012-01-26 Kyocera Corporation Mobile electronic device
JP5799521B2 (ja) * 2011-02-15 2015-10-28 ソニー株式会社 情報処理装置、オーサリング方法及びプログラム
JP5724543B2 (ja) * 2011-03-31 2015-05-27 ソニー株式会社 端末装置、オブジェクト制御方法及びプログラム
KR101971948B1 (ko) * 2011-07-28 2019-04-24 삼성전자주식회사 평면 특성 기반 마커리스 증강 현실 시스템 및 그 동작 방법
EP3680863B1 (en) * 2011-08-24 2024-01-10 Sony Group Corporation Information processing device, information processing method, and program
JP2013225245A (ja) * 2012-04-23 2013-10-31 Sony Corp 画像処理装置、画像処理方法及びプログラム
US9317972B2 (en) * 2012-12-18 2016-04-19 Qualcomm Incorporated User interface for augmented reality enabled devices
KR20140145217A (ko) * 2013-05-30 2014-12-23 (주)브이알엑스 공간정보를 이용한 3차원 가상 모델링 시스템 및 그 방법
US9432636B2 (en) * 2013-11-26 2016-08-30 Microsoft Technology Licensing, Llc Large-scale surface reconstruction that is robust against tracking and mapping errors
US10194124B2 (en) * 2013-12-19 2019-01-29 Maxell, Ltd. Projection type video display device and projection type video display method
US9953111B2 (en) * 2014-06-06 2018-04-24 Matterport, Inc. Semantic understanding of 3D data
WO2016012041A1 (en) * 2014-07-23 2016-01-28 Metaio Gmbh Method and system for presenting at least part of an image of a real object in a view of a real environment, and method and system for selecting a subset of a plurality of images
US20160191877A1 (en) * 2014-12-25 2016-06-30 Panasonic Intellectual Property Management Co., Ltd. Projector device and projection method
JP2016139199A (ja) * 2015-01-26 2016-08-04 株式会社リコー 画像処理装置、画像処理方法、およびプログラム
JP6723798B2 (ja) * 2015-05-20 2020-07-15 キヤノン株式会社 情報処理装置、方法、プログラム
KR20170014451A (ko) * 2015-07-30 2017-02-08 삼성에스디에스 주식회사 시야 확보 시스템, 방법 및 이를 수행하기 위한 단말
US9858683B2 (en) * 2015-08-05 2018-01-02 Intel Corporation Method and system of planar surface detection objects in 3d space generated from captured images for image processing

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0518940A (ja) * 1991-07-09 1993-01-26 Aloka Co Ltd 超音波三次元画像表示装置
JP2013512480A (ja) * 2009-09-21 2013-04-11 インテル・コーポレーション 端末の角度に応じて互いに異なる映像情報を提供するための方法、端末およびコンピュータ読取可能な記録媒体
CN103080933A (zh) * 2010-06-30 2013-05-01 诺基亚公司 用于提供增强现实中恒定水平的信息的方法、装置和计算机程序产品
KR20130025200A (ko) * 2011-09-01 2013-03-11 에스케이텔레콤 주식회사 증강 현실을 이용하여 실내 위치 기반 서비스를 제공하는 단말기 및 컴퓨터로 읽을 수 있는 기록매체
KR20140001167A (ko) * 2012-06-26 2014-01-06 한국과학기술원 웨어러블 증강현실 환경에서 증강현실 서비스 제공 방법 및 장치

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
仿射变换虚实配准的空间信息增强表达;武雪玲等;《计算机工程与应用》;20100121(第03期);全文 *

Also Published As

Publication number Publication date
WO2018164287A1 (ko) 2018-09-13
EP3594906A1 (en) 2020-01-15
CN116863107A (zh) 2023-10-10
US20190333282A1 (en) 2019-10-31
JP6980802B2 (ja) 2021-12-15
US11562545B2 (en) 2023-01-24
JP2020509505A (ja) 2020-03-26
US11120629B2 (en) 2021-09-14
EP3594906A4 (en) 2020-11-04
CN110313021A (zh) 2019-10-08
US20210366199A1 (en) 2021-11-25
EP3594906B1 (en) 2022-10-19

Similar Documents

Publication Publication Date Title
CN110313021B (zh) 增强现实提供方法、装置以及计算机可读记录介质
AU2020202551B2 (en) Method for representing points of interest in a view of a real environment on a mobile device and mobile device therefor
CN107852573B (zh) 混合现实社交交互
US12033270B2 (en) Systems and methods for generating stabilized images of a real environment in artificial reality
US10249089B2 (en) System and method for representing remote participants to a meeting
CN104995665B (zh) 用于在真实环境中表示虚拟信息的方法
JP7008730B2 (ja) 画像に挿入される画像コンテンツについての影生成
CN115335894A (zh) 用于虚拟和增强现实的系统和方法
US20150185825A1 (en) Assigning a virtual user interface to a physical object
US20140002443A1 (en) Augmented reality interface
US10825217B2 (en) Image bounding shape using 3D environment representation
JP2014525089A5 (enExample)
US20200394841A1 (en) Information processing apparatus, information processing method, and storage medium
JP2014525089A (ja) ３次元特徴シミュレーション
US12105866B2 (en) Spatial anchor sharing for multiple virtual reality systems in shared real-world environments
US12322131B2 (en) Method and system for displaying a large 3D model on a remote device
CN110926334A (zh) 测量方法、装置、电子设备及存储介质
US9881419B1 (en) Technique for providing an initial pose for a 3-D model
WO2021002978A1 (en) Preview animation
US12002165B1 (en) Light probe placement for displaying objects in 3D environments on electronic devices
WO2022089061A1 (zh) 物体标注信息呈现方法、装置、电子设备及存储介质
Li Mobile augmented/virtual reality interface design and evaluation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Tokyo

Applicant after: AI Holding Co.,Ltd.

Address before: Tokyo

Applicant before: LINE Corp.

TA01 Transfer of patent application right

Effective date of registration: 20220125

Address after: Tokyo

Applicant after: LINE Corp.

Address before: Tokyo

Applicant before: AI Holding Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: Tokyo, Japan

Patentee after: From Zhongzhong Global Co.,Ltd.

Country or region after: Japan

Address before: Tokyo, Japan

Patentee before: LINE Corp.

Country or region before: Japan

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240621

Address after: Tokyo, Japan

Patentee after: Aiwanwai Co.,Ltd.

Country or region after: Japan

Address before: Tokyo, Japan

Patentee before: From Zhongzhong Global Co.,Ltd.

Country or region before: Japan