WO2023071381A1 - Procédé et appareil de fusion virtuel-réel, et dispositif, support de stockage et produit programme - Google Patents
Procédé et appareil de fusion virtuel-réel, et dispositif, support de stockage et produit programme Download PDFInfo
- Publication number
- WO2023071381A1 WO2023071381A1 PCT/CN2022/111199 CN2022111199W WO2023071381A1 WO 2023071381 A1 WO2023071381 A1 WO 2023071381A1 CN 2022111199 W CN2022111199 W CN 2022111199W WO 2023071381 A1 WO2023071381 A1 WO 2023071381A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- virtual object
- projection
- display
- projection position
- target
- Prior art date
Links
- 238000007500 overflow downdraw method Methods 0.000 title claims abstract description 27
- 230000004044 response Effects 0.000 claims abstract description 57
- 238000000034 method Methods 0.000 claims description 114
- 238000012937 correction Methods 0.000 claims description 105
- 230000008859 change Effects 0.000 claims description 97
- 230000008569 process Effects 0.000 claims description 68
- 230000004927 fusion Effects 0.000 claims description 37
- 230000009466 transformation Effects 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 7
- 238000009877 rendering Methods 0.000 claims description 5
- 230000004048 modification Effects 0.000 claims 1
- 238000012986 modification Methods 0.000 claims 1
- 230000000007 visual effect Effects 0.000 description 25
- 230000000694 effects Effects 0.000 description 14
- 230000003190 augmentative effect Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 6
- 230000001186 cumulative effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000002411 adverse Effects 0.000 description 4
- 230000009191 jumping Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000018109 developmental process Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
Definitions
- the present disclosure relates to the technical field of augmented reality, and in particular to a virtual-real fusion method, device, equipment, storage medium and program product.
- the method of changing the display position of the virtual object from the first projection position to the target projection position by using the second correction strategy is as described above.
- the fusion part 42 in response to obtaining the corrected second positioning result of the target device and the virtual object does not meet the first preset condition, adopts the first correction strategy or the second correction strategy to change the display of the virtual object to Changing the position from the first projection position to the target projection position includes: in response to the virtual object belonging to the second type, using the first correction strategy to change the display position of the virtual object from the first projection position to the target projection position; in response to the virtual object belonging to The third type is to change the display position of the virtual object from the first projection position to the target projection position by using the second correction strategy; The display position of the object is changed from the first projection position to the target projection position.
- the above solution improves the flexibility of the correction strategy by implementing different correction strategies for different types of virtual objects.
- the second positioning result of the target device in the preset map is obtained by positioning and matching the target device with the preset map, so that the second positioning result is more accurate than the first positioning result before correction.
- the implementation of the device embodiment may refer to the implementation of the method embodiment.
- This disclosure relates to the field of augmented reality.
- acquiring the image information of the target object in the real environment and then using various visual correlation algorithms to detect or identify the relevant features, states and attributes of the target object, and thus obtain the image information that matches the specific application.
- AR effect combining virtual and reality.
- the target object may involve faces, limbs, gestures, actions, etc. related to the human body, or markers and markers related to objects, or sand tables, display areas or display items related to venues or places.
- Vision-related algorithms can involve visual positioning, real-time positioning in map construction (Simultaneous Localization and Mapping, SLAM), 3D reconstruction, image registration, background segmentation, key point extraction and tracking of objects, object pose or depth detection, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
Abstract
La présente divulgation concerne un procédé et un appareil de fusion virtuel-réel, ainsi qu'un dispositif, un support de stockage et un produit programme. Le procédé de fusion virtuel-réel consiste à : sur la base d'un premier résultat de positionnement d'un dispositif cible avant étalonnage, déterminer une première position de projection d'un objet virtuel dans une image photographiée actuelle du dispositif cible, la première position de projection étant déterminée comme devant être une position d'affichage de l'objet virtuel dans l'image photographiée actuelle ; et en réponse à l'acquisition d'un second résultat de positionnement du dispositif cible après étalonnage et à la satisfaction par l'objet virtuel d'une première condition prédéfinie, continuer à déterminer la première position de projection comme devant être la position d'affichage de l'objet virtuel dans l'image photographiée actuelle.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111272361.8 | 2021-10-29 | ||
| CN202111272361.8A CN114092668A (zh) | 2021-10-29 | 2021-10-29 | 虚实融合方法、装置、设备及存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023071381A1 true WO2023071381A1 (fr) | 2023-05-04 |
Family
ID=80298233
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/111199 WO2023071381A1 (fr) | 2021-10-29 | 2022-08-09 | Procédé et appareil de fusion virtuel-réel, et dispositif, support de stockage et produit programme |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114092668A (fr) |
| WO (1) | WO2023071381A1 (fr) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114092668A (zh) * | 2021-10-29 | 2022-02-25 | 深圳市慧鲤科技有限公司 | 虚实融合方法、装置、设备及存储介质 |
| CN115002345B (zh) * | 2022-05-13 | 2024-02-13 | 北京字节跳动网络技术有限公司 | 一种图像校正方法、装置、电子设备及存储介质 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109671117A (zh) * | 2018-11-13 | 2019-04-23 | 宁波视睿迪光电有限公司 | 虚拟现实交互装置的空间定位方法及装置 |
| CN111880654A (zh) * | 2020-07-27 | 2020-11-03 | 歌尔光学科技有限公司 | 一种图像显示方法、装置、穿戴设备及存储介质 |
| CN112967405A (zh) * | 2021-03-23 | 2021-06-15 | 深圳市商汤科技有限公司 | 虚拟物体的位姿更新方法、装置、设备以及存储介质 |
| WO2021203902A1 (fr) * | 2020-04-08 | 2021-10-14 | Oppo广东移动通信有限公司 | Procédé et appareil de réalisation d'image virtuelle, et support de stockage et dispositif de terminal |
| CN114092668A (zh) * | 2021-10-29 | 2022-02-25 | 深圳市慧鲤科技有限公司 | 虚实融合方法、装置、设备及存储介质 |
-
2021
- 2021-10-29 CN CN202111272361.8A patent/CN114092668A/zh active Pending
-
2022
- 2022-08-09 WO PCT/CN2022/111199 patent/WO2023071381A1/fr unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109671117A (zh) * | 2018-11-13 | 2019-04-23 | 宁波视睿迪光电有限公司 | 虚拟现实交互装置的空间定位方法及装置 |
| WO2021203902A1 (fr) * | 2020-04-08 | 2021-10-14 | Oppo广东移动通信有限公司 | Procédé et appareil de réalisation d'image virtuelle, et support de stockage et dispositif de terminal |
| CN111880654A (zh) * | 2020-07-27 | 2020-11-03 | 歌尔光学科技有限公司 | 一种图像显示方法、装置、穿戴设备及存储介质 |
| CN112967405A (zh) * | 2021-03-23 | 2021-06-15 | 深圳市商汤科技有限公司 | 虚拟物体的位姿更新方法、装置、设备以及存储介质 |
| CN114092668A (zh) * | 2021-10-29 | 2022-02-25 | 深圳市慧鲤科技有限公司 | 虚实融合方法、装置、设备及存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114092668A (zh) | 2022-02-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11928838B2 (en) | Calibration system and method to align a 3D virtual scene and a 3D real world for a stereoscopic head-mounted display | |
| US10846871B2 (en) | Method and system for determining spatial coordinates of a 3D reconstruction of at least part of a real object at absolute spatial scale | |
| US20210131790A1 (en) | Information processing apparatus, information processing method, and recording medium | |
| WO2023071381A1 (fr) | Procédé et appareil de fusion virtuel-réel, et dispositif, support de stockage et produit programme | |
| US9576183B2 (en) | Fast initialization for monocular visual SLAM | |
| KR101056418B1 (ko) | 모바일 센서를 이용한 증강 현실 콘텐츠 추적 장치 및 방법 | |
| US8878846B1 (en) | Superimposing virtual views of 3D objects with live images | |
| KR101554797B1 (ko) | 콘텍스트 인식 증강 상호작용 | |
| US10733798B2 (en) | In situ creation of planar natural feature targets | |
| US10768711B2 (en) | Mediated reality | |
| US10838515B1 (en) | Tracking using controller cameras | |
| JP2018524657A (ja) | 電子デバイス上における環境マッピング用のフィーチャ・データの管理 | |
| JP2005256232A (ja) | ３ｄデータ表示方法、装置、およびプログラム | |
| KR20010055957A (ko) | 증강현실 기반의 3차원 트래커와 컴퓨터 비젼을 이용한영상 정합 방법 | |
| CN112912936A (zh) | 混合现实系统、程序、移动终端装置和方法 | |
| US11758100B2 (en) | Portable projection mapping device and projection mapping system | |
| KR20100006736A (ko) | 이미지 및 문자를 인식하는 심플 프레임 마커를 구비하는 증강현실 시스템과 그 장치, 및 상기 시스템 또는 상기 장치를 이용한 증강현실 구현방법 | |
| Ogawa et al. | Occlusion Handling in Outdoor Augmented Reality using a Combination of Map Data and Instance Segmentation | |
| Piérard et al. | I-see-3d! an interactive and immersive system that dynamically adapts 2d projections to the location of a user's eyes | |
| CN106384365B (zh) | 一种包含深度信息获取的扩增实境系统及其方法 | |
| CN113923437B (zh) | 信息显示方法及其处理装置与显示系统 | |
| WO2023048018A1 (fr) | Dispositif d'affichage, procédé de commande de dispositif d'affichage et programme | |
| WO2024095744A1 (fr) | Dispositif de traitement d'informations, procédé de traitement d'informations et programme | |
| EP3847621A1 (fr) | Suivi d'un objet | |
| Moemeni | Hybrid Marker-Less Camera Pose Tracking with Integrated Sensor Fusion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22885281 Country of ref document: EP Kind code of ref document: A1 |