CN116034397A - 一种混合现实显示的方法、混合现实设备及存储介质 - Google Patents
一种混合现实显示的方法、混合现实设备及存储介质 Download PDFInfo
- Publication number
- CN116034397A CN116034397A CN202080003470.7A CN202080003470A CN116034397A CN 116034397 A CN116034397 A CN 116034397A CN 202080003470 A CN202080003470 A CN 202080003470A CN 116034397 A CN116034397 A CN 116034397A
- Authority
- CN
- China
- Prior art keywords
- image
- image sensor
- display
- sensor array
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000003860 storage Methods 0.000 title claims abstract description 15
- 238000009877 rendering Methods 0.000 claims abstract description 20
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 15
- 239000011159 matrix material Substances 0.000 claims description 72
- 238000005286 illumination Methods 0.000 claims description 24
- 230000007613 environmental effect Effects 0.000 claims description 23
- 210000001508 eye Anatomy 0.000 claims description 21
- 230000003287 optical effect Effects 0.000 claims description 14
- 238000013519 translation Methods 0.000 claims description 14
- 230000003068 static effect Effects 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 10
- 230000000007 visual effect Effects 0.000 claims description 9
- 230000000694 effects Effects 0.000 claims description 7
- 238000012935 Averaging Methods 0.000 claims description 6
- 230000002146 bilateral effect Effects 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 6
- 238000001914 filtration Methods 0.000 claims description 6
- 238000012937 correction Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 25
- 238000012545 processing Methods 0.000 description 20
- 238000003491 array Methods 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 210000003128 head Anatomy 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 238000003466 welding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/15—Processing image signals for colour aspects of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
一种混合现实显示的方法、混合现实设备及存储介质，该方法包括：接收混合显示信号后，通过眼球追踪器对用户的眼球进行追踪，确定用户在显示屏上的注视点(101)；根据注视点与显示屏中子显示区域的对应关系，确定用户注视的子显示区域(102)；根据子显示区域与图像传感器阵列中图像传感器的对应关系，确定至少一个第一图像传感器，并对至少一个第一图像传感器进行调整，使至少一个第一图像传感器生成的图像的分辨率增大；其中，第一图像传感器对应的子显示区域的中心点与注视点的距离小于设定距离，图像传感器阵列中相邻两个图像传感器的视场角部分重叠(103)；将图像传感器阵列输出的环境图像与虚拟图像进行叠加和渲染，得到并显示MR图像(104)。
Description
PCT国内申请，说明书已公开。
Claims (13)
- PCT国内申请，权利要求书已公开。
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/138106 WO2022133683A1 (zh) | 2020-12-21 | 2020-12-21 | 一种混合现实显示的方法、混合现实设备及存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116034397A true CN116034397A (zh) | 2023-04-28 |
Family
ID=82156957
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080003470.7A Pending CN116034397A (zh) | 2020-12-21 | 2020-12-21 | 一种混合现实显示的方法、混合现实设备及存储介质 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20230403382A1 (zh) |
| CN (1) | CN116034397A (zh) |
| WO (1) | WO2022133683A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117372656A (zh) * | 2023-09-25 | 2024-01-09 | 广东工业大学 | 一种用于混合现实的用户界面显示方法、设备及介质 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117032618B (zh) * | 2023-10-07 | 2024-02-02 | 启迪数字科技(深圳)有限公司 | 基于多屏幕的动画旋转方法、设备及介质 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107908002A (zh) * | 2017-12-06 | 2018-04-13 | 黄心铭 | 增强和混合现实的装置及方法 |
| EP3727622B1 (en) * | 2017-12-22 | 2023-09-06 | Magic Leap, Inc. | Caching and updating of dense 3d reconstruction data |
| CN110324601A (zh) * | 2018-03-27 | 2019-10-11 | 京东方科技集团股份有限公司 | 渲染方法、计算机产品及显示装置 |
| CN109801353A (zh) * | 2019-01-16 | 2019-05-24 | 北京七鑫易维信息技术有限公司 | 一种图像渲染的方法、服务器及终端 |
| CN110378914A (zh) * | 2019-07-22 | 2019-10-25 | 北京七鑫易维信息技术有限公司 | 基于注视点信息的渲染方法及装置、系统、显示设备 |
| CN111626936B (zh) * | 2020-05-22 | 2023-05-12 | 湖南国科智瞳科技有限公司 | 一种显微图像的快速全景拼接方法及系统 |
-
2020
- 2020-12-21 CN CN202080003470.7A patent/CN116034397A/zh active Pending
- 2020-12-21 US US18/036,379 patent/US20230403382A1/en active Pending
- 2020-12-21 WO PCT/CN2020/138106 patent/WO2022133683A1/zh unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117372656A (zh) * | 2023-09-25 | 2024-01-09 | 广东工业大学 | 一种用于混合现实的用户界面显示方法、设备及介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022133683A1 (zh) | 2022-06-30 |
| US20230403382A1 (en) | 2023-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11514657B2 (en) | Replica graphic causing reduced visibility of an image artifact in a direct-view of a real-world scene | |
| CN110650368B (zh) | 视频处理方法、装置和电子设备 | |
| CN109314753B (zh) | 使用光流生成中间视图的方法和计算机可读存储介质 | |
| JP3300334B2 (ja) | 画像処理装置および監視システム | |
| EP3438919B1 (en) | Image displaying method and head-mounted display apparatus | |
| EP3572916B1 (en) | Apparatus, system, and method for accelerating positional tracking of head-mounted displays | |
| US11567568B2 (en) | Display apparatuses and methods incorporating foveated rendering | |
| US20210400250A1 (en) | Dynamic covergence adjustment in augmented reality headsets | |
| CN116034397A (zh) | 一种混合现实显示的方法、混合现实设备及存储介质 | |
| CN112384843A (zh) | 动态面板掩膜 | |
| US20220172319A1 (en) | Camera-based Transparent Display | |
| WO2020090316A1 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
| JP2020523957A (ja) | マルチ・ビュー・コンテンツを観察するユーザに情報を提示する方法及び機器 | |
| JP7367689B2 (ja) | 情報処理装置、情報処理方法、及び記録媒体 | |
| EP4086734A1 (en) | A tracking method for image generation, a computer program product and a computer system | |
| CN112866507B (zh) | 智能化的全景视频合成方法、系统、电子设备及介质 | |
| JP2005135052A (ja) | 複合現実空間でのｆｏｇ効果の実現手法 | |
| KR102629441B1 (ko) | 영상 생성 방법과 이를 이용한 표시장치 | |
| CN117672060A (zh) | 一种3d凸透镜成像的仿真方法及终端 | |
| CN113592704A (zh) | 一种图像生成方法、装置及系统 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |