CN113099204A - Remote live-action augmented reality method based on VR head-mounted display equipment - Google Patents
Remote live-action augmented reality method based on VR head-mounted display equipment Download PDFInfo
- Publication number
- CN113099204A CN113099204A CN202110392566.3A CN202110392566A CN113099204A CN 113099204 A CN113099204 A CN 113099204A CN 202110392566 A CN202110392566 A CN 202110392566A CN 113099204 A CN113099204 A CN 113099204A
- Authority
- CN
- China
- Prior art keywords
- virtual
- client
- head
- scene
- depth
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 28
- 238000004364 calculation method Methods 0.000 claims abstract description 36
- 230000005540 biological transmission Effects 0.000 claims abstract description 16
- 230000011664 signaling Effects 0.000 claims description 36
- 230000008569 process Effects 0.000 claims description 24
- 238000004891 communication Methods 0.000 claims description 22
- 230000004927 fusion Effects 0.000 claims description 18
- 238000009877 rendering Methods 0.000 claims description 15
- 230000009471 action Effects 0.000 claims description 9
- 238000005516 engineering process Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 230000033001 locomotion Effects 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000012937 correction Methods 0.000 claims description 5
- 238000010276 construction Methods 0.000 claims description 4
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 239000011159 matrix material Substances 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 claims description 3
- 238000007654 immersion Methods 0.000 abstract description 10
- 230000007547 defect Effects 0.000 abstract description 3
- 230000000875 corresponding effect Effects 0.000 description 17
- 210000003128 head Anatomy 0.000 description 11
- 239000000872 buffer Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 2
- HPTJABJPZMULFH-UHFFFAOYSA-N 12-[(Cyclohexylcarbamoyl)amino]dodecanoic acid Chemical compound OC(=O)CCCCCCCCCCCNC(=O)NC1CCCCC1 HPTJABJPZMULFH-UHFFFAOYSA-N 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 238000000265 homogenisation Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010899 nucleation Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003014 reinforcing effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110392566.3A CN113099204B (en) | 2021-04-13 | 2021-04-13 | Remote live-action augmented reality method based on VR head-mounted display equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110392566.3A CN113099204B (en) | 2021-04-13 | 2021-04-13 | Remote live-action augmented reality method based on VR head-mounted display equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113099204A true CN113099204A (en) | 2021-07-09 |
CN113099204B CN113099204B (en) | 2022-12-13 |
Family
ID=76676454
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110392566.3A Active CN113099204B (en) | 2021-04-13 | 2021-04-13 | Remote live-action augmented reality method based on VR head-mounted display equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113099204B (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113625997A (en) * | 2021-07-20 | 2021-11-09 | 青岛小鸟看看科技有限公司 | XR software development framework, application method and electronic equipment |
CN113766267A (en) * | 2021-09-15 | 2021-12-07 | 深圳市道通智能航空技术股份有限公司 | Multi-channel video live broadcast method, system, equipment and storage medium based on unmanned aerial vehicle |
CN113949929A (en) * | 2021-10-15 | 2022-01-18 | 保升(中国)科技实业有限公司 | Video communication lifelike technology |
CN114047824A (en) * | 2022-01-13 | 2022-02-15 | 北京悉见科技有限公司 | Method for interaction of multiple terminal users in virtual space |
CN114401414A (en) * | 2021-12-27 | 2022-04-26 | 北京达佳互联信息技术有限公司 | Immersive live broadcast information display method and system and information push method |
CN114844934A (en) * | 2022-04-28 | 2022-08-02 | 北京北建大科技有限公司 | Multi-person large-space VR interactive scene building method based on cloud rendering |
WO2023185856A1 (en) * | 2022-04-01 | 2023-10-05 | 中国移动通信有限公司研究院 | Data transmission method and apparatus, electronic device and readable storage medium |
TWI821876B (en) * | 2022-01-21 | 2023-11-11 | 在地實驗文化事業有限公司 | Mobile smart augmented reality live broadcast device |
CN117278731A (en) * | 2023-11-21 | 2023-12-22 | 启迪数字科技(深圳)有限公司 | Multi-video and three-dimensional scene fusion method, device, equipment and storage medium |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102510506A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Virtual and real occlusion handling method based on binocular image and range information |
CN102568026A (en) * | 2011-12-12 | 2012-07-11 | 浙江大学 | Three-dimensional enhancing realizing method for multi-viewpoint free stereo display |
CN102945564A (en) * | 2012-10-16 | 2013-02-27 | 上海大学 | True 3D modeling system and method based on video perspective type augmented reality |
CN103868460A (en) * | 2014-03-13 | 2014-06-18 | 桂林电子科技大学 | Parallax optimization algorithm-based binocular stereo vision automatic measurement method |
US20170116788A1 (en) * | 2015-10-22 | 2017-04-27 | Shandong University | New pattern and method of virtual reality system based on mobile devices |
CN106843456A (en) * | 2016-08-16 | 2017-06-13 | 深圳超多维光电子有限公司 | A kind of display methods, device and virtual reality device followed the trail of based on attitude |
US20170200317A1 (en) * | 2016-01-12 | 2017-07-13 | Siemens Healthcare Gmbh | Perspective representation of a virtual scene component |
CN107835436A (en) * | 2017-09-25 | 2018-03-23 | 北京航空航天大学 | A kind of real-time virtual reality fusion live broadcast system and method based on WebGL |
WO2018095278A1 (en) * | 2016-11-24 | 2018-05-31 | 腾讯科技(深圳)有限公司 | Aircraft information acquisition method, apparatus and device |
CN109062407A (en) * | 2018-07-27 | 2018-12-21 | 江西省杜达菲科技有限责任公司 | Remote mobile terminal three-dimensional display & control system and method based on VR technology |
CN110378990A (en) * | 2019-07-03 | 2019-10-25 | 北京悉见科技有限公司 | Augmented reality scene shows method, apparatus and storage medium |
WO2020221311A1 (en) * | 2019-04-30 | 2020-11-05 | 齐鲁工业大学 | Wearable device-based mobile robot control system and control method |
CN112114667A (en) * | 2020-08-26 | 2020-12-22 | 济南浪潮高新科技投资发展有限公司 | AR display method and system based on binocular camera and VR equipment |
CN112419472A (en) * | 2019-08-23 | 2021-02-26 | 南京理工大学 | Augmented reality real-time shadow generation method based on virtual shadow map |
CN112486606A (en) * | 2020-11-19 | 2021-03-12 | 湖南麒麟信安科技股份有限公司 | Cloud desktop display optimization method and system based on Android system |
-
2021
- 2021-04-13 CN CN202110392566.3A patent/CN113099204B/en active Active
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102510506A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Virtual and real occlusion handling method based on binocular image and range information |
CN102568026A (en) * | 2011-12-12 | 2012-07-11 | 浙江大学 | Three-dimensional enhancing realizing method for multi-viewpoint free stereo display |
CN102945564A (en) * | 2012-10-16 | 2013-02-27 | 上海大学 | True 3D modeling system and method based on video perspective type augmented reality |
CN103868460A (en) * | 2014-03-13 | 2014-06-18 | 桂林电子科技大学 | Parallax optimization algorithm-based binocular stereo vision automatic measurement method |
US20170116788A1 (en) * | 2015-10-22 | 2017-04-27 | Shandong University | New pattern and method of virtual reality system based on mobile devices |
US20170200317A1 (en) * | 2016-01-12 | 2017-07-13 | Siemens Healthcare Gmbh | Perspective representation of a virtual scene component |
CN106843456A (en) * | 2016-08-16 | 2017-06-13 | 深圳超多维光电子有限公司 | A kind of display methods, device and virtual reality device followed the trail of based on attitude |
WO2018095278A1 (en) * | 2016-11-24 | 2018-05-31 | 腾讯科技(深圳)有限公司 | Aircraft information acquisition method, apparatus and device |
CN107835436A (en) * | 2017-09-25 | 2018-03-23 | 北京航空航天大学 | A kind of real-time virtual reality fusion live broadcast system and method based on WebGL |
CN109062407A (en) * | 2018-07-27 | 2018-12-21 | 江西省杜达菲科技有限责任公司 | Remote mobile terminal three-dimensional display & control system and method based on VR technology |
WO2020221311A1 (en) * | 2019-04-30 | 2020-11-05 | 齐鲁工业大学 | Wearable device-based mobile robot control system and control method |
CN110378990A (en) * | 2019-07-03 | 2019-10-25 | 北京悉见科技有限公司 | Augmented reality scene shows method, apparatus and storage medium |
CN112419472A (en) * | 2019-08-23 | 2021-02-26 | 南京理工大学 | Augmented reality real-time shadow generation method based on virtual shadow map |
CN112114667A (en) * | 2020-08-26 | 2020-12-22 | 济南浪潮高新科技投资发展有限公司 | AR display method and system based on binocular camera and VR equipment |
CN112486606A (en) * | 2020-11-19 | 2021-03-12 | 湖南麒麟信安科技股份有限公司 | Cloud desktop display optimization method and system based on Android system |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113625997B (en) * | 2021-07-20 | 2024-03-12 | 青岛小鸟看看科技有限公司 | XR software development architecture, application method and electronic equipment |
CN113625997A (en) * | 2021-07-20 | 2021-11-09 | 青岛小鸟看看科技有限公司 | XR software development framework, application method and electronic equipment |
CN113766267A (en) * | 2021-09-15 | 2021-12-07 | 深圳市道通智能航空技术股份有限公司 | Multi-channel video live broadcast method, system, equipment and storage medium based on unmanned aerial vehicle |
CN113766267B (en) * | 2021-09-15 | 2023-10-24 | 深圳市道通智能航空技术股份有限公司 | Multi-path video live broadcast method, system, equipment and storage medium based on unmanned aerial vehicle |
CN113949929A (en) * | 2021-10-15 | 2022-01-18 | 保升(中国)科技实业有限公司 | Video communication lifelike technology |
CN114401414B (en) * | 2021-12-27 | 2024-01-23 | 北京达佳互联信息技术有限公司 | Information display method and system for immersive live broadcast and information pushing method |
CN114401414A (en) * | 2021-12-27 | 2022-04-26 | 北京达佳互联信息技术有限公司 | Immersive live broadcast information display method and system and information push method |
CN114047824A (en) * | 2022-01-13 | 2022-02-15 | 北京悉见科技有限公司 | Method for interaction of multiple terminal users in virtual space |
TWI821876B (en) * | 2022-01-21 | 2023-11-11 | 在地實驗文化事業有限公司 | Mobile smart augmented reality live broadcast device |
WO2023185856A1 (en) * | 2022-04-01 | 2023-10-05 | 中国移动通信有限公司研究院 | Data transmission method and apparatus, electronic device and readable storage medium |
CN114844934A (en) * | 2022-04-28 | 2022-08-02 | 北京北建大科技有限公司 | Multi-person large-space VR interactive scene building method based on cloud rendering |
CN117278731A (en) * | 2023-11-21 | 2023-12-22 | 启迪数字科技(深圳)有限公司 | Multi-video and three-dimensional scene fusion method, device, equipment and storage medium |
CN117278731B (en) * | 2023-11-21 | 2024-05-28 | 启迪数字科技(深圳)有限公司 | Multi-video and three-dimensional scene fusion method, device, equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN113099204B (en) | 2022-12-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113099204B (en) | Remote live-action augmented reality method based on VR head-mounted display equipment | |
US10839591B2 (en) | Stereoscopic rendering using raymarching and a virtual view broadcaster for such rendering | |
CN106101741B (en) | Method and system for watching panoramic video on network video live broadcast platform | |
US8228327B2 (en) | Non-linear depth rendering of stereoscopic animated images | |
CN112533002A (en) | Dynamic image fusion method and system for VR panoramic live broadcast | |
KR20150067194A (en) | Controlled three-dimensional communication endpoint | |
CN114401414B (en) | Information display method and system for immersive live broadcast and information pushing method | |
CN107277494A (en) | three-dimensional display system and method | |
JP2014505917A (en) | Hybrid reality for 3D human machine interface | |
US20150179218A1 (en) | Novel transcoder and 3d video editor | |
US20220189105A1 (en) | 3d Conversations in An Artificial Reality Environment | |
CN107562185B (en) | Light field display system based on head-mounted VR equipment and implementation method | |
US11727645B2 (en) | Device and method for sharing an immersion in a virtual environment | |
CN113379831B (en) | Augmented reality method based on binocular camera and humanoid robot | |
JP6091850B2 (en) | Telecommunications apparatus and telecommunications method | |
Valli et al. | Advances in spatially faithful (3d) telepresence | |
JP7011728B2 (en) | Image data output device, content creation device, content playback device, image data output method, content creation method, and content playback method | |
CN117456113B (en) | Cloud offline rendering interactive application implementation method and system | |
WO2022191070A1 (en) | 3d object streaming method, device, and program | |
US20220232201A1 (en) | Image generation system and method | |
US11688124B2 (en) | Methods and apparatus rendering images using point clouds representing one or more objects | |
CN114554232B (en) | Naked eye 3D-based mixed reality live broadcast method and system | |
WO2022004233A1 (en) | Information processing device, information processing method, and program | |
WO2022022548A1 (en) | Free viewpoint video reconstruction and playing processing method, device, and storage medium | |
Galloso et al. | Foundations of a new interaction paradigm for immersive 3D multimedia |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240318 Address after: Room 102, 1st Floor, Building 1, Yongye Building, No. 166 Haier Road, Laoshan District, Qingdao City, Shandong Province, 266000 Patentee after: Qingdao Inception Space Technology Co.,Ltd. Country or region after: China Address before: 266000 No.393, Songling Road, Laoshan District, Qingdao, Shandong Province Patentee before: QINGDAO RESEARCH INSTITUTE OF BEIHANG University Country or region before: China |
|
TR01 | Transfer of patent right | ||
CP03 | Change of name, title or address |
Address after: 102, 1st Floor, Building 1, Yongye Building, No. 166 Haier Road, Laoshan District, Qingdao City, Shandong Province, 266100 Patentee after: Jingjian Future (Qingdao) Technology Co.,Ltd. Country or region after: China Address before: Room 102, 1st Floor, Building 1, Yongye Building, No. 166 Haier Road, Laoshan District, Qingdao City, Shandong Province, 266000 Patentee before: Qingdao Inception Space Technology Co.,Ltd. Country or region before: China |