CN113129372A - 基于HoloLens空间映射的三维场景语义分析方法 - Google Patents
基于HoloLens空间映射的三维场景语义分析方法 Download PDFInfo
- Publication number
- CN113129372A CN113129372A CN202110331289.5A CN202110331289A CN113129372A CN 113129372 A CN113129372 A CN 113129372A CN 202110331289 A CN202110331289 A CN 202110331289A CN 113129372 A CN113129372 A CN 113129372A
- Authority
- CN
- China
- Prior art keywords
- hololens
- data
- scene
- point cloud
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013507 mapping Methods 0.000 title claims abstract description 36
- 238000004458 analytical method Methods 0.000 title claims abstract description 32
- 238000012549 training Methods 0.000 claims abstract description 47
- 238000013528 artificial neural network Methods 0.000 claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 16
- 238000002372 labelling Methods 0.000 claims abstract description 6
- 238000004519 manufacturing process Methods 0.000 claims abstract description 5
- 230000003930 cognitive ability Effects 0.000 claims abstract description 4
- 238000001914 filtration Methods 0.000 claims description 15
- 238000005070 sampling Methods 0.000 claims description 9
- 230000004927 fusion Effects 0.000 claims description 6
- 230000005484 gravity Effects 0.000 claims description 6
- 238000011176 pooling Methods 0.000 claims description 6
- 230000002146 bilateral effect Effects 0.000 claims description 4
- 238000011161 development Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000011068 loading method Methods 0.000 claims description 3
- 239000011159 matrix material Substances 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 230000008447 perception Effects 0.000 abstract 1
- 230000019771 cognition Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/243—Classification techniques relating to the number of classes
- G06F18/2433—Single-class perspective, e.g. one-against-all classification; Novelty detection; Outlier detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
- G06F18/253—Fusion techniques of extracted features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
- G06T2207/20028—Bilateral filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110331289.5A CN113129372B (zh) | 2021-03-29 | 2021-03-29 | 基于HoloLens空间映射的三维场景语义分析方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110331289.5A CN113129372B (zh) | 2021-03-29 | 2021-03-29 | 基于HoloLens空间映射的三维场景语义分析方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113129372A true CN113129372A (zh) | 2021-07-16 |
CN113129372B CN113129372B (zh) | 2023-11-03 |
Family
ID=76774300
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110331289.5A Active CN113129372B (zh) | 2021-03-29 | 2021-03-29 | 基于HoloLens空间映射的三维场景语义分析方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113129372B (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113470095A (zh) * | 2021-09-03 | 2021-10-01 | 贝壳技术有限公司 | 室内场景重建模型的处理方法和装置 |
CN113589929A (zh) * | 2021-07-29 | 2021-11-02 | 和舆图(北京)科技有限公司 | 一种基于HoloLens设备的空间距离测量方法及系统 |
CN113706689A (zh) * | 2021-08-04 | 2021-11-26 | 西安交通大学 | 一种基于Hololens深度数据的装配指导方法及系统 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103985155A (zh) * | 2014-05-14 | 2014-08-13 | 北京理工大学 | 基于映射法的散乱点云Delaunay三角剖分曲面重构方法 |
CN110353806A (zh) * | 2019-06-18 | 2019-10-22 | 北京航空航天大学 | 用于微创全膝关节置换手术的增强现实导航方法及系统 |
US20190340825A1 (en) * | 2016-12-26 | 2019-11-07 | Interdigital Ce Patent Holdings | Device and method for generating dynamic virtual contents in mixed reality |
CN111680542A (zh) * | 2020-04-17 | 2020-09-18 | 东南大学 | 基于多尺度特征提取和Pointnet神经网络的钢卷点云识别与分类方法 |
CN111753698A (zh) * | 2020-06-17 | 2020-10-09 | 东南大学 | 一种多模态三维点云分割系统和方法 |
CN111798475A (zh) * | 2020-05-29 | 2020-10-20 | 浙江工业大学 | 一种基于点云深度学习的室内环境3d语义地图构建方法 |
CN111968121A (zh) * | 2020-08-03 | 2020-11-20 | 电子科技大学 | 一种基于实例嵌入与语义融合的三维点云场景分割方法 |
CN112287939A (zh) * | 2020-10-29 | 2021-01-29 | 平安科技(深圳)有限公司 | 三维点云语义分割方法、装置、设备及介质 |
EP3789965A1 (en) * | 2019-09-09 | 2021-03-10 | apoQlar GmbH | Method for controlling a display, computer program and mixed reality display device |
-
2021
- 2021-03-29 CN CN202110331289.5A patent/CN113129372B/zh active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103985155A (zh) * | 2014-05-14 | 2014-08-13 | 北京理工大学 | 基于映射法的散乱点云Delaunay三角剖分曲面重构方法 |
US20190340825A1 (en) * | 2016-12-26 | 2019-11-07 | Interdigital Ce Patent Holdings | Device and method for generating dynamic virtual contents in mixed reality |
CN110353806A (zh) * | 2019-06-18 | 2019-10-22 | 北京航空航天大学 | 用于微创全膝关节置换手术的增强现实导航方法及系统 |
EP3789965A1 (en) * | 2019-09-09 | 2021-03-10 | apoQlar GmbH | Method for controlling a display, computer program and mixed reality display device |
CN111680542A (zh) * | 2020-04-17 | 2020-09-18 | 东南大学 | 基于多尺度特征提取和Pointnet神经网络的钢卷点云识别与分类方法 |
CN111798475A (zh) * | 2020-05-29 | 2020-10-20 | 浙江工业大学 | 一种基于点云深度学习的室内环境3d语义地图构建方法 |
CN111753698A (zh) * | 2020-06-17 | 2020-10-09 | 东南大学 | 一种多模态三维点云分割系统和方法 |
CN111968121A (zh) * | 2020-08-03 | 2020-11-20 | 电子科技大学 | 一种基于实例嵌入与语义融合的三维点云场景分割方法 |
CN112287939A (zh) * | 2020-10-29 | 2021-01-29 | 平安科技(深圳)有限公司 | 三维点云语义分割方法、装置、设备及介质 |
Non-Patent Citations (5)
Title |
---|
QI C R: "PointNet Plus Plus: Deep llierarchical feature Learning on Point Sets in a Metric Space", 《2017 31ST ANNUAL CONFERENCE ON NEURAL LNFORMATION PROCESSING SYSTEMS(N1PS)》 * |
YU FENG: "Mesorasi: Architecture Support for Point Cloud Analytics via Delayed-Aggregation", 《2020 53RD ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE (MICRO)》 * |
任浩然: "动态多光照三维光场采集系统设计与实现", 《杭州电子科技大学学报》 * |
李林瞳: "适用宇航智能交互场景的混合现实技术研究", 《计算机测量与控制》 * |
赵中阳: "基于多尺度特征和PointNet的LiDAR点云地物分类方法", 《激光与光电子学进展》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113589929A (zh) * | 2021-07-29 | 2021-11-02 | 和舆图(北京)科技有限公司 | 一种基于HoloLens设备的空间距离测量方法及系统 |
CN113706689A (zh) * | 2021-08-04 | 2021-11-26 | 西安交通大学 | 一种基于Hololens深度数据的装配指导方法及系统 |
CN113706689B (zh) * | 2021-08-04 | 2022-12-09 | 西安交通大学 | 一种基于Hololens深度数据的装配指导方法及系统 |
CN113470095A (zh) * | 2021-09-03 | 2021-10-01 | 贝壳技术有限公司 | 室内场景重建模型的处理方法和装置 |
CN113470095B (zh) * | 2021-09-03 | 2021-11-16 | 贝壳技术有限公司 | 室内场景重建模型的处理方法和装置 |
Also Published As
Publication number | Publication date |
---|---|
CN113129372B (zh) | 2023-11-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113129372B (zh) | 基于HoloLens空间映射的三维场景语义分析方法 | |
CN105550678B (zh) | 基于全局显著边缘区域的人体动作特征提取方法 | |
CN111243093B (zh) | 三维人脸网格的生成方法、装置、设备及存储介质 | |
Liao et al. | Automatic caricature generation by analyzing facial features | |
CN113012122B (zh) | 一种类别级6d位姿与尺寸估计方法及装置 | |
JP2016218999A (ja) | ターゲット環境の画像内に表現されたオブジェクトを検出するように分類器をトレーニングする方法およびシステム | |
CN112784736B (zh) | 一种多模态特征融合的人物交互行为识别方法 | |
Li et al. | Learning to reconstruct botanical trees from single images | |
CN107944459A (zh) | 一种rgb‑d物体识别方法 | |
CN106875437A (zh) | 一种面向rgbd三维重建的关键帧提取方法 | |
CN115082254A (zh) | 一种变电站精益管控数字孪生系统 | |
CN112396655B (zh) | 一种基于点云数据的船舶目标6d位姿估计方法 | |
CN114627017B (zh) | 一种基于多层次注意力感知的点云去噪方法 | |
CN112001293A (zh) | 结合多尺度信息和编解码网络的遥感影像地物分类方法 | |
CN111080754A (zh) | 一种头部肢体特征点连线的人物动画制作方法及装置 | |
CN110717978A (zh) | 基于单张图像的三维头部重建方法 | |
CN114299339A (zh) | 一种基于区域相关性建模的三维点云模型分类方法及系统 | |
CN113144613A (zh) | 基于模型的体积云生成的方法 | |
CN117853191A (zh) | 一种基于区块链技术的商品交易信息共享方法及系统 | |
CN116935008A (zh) | 一种基于混合现实的展示交互方法和装置 | |
WO2024044078A1 (en) | Systems and methods for rigging a point cloud for animation | |
CN117218192A (zh) | 一种基于深度学习与合成数据的弱纹理物体位姿估计方法 | |
CN113255514B (zh) | 基于局部场景感知图卷积网络的行为识别方法 | |
CN113657375B (zh) | 一种基于3d点云的瓶装物体文字检测方法 | |
CN113838199B (zh) | 一种三维地形生成方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20230921 Address after: C217-2, Tsinghua University Research Institute, No. 019 Gaoxin South 7th Road, Gaoxin Community, Yuehai Street, Nanshan District, Shenzhen City, Guangdong Province, 518000 Applicant after: Shenzhen Qingyuan Cultural Technology Co.,Ltd. Address before: 518000 1002, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Applicant before: Shenzhen Wanzhida Technology Co.,Ltd. Effective date of registration: 20230921 Address after: 518000 1002, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Applicant after: Shenzhen Wanzhida Technology Co.,Ltd. Address before: 710048 Shaanxi province Xi'an Beilin District Jinhua Road No. 5 Applicant before: XI'AN University OF TECHNOLOGY |
|
GR01 | Patent grant | ||
GR01 | Patent grant |