CN117916773A - 用于在移动设备中同时重建姿态和参数化3d人体模型的方法和系统 - Google Patents
用于在移动设备中同时重建姿态和参数化3d人体模型的方法和系统 Download PDFInfo
- Publication number
- CN117916773A CN117916773A CN202180101541.1A CN202180101541A CN117916773A CN 117916773 A CN117916773 A CN 117916773A CN 202180101541 A CN202180101541 A CN 202180101541A CN 117916773 A CN117916773 A CN 117916773A
- Authority
- CN
- China
- Prior art keywords
- image
- neural network
- mannequin
- person
- parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 80
- 238000013528 artificial neural network Methods 0.000 claims abstract description 95
- 238000013527 convolutional neural network Methods 0.000 claims abstract description 64
- 238000009877 rendering Methods 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims description 117
- 238000012549 training Methods 0.000 claims description 85
- 238000012360 testing method Methods 0.000 claims description 51
- 230000000306 recurrent effect Effects 0.000 claims description 47
- 230000015654 memory Effects 0.000 claims description 30
- 230000006870 function Effects 0.000 claims description 25
- 230000033001 locomotion Effects 0.000 claims description 13
- 230000036541 health Effects 0.000 claims description 9
- 230000003190 augmentative effect Effects 0.000 claims description 8
- 230000006399 behavior Effects 0.000 claims description 5
- 230000000694 effects Effects 0.000 claims description 4
- 239000000284 extract Substances 0.000 abstract description 3
- 239000010410 layer Substances 0.000 description 57
- 230000008569 process Effects 0.000 description 33
- 239000011521 glass Substances 0.000 description 24
- 238000001514 detection method Methods 0.000 description 22
- 238000004891 communication Methods 0.000 description 17
- 238000007781 pre-processing Methods 0.000 description 10
- 210000000746 body region Anatomy 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 210000001503 joint Anatomy 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 238000013135 deep learning Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 101000872559 Hediste diversicolor Hemerythrin Proteins 0.000 description 4
- 230000004913 activation Effects 0.000 description 4
- 239000003086 colorant Substances 0.000 description 4
- 101000742346 Crotalus durissus collilineatus Zinc metalloproteinase/disintegrin Proteins 0.000 description 3
- 210000004394 hip joint Anatomy 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000001537 neural effect Effects 0.000 description 3
- 238000012805 post-processing Methods 0.000 description 3
- 230000002829 reductive effect Effects 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 241000207875 Antirrhinum Species 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000000354 decomposition reaction Methods 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000000670 limiting effect Effects 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000011176 pooling Methods 0.000 description 2
- 239000000047 product Substances 0.000 description 2
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 description 1
- 101001018292 Protopolybia exigua Mastoparan-2 Proteins 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000037237 body shape Effects 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000011109 contamination Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/US2021/047793 WO2023027712A1 (fr) | 2021-08-26 | 2021-08-26 | Procédés et systèmes permettant de reconstruire simultanément une pose et des modèles humains 3d paramétriques dans des dispositifs mobiles |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117916773A true CN117916773A (zh) | 2024-04-19 |
Family
ID=85323111
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202180101541.1A Pending CN117916773A (zh) | 2021-08-26 | 2021-08-26 | 用于在移动设备中同时重建姿态和参数化3d人体模型的方法和系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117916773A (fr) |
| WO (1) | WO2023027712A1 (fr) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116758124B (zh) * | 2023-06-16 | 2024-09-24 | 北京代码空间科技有限公司 | 一种3d模型修正方法及终端设备 |
| CN117974904B (zh) * | 2024-02-27 | 2024-08-23 | 北京数原数字化城市研究中心 | 三维重建模型生成方法、三维重建方法、装置及相关设备 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9070182B1 (en) * | 2010-07-13 | 2015-06-30 | Google Inc. | Method and system for automatically cropping images |
| US9177410B2 (en) * | 2013-08-09 | 2015-11-03 | Ayla Mandel | System and method for creating avatars or animated sequences using human body features extracted from a still image |
| CN106104633A (zh) * | 2014-03-19 | 2016-11-09 | 英特尔公司 | 面部表情和/或交互驱动的化身装置和方法 |
| US10796480B2 (en) * | 2015-08-14 | 2020-10-06 | Metail Limited | Methods of generating personalized 3D head models or 3D body models |
-
2021
- 2021-08-26 WO PCT/US2021/047793 patent/WO2023027712A1/fr active Application Filing
- 2021-08-26 CN CN202180101541.1A patent/CN117916773A/zh active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023027712A1 (fr) | 2023-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11644890B2 (en) | Image capturing in extended reality environments | |
| US11132845B2 (en) | Real-world object recognition for computing device | |
| CN112639846A (zh) | 一种训练深度学习模型的方法和装置 | |
| CN111046734A (zh) | 基于膨胀卷积的多模态融合视线估计方法 | |
| CN114120432A (zh) | 基于视线估计的在线学习注意力跟踪方法及其应用 | |
| WO2023101679A1 (fr) | Récupération inter-modale d'image de texte sur la base d'une expansion de mots virtuels | |
| CN116391209A (zh) | 现实的音频驱动的3d化身生成 | |
| CN117916773A (zh) | 用于在移动设备中同时重建姿态和参数化3d人体模型的方法和系统 | |
| US11734888B2 (en) | Real-time 3D facial animation from binocular video | |
| WO2022052782A1 (fr) | Procédé de traitement d'image et dispositif associé | |
| WO2021035071A1 (fr) | Systèmes et procédés de simulation de données de sensation et de création de perceptions | |
| US20240153184A1 (en) | Real-time hand-held markerless human motion recording and avatar rendering in a mobile platform | |
| CN115008454A (zh) | 一种基于多帧伪标签数据增强的机器人在线手眼标定方法 | |
| CN116185182B (zh) | 一种融合眼动注意力的可控图像描述生成系统及方法 | |
| WO2023086398A1 (fr) | Réseaux de rendu 3d basés sur des champs de radiance neurale de réfraction | |
| US20230093827A1 (en) | Image processing framework for performing object depth estimation | |
| WO2023250223A1 (fr) | Modèles morphables tridimensionnels dépendant de la vue | |
| CN116977506A (zh) | 模型动作重定向的方法、装置、电子设备及存储介质 | |
| WO2023277877A1 (fr) | Détection et reconstruction de plan sémantique 3d | |
| CN115482481A (zh) | 单视角三维人体骨骼关键点检测方法、装置、设备及介质 | |
| CN111360819B (zh) | 机器人的控制方法及装置、计算机设备、存储介质 | |
| WO2023091131A1 (fr) | Procédés et systèmes pour récupérer des images sur la base de caractéristiques de plan sémantique | |
| WO2023069086A1 (fr) | Système et procédé de ré-éclairage de portrait dynamique | |
| CN117813626A (zh) | 从多视图立体（mvs）图像重建深度信息 | |
| US20240135581A1 (en) | Three dimensional hand pose estimator |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |