WO2015185537A1 - Procédé et dispositif pour la reconstruction du visage d'un utilisateur portant un visiocasque - Google Patents
Procédé et dispositif pour la reconstruction du visage d'un utilisateur portant un visiocasque Download PDFInfo
- Publication number
- WO2015185537A1 WO2015185537A1 PCT/EP2015/062229 EP2015062229W WO2015185537A1 WO 2015185537 A1 WO2015185537 A1 WO 2015185537A1 EP 2015062229 W EP2015062229 W EP 2015062229W WO 2015185537 A1 WO2015185537 A1 WO 2015185537A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- face
- image
- user
- hmd
- mounted display
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000015654 memory Effects 0.000 description 9
- 238000004422 calculation algorithm Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 238000010422 painting Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 241000519995 Stachys sylvatica Species 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 238000012417 linear regression Methods 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000007591 painting process Methods 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 229920001690 polydopamine Polymers 0.000 description 2
- 230000003997 social interaction Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000013517 stratification Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000032258 transport Effects 0.000 description 1
Classifications
-
- G06T5/77—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Abstract
L'invention concerne un procédé de reconstruction du visage d'un utilisateur portant un visiocasque dans au moins une image comprenant le visage de l'utilisateur acquise à l'aide d'un appareil photographique. Le procédé consiste en la détermination de premières informations représentatives d'une pose du visage (201) et en le remplacement (42) d'au moins une partie du visage (201) de l'utilisateur avec au moins une partie (220) d'une deuxième image représentant le visage de l'utilisateur, le remplacement (42) utilisant lesdites informations représentatives de l'orientation et de la position du visage (201), sur des informations représentatives des dimensions du visiocasque (202) et sur des informations représentatives d'un emplacement du visiocasque (202) fournies par au moins un capteur inertiel du visiocasque (202).
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP14305841.0 | 2014-06-03 | ||
| EP14305842 | 2014-06-03 | ||
| EP14305841 | 2014-06-03 | ||
| EP14305842.8 | 2014-06-03 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015185537A1 true WO2015185537A1 (fr) | 2015-12-10 |
Family
ID=53267396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2015/062229 WO2015185537A1 (fr) | 2014-06-03 | 2015-06-02 | Procédé et dispositif pour la reconstruction du visage d'un utilisateur portant un visiocasque |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2015185537A1 (fr) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180101227A1 (en) * | 2016-10-06 | 2018-04-12 | Google Inc. | Headset removal in virtual, augmented, and mixed reality using an eye gaze database |
| CN109478344A (zh) * | 2016-04-22 | 2019-03-15 | 交互数字Ce专利控股公司 | 用于合成图像的方法和设备 |
| CN111936910A (zh) * | 2018-03-13 | 2020-11-13 | 罗纳德·温斯顿 | 虚拟现实系统和方法 |
| US11551427B2 (en) | 2017-08-30 | 2023-01-10 | Ronald H. Winston | System and method for rendering virtual reality interactions |
-
2015
- 2015-06-02 WO PCT/EP2015/062229 patent/WO2015185537A1/fr active Application Filing
Non-Patent Citations (9)
| Title |
|---|
| ANONYMOUS: "Positioning technology - Wikipedia, the free encyclopedia", 11 April 2013 (2013-04-11), XP055199758, Retrieved from the Internet <URL:https://en.wikipedia.org/w/index.php?title=Positioning_technology&oldid=549900889> [retrieved on 20150702] * |
| C. BAILLARD; A. ZISSERMAN: "A planesweep strategy for the 3D reconstruction of buildings from multiple images", INTERNATIONAL ARCHIVES OF PHOTOGRAMMETRY AND REMOTE SENSING, vol. 33, 2000, pages 56 - 62 |
| FANELLI ET AL.: "Real time head pose estimation with random regression forests", COMPUTER VISION AND PATTERN RECOGNITION, 2011 |
| MASAYUKI TAKEMURA ET AL: "Photometric inconsistency on a mixed-reality face", MIXED AND AUGMENTED REALITY, 2006. ISMAR 2006. IEEE/ACM INTERNATIONAL SYMPOSIUM ON, IEEE, PI, 1 October 2006 (2006-10-01), pages 129 - 138, XP031014660, ISBN: 978-1-4244-0650-0 * |
| MURPHY-CHUTORIAN E ET AL: "Head Pose Estimation in Computer Vision: A Survey", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, IEEE COMPUTER SOCIETY, USA, vol. 31, no. 4, 1 April 2009 (2009-04-01), pages 607 - 626, XP011266518, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2008.106 * |
| O. FAUGERAS; Q.T. LUONG: "The geometry of multiple images: the laws that govern the formation of multiple images of a scene and some of their applications", MIT PRESS, 2004 |
| TAKEMURA M ET AL: "Diminishing head-mounted display for shared mixed reality", PROCEEDINGS / INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED RALITY : ISMAR 2002 ; SEPTEMBER 30 - OCTOBER 1,2002, DARMSTADT, GERMANY, IEEEE COMPUTER SOCIETY, LOS ALAMITOS, CALIF. [U.A.], 30 September 2002 (2002-09-30), pages 149 - 156, XP010620951, ISBN: 978-0-7695-1781-0 * |
| X.P. BURGOS-ARTIZZU; P. PERONA; P. DOLLAR: "Robust face landmark estimation under occlusion", INTERNATIONAL CONFERENCE IN COMPUTER VISION (ICCV), IEEE, 2013 |
| Y. CHEN; G. MEDIONI: "Object modelling by registration of multiple range images", IMAGE AND VISION COMPUTING, vol. 10, no. 3, 1992, pages 145 - 155 |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109478344A (zh) * | 2016-04-22 | 2019-03-15 | 交互数字Ce专利控股公司 | 用于合成图像的方法和设备 |
| US11568606B2 (en) | 2016-04-22 | 2023-01-31 | Interdigital Ce Patent Holdings | Method and device for compositing an image |
| CN109478344B (zh) * | 2016-04-22 | 2023-05-30 | 交互数字Ce专利控股公司 | 用于合成图像的方法和设备 |
| US20180101227A1 (en) * | 2016-10-06 | 2018-04-12 | Google Inc. | Headset removal in virtual, augmented, and mixed reality using an eye gaze database |
| US10269177B2 (en) | 2016-10-06 | 2019-04-23 | Google Llc | Headset removal in virtual, augmented, and mixed reality using an eye gaze database |
| US11551427B2 (en) | 2017-08-30 | 2023-01-10 | Ronald H. Winston | System and method for rendering virtual reality interactions |
| CN111936910A (zh) * | 2018-03-13 | 2020-11-13 | 罗纳德·温斯顿 | 虚拟现实系统和方法 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11568606B2 (en) | Method and device for compositing an image | |
| US10055893B2 (en) | Method and device for rendering an image of a scene comprising a real object and a virtual replica of the real object | |
| US20180165830A1 (en) | Method and device for determining points of interest in an immersive content | |
| US20180144212A1 (en) | Method and device for generating an image representative of a cluster of images | |
| US11812066B2 (en) | Methods, devices and stream to encode global rotation motion compensated images | |
| WO2015185537A1 (fr) | Procédé et dispositif pour la reconstruction du visage d'un utilisateur portant un visiocasque | |
| EP3236423A1 (fr) | Procédé et dispositif pour composer une image | |
| WO2018069215A1 (fr) | Procédé, appareil et flux permettant de coder une transparence et des informations d'ombre d'un format vidéo immersif | |
| WO2018086960A1 (fr) | Procédé et dispositif de transmission de données représentant une image | |
| EP3716217A1 (fr) | Techniques pour la détection d'une occlusion en temps réel | |
| EP3310057A1 (fr) | Procédé, appareil et flux permettant de coder des informations d'ombrage et de transparence pour un format vidéo immersif | |
| EP3310053A1 (fr) | Procédé et appareil permettant de coder des informations de transparence pour un format vidéo immersif | |
| WO2020012071A1 (fr) | Procédé, appareil et produit programme informatique pour codage de vidéo volumétrique | |
| EP3310052A1 (fr) | Procédé, appareil et flux de format vidéo immersif | |
| EP3330839A1 (fr) | Procédé et dispositif permettant d'adapter un contenu immersif au champ de vision d'un utilisateur |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15724730 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 15724730 Country of ref document: EP Kind code of ref document: A1 |