KR20230028481A - 공간 인식 조건부 gan들을 이용하는 고해상도 제어가능한 얼굴 노화 - Google Patents
공간 인식 조건부 gan들을 이용하는 고해상도 제어가능한 얼굴 노화 Download PDFInfo
- Publication number
- KR20230028481A KR20230028481A KR1020237002611A KR20237002611A KR20230028481A KR 20230028481 A KR20230028481 A KR 20230028481A KR 1020237002611 A KR1020237002611 A KR 1020237002611A KR 20237002611 A KR20237002611 A KR 20237002611A KR 20230028481 A KR20230028481 A KR 20230028481A
- Authority
- KR
- South Korea
- Prior art keywords
- aging
- computing device
- skin
- image
- generator
- Prior art date
Links
- 230000032683 aging Effects 0.000 title claims abstract description 256
- 208000009119 Giant Axonal Neuropathy Diseases 0.000 title claims 4
- 201000003382 giant axonal neuropathy 1 Diseases 0.000 title claims 4
- 238000012549 training Methods 0.000 claims abstract description 64
- 238000000034 method Methods 0.000 claims abstract description 59
- 208000024891 symptom Diseases 0.000 claims abstract description 30
- 206010040954 Skin wrinkling Diseases 0.000 claims description 63
- 230000037303 wrinkles Effects 0.000 claims description 56
- 230000001815 facial effect Effects 0.000 claims description 28
- 238000012545 processing Methods 0.000 claims description 25
- 210000000887 face Anatomy 0.000 claims description 18
- 230000000694 effects Effects 0.000 claims description 17
- 210000001061 forehead Anatomy 0.000 claims description 17
- 208000031709 Skin Manifestations Diseases 0.000 claims description 15
- 230000009466 transformation Effects 0.000 claims description 12
- 230000006870 function Effects 0.000 claims description 11
- 238000004088 simulation Methods 0.000 claims description 9
- 239000002537 cosmetic Substances 0.000 claims description 8
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 claims description 7
- 230000003712 anti-aging effect Effects 0.000 claims description 7
- 238000012986 modification Methods 0.000 claims description 7
- 230000004048 modification Effects 0.000 claims description 7
- 230000007246 mechanism Effects 0.000 claims description 6
- 239000003607 modifier Substances 0.000 claims description 6
- 238000000844 transformation Methods 0.000 claims description 6
- 230000003190 augmentative effect Effects 0.000 claims description 5
- 230000008929 regeneration Effects 0.000 claims description 4
- 238000011069 regeneration method Methods 0.000 claims description 4
- 230000003716 rejuvenation Effects 0.000 claims description 4
- 238000007665 sagging Methods 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 3
- 238000013136 deep learning model Methods 0.000 claims description 2
- 206010015995 Eyelid ptosis Diseases 0.000 claims 1
- 201000003004 ptosis Diseases 0.000 claims 1
- 230000001131 transforming effect Effects 0.000 abstract description 4
- 238000013459 approach Methods 0.000 description 27
- 230000000875 corresponding effect Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 238000003491 array Methods 0.000 description 7
- 208000012641 Pigmentation disease Diseases 0.000 description 6
- 238000009826 distribution Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 238000002474 experimental method Methods 0.000 description 5
- 230000019612 pigmentation Effects 0.000 description 5
- 238000003860 storage Methods 0.000 description 5
- 230000003679 aging effect Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000003750 conditioning effect Effects 0.000 description 4
- 230000014509 gene expression Effects 0.000 description 4
- 210000004209 hair Anatomy 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008921 facial expression Effects 0.000 description 3
- 230000009759 skin aging Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010924 continuous production Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 210000004709 eyebrow Anatomy 0.000 description 2
- 238000009472 formulation Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 1
- 238000002679 ablation Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000001143 conditioned effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000002068 genetic effect Effects 0.000 description 1
- 230000002650 habitual effect Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000036571 hydration Effects 0.000 description 1
- 238000006703 hydration reaction Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 230000003472 neutralizing effect Effects 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000011158 quantitative evaluation Methods 0.000 description 1
- 238000007430 reference method Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000009758 senescence Effects 0.000 description 1
- 230000036548 skin texture Effects 0.000 description 1
- 230000036555 skin type Effects 0.000 description 1
- 230000000391 smoking effect Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000008833 sun damage Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000036962 time dependent Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D44/005—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/088—Non-supervised learning, e.g. competitive learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
- G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
- G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
- G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/50—Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
- G06V10/765—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects using rules for classification or partitioning the feature space
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30088—Skin; Dermal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Molecular Biology (AREA)
- Data Mining & Analysis (AREA)
- Biophysics (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Biodiversity & Conservation Biology (AREA)
- Human Computer Interaction (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202063046011P | 2020-06-30 | 2020-06-30 | |
US63/046,011 | 2020-06-30 | ||
FR2009199A FR3112633B1 (fr) | 2020-06-30 | 2020-09-11 | Vieillissement du visage contrôlable à haute résolution avec des GAN conditionnels à sensibilité spatiale |
FR2009199 | 2020-09-11 | ||
PCT/EP2021/067890 WO2022002964A1 (en) | 2020-06-30 | 2021-06-29 | High-resolution controllable face aging with spatially-aware conditional gans |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20230028481A true KR20230028481A (ko) | 2023-02-28 |
Family
ID=76765173
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020237002611A KR20230028481A (ko) | 2020-06-30 | 2021-06-29 | 공간 인식 조건부 gan들을 이용하는 고해상도 제어가능한 얼굴 노화 |
Country Status (6)
Country | Link |
---|---|
US (1) | US12067645B2 (zh) |
EP (1) | EP4150514A1 (zh) |
JP (1) | JP2023531265A (zh) |
KR (1) | KR20230028481A (zh) |
CN (1) | CN116097319A (zh) |
WO (1) | WO2022002964A1 (zh) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112287852B (zh) * | 2020-11-02 | 2023-11-21 | 腾讯科技(深圳)有限公司 | 人脸图像的处理方法、显示方法、装置及设备 |
FR3135557B1 (fr) * | 2022-05-10 | 2024-09-27 | Oreal | Procédé de prédiction d’évolution temporelle de signes cutanés |
FR3135556A1 (fr) * | 2022-05-10 | 2023-11-17 | L'oreal | Détection et visualisation de signes cutanés au moyen d’une carte thermique |
FR3144888A1 (fr) * | 2023-01-06 | 2024-07-12 | L'oreal | Procédé de modélisation et d’évaluation de l’évolution des signes de l’âge chez un utilisateur. |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3547373A (en) | 1968-05-23 | 1970-12-15 | Eastman Kodak Co | Cartridge and means for locating a cartridge on a projector or the like |
US20140229239A1 (en) * | 2013-02-14 | 2014-08-14 | Bank Of America Corporation | Face retirement tool |
US10360494B2 (en) * | 2016-11-30 | 2019-07-23 | Altumview Systems Inc. | Convolutional neural network (CNN) system based on resolution-limited small-scale CNN modules |
JP7020626B2 (ja) * | 2017-02-01 | 2022-02-16 | エルジー ハウスホールド アンド ヘルスケア リミテッド | メイクアップ評価システム及びその動作方法 |
WO2018222808A1 (en) * | 2017-05-31 | 2018-12-06 | The Procter & Gamble Company | Systems and methods for determining apparent skin age |
US10943156B2 (en) * | 2018-01-05 | 2021-03-09 | L'oreal | Machine-implemented facial health and beauty assistant |
CN114502061B (zh) | 2018-12-04 | 2024-05-28 | 巴黎欧莱雅 | 使用深度学习的基于图像的自动皮肤诊断 |
-
2021
- 2021-06-29 JP JP2022580297A patent/JP2023531265A/ja active Pending
- 2021-06-29 WO PCT/EP2021/067890 patent/WO2022002964A1/en unknown
- 2021-06-29 CN CN202180046647.6A patent/CN116097319A/zh active Pending
- 2021-06-29 EP EP21737441.2A patent/EP4150514A1/en active Pending
- 2021-06-29 KR KR1020237002611A patent/KR20230028481A/ko unknown
- 2021-06-30 US US17/363,098 patent/US12067645B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
EP4150514A1 (en) | 2023-03-22 |
US12067645B2 (en) | 2024-08-20 |
JP2023531265A (ja) | 2023-07-21 |
CN116097319A (zh) | 2023-05-09 |
US20210407153A1 (en) | 2021-12-30 |
WO2022002964A1 (en) | 2022-01-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Tang et al. | Attention-guided generative adversarial networks for unsupervised image-to-image translation | |
KR102658960B1 (ko) | 얼굴 재연을 위한 시스템 및 방법 | |
CN108122264B (zh) | 促进草图到绘画变换 | |
US12067645B2 (en) | High-resolution controllable face aging with spatially-aware conditional GANs | |
JP7448652B2 (ja) | 教師あり学習のための非ペアデータを使用する画像から画像への変換 | |
US10650283B2 (en) | Electronic apparatus and control method thereof | |
Singh et al. | Neural style transfer: A critical review | |
EP4293567A1 (en) | Three-dimensional face reconstruction method and apparatus, device, and storage medium | |
JP2023531264A (ja) | 改善された顔属性分類およびその使用のためのシステム及び方法 | |
Despois et al. | AgingMapGAN (AMGAN): High-resolution controllable face aging with spatially-aware conditional GANs | |
CN113298226A (zh) | 通过中间潜在空间控制神经网络 | |
US11769227B2 (en) | Generating synthesized digital images utilizing a multi-resolution generator neural network | |
US11074671B2 (en) | Electronic apparatus and control method thereof | |
Galteri et al. | Deep 3d morphable model refinement via progressive growing of conditional generative adversarial networks | |
US20220207790A1 (en) | Image generation method and apparatus, and computer | |
US11861762B2 (en) | Generating synthesized digital images utilizing class-specific machine-learning models | |
US20220198830A1 (en) | Applying a continuous effect via model-estimated class embeddings | |
Sun et al. | Landmarkgan: Synthesizing faces from landmarks | |
Geng et al. | Towards photo-realistic facial expression manipulation | |
Li et al. | Instant3d: Instant text-to-3d generation | |
JPWO2022002961A5 (zh) | ||
JP6320844B2 (ja) | パーツの影響度に基づいて感情を推定する装置、プログラム及び方法 | |
Peruzzo et al. | Interactive Neural Painting | |
JPWO2022002964A5 (zh) | ||
Šoberl | Mixed reality and deep learning: Augmenting visual information using generative adversarial networks |