CN116097319A - 利用空间感知的条件gan的高分辨率可控面部老化 - Google Patents

利用空间感知的条件gan的高分辨率可控面部老化 Download PDF

Info

Publication number
CN116097319A
CN116097319A CN202180046647.6A CN202180046647A CN116097319A CN 116097319 A CN116097319 A CN 116097319A CN 202180046647 A CN202180046647 A CN 202180046647A CN 116097319 A CN116097319 A CN 116097319A
Authority
CN
China
Prior art keywords
aging
computing device
image
skin
map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180046647.6A
Other languages
English (en)
Chinese (zh)
Inventor
朱利恩·戴斯伯斯
弗雷德里克·弗莱蒙特
马蒂厄·佩罗特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ba Lioulaiya
Original Assignee
Ba Lioulaiya
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from FR2009199A external-priority patent/FR3112633B1/fr
Application filed by Ba Lioulaiya filed Critical Ba Lioulaiya
Publication of CN116097319A publication Critical patent/CN116097319A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • A45D44/005—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0475—Generative networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/0895—Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/094—Adversarial learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Recommending goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/50—Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G06V10/765—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects using rules for classification or partitioning the feature space
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30088—Skin; Dermal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Databases & Information Systems (AREA)
  • Biophysics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
CN202180046647.6A 2020-06-30 2021-06-29 利用空间感知的条件gan的高分辨率可控面部老化 Pending CN116097319A (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202063046011P 2020-06-30 2020-06-30
US63/046,011 2020-06-30
FR2009199 2020-09-11
FR2009199A FR3112633B1 (fr) 2020-06-30 2020-09-11 Vieillissement du visage contrôlable à haute résolution avec des GAN conditionnels à sensibilité spatiale
PCT/EP2021/067890 WO2022002964A1 (en) 2020-06-30 2021-06-29 High-resolution controllable face aging with spatially-aware conditional gans

Publications (1)

Publication Number Publication Date
CN116097319A true CN116097319A (zh) 2023-05-09

Family

ID=76765173

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180046647.6A Pending CN116097319A (zh) 2020-06-30 2021-06-29 利用空间感知的条件gan的高分辨率可控面部老化

Country Status (6)

Country Link
US (1) US12067645B2 (https=)
EP (1) EP4150514A1 (https=)
JP (1) JP7690500B2 (https=)
KR (1) KR102824321B1 (https=)
CN (1) CN116097319A (https=)
WO (1) WO2022002964A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112287852B (zh) * 2020-11-02 2023-11-21 腾讯科技（深圳）有限公司 人脸图像的处理方法、显示方法、装置及设备
US12307616B2 (en) * 2021-09-13 2025-05-20 Disney Enterprises, Inc. Techniques for re-aging faces in images and video frames
JP7813426B2 (ja) * 2022-03-25 2026-02-13 株式会社コーセーホールディングス 情報処理装置の動作方法、情報処理装置、及びプログラム
FR3135556B1 (fr) * 2022-05-10 2025-02-14 Oreal Détection et visualisation de signes cutanés au moyen d’une carte thermique
FR3135557B1 (fr) * 2022-05-10 2024-09-27 Oreal Procédé de prédiction d’évolution temporelle de signes cutanés
KR102747570B1 (ko) * 2022-08-11 2024-12-31 박영순 사진 이미지를 자동으로 편집하는 방법 및 장치
FR3144888A1 (fr) * 2023-01-06 2024-07-12 L'oreal Procédé de modélisation et d’évaluation de l’évolution des signes de l’âge chez un utilisateur.
CN116758611B (zh) * 2023-06-12 2025-11-04 沈阳工业大学 一种人脸年龄化模拟方法
KR20250092445A (ko) 2023-12-15 2025-06-24 한국전자통신연구원 시선 방향의 제어가 가능한 얼굴 이미지 생성 방법 및 이를 위한 장치
KR102805324B1 (ko) * 2024-10-10 2025-05-13 주식회사 덱스터스튜디오 비디오 시퀀스에 대한 디에이징 항상성 유지를 위한 영상 제작 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107977629A (zh) * 2017-12-04 2018-05-01 电子科技大学 一种基于特征分离对抗网络的人脸图像衰老合成方法
US20190034581A1 (en) * 2017-07-25 2019-01-31 Insilico Medicine. Inc. Deep transcriptomic markers of human biological aging and methods of determining a biological aging clock
CN109584327A (zh) * 2018-11-08 2019-04-05 深圳市威富视界有限公司 人脸老化模拟方法、装置以及设备
CN110322394A (zh) * 2019-06-18 2019-10-11 中国科学院自动化研究所 基于属性引导的人脸年龄老化图像对抗生成方法及装置
CN110326034A (zh) * 2017-03-21 2019-10-11 宝洁公司 用于年龄外貌模拟的方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3547373A (en) 1968-05-23 1970-12-15 Eastman Kodak Co Cartridge and means for locating a cartridge on a projector or the like
US20140229239A1 (en) * 2013-02-14 2014-08-14 Bank Of America Corporation Face retirement tool
US10360494B2 (en) 2016-11-30 2019-07-23 Altumview Systems Inc. Convolutional neural network (CNN) system based on resolution-limited small-scale CNN modules
WO2018143707A1 (ko) * 2017-02-01 2018-08-09 주식회사 엘지생활건강 메이크업 평가 시스템 및 그의 동작 방법
KR102297301B1 (ko) * 2017-05-31 2021-09-06 더 프록터 앤드 갬블 캄파니 겉보기 피부 나이를 결정하기 위한 시스템 및 방법
US10943156B2 (en) * 2018-01-05 2021-03-09 L'oreal Machine-implemented facial health and beauty assistant
WO2020113326A1 (en) * 2018-12-04 2020-06-11 Jiang Ruowei Automatic image-based skin diagnostics using deep learning

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110326034A (zh) * 2017-03-21 2019-10-11 宝洁公司 用于年龄外貌模拟的方法
US20190034581A1 (en) * 2017-07-25 2019-01-31 Insilico Medicine. Inc. Deep transcriptomic markers of human biological aging and methods of determining a biological aging clock
CN107977629A (zh) * 2017-12-04 2018-05-01 电子科技大学 一种基于特征分离对抗网络的人脸图像衰老合成方法
CN109584327A (zh) * 2018-11-08 2019-04-05 深圳市威富视界有限公司 人脸老化模拟方法、装置以及设备
CN110322394A (zh) * 2019-06-18 2019-10-11 中国科学院自动化研究所 基于属性引导的人脸年龄老化图像对抗生成方法及装置

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
JULIEN DESPOIS: "AgingMapGAN (AMGAN): High-Resolution Controllable Face Aging with Spatially-Aware Conditional GANs", ARXIV.ORG, 26 August 2020 (2020-08-26), pages 1 - 16 *
PEIPEI LI: "Global and Local Consistent Age Generative Adversarial Networks", ARXIV.ORG, 25 January 2018 (2018-01-25), pages 1 - 6 *
SI LIU: "Face Aging with Contextual Generative Adversarial Nets", COMPUTER VISION AND PATTERN RECOGNITION, 1 February 2018 (2018-02-01) *

Also Published As

Publication number Publication date
US12067645B2 (en) 2024-08-20
WO2022002964A1 (en) 2022-01-06
KR20230028481A (ko) 2023-02-28
US20210407153A1 (en) 2021-12-30
JP2023531265A (ja) 2023-07-21
KR102824321B1 (ko) 2025-06-26
JP7690500B2 (ja) 2025-06-10
EP4150514A1 (en) 2023-03-22

Similar Documents

Publication Publication Date Title
JP7690500B2 (ja) 空間認識条件付きｇａｎによる高解像度で制御可能な顔のエージング
US11861936B2 (en) Face reenactment
Geng et al. 3d guided fine-grained face manipulation
JP2023531265A5 (https=)
Singh et al. Neural style transfer: A critical review
US10535163B2 (en) Avatar digitization from a single image for real-time rendering
JP7448652B2 (ja) 教師あり学習のための非ペアデータを使用する画像から画像への変換
CN116848560B (zh) 经由模型估计的类嵌入应用连续效果
JP2023531264A (ja) 改善された顔属性分類およびその使用のためのシステム及び方法
JP2024500896A (ja) ３ｄ頭部変形モデルを生成するための方法、システム及び方法
JP2024503794A (ja) ２次元（２ｄ）顔画像から色を抽出するための方法、システム及びコンピュータプログラム
WO2019050808A1 (en) SCANNING AVATAR FROM A SINGLE IMAGE FOR REAL TIME REALIZATION
US20220207790A1 (en) Image generation method and apparatus, and computer
Despois et al. AgingMapGAN (AMGAN): High-resolution controllable face aging with spatially-aware conditional GANs
US12586272B2 (en) Methods and systems for transferring hair characteristics from a reference image to a digital image
Geng et al. Towards photo-realistic facial expression manipulation
US20230401632A1 (en) Methods and Systems for Initiating a Virtual Try-On Application Running on a Computer System and Providing Interactive Augmented Reality (AR) Graphics
KR20250029197A (ko) Gan 공간의 제어 가능한 방향을 결정하고 사용하기 위한 방법 및 장치
US12586157B2 (en) Methods and systems for modifying hair characteristics in a digital image
Šoberl Mixed reality and deep learning: Augmenting visual information using generative adversarial networks
FR3112633A1 (fr) Vieillissement du visage contrôlable à haute résolution avec des GAN conditionnels à sensibilité spatiale
WO2010010342A1 (en) A system and method for facial recognition
CN120707701B (zh) 一种根据产品信息自动匹配场景的方法及系统
US20250299377A1 (en) System and Method for Generating Two-Dimensional (2D) Image of an Object in a Scene
Lahari et al. Enhancing Facial Transformation Capabilities: Synthetic Child Facial Data Generation and Validation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination