JP7690500B2 - 空間認識条件付きganによる高解像度で制御可能な顔のエージング - Google Patents

空間認識条件付きganによる高解像度で制御可能な顔のエージング Download PDF

Info

Publication number
JP7690500B2
JP7690500B2 JP2022580297A JP2022580297A JP7690500B2 JP 7690500 B2 JP7690500 B2 JP 7690500B2 JP 2022580297 A JP2022580297 A JP 2022580297A JP 2022580297 A JP2022580297 A JP 2022580297A JP 7690500 B2 JP7690500 B2 JP 7690500B2
Authority
JP
Japan
Prior art keywords
aging
image
computing device
skin
map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022580297A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023531265A (ja
JP2023531265A5 (https=
Inventor
デスポア・ジュリアン
フラマン・フレデリック
ペロット・マシュー
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LOreal SA
Original Assignee
LOreal SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from FR2009199A external-priority patent/FR3112633B1/fr
Application filed by LOreal SA filed Critical LOreal SA
Publication of JP2023531265A publication Critical patent/JP2023531265A/ja
Publication of JP2023531265A5 publication Critical patent/JP2023531265A5/ja
Application granted granted Critical
Publication of JP7690500B2 publication Critical patent/JP7690500B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00Two-dimensional [2D] image generation
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • A45D44/005Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • G06N3/0455Auto-encoder networks; Encoder-decoder networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0475Generative networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/088Non-supervised learning, e.g. competitive learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/0895Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/094Adversarial learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0631Recommending goods or services
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G06V10/765Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects using rules for classification or partitioning the feature space
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30088Skin; Dermal
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Databases & Information Systems (AREA)
  • Biophysics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
JP2022580297A 2020-06-30 2021-06-29 空間認識条件付きganによる高解像度で制御可能な顔のエージング Active JP7690500B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202063046011P 2020-06-30 2020-06-30
US63/046,011 2020-06-30
FR2009199 2020-09-11
FR2009199A FR3112633B1 (fr) 2020-06-30 2020-09-11 Vieillissement du visage contrôlable à haute résolution avec des GAN conditionnels à sensibilité spatiale
PCT/EP2021/067890 WO2022002964A1 (en) 2020-06-30 2021-06-29 High-resolution controllable face aging with spatially-aware conditional gans

Publications (3)

Publication Number Publication Date
JP2023531265A JP2023531265A (ja) 2023-07-21
JP2023531265A5 JP2023531265A5 (https=) 2023-12-28
JP7690500B2 true JP7690500B2 (ja) 2025-06-10

Family

ID=76765173

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022580297A Active JP7690500B2 (ja) 2020-06-30 2021-06-29 空間認識条件付きganによる高解像度で制御可能な顔のエージング

Country Status (6)

Country Link
US (1) US12067645B2 (https=)
EP (1) EP4150514A1 (https=)
JP (1) JP7690500B2 (https=)
KR (1) KR102824321B1 (https=)
CN (1) CN116097319A (https=)
WO (1) WO2022002964A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112287852B (zh) * 2020-11-02 2023-11-21 腾讯科技(深圳)有限公司 人脸图像的处理方法、显示方法、装置及设备
US12307616B2 (en) * 2021-09-13 2025-05-20 Disney Enterprises, Inc. Techniques for re-aging faces in images and video frames
JP7813426B2 (ja) * 2022-03-25 2026-02-13 株式会社コーセーホールディングス 情報処理装置の動作方法、情報処理装置、及びプログラム
FR3135556B1 (fr) * 2022-05-10 2025-02-14 Oreal Détection et visualisation de signes cutanés au moyen d’une carte thermique
FR3135557B1 (fr) * 2022-05-10 2024-09-27 Oreal Procédé de prédiction d’évolution temporelle de signes cutanés
KR102747570B1 (ko) * 2022-08-11 2024-12-31 박영순 사진 이미지를 자동으로 편집하는 방법 및 장치
FR3144888A1 (fr) * 2023-01-06 2024-07-12 L'oreal Procédé de modélisation et d’évaluation de l’évolution des signes de l’âge chez un utilisateur.
CN116758611B (zh) * 2023-06-12 2025-11-04 沈阳工业大学 一种人脸年龄化模拟方法
KR20250092445A (ko) 2023-12-15 2025-06-24 한국전자통신연구원 시선 방향의 제어가 가능한 얼굴 이미지 생성 방법 및 이를 위한 장치
KR102805324B1 (ko) * 2024-10-10 2025-05-13 주식회사 덱스터스튜디오 비디오 시퀀스에 대한 디에이징 항상성 유지를 위한 영상 제작 방법

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020515952A (ja) 2017-03-21 2020-05-28 ザ プロクター アンド ギャンブル カンパニーThe Procter & Gamble Company 年齢容姿シミュレーションのための方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3547373A (en) 1968-05-23 1970-12-15 Eastman Kodak Co Cartridge and means for locating a cartridge on a projector or the like
US20140229239A1 (en) * 2013-02-14 2014-08-14 Bank Of America Corporation Face retirement tool
US10360494B2 (en) 2016-11-30 2019-07-23 Altumview Systems Inc. Convolutional neural network (CNN) system based on resolution-limited small-scale CNN modules
WO2018143707A1 (ko) * 2017-02-01 2018-08-09 주식회사 엘지생활건강 메이크업 평가 시스템 및 그의 동작 방법
KR102297301B1 (ko) * 2017-05-31 2021-09-06 더 프록터 앤드 갬블 캄파니 겉보기 피부 나이를 결정하기 위한 시스템 및 방법
US10325673B2 (en) * 2017-07-25 2019-06-18 Insilico Medicine, Inc. Deep transcriptomic markers of human biological aging and methods of determining a biological aging clock
CN107977629A (zh) * 2017-12-04 2018-05-01 电子科技大学 一种基于特征分离对抗网络的人脸图像衰老合成方法
US10943156B2 (en) * 2018-01-05 2021-03-09 L'oreal Machine-implemented facial health and beauty assistant
CN109584327B (zh) * 2018-11-08 2023-07-25 深圳市威富视界有限公司 人脸老化模拟方法、装置以及设备
WO2020113326A1 (en) * 2018-12-04 2020-06-11 Jiang Ruowei Automatic image-based skin diagnostics using deep learning
CN110322394A (zh) * 2019-06-18 2019-10-11 中国科学院自动化研究所 基于属性引导的人脸年龄老化图像对抗生成方法及装置

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020515952A (ja) 2017-03-21 2020-05-28 ザ プロクター アンド ギャンブル カンパニーThe Procter & Gamble Company 年齢容姿シミュレーションのための方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Peipei Li et al,Global and Local Consistent Age Generative Adversarial Networks,2018 24th International Conference on Pattern Recognition (ICPR),IEEE,2018年08月20日,Year: 2018,https://ieeexplore.ieee.org/document/8545119

Also Published As

Publication number Publication date
US12067645B2 (en) 2024-08-20
WO2022002964A1 (en) 2022-01-06
KR20230028481A (ko) 2023-02-28
US20210407153A1 (en) 2021-12-30
JP2023531265A (ja) 2023-07-21
KR102824321B1 (ko) 2025-06-26
CN116097319A (zh) 2023-05-09
EP4150514A1 (en) 2023-03-22

Similar Documents

Publication Publication Date Title
JP7690500B2 (ja) 空間認識条件付きganによる高解像度で制御可能な顔のエージング
JP2023531265A5 (https=)
JP7660202B2 (ja) モデル推定クラス埋め込みによる連続効果の適用
Singh et al. Neural style transfer: A critical review
JP7448652B2 (ja) 教師あり学習のための非ペアデータを使用する画像から画像への変換
Natarajan et al. Dynamic GAN for high-quality sign language video generation from skeletal poses using generative adversarial networks
US11769227B2 (en) Generating synthesized digital images utilizing a multi-resolution generator neural network
US10650283B2 (en) Electronic apparatus and control method thereof
US20180374242A1 (en) Avatar digitization from a single image for real-time rendering
JP2023531264A (ja) 改善された顔属性分類およびその使用のためのシステム及び方法
JP2024500896A (ja) 3d頭部変形モデルを生成するための方法、システム及び方法
KR20210119438A (ko) 얼굴 재연을 위한 시스템 및 방법
JP2023531264A5 (https=)
JP2024503794A (ja) 2次元(2d)顔画像から色を抽出するための方法、システム及びコンピュータプログラム
WO2019050808A1 (en) SCANNING AVATAR FROM A SINGLE IMAGE FOR REAL TIME REALIZATION
Despois et al. AgingMapGAN (AMGAN): High-resolution controllable face aging with spatially-aware conditional GANs
US11861762B2 (en) Generating synthesized digital images utilizing class-specific machine-learning models
US11074671B2 (en) Electronic apparatus and control method thereof
KR20250029197A (ko) Gan 공간의 제어 가능한 방향을 결정하고 사용하기 위한 방법 및 장치
CN119631109A (zh) 用于三维形变模型的面部纹理合成
FR3112633A1 (fr) Vieillissement du visage contrôlable à haute résolution avec des GAN conditionnels à sensibilité spatiale
Zhang et al. Monocular face reconstruction with global and local shape constraints
Lahari et al. Enhancing Facial Transformation Capabilities: Synthetic Child Facial Data Generation and Validation
KR20260064428A (ko) 생성형 ai를 이용한 가상 메이크업 솔루션 제공 시스템

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231218

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20231219

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20241016

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20241112

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250124

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250507

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250529

R150 Certificate of patent or registration of utility model

Ref document number: 7690500

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150