KR20230028481A - 공간 인식 조건부 gan들을 이용하는 고해상도 제어가능한 얼굴 노화 - Google Patents

공간 인식 조건부 gan들을 이용하는 고해상도 제어가능한 얼굴 노화 Download PDF

Info

Publication number
KR20230028481A
KR20230028481A KR1020237002611A KR20237002611A KR20230028481A KR 20230028481 A KR20230028481 A KR 20230028481A KR 1020237002611 A KR1020237002611 A KR 1020237002611A KR 20237002611 A KR20237002611 A KR 20237002611A KR 20230028481 A KR20230028481 A KR 20230028481A
Authority
KR
South Korea
Prior art keywords
aging
computing device
skin
image
generator
Prior art date
Application number
KR1020237002611A
Other languages
English (en)
Korean (ko)
Inventor
줄리앙 데스프와
프레데릭 플라망
마티유 페로
Original Assignee
로레알
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from FR2009199A external-priority patent/FR3112633B1/fr
Application filed by 로레알 filed Critical 로레알
Publication of KR20230028481A publication Critical patent/KR20230028481A/ko

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • A45D44/005Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/088Non-supervised learning, e.g. competitive learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0631Item recommendations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G06V10/765Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects using rules for classification or partitioning the feature space
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30088Skin; Dermal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
KR1020237002611A 2020-06-30 2021-06-29 공간 인식 조건부 gan들을 이용하는 고해상도 제어가능한 얼굴 노화 KR20230028481A (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202063046011P 2020-06-30 2020-06-30
US63/046,011 2020-06-30
FR2009199 2020-09-11
FR2009199A FR3112633B1 (fr) 2020-06-30 2020-09-11 Vieillissement du visage contrôlable à haute résolution avec des GAN conditionnels à sensibilité spatiale
PCT/EP2021/067890 WO2022002964A1 (en) 2020-06-30 2021-06-29 High-resolution controllable face aging with spatially-aware conditional gans

Publications (1)

Publication Number Publication Date
KR20230028481A true KR20230028481A (ko) 2023-02-28

Family

ID=76765173

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020237002611A KR20230028481A (ko) 2020-06-30 2021-06-29 공간 인식 조건부 gan들을 이용하는 고해상도 제어가능한 얼굴 노화

Country Status (6)

Country Link
US (1) US12067645B2 (zh)
EP (1) EP4150514A1 (zh)
JP (1) JP2023531265A (zh)
KR (1) KR20230028481A (zh)
CN (1) CN116097319A (zh)
WO (1) WO2022002964A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112287852B (zh) * 2020-11-02 2023-11-21 腾讯科技(深圳)有限公司 人脸图像的处理方法、显示方法、装置及设备
US20230080639A1 (en) * 2021-09-13 2023-03-16 Disney Enterprises, Inc. Techniques for re-aging faces in images and video frames
FR3135556A1 (fr) * 2022-05-10 2023-11-17 L'oreal Détection et visualisation de signes cutanés au moyen d’une carte thermique
FR3135557B1 (fr) * 2022-05-10 2024-09-27 Oreal Procédé de prédiction d’évolution temporelle de signes cutanés
KR102747570B1 (ko) * 2022-08-11 2024-12-31 박영순 사진 이미지를 자동으로 편집하는 방법 및 장치
FR3144888A1 (fr) * 2023-01-06 2024-07-12 L'oreal Procédé de modélisation et d’évaluation de l’évolution des signes de l’âge chez un utilisateur.

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3547373A (en) 1968-05-23 1970-12-15 Eastman Kodak Co Cartridge and means for locating a cartridge on a projector or the like
US20140229239A1 (en) * 2013-02-14 2014-08-14 Bank Of America Corporation Face retirement tool
US10360494B2 (en) * 2016-11-30 2019-07-23 Altumview Systems Inc. Convolutional neural network (CNN) system based on resolution-limited small-scale CNN modules
JP7020626B2 (ja) * 2017-02-01 2022-02-16 エルジー ハウスホールド アンド ヘルスケア リミテッド メイクアップ評価システム及びその動作方法
KR102297301B1 (ko) * 2017-05-31 2021-09-06 더 프록터 앤드 갬블 캄파니 겉보기 피부 나이를 결정하기 위한 시스템 및 방법
US10943156B2 (en) * 2018-01-05 2021-03-09 L'oreal Machine-implemented facial health and beauty assistant
WO2020113326A1 (en) 2018-12-04 2020-06-11 Jiang Ruowei Automatic image-based skin diagnostics using deep learning

Also Published As

Publication number Publication date
US20210407153A1 (en) 2021-12-30
US12067645B2 (en) 2024-08-20
CN116097319A (zh) 2023-05-09
EP4150514A1 (en) 2023-03-22
WO2022002964A1 (en) 2022-01-06
JP2023531265A (ja) 2023-07-21

Similar Documents

Publication Publication Date Title
US12067645B2 (en) High-resolution controllable face aging with spatially-aware conditional GANs
KR102658960B1 (ko) 얼굴 재연을 위한 시스템 및 방법
Tang et al. Attention-guided generative adversarial networks for unsupervised image-to-image translation
CN108122264B (zh) 促进草图到绘画变换
Singh et al. Neural style transfer: A critical review
JP7448652B2 (ja) 教師あり学習のための非ペアデータを使用する画像から画像への変換
US10650283B2 (en) Electronic apparatus and control method thereof
Natarajan et al. Dynamic GAN for high-quality sign language video generation from skeletal poses using generative adversarial networks
JP2023531264A (ja) 改善された顔属性分類およびその使用のためのシステム及び方法
Despois et al. AgingMapGAN (AMGAN): High-resolution controllable face aging with spatially-aware conditional GANs
CN113298226A (zh) 通过中间潜在空间控制神经网络
US11769227B2 (en) Generating synthesized digital images utilizing a multi-resolution generator neural network
US12190637B2 (en) Applying a continuous effect via model-estimated class embeddings
US11861762B2 (en) Generating synthesized digital images utilizing class-specific machine-learning models
Galteri et al. Deep 3d morphable model refinement via progressive growing of conditional generative adversarial networks
US20220207790A1 (en) Image generation method and apparatus, and computer
US11074671B2 (en) Electronic apparatus and control method thereof
Sun et al. Landmarkgan: Synthesizing faces from landmarks
Geng et al. Towards photo-realistic facial expression manipulation
JPWO2022002961A5 (zh)
JPWO2022002964A5 (zh)
JP6320844B2 (ja) パーツの影響度に基づいて感情を推定する装置、プログラム及び方法
Peruzzo et al. Interactive Neural Painting
Šoberl Mixed reality and deep learning: Augmenting visual information using generative adversarial networks
FR3112633A1 (fr) Vieillissement du visage contrôlable à haute résolution avec des GAN conditionnels à sensibilité spatiale

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20230120

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20230120

Comment text: Request for Examination of Application

PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20241015

Patent event code: PE09021S01D