KR20230025906A - 개선된 얼굴 속성 분류 및 그것의 사용을 위한 시스템들 및 방법들 - Google Patents

개선된 얼굴 속성 분류 및 그것의 사용을 위한 시스템들 및 방법들 Download PDF

Info

Publication number
KR20230025906A
KR20230025906A KR1020237002610A KR20237002610A KR20230025906A KR 20230025906 A KR20230025906 A KR 20230025906A KR 1020237002610 A KR1020237002610 A KR 1020237002610A KR 20237002610 A KR20237002610 A KR 20237002610A KR 20230025906 A KR20230025906 A KR 20230025906A
Authority
KR
South Korea
Prior art keywords
facial
attributes
attribute
face
individual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020237002610A
Other languages
English (en)
Korean (ko)
Inventor
파르햄 아아라비
프레데릭 앙트와냉 레이몽 세르쥬 플라망
제프리 호턴
루오웨이 지앙
위쩌 장
즈 위
Original Assignee
로레알
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from FR2010128A external-priority patent/FR3114895B1/fr
Application filed by 로레알 filed Critical 로레알
Publication of KR20230025906A publication Critical patent/KR20230025906A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Recommending goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Business, Economics & Management (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Image Analysis (AREA)
KR1020237002610A 2020-06-29 2021-06-29 개선된 얼굴 속성 분류 및 그것의 사용을 위한 시스템들 및 방법들 Pending KR20230025906A (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202063045303P 2020-06-29 2020-06-29
US63/045,303 2020-06-29
FRFR2010128 2020-10-05
FR2010128A FR3114895B1 (fr) 2020-10-05 2020-10-05 Systèmes et procédés pour une classification améliorée des attributs faciaux et leurs applications
PCT/EP2021/067883 WO2022002961A1 (en) 2020-06-29 2021-06-29 Systems and methods for improved facial attribute classification and use thereof

Publications (1)

Publication Number Publication Date
KR20230025906A true KR20230025906A (ko) 2023-02-23

Family

ID=76765172

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020237002610A Pending KR20230025906A (ko) 2020-06-29 2021-06-29 개선된 얼굴 속성 분류 및 그것의 사용을 위한 시스템들 및 방법들

Country Status (6)

Country Link
US (2) US11978242B2 (https=)
EP (1) EP4150513A1 (https=)
JP (1) JP2023531264A (https=)
KR (1) KR20230025906A (https=)
CN (1) CN116097320A (https=)
WO (1) WO2022002961A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102602659B1 (ko) * 2023-05-26 2023-11-15 주식회사 손손컴퍼니 증강현실에 기초한 핏팅 시스템

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116097320A (zh) * 2020-06-29 2023-05-09 巴黎欧莱雅 用于改进的面部属性分类的系统和方法及其用途
EP4179476A4 (en) * 2020-07-09 2024-12-04 Wyze Labs, Inc. DATASET-COMPATIBLE AND INVARIANT LEARNING FOR FACIAL RECOGNITION
CN112200626A (zh) * 2020-09-30 2021-01-08 京东方科技集团股份有限公司 确定推荐产品的方法和装置、电子设备、计算机可读介质
JP7779760B2 (ja) * 2022-02-18 2025-12-03 Ｌｉｎｅヤフー株式会社 情報提供装置、情報提供方法および情報提供プログラム
CN114663552B (zh) * 2022-05-25 2022-08-16 武汉纺织大学 一种基于2d图像的虚拟试衣方法
CN115410250B (zh) * 2022-08-01 2026-02-13 五邑大学 阵列式人脸美丽预测方法、设备及存储介质
FR3145227B1 (fr) * 2023-01-19 2025-12-05 Oreal SYSTÈME, APPAREIL ET PROCÉDÉ DE diagnostic de boucle
WO2024073041A1 (en) * 2022-09-30 2024-04-04 L'oreal Curl diagnosis system, apparatus, and method
FR3145228B1 (fr) * 2023-01-19 2025-10-31 Oreal Système, appareil et procédé d’appréciation et de personnalisation de cheveux bouclés
FR3145226A1 (fr) * 2023-01-19 2024-07-26 L'oreal Systèmes, dispositif et procédés collaboratifs pour la caractérisation des cheveux bouclés
JP2024069041A (ja) * 2022-11-09 2024-05-21 キヤノン株式会社 画像処理装置、画像処理方法、及びコンピュータプログラム
CN115909470B (zh) * 2022-11-24 2023-07-07 浙江大学 基于深度学习的全自动眼睑疾病术后外观预测系统和方法
US12394098B2 (en) 2023-01-13 2025-08-19 L'oreal Multi-camera video capture for accurate skin tone measurement
FR3147890B1 (fr) * 2023-04-17 2025-04-18 Oreal Capture vidéo multi-caméras pour une mesure précise de carnation
WO2024151984A1 (en) * 2023-01-13 2024-07-18 L'oreal Multi-camera video capture for accurate skin tone measurement
WO2025120099A1 (en) * 2023-12-07 2025-06-12 L'oréal Hair color classification using consistency regularization and annotation confusion matrices and hair color simulation using a hair color classification guided network
US20250191338A1 (en) * 2023-12-07 2025-06-12 L'oreal Hair color classification using consistency regularization and annotation confusion matrices
US20250191248A1 (en) * 2023-12-07 2025-06-12 L'oreal Hair color simulation using a hair color classification guided network
US20250239026A1 (en) * 2024-01-23 2025-07-24 L'oreal Method and system for 3d hair virtual try on
US12586412B2 (en) * 2024-04-10 2026-03-24 Lashify, Inc. Using two-dimensional images and machine learning to identify information pertaining to eye shape
WO2025216339A1 (ko) * 2024-04-11 2025-10-16 주식회사 엔씨소프트 언어 중심 모델에 기반한 얼굴 속성 인식을 위한 전자 장치, 방법, 및 비-일시적 컴퓨터 판독 가능 저장 매체

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030065255A1 (en) * 2001-10-01 2003-04-03 Daniela Giacchetti Simulation of an aesthetic feature on a facial image
JP4315234B2 (ja) * 2008-08-15 2009-08-19 ソニー株式会社 撮像装置および表情評価装置
JP5304294B2 (ja) * 2009-02-10 2013-10-02 株式会社ニコン 電子スチルカメラ
EP2462535A2 (fr) * 2009-08-04 2012-06-13 Vesalis Procédé de traitement d'image pour corriger une image cible en fonction d'une image de reference et dispositif de traitement d'image correspondant
US8638993B2 (en) * 2010-04-05 2014-01-28 Flashfoto, Inc. Segmenting human hairs and faces
US8879804B1 (en) * 2010-12-18 2014-11-04 Alexey Konoplev System and method for automatic detection and recognition of facial features
US8908904B2 (en) * 2011-12-28 2014-12-09 Samsung Electrônica da Amazônia Ltda. Method and system for make-up simulation on portable devices having digital cameras
JP2014149678A (ja) * 2013-02-01 2014-08-21 Panasonic Corp 美容支援装置、美容支援システム、美容支援方法、並びに美容支援プログラム
JP6397250B2 (ja) * 2014-07-30 2018-09-26 Kddi株式会社 集中度推定装置、方法及びプログラム
US9349178B1 (en) 2014-11-24 2016-05-24 Siemens Aktiengesellschaft Synthetic data-driven hemodynamic determination in medical imaging
CN105678561B (zh) * 2016-01-29 2020-04-03 京东方科技集团股份有限公司 智能梳妆台及相应的云专家系统
JP2018124604A (ja) * 2017-01-30 2018-08-09 グローリー株式会社 接客支援システム、接客支援装置及び接客支援方法
US10529115B2 (en) * 2017-03-20 2020-01-07 Google Llc Generating cartoon images from photos
WO2019183758A1 (en) * 2018-03-26 2019-10-03 Intel Corporation Methods and apparatus for multi-task recognition using neural networks
CN108765268A (zh) * 2018-05-28 2018-11-06 京东方科技集团股份有限公司 一种辅助化妆方法、装置及智能镜
US11882918B2 (en) * 2018-05-28 2024-01-30 Boe Technology Group Co., Ltd. Make-up assistance method and apparatus and smart mirror
US11222196B2 (en) * 2018-07-11 2022-01-11 Samsung Electronics Co., Ltd. Simultaneous recognition of facial attributes and identity in organizing photo albums
EP3628187A1 (en) * 2018-09-26 2020-04-01 Chanel Parfums Beauté Method for simulating the rendering of a make-up product on a body area
EP3664035B1 (en) * 2018-12-03 2021-03-03 Chanel Parfums Beauté Method for simulating the realistic rendering of a makeup product
KR102653079B1 (ko) * 2019-04-23 2024-04-01 더 프록터 앤드 갬블 캄파니 미용 피부 속성을 측정하기 위한 장치 및 방법
US11348334B1 (en) * 2019-06-30 2022-05-31 George Douglas MacEwen Methods and systems for skin color matching using an imaging device and a controlled light source
JP6651085B1 (ja) * 2019-07-03 2020-02-19 Ａｗｌ株式会社 属性認識システム、学習サーバ、及び属性認識プログラム
US11039676B2 (en) * 2019-07-21 2021-06-22 Shaobo Kuang System and method for selecting or recommending skincare, haircare, beauty or fashion products
CN110443189B (zh) * 2019-07-31 2021-08-03 厦门大学 基于多任务多标签学习卷积神经网络的人脸属性识别方法
WO2021138481A1 (en) * 2019-12-31 2021-07-08 L'oreal High-resolution and hyperspectral imaging of skin
US11227151B2 (en) * 2020-03-05 2022-01-18 King Fahd University Of Petroleum And Minerals Methods and systems for computerized recognition of hand gestures
CN113496459A (zh) * 2020-04-01 2021-10-12 华为技术有限公司 辅助化妆方法、终端设备、存储介质及程序产品
US12333855B1 (en) * 2020-06-11 2025-06-17 Eyevious Style Incorporated Automated system for generating personalized eyewear recommendations based on fit and style within a purchasing system
TWI762958B (zh) * 2020-06-22 2022-05-01 威聯通科技股份有限公司 收集臉部辨識資料的方法及系統
CN116097320A (zh) * 2020-06-29 2023-05-09 巴黎欧莱雅 用于改进的面部属性分类的系统和方法及其用途
US11461946B2 (en) * 2020-12-30 2022-10-04 L'oreal Digital makeup artist
US11657553B2 (en) * 2020-12-30 2023-05-23 L'oreal Digital makeup artist
JP7488223B2 (ja) * 2021-05-27 2024-05-21 株式会社アシックス 着装シミュレーション装置
WO2024141513A1 (en) * 2022-12-28 2024-07-04 L'oréal Makeup virtual try on methods and apparatus
US20240265433A1 (en) * 2023-02-02 2024-08-08 Modaviti Emarketing Private Limited Interactive system and method for recommending one or more lifestyle products

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102602659B1 (ko) * 2023-05-26 2023-11-15 주식회사 손손컴퍼니 증강현실에 기초한 핏팅 시스템

Also Published As

Publication number Publication date
EP4150513A1 (en) 2023-03-22
CN116097320A (zh) 2023-05-09
US20240249504A1 (en) 2024-07-25
US11978242B2 (en) 2024-05-07
JP2023531264A (ja) 2023-07-21
US20210406996A1 (en) 2021-12-30
WO2022002961A1 (en) 2022-01-06

Similar Documents

Publication Publication Date Title
US11978242B2 (en) Systems and methods for improved facial attribute classification and use thereof
US10489683B1 (en) Methods and systems for automatic generation of massive training data sets from 3D models for training deep learning networks
CN109310196B (zh) 化妆辅助装置以及化妆辅助方法
US8208694B2 (en) Method and system for image and video analysis, enhancement and display for communication
US9501724B1 (en) Font recognition and font similarity learning using a deep neural network
JPWO2022002961A5 (https=)
US11507781B2 (en) Methods and systems for automatic generation of massive training data sets from 3D models for training deep learning networks
CN108846792B (zh) 图像处理方法、装置、电子设备及计算机可读介质
US20110016001A1 (en) Method and apparatus for recommending beauty-related products
JP6320844B2 (ja) パーツの影響度に基づいて感情を推定する装置、プログラム及び方法
Adilova et al. Personalized Aesthetic Assessment: integrating fuzzy logic and color preferences
Suguna et al. An efficient real time product recommendation using facial sentiment analysis
Tanmay et al. Augmented reality based recommendations based on perceptual shape style compatibility with objects in the viewpoint and color compatibility with the background
Kutt et al. Evaluation of selected APIs for emotion recognition from facial expressions
CN113298593B (zh) 商品推荐及图像检测方法、装置、设备和存储介质
CN119397072A (zh) 基于多特征融合人脸识别实现个性化推荐的方法及系统
Ayush Context aware recommendations embedded in augmented viewpoint to retarget consumers in v-commerce
Liu et al. Design and implementation of hair recommendation system based on face recognition
Khan et al. Next-Generation Augmented Reality: A Deep Learning–Driven Framework for Intelligent Visual Perception and Interaction
Bar et al. A Deep Learning-Based Approach for Students' Involvement Assessment in an E-Learning Platform
Kumar et al. Smart Mirror with Deep Learning for Health Evaluation, Skincare, and Virtual Enhancement
Lee et al. Development and Evaluation of a Mobile-based Skincare Recommendation System Using Facial Analysis.
Curbelo et al. A methodology for realistic human shape reconstruction from 2D images
CN117764687B (zh) 基于人工智能和图像处理的化妆品推荐方法和系统
Daram et al. Virtual glamour: AI-enhanced makeup recommendations and trials

Legal Events

Date Code Title Description
A201 Request for examination
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

D13-X000 Search requested

St.27 status event code: A-1-2-D10-D13-srh-X000

D14-X000 Search report completed

St.27 status event code: A-1-2-D10-D14-srh-X000

D21 Rejection of application intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D21-EXM-PE0902 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P13-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000