KR102334279B1 - 얼굴 특징점 위치결정 방법 및 장치 - Google Patents

얼굴 특징점 위치결정 방법 및 장치 Download PDF

Info

Publication number
KR102334279B1
KR102334279B1 KR1020197037564A KR20197037564A KR102334279B1 KR 102334279 B1 KR102334279 B1 KR 102334279B1 KR 1020197037564 A KR1020197037564 A KR 1020197037564A KR 20197037564 A KR20197037564 A KR 20197037564A KR 102334279 B1 KR102334279 B1 KR 102334279B1
Authority
KR
South Korea
Prior art keywords
image
fusion
facial feature
facial
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020197037564A
Other languages
English (en)
Korean (ko)
Other versions
KR20200010397A (ko
Inventor
첸 퀴안
웬얀 우
Original Assignee
베이징 센스타임 테크놀로지 디벨롭먼트 컴퍼니 리미티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 베이징 센스타임 테크놀로지 디벨롭먼트 컴퍼니 리미티드 filed Critical 베이징 센스타임 테크놀로지 디벨롭먼트 컴퍼니 리미티드
Publication of KR20200010397A publication Critical patent/KR20200010397A/ko
Application granted granted Critical
Publication of KR102334279B1 publication Critical patent/KR102334279B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G06K9/00228—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/251—Fusion techniques of input or preprocessed data
    • G06K9/00281—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/803—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of input or preprocessed data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
KR1020197037564A 2018-04-24 2018-11-21 얼굴 특징점 위치결정 방법 및 장치 Active KR102334279B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201810373871.6A CN108596093B (zh) 2018-04-24 2018-04-24 人脸特征点的定位方法及装置
CN201810373871.6 2018-04-24
PCT/CN2018/116779 WO2019205605A1 (zh) 2018-04-24 2018-11-21 人脸特征点的定位方法及装置

Publications (2)

Publication Number Publication Date
KR20200010397A KR20200010397A (ko) 2020-01-30
KR102334279B1 true KR102334279B1 (ko) 2021-12-02

Family

ID=63614398

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020197037564A Active KR102334279B1 (ko) 2018-04-24 2018-11-21 얼굴 특징점 위치결정 방법 및 장치

Country Status (7)

Country Link
US (1) US11314965B2 (enExample)
JP (1) JP7042849B2 (enExample)
KR (1) KR102334279B1 (enExample)
CN (1) CN108596093B (enExample)
MY (1) MY201922A (enExample)
SG (1) SG11201912428TA (enExample)
WO (1) WO2019205605A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108596093B (zh) 2018-04-24 2021-12-03 北京市商汤科技开发有限公司 人脸特征点的定位方法及装置
CN109285182A (zh) * 2018-09-29 2019-01-29 北京三快在线科技有限公司 模型生成方法、装置、电子设备和计算机可读存储介质
CN109522910B (zh) * 2018-12-25 2020-12-11 浙江商汤科技开发有限公司 关键点检测方法及装置、电子设备和存储介质
CN109461188B (zh) * 2019-01-30 2019-04-26 南京邮电大学 一种二维x射线头影测量图像解剖特征点自动定位方法
CN111553865B (zh) * 2020-04-30 2023-08-22 深圳市商汤科技有限公司 图像修复方法及装置、电子设备和存储介质
CN112836654B (zh) * 2021-02-07 2024-06-07 上海卓繁信息技术股份有限公司 一种基于融合的表情识别方法、装置和电子设备
US20230353885A1 (en) * 2022-04-27 2023-11-02 Sonic Star Global Limited Image processing system and method for processing images
CN115564837B (zh) * 2022-11-17 2023-04-18 歌尔股份有限公司 一种视觉定位方法、装置和系统
CN119028369B (zh) * 2024-07-30 2025-06-17 浙江大学金华研究院 基于音频驱动的人脸对话生成模型的人脸视频生成方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006011978A (ja) * 2004-06-28 2006-01-12 Canon Inc 画像処理方法、画像処理装置
KR101785661B1 (ko) * 2016-12-06 2017-10-17 인천대학교 산학협력단 회색 값 분산을 이용한 얼굴 윤곽 인식방법 및 그 장치

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8620038B2 (en) * 2006-05-05 2013-12-31 Parham Aarabi Method, system and computer program product for automatic and semi-automatic modification of digital images of faces
JP4811259B2 (ja) 2006-12-11 2011-11-09 日産自動車株式会社 視線方向推定装置及び視線方向推定方法
JP5202037B2 (ja) 2008-02-29 2013-06-05 キヤノン株式会社 特徴点位置決定方法及び装置
JP5153434B2 (ja) 2008-04-22 2013-02-27 キヤノン株式会社 情報処理装置及び情報処理方法
CN103679158B (zh) * 2013-12-31 2017-06-16 北京天诚盛业科技有限公司 人脸认证方法和装置
CN106156692B (zh) 2015-03-25 2019-12-13 阿里巴巴集团控股有限公司 一种用于人脸边缘特征点定位的方法及装置
US10198624B2 (en) * 2016-02-18 2019-02-05 Pinscreen, Inc. Segmentation-guided real-time facial performance capture
WO2018144537A1 (en) * 2017-01-31 2018-08-09 The Regents Of The University Of California Machine learning based driver assistance
CN106951840A (zh) * 2017-03-09 2017-07-14 北京工业大学 一种人脸特征点检测方法
CN107832741A (zh) * 2017-11-28 2018-03-23 北京小米移动软件有限公司 人脸特征点定位的方法、装置及计算机可读存储介质
CN108596093B (zh) * 2018-04-24 2021-12-03 北京市商汤科技开发有限公司 人脸特征点的定位方法及装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006011978A (ja) * 2004-06-28 2006-01-12 Canon Inc 画像処理方法、画像処理装置
KR101785661B1 (ko) * 2016-12-06 2017-10-17 인천대학교 산학협력단 회색 값 분산을 이용한 얼굴 윤곽 인식방법 및 그 장치

Also Published As

Publication number Publication date
JP7042849B2 (ja) 2022-03-28
CN108596093A (zh) 2018-09-28
MY201922A (en) 2024-03-23
JP2020523694A (ja) 2020-08-06
SG11201912428TA (en) 2020-01-30
KR20200010397A (ko) 2020-01-30
US20200125833A1 (en) 2020-04-23
US11314965B2 (en) 2022-04-26
WO2019205605A1 (zh) 2019-10-31
CN108596093B (zh) 2021-12-03

Similar Documents

Publication Publication Date Title
KR102334279B1 (ko) 얼굴 특징점 위치결정 방법 및 장치
US12211315B2 (en) Human face and hand association detecting method and a device, and storage medium
KR102442485B1 (ko) 이미지 처리 방법 및 장치, 전자 기기 및 컴퓨터 판독 가능한 저장 매체
JP7262659B2 (ja) 目標対象物マッチング方法及び装置、電子機器並びに記憶媒体
CN109257645B (zh) 视频封面生成方法及装置
CN107692997B (zh) 心率检测方法及装置
CN110555794B (zh) 图像处理方法及装置、电子设备和存储介质
CN111243011A (zh) 关键点检测方法及装置、电子设备和存储介质
JP7316456B2 (ja) 点群マップ構築方法及びその装置、電子機器、記憶媒体並びにプログラム
CN110933488A (zh) 视频剪辑方法及装置
CN108881952B (zh) 视频生成方法及装置、电子设备和存储介质
CN110929616B (zh) 一种人手识别方法、装置、电子设备和存储介质
CN111476057B (zh) 车道线获取方法及装置、车辆驾驶方法及装置
CN108900903B (zh) 视频处理方法及装置、电子设备和存储介质
CN109472738B (zh) 图像光照校正方法及装置、电子设备和存储介质
KR102324001B1 (ko) 위치자세 검출 방법 및 장치, 전자 기기 및 저장 매체
CN106875446B (zh) 相机重定位方法及装置
CN111753596B (zh) 神经网络的训练方法及装置、电子设备和存储介质
WO2021073204A1 (zh) 对象的显示方法、装置、电子设备及计算机可读存储介质
KR20210157470A (ko) 자세 검출 및 비디오 처리 방법, 장치, 전자 기기 및 저장 매체
CN114638817B (zh) 一种图像分割方法及装置、电子设备和存储介质
CN110969569A (zh) 试镜视频的生成方法及装置
CN114549983A (zh) 计算机视觉模型训练方法及装置、电子设备和存储介质
CN109543544B (zh) 跨光谱图像匹配方法及装置、电子设备和存储介质
KR102374400B1 (ko) 이미지 처리 방법 및 장치, 전자 기기와 저장 매체

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

Patent event date: 20191219

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20210326

Patent event code: PE09021S01D

E601 Decision to refuse application
PE0601 Decision on rejection of patent

Patent event date: 20210923

Comment text: Decision to Refuse Application

Patent event code: PE06012S01D

Patent event date: 20210326

Comment text: Notification of reason for refusal

Patent event code: PE06011S01I

AMND Amendment
PX0901 Re-examination

Patent event code: PX09011S01I

Patent event date: 20210923

Comment text: Decision to Refuse Application

PX0701 Decision of registration after re-examination

Patent event date: 20211119

Comment text: Decision to Grant Registration

Patent event code: PX07013S01D

Patent event date: 20211019

Comment text: Amendment to Specification, etc.

Patent event code: PX07012R01I

Patent event date: 20210923

Comment text: Decision to Refuse Application

Patent event code: PX07011S01I

X701 Decision to grant (after re-examination)
GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20211129

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20211130

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20241031

Start annual number: 4

End annual number: 4