JP7042849B2 - 顔特徴点の測位方法及び装置 - Google Patents

顔特徴点の測位方法及び装置 Download PDF

Info

Publication number
JP7042849B2
JP7042849B2 JP2019568632A JP2019568632A JP7042849B2 JP 7042849 B2 JP7042849 B2 JP 7042849B2 JP 2019568632 A JP2019568632 A JP 2019568632A JP 2019568632 A JP2019568632 A JP 2019568632A JP 7042849 B2 JP7042849 B2 JP 7042849B2
Authority
JP
Japan
Prior art keywords
image
fusion
face
feature line
facial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019568632A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020523694A (ja
JP2020523694A5 (enExample
Inventor
チェン チエン
ウェンイエン ウー
Original Assignee
ベイジン センスタイム テクノロジー デベロップメント カンパニー， リミテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ベイジン センスタイム テクノロジー デベロップメント カンパニー， リミテッド filed Critical ベイジン センスタイム テクノロジー デベロップメント カンパニー， リミテッド
Publication of JP2020523694A publication Critical patent/JP2020523694A/ja
Publication of JP2020523694A5 publication Critical patent/JP2020523694A5/ja
Application granted granted Critical
Publication of JP7042849B2 publication Critical patent/JP7042849B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/251—Fusion techniques of input or preprocessed data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/803—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of input or preprocessed data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
JP2019568632A 2018-04-24 2018-11-21 顔特徴点の測位方法及び装置 Active JP7042849B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201810373871.6A CN108596093B (zh) 2018-04-24 2018-04-24 人脸特征点的定位方法及装置
CN201810373871.6 2018-04-24
PCT/CN2018/116779 WO2019205605A1 (zh) 2018-04-24 2018-11-21 人脸特征点的定位方法及装置

Publications (3)

Publication Number Publication Date
JP2020523694A JP2020523694A (ja) 2020-08-06
JP2020523694A5 JP2020523694A5 (enExample) 2020-09-17
JP7042849B2 true JP7042849B2 (ja) 2022-03-28

Family

ID=63614398

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019568632A Active JP7042849B2 (ja) 2018-04-24 2018-11-21 顔特徴点の測位方法及び装置

Country Status (7)

Country Link
US (1) US11314965B2 (enExample)
JP (1) JP7042849B2 (enExample)
KR (1) KR102334279B1 (enExample)
CN (1) CN108596093B (enExample)
MY (1) MY201922A (enExample)
SG (1) SG11201912428TA (enExample)
WO (1) WO2019205605A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108596093B (zh) 2018-04-24 2021-12-03 北京市商汤科技开发有限公司 人脸特征点的定位方法及装置
CN109285182A (zh) * 2018-09-29 2019-01-29 北京三快在线科技有限公司 模型生成方法、装置、电子设备和计算机可读存储介质
CN109522910B (zh) * 2018-12-25 2020-12-11 浙江商汤科技开发有限公司 关键点检测方法及装置、电子设备和存储介质
CN109461188B (zh) * 2019-01-30 2019-04-26 南京邮电大学 一种二维x射线头影测量图像解剖特征点自动定位方法
CN111553865B (zh) * 2020-04-30 2023-08-22 深圳市商汤科技有限公司 图像修复方法及装置、电子设备和存储介质
CN112836654B (zh) * 2021-02-07 2024-06-07 上海卓繁信息技术股份有限公司 一种基于融合的表情识别方法、装置和电子设备
US20230353885A1 (en) * 2022-04-27 2023-11-02 Sonic Star Global Limited Image processing system and method for processing images
CN115564837B (zh) * 2022-11-17 2023-04-18 歌尔股份有限公司 一种视觉定位方法、装置和系统
CN119028369B (zh) * 2024-07-30 2025-06-17 浙江大学金华研究院 基于音频驱动的人脸对话生成模型的人脸视频生成方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008146356A (ja) 2006-12-11 2008-06-26 Nissan Motor Co Ltd 視線方向推定装置及び視線方向推定方法
JP2009265774A (ja) 2008-04-22 2009-11-12 Canon Inc 情報処理装置及び情報処理方法
US20160283780A1 (en) 2015-03-25 2016-09-29 Alibaba Group Holding Limited Positioning feature points of human face edge

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4217664B2 (ja) * 2004-06-28 2009-02-04 キヤノン株式会社 画像処理方法、画像処理装置
US8620038B2 (en) * 2006-05-05 2013-12-31 Parham Aarabi Method, system and computer program product for automatic and semi-automatic modification of digital images of faces
JP5202037B2 (ja) 2008-02-29 2013-06-05 キヤノン株式会社 特徴点位置決定方法及び装置
CN103679158B (zh) * 2013-12-31 2017-06-16 北京天诚盛业科技有限公司 人脸认证方法和装置
US10198624B2 (en) * 2016-02-18 2019-02-05 Pinscreen, Inc. Segmentation-guided real-time facial performance capture
KR101785661B1 (ko) * 2016-12-06 2017-10-17 인천대학교 산학협력단 회색 값 분산을 이용한 얼굴 윤곽 인식방법 및 그 장치
WO2018144537A1 (en) * 2017-01-31 2018-08-09 The Regents Of The University Of California Machine learning based driver assistance
CN106951840A (zh) * 2017-03-09 2017-07-14 北京工业大学 一种人脸特征点检测方法
CN107832741A (zh) * 2017-11-28 2018-03-23 北京小米移动软件有限公司 人脸特征点定位的方法、装置及计算机可读存储介质
CN108596093B (zh) * 2018-04-24 2021-12-03 北京市商汤科技开发有限公司 人脸特征点的定位方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008146356A (ja) 2006-12-11 2008-06-26 Nissan Motor Co Ltd 視線方向推定装置及び視線方向推定方法
JP2009265774A (ja) 2008-04-22 2009-11-12 Canon Inc 情報処理装置及び情報処理方法
US20160283780A1 (en) 2015-03-25 2016-09-29 Alibaba Group Holding Limited Positioning feature points of human face edge

Also Published As

Publication number Publication date
CN108596093A (zh) 2018-09-28
MY201922A (en) 2024-03-23
JP2020523694A (ja) 2020-08-06
SG11201912428TA (en) 2020-01-30
KR102334279B1 (ko) 2021-12-02
KR20200010397A (ko) 2020-01-30
US20200125833A1 (en) 2020-04-23
US11314965B2 (en) 2022-04-26
WO2019205605A1 (zh) 2019-10-31
CN108596093B (zh) 2021-12-03

Similar Documents

Publication Publication Date Title
JP7042849B2 (ja) 顔特徴点の測位方法及び装置
US12211315B2 (en) Human face and hand association detecting method and a device, and storage medium
JP7262659B2 (ja) 目標対象物マッチング方法及び装置、電子機器並びに記憶媒体
US10930010B2 (en) Method and apparatus for detecting living body, system, electronic device, and storage medium
CN108764069B (zh) 活体检测方法及装置
CN109257645B (zh) 视频封面生成方法及装置
JP2021519051A (ja) ビデオ修復方法および装置、電子機器、ならびに記憶媒体
CN107692997B (zh) 心率检测方法及装置
US11455836B2 (en) Dynamic motion detection method and apparatus, and storage medium
EP3038345A1 (en) Auto-focusing method and auto-focusing device
CN108881952B (zh) 视频生成方法及装置、电子设备和存储介质
JP7387002B2 (ja) 測位方法、装置、電子機器、記憶媒体、プログラム及び製品
CN111104920A (zh) 视频处理方法及装置、电子设备和存储介质
CN110989884A (zh) 图像定位的操作显示方法及装置、电子设备和存储介质
EP2990905A1 (en) Method and device for displaying image
CN114550261A (zh) 人脸识别方法及装置、电子设备和存储介质
CN111325786B (zh) 图像处理方法及装置、电子设备和存储介质
CN110333903B (zh) 页面加载时长的确定方法及装置
AU2020309091A1 (en) Image processing method and apparatus, electronic device, and storage medium
CN114549983B (zh) 计算机视觉模型训练方法及装置、电子设备和存储介质
CN110969569A (zh) 试镜视频的生成方法及装置
KR102374400B1 (ko) 이미지 처리 방법 및 장치, 전자 기기와 저장 매체
KR20230073869A (ko) 인터랙션을 지원하는 사용자 인터페이스를 제공하는 방법 및 이를 수행하는 전자 장치
CN117893591B (zh) 光幕模板识别方法及装置、设备、存储介质和程序产品
HK40016966B (en) Face and hand association detection method and device, electronic apparatus, and storage medium

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191212

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191212

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210126

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210216

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210428

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20211005

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220118

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20220118

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20220127

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20220201

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220308

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220315

R150 Certificate of patent or registration of utility model

Ref document number: 7042849

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150