EP3859605A3 - Image recognition method, apparatus, device, and computer storage medium - Google Patents

Image recognition method, apparatus, device, and computer storage medium Download PDF

Info

Publication number
EP3859605A3
EP3859605A3 EP21163966.1A EP21163966A EP3859605A3 EP 3859605 A3 EP3859605 A3 EP 3859605A3 EP 21163966 A EP21163966 A EP 21163966A EP 3859605 A3 EP3859605 A3 EP 3859605A3
Authority
EP
European Patent Office
Prior art keywords
face image
human face
obtaining
defect
recognition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP21163966.1A
Other languages
German (de)
French (fr)
Other versions
EP3859605A2 (en
Inventor
Zhizhi GUO
Yipeng Sun
Jingtuo LIU
Junyu Han
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Publication of EP3859605A2 publication Critical patent/EP3859605A2/en
Publication of EP3859605A3 publication Critical patent/EP3859605A3/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/253—Fusion techniques of extracted features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/29—Graphical models, e.g. Bayesian networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/806—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of extracted features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Abstract

The present application discloses an image recognition method, apparatus, device, and a computer storage medium, which is related to a technical field of artificial intelligence, and in particular, to a technical field of image processing. The method includes: performing organ recognition on a human face image and marking positions of the human facial five sense organs in the human face image, obtaining a marked human face image; inputting the marked human face image into a backbone network model and performing feature extraction, obtaining defect features of the marked human face image outputted by different convolutional neural network levels of the backbone network model; and fusing the defect features of different levels that are located in a same area of the human face image, obtaining a defect recognition result of the human face image. Embodiments of the present application can improve the accuracy and efficiency of human facial defect recognition.
EP21163966.1A 2020-06-30 2021-03-22 Image recognition method, apparatus, device, and computer storage medium Ceased EP3859605A3 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010611133.8A CN111767858B (en) 2020-06-30 2020-06-30 Image recognition method, device, equipment and computer storage medium

Publications (2)

Publication Number Publication Date
EP3859605A2 EP3859605A2 (en) 2021-08-04
EP3859605A3 true EP3859605A3 (en) 2021-10-13

Family

ID=72722886

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21163966.1A Ceased EP3859605A3 (en) 2020-06-30 2021-03-22 Image recognition method, apparatus, device, and computer storage medium

Country Status (5)

Country Link
US (1) US11756332B2 (en)
EP (1) EP3859605A3 (en)
JP (1) JP7301092B2 (en)
KR (1) KR20210040313A (en)
CN (1) CN111767858B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112348121B (en) * 2020-12-01 2022-06-28 吉林大学 Target detection method, target detection equipment and computer storage medium
CN112598591A (en) * 2020-12-18 2021-04-02 北京达佳互联信息技术有限公司 Image processing method, image processing device, electronic equipment and storage medium
CN112581359B (en) * 2020-12-23 2023-06-09 Oppo（重庆）智能科技有限公司 Image processing method, device, terminal and storage medium
CN114049315B (en) * 2021-10-29 2023-04-18 北京长木谷医疗科技有限公司 Joint recognition method, electronic device, storage medium, and computer program product
CN114115054A (en) * 2021-11-30 2022-03-01 沈阳工业大学 Online detection robot control system based on neural network
WO2024039785A1 (en) * 2022-08-18 2024-02-22 Onto Innovation Inc. Substrate defect-detection and comparison
CN116959064B (en) * 2023-06-25 2024-04-26 上海腾桥信息技术有限公司 Certificate verification method and device, computer equipment and storage medium
CN117523636A (en) * 2023-11-24 2024-02-06 北京远鉴信息技术有限公司 Face detection method and device, electronic equipment and storage medium

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11710489B2 (en) * 2004-06-14 2023-07-25 Wanda Papadimitriou Autonomous material evaluation system and method
CN100463000C (en) 2007-09-27 2009-02-18 上海交通大学 Human eye state detection method based on cascade classification and hough circle transform
JP5547730B2 (en) * 2008-07-30 2014-07-16 デジタルオプティックス・コーポレイション・ヨーロッパ・リミテッド Automatic facial and skin beautification using face detection
JP5882929B2 (en) 2013-02-26 2016-03-09 日本電信電話株式会社 Image processing apparatus, image processing method, and image processing program
JP6706788B2 (en) 2015-03-06 2020-06-10 パナソニックＩｐマネジメント株式会社 Image recognition method, image recognition device and program
CN110709856B (en) * 2017-05-31 2023-11-28 宝洁公司 System and method for determining apparent skin age
WO2019014812A1 (en) * 2017-07-17 2019-01-24 深圳和而泰智能控制股份有限公司 Method for detecting blemish spot on human face, and intelligent terminal
CN108921825A (en) 2018-06-12 2018-11-30 北京羽医甘蓝信息技术有限公司 The method and device of the facial skin points shape defect of detection based on deep learning
JP7395604B2 (en) 2018-12-04 2023-12-11 ジャン・ルオウェイ Automatic image-based skin diagnosis using deep learning
CN109815886B (en) * 2019-01-21 2020-12-18 南京邮电大学 Pedestrian and vehicle detection method and system based on improved YOLOv3
CN109816024B (en) * 2019-01-29 2021-08-31 电子科技大学 Real-time vehicle logo detection method based on multi-scale feature fusion and DCNN
CN110059635B (en) * 2019-04-19 2021-03-23 厦门美图之家科技有限公司 Skin defect detection method and device
CN110490874A (en) * 2019-09-04 2019-11-22 河海大学常州校区 Weaving cloth surface flaw detecting method based on YOLO neural network

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
"LECTURE NOTES IN COMPUTER SCIENCE", vol. 9005, 1 January 2015, SPRINGER BERLIN HEIDELBERG, Berlin, Heidelberg, ISBN: 978-3-54-045234-8, ISSN: 0302-9743, article CHOON-CHING NG ET AL: "Automatic Wrinkle Detection Using Hybrid Hessian Filter", pages: 609 - 622, XP055207995, DOI: 10.1007/978-3-319-16811-1_40 *
CHOON CHING NG: "Face age estimation using wrinkle patterns", 1 January 2015 (2015-01-01), XP055569949, Retrieved from the Internet <URL:https://e-space.mmu.ac.uk/595499/1/Choon-Ching%20Ng%20-%20PhD%20Thesis%202015.pdf> [retrieved on 20210902] *
NG CHOON-CHING ET AL: "Hybrid Ageing Patterns for face age estimation", IMAGE AND VISION COMPUTING, ELSEVIER, GUILDFORD, GB, vol. 69, 6 September 2017 (2017-09-06), pages 92 - 102, XP085413065, ISSN: 0262-8856, DOI: 10.1016/J.IMAVIS.2017.08.005 *
NG CHOON-CHING ET AL: "Will Wrinkle Estimate the Face Age?", 2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, IEEE, 9 October 2015 (2015-10-09), pages 2418 - 2423, XP032847509, DOI: 10.1109/SMC.2015.423 *
NG CHOON-CHING ET AL: "Wrinkle Detection Using Hessian Line Tracking", IEEE ACCESS, vol. 3, 28 July 2015 (2015-07-28), pages 1079 - 1088, XP011664465, DOI: 10.1109/ACCESS.2015.2455871 *
SHIN IL-KYU ET AL: "Extraction and Transfer of Facial Expression Wrinkles for Facial Performance Enhancement", PACIFIC GRAPHICS (2014), 10 October 2014 (2014-10-10), XP055837670, Retrieved from the Internet <URL:https://cgl.ethz.ch/Downloads/Publications/Papers/2014/Ozt14a/Ozt14a.pdf> [retrieved on 20210903] *

Also Published As

Publication number Publication date
US20210209343A1 (en) 2021-07-08
JP2021108215A (en) 2021-07-29
KR20210040313A (en) 2021-04-13
JP7301092B2 (en) 2023-06-30
CN111767858A (en) 2020-10-13
US11756332B2 (en) 2023-09-12
CN111767858B (en) 2024-03-22
EP3859605A2 (en) 2021-08-04

Similar Documents

Publication Publication Date Title
EP3859605A3 (en) Image recognition method, apparatus, device, and computer storage medium
EP3859604A3 (en) Image recognition method and apparatus, device, and computer storage medium
US20190311479A1 (en) Method and device for identifying pathological picture
CN107330444A (en) A kind of image autotext mask method based on generation confrontation network
EP3926526A3 (en) Optical character recognition method and apparatus, electronic device and storage medium
CN111243730B (en) Mammary gland focus intelligent analysis method and system based on mammary gland ultrasonic image
CN111341437B (en) Digestive tract disease judgment auxiliary system based on tongue image
CN110097557B (en) Medical image automatic segmentation method and system based on 3D-UNet
CN109711356B (en) Expression recognition method and system
CN112734764A (en) Unsupervised medical image segmentation method based on countermeasure network
EP3910553A3 (en) Image processing method, training method for a neural network, device and medium
Khan et al. An efficient sign language translator device using convolutional neural network and customized ROI segmentation
EP3876197A3 (en) Portrait extracting method and apparatus, electronic device and storage medium
US20040068408A1 (en) Generating animation from visual and audio input
CN110334566A (en) Fingerprint extraction method inside and outside a kind of OCT based on three-dimensional full convolutional neural networks
CN113657168A (en) Convolutional neural network-based student learning emotion recognition method
CN115936944A (en) Virtual teaching management method and device based on artificial intelligence
WO2021127916A1 (en) Facial emotion recognition method, smart device and computer-readabel storage medium
CN111667425A (en) Prior algorithm-based facial expression image occlusion restoration method
CN113627256B (en) False video inspection method and system based on blink synchronization and binocular movement detection
Guarin et al. The effect of improving facial alignment accuracy on the video-based detection of neurological diseases
CN111462082A (en) Focus picture recognition device, method and equipment and readable storage medium
CN111611854A (en) Classroom condition evaluation method based on pattern recognition
CN111832412B (en) Sounding training correction method and system
CN114359317A (en) Blood vessel reconstruction method based on small sample identification

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210322

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/62 20060101ALI20210908BHEP

Ipc: G06K 9/00 20060101AFI20210908BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20220610

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20230818