SG11202002740SA - Face pose analysis method and apparatus, device, storage medium, and program - Google Patents

Face pose analysis method and apparatus, device, storage medium, and program

Info

Publication number
SG11202002740SA
SG11202002740SA SG11202002740SA SG11202002740SA SG11202002740SA SG 11202002740S A SG11202002740S A SG 11202002740SA SG 11202002740S A SG11202002740S A SG 11202002740SA SG 11202002740S A SG11202002740S A SG 11202002740SA SG 11202002740S A SG11202002740S A SG 11202002740SA
Authority
SG
Singapore
Prior art keywords
program
storage medium
analysis method
face pose
pose analysis
Prior art date
Application number
SG11202002740SA
Inventor
Quan Wang
Fei Wang
Chen Qian
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11202002740SA publication Critical patent/SG11202002740SA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06F18/2148—Generating training patterns; Bootstrap methods, e.g. bagging or boosting characterised by the process organisation or structure, e.g. boosting cascade
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G06F18/2178—Validation; Performance evaluation; Active pattern learning techniques based on feedback of a supervisor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G06V20/653—Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G06V40/11—Hand-related biometrics; Hand pose recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/175—Static expression
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/047—Probabilistic or stochastic networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G06V40/117—Biometrics derived from hands

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
SG11202002740SA 2017-12-25 2018-12-24 Face pose analysis method and apparatus, device, storage medium, and program SG11202002740SA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711424986.5A CN109960986A (en) 2017-12-25 2017-12-25 Human face posture analysis method, device, equipment, storage medium and program
PCT/CN2018/123156 WO2019128932A1 (en) 2017-12-25 2018-12-24 Face pose analysis method and apparatus, device, storage medium, and program

Publications (1)

Publication Number Publication Date
SG11202002740SA true SG11202002740SA (en) 2020-04-29

Family

ID=67021409

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202002740SA SG11202002740SA (en) 2017-12-25 2018-12-24 Face pose analysis method and apparatus, device, storage medium, and program

Country Status (5)

Country Link
US (1) US11341769B2 (en)
JP (1) JP6970305B2 (en)
CN (1) CN109960986A (en)
SG (1) SG11202002740SA (en)
WO (1) WO2019128932A1 (en)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018033137A1 (en) * 2016-08-19 2018-02-22 北京市商汤科技开发有限公司 Method, apparatus, and electronic device for displaying service object in video image
CN110059522B (en) * 2018-01-19 2021-06-25 北京市商汤科技开发有限公司 Human body contour key point detection method, image processing method, device and equipment
US10915769B2 (en) 2018-06-04 2021-02-09 Shanghai Sensetime Intelligent Technology Co., Ltd Driving management methods and systems, vehicle-mounted intelligent systems, electronic devices, and medium
US10970571B2 (en) * 2018-06-04 2021-04-06 Shanghai Sensetime Intelligent Technology Co., Ltd. Vehicle control method and system, vehicle-mounted intelligent system, electronic device, and medium
CN110490067A (en) * 2019-07-11 2019-11-22 平安科技（深圳）有限公司 A kind of face identification method and device based on human face posture
CN110555404A (en) * 2019-08-29 2019-12-10 西北工业大学 Flying wing unmanned aerial vehicle ground station interaction device and method based on human body posture recognition
CN110781728B (en) * 2019-09-16 2020-11-10 北京嘀嘀无限科技发展有限公司 Face orientation estimation method and device, electronic equipment and storage medium
CN110956691B (en) * 2019-11-21 2023-06-06 Oppo广东移动通信有限公司 Three-dimensional face reconstruction method, device, equipment and storage medium
CN111297367A (en) * 2019-11-26 2020-06-19 北京海益同展信息科技有限公司 Animal state monitoring method and device, electronic equipment and storage medium
CN111368751A (en) * 2020-03-06 2020-07-03 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
CN111476709B (en) * 2020-04-09 2023-04-07 广州方硅信息技术有限公司 Face image processing method and device and electronic equipment
CN111814573A (en) * 2020-06-12 2020-10-23 深圳禾思众成科技有限公司 Face information detection method and device, terminal equipment and storage medium
CN111768485B (en) * 2020-06-28 2024-01-12 北京百度网讯科技有限公司 Method and device for marking key points of three-dimensional image, electronic equipment and storage medium
CN111738220B (en) 2020-07-27 2023-09-15 腾讯科技（深圳）有限公司 Three-dimensional human body posture estimation method, device, equipment and medium
CN112200765B (en) * 2020-09-04 2024-05-14 浙江大华技术股份有限公司 Method and device for determining false-detected key points in vehicle
CN112165573B (en) * 2020-09-14 2023-04-18 上海商汤智能科技有限公司 Shooting processing method and device, equipment and storage medium
CN112183657B (en) * 2020-10-14 2022-03-01 北京字跳网络技术有限公司 Method and device for acquiring annotation information, electronic equipment and computer readable medium
CN112287820A (en) * 2020-10-28 2021-01-29 广州虎牙科技有限公司 Face detection neural network, face detection neural network training method, face detection method and storage medium
CN112287855B (en) * 2020-11-02 2024-05-10 东软睿驰汽车技术（沈阳）有限公司 Driving behavior detection method and device based on multi-task neural network
CN112489036A (en) * 2020-12-14 2021-03-12 Oppo（重庆）智能科技有限公司 Image evaluation method, image evaluation device, storage medium, and electronic apparatus
CN112622892B (en) * 2020-12-14 2023-03-24 深圳技术大学 Emergency braking method and system based on face and limb posture recognition
CN112699784A (en) * 2020-12-29 2021-04-23 深圳市普渡科技有限公司 Face orientation estimation method and device, electronic equipment and storage medium
CN112734632B (en) * 2021-01-05 2024-02-27 百果园技术(新加坡)有限公司 Image processing method, device, electronic equipment and readable storage medium
CN112861776A (en) * 2021-03-05 2021-05-28 罗普特科技集团股份有限公司 Human body posture analysis method and system based on dense key points
CN115082978A (en) * 2021-03-10 2022-09-20 佳能株式会社 Face posture detection device, method, image processing system and storage medium
WO2022234741A1 (en) * 2021-05-05 2022-11-10 Nec Corporation Methods and apparatuses for processing an image
CN113239861B (en) * 2021-05-28 2024-05-28 多伦科技股份有限公司 Method for determining head motion of driver, storage medium, and electronic device
CN113379832B (en) * 2021-06-23 2022-06-07 南京领行科技股份有限公司 Camera pose adjusting method and device, electronic equipment and storage medium
CN113453034B (en) * 2021-06-29 2023-07-25 上海商汤智能科技有限公司 Data display method, device, electronic equipment and computer readable storage medium
CN113850198B (en) * 2021-09-27 2024-06-07 平安科技（深圳）有限公司 Behavior detection method, device, medium and computer equipment based on edge calculation
CN113947799B (en) * 2021-11-11 2023-03-14 石家庄学院 Three-dimensional face data preprocessing method and equipment
CN114220149A (en) * 2021-12-09 2022-03-22 东软睿驰汽车技术（沈阳）有限公司 Method, device, equipment and storage medium for acquiring true value of head posture
CN114496263B (en) * 2022-04-13 2022-07-12 杭州研极微电子有限公司 Neural network model establishing method and storage medium for body mass index estimation
CN114549711B (en) * 2022-04-27 2022-07-12 广州公评科技有限公司 Intelligent video rendering method and system based on expression muscle positioning
GB2621863A (en) * 2022-08-25 2024-02-28 Continental Automotive Tech Gmbh Pose classification and in-cabin monitoring methods and associated systems
CN116597427B (en) * 2023-07-18 2023-10-20 山东科技大学 Ship driver's cab identity recognition method based on deep learning

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060011399A1 (en) 2004-07-15 2006-01-19 International Business Machines Corporation System and method for controlling vehicle operation based on a user's facial expressions and physical state
CN100565583C (en) 2004-11-12 2009-12-02 欧姆龙株式会社 Face characteristic point detection device, feature point detection device
JP4795281B2 (en) * 2007-03-15 2011-10-19 本田技研工業株式会社 Vehicle safety device
JP5451302B2 (en) * 2009-10-19 2014-03-26 キヤノン株式会社 Image processing apparatus and method, program, and storage medium
US9405982B2 (en) * 2013-01-18 2016-08-02 GM Global Technology Operations LLC Driver gaze detection system
CN103605965A (en) * 2013-11-25 2014-02-26 苏州大学 Multi-pose face recognition method and device
CN105096528B (en) 2015-08-05 2017-07-11 广州云从信息科技有限公司 A kind of method for detecting fatigue driving and system
EP3345127A4 (en) 2015-08-31 2019-08-21 SRI International Method and system for monitoring driving behaviors
CN105389570A (en) * 2015-11-19 2016-03-09 吴建忠 Face angle determination method and system
CN106897658B (en) * 2015-12-18 2021-12-14 腾讯科技（深圳）有限公司 Method and device for identifying human face living body
CN105354565A (en) 2015-12-23 2016-02-24 北京市商汤科技开发有限公司 Full convolution network based facial feature positioning and distinguishing method and system
CN105719248B (en) * 2016-01-14 2019-06-21 深圳市商汤科技有限公司 A kind of real-time Facial metamorphosis method and its system
CN105760836A (en) * 2016-02-17 2016-07-13 厦门美图之家科技有限公司 Multi-angle face alignment method based on deep learning and system thereof and photographing terminal
CN106257489A (en) * 2016-07-12 2016-12-28 乐视控股（北京）有限公司 Expression recognition method and system
CN106203376B (en) 2016-07-19 2020-04-10 北京旷视科技有限公司 Face key point positioning method and device
CN106339680B (en) 2016-08-25 2019-07-23 北京小米移动软件有限公司 Face key independent positioning method and device
CN106384098B (en) * 2016-09-23 2019-11-26 北京小米移动软件有限公司 Head pose detection method, device and terminal based on image
CN106651910A (en) * 2016-11-17 2017-05-10 北京蓝天多维科技有限公司 Intelligent image analysis method and alarm system for abnormal driver behavior state
CN106909879A (en) 2017-01-11 2017-06-30 开易（北京）科技有限公司 A kind of method for detecting fatigue driving and system
CN107038429A (en) * 2017-05-03 2017-08-11 四川云图睿视科技有限公司 A kind of multitask cascade face alignment method based on deep learning
CN107194381A (en) * 2017-07-06 2017-09-22 重庆邮电大学 Driver status monitoring system based on Kinect
CN107609519B (en) * 2017-09-15 2019-01-22 维沃移动通信有限公司 A kind of localization method and device of human face characteristic point

Also Published As

Publication number Publication date
US11341769B2 (en) 2022-05-24
WO2019128932A1 (en) 2019-07-04
US20200218883A1 (en) 2020-07-09
CN109960986A (en) 2019-07-02
JP2020535568A (en) 2020-12-03
JP6970305B2 (en) 2021-11-24

Similar Documents

Publication Publication Date Title
SG11202002740SA (en) Face pose analysis method and apparatus, device, storage medium, and program
EP3734447C0 (en) Application program processing method, apparatus, storage medium and computer device
SG10201706430PA (en) Non-transitory recording medium recording cyber-attack analysis supporting program, cyber-attack analysis supporting method, and cyber-attack analysis supporting apparatus
EP3358476A4 (en) Method and apparatus for constructing decision model, computer device and storage device
EP3324183A4 (en) Image analysis device, image analysis method, image analysis system, image analysis program, and recording medium
EP3647949C0 (en) Application program processing method, device and storage medium
SG11202001403XA (en) Face pose detection method, device and storage medium
EP3396354A4 (en) Number analyzing method, number analyzing device, and storage medium for number analysis
GB201719210D0 (en) Sound source position detection device, sound source position detection method, sound source position detection program, and storage medium
GB201609330D0 (en) Data browse apparatus, data browse method, program, and storage medium
SG11201702431PA (en) Analysis system, analysis device, analysis method, and storage medium having analysis program recorded therein
SG11201913243RA (en) Data statistical analysis method, apparatus, and device
EP3358567A4 (en) Sound-mixing processing method, apparatus and device, and storage medium
SG11202000578UA (en) Keyframe scheduling method and apparatus, electronic device, program and medium
GB2565005B (en) Analysis device, analysis method, and storage medium storing program
GB201705641D0 (en) Apparatus and method for monitoring objects in space
EP3382610A4 (en) Data analysis apparatus, method, and program
GB201510765D0 (en) Method, apparatus and electrochemical test device
HK1248900A1 (en) Data analysis apparatus and data analysis method
GB2580830B (en) Data verification apparatus, data verification method, and data verification program
GB201710652D0 (en) Image processing device and method, program, and recording medium
GB201814927D0 (en) Analysis device, analysis method and storage medium which stores program
EP3098813A4 (en) Linear-predictive analysis device, method, program, and recording medium
SG11201604723TA (en) Authenticating apparatus, authenticating system, program, storage medium, and authenticating method
SG11201702438VA (en) Analysis system, analysis device, analysis method, and storage medium having analysis program recorded therein