SG11202100356TA - Action recognition method and apparatus, and driver state analysis method and apparatus - Google Patents

Action recognition method and apparatus, and driver state analysis method and apparatus

Info

Publication number
SG11202100356TA
SG11202100356TA SG11202100356TA SG11202100356TA SG11202100356TA SG 11202100356T A SG11202100356T A SG 11202100356TA SG 11202100356T A SG11202100356T A SG 11202100356TA SG 11202100356T A SG11202100356T A SG 11202100356TA SG 11202100356T A SG11202100356T A SG 11202100356TA
Authority
SG
Singapore
Prior art keywords
driver state
state analysis
action recognition
analysis method
recognition method
Prior art date
Application number
SG11202100356TA
Inventor
Yanjie Chen
Fei Wang
Chen Qian
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11202100356TA publication Critical patent/SG11202100356TA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
    • B60W40/105—Speed
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00—Input parameters relating to overall vehicle dynamics
    • B60W2520/10—Longitudinal speed
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
SG11202100356TA 2018-09-27 2019-06-25 Action recognition method and apparatus, and driver state analysis method and apparatus SG11202100356TA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811132681.1A CN110956061B (en) 2018-09-27 2018-09-27 Action recognition method and device, and driver state analysis method and device
PCT/CN2019/092715 WO2020062969A1 (en) 2018-09-27 2019-06-25 Action recognition method and device, and driver state analysis method and device

Publications (1)

Publication Number Publication Date
SG11202100356TA true SG11202100356TA (en) 2021-02-25

Family

ID=69950204

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202100356TA SG11202100356TA (en) 2018-09-27 2019-06-25 Action recognition method and apparatus, and driver state analysis method and apparatus

Country Status (6)

Country Link
US (1) US20210133468A1 (en)
JP (1) JP7295936B2 (en)
KR (1) KR20210036955A (en)
CN (1) CN110956061B (en)
SG (1) SG11202100356TA (en)
WO (1) WO2020062969A1 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3884426B1 (en) * 2018-11-20 2024-01-03 DeepMind Technologies Limited Action classification in video clips using attention-based neural networks
CN111753602A (en) * 2019-03-29 2020-10-09 北京市商汤科技开发有限公司 Motion recognition method and device, electronic equipment and storage medium
EP3961498A4 (en) * 2020-06-29 2023-05-24 Beijing Baidu Netcom Science And Technology Co., Ltd. Dangerous driving behavior recognition method and apparatus, and electronic device and storage medium
CN112990069A (en) * 2021-03-31 2021-06-18 新疆爱华盈通信息技术有限公司 Abnormal driving behavior detection method, device, terminal and medium
CN113033529A (en) * 2021-05-27 2021-06-25 北京德风新征程科技有限公司 Early warning method and device based on image recognition, electronic equipment and medium
CN113673351A (en) * 2021-07-21 2021-11-19 浙江大华技术股份有限公司 Behavior detection method, equipment and storage medium
KR102634012B1 (en) * 2021-10-12 2024-02-07 경북대학교 산학협력단 Apparatus for detecting driver behavior using object classification based on deep running
CN114005178B (en) * 2021-10-29 2023-09-01 北京百度网讯科技有限公司 Character interaction detection method, neural network, training method, training equipment and training medium thereof
CN114255517B (en) * 2022-03-02 2022-05-20 中运科技股份有限公司 Scenic spot tourist behavior monitoring system and method based on artificial intelligence analysis
CN115188148A (en) * 2022-07-11 2022-10-14 卡奥斯工业智能研究院(青岛)有限公司 Security monitoring system and method based on 5G, electronic device and storage medium
CN116884034A (en) * 2023-07-10 2023-10-13 中电金信软件有限公司 Object identification method and device

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3495934B2 (en) 1999-01-08 2004-02-09 矢崎総業株式会社 Accident prevention system
JP4898475B2 (en) * 2007-02-05 2012-03-14 富士フイルム株式会社 Imaging control apparatus, imaging apparatus, and imaging control method
JP4946807B2 (en) 2007-11-07 2012-06-06 トヨタ自動車株式会社 Lane departure prevention control device
JP2010271922A (en) 2009-05-21 2010-12-02 Fujifilm Corp Busy person detection method, busy person detector, and busy person detection program
CN102436715B (en) * 2011-11-25 2013-12-11 大连海创高科信息技术有限公司 Detection method for fatigue driving
CN102799868B (en) * 2012-07-10 2014-09-10 吉林禹硕动漫游戏科技股份有限公司 Method for identifying key facial expressions of human faces
JP6150258B2 (en) 2014-01-15 2017-06-21 みこらった株式会社 Self-driving car
JP2016031747A (en) 2014-07-30 2016-03-07 キヤノン株式会社 Information processing apparatus and information processing method
CN104616437A (en) * 2015-02-27 2015-05-13 浪潮集团有限公司 Vehicle-mounted fatigue identification system and method
CN105117681B (en) * 2015-06-29 2018-06-08 电子科技大学 Multiple features fatigue real-time detection method based on Android
JP2017034567A (en) 2015-08-05 2017-02-09 キヤノン株式会社 Imaging apparatus
CN105769120B (en) * 2016-01-27 2019-01-22 深圳地平线机器人科技有限公司 Method for detecting fatigue driving and device
JP6534103B2 (en) 2016-03-18 2019-06-26 パナソニックＩｐマネジメント株式会社 Recording apparatus and image reproduction method
CN105975935B (en) * 2016-05-04 2019-06-25 腾讯科技（深圳）有限公司 A kind of face image processing process and device
WO2017208529A1 (en) 2016-06-02 2017-12-07 オムロン株式会社 Driver state estimation device, driver state estimation system, driver state estimation method, driver state estimation program, subject state estimation device, subject state estimation method, subject state estimation program, and recording medium
CN106203293A (en) * 2016-06-29 2016-12-07 广州鹰瞰信息科技有限公司 A kind of method and apparatus detecting fatigue driving
CN107590482A (en) * 2017-09-29 2018-01-16 百度在线网络技术（北京）有限公司 information generating method and device
CN108446600A (en) * 2018-02-27 2018-08-24 上海汽车集团股份有限公司 A kind of vehicle driver's fatigue monitoring early warning system and method
CN108549838B (en) * 2018-03-13 2022-01-14 心科(上海)网络科技有限公司 Auxiliary supervision method based on visual system

Also Published As

Publication number Publication date
US20210133468A1 (en) 2021-05-06
KR20210036955A (en) 2021-04-05
CN110956061B (en) 2024-04-16
CN110956061A (en) 2020-04-03
JP7295936B2 (en) 2023-06-21
JP2021530789A (en) 2021-11-11
WO2020062969A1 (en) 2020-04-02

Similar Documents

Publication Publication Date Title
SG11202100356TA (en) Action recognition method and apparatus, and driver state analysis method and apparatus
SG11202009320PA (en) Maneuver recognition and driving maneuver analysis method and apparatus, and electronic device
EP3651055A4 (en) Gesture recognition method, apparatus, and device
EP3480727A4 (en) Method and apparatus for identity recognition
EP3336733A4 (en) Fingerprint recognition system and method, and display apparatus
EP3296930A4 (en) Recurrent neural network learning method, computer program for same, and voice recognition device
EP3825981A4 (en) Warning apparatus, driving tendency analysis device, driving tendency analysis method, and program
EP3869364A4 (en) Biological recognition interaction method, graphical interaction interface, and related apparatus
EP3327614A4 (en) Fingerprint collection method, apparatus, and terminal
EP3848855A4 (en) Learning method and apparatus for intention recognition model, and device
EP3647140A4 (en) Vehicle control method, device, and apparatus
EP3805982A4 (en) Gesture recognition method, apparatus and device
EP3611690A4 (en) Recognition device, recognition method, and recognition program
EP3261023A4 (en) Method, apparatus and terminal device for fingerprint identification
EP3848833A4 (en) Analysis function imparting device, analysis function imparting method, and analysis function imparting program
EP3757874A4 (en) Action recognition method and apparatus
EP3327613A4 (en) Fingerprint entry method, apparatus, and terminal device
GB201904232D0 (en) Apparatus, vehicle and method
EP3336749A4 (en) Fingerprint image recognition method, apparatus, and terminal
EP3591532A4 (en) Analysis device, analysis method, and analysis program
GB201608455D0 (en) Break analysis system, method and device
EP3882628A4 (en) Analysis method, analysis device, and analysis program
EP3633397A4 (en) State analysis apparatus, state analysis method, and program
EP3617991A4 (en) Learning device, image recognition device, learning method, and program
EP4044112A4 (en) Fog feature recognition method, apparatus, and related device