SG11202009320PA - Maneuver recognition and driving maneuver analysis method and apparatus, and electronic device - Google Patents

Maneuver recognition and driving maneuver analysis method and apparatus, and electronic device

Info

Publication number
SG11202009320PA
SG11202009320PA SG11202009320PA SG11202009320PA SG11202009320PA SG 11202009320P A SG11202009320P A SG 11202009320PA SG 11202009320P A SG11202009320P A SG 11202009320PA SG 11202009320P A SG11202009320P A SG 11202009320PA SG 11202009320P A SG11202009320P A SG 11202009320PA
Authority
SG
Singapore
Prior art keywords
maneuver
electronic device
analysis method
recognition
driving
Prior art date
Application number
SG11202009320PA
Inventor
Yanjie Chen
Fei Wang
Chen Qian
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11202009320PA publication Critical patent/SG11202009320PA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • B60R21/01512Passenger detection systems
    • B60R21/01542Passenger detection systems detecting passenger motion
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/776Validation; Performance evaluation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/28Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo or light sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping
SG11202009320PA 2018-09-27 2019-09-26 Maneuver recognition and driving maneuver analysis method and apparatus, and electronic device SG11202009320PA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811130798.6A CN110956060A (en) 2018-09-27 2018-09-27 Motion recognition method, driving motion analysis method, device and electronic equipment
PCT/CN2019/108167 WO2020063753A1 (en) 2018-09-27 2019-09-26 Maneuver recognition and driving maneuver analysis method and apparatus, and electronic device

Publications (1)

Publication Number Publication Date
SG11202009320PA true SG11202009320PA (en) 2020-10-29

Family

ID=69951010

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202009320PA SG11202009320PA (en) 2018-09-27 2019-09-26 Maneuver recognition and driving maneuver analysis method and apparatus, and electronic device

Country Status (6)

Country Link
US (1) US20210012127A1 (en)
JP (1) JP7061685B2 (en)
KR (1) KR102470680B1 (en)
CN (1) CN110956060A (en)
SG (1) SG11202009320PA (en)
WO (1) WO2020063753A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110599503B (en) * 2019-06-18 2021-05-28 腾讯科技(深圳)有限公司 Detection model training method and device, computer equipment and storage medium
US11222242B2 (en) * 2019-08-23 2022-01-11 International Business Machines Corporation Contrastive explanations for images with monotonic attribute functions
US10803334B1 (en) * 2019-10-18 2020-10-13 Alpine Electronics of Silicon Valley, Inc. Detection of unsafe cabin conditions in autonomous vehicles
KR102374211B1 (en) * 2019-10-28 2022-03-15 주식회사 에스오에스랩 Object recognition method and object recognition device performing the same
US11043003B2 (en) * 2019-11-18 2021-06-22 Waymo Llc Interacted object detection neural network
CN112947740A (en) * 2019-11-22 2021-06-11 深圳市超捷通讯有限公司 Human-computer interaction method based on motion analysis and vehicle-mounted device
CN111553282B (en) * 2020-04-29 2024-03-29 北京百度网讯科技有限公司 Method and device for detecting a vehicle
CN111931640B (en) * 2020-08-07 2022-06-10 上海商汤临港智能科技有限公司 Abnormal sitting posture identification method and device, electronic equipment and storage medium
CN112270210B (en) * 2020-10-09 2024-03-01 珠海格力电器股份有限公司 Data processing and operation instruction identification method, device, equipment and medium
CN112257604A (en) * 2020-10-23 2021-01-22 北京百度网讯科技有限公司 Image detection method, image detection device, electronic equipment and storage medium
CN112339764A (en) * 2020-11-04 2021-02-09 杨华勇 New energy automobile driving posture analysis system based on big data
CN113011279A (en) * 2021-02-26 2021-06-22 清华大学 Method and device for recognizing mucosa contact action, computer equipment and storage medium
CN117203678A (en) * 2021-04-15 2023-12-08 华为技术有限公司 Target detection method and device
CN113205067B (en) * 2021-05-26 2024-04-09 北京京东乾石科技有限公司 Method and device for monitoring operators, electronic equipment and storage medium
CN113205075A (en) * 2021-05-31 2021-08-03 浙江大华技术股份有限公司 Method and device for detecting smoking behavior and readable storage medium
CN113362314B (en) * 2021-06-18 2022-10-18 北京百度网讯科技有限公司 Medical image recognition method, recognition model training method and device
CN114670856B (en) * 2022-03-30 2022-11-25 湖南大学无锡智能控制研究院 Parameter self-tuning longitudinal control method and system based on BP neural network
CN116901975B (en) * 2023-09-12 2023-11-21 深圳市九洲卓能电气有限公司 Vehicle-mounted AI security monitoring system and method thereof

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8447100B2 (en) * 2007-10-10 2013-05-21 Samsung Electronics Co., Ltd. Detecting apparatus of human component and method thereof
TWI474264B (en) 2013-06-14 2015-02-21 Utechzone Co Ltd Warning method for driving vehicle and electronic apparatus for vehicle
KR101386823B1 (en) * 2013-10-29 2014-04-17 김재철 2 level drowsy driving prevention apparatus through motion, face, eye,and mouth recognition
CN104573659B (en) * 2015-01-09 2018-01-09 安徽清新互联信息科技有限公司 A kind of driver based on svm takes phone-monitoring method
CN105260705B (en) * 2015-09-15 2019-07-05 西安邦威电子科技有限公司 A kind of driver's making and receiving calls behavioral value method suitable under multi-pose
CN105260703B (en) * 2015-09-15 2019-07-05 西安邦威电子科技有限公司 A kind of driver's smoking behavioral value method suitable under multi-pose
JP6443393B2 (en) * 2016-06-01 2018-12-26 トヨタ自動車株式会社 Action recognition device, learning device, method and program
CN106096607A (en) * 2016-06-12 2016-11-09 湘潭大学 A kind of licence plate recognition method
CN106504233B (en) * 2016-10-18 2019-04-09 国网山东省电力公司电力科学研究院 Unmanned plane inspection image electric power widget recognition methods and system based on Faster R-CNN
CN106780612B (en) * 2016-12-29 2019-09-17 浙江大华技术股份有限公司 Object detecting method and device in a kind of image
CN106815574B (en) * 2017-01-20 2020-10-02 博康智能信息技术有限公司北京海淀分公司 Method and device for establishing detection model and detecting behavior of connecting and calling mobile phone
CN106941602B (en) * 2017-03-07 2020-10-13 中国铁路总公司 Locomotive driver behavior identification method and device
CN107316001A (en) * 2017-05-31 2017-11-03 天津大学 Small and intensive method for traffic sign detection in a kind of automatic Pilot scene
CN107316058A (en) * 2017-06-15 2017-11-03 国家新闻出版广电总局广播科学研究院 Improve the method for target detection performance by improving target classification and positional accuracy
CN107563446B (en) * 2017-09-05 2020-08-18 华中科技大学 Target detection method for micro-operation system

Also Published As

Publication number Publication date
WO2020063753A1 (en) 2020-04-02
KR20200124280A (en) 2020-11-02
CN110956060A (en) 2020-04-03
KR102470680B1 (en) 2022-11-25
JP7061685B2 (en) 2022-04-28
JP2021517312A (en) 2021-07-15
US20210012127A1 (en) 2021-01-14

Similar Documents

Publication Publication Date Title
SG11202009320PA (en) Maneuver recognition and driving maneuver analysis method and apparatus, and electronic device
EP3693887A4 (en) Fingerprint recognition apparatus and method, and electronic device
SG11202004836UA (en) Cross-blockchain interaction method, apparatus, system, and electronic device
SG11202005053QA (en) Method, apparatus, and electronic device for executing transactions based on blockchain
SG11202004745SA (en) Method, apparatus, system, and electronic device for cross-blockchain interaction
SG11202006120XA (en) Parking charging method, apparatus, and electronic device
SG11202100621QA (en) Method, apparatus and electronic device for blockchain transactions
EP3633549A4 (en) Facial detection training method, apparatus and electronic device
SG11202100356TA (en) Action recognition method and apparatus, and driver state analysis method and apparatus
SG11202010849XA (en) Method, apparatus and electronic device for blockchain transactions
SG11201913066WA (en) Visual positioning method and apparatus, electronic device, and system
SG11202010811VA (en) Method, apparatus and electronic device for blockchain transactions
EP3651055A4 (en) Gesture recognition method, apparatus, and device
SG11202010816YA (en) Method, apparatus and electronic device for blockchain transactions
EP3663966A4 (en) Fingerprint detection apparatus and method and electronic device
EP3745639A4 (en) Method and apparatus for obtaining device identification
EP3825981A4 (en) Warning apparatus, driving tendency analysis device, driving tendency analysis method, and program
SG11202100939XA (en) Method, apparatus and electronic device for blockchain transactions
EP3523726A4 (en) Database processing method, apparatus, and electronic device
EP3885969A4 (en) Fingerprint recognition method, fingerprint recognition device and electronic apparatus
SG11202000909QA (en) Login method and apparatus, and electronic device
EP3690621A4 (en) Identification method and apparatus for touch operation, and electronic device
GB2598015B (en) Action recognition method and device for target object, and electronic apparatus
EP3805982A4 (en) Gesture recognition method, apparatus and device
SG11202101754WA (en) Method, apparatus and electronic device for blockchain transactions