SG11202004942RA - Passenger state analysis method and apparatus, vehicle, electronic device and storage medium - Google Patents

Passenger state analysis method and apparatus, vehicle, electronic device and storage medium

Info

Publication number
SG11202004942RA
SG11202004942RA SG11202004942RA SG11202004942RA SG11202004942RA SG 11202004942R A SG11202004942R A SG 11202004942RA SG 11202004942R A SG11202004942R A SG 11202004942RA SG 11202004942R A SG11202004942R A SG 11202004942RA SG 11202004942R A SG11202004942R A SG 11202004942RA
Authority
SG
Singapore
Prior art keywords
vehicle
electronic device
storage medium
analysis method
state analysis
Prior art date
Application number
SG11202004942RA
Inventor
Chengming Yi
Guanhua Liang
Yang Wei
Renbo Qin
Chendi Yu
Original Assignee
Shanghai Sensetime Intelligent Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Sensetime Intelligent Tech Co Ltd filed Critical Shanghai Sensetime Intelligent Tech Co Ltd
Publication of SG11202004942RA publication Critical patent/SG11202004942RA/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/29Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area inside the vehicle, e.g. for viewing passengers or cargo
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/593Recognising seat occupancy
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/23Recognition of whole body movements, e.g. for sport training
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8006Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
    • B60R2300/8013Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo for child monitoring
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/01Occupants other than the driver
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/178Human faces, e.g. facial parts, sketches or expressions estimating age from face image; using age information for improving recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mechanical Engineering (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Automation & Control Theory (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • General Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Transportation (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)
  • Automatic Disk Changers (AREA)
  • Devices For Checking Fares Or Tickets At Control Points (AREA)
SG11202004942RA 2018-10-19 2019-10-18 Passenger state analysis method and apparatus, vehicle, electronic device and storage medium SG11202004942RA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811224257.XA CN111079474A (en) 2018-10-19 2018-10-19 Passenger state analysis method and device, vehicle, electronic device, and storage medium
PCT/CN2019/111929 WO2020078462A1 (en) 2018-10-19 2019-10-18 Passenger state analysis method and device, vehicle, electronic device, and storage medium

Publications (1)

Publication Number Publication Date
SG11202004942RA true SG11202004942RA (en) 2020-06-29

Family

ID=70284045

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202004942RA SG11202004942RA (en) 2018-10-19 2019-10-18 Passenger state analysis method and apparatus, vehicle, electronic device and storage medium

Country Status (6)

Country Link
US (1) US11386676B2 (en)
JP (1) JP2021504814A (en)
KR (1) KR102446686B1 (en)
CN (1) CN111079474A (en)
SG (1) SG11202004942RA (en)
WO (1) WO2020078462A1 (en)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11550320B2 (en) * 2019-03-18 2023-01-10 Pony Ai Inc. Vehicle redundant processing resource usage
US11778369B2 (en) * 2019-05-21 2023-10-03 Nippon Telegraph And Telephone Corporation Notification apparatus, notification method, and program
US11132585B2 (en) * 2019-12-17 2021-09-28 Robert Bosch Gmbh System and method for detecting abnormal passenger behavior in autonomous vehicles
US11518391B1 (en) * 2020-05-26 2022-12-06 BlueOwl, LLC Systems and methods for identifying distracted driving events using semi-supervised clustering
US11810198B2 (en) 2020-05-26 2023-11-07 BlueOwl, LLC Systems and methods for identifying distracted driving events using common features
US11518392B1 (en) 2020-06-26 2022-12-06 BlueOwl, LLC Systems and methods for identifying distracted driving events using unsupervised clustering
CN112001230B (en) * 2020-07-09 2024-07-30 浙江大华技术股份有限公司 Sleep behavior monitoring method and device, computer equipment and readable storage medium
US11458995B2 (en) * 2020-07-28 2022-10-04 Motional Ad Llc Passenger health screening and monitoring
CN112084919A (en) * 2020-08-31 2020-12-15 广州小鹏汽车科技有限公司 Target detection method, target detection device, vehicle and storage medium
JP7370073B2 (en) * 2020-09-30 2023-10-27 株式会社ユピテル Systems and programs etc.
JP7480694B2 (en) 2020-12-22 2024-05-10 トヨタ自動車株式会社 Information processing device, information processing method, and program
CN112507976A (en) * 2021-01-08 2021-03-16 蔚来汽车科技(安徽)有限公司 In-vehicle child protection method, device, computer-readable storage medium and vehicle
CN112906486B (en) * 2021-01-26 2023-09-12 吉利汽车研究院(宁波)有限公司 Passenger condition detection method, control method and system for unmanned taxi
CN112906515B (en) * 2021-02-03 2024-07-19 珠海研果科技有限公司 In-vehicle abnormal behavior identification method, system, electronic equipment and storage medium
WO2022209347A1 (en) * 2021-03-31 2022-10-06 日本電気株式会社 Information processing device, information processing method, computer-readable medium, and information processing system
JP7305698B2 (en) * 2021-04-06 2023-07-10 矢崎総業株式会社 Vehicle congestion determination method and vehicle congestion determination system
CN113409543A (en) * 2021-06-24 2021-09-17 广西宁达汽车科技有限公司 System and method for caring for children in vehicle
CN113581187A (en) * 2021-08-06 2021-11-02 阿尔特汽车技术股份有限公司 Control method for vehicle, and corresponding system, vehicle, apparatus, and medium
CN113947783A (en) * 2021-10-20 2022-01-18 新疆爱华盈通信息技术有限公司 Personnel riding monitoring management method and system
CN113920492A (en) * 2021-10-29 2022-01-11 上海商汤临港智能科技有限公司 Method and device for detecting people in vehicle, electronic equipment and storage medium
CN114475507A (en) * 2022-01-26 2022-05-13 广汽丰田汽车有限公司 In-vehicle child safety warning method and device, electronic equipment and storage medium
KR102457629B1 (en) * 2022-01-26 2022-10-21 이상배 Apparatus for real-time condition check of vehicle back seat
US20230339366A1 (en) * 2022-04-20 2023-10-26 Aptiv Technologies Limited In-Vehicle Occupant Monitoring and Calming System
CN114677651B (en) * 2022-05-30 2022-09-27 山东极视角科技有限公司 Passenger flow statistical method based on low-image-quality low-frame-rate video and related device
CN114973155B (en) * 2022-08-01 2022-10-21 鹰驾科技(深圳)有限公司 Intelligent monitoring, analyzing and managing system based on AI image recognition behaviors
CN115512315B (en) * 2022-11-01 2023-04-18 深圳市城市交通规划设计研究中心股份有限公司 Non-motor vehicle child riding detection method, electronic equipment and storage medium
CN116811915A (en) * 2023-06-30 2023-09-29 清华大学 Vehicle decision method and device based on passenger brain electrical signals and computer equipment

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1996054B (en) * 2006-11-23 2010-12-08 浙江工业大学 Debris flow early-warning predictor based on omnibearing visual range
JP2009219555A (en) * 2008-03-13 2009-10-01 Toyota Motor Corp Drowsiness detector, driving support apparatus, drowsiness detecting method
US9517679B2 (en) 2009-03-02 2016-12-13 Flir Systems, Inc. Systems and methods for monitoring vehicle occupants
WO2012139242A1 (en) * 2011-04-11 2012-10-18 Intel Corporation Personalized program selection system and method
CN102201188A (en) * 2011-05-25 2011-09-28 华侨大学 Building television advertisement system oriented intelligent control device and method
JP2015067254A (en) 2013-10-01 2015-04-13 パナソニックIpマネジメント株式会社 On-vehicle equipment and vehicle mounted therewith
JP2015096413A (en) 2013-10-11 2015-05-21 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America Processing method, program, processing device, and detection system
CN103978932B (en) 2014-05-16 2016-06-29 长安大学 The detecting device of a kind of bus driver dangerous driving and detection method
JP2016030478A (en) 2014-07-28 2016-03-07 ポップニート株式会社 In-vehicle information processing device, in-vehicle information processing method, program, and camera
US9594947B1 (en) * 2014-09-30 2017-03-14 Amazon Technologies, Inc. Aspect ratio validation
KR102428319B1 (en) * 2014-12-24 2022-08-02 주식회사 케이티 Customer information provision method, device and computer program
CN104731649A (en) * 2015-04-21 2015-06-24 中国建设银行股份有限公司 Multi-task processing method and multi-task processing device
JP2017007548A (en) * 2015-06-23 2017-01-12 株式会社デンソー Rear seat state display control device
US20160379466A1 (en) 2015-06-26 2016-12-29 Continental Automotive Systems, Inc. System For Warning A Driver That A Passenger Is Left In A Vehicle
US9942522B2 (en) * 2015-08-19 2018-04-10 Faraday&Future Inc. In-vehicle camera system
CN107924528A (en) 2015-09-04 2018-04-17 罗伯特·博世有限公司 Access and control for the driving of autonomous driving vehicle
US9663032B1 (en) * 2015-11-09 2017-05-30 Ford Global Technologies, Llc Child seat monitoring system and method
GB201521885D0 (en) 2015-12-11 2016-01-27 Univ London Queen Mary Method and apparatus for monitoring
CN106878364A (en) * 2015-12-11 2017-06-20 比亚迪股份有限公司 Information-pushing method, system, Cloud Server and vehicle for vehicle
CN105975916B (en) * 2016-04-28 2019-10-11 西安电子科技大学 Age estimation method based on multi output convolutional neural networks and ordinal regression
JP6443393B2 (en) 2016-06-01 2018-12-26 トヨタ自動車株式会社 Action recognition device, learning device, method and program
CN106652025B (en) * 2016-12-20 2019-10-01 五邑大学 A kind of three-dimensional face modeling method and printing equipment based on video flowing Yu face multi-attribute Matching
CN106781285A (en) * 2017-01-09 2017-05-31 重庆新派新智能科技有限公司 The alarming method for power and system of fatigue driving
CN106985750A (en) * 2017-01-17 2017-07-28 戴姆勒股份公司 In-car safety monitoring system and automobile for vehicle
CN107341438A (en) 2017-01-24 2017-11-10 问众智能信息科技(北京)有限公司 The method and apparatus of in-car safety monitoring based on computer vision
KR101893554B1 (en) * 2017-02-14 2018-08-30 영남대학교 산학협력단 Method and apparatus of recognizing facial expression base on multi-modal
JP6714552B2 (en) * 2017-08-24 2020-06-24 本田技研工業株式会社 Vehicle control device
CN108369645A (en) * 2018-02-08 2018-08-03 深圳前海达闼云端智能科技有限公司 Taxi operation monitoring method, device, storage medium and system
US20190391581A1 (en) * 2018-06-26 2019-12-26 Uber Technologies, Inc. Passenger Health Monitoring and Intervention for Autonomous Vehicles

Also Published As

Publication number Publication date
US20200285870A1 (en) 2020-09-10
CN111079474A (en) 2020-04-28
JP2021504814A (en) 2021-02-15
WO2020078462A1 (en) 2020-04-23
US11386676B2 (en) 2022-07-12
KR20200079277A (en) 2020-07-02
KR102446686B1 (en) 2022-09-23

Similar Documents

Publication Publication Date Title
SG11202004942RA (en) Passenger state analysis method and apparatus, vehicle, electronic device and storage medium
SG11202009419RA (en) Vehicle door unlocking method and apparatus, system, vehicle, electronic device and storage medium
SG11202110895QA (en) Vehicle door control method, apparatus, and system, vehicle, electronic device, and storage medium
SG11202005729TA (en) Collision control method and apparatus, and electronic device and storage medium
SG11202009720QA (en) Method and apparatus for identifying dangerous actions of persons in vehicle, electronic device and storage medium
SG11201913733QA (en) Pedestrian re-identification method and apparatus, electronic device, and storage medium
SG11202004944PA (en) Child state analysis method and apparatus, vehicle, electronic device and storage medium
EP3570240A4 (en) Vehicle assessment method and device and apparatus
EP3722901A4 (en) Vehicle trouble diagnosis method, vehicle trouble diagnosis apparatus and electronic device
SG11202006120XA (en) Parking charging method, apparatus, and electronic device
EP3806064A4 (en) Method and apparatus for detecting parking space usage condition, electronic device, and storage medium
EP3477550A4 (en) Vehicle license plate classification method and system based on deep learning, electronic apparatus, and storage medium
EP3520045B8 (en) Image-based vehicle loss assessment method, apparatus, and system, and electronic device
SG11202005736VA (en) Collision control method and apparatus, and electronic device and storage medium
SG11202100920XA (en) Invoice Access Method And Apparatus Based On Blockchain, And Electronic Device
SG11202003818YA (en) Key point detection method and apparatus, electronic device, and storage medium
SG11202101462WA (en) Image stitching method and device, on-board image processing device, electronic apparatus, and storage medium
EP3734570A4 (en) Vehicle detection method, apparatus, device and readable storage medium
SG11202002741VA (en) Method and apparatus for anti-spoofing detection, electronic device, and storage medium
SG11202007158UA (en) Object prediction method and apparatus, electronic device and storage medium
SG11202108000YA (en) Driving early warning method and apparatus, electronic device, and computer storage medium
SG11202005080VA (en) Method, apparatus and system for liveness detection, electronic device, and storage medium
EP3796110A4 (en) Method and apparatus for determining controlled object, and storage medium and electronic device
EP3677465A4 (en) Battery equalization method and system, vehicle, storage medium, and electronic device
SG11202004728XA (en) Method and apparatus for processing loss assessment data for car insurance and processing device