SG11202002549WA - Driving state monitoring methods and apparatuses, driver monitoring systems, and vehicles - Google Patents

Driving state monitoring methods and apparatuses, driver monitoring systems, and vehicles

Info

Publication number
SG11202002549WA
SG11202002549WA SG11202002549WA SG11202002549WA SG11202002549WA SG 11202002549W A SG11202002549W A SG 11202002549WA SG 11202002549W A SG11202002549W A SG 11202002549WA SG 11202002549W A SG11202002549W A SG 11202002549WA SG 11202002549W A SG11202002549W A SG 11202002549WA
Authority
SG
Singapore
Prior art keywords
apparatuses
vehicles
driving state
driver
methods
Prior art date
Application number
SG11202002549WA
Inventor
Fei Wang
Chen Qian
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11202002549WA publication Critical patent/SG11202002549WA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/087—Interaction between the driver and the control system where the control system corrects or modifies a request from the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/225—Direction of gaze
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Automation & Control Theory (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Evolutionary Computation (AREA)
  • Ophthalmology & Optometry (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Eye Examination Apparatus (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
SG11202002549WA 2017-08-10 2018-04-25 Driving state monitoring methods and apparatuses, driver monitoring systems, and vehicles SG11202002549WA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/096957 WO2019028798A1 (en) 2017-08-10 2017-08-10 Method and device for monitoring driving condition, and electronic device
PCT/CN2018/084526 WO2019029195A1 (en) 2017-08-10 2018-04-25 Driving state monitoring method and device, driver monitoring system, and vehicle

Publications (1)

Publication Number Publication Date
SG11202002549WA true SG11202002549WA (en) 2020-04-29

Family

ID=65273075

Family Applications (2)

Application Number Title Priority Date Filing Date
SG11202002549WA SG11202002549WA (en) 2017-08-10 2018-04-25 Driving state monitoring methods and apparatuses, driver monitoring systems, and vehicles
SG11202009720QA SG11202009720QA (en) 2017-08-10 2019-12-27 Method and apparatus for identifying dangerous actions of persons in vehicle, electronic device and storage medium

Family Applications After (1)

Application Number Title Priority Date Filing Date
SG11202009720QA SG11202009720QA (en) 2017-08-10 2019-12-27 Method and apparatus for identifying dangerous actions of persons in vehicle, electronic device and storage medium

Country Status (8)

Country Link
US (5) US10853675B2 (en)
EP (1) EP3666577A4 (en)
JP (2) JP6933668B2 (en)
KR (2) KR102391279B1 (en)
CN (3) CN109803583A (en)
SG (2) SG11202002549WA (en)
TW (1) TWI758689B (en)
WO (3) WO2019028798A1 (en)

Families Citing this family (101)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018033137A1 (en) * 2016-08-19 2018-02-22 北京市商汤科技开发有限公司 Method, apparatus, and electronic device for displaying service object in video image
WO2019028798A1 (en) * 2017-08-10 2019-02-14 北京市商汤科技开发有限公司 Method and device for monitoring driving condition, and electronic device
JP6888542B2 (en) * 2017-12-22 2021-06-16 トヨタ自動車株式会社 Drowsiness estimation device and drowsiness estimation method
US10850746B2 (en) * 2018-07-24 2020-12-01 Harman International Industries, Incorporated Coordinating delivery of notifications to the driver of a vehicle to reduce distractions
CN113168680A (en) * 2018-12-12 2021-07-23 三菱电机株式会社 State determination device, state determination method, and state determination program
US11170240B2 (en) * 2019-01-04 2021-11-09 Cerence Operating Company Interaction system and method
US10657396B1 (en) * 2019-01-30 2020-05-19 StradVision, Inc. Method and device for estimating passenger statuses in 2 dimension image shot by using 2 dimension camera with fisheye lens
CN111626087A (en) * 2019-02-28 2020-09-04 北京市商汤科技开发有限公司 Neural network training and eye opening and closing state detection method, device and equipment
CN111661059B (en) * 2019-03-08 2022-07-08 虹软科技股份有限公司 Method and system for monitoring distracted driving and electronic equipment
CN110001652B (en) * 2019-03-26 2020-06-23 深圳市科思创动科技有限公司 Driver state monitoring method and device and terminal equipment
KR102610759B1 (en) * 2019-04-03 2023-12-08 현대자동차주식회사 Apparatus for managing a drowsy driving, system having the same and method thereof
CN111845749A (en) * 2019-04-28 2020-10-30 郑州宇通客车股份有限公司 Control method and system for automatically driving vehicle
CN109977930B (en) * 2019-04-29 2021-04-02 中国电子信息产业集团有限公司第六研究所 Fatigue driving detection method and device
GB2583742B (en) * 2019-05-08 2023-10-25 Jaguar Land Rover Ltd Activity identification method and apparatus
CN110263641A (en) * 2019-05-17 2019-09-20 成都旷视金智科技有限公司 Fatigue detection method, device and readable storage medium storing program for executing
US11281920B1 (en) * 2019-05-23 2022-03-22 State Farm Mutual Automobile Insurance Company Apparatuses, systems and methods for generating a vehicle driver signature
CN110188655A (en) * 2019-05-27 2019-08-30 上海蔚来汽车有限公司 Driving condition evaluation method, system and computer storage medium
WO2020237664A1 (en) * 2019-05-31 2020-12-03 驭势（上海）汽车科技有限公司 Driving prompt method, driving state detection method and computing device
CN112241645A (en) * 2019-07-16 2021-01-19 广州汽车集团股份有限公司 Fatigue driving detection method and system and electronic equipment
JP7047821B2 (en) * 2019-07-18 2022-04-05 トヨタ自動車株式会社 Driving support device
US10991130B2 (en) * 2019-07-29 2021-04-27 Verizon Patent And Licensing Inc. Systems and methods for implementing a sensor based real time tracking system
FR3100640B1 (en) * 2019-09-10 2021-08-06 Faurecia Interieur Ind Method and device for detecting yawns of a driver of a vehicle
CN112758098B (en) * 2019-11-01 2022-07-22 广州汽车集团股份有限公司 Vehicle driving authority take-over control method and device based on driver state grade
CN110942591B (en) * 2019-11-12 2022-06-24 博泰车联网科技(上海)股份有限公司 Driving safety reminding system and method
CN110826521A (en) * 2019-11-15 2020-02-21 爱驰汽车有限公司 Driver fatigue state recognition method, system, electronic device, and storage medium
CN110837815A (en) * 2019-11-15 2020-02-25 济宁学院 Driver state monitoring method based on convolutional neural network
CN110968718B (en) * 2019-11-19 2023-07-14 北京百度网讯科技有限公司 Target detection model negative sample mining method and device and electronic equipment
CN110909715B (en) * 2019-12-06 2023-08-04 重庆商勤科技有限公司 Method, device, server and storage medium for identifying smoking based on video image
CN111160126B (en) * 2019-12-11 2023-12-19 深圳市锐明技术股份有限公司 Driving state determining method, driving state determining device, vehicle and storage medium
JP2021096530A (en) * 2019-12-13 2021-06-24 トヨタ自動車株式会社 Operation support device, operation support program, and operation support system
CN111191573A (en) * 2019-12-27 2020-05-22 中国电子科技集团公司第十五研究所 Driver fatigue detection method based on blink rule recognition
CN111160237A (en) * 2019-12-27 2020-05-15 智车优行科技（北京）有限公司 Head pose estimation method and apparatus, electronic device, and storage medium
CN113128295A (en) * 2019-12-31 2021-07-16 湖北亿咖通科技有限公司 Method and device for identifying dangerous driving state of vehicle driver
CN113126296B (en) * 2020-01-15 2023-04-07 未来（北京）黑科技有限公司 Head-up display equipment capable of improving light utilization rate
CN111243236A (en) * 2020-01-17 2020-06-05 南京邮电大学 Fatigue driving early warning method and system based on deep learning
US11873000B2 (en) 2020-02-18 2024-01-16 Toyota Motor North America, Inc. Gesture detection for transport control
JP7462778B2 (en) * 2020-02-25 2024-04-05 華為技術有限公司 METHOD AND APPARATUS FOR RECOGNIZING SPECIAL ROAD CONDITIONS, ELECTRONIC DEVICE, AND STORAGE MEDIUM - Patent application
JP7402084B2 (en) * 2020-03-05 2023-12-20 本田技研工業株式会社 Occupant behavior determination device
US11912307B2 (en) * 2020-03-18 2024-02-27 Waymo Llc Monitoring head movements of drivers tasked with monitoring a vehicle operating in an autonomous driving mode
CN111783515A (en) * 2020-03-18 2020-10-16 北京沃东天骏信息技术有限公司 Behavior action recognition method and device
CN111460950B (en) * 2020-03-25 2023-04-18 西安工业大学 Cognitive distraction method based on head-eye evidence fusion in natural driving conversation behavior
JP7380380B2 (en) * 2020-03-26 2023-11-15 いすゞ自動車株式会社 Driving support device
CN111626101A (en) * 2020-04-13 2020-09-04 惠州市德赛西威汽车电子股份有限公司 Smoking monitoring method and system based on ADAS
WO2021240668A1 (en) * 2020-05-27 2021-12-02 三菱電機株式会社 Gesture detection device and gesture detection method
US20230154226A1 (en) * 2020-05-27 2023-05-18 Mitsubishi Electric Corporation Gesture detection apparatus and gesture detection method
CN111611970B (en) * 2020-06-01 2023-08-22 城云科技（中国）有限公司 Urban management monitoring video-based random garbage throwing behavior detection method
CN111652128B (en) * 2020-06-02 2023-09-01 浙江大华技术股份有限公司 High-altitude power operation safety monitoring method, system and storage device
CN111767823A (en) * 2020-06-23 2020-10-13 京东数字科技控股有限公司 Sleeping post detection method, device, system and storage medium
JP7359087B2 (en) * 2020-07-02 2023-10-11 トヨタ自動車株式会社 Driver monitoring device and driver monitoring method
CN111785008A (en) * 2020-07-04 2020-10-16 苏州信泰中运物流有限公司 Logistics monitoring management method and device based on GPS and Beidou positioning and computer readable storage medium
CN113920576A (en) * 2020-07-07 2022-01-11 奥迪股份公司 Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle
US20220414796A1 (en) * 2020-07-08 2022-12-29 Pilot Travel Centers, LLC Computer implemented oil field logistics
CN111797784B (en) * 2020-07-09 2024-03-05 斑马网络技术有限公司 Driving behavior monitoring method and device, electronic equipment and storage medium
US11776319B2 (en) * 2020-07-14 2023-10-03 Fotonation Limited Methods and systems to predict activity in a sequence of images
CN111860280A (en) * 2020-07-15 2020-10-30 南通大学 Deep learning-based driver violation behavior recognition system
CN111860292B (en) * 2020-07-16 2024-06-07 科大讯飞股份有限公司 Monocular camera-based human eye positioning method, device and equipment
CN111832526B (en) * 2020-07-23 2024-06-11 浙江蓝卓工业互联网信息技术有限公司 Behavior detection method and device
CN112061065B (en) * 2020-07-27 2022-05-10 大众问问(北京)信息科技有限公司 In-vehicle behavior recognition alarm method, device, electronic device and storage medium
CN111931653B (en) * 2020-08-11 2024-06-11 沈阳帝信人工智能产业研究院有限公司 Security monitoring method, device, electronic equipment and readable storage medium
US11651599B2 (en) * 2020-08-17 2023-05-16 Verizon Patent And Licensing Inc. Systems and methods for identifying distracted driver behavior from video
CN112069931A (en) * 2020-08-20 2020-12-11 深圳数联天下智能科技有限公司 State report generation method and state monitoring system
CN112016457A (en) * 2020-08-27 2020-12-01 青岛慕容信息科技有限公司 Driver distraction and dangerous driving behavior recognition method, device and storage medium
CN114201985A (en) * 2020-08-31 2022-03-18 魔门塔(苏州)科技有限公司 Method and device for detecting key points of human body
CN112084919A (en) * 2020-08-31 2020-12-15 广州小鹏汽车科技有限公司 Target detection method, target detection device, vehicle and storage medium
CN112163470A (en) * 2020-09-11 2021-01-01 高新兴科技集团股份有限公司 Fatigue state identification method, system and storage medium based on deep learning
CN112307920B (en) * 2020-10-22 2024-03-22 东云睿连(武汉)计算技术有限公司 High-risk worker behavior early warning device and method
CN112149641A (en) * 2020-10-23 2020-12-29 北京百度网讯科技有限公司 Method, device, equipment and storage medium for monitoring driving state
CN112347891B (en) * 2020-10-30 2022-02-22 南京佑驾科技有限公司 Method for detecting drinking water state in cabin based on vision
CN112270283A (en) * 2020-11-04 2021-01-26 北京百度网讯科技有限公司 Abnormal driving behavior determination method, device, equipment, vehicle and medium
CN112356839A (en) * 2020-11-06 2021-02-12 广州小鹏自动驾驶科技有限公司 Driving state monitoring method and system and automobile
JP2022077282A (en) * 2020-11-11 2022-05-23 株式会社コムテック Warning system
KR102443980B1 (en) * 2020-11-17 2022-09-21 주식회사 아르비존 Vehicle control method
TWI739675B (en) * 2020-11-25 2021-09-11 友達光電股份有限公司 Image recognition method and apparatus
CN112455452A (en) * 2020-11-30 2021-03-09 恒大新能源汽车投资控股集团有限公司 Method, device and equipment for detecting driving state
CN112528792B (en) * 2020-12-03 2024-05-31 深圳地平线机器人科技有限公司 Fatigue state detection method, device, medium and electronic equipment
CN112766050B (en) * 2020-12-29 2024-04-16 富泰华工业（深圳）有限公司 Dressing and operation checking method, computer device and storage medium
CN112660141A (en) * 2020-12-29 2021-04-16 长安大学 Method for identifying driver driving distraction behavior through driving behavior data
CN112754498B (en) * 2021-01-11 2023-05-26 一汽解放汽车有限公司 Driver fatigue detection method, device, equipment and storage medium
JP2022130086A (en) * 2021-02-25 2022-09-06 トヨタ自動車株式会社 Taxi vehicle and taxi system
CN113011347B (en) * 2021-03-23 2022-01-07 深圳信可通讯技术有限公司 Intelligent driving method and device based on artificial intelligence and related products
CN113313019A (en) * 2021-05-27 2021-08-27 展讯通信(天津)有限公司 Distracted driving detection method, system and related equipment
CN113139531A (en) * 2021-06-21 2021-07-20 博泰车联网(南京)有限公司 Drowsiness state detection method and apparatus, electronic device, and readable storage medium
CN113486759B (en) * 2021-06-30 2023-04-28 上海商汤临港智能科技有限公司 Dangerous action recognition method and device, electronic equipment and storage medium
CN113537135A (en) * 2021-07-30 2021-10-22 三一重机有限公司 Driving monitoring method, device and system and readable storage medium
CN113734173B (en) * 2021-09-09 2023-06-20 东风汽车集团股份有限公司 Intelligent vehicle monitoring method, device and storage medium
KR102542683B1 (en) * 2021-09-16 2023-06-14 국민대학교산학협력단 Method and apparatus for classifying action based on hand tracking
FR3127355B1 (en) * 2021-09-20 2023-09-29 Renault Sas method of selecting an operating mode of an image capture device for facial recognition
KR102634012B1 (en) * 2021-10-12 2024-02-07 경북대학교 산학협력단 Apparatus for detecting driver behavior using object classification based on deep running
CN114162130B (en) * 2021-10-26 2023-06-20 东风柳州汽车有限公司 Driving assistance mode switching method, device, equipment and storage medium
CN114187581B (en) * 2021-12-14 2024-04-09 安徽大学 Driver distraction fine granularity detection method based on unsupervised learning
CN114005105B (en) * 2021-12-30 2022-04-12 青岛以萨数据技术有限公司 Driving behavior detection method and device and electronic equipment
US11999233B2 (en) * 2022-01-18 2024-06-04 Toyota Jidosha Kabushiki Kaisha Driver monitoring device, storage medium storing computer program for driver monitoring, and driver monitoring method
CN114582090A (en) * 2022-02-27 2022-06-03 武汉铁路职业技术学院 Rail vehicle drives monitoring and early warning system
CN114666378A (en) * 2022-03-03 2022-06-24 武汉科技大学 Vehicle-mounted remote monitoring system of heavy-duty diesel vehicle
KR20230145614A (en) 2022-04-07 2023-10-18 한국기술교육대학교 산학협력단 System and method for monitoring driver safety
CN115035502A (en) * 2022-07-08 2022-09-09 北京百度网讯科技有限公司 Driver behavior monitoring method and device, electronic equipment and storage medium
CN114898341B (en) * 2022-07-14 2022-12-20 苏州魔视智能科技有限公司 Fatigue driving early warning method and device, electronic equipment and storage medium
CN115601709B (en) * 2022-11-07 2023-10-27 北京万理软件开发有限公司 Colliery staff violation statistics system, method, device and storage medium
CN116311181B (en) * 2023-03-21 2023-09-12 重庆利龙中宝智能技术有限公司 Method and system for rapidly detecting abnormal driving
CN116052136B (en) * 2023-03-27 2023-09-05 中国科学技术大学 Distraction detection method, vehicle-mounted controller, and computer storage medium
CN116645732B (en) * 2023-07-19 2023-10-10 厦门工学院 Site dangerous activity early warning method and system based on computer vision

Family Cites Families (113)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2546415B2 (en) * 1990-07-09 1996-10-23 トヨタ自動車株式会社 Vehicle driver monitoring device
US7738678B2 (en) * 1995-06-07 2010-06-15 Automotive Technologies International, Inc. Light modulation techniques for imaging objects in or around a vehicle
JP3843513B2 (en) * 1996-12-24 2006-11-08 トヨタ自動車株式会社 Vehicle alarm device
JPH11161798A (en) * 1997-12-01 1999-06-18 Toyota Motor Corp Vehicle driver monitoring device
JP3383594B2 (en) * 1998-09-29 2003-03-04 沖電気工業株式会社 Eye opening measurement device
JP3495934B2 (en) * 1999-01-08 2004-02-09 矢崎総業株式会社 Accident prevention system
US20120231773A1 (en) * 1999-08-27 2012-09-13 Lipovski Gerald John Jack Cuboid-based systems and methods for safe mobile texting.
AU2001258867A1 (en) * 2000-05-04 2001-11-12 Jin-Ho Song Automatic vehicle management apparatus and method using wire and wireless communication network
JP2003131785A (en) * 2001-10-22 2003-05-09 Toshiba Corp Interface device, operation control method and program product
US6926429B2 (en) * 2002-01-30 2005-08-09 Delphi Technologies, Inc. Eye tracking/HUD system
EP2305106A1 (en) * 2002-02-19 2011-04-06 Volvo Technology Corporation Method for monitoring and managing driver attention loads
US6873714B2 (en) * 2002-02-19 2005-03-29 Delphi Technologies, Inc. Auto calibration and personalization of eye tracking system using larger field of view imager with higher resolution
JP2004017939A (en) * 2002-06-20 2004-01-22 Denso Corp Apparatus and program for transmitting information for vehicle
JP3951231B2 (en) * 2002-12-03 2007-08-01 オムロン株式会社 Safe travel information mediation system, safe travel information mediation device used therefor, and safe travel information confirmation method
BRPI0411056A (en) * 2003-06-06 2007-04-17 Volvo Technology Corp method and arrangement for controlling vehicle subsystems based on interpretive driver activity
KR100494848B1 (en) 2004-04-16 2005-06-13 에이치케이이카 주식회사 Method for sensing if person sleeps inside vehicle and device therefor
DE102005018697A1 (en) * 2004-06-02 2005-12-29 Daimlerchrysler Ag Method and device for warning a driver in the event of leaving the traffic lane
JP4564320B2 (en) 2004-09-29 2010-10-20 アイシン精機株式会社 Driver monitor system
CN1680779A (en) * 2005-02-04 2005-10-12 江苏大学 Fatigue monitoring method and device for driver
US7253739B2 (en) * 2005-03-10 2007-08-07 Delphi Technologies, Inc. System and method for determining eye closure state
WO2006131926A2 (en) * 2005-06-09 2006-12-14 Drive Diagnostics Ltd. System and method for displaying a driving profile
US20070041552A1 (en) * 2005-06-13 2007-02-22 Moscato Jonathan D Driver-attentive notification system
JP2007237919A (en) * 2006-03-08 2007-09-20 Toyota Motor Corp Input operation device for vehicle
CN101489467B (en) * 2006-07-14 2011-05-04 松下电器产业株式会社 Visual axis direction detection device and visual line direction detection method
US20130150004A1 (en) * 2006-08-11 2013-06-13 Michael Rosen Method and apparatus for reducing mobile phone usage while driving
CN100462047C (en) * 2007-03-21 2009-02-18 汤一平 Safe driving auxiliary device based on omnidirectional computer vision
CN101030316B (en) * 2007-04-17 2010-04-21 北京中星微电子有限公司 Safety driving monitoring system and method for vehicle
JP2008302741A (en) * 2007-06-05 2008-12-18 Toyota Motor Corp Driving support device
US20130275899A1 (en) * 2010-01-18 2013-10-17 Apple Inc. Application Gateway for Providing Different User Interfaces for Limited Distraction and Non-Limited Distraction Contexts
JP5208711B2 (en) 2008-12-17 2013-06-12 アイシン精機株式会社 Eye open / close discrimination device and program
CN101540090B (en) * 2009-04-14 2011-06-15 华南理工大学 Driver fatigue monitoring method based on multivariate information fusion
US10019634B2 (en) * 2010-06-04 2018-07-10 Masoud Vaziri Method and apparatus for an eye tracking wearable computer
US9460601B2 (en) * 2009-09-20 2016-10-04 Tibet MIMAR Driver distraction and drowsiness warning and sleepiness reduction for accident avoidance
CN101877051A (en) * 2009-10-30 2010-11-03 江苏大学 Driver attention state monitoring method and device
CN101692980B (en) 2009-10-30 2011-06-08 深圳市汉华安道科技有限责任公司 Method and device for detecting fatigue driving
US20110224875A1 (en) * 2010-03-10 2011-09-15 Cuddihy Mark A Biometric Application of a Polymer-based Pressure Sensor
US10592757B2 (en) * 2010-06-07 2020-03-17 Affectiva, Inc. Vehicular cognitive data collection using multiple devices
US10074024B2 (en) * 2010-06-07 2018-09-11 Affectiva, Inc. Mental state analysis using blink rate for vehicles
CN101950355B (en) * 2010-09-08 2012-09-05 中国人民解放军国防科学技术大学 Method for detecting fatigue state of driver based on digital video
JP5755012B2 (en) * 2011-04-21 2015-07-29 キヤノン株式会社 Information processing apparatus, processing method thereof, program, and imaging apparatus
US11270699B2 (en) * 2011-04-22 2022-03-08 Emerging Automotive, Llc Methods and vehicles for capturing emotion of a human driver and customizing vehicle response
JP5288045B2 (en) * 2011-07-11 2013-09-11 トヨタ自動車株式会社 Emergency vehicle evacuation device
US8744642B2 (en) * 2011-09-16 2014-06-03 Lytx, Inc. Driver identification based on face data
CN102436715B (en) * 2011-11-25 2013-12-11 大连海创高科信息技术有限公司 Detection method for fatigue driving
KR20140025812A (en) * 2012-08-22 2014-03-05 삼성전기주식회사 Apparatus and method for sensing drowsy driving
JP2014048760A (en) * 2012-08-29 2014-03-17 Denso Corp Information presentation system, information presentation device, and information center for presenting information to vehicle driver
JP6036065B2 (en) * 2012-09-14 2016-11-30 富士通株式会社 Gaze position detection device and gaze position detection method
US9405982B2 (en) * 2013-01-18 2016-08-02 GM Global Technology Operations LLC Driver gaze detection system
US20140272811A1 (en) * 2013-03-13 2014-09-18 Mighty Carma, Inc. System and method for providing driving and vehicle related assistance to a driver
US10210761B2 (en) * 2013-09-30 2019-02-19 Sackett Solutions & Innovations, LLC Driving assistance systems and methods
JP5939226B2 (en) * 2013-10-16 2016-06-22 トヨタ自動車株式会社 Driving assistance device
KR101537936B1 (en) * 2013-11-08 2015-07-21 현대자동차주식회사 Vehicle and control method for the same
US10417486B2 (en) * 2013-12-30 2019-09-17 Alcatel Lucent Driver behavior monitoring systems and methods for driver behavior monitoring
JP6150258B2 (en) * 2014-01-15 2017-06-21 みこらった株式会社 Self-driving car
JP6213282B2 (en) 2014-02-12 2017-10-18 株式会社デンソー Driving assistance device
US20150310758A1 (en) * 2014-04-26 2015-10-29 The Travelers Indemnity Company Systems, methods, and apparatus for generating customized virtual reality experiences
US20160001785A1 (en) * 2014-07-07 2016-01-07 Chin-Jung Hsu Motion sensing system and method
US9714037B2 (en) * 2014-08-18 2017-07-25 Trimble Navigation Limited Detection of driver behaviors using in-vehicle systems and methods
US9796391B2 (en) * 2014-10-13 2017-10-24 Verizon Patent And Licensing Inc. Distracted driver prevention systems and methods
TW201615457A (en) * 2014-10-30 2016-05-01 鴻海精密工業股份有限公司 Safety recognition and reaction system and method utilized in automobile
CN104408879B (en) * 2014-11-19 2017-02-01 湖南工学院 Method, device and system for processing fatigue driving early warning
US10614726B2 (en) * 2014-12-08 2020-04-07 Life Long Driver, Llc Behaviorally-based crash avoidance system
CN104574817A (en) * 2014-12-25 2015-04-29 清华大学苏州汽车研究院（吴江） Machine vision-based fatigue driving pre-warning system suitable for smart phone
JP2016124364A (en) * 2014-12-26 2016-07-11 本田技研工業株式会社 Awakener
US10705521B2 (en) 2014-12-30 2020-07-07 Visteon Global Technologies, Inc. Autonomous driving interface
DE102015200697A1 (en) * 2015-01-19 2016-07-21 Robert Bosch Gmbh Method and apparatus for detecting microsleep of a driver of a vehicle
CN104688251A (en) * 2015-03-02 2015-06-10 西安邦威电子科技有限公司 Method for detecting fatigue driving and driving in abnormal posture under multiple postures
FR3033303B1 (en) * 2015-03-03 2017-02-24 Renault Sas DEVICE AND METHOD FOR PREDICTING A LEVEL OF VIGILANCE IN A DRIVER OF A MOTOR VEHICLE.
EP3286057B1 (en) * 2015-04-20 2021-06-09 Bayerische Motoren Werke Aktiengesellschaft Apparatus and method for controlling a user situation awareness modification of a user of a vehicle, and a user situation awareness modification processing system
CN105139583A (en) * 2015-06-23 2015-12-09 南京理工大学 Vehicle danger prompting method based on portable intelligent equipment
CN106327801B (en) * 2015-07-07 2019-07-26 北京易车互联信息技术有限公司 Method for detecting fatigue driving and device
CN204915314U (en) * 2015-07-21 2015-12-30 戴井之 Car safe driving device
CN105096528B (en) * 2015-08-05 2017-07-11 广州云从信息科技有限公司 A kind of method for detecting fatigue driving and system
EP3345127A4 (en) * 2015-08-31 2019-08-21 SRI International Method and system for monitoring driving behaviors
CN105261153A (en) * 2015-11-03 2016-01-20 北京奇虎科技有限公司 Vehicle running monitoring method and device
CN105354985B (en) * 2015-11-04 2018-01-12 中国科学院上海高等研究院 Fatigue driving monitoring apparatus and method
JP6641916B2 (en) * 2015-11-20 2020-02-05 オムロン株式会社 Automatic driving support device, automatic driving support system, automatic driving support method, and automatic driving support program
CN105574487A (en) * 2015-11-26 2016-05-11 中国第一汽车股份有限公司 Facial feature based driver attention state detection method
CN105654753A (en) * 2016-01-08 2016-06-08 北京乐驾科技有限公司 Intelligent vehicle-mounted safe driving assistance method and system
CN105769120B (en) * 2016-01-27 2019-01-22 深圳地平线机器人科技有限公司 Method for detecting fatigue driving and device
FR3048544B1 (en) * 2016-03-01 2021-04-02 Valeo Comfort & Driving Assistance DEVICE AND METHOD FOR MONITORING A DRIVER OF A MOTOR VEHICLE
US10108260B2 (en) * 2016-04-01 2018-10-23 Lg Electronics Inc. Vehicle control apparatus and method thereof
WO2017208529A1 (en) * 2016-06-02 2017-12-07 オムロン株式会社 Driver state estimation device, driver state estimation system, driver state estimation method, driver state estimation program, subject state estimation device, subject state estimation method, subject state estimation program, and recording medium
US20180012090A1 (en) * 2016-07-07 2018-01-11 Jungo Connectivity Ltd. Visual learning system and method for determining a driver's state
JP2018022229A (en) * 2016-08-01 2018-02-08 株式会社デンソーテン Safety driving behavior notification system and safety driving behavior notification method
CN106218405A (en) * 2016-08-12 2016-12-14 深圳市元征科技股份有限公司 Fatigue driving monitoring method and cloud server
CN106446811A (en) * 2016-09-12 2017-02-22 北京智芯原动科技有限公司 Deep-learning-based driver's fatigue detection method and apparatus
US9928432B1 (en) * 2016-09-14 2018-03-27 Nauto Global Limited Systems and methods for near-crash determination
CN106355838A (en) * 2016-10-28 2017-01-25 深圳市美通视讯科技有限公司 Fatigue driving detection method and system
US10246014B2 (en) * 2016-11-07 2019-04-02 Nauto, Inc. System and method for driver distraction determination
US10467488B2 (en) * 2016-11-21 2019-11-05 TeleLingo Method to analyze attention margin and to prevent inattentive and unsafe driving
CN106709420B (en) * 2016-11-21 2020-07-10 厦门瑞为信息技术有限公司 Method for monitoring driving behavior of commercial vehicle driver
CN106585629B (en) * 2016-12-06 2019-07-12 广东泓睿科技有限公司 A kind of control method for vehicle and device
CN106585624B (en) * 2016-12-07 2019-07-26 深圳市元征科技股份有限公司 Driver status monitoring method and device
CN106781282A (en) * 2016-12-29 2017-05-31 天津中科智能识别产业技术研究院有限公司 A kind of intelligent travelling crane driver fatigue early warning system
CN106909879A (en) * 2017-01-11 2017-06-30 开易（北京）科技有限公司 A kind of method for detecting fatigue driving and system
CN106985750A (en) * 2017-01-17 2017-07-28 戴姆勒股份公司 In-car safety monitoring system and automobile for vehicle
FR3063557B1 (en) * 2017-03-03 2022-01-14 Valeo Comfort & Driving Assistance DEVICE FOR DETERMINING THE STATE OF ATTENTION OF A VEHICLE DRIVER, ON-BOARD SYSTEM COMPRISING SUCH A DEVICE, AND ASSOCIATED METHOD
DE112017007252T5 (en) * 2017-03-14 2019-12-19 Omron Corporation DRIVER MONITORING DEVICE, DRIVER MONITORING METHOD, LEARNING DEVICE AND LEARNING METHOD
US10922566B2 (en) * 2017-05-09 2021-02-16 Affectiva, Inc. Cognitive state evaluation for vehicle navigation
US10289938B1 (en) * 2017-05-16 2019-05-14 State Farm Mutual Automobile Insurance Company Systems and methods regarding image distification and prediction models
US10402687B2 (en) * 2017-07-05 2019-09-03 Perceptive Automata, Inc. System and method of predicting human interaction with vehicles
US10592785B2 (en) * 2017-07-12 2020-03-17 Futurewei Technologies, Inc. Integrated system for detection of driver condition
WO2019028798A1 (en) * 2017-08-10 2019-02-14 北京市商汤科技开发有限公司 Method and device for monitoring driving condition, and electronic device
JP6666892B2 (en) * 2017-11-16 2020-03-18 株式会社Ｓｕｂａｒｕ Driving support device and driving support method
CN107933471B (en) * 2017-12-04 2019-12-20 惠州市德赛西威汽车电子股份有限公司 Accident active calling rescue method and vehicle-mounted automatic help-seeking system
CN108407813A (en) * 2018-01-25 2018-08-17 惠州市德赛西威汽车电子股份有限公司 A kind of antifatigue safe driving method of vehicle based on big data
US10322728B1 (en) * 2018-02-22 2019-06-18 Futurewei Technologies, Inc. Method for distress and road rage detection
US10776644B1 (en) * 2018-03-07 2020-09-15 State Farm Mutual Automobile Insurance Company Image analysis technologies for assessing safety of vehicle operation
US10970571B2 (en) * 2018-06-04 2021-04-06 Shanghai Sensetime Intelligent Technology Co., Ltd. Vehicle control method and system, vehicle-mounted intelligent system, electronic device, and medium
US10915769B2 (en) * 2018-06-04 2021-02-09 Shanghai Sensetime Intelligent Technology Co., Ltd Driving management methods and systems, vehicle-mounted intelligent systems, electronic devices, and medium
JP6870660B2 (en) * 2018-06-08 2021-05-12 トヨタ自動車株式会社 Driver monitoring device
CN108961669A (en) * 2018-07-19 2018-12-07 上海小蚁科技有限公司 The safe early warning method and device, storage medium, server of net about vehicle

Also Published As

Publication number Publication date
WO2019029195A1 (en) 2019-02-14
KR102391279B1 (en) 2022-04-26
US20210049387A1 (en) 2021-02-18
JP2021517313A (en) 2021-07-15
JP6933668B2 (en) 2021-09-08
US20210049388A1 (en) 2021-02-18
CN109937152B (en) 2022-03-25
US10853675B2 (en) 2020-12-01
US20210009150A1 (en) 2021-01-14
KR20200051632A (en) 2020-05-13
US20210049386A1 (en) 2021-02-18
EP3666577A4 (en) 2020-08-19
WO2019028798A1 (en) 2019-02-14
EP3666577A1 (en) 2020-06-17
TW202033395A (en) 2020-09-16
WO2020173213A1 (en) 2020-09-03
CN110399767A (en) 2019-11-01
CN109803583A (en) 2019-05-24
US20190065873A1 (en) 2019-02-28
KR20200124278A (en) 2020-11-02
JP2019536673A (en) 2019-12-19
TWI758689B (en) 2022-03-21
CN109937152A (en) 2019-06-25
SG11202009720QA (en) 2020-10-29

Similar Documents

Publication Publication Date Title
SG11202002549WA (en) Driving state monitoring methods and apparatuses, driver monitoring systems, and vehicles
EP3721200A4 (en) Systems and methods for monitoring off-road vehicles
SG11202009437SA (en) Driving state detection method and apparatus, driver monitoring system and vehicle
EP3602511A4 (en) Vehicle behavior monitoring systems and methods
EP3478557A4 (en) System and method for driver monitoring
EP3369623A4 (en) Vehicular illumination device, vehicle system, and vehicle
EP3413289A4 (en) Automatic driving control device, vehicle, and automatic driving control method
EP3624089A4 (en) Vehicle control device, vehicle control method, and vehicle control system
EP3369621A4 (en) Vehicular illumination device, vehicle system, and vehicle
SG10201705352TA (en) Autonomous driving system and autonomous driving vehicle
IL244938A0 (en) Vehicle parking system, and method and device thereof
EP3182392A4 (en) Driving fatigue early warning method and system for use in vehicle
EP3278188A4 (en) Device, method and system for an autonomous vehicle
EP3369617A4 (en) Vehicular illumination device, vehicle system, and vehicle
EP3303088A4 (en) Vehicle monitoring system
EP3506236A4 (en) Vehicle state control device and method, and vehicle
EP3538844A4 (en) Systems and methods for monitoring a vehicle
EP3357760A4 (en) Monitoring system and vehicle control device
EP3396412A4 (en) Vehicular sensor, and vehicle provided with same
EP3225492A4 (en) Vehicular control device and vehicle control method
EP3553471A4 (en) Road identifying device, and vehicle control system
EP3253632B8 (en) Method for monitoring a brake for motor vehicles, brake system for implementing the method, and motor vehicle comprising same
EP3395615A4 (en) Vehicular illumination device, and vehicle and illumination control system
EP3561945A4 (en) Temperature conditioning unit, temperature conditioning system, and vehicle
EP3509912A4 (en) Dampening driver airbag assemblies and related systems and methods