EP3924207A4 - System and method for correlating user attention direction and outside view - Google Patents

System and method for correlating user attention direction and outside view Download PDF

Info

Publication number
EP3924207A4
EP3924207A4 EP20755721.6A EP20755721A EP3924207A4 EP 3924207 A4 EP3924207 A4 EP 3924207A4 EP 20755721 A EP20755721 A EP 20755721A EP 3924207 A4 EP3924207 A4 EP 3924207A4
Authority
EP
European Patent Office
Prior art keywords
outside view
user attention
attention direction
correlating user
correlating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP20755721.6A
Other languages
German (de)
French (fr)
Other versions
EP3924207A1 (en
Inventor
John P. Cordell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xevo Inc
Original Assignee
Xevo Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xevo Inc filed Critical Xevo Inc
Publication of EP3924207A1 publication Critical patent/EP3924207A1/en
Publication of EP3924207A4 publication Critical patent/EP3924207A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/85—Arrangements for transferring vehicle- or driver-related data
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/186—Displaying information according to relevancy
    • B60K2360/1868—Displaying information according to relevancy according to driving situations
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/592—Data transfer involving external databases
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B60K35/654—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive the user being the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/582—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of traffic signs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Transportation (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Navigation (AREA)
  • Image Analysis (AREA)
EP20755721.6A 2019-02-13 2020-02-12 System and method for correlating user attention direction and outside view Withdrawn EP3924207A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/275,294 US10882398B2 (en) 2019-02-13 2019-02-13 System and method for correlating user attention direction and outside view
PCT/US2020/017962 WO2020167974A1 (en) 2019-02-13 2020-02-12 System and method for correlating user attention direction and outside view

Publications (2)

Publication Number Publication Date
EP3924207A1 EP3924207A1 (en) 2021-12-22
EP3924207A4 true EP3924207A4 (en) 2022-10-12

Family

ID=71946574

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20755721.6A Withdrawn EP3924207A4 (en) 2019-02-13 2020-02-12 System and method for correlating user attention direction and outside view

Country Status (6)

Country Link
US (2) US10882398B2 (en)
EP (1) EP3924207A4 (en)
JP (1) JP2022519895A (en)
AU (1) AU2020221243A1 (en)
CA (1) CA3127247A1 (en)
WO (1) WO2020167974A1 (en)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10962780B2 (en) * 2015-10-26 2021-03-30 Microsoft Technology Licensing, Llc Remote rendering for virtual images
CN111527013B (en) * 2017-12-27 2024-02-23 宝马股份公司 Vehicle lane change prediction
WO2020055992A1 (en) 2018-09-11 2020-03-19 NetraDyne, Inc. Inward/outward vehicle monitoring for remote reporting and in-cab warning enhancements
JP7263734B2 (en) * 2018-10-29 2023-04-25 株式会社アイシン Visual recognition target determination device
CN111661059B (en) * 2019-03-08 2022-07-08 虹软科技股份有限公司 Method and system for monitoring distracted driving and electronic equipment
EP3744568B1 (en) * 2019-05-29 2022-01-19 Ningbo Geely Automobile Research & Development Co. Ltd. A system and method for providing a desired view for a vehicle occupant
JP7226104B2 (en) * 2019-05-30 2023-02-21 株式会社デンソー Information presentation device, information presentation method, and information presentation program
WO2021053365A1 (en) * 2019-09-16 2021-03-25 日産自動車株式会社 Information processing device and method for vehicle
KR20210034843A (en) * 2019-09-23 2021-03-31 삼성전자주식회사 Apparatus and method for controlling a vehicle
US11222213B2 (en) * 2019-09-30 2022-01-11 Verizon Patent And Licensing Inc. Vehicle behavior detection system
KR20190134554A (en) * 2019-11-15 2019-12-04 엘지전자 주식회사 Method of identifying dynamic obstacle and robot implementing thereof
US11541813B2 (en) * 2019-12-10 2023-01-03 Zf Friedrichshafen Ag Apparatus and method for assisting a driver of a vehicle with visualization of an ambient environment
JP7331729B2 (en) * 2020-02-19 2023-08-23 マツダ株式会社 Driver state estimation device
JP7331728B2 (en) * 2020-02-19 2023-08-23 マツダ株式会社 Driver state estimation device
WO2021171699A1 (en) * 2020-02-27 2021-09-02 株式会社Ｊｖｃケンウッド Projection control device for vehicle, projection system for vehicle, projection control method for vehicle, and program
US11115482B1 (en) * 2020-03-31 2021-09-07 Xevo Inc. System and method for correlating keep-alive connection communications with unary connection communications
SE544806C2 (en) * 2020-04-09 2022-11-22 Tobii Ab Driver alertness detection method, device and system
JP7467220B2 (en) * 2020-04-28 2024-04-15 株式会社ジャパンディスプレイ Display system and vehicle
US11535253B2 (en) * 2020-09-18 2022-12-27 GM Global Technology Operations LLC Lane change maneuver intention detection systems and methods
CN112270304A (en) * 2020-11-17 2021-01-26 北京百度网讯科技有限公司 Data processing method, device, equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040150514A1 (en) * 2003-02-05 2004-08-05 Newman Timothy J. Vehicle situation alert system with eye gaze controlled alert signal generation
US20160272215A1 (en) * 2015-03-20 2016-09-22 Harman International Industries, Incorporated Systems and methods for prioritized driver alerts
US9975483B1 (en) * 2013-02-08 2018-05-22 Amazon Technologies, Inc. Driver assist using smart mobile devices

Family Cites Families (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070135982A1 (en) 1995-06-07 2007-06-14 Automotive Technologies International, Inc. Methods for Sensing Weight of an Occupying Item in a Vehicular Seat
US7852462B2 (en) 2000-05-08 2010-12-14 Automotive Technologies International, Inc. Vehicular component control methods based on blind spot monitoring
JP3790680B2 (en) * 2001-05-25 2006-06-28 株式会社東芝 Image processing system and driving support system using the same
US7119832B2 (en) 2001-07-23 2006-10-10 L-3 Communications Mobile-Vision, Inc. Wireless microphone for use with an in-car video system
ATE454849T1 (en) * 2002-10-15 2010-01-15 Volvo Technology Corp METHOD FOR EVALUATION OF A PERSON'S HEAD AND EYE ACTIVITY
US6906619B2 (en) * 2003-02-27 2005-06-14 Motorola, Inc. Visual attention influenced condition indicia apparatus and method
EP1961622B1 (en) * 2005-12-12 2018-06-13 Panasonic Intellectual Property Corporation of America Safety-travel assistance device
JP2008039596A (en) * 2006-08-07 2008-02-21 Pioneer Electronic Corp System, method, program for providing information and memory medium
WO2008029802A1 (en) * 2006-09-04 2008-03-13 Panasonic Corporation Travel information providing device
JP4231884B2 (en) * 2006-09-27 2009-03-04 株式会社デンソーアイティーラボラトリ Gaze object detection device and gaze object detection method
TW200834040A (en) 2007-02-02 2008-08-16 Mitac Int Corp Dioramic navigation apparatus
EP1974998B1 (en) 2007-03-26 2011-05-25 Aisin AW Co., Ltd. Driving support method and driving support apparatus
US8571789B2 (en) 2007-07-04 2013-10-29 Mitsubishi Electric Corporation Navigation system
JP5050735B2 (en) * 2007-08-27 2012-10-17 マツダ株式会社 Vehicle driving support device
DE102007045932B4 (en) * 2007-09-26 2013-10-02 Daimler Ag Method and device for warning a driver of a vehicle
JP5018444B2 (en) 2007-12-13 2012-09-05 株式会社豊田中央研究所 Vehicle fault diagnosis and prediction device
US20090315766A1 (en) * 2008-06-19 2009-12-24 Microsoft Corporation Source switching for devices supporting dynamic direction information
US8391554B2 (en) 2008-10-01 2013-03-05 GM Global Technology Operations LLC Eye detection system using a single camera
US10019634B2 (en) * 2010-06-04 2018-07-10 Masoud Vaziri Method and apparatus for an eye tracking wearable computer
CA2734436C (en) 2010-04-27 2016-06-14 Timothy Newman Method and system for transmitting a warning message to a driver of a vehicle
US20110313593A1 (en) 2010-06-21 2011-12-22 Cohen Meir S Vehicle On Board Diagnostic Port Device with GPS Tracking, Auto-Upload, and Remote Manipulation
US8098170B1 (en) * 2010-10-08 2012-01-17 GM Global Technology Operations LLC Full-windshield head-up display interface for social networking
US9057874B2 (en) * 2010-12-30 2015-06-16 GM Global Technology Operations LLC Virtual cursor for road scene object selection on full windshield head-up display
US20120224060A1 (en) * 2011-02-10 2012-09-06 Integrated Night Vision Systems Inc. Reducing Driver Distraction Using a Heads-Up Display
KR20130005035A (en) 2011-07-05 2013-01-15 가온미디어 주식회사 Navigation system of cloud computing means and method for the same
US20130030811A1 (en) * 2011-07-29 2013-01-31 Panasonic Corporation Natural query interface for connected car
US9342610B2 (en) * 2011-08-25 2016-05-17 Microsoft Technology Licensing, Llc Portals: registered objects as virtualized, personalized displays
EP2564766B1 (en) * 2011-09-02 2018-03-21 Volvo Car Corporation Visual input of vehicle operator
US8824779B1 (en) * 2011-12-20 2014-09-02 Christopher Charles Smyth Apparatus and method for determining eye gaze from stereo-optic views
US9996150B2 (en) * 2012-12-19 2018-06-12 Qualcomm Incorporated Enabling augmented reality using eye gaze tracking
US8847771B2 (en) * 2013-01-25 2014-09-30 Toyota Motor Engineering & Manufacturing North America, Inc. Method and apparatus for early detection of dynamic attentive states for providing an inattentive warning
DE102014109079A1 (en) * 2013-06-28 2014-12-31 Harman International Industries, Inc. DEVICE AND METHOD FOR DETECTING THE INTEREST OF A DRIVER ON A ADVERTISING ADVERTISEMENT BY PURSUING THE OPERATOR'S VIEWS
US9758098B2 (en) * 2013-08-01 2017-09-12 Honda Motor Co., Ltd. Vehicle periphery monitoring device
GB2518187A (en) 2013-09-12 2015-03-18 Ford Global Tech Llc Collision warning for a driver controlled vehicle
US10210761B2 (en) 2013-09-30 2019-02-19 Sackett Solutions & Innovations, LLC Driving assistance systems and methods
JP6292054B2 (en) * 2013-11-29 2018-03-14 富士通株式会社 Driving support device, method, and program
US9354073B2 (en) * 2013-12-09 2016-05-31 Harman International Industries, Inc. Eye gaze enabled navigation system
US9613459B2 (en) * 2013-12-19 2017-04-04 Honda Motor Co., Ltd. System and method for in-vehicle interaction
JP6264037B2 (en) * 2013-12-27 2018-01-24 トヨタ自動車株式会社 Vehicle information display device and vehicle information display method
JP6176541B2 (en) * 2014-03-28 2017-08-09 パナソニックＩｐマネジメント株式会社 Information display device, information display method, and program
KR102209511B1 (en) * 2014-05-12 2021-01-29 엘지전자 주식회사 Wearable glass-type device and method of controlling the device
KR102179579B1 (en) 2014-05-29 2020-11-17 한국자동차연구원 Car steering wheel of the integrated smart navigation
US9476729B2 (en) * 2014-05-29 2016-10-25 GM Global Technology Operations LLC Adaptive navigation and location-based services based on user behavior patterns
WO2016029939A1 (en) 2014-08-27 2016-03-03 Metaio Gmbh Method and system for determining at least one image feature in at least one image
JP6184923B2 (en) 2014-09-11 2017-08-23 日立オートモティブシステムズ株式会社 Vehicle collision avoidance device
US9747812B2 (en) * 2014-10-22 2017-08-29 Honda Motor Co., Ltd. Saliency based awareness modeling
KR101714515B1 (en) * 2015-01-21 2017-03-22 현대자동차주식회사 Safe driving notice system and there of method using wearable device
DE102015206200A1 (en) * 2015-04-08 2016-10-13 Robert Bosch Gmbh Method and device for attention recognition of a driver
US20160362111A1 (en) * 2015-06-12 2016-12-15 Jaguar Land Rover Limited Driver awareness sensing and indicator control
US9845097B2 (en) * 2015-08-12 2017-12-19 Ford Global Technologies, Llc Driver attention evaluation
JP6684559B2 (en) * 2015-09-16 2020-04-22 株式会社バンダイナムコエンターテインメント Program and image generation device
DE102015220398A1 (en) * 2015-10-20 2017-04-20 Robert Bosch Gmbh Method for transmitting information to a driver of a motor vehicle and adaptive driver assistance system
KR101916993B1 (en) * 2015-12-24 2018-11-08 엘지전자 주식회사 Display apparatus for vehicle and control method thereof
JP2017122640A (en) * 2016-01-07 2017-07-13 トヨタ自動車株式会社 Information control device
JP6943877B2 (en) 2016-05-02 2021-10-06 デックスコム・インコーポレーテッド Systems and methods for providing optimized alerts for users
US10216269B2 (en) * 2016-06-21 2019-02-26 GM Global Technology Operations LLC Apparatus and method for determining intent of user based on gaze information
KR20200011405A (en) * 2016-07-01 2020-02-03 아이사이트 모빌 테크놀로지 엘티디 Systems and Methods for Driver Monitoring
US9760827B1 (en) 2016-07-22 2017-09-12 Alpine Electronics of Silicon Valley, Inc. Neural network applications in resource constrained environments
US10832031B2 (en) * 2016-08-15 2020-11-10 Apple Inc. Command processing using multimodal signal analysis
US11305766B2 (en) * 2016-09-26 2022-04-19 Iprd Group, Llc Combining driver alertness with advanced driver assistance systems (ADAS)
EP3299241B1 (en) * 2016-09-26 2021-11-10 Volvo Car Corporation Method, system and vehicle for use of an object displaying device in a vehicle
KR101896790B1 (en) * 2016-11-08 2018-10-18 현대자동차주식회사 Apparatus for determining concentration of driver, system having the same and method thereof
WO2018096619A1 (en) * 2016-11-24 2018-05-31 マクセル株式会社 Lighting apparatus
JP2018149941A (en) * 2017-03-14 2018-09-27 オムロン株式会社 Concentration level determination device, concentration level determination method, and program for determining concentration level
US11587419B2 (en) * 2017-08-04 2023-02-21 Toyota Research Institute, Inc. Methods and systems providing an intelligent camera system
TWI653170B (en) * 2017-11-01 2019-03-11 宏碁股份有限公司 Driving notification method and driving notification system
KR102014261B1 (en) * 2017-12-12 2019-08-26 엘지전자 주식회사 Vehicle control device mounted on vehicle and method for controlling the vehicle
JP7077616B2 (en) * 2017-12-28 2022-05-31 トヨタ自動車株式会社 Display control device and display control method
US10853674B2 (en) * 2018-01-23 2020-12-01 Toyota Research Institute, Inc. Vehicle systems and methods for determining a gaze target based on a virtual eye position
US10597042B2 (en) * 2018-03-27 2020-03-24 Intel Corporation User gesture directed object detection and recognition in a vehicle
US10849543B2 (en) * 2018-06-08 2020-12-01 Ford Global Technologies, Llc Focus-based tagging of sensor data
US10746987B2 (en) * 2018-07-12 2020-08-18 Toyota Research Institute, Inc. Vehicle systems and methods for redirecting a driver's gaze towards an object of interest
WO2020023926A1 (en) * 2018-07-26 2020-01-30 Standard Cognition, Corp. Directional impression analysis using deep learning
US10846876B2 (en) * 2018-11-02 2020-11-24 Yu-Sian Jiang Intended interest point detection method and system thereof
US11150656B2 (en) * 2018-11-19 2021-10-19 Honda Motor Co., Ltd. Autonomous vehicle decision making

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040150514A1 (en) * 2003-02-05 2004-08-05 Newman Timothy J. Vehicle situation alert system with eye gaze controlled alert signal generation
US9975483B1 (en) * 2013-02-08 2018-05-22 Amazon Technologies, Inc. Driver assist using smart mobile devices
US20160272215A1 (en) * 2015-03-20 2016-09-22 Harman International Industries, Incorporated Systems and methods for prioritized driver alerts

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2020167974A1 *

Also Published As

Publication number Publication date
EP3924207A1 (en) 2021-12-22
WO2020167974A1 (en) 2020-08-20
CA3127247A1 (en) 2020-08-20
US20200254876A1 (en) 2020-08-13
US20210078408A1 (en) 2021-03-18
JP2022519895A (en) 2022-03-25
US10882398B2 (en) 2021-01-05
AU2020221243A1 (en) 2021-08-12

Similar Documents

Publication Publication Date Title
EP3924207A4 (en) System and method for correlating user attention direction and outside view
EP3983907A4 (en) System and method using a fitness-gradient blockchain consensus
EP3841466A4 (en) Method and system for enhancing a user interface for a web application
EP3886737A4 (en) Histotripsy systems and methods
EP3805804A4 (en) Fast and precise positioning method and system
EP3701701A4 (en) Consensus system and method
EP3949274A4 (en) Systems and methods for improved meeting engagement
EP3826734A4 (en) Systems and methods for climbing
EP3968932A4 (en) Systems and methods for sensing and stimulation
EP3858064A4 (en) System and methods for enabling dl-edt
EP4022253A4 (en) Positioning systems and methods
EP3768159A4 (en) Replaceable sensor systems and methods
EP4049216A4 (en) Cryptocurrency acceptance system
EP3923833A4 (en) Dermaplaning device and related system
EP3794764A4 (en) A cryptographic system and method
EP4049906A4 (en) Sensor system and sensor unit
EP3908509A4 (en) Handlebar systems and method
EP4003479A4 (en) Systems and methods for user entrainment
EP3825734A4 (en) Moving-body positioning system and moving-body positioning method
EP4072979A4 (en) Case reorientation system and method
EP4051100A4 (en) Semi-autonomous medical systems and methods
EP3737940A4 (en) System and method for optimizing peak shapes
EP3757566A4 (en) Continuous manufacturing system and method
EP3906504A4 (en) Interaction system and method
EP3916851A4 (en) Doping system and doping method

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210913

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220914

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 7/18 20060101ALI20220908BHEP

Ipc: G06T 7/70 20170101ALI20220908BHEP

Ipc: G06K 9/00 20060101ALI20220908BHEP

Ipc: B60K 35/00 20060101AFI20220908BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20230418