EP3906504C0 - Interaktionssystem und verfahren - Google Patents

Interaktionssystem und verfahren

Info

Publication number
EP3906504C0
EP3906504C0 EP19907879.1A EP19907879A EP3906504C0 EP 3906504 C0 EP3906504 C0 EP 3906504C0 EP 19907879 A EP19907879 A EP 19907879A EP 3906504 C0 EP3906504 C0 EP 3906504C0
Authority
EP
European Patent Office
Prior art keywords
interaction system
interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19907879.1A
Other languages
English (en)
French (fr)
Other versions
EP3906504B1 (de
EP3906504A4 (de
EP3906504A1 (de
Inventor
Christian Ardelean
Michael Kaisser
Johan Wouters
Robert M Policano
Nils Lenke
Binh Dac Nguyen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cerence Operating Co
Original Assignee
Cerence Operating Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cerence Operating Co filed Critical Cerence Operating Co
Publication of EP3906504A1 publication Critical patent/EP3906504A1/de
Publication of EP3906504A4 publication Critical patent/EP3906504A4/de
Application granted granted Critical
Publication of EP3906504C0 publication Critical patent/EP3906504C0/de
Publication of EP3906504B1 publication Critical patent/EP3906504B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q3/00—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
    • B60Q3/80—Circuits; Control arrangements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00—Heating, cooling or ventilating [HVAC] devices
    • B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
    • B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
    • B60H1/00742—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/593—Recognising seat occupancy
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0872—Driver physiology
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/21—Voice
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2710/00—Output or target parameters relating to a particular sub-units
    • B60W2710/24—Energy storage means
    • B60W2710/242—Energy storage means for electrical energy
    • B60W2710/246—Temperature

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Transportation (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Thermal Sciences (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Traffic Control Systems (AREA)
EP19907879.1A 2019-01-04 2019-12-20 Interaktionssystem und verfahren Active EP3906504B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962788401P 2019-01-04 2019-01-04
US16/405,737 US11170240B2 (en) 2019-01-04 2019-05-07 Interaction system and method
PCT/US2019/067770 WO2020142260A1 (en) 2019-01-04 2019-12-20 Interaction system and method

Publications (4)

Publication Number Publication Date
EP3906504A1 EP3906504A1 (de) 2021-11-10
EP3906504A4 EP3906504A4 (de) 2023-02-22
EP3906504C0 true EP3906504C0 (de) 2025-05-07
EP3906504B1 EP3906504B1 (de) 2025-05-07

Family

ID=71403993

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19907879.1A Active EP3906504B1 (de) 2019-01-04 2019-12-20 Interaktionssystem und verfahren

Country Status (4)

Country Link
US (1) US11170240B2 (de)
EP (1) EP3906504B1 (de)
CN (1) CN113287117B (de)
WO (1) WO2020142260A1 (de)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12043265B2 (en) * 2020-12-22 2024-07-23 Subaru Corporation Safety drive assist apparatus
US20230095845A1 (en) * 2021-09-27 2023-03-30 Toyota Motor North America, Inc. Transport modifications for impaired occupants

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5636545U (de) * 1979-08-31 1981-04-08
DE4339113C2 (de) * 1993-11-16 1996-09-05 Daimler Benz Ag Sitzbelegungserkennungseinrichtung in einem Kraftfahrzeug
CN101669090A (zh) * 2007-04-26 2010-03-10 福特全球技术公司 情绪提示系统和方法
US9998697B2 (en) * 2009-03-02 2018-06-12 Flir Systems, Inc. Systems and methods for monitoring vehicle occupants
KR101298197B1 (ko) 2013-02-18 2013-08-20 주식회사 자이언트스타 졸음 방지 기능을 구비하는 vsdt 룸 미러
US9751534B2 (en) * 2013-03-15 2017-09-05 Honda Motor Co., Ltd. System and method for responding to driver state
US20150283914A1 (en) * 2014-04-04 2015-10-08 Ford Global Technologies, Llc Method and system for vehicle battery environment control
US10099700B2 (en) * 2014-04-30 2018-10-16 Ford Global Technologies, Llc Method and system for driver tailored interaction time alert
KR101659027B1 (ko) * 2014-05-15 2016-09-23 엘지전자 주식회사 이동 단말기 및 차량 제어 장치
CN104354701B (zh) * 2014-10-29 2016-11-23 云南大学 一种人车交互的实现方法
US9533687B2 (en) * 2014-12-30 2017-01-03 Tk Holdings Inc. Occupant monitoring systems and methods
US10532659B2 (en) 2014-12-30 2020-01-14 Joyson Safety Systems Acquisition Llc Occupant monitoring systems and methods
US10137902B2 (en) * 2015-02-12 2018-11-27 Harman International Industries, Incorporated Adaptive interactive voice system
JP6515764B2 (ja) 2015-09-28 2019-05-22 株式会社デンソー 対話装置及び対話方法
US10884503B2 (en) * 2015-12-07 2021-01-05 Sri International VPA with integrated object recognition and facial expression recognition
CN105700682A (zh) * 2016-01-08 2016-06-22 北京乐驾科技有限公司 基于视觉和语音的智能性别、情绪识别检测系统及方法
US20170287476A1 (en) * 2016-03-31 2017-10-05 GM Global Technology Operations LLC Vehicle aware speech recognition systems and methods
US20180022357A1 (en) * 2016-07-19 2018-01-25 Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America Driving recorder system
US20180118218A1 (en) * 2016-10-27 2018-05-03 Ford Global Technologies, Llc Method and apparatus for vehicular adaptation to driver state
KR20180059052A (ko) * 2016-11-25 2018-06-04 르노삼성자동차 주식회사 자동차 뒷좌석 모니터링 시스템
CN108237976A (zh) * 2016-12-27 2018-07-03 广州市联奥信息科技有限公司 具备情绪表达能力的交互行车系统及方法
CN106803423B (zh) * 2016-12-27 2020-09-04 智车优行科技（北京）有限公司 基于用户情绪状态的人机交互语音控制方法、装置及车辆
US20180335776A1 (en) * 2017-05-16 2018-11-22 GM Global Technology Operations LLC Systems and methods for selecting driving modes in autonomous vehicles
US10474423B2 (en) * 2017-06-14 2019-11-12 GM Global Technology Operations LLC Systems and methods for soundscape selection in autonomous vehicles
WO2019028798A1 (zh) * 2017-08-10 2019-02-14 北京市商汤科技开发有限公司 驾驶状态监控方法、装置和电子设备

Also Published As

Publication number Publication date
EP3906504B1 (de) 2025-05-07
CN113287117B (zh) 2025-03-04
CN113287117A (zh) 2021-08-20
EP3906504A4 (de) 2023-02-22
US20200218914A1 (en) 2020-07-09
EP3906504A1 (de) 2021-11-10
US11170240B2 (en) 2021-11-09
WO2020142260A1 (en) 2020-07-09

Similar Documents

Publication Publication Date Title
EP3811316C0 (de) Blockchain system und verfahren
EP3948772A4 (de) Verfahren und system zur selektion von embryonen
EP3737229C0 (de) System und verfahren
EP3754944A4 (de) Verfahren und system zur ressourcenplanung
EP3616481C0 (de) System und verfahren zum verhindern von anzeigewölbung
EP3805796A4 (de) Verfahren und system zur navigationsverbesserung
EP3687742A4 (de) Automatisiertes wandendbearbeitungssystem und verfahren
EP3662686A4 (de) System und verfahren für sidelink-rückkopplung
EP3658589C0 (de) Anti-sirp-alpha-antikörper und verwandte verfahren
EP3641959A4 (de) Feststoffabfallbehandlungssystem und verfahren
EP3678068A4 (de) Verteiltes system zur ausführung von maschinenlernen und verfahren dafür
EP3552137A4 (de) System und verfahren zur erkennung von cryptoware
EP3700606A4 (de) System und verfahren zur entnahme von plasma
EP4062561A4 (de) Lineare fotonische prozessoren und zugehörige verfahren
EP3733842A4 (de) System und verfahren zur genomeditierung
EP3469623A4 (de) System zur sanften ionisierung und verfahren zur verwendung davon
EP3454924A4 (de) System und verfahren zur radiologischen dosierung
EP3692377A4 (de) Verfahren und system zur überwachung von sich bewegenden elementen
EP3481290A4 (de) System und verfahren zur erkennung von ödemen
EP3600549A4 (de) System und verfahren zur bereitstellung von strahlentherapie
EP3678030A4 (de) Verteiltes system zur ausführung von maschinenlernen und verfahren dafür
EP3642763A4 (de) System und verfahren für neuronale netzwerke
EP3471106C0 (de) Verfahren und system zur unterstützung klinischer entscheidungen
EP4071029A4 (de) Planungssystem und planungsverfahren
EP3833827A4 (de) Luftreinigungspaneel, system und verfahren

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210722

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: G06V 20/59 20220101ALI20220922BHEP

Ipc: B60Q 3/80 20170101ALI20220922BHEP

Ipc: G06V 20/00 20220101ALI20220922BHEP

Ipc: B60H 1/00 20060101ALI20220922BHEP

Ipc: G06F 3/16 20060101ALI20220922BHEP

Ipc: G06K 9/00 20060101AFI20220922BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20230123

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240214

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06K0009000000

Ipc: G06F0003160000

Ref document number: 602019069801

Country of ref document: DE

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: B60Q 3/80 20170101ALI20250107BHEP

Ipc: G06V 20/00 20220101ALI20250107BHEP

Ipc: B60H 1/00 20060101ALI20250107BHEP

Ipc: G06V 20/59 20220101ALI20250107BHEP

Ipc: G06F 3/16 20060101AFI20250107BHEP

INTG Intention to grant announced

Effective date: 20250117

RIN1 Information on inventor provided before grant (corrected)

Inventor name: NGUYEN, BINH DAC

Inventor name: LENKE, NILS

Inventor name: POLICANO, ROBERT M.

Inventor name: WOUTERS, JOHAN

Inventor name: KAISSER, MICHAEL

Inventor name: ARDELEAN, CHRISTIAN

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019069801

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

U01 Request for unitary effect filed

Effective date: 20250603

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT RO SE SI

Effective date: 20250610

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250507

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250807

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250808

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250507

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250507

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250907