WO2003016110A2 - Procede permettant d'aider l'utilisateur d'un equipement a localiser un element de commande - Google Patents

Procede permettant d'aider l'utilisateur d'un equipement a localiser un element de commande Download PDF

Info

Publication number
WO2003016110A2
WO2003016110A2 PCT/EP2002/005650 EP0205650W WO03016110A2 WO 2003016110 A2 WO2003016110 A2 WO 2003016110A2 EP 0205650 W EP0205650 W EP 0205650W WO 03016110 A2 WO03016110 A2 WO 03016110A2
Authority
WO
WIPO (PCT)
Prior art keywords
control element
operator
occupant
recognition system
vehicle
Prior art date
Application number
PCT/EP2002/005650
Other languages
German (de)
English (en)
Other versions
WO2003016110A3 (fr
WO2003016110A8 (fr
Inventor
Josef Bärenweiler
Günter Fendt
Helmut Riedel
Original Assignee
Conti Temic Microelectronic Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Conti Temic Microelectronic Gmbh filed Critical Conti Temic Microelectronic Gmbh
Publication of WO2003016110A2 publication Critical patent/WO2003016110A2/fr
Publication of WO2003016110A3 publication Critical patent/WO2003016110A3/fr
Publication of WO2003016110A8 publication Critical patent/WO2003016110A8/fr

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q3/00—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
    • B60Q3/10—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors for dashboards
    • B60Q3/16—Circuits; Control arrangements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/006—Teaching or communicating with blind persons using audible presentation of the information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Definitions

  • the invention relates to a method for supporting an operator of a device in finding an operating element.
  • control elements are increasingly designed to be multifunctional and arranged in a wide variety of positions on the vehicle, so that an occupant may even be distracted by searching for an control element in safety-critical traffic situations.
  • a speech recognition system By means of a speech recognition system, the acoustic signals in the vicinity of the device are monitored for a search query by the operator regarding a control element to be found.
  • a conventional speech recognition system can be used for this.
  • a signaling control unit activates a signaling which is perceptible to the operator and which tells the operator the position of the operating element displays.
  • the signaling control unit can thus activate a lighting device in the vicinity of the control element, in particular switch the background lighting of the control element in question, for example into a flashing operating state for a predetermined period of time.
  • a prepared voice signal can be output, which describes the position of the corresponding control element.
  • the position of the hands of the operator is additionally detected by means of a sensor, and voice signals are generated in such a way that they indicate how the operator has to move his hands or one of the hands in order to arrive at the operating element sought .
  • a sensor for example, for detecting seat occupancy or occupant position in vehicles, in order to accordingly release occupant protection devices or to suppress their triggering.
  • a number of such interior monitoring sensors offer sufficient image resolution for detecting the position of the hand or hands of the operator or can be further developed in a corresponding manner without great effort.
  • the signaling control unit which here receives a search request from the operator regarding the control element to be found by the speech recognition system, has a memory in which the position of the control elements of the vehicle is stored and which contains the signal from a sensor for describing the actual position of the hand or hands of the operator can be fed, which accordingly generates a voice signal to the occupant as a function of the difference between the actual position of the hand and the hands of the occupant and the positions of the control element to be found in the memory.
  • Figure 1 vehicle with occupants and optical signaling of the control element sought.
  • FIG. 1 shows an occupant 1 in a vehicle 2, here the driver, for example, the method also being applicable to other occupants in vehicles, be they passengers, passengers in the rear or passengers in a bus, plane or train.
  • the vehicle 2 has a speech recognition system 4 with a microphone 3 for detecting the acoustic signals in the vehicle 2, wherein speech recognition systems already present in the vehicle 2 can be used for this, provided that these offer the possibility of corresponding adaptation to monitoring of a search query by the occupant 1 with respect to a control element to be found.
  • other devices can also be equipped with a corresponding speech recognition system 4 and this method can be used to assist the operator in finding an operating element.
  • a signaling control device here in a functional unit with the speech recognition system - likewise identified as 4 - activates a signaling 7a which is perceptible to the occupant 1 and which the occupant 1 detects the position of the control element 6a displays.
  • the signaling control unit 4 controls an illumination device 7a in the vicinity of the control element 6a, more precisely here even the background illumination of the control element 6a sought, and preferably for a certain period of time by means of a flashing signal, so that it is independent of the connection general vehicle lighting
  • FIG. 2 shows a sketch of the method by means of bidirectional voice control, in which the speech recognition system 4 provides the occupant with a speech signal 7b describing the position of the control element 6b sought after the search query 12.
  • This can be a generally prepared speech signal, which is read out from a memory and played back when such a search query is recognized and which indicates the position of the operating element 6b to the occupant 1 on the basis of instructions, for example the front row on the center console.
  • this descriptive voice signal 7b can also be used in addition to optical signaling, as shown in FIG. 1.
  • This method is particularly preferably supplemented, in which the position of the hand or hands 11 of the occupant is detected by means of a sensor 5 arranged here in the upper corner between the windshield and the roof of the vehicle.
  • a sensor 5 arranged here in the upper corner between the windshield and the roof of the vehicle.
  • these interior sensors 5 can also be used to detect the position of the occupant's hand or hands 11.
  • This is used in DE 197 53 160 C1, for example, to recognize an impending accident situation of the vehicle, to record the speed of movement of the driver's hands and to derive an impending accident situation from this if the driver moves his hands in a panic.
  • the position of the hands 11 of the occupant 1 is to be used to locate an operating element 6b by responding to a query by the occupant 1 regarding an operating element to be found
  • a speech signal 7b is output by the loudspeaker 8, which indicates how the occupant 1 has to move his hands 11 in order to arrive at the control element 6b sought.
  • the hand 11 of the occupant is guided step by step to the operating element 6b on the basis of simple predetermined speech signals 7b, and the actual position of the hand 11 of the occupant 1 detected by the sensor 5 is brought into agreement with the position of the operating element 6b to be found in the memory.
  • a PMD sensor is particularly suitable as a sensor 5 for detecting the position of the hands 11 of the occupant 1, which, in addition to an optical image by means of phase modulation, can also assign a distance signal to the respective image point and thus generate a three-dimensional image of the interior of the vehicle.
  • the voice signal 7b can also explain the mode of operation of the control element 6b in more detail, which appears particularly useful in the case of multifunction control elements.
  • the way in which the functional units are arranged after the control element 6b can also be described, possibly in response to a corresponding supplemented search query 12.
  • a voice recognition system 4 in a vehicle 2 by reading in a program stored on a portable storage medium, allows this preinstalled voice recognition system 4 to be equipped with the additional data about the position of the operating elements 6 of the vehicle 2 and the voice signals agreed for the search query, so that even in different speech recognition systems, an occupant 1, for example from a rental car company, is provided with corresponding requests for the preparation of the speech recognition system 4 for carrying out the method, provided that this is not pre-assembled in the vehicle.
  • Appropriate data supplementation and search queries mean that the occupant 1 can obtain an almost complete presentation of the control elements 6 of the vehicle 2.
  • Storage volume can be implemented in the language processing system. It can also be used for a plurality of devices in each case by means of a speech recognition system.

Abstract

L'invention concerne un procédé permettant d'aider l'utilisateur d'un équipement, en particulier d'un véhicule, à localiser un élément de commande. Selon ce procédé, des signaux acoustiques émis dans le voisinage de l'équipement, par exemple dans l'habitacle du véhicule, sont surveillés à l'aide d'un système de reconnaissance de la parole, lorsque l'utilisateur émet une demande de recherche relative à un élément de commande à localiser. Lorsqu'une demande de recherche de ce type est détectée par le système de reconnaissance de la parole d'une unité de commande de signalisation, une signalisation perceptible par l'utilisateur est activée, laquelle signalisation indique à cet utilisateur la position de l'élément de commande. Cette signalisation peut être de type optique. Dans ce cas, un système d'éclairage, de préférence un rétroéclairage, est activé dans le voisinage de l'élément de commande. En variante, un signal vocal, enregistré dans une mémoire et préparé pour l'élément de commande correspondant, est activé. Idéalement, un détecteur conçu pour détecter la position de la main de l'utilisateur peut, en outre, être utilisé. Dans ce cas, des signaux vocaux sont produits, de manière à indiquer à l'utilisateur comment déplacer sa main pour atteindre l'élément de commande. A cet effet, des véhicules peuvent être équipés, en particulier, d'un détecteur conçu pour surveiller l'habitacle.
PCT/EP2002/005650 2001-08-16 2002-05-23 Procede permettant d'aider l'utilisateur d'un equipement a localiser un element de commande WO2003016110A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE10140097.7 2001-08-16
DE10140097A DE10140097B4 (de) 2001-08-16 2001-08-16 Verfahren zur Unterstützung eines Bedieners eines Gerätes beim Auffinden der Position eines Bedienelements

Publications (3)

Publication Number Publication Date
WO2003016110A2 true WO2003016110A2 (fr) 2003-02-27
WO2003016110A3 WO2003016110A3 (fr) 2003-11-20
WO2003016110A8 WO2003016110A8 (fr) 2003-12-18

Family

ID=7695552

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2002/005650 WO2003016110A2 (fr) 2001-08-16 2002-05-23 Procede permettant d'aider l'utilisateur d'un equipement a localiser un element de commande

Country Status (2)

Country Link
DE (1) DE10140097B4 (fr)
WO (1) WO2003016110A2 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10321964A1 (de) * 2003-05-15 2004-12-09 Webasto Ag Fahrzeugdach mit einer Bedieneinrichtung für elektrische Fahrzeugkomponenten sowie Verfahren zur Bedienung elektrischer Fahrzeugkomponenten
DE102004045885A1 (de) * 2004-09-22 2006-03-23 Volkswagen Ag Bedienelement für ein Kraftfahrzeug
DE102005035992A1 (de) * 2005-08-01 2007-02-08 GM Global Technology Operations, Inc., Detroit Informationssystem für ein Kraftfahrzeug
DE102005040853A1 (de) * 2005-08-29 2007-03-08 Webasto Ag Bedieneinheit
SG133461A1 (en) * 2005-12-06 2007-07-30 Sin Etke Technology Co Ltd On-line voice help system and method for automobile
WO2015130567A1 (fr) * 2014-02-28 2015-09-03 Bombardier Inc. Procédé, système, et produit-programme exécutable de commande de services pour passager
US10112716B2 (en) 2014-02-28 2018-10-30 Bombardier Inc. Method, system, and executable program product for controlling lighting
US10144512B2 (en) 2014-02-28 2018-12-04 Bombardier Inc. Method, system, and executable program product for controlling passenger services

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005052843A1 (de) * 2005-11-05 2007-05-10 GM Global Technology Operations, Inc., Detroit Spracherkennungssystem in einem Kraftfahrzeug
DE102012001149B4 (de) * 2012-01-21 2016-04-28 Audi Ag Verfahren und Vorrichtung zur Erzeugung eines synthetischen, räumlich verorteten, akustischen Feedback-Signals bei Betätigung eines Bedienelements
DE102019211751A1 (de) * 2019-08-06 2021-02-11 Volkswagen Aktiengesellschaft Verfahren zur akustischen Anzeige einer Position eines Fahrzeugelements in einem Fahrzeuginnenraum eines Fahrzeugs, sowie Schallerzeugungssystem
DE102019212429A1 (de) 2019-08-20 2021-02-25 Volkswagen Aktiengesellschaft Verfahren zum Bereitstellen einer individuellen Nutzerführung für zumindest eine Funktionskomponente eines Kraftfahrzeugs für einen Nutzer in dem Kraftfahrzeug, sowie elektronisches Nutzerführungssystem
DE102021003861A1 (de) 2021-07-27 2021-10-28 Daimler Ag Verfahren und System zur Einstellung einer deeskalierenden Körperhaltung eines Fahrzeuginsassen bei einer erkannten Polizeikontrolle

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3511026A1 (de) * 1985-03-27 1986-10-02 Blaupunkt-Werke Gmbh, 3200 Hildesheim Bedienelemente aufweisende frontplatte eines geraetes der nachrichtentechnik
DE69101527T2 (de) * 1990-08-16 1994-07-14 Fujitsu Ten Ltd Spracherkennungseinrichtung für ein Fahrzeug mit einer Mikrophonanordnung zur Lokalisierung des Sitzes, von welchem ein Befehl kommt.
EP1164465A3 (fr) * 1991-05-31 2002-01-09 Koninklijke Philips Electronics N.V. Procédé de traitement des entrées de l'utilisateur
DE69232553T2 (de) * 1991-05-31 2002-12-05 Koninkl Philips Electronics Nv Gerät mit einer Mensch-Maschine-Schnittstelle
US5956682A (en) * 1991-06-06 1999-09-21 Lj Laboratories, Llc Picture frame with associated audio messages and position sensitive or speech recognition device
DE59504191D1 (de) * 1994-06-06 1998-12-17 Volkswagen Ag Multifunktionseinrichtung zur Betätigung unterschiedlicher Stellglieder in einem Kraftfahrzeug und Kraftfahrzeug mit einer derartigen Multifunktionseinrichtung
US6012029A (en) * 1995-09-29 2000-01-04 Cirino; Sepideh S. Voice activated system for locating misplaced items
DE19709518C5 (de) * 1997-03-10 2006-05-04 Harman Becker Automotive Systems Gmbh Verfahren und Vorrichtung zur Spracheingabe einer Zieladresse in ein Zielführungssystem im Echtzeitbetrieb
DE19753160C1 (de) * 1997-11-29 1999-04-15 Bosch Gmbh Robert Vorrichtung zum Erkennen einer bevorstehenden Unfallsituation eines Fahrzeugs
US6201540B1 (en) * 1998-01-07 2001-03-13 Microsoft Corporation Graphical interface components for in-dash automotive accessories
DE19845030A1 (de) * 1998-09-30 2000-04-20 Siemens Ag Bildsystem
US6240347B1 (en) * 1998-10-13 2001-05-29 Ford Global Technologies, Inc. Vehicle accessory control with integrated voice and manual activation
DE19907795A1 (de) * 1999-02-24 2000-09-14 Daimler Chrysler Ag Verfahren zur Unterstützung eines Benutzers eines Kraftfahrzeugs bei der Bedienung von Komponenten des Kraftfahrzeugs sowie eine zugehörige Vorrichtung
DE10008197C1 (de) * 2000-02-23 2001-07-26 Kostal Leopold Gmbh & Co Kg Multifunktionale Bedieneinrichtung

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10321964B4 (de) * 2003-05-15 2008-05-29 Webasto Ag Fahrzeugdach mit einer Bedieneinrichtung für elektrische Fahrzeugkomponenten sowie Verfahren zur Bedienung elektrischer Fahrzeugkomponenten
DE10321964A1 (de) * 2003-05-15 2004-12-09 Webasto Ag Fahrzeugdach mit einer Bedieneinrichtung für elektrische Fahrzeugkomponenten sowie Verfahren zur Bedienung elektrischer Fahrzeugkomponenten
US7342485B2 (en) 2003-05-15 2008-03-11 Webasto Ag Motor vehicle roof with a control means for electrical motor vehicle components and process for operating electrical motor vehicle components
DE102004045885A1 (de) * 2004-09-22 2006-03-23 Volkswagen Ag Bedienelement für ein Kraftfahrzeug
DE102005035992A1 (de) * 2005-08-01 2007-02-08 GM Global Technology Operations, Inc., Detroit Informationssystem für ein Kraftfahrzeug
EP1749688A3 (fr) * 2005-08-01 2010-03-31 GM Global Technology Operations, Inc. Système d'information pour automobile
DE102005040853A1 (de) * 2005-08-29 2007-03-08 Webasto Ag Bedieneinheit
SG133461A1 (en) * 2005-12-06 2007-07-30 Sin Etke Technology Co Ltd On-line voice help system and method for automobile
WO2015130567A1 (fr) * 2014-02-28 2015-09-03 Bombardier Inc. Procédé, système, et produit-programme exécutable de commande de services pour passager
CN106068225A (zh) * 2014-02-28 2016-11-02 庞巴迪公司 用于控制乘客服务的方法、系统和可执行程序产品
US10093419B2 (en) 2014-02-28 2018-10-09 Bombardier Inc. Method, system, and executable program product for controlling passenger services
US10112716B2 (en) 2014-02-28 2018-10-30 Bombardier Inc. Method, system, and executable program product for controlling lighting
US10144512B2 (en) 2014-02-28 2018-12-04 Bombardier Inc. Method, system, and executable program product for controlling passenger services

Also Published As

Publication number Publication date
WO2003016110A3 (fr) 2003-11-20
DE10140097A1 (de) 2003-02-27
WO2003016110A8 (fr) 2003-12-18
DE10140097B4 (de) 2005-04-28

Similar Documents

Publication Publication Date Title
EP1658200B1 (fr) Systeme pour vehicule
EP2752036B1 (fr) Véhicule à moteur
DE102017216837A1 (de) Gestik- und Mimiksteuerung für ein Fahrzeug
EP1977926B1 (fr) Unité et procédé de commande
EP1031456B1 (fr) Procédé et dispositif pour assister l'utilisateur d'une automobile lors de la commande des composants
DE112014006409T5 (de) Fahrzeugsteuervorrichtung und Fahrzeugsteuerverfahren
WO2003016110A2 (fr) Procede permettant d'aider l'utilisateur d'un equipement a localiser un element de commande
DE102010049081A1 (de) Verfahren zum Betreiben eines Kraftfahrzeugs und Kraftfahrzeug
DE102014204980B4 (de) Verfahren und Vorrichtung zur Einschränkung oder Zwangsaktivierung von Kraftfahrzeugfunktionen
DE102016212647A1 (de) Verfahren zum Betreiben eines Sprachsteuerungssystems in einem Innenraum und Sprachsteuerungssystem
DE102017011827A1 (de) Verfahren zum Betrieb einer Insassenschutzvorrichtung
DE112017007207T5 (de) Insassenunterstützungsvorrichtung, Verfahren und Programm
EP2727773A1 (fr) Procédé d'activation d'une interaction vocale avec un passager d'un véhicule et système d'interaction vocale pour un véhicule
DE202013006009U1 (de) Fahrerassistenzsystem
DE102012004601A1 (de) Fahrerassistenzsystem und Verfahren zum Anbieten und/oder Signalisieren von Informationen an einen Insassen eines Kraftfahrzeugs, sowie Kraftfahrzeug mit dem Fahrerassistenzsystem
DE102012203795A1 (de) Vorrichtung zum Einstellen und/oder Nachjustieren eines Spiegels in einem Kraftfahrzeug
WO2016124278A1 (fr) Détermination d'une position d'un objet étranger à un véhicule dans un véhicule
DE102017103391A1 (de) Verfahren zur Verbesserung der Benutzerfreundlichkeit eines Fahrzeugs
DE102016211034A1 (de) Informationsbereitstellungsvorrichtung für ein Fahrzeug
DE10308415B3 (de) Verfahren zur Steuerung einer Sitzeinstellung
DE102018217634A1 (de) Verfahren zum Betrieb eines Fahrzeugs sowie Fahrzeug
DE102017206876A1 (de) Verfahren und Vorrichtung zur Ausgabe einer Statusmeldung in einem Kraftfahrzeug mit Sprachsteuerungssystem
DE102016200048B4 (de) Warneinrichtung und Verfahren zum Warnen von Kraftfahrzeuginsassen
DE10012788B4 (de) Fahrerassistenzvorrichtung für ein Kraftfahrzeug, insbesondere Einparkhilfe
DE102020114924A1 (de) Kraftfahrzeug

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): JP

Kind code of ref document: A2

Designated state(s): JP US

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB IE IT LU MC NL PT SE TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
CFP Corrected version of a pamphlet front page
CR1 Correction of entry in section i

Free format text: IN PCT GAZETTE 09/2003 UNDER (71) DELETE "PATENTE & LIZENZEN"

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP