WO2015062750A1 - Infortainment system for a vehicle - Google Patents

Infortainment system for a vehicle Download PDF

Info

Publication number
WO2015062750A1
WO2015062750A1 PCT/EP2014/064329 EP2014064329W WO2015062750A1 WO 2015062750 A1 WO2015062750 A1 WO 2015062750A1 EP 2014064329 W EP2014064329 W EP 2014064329W WO 2015062750 A1 WO2015062750 A1 WO 2015062750A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
occupant
gesture
infotainment system
dimensional
Prior art date
Application number
PCT/EP2014/064329
Other languages
German (de)
French (fr)
Other versions
WO2015062750A8 (en
Inventor
Oliver Kirsch
Frank Schliep
Original Assignee
Johnson Controls Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Johnson Controls Gmbh filed Critical Johnson Controls Gmbh
Publication of WO2015062750A1 publication Critical patent/WO2015062750A1/en
Publication of WO2015062750A8 publication Critical patent/WO2015062750A8/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/11—Instrument graphical user interfaces or menu aspects
    • B60K2360/115—Selection of menu items
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/141—Activation of instrument input devices by approaching fingers or pens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146—Instrument input by gesture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146—Instrument input by gesture
    • B60K2360/1464—3D-gesture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/33—Illumination features
    • B60K2360/334—Projection means

Definitions

  • the invention relates to an infotainment system for a vehicle according to the preamble of claim 1. Furthermore, the invention relates to a
  • Vehicle known to access locally stored in the vehicle data or external data. Access to external data takes place, for example, via the Internet. This can be a driver or another occupant of the vehicle
  • a driver or other occupant of the vehicle may use the infotainment system to provide data to particular objects of interest, also referred to as Points Of Interest or POI, that is, to spend.
  • objects of interest also referred to as Points Of Interest or POI
  • this relates to data about objects located near the vehicle, for example a gas station, a restaurant or another object.
  • a three-dimensional camera system is provided according to the invention, by means of which at least one predeterminable gesture of an occupant can be detected, wherein the gesture is directed to an object of interest to the occupant and subsequently Data for this object can be output to the occupants.
  • These gestures are usually performed subconsciously by the occupant, such as directing the view of an object of interest.
  • directing a finger on an object of interest is known from everyday life, so that the use of the infotainment system No special gestures are required. This considerably increases the comfort for the occupant.
  • a part of the three-dimensional camera system is in such a way
  • Vehicle interior arranged that a vehicle interior is detected.
  • the three-dimensional camera system has a further part which is arranged on the vehicle such that an external vehicle environment can be detected.
  • an external vehicle environment can be detected.
  • objects located outside the vehicle can preferably also be detected.
  • both the part of the three-dimensional camera system directed towards the external vehicle environment and its part directed into the vehicle interior each comprise at least two cameras.
  • the three-dimensional camera system comprises only a part with two or three cameras whose detection range is designed such that both a vehicle interior and an outer
  • Vehicle environment are detectable.
  • the infotainment system is connected or connectable to a data memory, in particular via the Internet, which comprises three-dimensional coordinates of a number of specific objects.
  • the infotainment system can this one
  • a method according to the invention for using an infotainment system comprises the following steps:
  • the method allows a significant improvement in comfort when using an infotainment system over the prior art.
  • an interesting for the occupant object can be identified in a quick and easy way.
  • the detected gesture is determined by means of a segmentation of an image background by using a
  • Deep threshold value identified For this purpose, certain characteristics of the occupant can be detected. With reference to a hand in the vehicle, it is, for example, the position and / or orientation of a fingertip, a finger's center of gravity and / or a finger shape. Also, objects outside the vehicle can be identified based on its 3D shape or 2D shape or its texture, wherein preferably a global position and orientation of the vehicle and / or its position and orientation with respect to the objects imaged in the image background are known or ascertainable or is.
  • the output of the information stored on the object can be any suitable output of the information stored on the object.
  • a marker is preferably optically displayed on a windshield, which gives a return information about the selected object.
  • a framing of the selected object or its image on the windshield it is possible to present a framing of the selected object or its image on the windshield.
  • a voice command For example, the question "What is this?" Activates, allowing the inmate to easily request the output of the information.
  • FIG. 1 shows schematically a perspective view of a
  • the sole FIGURE 1 shows a vehicle interior in a perspective view.
  • Fingertip 2 in particular index finger tip, and the center of gravity 3 are detected by means of an in-vehicle 3D camera system, not shown, shown.
  • a vector 4 is determined from the detected position of the center of gravity 3 and the fingertip 2, which vector is a pointing direction
  • the 3D camera system detects a building 5.
  • the building 5 is - apart from the translucent ones
  • the driver not shown, thus has the building 5 as
  • a marker 6 is displayed as a border 6 of the building 5 on the windshield of the vehicle, which highlights the building 5 as a selected object.
  • the driver then receives from a data store to the building 5 stored information, such as name, size, year, owner and tenant, the information on one in the
  • Vehicle interior arranged display unit can be emitted acoustically and / or loudspeakers acoustically.
  • the outline 6 shown can be displayed before the information output, simultaneously or later.
  • the 3D camera system not shown here is part of an infotainment system, also not shown, which is arranged in the vehicle interior.
  • the infotainment system can access locally stored data in the vehicle or external data and this the
  • Access to external data is for example via the Internet, the
  • Information from the aforementioned data storage are also accessible via the Internet.
  • the 3D camera system has a detection area which comprises both the vehicle interior and at least parts of an external vehicle environment. In this case, in particular, a lying in front of the vehicle in the direction of travel area of detected external vehicle environment.
  • the 3D camera system has at least two cameras arranged in the vehicle interior.
  • a part of the 3D camera system can also be arranged on the vehicle.
  • two more cameras are arranged on the vehicle, which are directed to an external vehicle environment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Image Analysis (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention concerns an infotainment system for a vehicle, by means of which data relating to a particular object of interest can be output. According to the invention, a 3D camera system is provided, by means of which at least one predefinable gesture of a vehicle occupant can be detected, the gesture being directed to an object in which the vehicle occupant is interested and it subsequently being possible for data concerning this object to be output for said occupant. The invention further concerns a method for using an infotainment system.

Description

Infotainmentsystem für ein Fahrzeug  Infotainment system for a vehicle
Beschreibung description
Die Erfindung betrifft ein Infotainmentsystem für ein Fahrzeug gemäß dem Oberbegriff des Anspruchs 1 . Weiterhin betrifft die Erfindung eine The invention relates to an infotainment system for a vehicle according to the preamble of claim 1. Furthermore, the invention relates to a
Verwendung eines solchen Infotainmentsystems. Im Stand der Technik sind verschiedene Infotainmentsysteme für einUse of such an infotainment system. Various infotainment systems are known in the art
Fahrzeug bekannt, die auf lokal im Fahrzeug gespeicherte Daten oder auf externe Daten zugreifen. Der Zugriff auf externe Daten erfolgt beispielsweise über das Internet. Damit kann ein Fahrer oder ein sonstiger Insasse des Fahrzeuges Vehicle known to access locally stored in the vehicle data or external data. Access to external data takes place, for example, via the Internet. This can be a driver or another occupant of the vehicle
Informationen über Objekte außerhalb des Fahrzeuges erhalten, sofern derartige Daten hinterlegt sind; dies kann durch Zugriff auf externe Daten über das Internet, also online, oder durch Zugriff auf im Fahrzeug  Receive information about objects outside the vehicle, provided such data is stored; This can be done by accessing external data via the Internet, ie online, or by accessing the vehicle
gespeicherte Daten, also offline, erfolgen. stored data, so offline, done.
Beispielsweise kann ein Fahrer oder ein sonstiger Insasse des Fahrzeuges das Infotainmentsystem dazu verwenden, Daten zu interessierenden bestimmten Objekten, die auch als Points Of Interest oder als POI bezeichnet werden, zur Verfügung zu stellen, also sich ausgeben zu lassen. Insbesondere betrifft dies Daten zu Objekten, die sich in Fahrzeugnähe befinden, beispielsweise eine Tankstelle, ein Restaurant oder eine anderes Objekt. For example, a driver or other occupant of the vehicle may use the infotainment system to provide data to particular objects of interest, also referred to as Points Of Interest or POI, that is, to spend. In particular, this relates to data about objects located near the vehicle, for example a gas station, a restaurant or another object.
Aufgabe der vorliegenden Erfindung ist es, ein gegenüber dem Stand der Technik verbessertes Infotainmentsystem für ein Fahrzeug sowie einObject of the present invention is an improved over the prior art infotainment system for a vehicle and a
Verfahren zur Verwendung eines solchen Infotainmentsystems anzugeben, mittels dem ein Komfort für einen Insassen gegenüber dem Stand der Technik verbesserbar ist. To provide a method of using such an infotainment system by means of which a comfort for an occupant can be improved over the prior art.
Hinsichtlich des Infotainmentsystems wird die Aufgabe erfindungsgemäß mit den in Anspruch 1 angegebenen Merkmalen und hinsichtlich des Verfahrens mit den in Anspruch 8 angegebenen Merkmalen gelöst. With regard to the infotainment system, the object is achieved according to the invention with the features specified in claim 1 and in terms of the method with the features specified in claim 8.
Bei einem Infotainmentsystem für ein Fahrzeug, mittels dem Daten zu einem bestimmten interessierenden Objekt ausgebbar sind, ist erfindungsgemäß ein dreidimensionales Kamerasystem vorgesehen, mittels dem wenigstens eine vorgebbare Geste eines Insassen erfassbar ist, wobei die Geste auf ein den Insassen interessierendes Objekt gerichtet ist und wobei anschließend Daten zu diesem Objekt an den Insassen ausgebbar sind. Das derart ausgebildete Infotainmentsystem verbessert einen Komfort für einen Insassen des Fahrzeugs signifikant gegenüber dem Stand der In an infotainment system for a vehicle, by means of which data can be output to a specific object of interest, a three-dimensional camera system is provided according to the invention, by means of which at least one predeterminable gesture of an occupant can be detected, wherein the gesture is directed to an object of interest to the occupant and subsequently Data for this object can be output to the occupants. The thus formed infotainment system improves comfort for an occupant of the vehicle significantly over the prior art
Technik, da der Insasse hierbei die Möglichkeit hat, Informationen zu Technology, because the inmate has the opportunity to provide information
Objekten, insbesondere zu außerhalb des Fahrzeugs befindlichen Objekten durch Ausführen einer einfachen Geste zu erhalten. Zudem ist es möglich, mittels der Geste ein einzelnes Objekt auszuwählen und damit Informationen nur bezüglich des ausgewählten Objekts zu erhalten. Obtain objects, in particular objects located outside of the vehicle by performing a simple gesture. In addition, it is possible to select a single object by means of the gesture and thus to obtain information only with regard to the selected object.
Als eine Geste sind bzw. ist dabei eine Lage und/oder eine Ausrichtung eines Insassen kopfes und/oder eine Blickrichtung eines Insassen und/oder eine Lage einer Fingerspitze und/oder ein Schwerpunkt eines Fingers und/oder eine Form eines Fingers und/oder eine Richtung, in die ein Finger zeigt, vorgebbar. Diese Gesten werden zumeist unterbewusst vom Insassen durchgeführt, wie beispielsweise den Blick auf ein interessierendes Objekt zu richten. Auch das Richten eines Fingers auf ein interessierendes Objekt ist aus dem Alltag bekannt, so dass zur Verwendung des Infotainmentsystems keine speziellen Gesten erforderlich sind. Dies erhöht den Komfort für den Insassen erheblich. As a gesture, a position and / or an orientation of an occupant's head and / or a viewing direction of an occupant and / or a position of a fingertip and / or a center of gravity of a finger and / or a shape of a finger and / or a Direction in which a finger points, specifiable. These gestures are usually performed subconsciously by the occupant, such as directing the view of an object of interest. Also, directing a finger on an object of interest is known from everyday life, so that the use of the infotainment system No special gestures are required. This considerably increases the comfort for the occupant.
Zur Erfassung einer Geste und/oder eines Objekts innerhalb des Fahrzeugs ist ein Teil des dreidimensionalen Kamerasystems derart in einem For detecting a gesture and / or an object within the vehicle, a part of the three-dimensional camera system is in such a way
Fahrzeuginneren angeordnet, dass ein Fahrzeuginnenraum erfassbar ist.  Vehicle interior arranged that a vehicle interior is detected.
Gemäß einem bevorzugten Ausführungsbeispiel weist das dreidimensionale Kamerasystem einen weiteren Teil auf, welcher derart am Fahrzeug angeordnet ist, dass eine äußere Fahrzeugumgebung erfassbar ist. Damit sind vorzugsweise auch außerhalb des Fahrzeugs befindliche Objekte erfassbar. According to a preferred embodiment, the three-dimensional camera system has a further part which is arranged on the vehicle such that an external vehicle environment can be detected. Thus, objects located outside the vehicle can preferably also be detected.
Vorzugsweise umfassen sowohl der zur äußeren Fahrzeugumgebung gerichtete Teil des dreidimensionalen Kamerasystems als auch dessen in den Fahrzeuginnenraum gerichteter Teil jeweils wenigstens 2 Kameras. Preferably, both the part of the three-dimensional camera system directed towards the external vehicle environment and its part directed into the vehicle interior each comprise at least two cameras.
Damit ist es möglich, sowohl den Fahrzeuginnenraum als auch die äußere This makes it possible to use both the vehicle interior and the exterior
Fahrzeugumgebung dreidimensional zu erfassen. Alternativ ist es auch möglich, dass das dreidimensionale Kamerasystem nur einen Teil mit zwei oder drei Kameras umfasst, dessen Erfassungsbereich derart ausgebildet ist, dass sowohl ein Fahrzeuginnenraum als auch eine äußere Vehicle environment to capture three-dimensional. Alternatively, it is also possible that the three-dimensional camera system comprises only a part with two or three cameras whose detection range is designed such that both a vehicle interior and an outer
Fahrzeugumgebung erfassbar sind.  Vehicle environment are detectable.
Zur Identifizierung des ausgewählten Objekts ist das Infotainmentsystem mit einem Datenspeicher verbunden oder verbindbar, insbesondere über das Internet, welcher dreidimensionale Koordinaten einer Anzahl von bestimmten Objekten umfasst. Das Infotainmentsystem kann hierbei einen To identify the selected object, the infotainment system is connected or connectable to a data memory, in particular via the Internet, which comprises three-dimensional coordinates of a number of specific objects. The infotainment system can this one
Merkmalsvergleich des ausgewählten Objekts und der in dem Datenspeicher vorhandenen Objekte durchführen. Somit ist vorzugweise mittels des dreidimensionalen Kamerasystems und unter Verwendung des Perform feature comparison of the selected object and the objects present in the data store. Thus, preferably by means of the three-dimensional camera system and using the
Datenspeichers erfassbar, auf welches Objekt der Insasse des Fahrzeuges seine Geste richtet. Ein erfindungsgemäßes Verfahren zur Verwendung eines Infotainmentsystems umfasst folgende Schritte: Data storage detectable on which object the occupant of the vehicle directs his gesture. A method according to the invention for using an infotainment system comprises the following steps:
- dreidimensionales Erfassen einer richtungsweisenden Geste eines im Erfassungsbereich befindlichen Insassen,  three-dimensional detection of a directional gesture of an occupant located in the detection area,
- Ermitteln eines Vektors, welcher eine Richtung der Geste repräsentiert, Determining a vector representing a direction of the gesture,
- Extrapolieren des Vektors auf eine vorbestimmbare Länge und Extrapolate the vector to a predeterminable length and
- Auswählen eines Objekts, welches den extrapolierten Vektor an erster Stelle schneidet.  Selecting an object which intersects the extrapolated vector in the first place.
Das Verfahren ermöglicht eine wesentliche Komfortverbesserung bei der Verwendung eines Infotainmentsytems gegenüber dem Stand der Technik. Hierbei kann ein für den Insassen interessantes Objekt auf schnelle und einfache Art und Weise identifiziert werden. The method allows a significant improvement in comfort when using an infotainment system over the prior art. Here, an interesting for the occupant object can be identified in a quick and easy way.
Gemäß einem Ausführungsbeispiel wird die erfasste Geste mittels einer Segmentierung von einem Bildhintergrund durch Anwendung eines According to an exemplary embodiment, the detected gesture is determined by means of a segmentation of an image background by using a
Tiefenschwell wertes identifiziert. Dazu sind bestimmte Eigenschaften des Insassen erfassbar. Bezogen auf eine Hand im Fahrzeug handelt es sich dabei zum Beispiel um Lage und/oder Orientierung einer Fingerspitze, eines Fingerschwerpunktes und/oder einer Fingerform. Auch Objekte außerhalb des Fahrzeugs sind basierend auf dessen 3D-Form oder 2D-Form oder dessen Textur identifizierbar, wobei bevorzugt eine globale Position und Ausrichtung des Fahrzeugs und/oder dessen Position und Ausrichtung in Bezug auf die im Bildhintergrund abgebildeten Objekte bekannt oder ermittelbar sind bzw. ist. Deep threshold value identified. For this purpose, certain characteristics of the occupant can be detected. With reference to a hand in the vehicle, it is, for example, the position and / or orientation of a fingertip, a finger's center of gravity and / or a finger shape. Also, objects outside the vehicle can be identified based on its 3D shape or 2D shape or its texture, wherein preferably a global position and orientation of the vehicle and / or its position and orientation with respect to the objects imaged in the image background are known or ascertainable or is.
Die Ausgabe der zum Objekt hinterlegten Informationen können The output of the information stored on the object can
vorzugsweise optisch und/oder akustisch ausgegeben werden. Dazu kann beispielsweise ein Zentraldisplay oder ein Head-up-Display verwendet werden. Bevorzugt wird bei kontaktanaloger Bilddarstellung auf einer Frontscheibe ein Marker optisch dargestellt, der eine Rückinformation zum ausgewählten Objekt gibt. Somit ist es möglich, eine Umrahmung des ausgewählten Objektes oder dessen Abbildung auf der Windschutzscheibe darzustellen. preferably be issued optically and / or acoustically. For this purpose, for example, a central display or a head-up display can be used. In the case of contact-analogous image representation, a marker is preferably optically displayed on a windshield, which gives a return information about the selected object. Thus, it is possible to present a framing of the selected object or its image on the windshield.
Besonders bevorzugt wird die Ausgabe von Informationen zum Particularly preferred is the output of information for
ausgewählten Objekt mittels eines Sprachbefehls, z. B. durch die Frage „Was ist das?", aktiviert. Damit kann der Insasse auf einfache Art und Weise die Ausgabe der Informationen anfordern. selected object by means of a voice command, z. For example, the question "What is this?" Activates, allowing the inmate to easily request the output of the information.
Anhand der beigefügten schematischen Figur wird die Erfindung im With reference to the attached schematic figure, the invention is in
Folgenden genauer beschrieben. Described in more detail below.
Dabei zeigt: Showing:
Figur 1 schematisch eine perspektivische Ansicht eines 1 shows schematically a perspective view of a
Fahrzeuginnenraums.  Vehicle interior.
Die einzige Figur 1 zeigt einen Fahrzeuginnenraum in perspektivischer Ansicht. The sole FIGURE 1 shows a vehicle interior in a perspective view.
Im Fahrzeuginnenraum ist eine Hand 1 eines Insassen, dessen In the vehicle interior is a hand 1 of an occupant whose
Fingerspitze 2, insbesondere Zeigefingerspitze, und Handschwerpunkt 3 mittels eines nicht dargestellten, fahrzeuginternen 3D-Kamerasystems detektiert werden, dargestellt. Fingertip 2, in particular index finger tip, and the center of gravity 3 are detected by means of an in-vehicle 3D camera system, not shown, shown.
Erfindungsgemäß wird aus der erfassten Position von Handschwerpunkt 3 und Fingerspitze 2 ein Vektor 4 ermittelt, der eine Zeigerichtung According to the invention, a vector 4 is determined from the detected position of the center of gravity 3 and the fingertip 2, which vector is a pointing direction
repräsentiert. In Richtung des Vektors 4 erfasst das 3D-Kamerasystenn ein Gebäude 5. Das Gebäude 5 ist - abgesehen von der lichtdurchlässigen represents. In the direction of the vector 4, the 3D camera system detects a building 5. The building 5 is - apart from the translucent ones
Windschutzscheibe - das erste Objekt, mit dem sich der Vektor 4 schneidet. Der nicht gezeigte Fahrzeugführer hat somit das Gebäude 5 als Windscreen - the first object with which vector 4 intersects. The driver, not shown, thus has the building 5 as
interessierendes Objekt ausgewählt. object of interest selected.
Dabei ist ein Marker 6 als eine Umrandung 6 des Gebäudes 5 auf der Windschutzscheibe des Fahrzeuges angezeigt, welcher das Gebäude 5 als ausgewähltes Objekt hervorhebt. In this case, a marker 6 is displayed as a border 6 of the building 5 on the windshield of the vehicle, which highlights the building 5 as a selected object.
Der Fahrzeugführer erhält anschließend von einem Datenspeicher zum Gebäude 5 hinterlegte Informationen, beispielsweise Name, Größe, Baujahr, Eigentümer und Mieter, wobei die Informationen auf einer in dem The driver then receives from a data store to the building 5 stored information, such as name, size, year, owner and tenant, the information on one in the
Fahrzeuginnenraum angeordneten Anzeigeeinheit optisch und/oder mittels Lautsprechern akustisch ausgebbar sind. Die gezeigte Umrandung 6 kann dabei vor der Informationsausgabe, gleichzeitig oder später angezeigt werden. Vehicle interior arranged display unit can be emitted acoustically and / or loudspeakers acoustically. The outline 6 shown can be displayed before the information output, simultaneously or later.
Das nicht gezeigte 3D-Kamerasystem ist hierbei Teil eines ebenfalls nicht näher dargestellten Infotainmentsystems, welches im Fahrzeuginnenraum angeordnet ist. Das Infotainmentsystem kann auf lokal im Fahrzeug gespeicherte Daten oder auf externe Daten zugreifen und diese dem The 3D camera system, not shown here is part of an infotainment system, also not shown, which is arranged in the vehicle interior. The infotainment system can access locally stored data in the vehicle or external data and this the
Fahrzeugführer und/oder weiteren Insassen ausgeben. Der Zugriff auf externe Daten erfolgt beispielsweise über das Internet, wobei die Issue driver and / or other inmates. Access to external data is for example via the Internet, the
Informationen aus dem zuvor genannten Datenspeicher ebenfalls über das Internet abrufbar sind. Information from the aforementioned data storage are also accessible via the Internet.
Das 3D-Kamerasystem weist im vorliegenden Ausführungsbeispiel einen Erfassungsbereich auf, welcher sowohl den Fahrzeuginnenraum als auch zumindest Teile einer äußeren Fahrzeugumgebung umfasst. Dabei wird insbesondere ein vor dem Fahrzeug in Fahrtrichtung liegender Bereich einer äußeren Fahrzeugumgebung erfasst. Das 3D Kamerasystem weist dazu mindestens zwei im Fahrzeuginnenraum angeordnete Kameras auf. In the present exemplary embodiment, the 3D camera system has a detection area which comprises both the vehicle interior and at least parts of an external vehicle environment. In this case, in particular, a lying in front of the vehicle in the direction of travel area of detected external vehicle environment. For this purpose, the 3D camera system has at least two cameras arranged in the vehicle interior.
Alternativ oder zusätzlich kann auch ein Teil des 3D Kamerasystems am Fahrzeug angeordnet sein. Dazu sind beispielsweise zwei weitere Kameras am Fahrzeug angeordnet, die auf eine äußere Fahrzeugumgebung gerichtet sind. Alternatively or additionally, a part of the 3D camera system can also be arranged on the vehicle. For this example, two more cameras are arranged on the vehicle, which are directed to an external vehicle environment.
Bezugszeichenliste LIST OF REFERENCE NUMBERS
1 Hand 1 hand
2 Fingerspitze 3 Handschwerpunkt 2 fingertip 3 center of gravity
4 Vektor 4 vector
5 Gebäude  5 buildings
6 Marker  6 markers

Claims

Patentansprüche claims
1 . Infotainmentsystem für ein Fahrzeug, mittels dem Daten zu einem bestimmten interessierenden Objekt ausgebbar sind, 1 . Infotainment system for a vehicle, by means of which data can be output to a specific object of interest,
gekennzeichnet durch ein dreidimensionales Kamerasystem, mittels welchem wenigstens eine vorgebbare Geste eines Insassen erfassbar ist, wobei die Geste auf ein den Insassen interessierendes Objekt gerichtet ist und wobei anschließend Daten zu diesem Objekt an den Insassen ausgebbar sind.  characterized by a three-dimensional camera system by means of which at least one predeterminable gesture of an occupant is detectable, wherein the gesture is directed to an object of interest to the occupant and wherein subsequently data on this object can be output to the occupant.
2. Infotainmentsystem nach Anspruch 1 , 2. Infotainment system according to claim 1,
dadurch gekennzeichnet, dass als eine Geste eine Lage und/oder eine Ausrichtung eines Insassenkopfes und/oder eine Blickrichtung eines Insassen und/oder eine Lage einer Fingerspitze (2) und/oder ein Schwerpunkt eines Fingers und/oder eine Form eines Fingers und/oder eine Richtung, in die ein Finger zeigt, vorgebbar sind bzw. ist.  characterized in that as a gesture a position and / or orientation of an occupant's head and / or a viewing direction of an occupant and / or a position of a fingertip (2) and / or a center of gravity of a finger and / or a shape of a finger and / or a direction in which a finger points, is predeterminable or is.
3. Infotainmentsystem nach Anspruch 1 oder 2, 3. Infotainment system according to claim 1 or 2,
dadurch gekennzeichnet, dass ein Teil des dreidimensionalen  characterized in that a part of the three-dimensional
Kamerasystems derart in einem Fahrzeuginneren angeordnet ist, dass ein Fahrzeuginnenraum erfassbar ist.  Camera system is arranged in a vehicle interior such that a vehicle interior can be detected.
4. Infotainmentsystem nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass ein weiterer Teil des dreidimensionalen Kamerasystems derart am Fahrzeug angeordnet ist, dass eine äußere Fahrzeugumgebung erfassbar ist. 4. Infotainment system according to one of the preceding claims, characterized in that a further part of the three-dimensional camera system is arranged on the vehicle such that an external vehicle environment can be detected.
5. Infotainmentsystem nach Anspruch 3 oder 4, 5. Infotainment system according to claim 3 or 4,
dadurch gekennzeichnet, dass sowohl der zur äußeren  characterized in that both the outer
Fahrzeugumgebung gerichtete Teil des dreidimensionalen Kamerasystenns als auch dessen in den Fahrzeuginnenraum gerichteter Teil jeweils wenigstens zwei Kameras umfassen. Vehicle environment directed part of the three-dimensional Kamerystenns and its directed into the vehicle interior part each comprise at least two cameras.
Infotainmentsystem nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass das Infotainmentsystem mit einem Datenspeicher verbunden oder verbindbar ist, welcher Infotainment system according to one of the preceding claims, characterized in that the infotainment system is connected or connectable to a data memory, which
dreidimensionale Koordinaten einer Anzahl von bestimmten Objekten umfasst. comprises three-dimensional coordinates of a number of particular objects.
Infotainmentsystem nach Anspruch 6, Infotainment system according to claim 6,
dadurch gekennzeichnet, dass mittels des dreidimensionalen characterized in that by means of the three-dimensional
Kamerasystems und unter Verwendung des Datenspeichers erfassbar ist, auf welches Objekt der Insasse des Fahrzeuges seine Geste richtet.  Camera system and using the data storage is detected on which object the occupant of the vehicle directs his gesture.
Verfahren zur Verwendung eines Infotainmentsystems gemäß der Ansprüche 1 bis 7, Method for using an infotainment system according to claims 1 to 7,
gekennzeichnet durch folgende Schritte: characterized by the following steps:
- dreidimensionales Erfassen einer richtungsweisenden Geste eines im Erfassungsbereich befindlichen Insassen,  three-dimensional detection of a directional gesture of an occupant located in the detection area,
- Ermitteln eines Vektors (4), der eine Richtung der Geste  - Determine a vector (4) that gives a direction of the gesture
repräsentiert und represented and
- Extrapolieren des Vektors (4) auf eine vorbestimmbare Länge und Extrapolating the vector (4) to a predeterminable length and
- Auswählen eines Objekts, welches den extrapolierten Vektor (4) an erster Stelle schneidet. Selecting an object which intersects the extrapolated vector (4) in the first place.
Verfahren nach Anspruch 8, Method according to claim 8,
dadurch gekennzeichnet, dass die Geste mittels einer Segmentierung von einem Bildhintergrund durch Anwendung eines characterized in that the gesture by means of a segmentation of a picture background by application of a
Tiefenschwell wertes identifiziert wird. Deep threshold value is identified.
10. Verfahren nach Anspruch 8 oder 9, 10. The method according to claim 8 or 9,
dadurch gekennzeichnet, dass zum Objekt hinterlegte Informationen optisch und/oder akustisch ausgegeben werden.  characterized in that information stored on the object is output optically and / or acoustically.
1 1 . Verfahren nach einem der Ansprüche 8 bis 10, 1 1. Method according to one of claims 8 to 10,
dadurch gekennzeichnet, dass bei kontaktanaloger Bilddarstellung auf einer Frontscheibe ein Marker (6) optisch dargestellt wird, der eine Rückinformation zum ausgewählten Objekt gibt.  characterized in that in contact-analogue image representation on a windscreen, a marker (6) is displayed optically, which gives a return information to the selected object.
12. Verfahren nach einem der Ansprüche 8 bis 1 1 , 12. The method according to any one of claims 8 to 1 1,
dadurch gekennzeichnet, dass die Ausgabe von Informationen zum ausgewählten Objekt mittels eines Sprachbefehls aktiviert wird.  characterized in that the output of information on the selected object is activated by means of a voice command.
PCT/EP2014/064329 2013-11-04 2014-07-04 Infortainment system for a vehicle WO2015062750A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102013222302.1 2013-11-04
DE102013222302 2013-11-04

Publications (2)

Publication Number Publication Date
WO2015062750A1 true WO2015062750A1 (en) 2015-05-07
WO2015062750A8 WO2015062750A8 (en) 2015-07-16

Family

ID=51167875

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2014/064329 WO2015062750A1 (en) 2013-11-04 2014-07-04 Infortainment system for a vehicle

Country Status (1)

Country Link
WO (1) WO2015062750A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018149768A1 (en) * 2017-02-15 2018-08-23 Bayerische Motoren Werke Aktiengesellschaft Automated activation of a vision support system
WO2018162674A1 (en) * 2017-03-08 2018-09-13 Nicolas Bissantz Device for monitoring the viewing direction of a person
WO2020126143A1 (en) * 2018-12-20 2020-06-25 Robert Bosch Gmbh Device and method for controlling the output of driver information and for maintaining the attention of a driver of an automated vehicle
DE102021118628A1 (en) 2021-07-19 2023-01-19 Bayerische Motoren Werke Aktiengesellschaft Method for displaying land points in a vehicle

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009046376A1 (en) * 2009-11-04 2011-05-05 Robert Bosch Gmbh Driver assistance system for automobile, has input device including manually operated control element that is arranged at steering wheel and/or in area of instrument panel, where area lies in direct vicinity of wheel
WO2012107892A2 (en) * 2011-02-09 2012-08-16 Primesense Ltd. Gaze detection in a 3d mapping environment
US20130030811A1 (en) * 2011-07-29 2013-01-31 Panasonic Corporation Natural query interface for connected car
DE102012000274A1 (en) * 2012-01-10 2013-07-11 Daimler Ag A method and apparatus for operating functions in a vehicle using gestures executed in three-dimensional space and related computer program product

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009046376A1 (en) * 2009-11-04 2011-05-05 Robert Bosch Gmbh Driver assistance system for automobile, has input device including manually operated control element that is arranged at steering wheel and/or in area of instrument panel, where area lies in direct vicinity of wheel
WO2012107892A2 (en) * 2011-02-09 2012-08-16 Primesense Ltd. Gaze detection in a 3d mapping environment
US20130030811A1 (en) * 2011-07-29 2013-01-31 Panasonic Corporation Natural query interface for connected car
DE102012000274A1 (en) * 2012-01-10 2013-07-11 Daimler Ag A method and apparatus for operating functions in a vehicle using gestures executed in three-dimensional space and related computer program product

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018149768A1 (en) * 2017-02-15 2018-08-23 Bayerische Motoren Werke Aktiengesellschaft Automated activation of a vision support system
WO2018162674A1 (en) * 2017-03-08 2018-09-13 Nicolas Bissantz Device for monitoring the viewing direction of a person
WO2020126143A1 (en) * 2018-12-20 2020-06-25 Robert Bosch Gmbh Device and method for controlling the output of driver information and for maintaining the attention of a driver of an automated vehicle
US11423778B2 (en) 2018-12-20 2022-08-23 Robert Bosch Gmbh Device and method for controlling the output of driver information and for maintaining the attention of a driver of an automated vehicle
DE102021118628A1 (en) 2021-07-19 2023-01-19 Bayerische Motoren Werke Aktiengesellschaft Method for displaying land points in a vehicle

Also Published As

Publication number Publication date
WO2015062750A8 (en) 2015-07-16

Similar Documents

Publication Publication Date Title
DE102012223730B4 (en) DEVICE AND METHOD FOR ADJUSTING A PARKING POSITION BASED ON AN AV IMAGE
DE102012222972A1 (en) Method for determining trajectory of driving maneuver, involves inputting symbol on touch-sensitive display device by user, where target pose is recognized depending on input symbol
DE102014009077A1 (en) Parking control device, parking control method and parking control system
EP3695266B1 (en) Method for operating a display device in a motor vehicle
DE102013011311B4 (en) Method for operating an information system of a motor vehicle and information system for a motor vehicle
DE102012218837A1 (en) Method for displaying a representation on head-up display or head-mounted display e.g. LCD in passenger car, involves determining representation that is to-be-superimposed from view of user in environment, and assigning representation
WO2015062750A1 (en) Infortainment system for a vehicle
DE102010003851A1 (en) Destination marking method for motor vehicle driver, involves determining position of destination relative to vehicle, and embedding virtual object in real vehicle environment that is visible to vehicle occupant on head-up display
DE102016008231A1 (en) Method and device for generating a virtual view from a vehicle
DE102014119317A1 (en) Method for displaying an image overlay element in an image with 3D information, driver assistance system and motor vehicle
DE102017215161A1 (en) Method and device for selecting an environment object in the environment of a vehicle
DE112016005798T5 (en) VEHICLE INTERNAL SYSTEM AND METHOD FOR PROVIDING INFORMATION RELATING TO POINTS OF INTEREST
DE102015015676A1 (en) A method for automatically connecting an environmental image on a display unit of a vehicle
DE102017215956A1 (en) A method of outputting information about an object in an environment of a vehicle, system and automobile
EP2813999A2 (en) Augmented reality system and method of generating and displaying augmented reality object representations for a vehicle
EP2996327B1 (en) Surround view system for vehicles with attachments
DE102013215408A1 (en) A vehicle display system and method for displaying a vehicle environment
DE102013016241A1 (en) Method and device for augmented presentation
DE102018216409A1 (en) Method, device and means of transportation for a kinetose-avoiding representation of a liquid in a display in a means of transportation
DE102018203865A1 (en) Method and device for providing information through an augmented reality device, method and device for providing information for controlling an indication of an augmented reality device, method and device for controlling an indication of an augmented reality device, computer readable storage medium having Instructions for carrying out the procedures
DE102013019114A1 (en) Method and system for operating a display device of a motor vehicle and motor vehicles with a system for operating a display device
WO2019048623A1 (en) Assistance system for a vehicle
DE102013218299A1 (en) A method of detecting damage to a vehicle from a test image, corresponding system and computer program product
DE102019219171A1 (en) Driver assistance system, crowdsourcing module, procedure and computer program
DE102020109789A1 (en) Method for performing self-localization of a vehicle on the basis of a reduced digital map of the surroundings, computer program product and a self-localization system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14737201

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14737201

Country of ref document: EP

Kind code of ref document: A1