DE102019005454A1 - Device for the interactive support of a vehicle user - Google Patents

Abstract

The invention relates to a device and a method for interactive support of a vehicle user. The proposed device comprises a camera system (101) for capturing image data BD from an object O arranged on a seat of the vehicle FZ or on a loading area of a loading space of the vehicle FZ, an evaluation device (102) for evaluating the image data BD and for determining at least one Information I (O) characterizing the object O, a storage unit (103) on which input requests EA (I (O)) dependent on the at least one information I (O) with associated input options EM (EA (I (O))) are stored , an output unit (104) for outputting a stored input request EA (I (O)) dependent on the determined information I (O), an input unit (105) for inputting one of the input options EM (EA (I (O))), and a control unit (106), which is designed to store one of the input options EM (EA (I (O))) as acknowledged and / or automatically a function F after the vehicle user has entered it ig from the input information EM (EA (I (O))) entered by the vehicle user.

Description

The invention relates to a device and a method for interactive support of a vehicle user in the vehicle and a vehicle with such a device.

From the pamphlet DE 10 2015 010 421 A1 a motor vehicle is known in which a vehicle interior is detected by means of a 3D sensor system, and a controllable component of the motor vehicle is controlled as a function of the result of the three-dimensional detection.

The object of the invention is to specify a device and a method for the interactive support of a vehicle user that is based on a recognition of objects in the vehicle, in particular on a seat or a loading area of the vehicle.

The invention results from the features of the independent claims. The dependent claims relate to advantageous developments and refinements.

A first aspect of the invention relates to a device for interactive support of a vehicle user, comprising: a camera system for capturing image data BD from an object O arranged on a seat of the vehicle FZ or on a loading surface of a loading space of the vehicle FZ; an evaluation device for evaluating the image data BD and for determining at least one item of information I (O) characterizing the object O; a memory unit on which input requests EA (I (O)) dependent on the at least one item of information I (O) with associated input options EM (EA (I (O))) are stored; an output unit for outputting a stored input request EA (I (O)) which is dependent on the determined information I (O); an input unit ( 105 ) to enter one of the input options EM (EA (I (O))); and a control unit that is designed to save one of the input options EM (EA (I (O))) by the vehicle user as acknowledged and / or automatically set a function F = F (EM (EA (I ( O)))) depending on the input information EM (EA (I (O))) entered by the vehicle user.
The camera system is advantageously used to capture 2D or 3D image data. The detection area of the camera system advantageously comprises an area which is sufficiently large to completely detect an object which is arranged or can be arranged on the seat or the loading area.

The term “object O” is understood broadly in the present case. In particular, it includes a person (e.g. baby, toddler, adult, etc.), an animal (e.g. dog, cat, mouse, etc.) and any objects (e.g. baby seat, piece of luggage, suitcase, Christmas tree, wheelchair, book, etc.) ).

The camera system is designed and set up in such a way that an object O arranged on the seat or the loading area is captured in image data BD. The camera system advantageously comprises a video camera, a stereo camera, a TOF camera, a laser scanner, an ultrasonic sensor or a combination thereof. Furthermore, the camera system advantageously comprises a light source for illuminating a partial interior space of the vehicle assigned to the seat. The light source is advantageously an infrared light source.

The evaluation device for evaluating the image data BD and for determining at least one item of information I (O) characterizing the object O is advantageously designed as an image data computing unit that has a processor and image data evaluation software running on it.

The term “Information I (O)” is understood broadly here. It basically includes all information that can be determined from an analysis of the image data BD about an object O mapped therein, such as shape, dimensions, color, pose, position, type of object, etc. The specific content of the information I (O) depends on the specific application and is selected appropriately.

The input requests EA (I (O)), which are dependent on the at least one item of information I (O), with the associated input options EM (EA (I (O))) are advantageously stored digitally on the memory unit.

The term “input request EA (I (O))” is understood broadly here. It basically includes all information, in the form of alphanumeric and / or graphic and / or acoustic formats, which, when output, cause a vehicle user to make an entry.
The term “associated input options EM (EA (I (O)))” denotes a number N of predefined input options EM _n (EA (I (O))) assigned to the respective input prompt EA (I (O)), with n = 1, 2, ..., N and N ≥ 1, i.e. an input prompt EA (I (O)) are the input options EM _{n = 1} (EA (I (O))), EM _{n = 2} (EA (I (O))), ..., EM _{n = N} (EA (I (O))).

The term automatically describes that after selecting one of the input options EM (EA (I (O))), a function of a vehicle component is carried out without further action, that is to say, for example, a driver's seat is changed by changing the Seat height, inclination of the seat surface and seat back and / or the longitudinal position moved into a predetermined position.

In the simplest case, the output of the input request EA (I (O)) includes a message to the vehicle user, which the vehicle user has to acknowledge by means of an input (e.g. manual, acoustic input). In this case, there is only one possible input EM (EA (I (O))), namely the input representing an acknowledgment of the information issued, from which the vehicle user can infer that the information issued has been acknowledged.

The input options EM (EA (I (O)) can also include the selection of one or more options. The output of the input prompt E EA (I (O)) or the input options EM (EA (I (O))) is advantageously optical and / or acoustic.

The output unit is advantageously designed to output optical and / or acoustic and / or haptic information. The input unit is advantageously designed for inputting optical and / or acoustic and / or haptic input information.

If, for example, the information I (O) is an indication of the dimensions of a person sitting on the front passenger seat, the input request EA (I (O)) can, for example, have two input options, EM _{n = 1} (EA (I (O))), EM _{n = 2} (EA (I (O))) consist in confirming an automatically determined optimal position of the passenger seat, which is also output in the input prompts EA (I (O)) [EM _{n = 1} (EA (I (O)))] or, alternatively, to enter a different position of the passenger seat [EM _{n = 2} (EA (I (O)))].

The proposed device supports a vehicle user interactively when using a vehicle, in which it depends on the occupancy of a seat or an occupancy of a loading area of the vehicle FZ by an object O, input prompts EA (I (O)) and assigned input options EM (EA (I ( O))), which must at least be actively acknowledged by the vehicle user or the vehicle user must make a respective selection from the possible input options EM (EA (I (O))). In this way, the vehicle user can be made aware of certain conditions, dangers, sensible / optional actions, etc., or he can continue to select one or more of the displayed input options EM (EA (I (O))) on a vehicle function F act. For example, after a corresponding input by the vehicle user, this is saved as acknowledged by the control unit, which ensures that information is read by the user and re-display is suppressed, or the control unit automatically performs or initiates the execution of a function F = F (EM (EA (I (O)))) depending on the input information EM (EA (I (O))) entered by the vehicle user. In principle, the function F can be any function F of the vehicle or a vehicle system that is directly or indirectly dependent on the occupancy of a seat or an occupancy of a loading area of the vehicle with an object O. For example, the function F can adjust the seat occupied by the object O. or the adjustment of a seat in front of, behind or next to the seat with the object O. The function F can also relate to an activation / deactivation of an airbag or a door lock, a setting of an air conditioning or ventilation system, a vehicle window, a shading device, a roof window, an entertainment system, etc. of the vehicle. The output unit is advantageously designed and set up in such a way that input options EM _F (EA (I (O))) assigned to the function F are output. Furthermore, after one of the input options EM (EA (I (O))) has been entered by the vehicle user, the control unit controls the output unit to delete the displayed input request EA (I (O)) and the input options EM (EA (I (O))) at.

An advantageous development of the proposed device is characterized in that the evaluation device for evaluating the image data BD is designed and set up with face recognition, the information I (O) indicating an individualization of a person or a child. This makes it possible to output individualized input prompts EA (I (O)) and assigned input options EM (EA (I (O))) and thus, for example, to control individualized functions F of the vehicle FZ after appropriate input. As an alternative or in addition, the information I (O) indicates the position of the face or the eyes of the person or the child or the baby. This makes it possible to output individualized input prompts EA (I (O)) and assigned input options EM (EA (I (O))) that depend on the position of the face or eyes of the person or the child or the baby and so for example to control individualized functions F of the vehicle FZ after appropriate input.

An advantageous development of the proposed device is characterized in that the evaluation device is designed and set up to determine a skeleton model of a person recognized in the image data BD, at least one dimension of the person and / or a current pose of the person being determined on the basis of the skeleton model and the characterizing information I (O) indicating at least one dimension of the person and / or the current pose of the person. This makes it possible, provided that the object O is a person, input prompts EA (I (O)) and assigned input options EM (EA (I (O))) depending on the person's dimensions and / or the person's poses. output, and so after appropriate input of dimensions of the person and / or of poses of the person-dependent functions F of the vehicle FZ to control.

An advantageous development of the proposed device is characterized in that the characterizing information I (O) includes an orientation and / or a size / extension of the object O. This makes it possible to output input prompts EA (I (O)) and assigned input options EM (EA (I (O))) that are dependent on an orientation and / or a size / extent of the object O and thus, after a corresponding input, for example, from an orientation and / or to control functions F of the vehicle FZ that are dependent on a size / extent of the object O.

An advantageous development of the proposed device is characterized in that the characterizing information I (O) classifies the object O into an object class K _{n of} a number N of predefined object classes K _n with n = 1, 2, ..., N, and N> 1, ie, I (O) = K _n (O). This makes it possible to output input prompts EA (I (O)) and assigned input options EM (EA (I (O))) that are dependent on the classification of the object O in an object class K _n and thus, after appropriate input, e.g. of a classification of the object O to control functions F of the vehicle FZ which are dependent on an object class K _n .

• K_n=1: erwachsene Person,
• K_n=2: Kind,
• K_n=3: Babysitz entgegen Fahrtrichtung angeordnet,
• K_n=3b: Babysitz in Fahrtrichtung angeordnet,
• K_n=4: Tier, insbesondere: Hund, Katze, und
• K_n=5: anderes Objekt.

The classification advantageously distinguishes at least the following five object classes K _n :

• K _{n = 1} : adult person,
• K _{n = 2} : child,
• K _{n = 3} : Baby seat arranged against the direction of travel,
• K _{n = 3b} : Baby seat arranged in the direction of travel,
• K _{n = 4} : animal, in particular: dog, cat, and
• K _{n = 5} : other object.

An advantageous development of the proposed device is characterized in that the output unit is designed and set up in such a way that in the case of a classification of the object O on the seat as a baby seat, which is arranged against the direction of travel, and the airbag assigned to the seat is switched on, an input request EA (I (O)) is issued, which enables deactivation of the airbag or that in the case of a classification of the object O as a child or adult and switched off, the airbag assigned to the seat, a prompt EA (I (O)) is issued, which enables the vehicle user to activate the airbag. With a selection of a corresponding input option EM (EA (I (O)) of the vehicle user, the control unit ( 105 ) deactivates or activates the airbag accordingly.

An advantageous development of the proposed device is characterized in that the output unit is designed and set up in such a way that, in the case of a classification of the object O on the seat as an adult, a child or a baby (seat), an optimized setting with regard to a Position of the seat, to a setting of a seat belt assigned to the seat and / or in relation to an airbag assigned to the seat is determined and output, an input request EA (I (O)) being output which asks the vehicle user to make the optimal settings determined accept or reject, with the control unit making the corresponding optimized settings when the corresponding input option EM (EA (I (O)) is selected.

An advantageous development of the proposed device is characterized in that the output unit is designed and set up in such a way that, in the event of a classification of the object O on the seat, in particular on the passenger seat, as a baby seat, an input request EA (I (O)) is output , which offers the vehicle user an input option EM (EA (I (O)), the current or optimized setting of the seat, in particular a position and / or a pose of the seat, a memory button assigned to the driver and / or front passenger seat for storing seat settings By selecting the appropriate input option EM (EA (I (O)), the control unit assigns the current setting of the seat to the respective memory button. If the detected object 0 is a baby seat, then the optimized setting of the seat on which the baby seat is attached , stored in an advantageous manner on the driver's memory button After the seat has been adjusted, the When driving again with the baby seat, the driver can easily call up the optimized setting from his seat using the memory button.

An advantageous development of the proposed device is characterized in that the output unit ( 104 ) is designed and set up in such a way that in the case of a classification of the object O on the seat as a child, an input prompt EA (I (O)) is output, which offers the vehicle user an input option EM (EA (I (O)), by means of which a child lock a vehicle door assigned to the seat can be activated.

An advantageous further development of the proposed device is characterized in that the output unit is designed and set up in such a way that in the event of a classification of the object O on the seat as a baby seat and if there is no seat belt buckle signal assigned to the seat, an input request EA (I (O)) is output, which offers the driver an acknowledgeable input option EM (EA (I (O)) as a read confirmation. The term "seat belt lock signal" refers to a signal that is generated when a seat belt is closed, ie inserted into the seat belt buckle.

An advantageous further development of the proposed device is characterized in that the output unit is designed and set up in such a way that, in the event of a classification of the object O as an object having a predetermined pose and / or minimum dimensions, an input request EA (I (O)) is output that asks the vehicle driver to fix the object in the vehicle or to secure it and offers an EM (EA (I (O)) input option that can be acknowledged.

A preferred development of the proposed device is characterized in that the input options EM (EA (I (O))) indicate parameters P, (F) assigned to the respective function F, with i = 1, 2, ..., I, I = I (F) and I ≥ 1, where the output unit ( 104 ) both preset settings of the parameters P _{l, before} (F) as well as an assigned range [P _{l, min} (F), P _{l, max} (F)] with P _{i, before} (F) ∈ [P _{i, min} ( F), P _{i, max} (F)] is output in that the proposed settings P _{i, before} (F) of the respective parameters P, (F) can be changed by corresponding input of changed parameter settings P _{i, before} (F) *. For example, a parameter range from x = 0 (move all the way forward) to x = 30 (move all the way back) is output for an adjustment of the seat in the direction of travel (x-axis); the vehicle user can use a suggested setting P _{i, in front of} (F ) or select a setting P _{i, before} (F) * _that differs from the suggested setting P _{i, before} (F) * from the range [P _{l, min} (F), P _{i, max} (F)]. The range [P _{i, min} (F), P _{i, max} (F)] preferably specifies settings of a vehicle component which offer a high level of occupant protection. The area offers a vehicle user a possibility of variation, which at the same time offers a high level of driving safety. Thus, for example, an unfavorable position in relation to the airbag, an unfavorable belt run, etc. are excluded.

• - eine Auswahlmöglichkeit einer Funktionen F des Fahrzeugs FZ und
• - eine Auswahlmöglichkeit, ob diese Funktionen F jeweils entweder mit den vorgeschlagenen Einstellungen der Parameter P_i,vor(F) oder mit veränderten Parametereinstellungen P_i,vor(F)* ausgeführt werden sollen.

The proposed device is characterized by the fact that the input option EM (EA (I (O)) indicates:

• - A selection option of a function F of the vehicle FZ and
• - A choice of whether these functions F are to be carried out either with the proposed settings of the parameters P _{i, before} (F) or with changed parameter settings P _{i, before} (F) *.

• - eine Einstellung des Sitzes (Position, Höhe, Kopfstütze, Rückenlehne, Oberschenkelunterstützung, Lordosenstütze, Sitzheizung, etc.), und/oder
• - eine Einstellung des dem Sitz zugeordneten Rückhaltegurtsystems (Gurtkraftbegrenzung, Auslösekraft, Anschnallsignalisierung, etc..), und/oder
• - eine Einstellung des dem Sitz zugeordneten Airbag (Aktivierung/Deaktivierung),
• - eine Einstellung des dem Sitz zugeordneten Sonnenschutzsystems,
• - eine Einstellung des dem Sitz zugeordneten Beleuchtungssystems,
• - eine Einstellung des dem Sitz zugeordneten Entertainmentsystems,
• - eine Einstellung des dem Sitz zugeordneten Klimatisierungssystems,
• - eine Einstellung der dem Sitz zugeordneten Türverriegelung,
• - eine Einstellung des Schiebedachs,
• - eine Sperrung einer Schiebebetätigung bei erkanntem Kind
• - Durchzuführende Einstellungen von Fahrzeugsystemen und Ausführung von Fahrzeugfunktionen sofern nach einer Verriegelung des Fahrzeugs von außen ein Kind oder ein Tier auf einem Sitz oder im Laderaum des Fahrzeugs erkannt wird,
• - eine automatische Verriegelung des Fahrzeugs, wenn keine Person, kein Kind oder kein Tier auf einem Sitz oder im Laderaum des Fahrzeugs erkannt wird.

The function F of the vehicle FZ advantageously relates to:

• - an adjustment of the seat (position, height, headrest, backrest, thigh support, lumbar support, seat heating, etc.), and / or
• - an adjustment of the restraint belt system assigned to the seat (belt force limitation, release force, seat belt signaling, etc ..), and / or
• - a setting of the airbag assigned to the seat (activation / deactivation),
• - an adjustment of the sun protection system assigned to the seat,
• - an adjustment of the lighting system assigned to the seat,
• - a setting of the entertainment system assigned to the seat,
• - a setting of the air conditioning system assigned to the seat,
• - an adjustment of the door lock assigned to the seat,
• - an adjustment of the sunroof,
• - a blocking of a sliding operation when a child is recognized
• - Settings to be carried out for vehicle systems and execution of vehicle functions if, after the vehicle has been locked, a child or animal is recognized from outside on a seat or in the cargo area of the vehicle,
• - an automatic locking of the vehicle if no person, no child or no animal is detected on a seat or in the cargo area of the vehicle.

An advantageous development of the proposed device is characterized in that the device additionally comprises a force sensor system which determines a weight G (O) that the object O exerts on the seat or the floor of the cargo space, the information I captured from the image data (O) the recorded weight G (0) can be assigned. This enables input prompts EA (I (O)) and dependent on the weight G (O) and the information I (O) to output associated input options EM (EA (I (O))) and so, after appropriate input, for example, to control functions F of the vehicle FZ that are dependent on the weight G (O) or to output an input request EA (I (O)) that the vehicle driver prompts you to fix or secure the object in the vehicle and to acknowledge the EA (I (O)) prompt.

• - mit einem ein Kamerasystem Erfassen von Bilddaten BD von einem auf einem Sitz des Fahrzeugs FZ oder auf einer Ladefläche eines Laderaums des Fahrzeugs FZ angeordneten Objekts O,
• - mit einer Auswerteeinrichtung Auswerten der Bilddaten BD und Ermitteln zumindest einer das Objekt O charakterisierenden Information I(O),
• - Bereitstellen von der zumindest einen Information I(O) abhängige Eingabeaufforderungen EA(I(O)) mit zugehörigen Eingabemöglichkeiten EM(EA(I(O))) von einer Speichereinheit,
• - mit einer Ausgabeeinheit Ausgeben einer von der ermittelten Information I(O) abhängigen und gespeicherten Eingabeaufforderung EA(I(O)),
• - Eingeben einer der Eingabemöglichkeiten EM(EA(I(O))) in eine Eingabeeinheit, und
• - mit einer Steuereinheit (106) nach erfolgter Eingabe einer der Eingabemöglichkeiten EM(EA(I(O))) durch den Fahrzeugnutzer, diese als quittiert speichern und/oder automatische Ausführung einer Funktion F = F(EM(EA(I(O)))) abhängig von der vom Fahrzeugnutzer eingegebenen Eingabeinformation EM(EA(I(O))).

A second aspect of the invention relates to a method for interactive support of a vehicle user. The procedure consists of the following steps:

• - With a camera system capturing image data BD from an object O arranged on a seat of the vehicle FZ or on a loading area of a loading space of the vehicle FZ,
• - Using an evaluation device, evaluating the image data BD and determining at least one item of information I (O) characterizing the object O,
• - Provision of the at least one information I (O) dependent input requests EA (I (O)) with associated input options EM (EA (I (O))) from a memory unit,
• - with an output unit outputting a stored input request EA (I (O)) that is dependent on the determined information I (O),
• - Entering one of the input options EM (EA (I (O))) in an input unit, and
• - with a control unit ( 106 ) after one of the input options EM (EA (I (O))) has been entered by the vehicle user, save this as acknowledged and / or automatically execute a function F = F (EM (EA (I (O)))) depending on the Input information EM (EA (I (O))) entered by the vehicle user.

In a further embodiment, the method is developed by one or more method steps that are carried out by the device described above.

Further advantages, features and details emerge from the following description in which at least one exemplary embodiment is described in detail - possibly with reference to the drawings. Identical, similar and / or functionally identical parts are provided with the same reference symbols.

• 1 ein stark schematisierter Aufbau einer vorgeschlagenen Vorrichtung,
• 2 ein stark schematisierter Ablaufplan eines vorgeschlagenen Verfahrens.

Show it:

• 1 a highly schematic structure of a proposed device,
• 2 a highly schematic flow chart of a proposed method.

1 shows a highly schematic structure of a proposed device for interactive support of a vehicle user, comprising: a camera system 101 , in the present case a 3D camera for capturing image data BD from an object O arranged on a passenger seat of the vehicle FZ, and an image data evaluation device 102 for evaluating the image data BD and for determining at least one item of information I (O) characterizing the object 0. The device also includes a memory unit 103 on which input requests EA (I (O)) dependent on the at least one item of information I (O) with associated input options EM (EA (I (O))) are stored, an output unit 104 an input unit for outputting a stored input request EA (I (O)) that is dependent on the information I (O) determined 105 for entering one of the input options EM (EA (I (O))), and a control unit 106 which, after one of the input options EM (EA (I (O))) has been entered by the vehicle user, saves this as acknowledged depending on the selected input option EM (EA (I (O))) and / or automatically executes a function F = F (EM (EA (I (O)))) depending on the input information EM (EA (I (O))) entered by the vehicle user.

The proposed device can advantageously be used or configured for the following exemplary embodiments.

To control an airbag system, the device determines whether a rear seat is occupied by a rear-facing baby seat. If such a baby seat has been recognized in the image data BD and the airbag assigned to the rear seat is switched on, the driver is requested to check the status of the airbag and to correct it if necessary. This prompt must be acknowledged by the driver.

In one embodiment, the device is set up such that, in the case of a seat occupied by a person or a child seat oriented in the direction of travel, in the image data and a deactivated airbag is assigned to the seat, the driver is requested to check the status of the airbag and correct if necessary.

In one embodiment, the device is set up in such a way that the dimensions of a person sitting on a seat are determined and a seat setting associated with the dimensions is determined. An input option is also output by means of which the seat is automatically adjusted to the specific seat setting. After selecting the input option, the seat is automatically moved to the suggested position. Manual fine adjustment of this position remains unaffected. That is advantageous The device is set up in such a way that it stores the dimensions of this person, and when this seat is subsequently occupied by another person, a seat adjustment is only offered if the dimensions of the new person differ from the previous person. The dimensions of the seated person are determined using a skeleton model. The from the camera system ( 101 ) detectable body parts are evaluated. From the recorded body parts, a stored model is used to deduce the dimensions of non-detectable body parts hidden in the interior of the vehicle in the camera detection area. A total dimension of the person, for example the total height, is determined by means of dimensions determined by the camera and model. For example, the model assigns a corresponding leg length to an arm length of a person recorded by the camera. Thus, depending on the dimensions of a recognized person, a seat position, an airbag status, an airbag trigger level and / or a belt force limit of the seat belt can be set.

The device can advantageously be designed to compare dimensions of a recognized person on a seat with stored dimensions of a person previously seated on the seat, for example using a generated skeleton model, with an input option for the recognized person if the dimensions of the recognized person deviate above a threshold value Selection of a proposed seat adjustment P _{i, before} (F) is offered for confirmation and / or if the vehicle user wishes to set the actuators for seat adjustment otherwise, an input option for replacing a proposed seat setting P _{i, before} (F) with changed parameter settings P _{i, before} (F) * is output.

Furthermore, the device is set up so that an object on the seat is classified as a child or baby seat and an optimized seat setting is determined with regard to position in the room, to positioning to the airbag, to the seat belt and / or to interior parts and an input option is output Selection causes the seat to be adjusted to the optimized position. In one embodiment, the device is set up in such a way that a further input option is output which causes the optimized seat setting to be saved, the saved optimized seat setting then being able to be called up by pressing a memory button on the driver and / or front passenger side.

In one embodiment, the device is set up in such a way that in the event that a child or baby seat that is not fastened with the belt system is detected on a seat, a driver is informed and a request is issued to the driver to fasten the child seat. This prompt must be acknowledged by the driver. This ensures that a child seat is securely attached / secured to a vehicle seat.

The device thus makes it possible, depending on the type of seat occupancy recognized, to carry out a review and / or a change in vehicle settings related to the seat occupancy interactively. An input from a vehicle user is always required.

The device is advantageously designed to determine rules from a current context (e.g. location, time, vehicle status, navigation data, route information, settings of an infotainment system, settings of an air conditioning system, etc.) of a setting process and associated setting data from stored and current setting data. The input requests EA (I (O)) with the associated input options EM (EA (I (O))) are advantageously adapted based on the rules determined. as a result, the device is capable of learning and adapts to the usage habits of a vehicle user.
For example, it is determined that the vehicle travels a certain route every working day with a child seat in the front passenger seat. The device is then advantageously designed to propose a correspondingly stored setting for the front passenger seat if a child seat is recognized in the front passenger seat on a working day.

The device is advantageously designed to output information when the seat is occupied by an object with dimensions exceeding a threshold value, with the recommendation to buckle the object or to secure it on the seat. The object is advantageously categorized / classified. The information can be output for specified object categories / classes to transport the object in the trunk instead of on the seat.

2 shows a highly schematic flow chart of a proposed method for interactive support of a vehicle user, with the following steps.

In one step 201 takes place with a camera system 101 acquisition of image data BD from an object O arranged on a seat of the vehicle FZ or on a loading surface of a loading space of the vehicle FZ. In one step 202 takes place with an evaluation device 102 an evaluation of the image data BD and a determination 202 at least one item of information I (O) characterizing the object O. In a step 203, the at least one item of information I (O) is made available Input prompts EA (I (O)) with associated input options EM (EA (I (O))) from a storage unit 103 . In a step 204 takes place with an output unit 104 outputting a stored input request EA (I (O)) that is dependent on the determined information I (O).

In a step 205, one of the input options EM (EA (I (O))) is entered into an input unit 105 . A control unit is used in a step 206 106 after one of the input options EM (EA (I (O))) has been entered by the vehicle user, storage as an acknowledgment and / or automatic execution of a function F = F (EM (EA (I (O)))) depending on the Vehicle user entered input option EM (EA (I (O))).

Although the invention has been illustrated and explained in more detail by preferred exemplary embodiments, the invention is not restricted by the disclosed examples and other variations can be derived therefrom by the person skilled in the art without departing from the scope of protection of the invention. It is therefore clear that there is a multitude of possible variations. It is also clear that embodiments cited by way of example really only represent examples which are not to be interpreted in any way as a limitation, for example, of the scope, the possible applications or the configuration of the invention. Rather, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete terms, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without leaving the scope of protection which is defined by the claims and their legal equivalents, such as further explanations in the description.

List of reference symbols

101

Camera system

102

Evaluation device

103

Storage unit

104

Output unit

105

Input unit

106

Control unit

201-202

Procedural steps

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 102015010421 A1 [0002]

Claims (11)

Device for interactive support of a vehicle user, comprising: - A camera system (101) for capturing image data BD from an object O arranged on a seat of a vehicle FZ or on a loading area of a loading space of the vehicle FZ, - an evaluation device (102) for evaluating the image data BD and for determining at least one item of information I (O) characterizing the object O, - A memory unit (103) on which input requests EA (I (O)) dependent on the at least one item of information I (O) with associated input options EM (EA (I (O))) are stored, - an output unit (104) for outputting a stored input request EA (I (O)) which is dependent on the information I (O) determined, - An input unit (105) for inputting one of the input options EM (EA (I (O))), and - A control unit (106), which is designed to save one of the input options EM (EA (I (O))) by the vehicle user as acknowledged and / or automatically a function F depending on the input information entered by the vehicle user EM (EA (I (O))). Device according to Claim 1 , in which the evaluation device (102) is designed and set up to determine a skeleton model of a person recognized as object O in the image data BD, with at least one dimension of the person and / or a current pose of the person being determined on the basis of the skeleton model and the information I (O) indicating at least one dimension of the person and / or the current pose of the person. Device according to one of the Claims 1 to 2 , in which the characterizing information I (O) comprises an orientation and / or a size / extent of the object O. Device according to one of the Claims 1 to 3 , in which the characterizing information I (O) is a classification of the object O into an object class K _{n of} a number N of predetermined object classes K _n with n = 1, 2, ..., N, and N> 1, ie I ( O) = K _n (O), the classification distinguishing between at least the following five object classes K _n : K _{n = 1} : adult, K _{n = 2} : child, K _{n = 3} : baby seat arranged against the direction of travel, K _{n = 3b} : Child or baby seat arranged in the direction of travel, K _{n = 4} : animal, in particular: dog, cat, and K _{n = 5} : other object. Device according to Claim 4 , in which in the case of the classification of the object O as a baby seat against the direction of travel and the airbag assigned to the seat being switched on, an input option EM (EA (I (O)) for deactivating the airbag is output or in the case of the classification of the object O as Child or adult and the airbag assigned to the seat is switched off, an input option EM (EA (I (O)) for activating the airbag is output. Device according to Claim 4 or 5 In the case of the classification of the object O on the seat as an adult, as a child, as a child or baby seat, an optimized setting with respect to a position of the seat, an adjustment of a seat belt assigned to the seat and / or with respect to an airbag assigned to the seat is determined and an input option EM (EA (I (O)) for accepting the setting or rejection is output. Device according to Claim 6 , in which an input option EM (EA (I (O)) is output, by means of which the optimized seat settings can be saved, with the control unit selecting the corresponding input option EM (EA (I (O)) the current setting of the seat of the Assigns memory button to driver and / or front passenger. Device according to Claim 4 to 7th , when the object O on the seat is classified as a baby seat and when a seat belt buckle signal assigned to the seat and no seat belt buckle signal is detected, an acknowledgeable buckle up request is output as an input option EM (EA (I (O)). Device according to Claim 4 to 8th , in which in the case of a classification of the object O on the seat as a child, an input option EM (EA (I (O)) is output, by means of which a child safety device for a vehicle door assigned to the seat can be effected. Device according to one of the Claims 2 to 7th , in which the function F of the vehicle FZ relates to: - an adjustment of the seat (position, height, headrest, backrest, thigh support, lumbar support, seat heating, etc.), and / or - an adjustment of the restraint belt system assigned to the seat (belt force limit, release force Seat belt signaling, etc ..), and / or - a setting of the airbag assigned to the seat (activation / deactivation), - a setting of the sun protection system assigned to the seat, - a setting of the lighting system assigned to the seat, - a setting of the seat assigned Entertainment system, - a setting of the air conditioning system assigned to the seat, - a setting of the door lock assigned to the seat, - a setting of the sliding roof, - a blocking of a sliding operation when a child is detected - vehicle systems to be adjusted and vehicle functions to be carried out if, after the vehicle has been locked from the outside, a child or an animal on a seat or in the cargo space of the vehicle is recognized, - an automatic locking of the vehicle if no person, no child or no animal is recognized on a seat or in the cargo area of the vehicle. Method for interactive support of a vehicle user, with the steps: - With a camera system (101) capturing (201) image data BD from an object O arranged on a seat of the vehicle FZ or on a loading area of a loading space of the vehicle FZ, - with an evaluation device (102) evaluating the image data BD and determining (202) at least one item of information I (O) characterizing the object O, - Provision (203) of the at least one information I (O) dependent input requests EA (I (O)) with associated input options EM (EA (I (O))) from a memory unit (103), - with an output unit (104) outputting (204) a stored input request EA (I (O)) which is dependent on the determined information I (O), - Entering (205) an input option EM (EA (I (O))) in an input unit (105), and - with a control unit (106) after one of the input options EM (EA (I (O))) has been entered by the vehicle user, this is saved as acknowledged and / or a function F is automatically executed depending on the input option EM (EA (EA ( I (O))).

Images