DE102017215404A1 - Method, mobile user device, system, computer program for controlling a mobile user device of an occupant of a vehicle - Google Patents

Abstract

Method for controlling a mobile user device of an occupant of a vehicle, in particular in an at least partially automated driving, comprising at least
Detecting a traffic situation and / or determining a specific need for action of at least one occupant of a vehicle while driving,
Transmitting information about the detected traffic situation and / or the at least one specific action requirement of the occupant of the vehicle to the mobile user device of the occupant of the vehicle and then
- Control of the mobile user device, in particular an output unit of the mobile user device depending on the transmitted information.

Description

The invention relates to a method, a device, a system and a corresponding computer program for controlling a mobile user device of an occupant of a vehicle, in particular in an at least partially automated driving. Furthermore, the scope of the invention also includes a suitably equipped mobile user device.

In the future, vehicles will be operated increasingly automated, so that a driver does not always have to concentrate on the vehicle or on the driving environment. However, depending on the situation, it may be necessary for the driver to focus on the driving environment (even at very short notice). At the same time it is the desire of the occupants of the automated moving vehicle to use the ever greater relief of the driving tasks for further employment.

It is an object of the present invention to provide a method and a device comprising a mobile user device, which indicate an improved usability of a mobile user device in the vehicle, in particular in an at least partially automated driving. Furthermore, it is the object of the invention to output a (expedient, desired or necessary) information to at least one occupant of the vehicle, in particular in connection with an at least partially automated driving.

The object is solved by the features of the independent claims. Advantageous embodiments are characterized in the subclaims.

The invention is characterized by a method for controlling a mobile user device of an occupant of a vehicle, in particular in an at least partially automated driving. The invention is also characterized by a device which is designed to carry out the method. The method comprises detecting a traffic situation and / or determining a specific need for action of at least one occupant of a vehicle, in particular at least partially automated. The method further comprises transmitting information dependent on the detected traffic situation and / or on the at least one specific need for action of the at least one occupant of the vehicle to the mobile user device of the occupant of the vehicle. The method then further comprises a control of the mobile user device, in particular a direct or indirect control of an output unit of the mobile user device depending on the transmitted information.

Particularly preferably, the method is executable in an at least partially automated driving or depending on the at least partially automated driving operation of the vehicle. For the partially automated driving or driving operation, a driving or driving operation supported by a driver assistance system can also be counted.

The mobile user device of an occupant of a vehicle is, in particular, a mobile user device carried in the vehicle (when driving) or mounted in the vehicle. In particular, the occupant's mobile user device is the mobile user device used by a (particular) occupant.

The information dependent on the detected traffic situation and / or on the at least one specific action requirement of the occupant of the vehicle can be determined in the method, in particular by means of the vehicle or a vehicle unit, depending on one or more qualitative and / or quantitative parameters of the detected, especially interpreted traffic situation and / or the need for action.

For example, the output unit of the at least one mobile user device operated in the vehicle can be controlled in such a way that at least one content to be output so far, e.g. Display, image sequence, e.g. a movie, audio content is changed and / or paused. Thus, a (for modern people almost instinctive drive) the virtual content with a high attention to pursue, at least temporarily weakened.

The content to be output so far may be another, so to speak, "own" content, for example "own" content generated by the mobile user device, in particular independent of the vehicle or the journey. act a computer game or a user interface of a social network. The previously issued content is in particular independent of the vehicle or the ride in the vehicle. The output unit of the mobile user equipment may be more or less directly or indirectly, e.g. by influencing a running application or the operating system of the mobile user device. In particular, the control of the output unit can take place with a high (far above average) priority in comparison to at least one further content to be output.

Alternatively or additionally, the output unit of the at least one in the vehicle powered user device controlled such that by means of the output unit (again by human perception interpretable, certain) occupant information is output. In terms of their contents, output parameters, in particular an output time or output time interval, etc., the occupant information may be in a predetermined relationship with the detected traffic situation and / or with the determined need for action. For example, at least one content, output parameter, in particular an output time or output time interval is determined depending on one or more parameters of the detected traffic situation and / or the need for action. Preferably, the display of occupant information with a higher priority and / or perceptibility is initiated than one or more contents previously output at the mobile user device.

Preferably, the said occupant information can at least temporarily and / or at least partially replace at least one content that was previously output at the mobile user device. For example, by directly or indirectly driving the output unit of the mobile user equipment, a ratio of the sizes, display areas, contents of a content to be outputted (vehicle-independent) and a traffic situation and / or a need for action related to the operation the vehicle dependent) passenger information changed, in particular adapted.

In particular, the method is carried out such that, an occupant, for example the driver of the vehicle or an occupant in the driver's seat, occupant information regarding the traffic situation and / or a need for action, in particular with respect to an action to be performed by the occupant, by the said , in particular actively serviced by him, gets mobile user device. This can preferably be done in the method still while the perception and / or attention of the occupant in question is essentially concentrated on the mobile user device or certain other contents on the mobile user device, e.g. while its perceptual channels, e.g. Eyes, targeted listening, sensing, etc. are concentrated on the mobile user device. Among other things, there is the advantage of a very fast transmission, a conscious perceptibility, readability of the occupant information or a corresponding, appropriate response by the occupant concerned. Thereupon, the respective inmate can then, in the real world, e.g., by changing the contents of the mobile user device output, on the mobile user device used by him and / or with the help of the occupant information output at the mobile user device. in relation to the current driving context of the journey, the real vehicle environment, etc., reacting or acting quickly and appropriately.

The transmission of said information to the detected traffic situation and / or the at least one specific action requirement of the occupant of the vehicle to the mobile user device of the occupant of the vehicle can take place in the form of a predetermined code. In this case, the required data rate can be reduced, for example, in comparison to a transmission of all the information to be output at the mobile user device, or the transmission speed can be increased.

Particularly preferably, the transmission of said information takes place by means of an immediate wired or wireless data exchange. Preferably, the transmission of said information by means of WLAN or preferably by means of a so-called WPAN (= Wireless Personal Area Network), e.g. a near-field transmission method, e.g., Bluetooth or the like. In this case, a very high real-time capability of the method can be achieved. Thus, there are numerous advantages compared to, for example, indirect data exchange, e.g. via several intermediate computing units. For example, the transmitted information may include control signals for direct or indirect control of the output unit of the mobile user device.

Furthermore, in the method, a further (second) information from the at least one mobile User device to the vehicle or to the vehicle unit are transmitted. This further information may be indicative of (among other things) which activation of the output unit of the mobile user equipment has been successfully carried out, for example, the timing of the change of a previous content and / or the output of occupant information on the mobile user equipment. Also, further information may be indicative of the reaction of the occupant concerned to the activation of said at least one output unit of the mobile user device.

For example, at least one function of the vehicle can be controlled to receive the wide information (depending on the receipt of the further information). For example, the at least one vehicle function, in particular a function for at least partially automated driving, will be actuated depending on whether and how the at least one occupant reacted to the activation of the output unit of his mobile user device. For example, further information can be transmitted from the at least one mobile user device to the vehicle or to the vehicle unit, which is indicative that the occupant has interrupted the operation of the user device and / or the perception or attention of the mobile user device or of has turned away from a particular content of the mobile user device. Such further information can be determined, for example, by means of the mobile user device, e.g. by means of the camera of the mobile user device. The transmitted further information can be stored in the on-board network of the vehicle, e.g. be provided to control at least one vehicle function. Upon transmission of the further information from the at least one mobile user device to the vehicle or to the vehicle unit, e.g. an at least partially automated vehicle guidance, in particular a currently executed or planned for the near future vehicle guidance action, e.g. a maneuver, be changed, a decision with respect to at least one (current) influencing the leadership of the vehicle are taken or a safety measure, for example, a so-called pre-crash action in the vehicle be prompted.

The output unit here is in particular a display, e.g. a screen display and / or an actuator and / or an audio output and / or a unit connected to a body, such as a headphone and / or a hearing aid.

Particularly preferably, the control takes place in such a way that the control of the output unit represents a specific (concrete) information, in particular a concrete feature regarding the traffic situation and / or the specific (concrete) action requirement of the driver.

The method may preferably be executable in one or more mobile user devices carried in the interior of the vehicle. The method is particularly preferably implemented as a function of the recognition of at least one mobile user device and / or depending on a recognized (active) use of the at least one mobile user device in the vehicle and / or depending on the driving mode of the vehicle. The method may be executed depending on the recognition of a, in particular a degree exceeding, use of a mobile user device in the vehicle and / or recognizing the driving operation of the vehicle, in particular depending on a exceeding a certain limit parameter parameters of the driving operation of the vehicle.

The traffic situation in the context of this document is an up-to-date or, in the near future, a few seconds imminent traffic situation. In particular, the traffic situation is to be understood as a traffic situation in the immediate surroundings of the vehicle. In other words, the traffic situation means a traffic situation that is effective for the vehicle at the given time interval or in the near future of a few seconds (almost immediately). In particular, the traffic situation is a traffic situation recorded with sensory means (camera, radar, lidar, ultrasound system). Alternatively or additionally, the traffic situation may be understood as an arrangement or arrangement pattern and / or movement parameters of further objects, e.g. Road users in the immediate vicinity of the vehicle, e.g. in relation to the vehicle.

The traffic situation and / or the need for action can be detected or evaluated in the method in connection with the respective driving context, type of road, urban, out-of-town, road layout, traffic sign arrangement, behavior of at least one other road user.

Preferably, the evaluation of the traffic situation is carried out at least partially by means of the vehicle. In this case, the (suitably designed and / or configured) sensor system of the vehicle and in particular means of at least one driver assistance system, a safety system or a system for carrying out the at least partially automated driving can be used. Alternatively or additionally, evaluation of the traffic situation can be carried out at least partially by means of the mobile user device.

The method thus achieves that the driver or occupant, who is supposed to do something with respect to driving and is predominantly in virtual reality with his or her attention, still in the virtual reality on the (occurred or coming, predicted) real situation is prepared.

Preferably, in the method, expedient occupant information, in particular at a suitably selected point in time, in particular depending on a predefined condition, can be output to at least one occupant within the virtual reality perceived in a (predefined) relation to the traffic situation and / or traffic situation Need for action, especially a need for action or need for action in relation to the identified traffic situation are transmitted.

In a greatly simplified example, the occupant gets selected occupant information related to the current or imminent traffic situation or one (on this traffic situation tailored action), while his perception, concentration, for example, his gaze to a substantial extent still on the mobile user device or a content output at the mobile user device, eg in a virtual reality, is.

The said action requirement may be e.g. also be a necessary or recommended operating action for the operation of the vehicle by the occupant, in particular the driver or the occupant at the driver's seat. Particularly preferably, the need for action or the occupant information which is output on detecting the action requirement relates to a specific driving task, for example influencing the transverse guidance, longitudinal guidance, maneuver execution of the vehicle. The occupant information can therefore be a specific information characterizing the traffic situation and / or the need for action, which is directed in particular to the particular occupant. Further, the occupant information may have a possible or imminent consequence of the traffic situation and / or performing or not performing an action, e.g. a specific operator action in relation to the vehicle or a driving task.

Furthermore, the occupant information output on the mobile user device depending on the transmitted information may relate to the actions, in particular driving tasks or driving actions, which are explicitly not recommended for the current time interval or in relation to the detected traffic situation and / or with regard to the determined action requirement. to avoid. For example, if it is determined that the occupant is actively using a mobile user device at the driver's seat and during which a certain driving action has been planned or started by the at least partially automated, in particular highly automated, moving vehicle, such an activation of the output unit can take place as a counterproductive (possibly instinctive or frightened) Reaction of the occupant, eg braking is avoided. For example, when a change in the at least guidance of the vehicle, for example, an overtaking operation, threading operation, an avoidance operation (e.g., due to a changed traffic situation) is made partially automated, certain occupant information may be output to the occupant's mobile user equipment. The occupant information may indicate that the occupant should refrain from certain actions. In this case, the occupant information can also identify the specific reason and / or a consequence for the actions.

Alternatively or additionally, the said information to be transmitted to the mobile user device can be determined depending on a technical condition of the vehicle. For example, the information to be transmitted can be determined and transmitted as a function of a technical condition of the vehicle that falls below a certain limit value, in particular a technical condition of one or more vehicle systems requiring immediate or prompt action by at least one occupant. Then, the at least one output unit of the mobile user device can be controlled accordingly. For example, the said information to be transmitted to the mobile user device can be determined as a function of a more or less abrupt or unexpected deterioration in the technical condition of the vehicle. For example, occupant information can be output on the mobile user device which identifies a specific (applicable) technical problem of the vehicle and / or a specific need for action, possibly concerning or within the current journey, in connection with the technical state of the vehicle.

Thus, by the method also a longer orientation and orientation in the real situation after averting the perception and / or attention, e.g. the view of the occupant, the mobile user device, and / or spares the typically required Augenakkommodation (on a real) vehicle environment and / or vehicle displays.

Occupant information may be output to the occupant, in particular to the driver of the vehicle, who is already using it before, during or shortly after the transmission of his / her perception and / or attention from the mobile user device to the real environment of the vehicle.

Since the said transmission of perception and / or attention depends on numerous criteria, e.g. Lighting differences (between the interior of the vehicle, vehicle environment, display of the mobile user device), complexity of the driving context, disruptive factors can take up to 5 seconds, there is a significant advantage that the said, in particular certain occupant information during this time is already available or is already known to the occupant.

For example, occupant information may be output to the occupant, who provides the occupant with at least one particular clue or tendency for a decision, reaction, a driver's action, even before his or her perception and / or attention sufficiently transmitted to the vehicle environment. In this case, the said time of a few seconds can be used appropriately and / or a surprise of the driver can be avoided, for example with a traffic situation not expected by him or by an action decision to be taken.

The information transmitted to the mobile user device (by the vehicle or by a vehicle-operated computing unit) can be determined in the method such that it is in a predetermined relationship with the traffic situation and / or the need for action. The transmitted information may depend on the particular, e.g. selected, e.g. One or more certain thresholds exceeding parameters of the traffic situation and / or a need for action are determined. For example, it can be decided depending on one or more predetermined conditions that information is transmitted to or depending on the traffic situation and / or the need for action. Also, a content, a parameter of the information to be transmitted can be determined depending on one or more parameters of the traffic situation and / or a need for action.

• - eine Veränderung eines aktuell ausgegebenen Inhalts, z.B. einer aktuellen Anzeige des mobilen Anwendergeräts, z.B. eine Minimierung einer ablenkenden Anzeige, und/oder ein Erzeugen einer weiteren Anzeige auf dem mobilen Anwendergerät im Zusammenhang mit der erkannten Verkehrssituation bzw. mit dem Handlungsbedarf des Insassen des Fahrzeugs, und/oder
• - eine Veränderung einer Audioausgabe des mobilen Anwendergeräts, z.B. eine Reduktion der Lautstärke oder Pausieren einer auditiven Kommunikation, und/oder eine Ausgabe eines Sounds im Zusammenhang mit der erkannten Verkehrssituation bzw. mit dem Handlungsbedarf des Insassen des Fahrzeugs mit dem mobilen Anwendergerät, und/oder
• - eine Ansteuerung eines Aktors des mobilen Anwendergeräts, insbesondere eines Umwuchtaktors, Vibrationsaktors, Beschleunigungsaktors im Zusammenhang mit der erkannten Verkehrssituation bzw. mit dem Handlungsbedarf des Insassen des Fahrzeugs mit dem mobilen Anwendergerät.

Depending on the transmitted information in connection with the detected traffic situation or with the need for action of the occupant of the vehicle, particular preference is given to:

• - A change of a currently output content, such as a current display of the mobile user device, such as minimizing a distracting display, and / or generating a further display on the mobile user device in connection with the detected traffic situation or with the need for action of the occupant of the vehicle , and or
• a change in an audio output of the mobile user device, eg a reduction of the volume or pausing of an auditory communication, and / or an output of a sound in connection with the detected traffic situation or with the action requirement of the occupant of the vehicle with the mobile user device, and / or
• - An activation of an actuator of the mobile user device, in particular a Umwuchtaktors, vibration actuator, acceleration actuator in connection with the detected traffic situation or with the need for action of the occupant of the vehicle with the mobile user device.

In a simplified case, the information to be transmitted to the at least one mobile user device operated in the vehicle and / or an occupant information output thereupon may be an identifier for a qualitative or quantitative parameter of the traffic situation and / or the need for action (eg need for action with respect to the traffic situation). include. For example, the information to be transmitted to the at least one mobile user device operated in the vehicle and / or an occupant information output thereupon may include a parameter relating to the type and / or criticality of the detected traffic situation and / or the nature and / or urgency of at least one Need for action.

For example, the occupant information then output to the at least one mobile user device comprises a component (by human perception) that can be quickly interpreted, e.g. Symbols, selected sounds, certain haptic patterns, etc.

Particularly preferably, in the method, a (previously used) active display content of the mobile user device can be reduced or edited, and / or a further display can be displayed which at least partially represents a relevant traffic situation and / or a specific need for action associated with the traffic situation of the occupant of the vehicle ,

Preferably, the modification, in particular reduction and / or pausing of the content previously output by means of the mobile user equipment and / or the output of the occupant information with the middle of the mobile user equipment to at least one vehicle means, e.g. be determined with the sensor system of the vehicle determinable condition. Such a condition may e.g. indicate that the detected traffic situation corresponds to predefined criteria, in particular if a (safety) critical traffic situation and / or (safety) critical need for action is recognized.

The method may include preparing the data for the at least one detected traffic situation and / or for at least one action requirement. The processing can be carried out at least partially by means of the vehicle and / or at least partially by means of the mobile user device. In this case, for example, data of the sensor system of the vehicle can be processed, in particular analyzed, interpreted. A processing of the data here is in particular a filtering, eg an extraction of relevant facts and / or a highlighting of critical objects in the environment of the vehicle. Furthermore, the preparation of the data may include determining a forecast for the near future, for example extrapolating at least part of the traffic situation and / or a need for action for the next few seconds.

The processing of the data preferably comprises determining information to be transmitted to the mobile user device and / or occupant information to be output thereon at the mobile user device, which relates to the traffic situation and / or the action required at a time in the near future, e.g. approximately, 1, 2, 3, 5, 10 seconds after the triggering of the output unit of the mobile user device is valid or optimized.

In particular, the information to be transmitted to the at least one mobile user device and / or the subsequently issued occupant information can relate to the traffic situation and / or the need for action which will apply (for example, according to an extrapolation of the traffic situation for the near future). Thus, after the accommodation of his eyes, e.g. for example, upon a dark environment of the vehicle after viewing a bright screen of the mobile user device, have occupant information that will apply (at least with a certain degree of probability) at about the time the accommodation is sufficiently completed. Thus, the driver of the vehicle or the occupant seat at the driver's seat can then perceive the then prevailing traffic situation more or less seamlessly, quickly find the "connection", react or act.

For example, in at least two occupants in the vehicle an occupant and / or a particular mobile user device can be determined, which can transmit its perception and / or attention (at least with a high probability) better or faster to the real environment. Then at least one specific mobile user device is transmitted to the at least one information to be transmitted and / or the occupant information output subsequently to the mobile user device is selected.

Preferably, a previous display, which has been observed or operated, for example, by the occupant, reduced in terms of their display area, display sharpness, virtually perceived proximity to the display, in particular minimized. The reduction in this context may also include a complete shutdown, hiding or shifting to the background. Preferably, the at least one output unit of the mobile user device is controlled in such a way that a reduction and / or pausing of the previously output content occurs. For example, a reduction of the previously output contents to the more important peripheries and / or a symbolic representation of at least part of the contents, e.g. the display contents, audio contents, haptic and / or tactile-perceptible contents. For example, a virtual reality generated by the mobile user device, e.g. a video game will be paused. It can be achieved that the perception and / or attention of the occupant much more quickly to his real environment, especially on the traffic situation or on a specific action, e.g. Operating action to be transmitted.

According to an optional embodiment, upon transmission of the at least one information to the mobile user device, a change of a content output with the output unit of the mobile user device takes place and / or an output of a specific occupant information with the output device.

Alternatively or additionally, at about the same time as transmitting the at least one information to the mobile user device or transmitting the at least one information to the mobile user device, a change of a content output with a human-machine interface of the vehicle and / or to an output of a certain occupant information by means of a man-machine interface of the vehicle done. For example, at least one output at the man-machine interface of the vehicle can be made dependent on a, in particular, confirmed transmission of said information to a mobile user device of the vehicle.

• - eine Aufforderung zur Zuwendung der Fahreraufmerksamkeit zu der Fahrzeugumgebung,
• - eine Aufforderung zur Zuwendung der Aufmerksamkeit des Insassen, insbesondere des Insassen am Fahrersitz bzw. des Fahrers zu einer Information des Fahrzeugs, insbesondere zu einer Anzeige des Fahrzeugs, insbesondere betreffend eine Fahrzeugführung,
• - eine Aufforderung zum Greifen des Lenkrads, insbesondere als ein sogenanntes „Hands-On-Request“
• - eine Aufforderung zum Antippen oder Bedienen eines Pedals des Fahrzeugs oder einer Bestätigung der Bedienbereitschaft zum Bedienen zumindest eines Pedals durch den Insassen, insbesondere den Insassen am Fahrersitz bzw. Fahrer,
• - eine Aufforderung zur Veränderung der Fahrzeuggeschwindigkeit,
• - eine Aufforderung zum Einhalten eines, insbesondere seitlichen Abstands,
• - eine Aufforderung zum Mitwirken des Insassen, insbesondere des Insassen am Fahrersitz bzw. des Fahrers bei einem bestimmten Manöver,
• - eine Aufforderung zur Entscheidung des Insassen, insbesondere des Insassen am Fahrersitz bzw. des Fahrers in Bezug auf ein bestimmtes Manöver,
• - eine Übernahmeaufforderung zumindest eines Teils der Fahrzeugführung durch den Insassen, insbesondere den Insassen am Fahrersitz bzw. den Fahrer.

According to an optional embodiment, the control of the output unit of the mobile user device is representative of:

• an invitation to attract driver attention to the vehicle environment,
• a request for the attention of the occupant, in particular the occupant at the driver's seat or the driver, to an information of the vehicle, in particular to a display of the vehicle, in particular concerning a vehicle guidance,
• a request to grasp the steering wheel, in particular as a so-called "hands-on request"
• a request to tap or operate a pedal of the vehicle or a confirmation of operator readiness to operate at least one pedal by the occupant, in particular the occupants of the driver's seat or driver,
• a request to change the vehicle speed,
• - a request to maintain a, in particular lateral distance,
• a request for the participation of the occupant, in particular the occupant at the driver's seat or the driver during a particular maneuver,
• a request for the decision of the occupant, in particular the occupant at the driver's seat or the driver in relation to a particular maneuver,
• a takeover request for at least part of the vehicle guidance by the occupant, in particular the occupants at the driver's seat or the driver.

In particular, a corresponding occupant information is output with the output unit of the mobile user device. This can e.g. be dependent on a parameter of the traffic situation and / or the need for action. For example, the occupant information may be a feature of the request for the attention of the occupant, particularly the occupant of the driver's seat, to a (specific) object or space in the vehicle or outside the vehicle, a feature of the occupant, particularly the occupant of the driver's seat or driver to perform action or action, etc. mark.

According to an optional embodiment, the transmission of the information to the mobile user device takes place (in connection with the detected traffic situation and / or the control of the output unit of the mobile user device depending on one or more predetermined criteria with respect to the determined traffic situation and / or the determination a specific need for action of at least one occupant of a, in particular at least partially automated driving, vehicle.

• - eine Einschätzung der Wichtigkeit und/oder der Eiligkeit einer Information zu einer erkannten Verkehrssituation und/oder eines Handlungsbedarfs des Fahrers,
• - eine Erkennung einer Verkehrssituation als eine Verkehrssituation einer bestimmten Art, z.B. eine Kollisionswahrscheinlichkeit,
• - ein Erkennen eines bestimmten Handlungsbedarfs hinsichtlich: Längsführung des Fahrzeugs und/oder Querführung des Fahrzeugs,
• - ein Überschreitung vorausbestimmter Schwellwerte. Auch können Schwellenwerte abhängig vom Fahrkontext (Stadtfahrt, Landstraßen Schnellstraße, Parken, Fahrer im dichten Verkehr, Nachtfahrt, etc.) gewählt werden.

For example, a predefined criterion may be considered:

• an assessment of the importance and / or the urgency of information on a detected traffic situation and / or a need for action of the driver,
• a recognition of a traffic situation as a traffic situation of a certain kind, eg a collision probability,
• a recognition of a specific need for action with regard to: longitudinal guidance of the vehicle and / or transverse guidance of the vehicle,
• - Exceeding predefined thresholds. Threshold values can also be selected depending on the driving context (city driving, highway expressway, parking, drivers in heavy traffic, night driving, etc.).

In a simplified case, the recognition of the at least one predetermined criterion may be simplified identification of the detected, evaluated or predicted for the near future traffic situation and / or possible or probable consequences of the traffic situation or an unfulfilled need for action of the occupant, in particular the driver be represented with the output unit of the mobile user equipment. In this case, the content, timing of the activation of the at least one output unit of the mobile user device depending on the at least one predetermined criterion, e.g. selected from one or more qualitative and / or quantitative parameters of the predetermined criterion.

In other words, in particular only (according to predetermined criteria) selected prioritized information can be transmitted and / or (according to predetermined criteria) prioritized controls of the output unit of the mobile user device.

Preferably, the control of the at least one output unit of the mobile user device is selected depending on one or more predetermined criteria or qualitative or quantitative parameters of the predetermined criteria that claimed each appropriate level of perception and / or attention of the occupant to the information to be transmitted and / or be directed to the environment of the vehicle, in particular at a convenient time selected or retrieved. In this case, e.g. a statistical measure applicable to people in general, for a particular person of the occupant or for a particular class of person to which he or she belongs, the occupant having the characteristics of his acting or reacting, e.g. a measure of his responsiveness will be considered

In this case, the occupant, in particular the driver only then or only to a significant extent taken out of his employment, if this requires the situation, in particular the overall situation. For example, a proportion of the perception and / or attention of the occupant may be directed to a specific traffic situation and / or need for action in the method, eg, depending on predefined criteria or other factors) by controlling the output unit of the mobile user device become. In the case of not very urgent need for action, eg decision requirements, a certain proportion of the perception, eg only a certain perceptual channel of the occupant or part of his or her attention can be directed to the surroundings of the vehicle or to a driver's posture.

If there are several occupants in the vehicle, a mobile user device is typically also arranged in the vehicle per occupant. Thus, it is advantageous to distinguish these mobile user devices. Therefore, according to a further advantageous embodiment, a mobile user device is recognized in the interior of the vehicle as that of the occupant at the driver's seat, and the transmission of the information on the detected traffic situation and / or the at least one specific action required by the occupant to the (certain) detected mobile User device, preferably associated with at least one current driver, eg to the mobile user device of the occupant at the driver's seat.

In accordance with a further advantageous embodiment, at least one mobile user device is recognized as a mobile user device of another, in particular a specific occupant or occupant at a further seat, and the transmission of the information about the detected traffic situation and / or the at least one specific action requirement of the occupant is done to the mobile user device of the occupant at the other seat of the vehicle.

This embodiment can be combined in particular with the previous embodiment, so that the transmitted information is distributed as optimally as possible to the mobile user devices in the vehicle.

Since the information is now purposefully transmitted, the information may preferably be a, e.g. act for a particular occupant or occupant with a specific role customized information. The information to be transmitted may be e.g. Depending on the age, previous knowledge, driving license, a predefined authority to perform certain operations, in particular certain driving expenses of the occupant can be varied.

Furthermore, the control of the output unit and / or on the mobile user device of the other inmates can optionally take place only if the control of the output unit of the occupant at the driver's seat was not possible and / or the attention of the occupant in the driver's seat beyond the traffic situation and / or his mobile user device was and / or not confirmed by the occupant in the driver's seat. In this case, the two information that was output at the mobile user device of the occupant at the driver's seat and / or another occupant may be different. For example, these may differ with respect to the predetermined thresholds and / or the role of the occupants.

The method can also be applied to a plurality of drivers or authorized passengers of a vehicle, in particular a vehicle that is at least partially automated. According to the invention, a driver, an approximately equal second driver and / or a co-driver with a lower or lower authority can be defined. Such a role of about the first driver, a second driver, a co-driver can be selected in the invention depending on the vehicle seat on which the at least one occupant sits. Also, such a role, e.g. Depending on the traffic situation and / or the need for action between at least two occupants of the vehicle can be divided.

One application here is that in the event of an (urgent) need for action identified by the vehicle, a co-driver is also notified if, for example, the driver has fallen asleep during highly automated driving.

At the other occupants e.g. For example, information transmitted to the passenger may be a request to wake the driver and / or a request to alert the driver if there is no urgent need for action and / or a request to take over at least one operator action of the vehicle , in particular one or more specific, eg within the information marked to perform operator actions in the vehicle. For example, the control of the output unit of the mobile user device of a passenger takes place depending on the actual response to the control of the output unit of the driver's mobile user device or depending on the further information from the driver's mobile user device.

In particular, a particular occupant may be considered a particular person, e.g. the owner of the particular mobile user device, or as an occupant at a particular seat, e.g. be recognized in the passenger seat of the vehicle. Thereupon, the respective information can be suitably generated and / or suitably addressed. In this case, the information for a further (second) occupant may be a second information which, for example, differs from the (first) information for the (first) driver and / or is outputting time-delayed information to the second mobile user device becomes.

• - ein mobile Anwendergerät im Innenraum des Fahrzeugs wird als das von dem Insassen am Fahrersitz erkannt, und
• - zumindest ein mobiles Anwendergerät wird als ein mobiles Anwendergerät eines weiteren bestimmten Insassen oder eines Insassen an einem weiteren Sitz, erkannt, und
• - das Übermitteln der Information zu der erfassten Verkehrssituation und/oder dem zumindest einem bestimmten Handlungsbedarf des Insassen erfolgt an das erkannte mobile Anwendergerät des Insassen am Fahrersitz. und/oder
• - das Übermitteln der Information zu der erfassten Verkehrssituation und/oder dem zumindest einem bestimmten Handlungsbedarf des Insassen erfolgt an das erkannte mobile Anwendergerät des Insassen an dem weiteren Sitz.

In a preferred embodiment, the method may comprise the following steps:

• - A mobile user device in the interior of the vehicle is recognized as that of the occupant in the driver's seat, and
• at least one mobile user device is recognized as a mobile user device of another specific occupant or occupant in another seat, and
• - The transmission of the information about the detected traffic situation and / or the at least one specific need for action of the occupant is made to the detected mobile user device of the occupant at the driver's seat. and or
• - The transmission of the information on the detected traffic situation and / or the at least one specific need for action of the occupant is made to the detected mobile user device of the occupant at the other seat.

Both information may preferably be different. For example, these may differ with respect to the predetermined thresholds and / or the role of the occupants. For example, the at least one second piece of information to a second mobile user device may output a further (second) occupant, which is dependent on the reaction of the first occupant to the first information. For example, if the transmission of the first information to the first occupant (e.g., the driver or the "first driver") resulted in no, expected, or insufficient response, the second information is issued to another (second) occupant.

According to a further advantageous refinement, different threshold values are distinguished with regard to the importance of the traffic situation and / or importance and urgency of the action requirement of the occupant, and then different activations of one or more output units of the mobile user device are carried out.

At different determined threshold values, different changes of the display of the mobile user device and / or different, e.g. different or differently strong tones and / or actuations of a haptic actuator, e.g. Vibration or another stimulus of the mobile user device causes.

For example, if a particular, e.g. unwanted traffic situation develops slowly, in the case of information exceeding (e.g., not hurriedly) a first threshold, on the mobile user equipment an unobtrusive information display, e.g. also as a picture-in-picture display together or within another (previous) content, e.g. together or within another application on the mobile user device, e.g. are displayed. However, if the traffic situation requires an urgent, in particular an immediate reaction / action of the occupant, in the case of information exceeding a second threshold value (for example, urgent and important), depending on the identified need for action, a previous content, e.g. for example, the previous display can be minimized, greyed out, hidden, reduced to symbols. In this case, the at least one output unit of the mobile user device can be controlled. The output unit can be controlled in such a way that the information to be transmitted at least partially uses the resources that were used by the previous content. For example, the proportion of the display area and / or audio frequency bands or time intervals for outputting said occupant information may be required by means of a reduction of the previous content and / or the release of the corresponding resources. In particular, e.g. depending on one or more predetermined criteria, a distribution of the resources between an occupant information to be output and one or more previous, active contents are executed on the mobile user device. Also, the resources of the mobile user equipment may be used in terms of computational power, memory or wireless data transmission in an analogous manner, e.g. in favor of the issue of occupant information.

According to a further advantageous refinement, an output of occupant information is initiated by a graphical output unit of the mobile user device, which comprises a graphic image, in particular an image sequence. In this case, the graphic illustration may identify one or more features of the traffic situation detected by means of the vehicle and / or of an operator action of the occupant requested or recommended in connection with the traffic situation.

For example, on a display device of the mobile user device, a graphic image, in particular a picture sequence representing essential detected by means of the vehicle, in particular interpreted traffic situation and / or issued in this context requested or recommended operation of the occupant.

For example, if an acute collision occurs while the occupant is engrossed in the applications of his mobile user equipment, a sequence of images (eg, a video sequence) may be displayed that represents a part, in particular the center of gravity of the traffic situation in question. In addition to the image sequence, in particular in the image sequence, for example, symbolic information can additionally be superimposed, in particular augmented, which requires action, eg at least one required action. The information about the specific need for action, for example a specific operator action from a specific occupant, may relate to the said detected traffic situation. This can, for example, mark a proposal to dissolve or defuse the particular traffic situation.

Alternatively or additionally, the occupant information may include actions, e.g. Represent operator actions for (specific) occupants who are dangerous, counterproductive and / or avoidable in the current traffic situation. For example, if the at least partially moving vehicle performs a particular maneuver, information can be output to the mobile user device of the at least one occupant, which states that he should not brake, not accelerate not steer. Thus, various conceivable misleading interpretations of the vehicle project by the occupant, especially the driver can be prevented.

Preferably, a machine-interpreted, in particular a simplified or reduced to the essentials or concentrated representation of the traffic situation is displayed on the mobile user device. For example, the representation of the traffic situation includes the highlighting of essential features of the traffic situation or (at the present time) essential objects and / or action requirements which are associated with certain characteristics of the traffic situation or with the objects. Such can help to output a meaningful, quickly occupant detectable occupant information on the detected traffic situation and / or the identified need for action with limited resources of an output unit of the mobile user equipment.

• - zumindest einen Ausschnitt eines mit einer Kamera des Fahrzeugs erfassten Abbildung der Umgebung des Fahrzeugs;
• - eine Abbildung, die eine mit einer Wärmebildkamera des Fahrzeugs erfasste Information repräsentiert, beispielsweise Fußgänger, andere Fahrzeuge, etc.;
• - eine zumindest teiltransparent in eine Abbildung eingeblendete oder augmentierte grafische Information, die eine betreffende Verkehrssituation oder zumindest ein Merkmal der Verkehrssituation kennzeichnet, insbesondere eine Abweichung von einer vorausbestimmten Norm. Beispielsweise können zu geringe Abstände des Fahrzeugs (seitlich, hinten, vorne) von einem weiteren Verkehrsteilnehmer angezeigt werden.

For example, the occupant information may include a graphical representation:

• - At least a section of a captured with a camera of the vehicle image of the environment of the vehicle;
• an image representing information acquired with a thermal imaging camera of the vehicle, such as pedestrians, other vehicles, etc .;
• an graphic information, which is at least partially transparent in an image or augmented, which characterizes a traffic situation in question or at least one feature of the traffic situation, in particular a deviation from a predetermined standard. For example, too small distances of the vehicle (side, back, front) can be displayed by another road user.

Particularly preferably, a need for action, e.g. be designed as an action instruction by means of a sequence of images, in particular a causally related image sequence (in an animated form), in particular superimposed in the image of the environment.

Particularly preferably, the occupant information may include or characterize a graphical representation of a particular control element of the vehicle and / or a visualization of a particular action to be performed by an occupant of the vehicle to perform said operator action. For example, an image sequence can be displayed as an animation, comprising a symbolically represented driver's hand and / or driver's foot, with which a likewise symbolically represented steering wheel, an accelerator pedal, a brake pedal and / or a further operating element of the vehicle with which the need for action is executed. For example, the occupant information may also indicate how to operate a steering wheel, an accelerator pedal, a brake pedal, and / or another operating element in which direction, in which direction, and in what order.

According to a further advantageous embodiment, the graphical representation, in particular representing an image sequence representing the traffic situation and / or a driver's need for action associated with the traffic situation, represents a reality predicted in the near future.

For example, the reality predicted in the near future may be one in the near future, e.g. 1-15 seconds predicted reality act. Such a reality can be determined, for example, by means of a simulation. This can also be determined as a probability-based prediction. It can, e.g. at least one or two probable (most likely) developments of the traffic situation are determined and displayed on the mobile user device.

In this case, the occupant information may indicate what or how it may happen and what or how the occupant concerned in this context, e.g. only in the case, if this is true, can or should do.

Thus, precious time can be saved by this design, a required To explain the action to the driver by other means if it is already due or overdue. Instead, this is initially explained as optional for a variant of the development of the real situation. Thus, the driver already knows what he can do when the driver has turned his gaze to the real environment and the traffic situation develops in the predicated way.

According to an advantageous embodiment, an action requirement of the occupant of the vehicle that is related to a traffic situation and / or an importance and / or urgency and / or the time for outputting the occupant information is determined at least partially by means of the mobile user device.

In this case, for example, the mobile user device or a relevant app on the mobile user device based on different criteria alone or together with means of the vehicle and / or means of a backend a corresponding decision to control the mobile user device, in particular the output unit of the (specific) mobile user device , determine.

In this case, information from one or more databases within the mobile user device and / or outside the mobile user device, e.g. determined from the backend, cloud or read from the vehicle data and taken into account. In this case, the computing power of the mobile user device can be used to calculate a corresponding decision to control the output unit.

Furthermore, it can also be determined within the mobile user device and / or on the basis of the information that is determined with the mobile user device, or at least co-determined, how the occupant needs to act in the traffic situation in question.

In this case, data recorded with the mobile user device can also be taken into account for the attention of the occupant of the vehicle and / or the direction of sight of the occupant of the vehicle, and / or behavior of the occupant of the vehicle and / or the physical condition of the occupant of the vehicle (alertness, pulse, reaction parameter) become.

According to an advantageous embodiment, it is recognized that the occupant hears and / or telephones an audible content with the mobile user device, and auditory information is output by means of the mobile user device representing the information about the particular traffic situation detected and / or to a requested or recommended action of the occupant in connection with the detected traffic situation.

Particularly preferably, alternatively or additionally, a vibration can also be output.

According to an advantageous embodiment, the method comprises recognizing a present application case of the mobile user device, and / or a sense channel of the driver substantially claimed by the use of the mobile user device, and then triggering the output unit of the mobile user device depending on the detected application of the mobile user device and / or from the detected perceptual channel.

If, for example, the mobile user device is held in the hand and thus telephoned, a first activation, for example a vibration and / or sound output, in particular comprising an announcement, can take place.

For example, if the mobile user device is being operated on the screen, e.g. played a game or viewed a map, a second control, such as a change and / or generating a display on the mobile user device can be done.

The use case of the mobile user device can be classified into two or more different classes. These classes may differ according to the particularly stressed perception channels of the occupant. These classes may also differ in the required, claimed or unclaimed perception and / or attention, gaze, listening, haptic contact, or haptic operation. In this case, the activation of the at least one output unit of the mobile user device can be varied depending on the detected application or the recognized class of the application.

According to an advantageous embodiment, the method comprises detecting, at least one particular perception channel of the occupant, in particular of the driver or occupant at the driver's seat which is claimed by the mobile user device, and in particular the intensity in the at least one perception channel is claimed and then a control of the output unit the mobile user device depending on the detected perceptual channel, and in particular depending on the detected intensity.

For example, the stress (current usage, attention, sensory overload) at one or two perception channels of the occupant may be related to the use of the mobile User device can be detected. Depending on the detected information, one or two actuations of the at least output unit of the mobile user device which concerns the at least two relevant perception channels of the occupant.

Preferably, depending on the input and / or output of the mobile user device, in particular also of evaluated contents, it can be recognized which of the perception channels of the occupant currently perceives the contents of the mobile user device.

It can also be determined how intensively this perception channel is used or overloaded and then decided on the control of one or more actuators of the mobile user device. For example, a vibration and / or sound output, in particular comprising an announcement, or a change and / or generating a display on the mobile user device.

Furthermore, the possibility can be provided in the invention by means of the mobile user device to influence, in particular to operate, at least one, in particular a related function of the vehicle in connection with the method.

In summary, the method described above provides the following advantages:

The method contributes to an increase in traffic safety for the holder of a, in particular at least partially automated moving vehicle, its occupants and other road users.

Mobile user devices such as smartphones are very important to many people. By the method, these devices can be used while driving an at least partially automated moving vehicle, without the road safety is compromised. Conversely, with the invention it is possible to use the vehicle or certain vehicle functions while driving, while a mobile user device fulfills a (possibly also urgent or important) function.

Furthermore, steps of the method can be carried out by means of the mobile user device, so that the resources of the mobile user device (data, sensors, computing power) can be used and the possibly overloaded resources of the vehicle can be relieved.

The procedure contributes to a sense of security of other (not sitting on the driver's seat) inmates, as they may also be notified.

According to a further aspect, the invention is characterized by a mobile user device, in particular a device comprising at least one mobile user device, set up such a method for controlling a mobile user device of an occupant of a vehicle, especially in an at least partially automated driving (at least partially automated driving ), together with a vehicle, wherein the mobile user device is set up to perform at least a part of the method for controlling an output unit of the mobile user device depending on a transmitted information. In this case, the mobile user device can be configured to execute at least a part of the method according to the first aspect. For example, the mobile user device can initiate the control of an output unit of the mobile user device depending on the transmitted information. Furthermore, the mobile user equipment may also be considered part of the described system.

For this purpose, the mobile application device can have a wired or wireless interface which is set up to carry out the method. Advantageously, alternatively or additionally, a transmission part and / or a sensor system and / or computing resources and / or a transceiver unit and / or authentication method of the mobile user device can be used or used in the method.

A structure of a data connection to the vehicle (set up to carry out the method) can be established automatically, e.g. if it is detected that the driver uses his mobile user device while driving, in particular under further predetermined conditions for driving context, etc.). For example, such a connection may also act as a proof of legitimacy of the use of the mobile user device while driving and / or as a technically-implemented requirement for the automation of the ride.

• - Mit Mitteln des Fahrzeugs ermittelte und an das mobile Anwendergerät übermittelte Information, insbesondere eine im sogenannten Push-Verfahren übermittelte Information, und/oder
• - eine durch das mobile Anwendergerät, z.B. Smartphone, insbesondere auf die Erfüllung vorausbestimmter Kriterien aus dem Fahrzeug ausgelesene, z.B. explizit abgerufene Information sein;

The information transmitted or exchanged between the vehicle or the vehicle unit and the at least one mobile user device can be:

• - Information determined by means of the vehicle and transmitted to the mobile user device, in particular information transmitted in the so-called push method, and / or
• - be an information retrieved by the mobile user device, eg smartphone, in particular on the fulfillment of predetermined criteria from the vehicle, for example, explicitly retrieved information;

The method can also distinguish between different types of mobile user equipment, e.g. different controls of the output units are provided in the different types of mobile user equipment.

For the purposes of this description, the mobile application device may include a smartphone, tablet, smart watch, smart closes, in particular a garment with an electronic device, motorcycle helmet, e.g. a motorcycle helmet with an integrated man-machine interface, a data glasses for the driver of the vehicle, a vehicle mitführbarer and connectable to the vehicle with a data interface vehicle computer, an external navigation device, or an analogous development of such devices.

For example, the control of one or more functions of the mobile user device may be dependent on the execution of another feature of the method. For example, if it is detected that the user device is carried in an at least partially automated mobile motor vehicle and / or it is actively operated at the driver's seat, certain functions of the mobile user device, operated depending on the readiness for performing the method. For example, certain functions, in particular certain applications, apps, etc., are operable only or to a greater extent when the vehicle is being driven, when a data connection is made for executing the method or when a readiness for transmitting the said information or for executing the control of the output unit of the vehicle mobile user device is ensured.

The method is preferably carried out as a function of a variable representing the degree of automation of the drive of the vehicle. By way of example, the method is carried out only or predominantly above a first limit value and / or below a second one of the specified size.

The variables representing the degree of automation of the drive of the vehicle represent different aspects of the degree of automation, for example in the form of code values. The degree of automation or the degree of automation can characterize qualitative and / or quantitative measures of the degree of automation.

• - Längsführung des Fahrzeugs und/oder
• - Querführung des Fahrzeugs und/oder
• - Durchführung eines Spurwechsels und/oder
• - Durchführung eines Überholvorgangs und/oder
• - Fahrerinformation, insbesondere im Zusammenhang mit der Fahrzeugführung.

Different aspects of the degree of automation of the drive of the vehicle can each be appropriately taken into account. In particular, aspects of the degree of automation that are activated or operated at least partially independently of one another can be taken into account individually or cumulatively. In this case, automation levels for at least two different aspects of the automation of the movement of the vehicle and / or for two or more different driver assistance functions of the vehicle can be used, for example

• - Longitudinal guidance of the vehicle and / or
• - Transverse guidance of the vehicle and / or
• - Carrying out a lane change and / or
• - Carrying out an overtaking process and / or
• Driver information, in particular in connection with the vehicle guidance.

For example, the degree of automation or the variable representing the degree of automation of the drive of the vehicle may be at least partially determined with reference to a preceding roadway section, e.g. be considered by 10, 20, 50, 100, 150 meters.

Preferably, the described activation of the mobile user device or the output unit of the mobile user device is no longer carried out or the effect of the effected change is no longer effected, canceled, e.g. explicitly canceled, undone if it is determined that the determined traffic situation no longer requires this or a use of the mobile user device for the purposes independent of the journey is (again) possible and / or there is no or no (urgent) need for action. For example, if it is determined that the occupant's attention to the environment of the vehicle, to one or more driving tasks is no longer (unconditionally or urgently) needed or if there is no (specific) need for action, no more changed output is executed or the reversed changes.

In particular, in the method information can be transmitted to the mobile user device that is (explicitly) characteristic of a criticality, urgency, danger potential, of the determined, in particular predicated, traffic situation, for example, in comparison to a predefined measure or in comparison to an expectation has or will decrease. In other words, in the process also an explicitly unaware information (also as a kind of "all-clear") the mobile user device to be transmitted. Thereupon, a direct or indirect control of the output unit of the mobile user device can be canceled or carried out such that at least a reduction of the previously caused changes takes place. For example, the previously output contents can then be restored or output (for example) with the previous parameters and / or output planned (or queued or interrupted) for output. Also, a previous application of the mobile user device can be continued. For example, canceling or no longer in the described manner, the driving and / or the output of a previously modified (hitherto interrupted, reduced, paused) content, eg in a last valid manner, depending on the (new or updated) to the mobile user device.

Preferably, with the invention, an operation of the mobile user device in the interior of the vehicle when driving the vehicle (this also includes a parking and maneuvering operation of the vehicle) addressed. This results in numerous explicitly described as well as other advantages easily understandable by the skilled person. For example, the mobile user device can be used while driving the vehicle, possibly also by the driver or the occupant at the driver's seat of the vehicle (for various purposes).

Alternatively or additionally, the method can also be operated such that the mobile user device is at least temporarily outside the vehicle, in particular in the vicinity of the vehicle. For example, the mobile user device may be operated while said vehicle is performing an at least partially automated parking or maneuvering operation. That the occupant of the vehicle may e.g. temporarily outside the vehicle.

• - Erfassung einer Verkehrssituation und/oder Ermitteln eines bestimmten Handlungsbedarfs zumindest eines Insassen eines, insbesondere im zumindest teilweise automatisierten Fahrbetrieb des Fahrzeugs (insbesondere in Bezug auf einen zumindest teilweise automatisierten Fahrbetrieb des Fahrzeugs) und zum
• - Übermitteln einer Information zu der erfassten Verkehrssituation und/oder dem zumindest einem bestimmten Handlungsbedarf des Insassen des Fahrzeugs zu dem mobilen Anwendergerät des Insassen des Fahrzeugs im Fahrbetrieb des Fahrzeugs und wobei das mobile Anwendergerät ausgebildet ist zur
• - Ansteuerung des mobilen Anwendergeräts, insbesondere einer Ausgabeeinheit des mobilen Anwendergeräts, abhängig von der übermittelten Information.

According to a further aspect, the invention is characterized by a system for controlling a mobile user device of an occupant of a vehicle, in particular in an at least partially automated driving, comprising a vehicle unit and a mobile user device, wherein the vehicle unit is designed for

• Detecting a traffic situation and / or determining a specific need for action of at least one occupant, in particular in the at least partially automated driving operation of the vehicle (in particular with respect to an at least partially automated driving operation of the vehicle) and
• - Transmission of information about the detected traffic situation and / or the at least one specific need for action of the occupant of the vehicle to the mobile user device of the occupant of the vehicle while driving the vehicle and wherein the mobile user device is designed for
• - Control of the mobile user device, in particular an output unit of the mobile user device, depending on the transmitted information.

According to a further aspect, the invention is characterized by a computer program, in particular a computer program product comprising a computer program, wherein the computer program is designed to carry out the method according to one of claims 1-12 when executed on a computing unit of the vehicle and / or the mobile user device ,

According to a further aspect, the invention is characterized by a vehicle unit or a vehicle comprising said vehicle unit. By way of example, the vehicle unit may be a control unit of the vehicle, a built-in computing unit installed in the vehicle and / or connected to the vehicle, wherein the vehicle unit is configured to execute at least the method together with a mobile user terminal that can be carried in the vehicle.

Also, the invention can be applied to an at least partially or mostly manually moving (or mobile) vehicle. By way of example, the method may also be executable in the case of driving the vehicle supported or supportable with a driver assistance system.

• 1 ein Ablaufdiagramm zur Ansteuerung eines mobilen Anwendergeräts eines Insassen eines Fahrzeugs im Fahrbetrieb; und
• 2 und 3 ein System zur Ansteuerung eines mobilen Anwendergeräts eines Insassen eines Fahrzeugs im Fahrbetrieb des Fahrzeugs.

Embodiments of the invention are explained in more detail below without limiting the generality with reference to the schematic drawings. Show it:

• 1 a flowchart for controlling a mobile user device of an occupant of a vehicle while driving; and
• 2 and 3 a system for controlling a mobile user device of an occupant of a vehicle while driving the vehicle.

The 1 shows a flowchart for controlling a mobile user device of an occupant of a vehicle in an at least partially assisted by a driver assistance system or automated driving.

The program can be from one device or from several devices, in particular in the context of a so-called distributed electronic Systems are processed. For this purpose, the device comprises in particular at least one arithmetic unit, a program and data memory, as well as, for example, one or more communication interfaces.

The program will be in one step S1 started in which variables can be initialized if necessary.

In one step S3 A detection of a traffic situation and / or determination of a specific need for action of at least one occupant of a vehicle that is at least partially assisted or automated is carried out.

In one step S5 a transmission of information about the detected traffic situation and / or the at least one specific need for action of the occupant of the vehicle to the mobile user device of the occupant of the vehicle. The information to be transmitted may already include control signals or coded values for direct or indirect activation of the mobile user device. The said information can also be transmitted to two mobile user devices of at least two occupants. In this case, the content, the sequence, a parameter of the transmitted information from a predetermined or assigned in the process role of the occupant can be transmitted. For example, to the mobile user device of the driver or the occupant at the driver's seat, another occupant information or be transmitted differently than to an occupant in the passenger seat, for example to a co-driver or to an occupant with a lesser power to operate the vehicle. Alternatively or additionally, in particular on the transmission of the same occupant information or on the transmission of different information to at least two different mobile user devices in a vehicle, a different change in the content and / or output of occupant information can be caused by means of the corresponding output units of the mobile user equipment.

In one step S7 there is an activation of an output unit of the mobile user device depending on the transmitted information. In this case, one or more parameters of the change in content and / or output of occupant information can be determined by means of the mobile user device. For example, personal settings can also be taken into account.

In one step S9 the program terminates and may again be in the step S1 to be started.

• Einen Schritt bei dem festgestellt wird, dass das mobile Anwendergerät im Fahrzeug bzw. Fahrzeuginnenraum mitgeführt wird.
• Einen Schritt bei dem festgestellt wird, dass das mobile Anwendergerät (während der Fahrt des Fahrzeugs) genutzt, insbesondere bedient wird. Dabei kann die Bedienart, Bedienhäufigkeit bewertet und berücksichtigt werden.
• Einen Schritt bei dem ein mobiles Anwendergerät im Innenraum des Fahrzeugs als das von dem Insassen am Fahrersitz erkannt wird, und das Übermitteln der Information, die von der erfassten Verkehrssituation und/oder dem zumindest einem bestimmten Handlungsbedarf des Insassen an das erkannte mobile Anwendergerät des Insassen am Fahrersitz abhängig ist, erfolgt. Die Übermittelte Information kann dabei eine oder mehrere Kennungen umfassen, die die besagte erkannte (und ggf. interpretierte Verkehrssituation kennzeichnen oder aus der erkannten oder interpretierten Verkehrssituation abgeleitet ist. Auch umfasst die zu dem mobilen Anwendergerät übermittelte Information eine Kennung zu dem (insbesondere aus der Verkehrssituation oder unter Berücksichtigung der Verkehrssituation) ermittelten Handlungsbedarf des zumindest einen Insassen, insbesondere des Insassen am Fahrerplatz oder explizit des Fahrers.
• Einen Schritt bei dem die Ansteuerung der Ausgabeeinheit des mobilen Anwendergeräts repräsentierend ist für:
  • - eine Aufforderung zur Zuwendung der Fahreraufmerksamkeit zu der Fahrzeugumgebung,
  • - eine Aufforderung zur Zuwendung der Fahreraufmerksamkeit zu einer Information des Fahrzeugs, insbesondere zu einer Anzeige des Fahrzeugs, insbesondere betreffend eine Fahrzeugführung,
  • - eine Aufforderung zum Greifen des Lenkrads, insbesondere als ein sogenanntes „Hands-On-Request“
  • - eine Aufforderung zum Antippen oder Bedienen eines Pedals des Fahrzeugs oder einer Bestätigung der Bedienbereitschaft zum Bedienen zumindest eines Pedals durch den Fahrer,
  • - eine Aufforderung zur Veränderung der Fahrzeuggeschwindigkeit,
  • - eine Aufforderung zum Einhalten eines, insbesondere seitlichen Abstands,
  • - eine Aufforderung zum Mitwirken des Fahrers bei einem bestimmten Manöver,
  • - eine Aufforderung zur Entscheidung des Fahrers in Bezug auf einem bestimmten Manöver,
  • - eine Übernahmeaufforderung zumindest eines Teils der Fahrzeugführung durch den Fahrer.
• Einen Schritt bei dem das Ermitteln und/oder Übermitteln der Information zu der erfassten Verkehrssituation und/oder die Ansteuerung der Ausgabeeinheit des mobilen Anwendergeräts abhängig von einem oder mehrerer vorausbestimmten Kriterien in Bezug auf die ermittelte Verkehrssituation und/oder dem Ermitteln eines bestimmten Handlungsbedarfs zumindest eines Insassen eines zumindest teilweise unterstützt oder automatisiert fahrenden Fahrzeugs erfolgt.
• Einen Schritt bei dem ein mobiles Anwendergerät im Innenraum des Fahrzeugs als das von dem Insassen am Fahrersitz (als das von dem Insassen am Fahrersitz genutzte, insbesondere aktuell genutzte) erkannt wird, und das Übermitteln der Information zu der erfassten Verkehrssituation und/oder dem zumindest einem bestimmten Handlungsbedarf des Insassen an das erkannte mobile Anwendergerät des Insassen am Fahrersitz erfolgt. Einen Schritt bei dem zumindest ein mobiles Anwendergerät als ein mobiles Anwendergerät eines weiteren, insbesondere eines bestimmten Insassen oder eines Insassen an einem weiteren Sitz, erkannt wird, und das Übermitteln der Information zu der erfassten Verkehrssituation und/oder dem zumindest einem bestimmten Handlungsbedarf des Insassen an das mobile Anwendergerät des Insassen an dem weiteren Sitz des Fahrzeugs erfolgt.
• Einen Schritt bei dem unterschiedliche Schwellenwerte, hinsichtlich der Wichtigkeit der Verkehrssituation und/oder Wichtigkeit und Eiligkeit des Handlungsbedarfs des Insassen unterschieden werden und daraufhin unterschiedliche Ansteuerungen eines oder mehrerer Ausgabeeinheiten des mobilen Anwendergeräts ausgeführt werden.
• Einen Schritt bei dem auf einer Anzeigevorrichtung des mobilen Anwendergeräts eine grafische Abbildung, insbesondere eine Bildsequenz, repräsentierend ein oder mehrere (für den Insassen relevante) Merkmale der mit Mitteln des Fahrzeugs erkannten Verkehrssituation und/oder eine in diesem Zusammenhang angeforderten oder empfohlenen Bedienhandlung des Insassen ausgegeben wird.
• Einen Schritt bei dem die grafische Abbildung, insbesondere eine Bildsequenz repräsentierend die Verkehrssituation und/oder einen mit der Verkehrssituation im Zusammenhang stehenden Handlungsbedarf des Fahrers, eine in die nahe Zukunft prädizierte Realität repräsentiert.
• Einen Schritt bei dem ein auf eine Verkehrssituation bezogener Handlungsbedarf des Insassen des Fahrzeugs und/oder ein Wichtigkeit und/oder Eiligkeit und/oder des Zeitpunkts zur Ausgabe der auszugebenden Information zumindest teilweise mit Mitteln des mobilen Anwendergeräts ermittelt wird.
• Einen Schritt bei dem erkannt wird, dass der Insasse einen hörbaren Inhalt mit dem mobilen Anwendergerät hört und/oder telefoniert, und eine Ausgabe einer auditiven Information mit Mitteln des mobilen Anwendergeräts repräsentierend die Information zu der bestimmten erkannten Verkehrssituation und/oder zu einer angeforderten oder empfohlenen Handlung des Insassen im Zusammenhang mit der erkannten Verkehrssituation erfolgt.
• Einen Schritt umfassend:
  • - Erkennen eines vorliegenden Anwendungsfalls des mobilen Anwendergeräts, und/oder welcher Wahrnehmungskanal des Fahrers durch dieses beansprucht wird, und daraufhin,
  • - Ansteuerung der Ausgabeeinheit des mobilen Anwendergeräts abhängig von dem erkannten Anwendungsfall des mobilen Anwendergeräts.
• Einen Schritt umfassend:
  • - Erkennen, zumindest eines bestimmten Wahrnehmungskanals des Fahrers der durch das mobile Anwendergerät, und insbesondere erkennen der Intensität in der zumindest ein Wahrnehmungskanal, beansprucht wird und daraufhin,
  • - Ansteuerung der Ausgabeeinheit des mobilen Anwendergeräts abhängig von dem erkannten Wahrnehmungskanal, uns insbesondere abhängig von der erkannten Intensität.

The method may optionally include one or more of the following steps:

• A step in which it is determined that the mobile user device is carried in the vehicle or vehicle interior.
• A step in which it is determined that the mobile user device is used (in particular while the vehicle is traveling), in particular being operated. The operating mode, operating frequency can be evaluated and taken into account.
• A step in which a mobile user device in the interior of the vehicle is recognized as that of the occupant of the driver's seat, and transmitting the information, the detected traffic situation and / or the at least one specific action required by the occupant to the detected mobile user device of the occupant Driver's seat is dependent, done. The transmitted information may include one or more identifiers that identify the said detected (and possibly interpreted traffic situation or derived from the detected or interpreted traffic situation.) The information transmitted to the mobile user device also includes an identifier for the traffic situation or taking into account the traffic situation) determined action requirement of the at least one occupant, in particular the occupant at the driver's seat or explicitly the driver.
• A step in which the control of the output unit of the mobile user equipment is representative of:
  • an invitation to attract driver attention to the vehicle environment,
  • a request for the attention of the driver to an information of the vehicle, in particular to a display of the vehicle, in particular concerning a vehicle guidance,
  • a request to grasp the steering wheel, in particular as a so-called "hands-on request"
  • a request to tap or operate a pedal of the vehicle or a confirmation of operator readiness to operate at least one pedal by the driver,
  • a request to change the vehicle speed,
  • - a request to maintain a distance, in particular lateral,
  • a request for the driver to participate in a particular maneuver,
  • - a request for the driver's decision in relation to a particular maneuver,
  • a takeover request for at least part of the vehicle guidance by the driver.
• A step in which the determination and / or transmission of the information on the detected traffic situation and / or the control of the output unit of the mobile user device depending on one or more predetermined criteria with respect to the determined traffic situation and / or determining a specific need for action of at least one occupant an at least partially assisted or automated driving vehicle takes place.
• A step in which a mobile user equipment is recognized in the interior of the vehicle as that of the occupant in the driver's seat (as used by the occupant in the driver's seat, in particular currently used), and transmitting the information on the detected traffic situation and / or the at least one certain action needs of the occupant to the detected mobile user device of the occupant at the driver's seat. One step in which at least one mobile user device is recognized as a mobile user device of another, in particular a specific occupant or occupant at a further seat, and transmitting the information about the detected traffic situation and / or the at least one specific action requirement of the occupant the mobile user device of the occupant takes place at the further seat of the vehicle.
• A step in which different threshold values are distinguished with regard to the importance of the traffic situation and / or importance and urgency of the action requirement of the occupant and then different activations of one or more output units of the mobile user equipment are carried out.
• A step in which on a display device of the mobile user device, a graphic image, in particular a picture sequence representing one or more (relevant to the occupant) features of the traffic situation detected by means of the vehicle and / or issued in this context requested or recommended operator action of the occupant becomes.
• One step in which the graphic representation, in particular a sequence of images representing the traffic situation and / or a driver's need for action associated with the traffic situation, represents a reality predicted in the near future.
• A step in which an action requirement of the occupant of the vehicle related to a traffic situation and / or an importance and / or urgency and / or the time for outputting the information to be output is at least partially determined by means of the mobile user device.
• A step of recognizing that the occupant is listening and / or telephoning audible content with the mobile user equipment, and outputting auditory information by means of the mobile user equipment representing the information about the particular traffic situation detected and / or requested or recommended Act of the occupant in connection with the detected traffic situation.
• One step:
  • Detecting a present application case of the mobile user device, and / or which perception channel of the driver is claimed by the latter, and then
  • - Control of the output unit of the mobile user device depending on the detected application of the mobile user device.
• One step:
  • Recognizing, at least one particular perception channel of the driver, which is claimed by the mobile user device, and in particular recognizing the intensity in the at least one perception channel, and then,
  • - Control of the output unit of the mobile user device depending on the detected perceptual channel, us in particular depending on the detected intensity.

The 2 illustrates that the mobile user devices 14 and 14 ' are in the interior of the vehicle. Further illustrated 2 that these mobile user devices 14 and 14 ' located in such areas and / or used, in particular served, which belong to different seats.

Optionally, the mobile user devices 14 . 14 ' as being located in the room areas belonging to different seats.

These are assigned to different seats (and thereby to one or more occupants, e.g., driver, passenger, particular occupant).

The 3 also illustrates further features of the invention.

In the vehicle 10 it is a vehicle that has been set up to be at least partially automated or (assisted by at least one driver assistance system). The method can be executed in particular in an at least partially automated operation of the vehicle. For example, the method becomes dependent on a signal coupling process ("pairing") between a vehicle unit, for example, into the vehicle 10 installed unit and the mobile user device 14 . 14 ' executable.

The at least one mobile user device 14 . 14 ' is preferably in the interior of the vehicle or is carried while driving the vehicle, especially in an at least partially automated driving, parking or maneuvering in the vehicle. The mobile user device 14 is simplified in this example represented as a smartphone. In the mobile user device 14 ' It may be a worn on the body of at least one occupant smart watch or smart garment ("smart clothes"). The invention is executed in particular while driving the vehicle.

The traffic situation VI and / or a specific need for action HB at least one occupant of a vehicle that at least partially supports or automatically drives a driver assistance system 10 is detected or determined, in particular by means of the vehicle 10 and / or the mobile user device 14 . 14 ' ,

One of the recorded traffic situation VI and / or the at least one specific need for action HB for the occupant of the vehicle 10 dependent information I becomes the mobile user equipment 14 . 14 ' the occupant of the vehicle 10 transmitted.

Subsequently, an activation of an output unit of the mobile user device takes place 14 . 14 ' depending on the transmitted information I. In this case, any previously issued content is changed. Depending on the transmitted information I and / or depending on the content previously output, the content is subsequently changed, in this example reduced, further output in a simplified form, paused, minimized, switched off. Coming in is a passenger information II output.

Optional is provided by the mobile user device 14 . 14 ' the further information WE described in the general part to the vehicle 10 , or the vehicle unit in the vehicle 10 transmitted.

The occupant information II comes with a dispensing unit AE of the mobile user device 14 . 14 ' output.

Furthermore, the invention includes that one or more functionality (s) described in this document is not or will be performed in a substantially altered form when it is detected that the mobile user device is 14 . 14 ' outside the interior of the vehicle 10 is or no longer in the interior of the vehicle 10 is located, for example, when an in-company data connection between the vehicle unit and the mobile user device is interrupted, or the mobile user device from the interior of the vehicle 10 is taken or was.

The steps may be from a device of the vehicle 10 and / or from a mobile user device 14 . 14 ' be executed.

Claims (16)

A method for controlling a mobile user device of an occupant of a vehicle, comprising at least Detecting a traffic situation and / or determining a specific need for action of at least one occupant of a vehicle while driving, Conveying information relating to the detected traffic situation and / or the at least one specific action requirement of the occupant of the vehicle to the mobile user device of at least one occupant of the vehicle and then - Control of the mobile user device depending on the transmitted information. Method according to the Claim 1 in which upon the transmission of the at least one information to the mobile user device a change of a content output with at least one output unit of the mobile user device and / or an output of a specific occupant information with at least one output device of the mobile user device is initiated. Method according to the Claim 1 or 2 in which the control of the output unit of the mobile user equipment is representative of: a request for the attention of the occupant, in particular of the occupant of the driver's seat to the vehicle environment, a request for the attention of the occupant, in particular the occupant at the driver's seat or the driver to an information of the vehicle, in particular to a display of the vehicle, in particular concerning a vehicle guidance, a request to grasp the steering wheel, in particular as a so-called "hands-on request" - a request for tapping or operating a pedal of the vehicle or confirmation of readiness to operate at least one pedal by the driver, - a request to change the vehicle speed - a request to maintain a, in particular lateral distance, - a request for participation of the occupant, in particular the occupant of the driver's seat or the driver in a particular maneuver, - a request for the decision of the occupant, in particular the occupant of the driver's seat or driver with regard to a particular maneuver, - a takeover request for at least part of the vehicle guidance by the occupant, in particular the occupants at the driver's seat or driver. Method according to one of the preceding claims, wherein the transmission of the information to the mobile user device in connection with a detected traffic situation and / or the control of the output unit of the mobile user device depending on one or more predetermined criteria with respect to the determined traffic situation and / or the Determining a certain need for action of at least one occupant of an at least partially automated moving vehicle takes place. Method according to one of the preceding claims, in which a mobile user device in the interior of the vehicle is recognized as being by the occupant in the driver's seat, and - The transmission of the information on the detected traffic situation and / or the at least one specific need for action of the occupant to the detected mobile user device of the occupant at the driver's seat. Method according to one of the preceding claims, in which at least one mobile user device is recognized as a mobile user device of another, in particular a specific occupant or an occupant at a further seat of the vehicle, and - The transmission of the information about the detected traffic situation and / or the at least one specific need for action of the occupant to the mobile user device of the occupant takes place at the further seat of the vehicle. Method according to one of the preceding claims, in which different threshold values, with regard to the importance of the traffic situation and / or importance and urgency of the action requirement of the at least one occupant, are distinguished and then different activations of one or more output units of the mobile user equipment are carried out. Method according to one of the preceding claims, in which an output of occupant information is initiated with a graphical output unit of the mobile user device which comprises a graphic image, in particular a picture sequence, wherein the graphic image includes one or more features of the traffic situation detected by means of the vehicle and / or or a required in the context of the traffic situation or recommended operating action of the occupant. Method according to the preceding claim, in which the graphic image, in particular a picture sequence representing the traffic situation and / or a driver's need for action related to the traffic situation, represents a reality predicted in the near future. Method according to one of the preceding claims, in which a need for action related to a traffic situation of the occupant of the vehicle and / or an importance and / or urgency and / or the time for issuing at least a part of the occupant formation is determined at least partially by means of the mobile user device. Method according to one of the preceding claims, in which it is recognized that the occupant hears and / or telephones audible content with the mobile user device, and - An output of an auditory information with means of the mobile user device representing the information about the particular detected traffic situation and / or to a requested or recommended action of the occupant in connection with the detected traffic situation takes place. Method according to one of the preceding claims, comprising: Detecting a present application case of the mobile user device, and / or at least one perception channel of the driver or the occupant in the driver's seat claimed by the use of the mobile user device, and then - Controlling the output unit of the mobile user device depending on the detected application of the mobile user device and / or the determined claimed perception channel of the driver or the occupant at the driver's seat. Method according to one of the preceding claims, comprising: - Recognizing, at least a certain channel of perception of the driver by the mobile user device, and in particular recognizing the intensity in the at least one perceptual channel is claimed and then, - control of the output unit of the mobile user device depending on the detected perceptual channel, in particular depending on the detected intensity , A mobile user device configured to perform a method of driving a mobile user device of an occupant of a vehicle in at least partially automated driving together with a vehicle or a vehicle-mounted device, wherein the mobile user device is configured to include at least part of the method of driving an output unit of the mobile user device depending on a transmitted information to perform. A system for controlling a mobile user device of an occupant of a vehicle for an at least partially automated driving comprising a vehicle unit and a mobile user device, wherein the vehicle unit is designed for Detecting a traffic situation and / or determining a specific need for action of at least one occupant of an at least partially automated vehicle and Transmitting information about the detected traffic situation and / or the at least one specific need for action of the occupant of the vehicle to the mobile user device of the occupant of the vehicle and to - Control of an output unit of the mobile user device depending on the transmitted information. Computer program, in particular a computer program product comprising a computer program, wherein the computer program is designed, when executed on a computing unit of the vehicle and / or a mobile user device, the method according to one of Claims 1 - 12 perform.

Images