DE102022117380B4 - Method for operating a screen of a motor vehicle and motor vehicle - Google Patents

Abstract

Method for operating a screen (12) of a motor vehicle (10), in which a control device (24) assigned to the screen (12) is used to check whether a surface (20) of the screen (12) needs to be cleaned, wherein at least one instruction is issued to a user of the motor vehicle (10) to clean the surface (20) of the screen (12), wherein the at least one instruction is displayed to the user by means of the screen (12), characterized in that the user is shown by means of the screen (12) how the user has to move an object (36) over the surface (20) of the screen (12), wherein at least one trajectory (72) for moving the object (36) is indicated on the surface (20) of the screen (12), wherein a sensor device (58) of the screen (12) detects whether there is a deviation from the at least one trajectory (72), and wherein in the event of deviation from the at least one trajectory (72) at least one measure is taken.

Description

The invention relates to a method for operating a screen of a motor vehicle, in which a control device assigned to the screen is used to check whether a surface of the screen needs to be cleaned. The invention also relates to a motor vehicle with a screen.

Displays or screens are common in motor vehicles. In order to use such screens properly, it is important to ensure that one surface of the screen or display is clean.

This is particularly important if the screen or display is part of a mirror replacement system in which a conventional, light-reflecting rear-view mirror is replaced by the screen or display, to which image data recorded by a camera in the vehicle is transmitted for display. This is because the readability of such a screen or display can be made more difficult by the fact that the display attracts more dust and dirt than a comparable mechanical rear-view mirror due to the static charge.

The DE 10 2021 132 366 A1 describes a method for cleaning a display in a vehicle. This runs an algorithm to monitor touch events on the display. A cleaning alert is generated when the total number of touch events is greater than a threshold. The cleaning alert can be a visual suggestion to clean the display that can be displayed on the display.

The EN 10 2018 115 394 A1 describes an interior cleaning system for a vehicle with a display including a screen. A level of soiling of a surface of the screen can be determined by a computer coupled to the display, whereby a number of user touches are counted and recorded. Using a lamp emitting UV light, a surface coating of the screen can be activated to cause the destruction of organic substances on the surface.

On the one hand, such a cleaning process is very complex and, on the other hand, it is only suitable for removing certain substances from the surface of the screen.

The US 6,208,331 B1 describes a touchscreen with a control panel for activating a cleaning mode. In cleaning mode, the touchscreen does not respond to operator input and glows brightly to reveal dirt and oil on the touchscreen.

The DE 10 2020 209 546 A1 describes a method for supporting the cleaning of a vehicle, in which a human cleaner is given instructions on a tablet computer for cleaning vehicle parts in a specific order.

The object of the present invention is to provide a method of the type mentioned at the outset, by means of which the surface of the screen can be cleaned in a particularly simple manner, and to provide a motor vehicle designed to carry out the method.

This object is achieved by a method having the features of patent claim 1 and by a motor vehicle having the features of patent claim 9. Advantageous embodiments with expedient further developments of the invention are specified in the dependent patent claims and in the following description.

In the method according to the invention for operating a screen of a motor vehicle, a control device assigned to the screen is used to check whether a surface of the screen needs to be cleaned. The control device therefore checks whether the surface of the screen should be cleaned. At least one instruction is issued to a user of the motor vehicle to clean the surface of the screen. The at least one instruction is displayed to the user via the screen.

In the method according to the invention, the screen shows the user how the user has to move an object across the surface of the screen. Such an instruction is very intuitive for the user of the motor vehicle. Because the user moves the object over the surface of the screen and thus wipes the surface, dirt can be removed very reliably from the surface of the screen.

At least one trajectory for moving the object is marked on the surface of the screen. This makes it particularly easy for the user to carry out targeted cleaning of the surface of the screen. This is because the user only needs to follow the at least one trajectory with the object. And by specifying the trajectory using the control device assigned to the screen, It is possible to clean very specifically those parts of the screen which are affected by dirt and for which cleaning is therefore particularly advisable.

A sensor device on the screen detects whether there is a deviation from at least one trajectory when the object is moved across the surface. In this way, the sensor device can be used to determine whether or not the surface of the screen has been cleaned as suggested by the control device. This is advantageous.

In the event of a deviation from the at least one trajectory, at least one measure is taken. As a measure, the user can, for example, be informed that the deviation from the at least one trajectory has occurred. Then the user can easily correct this negligence.

As an additional or alternative measure, the user can be shown another trajectory, which suggests moving along the surface of the screen at the point(s) where the deviation from the previously displayed trajectory occurred. This can ensure a very thorough cleaning of the surface of the screen.

The user therefore only needs to follow at least one instruction displayed on the screen in order to clean the surface of the screen. This makes it possible to clean the surface of the screen in a very intuitive or easy-to-understand way that is easy for the user to carry out. The method can therefore be used to clean the surface of the screen in a particularly simple manner. This in turn means that the user viewing the screen can be shown an image that is not affected by dirt using the screen.

In this way, the last part of a path from a signal source through the screen to the user who is viewing what is displayed on the screen is as free from interference as possible. This allows the viewer or user to perceive what is displayed on the screen very reliably and to interpret it safely. This is because what is displayed on the screen free of dirt can be perceived more easily by the user or viewer than would be the case if there were dirt on the surface of the screen.

Advantageously, the method provides a cost-neutral, safe and quick solution for showing the user of the motor vehicle an image that is as trouble-free as possible via the screen. These advantages come into play in particular when the screen is part of a mirror replacement system in which content is displayed on the screen which is captured by a camera in the motor vehicle. Such mirror replacement systems are becoming increasingly important as an alternative to a conventional, light-reflecting rearview mirror, be it in the form of an exterior mirror or in the form of an interior rearview mirror. And these camera-based systems can in principle be considered as an equivalent replacement for conventional or conventional rear-view mirrors.

In the mirror replacement system, a functioning interaction of the individual components such as the camera, a transmission path of the image data captured by the camera to the screen or display and the display must be ensured. It is also a challenge to ensure that the image or video on the screen can be recognized. By displaying the instruction on the screen to the user of the motor vehicle to clean the surface of the screen, a high level of functionality is guaranteed even for the last part of the path, namely the path from the screen to the user, after the user has cleaned the screen.

Mechanisms can already be implemented for individual components such as the camera, the transmission path and the display or the screen itself to increase security and ensure the highest possible reliability. In contrast, with regard to the visibility of content displayed on the screen, the challenge is to ensure that what is displayed on the screen is easy to recognize by cleaning the surface of the screen. Since the latter can be accomplished by the user in response to at least one instruction, this challenge can be overcome very easily.

Particularly if the screen is intended to replace the traditional rearview mirror and therefore no further fallback level exists, it is important that the mirror replacement system works well. In this context, issuing the instruction to clean the surface of the screen to the user using the screen is of particular importance and of great advantage.

By cleaning the surface of the screen, it can be ensured that the user of the motor vehicle who is viewing the screen, which may in particular be the driver of the motor vehicle, can see very clearly what is being shown on the screen. Problems that can arise from the presence of dirt on the surface of the screen can thus be largely avoided.

In connection with mechanical, conventional rear-view mirrors in motor vehicles, acoustic warnings can be provided, for example by using a warning tone to indicate road users or the like who are in the blind spot of the rear-view mirror. However, such an acoustic warning must first be perceived by the driver so that the driver can then react adequately. However, particularly in confusing traffic situations, it is advantageous if the user of the motor vehicle, in particular the driver, is not confused, but rather is clearly and unequivocally or unambiguously informed of the situation in which the motor vehicle is located. This can be achieved particularly well if the surface of the display is cleaned.

By displaying the instruction to the user via the screen, the fact that the user of the motor vehicle is looking at the screen whose surface is to be cleaned is exploited. This enables the user to follow at least one instruction very immediately. On the other hand, the user can very easily check the success of the cleaning, which results from the user following at least one instruction displayed on the screen.

The instruction can be displayed to the user via the screen by issuing a request on the screen to clean or clean the surface of the screen.

The object that the user should move across the surface of the screen, or that the user should guide along the surface of the screen, can be a part of the user's body, such as a finger or a fingertip, or several fingers or a hand of the user. Cleaning is then particularly easy because no other tools need to be used.

Additionally or alternatively, the user of the screen can be shown how the user should move an object, for example in the form of a cleaning cloth or the like, over the surface of the screen in order to clean the surface of the screen. Using such a cleaning cloth, a very intensive and good cleaning of the surface of the screen can be achieved.

The trajectory can be identified particularly easily by displaying a plurality of symbols or cleaning symbols on the screen, wherein preferably an order for moving from one cleaning symbol to the next cleaning symbol can also be displayed on the screen, for example by means of additional arrow symbols or by numbering the cleaning symbols or the like. By the user touching the symbols or cleaning symbols one after the other with the object in the suggested order, an intensive and at the same time targeted cleaning of the surface of the screen can be achieved.

In addition, such a swiping gesture is very easy and requires little effort for the user of the motor vehicle to implement. This is particularly because today's motor vehicle users are usually familiar with operating touchscreen screens, i.e. touch-sensitive screens on which swiping gestures or the like are often performed. Thus, identifying the at least one trajectory greatly accommodates the user's application habits when performing swiping gestures or the like. Therefore, following the at least one trajectory for the purpose of cleaning the surface of the screen is very intuitive for the user.

Even if the user of the motor vehicle is not actually inclined to clean the surface of the screen, such cleaning is carried out automatically by the user following at least one suggested trajectory with the object. This makes this type of cleaning of the surface of the screen particularly simple and reliable.

It can be provided that by moving the object along the at least one trajectory and the associated swiping gesture, at least one function of the screen is released. This is also intuitive and easy for the user to understand. Especially with touchscreens on mobile devices such as cell phones, moving along a predetermined trajectory, for example to unlock the screen, is a procedure with which the user is usually familiar. So if moving along the trajectory results in unlocking cleaning of the screen and/or enabling of functions of the screen, the user can be persuaded in a very intuitive way to clean the surface of the screen.

Preferably, the control device determines whether at least one criterion is met. If the at least one criterion is met, it is checked whether the surface of the screen needs to be cleaned. This avoids checking too frequently or unnecessarily whether the surface of the screen needs cleaning.

The at least one criterion can include the presence of a predetermined state of the motor vehicle. In this way it can be ensured that checking the need for cleaning of the surface of the screen and issuing the at least one instruction to the user is only carried out if the condition of the motor vehicle allows this. In this way, it can be achieved that the user is only given the instruction if this is not critical with regard to the condition of the motor vehicle.

The predetermined state of the motor vehicle can be achieved, for example, when the motor vehicle is stationary, for example at a traffic light or at a railway crossing or the like, or when the motor vehicle is parked. In particular, the at least one criterion can further include that the predetermined state of the motor vehicle lasts for a predetermined period of time of at least a few seconds. The driver can clean the surface of the screen within such a period of time.

Additionally or alternatively, the predetermined state can be reached when an autonomous driving device of the motor vehicle is in control of the vehicle and no intervention is required to drive the motor vehicle by the user or driver of the motor vehicle. In particular, in such an automated or even autonomous driving mode of the motor vehicle, the predetermined state of the motor vehicle can be achieved.

Additionally or alternatively, the predetermined state of the motor vehicle can be achieved when the motor vehicle is subjected to an inspection after production, i.e. at the end of production, and/or when such an inspection is carried out following repair or maintenance of components of the motor vehicle .

Additionally or alternatively, the at least one criterion can include the presence of at least one trigger. This ensures that at least one instruction for cleaning the surface of the screen is issued to the user only in situations in which cleaning the surface of the screen is advisable.

The trigger can be present or present, for example, if the motor vehicle has not been used for a long period of time and/or the motor vehicle has been driven and/or parked with at least one window open. Additionally or alternatively, the at least one trigger may include the fact that the screen or display has not been cleaned over a predetermined period of time and/or that the presence of dust has been detected in a passenger compartment of the motor vehicle, for example by means of an interior camera of the motor vehicle or the like .

Additionally or alternatively, the trigger may be that the control device detects that the user is having problems recognizing what is shown on the screen. This may manifest itself, for example, in the user reacting more slowly than usual or not at all to instructions given to the user on the screen. Additionally or alternatively, the control device may detect that the user's actions on the screen are not being carried out correctly or as expected. This may also be an indication that the user is having difficulty correctly recognizing what is shown on the screen.

For example, consider the case in which a portion of the screen is covered by an object such as a piece of clothing or paper or the like placed in the area of the screen or by means of a sticker. Then the user cannot recognize what is shown in this section. The presence of the item of clothing and/or paper and/or sticker or the like at least in the partial area of the surface of the screen can further result in an element displayed in this partial area being actuated or touched more frequently by the user, for example by pressing or such an operating action, or is operated with less success than would be the case without the presence of this disturbing object. This can also be identified by the control device as a trigger to initiate cleaning of the surface of the screen.

The check whether the surface of the screen needs to be cleaned is preferably carried out when, on the one hand, the predetermined state of the motor vehicle is present and, in addition, the at least one trigger is present. This can initiate a very targeted cleaning of the surface of the screen.

Preferably, a confirmation element is displayed to the user via the screen, whereby actuating the confirmation element can cause the screen to be put into a test mode. In the test mode, dirt on the surface of the screen is easier to see than in a normal mode of the screen. Advantageously, displaying the confirmation element on the screen means that the user of the vehicle has to look at the screen in order to be able to actuate the confirmation element, for example by bringing a finger or the like closer to the confirmation element or by touching the confirmation element. Accordingly, the user then has a direct view of the screen, and can determine whether it needs cleaning after the screen has been put into test mode.

Preferably, the confirmation element is arranged at varying positions on the screen. This makes it particularly easy to ensure that the user does not actuate the confirmation element blindly or without looking at the screen in order to put the screen into test mode. If, on the other hand, the confirmation element were always arranged at the same position on the screen, the probability would be increased that the user would activate the confirmation element without actually looking at the screen. However, this can be avoided by arranging the confirmation element at the varying or different positions when the screen is put into the test mode.

The test mode can be provided by reducing the brightness of the screen and/or by turning off the lights on the screen. In other words, the test mode may include or include reducing the brightness of the screen and/or turning off the screen's lights. This is based on the knowledge that dust and other dirt can be seen particularly well on a screen or display with a dark surface. In such a state there is a particularly high contrast between the dust particles on the surface of the screen and the surface of the screen.

Whether the brightness of the screen is simply reduced, thereby reducing the luminosity of the lamps, or whether the lamps are switched off completely, can depend in particular on the lighting conditions in the area surrounding the screen. For example, switching off the lamps on the screen can be advantageous in daylight, while at dusk or at night, reducing the brightness of the screen can be sufficient to improve the visibility of dirt on the surface of the screen.

In particular, after the user presses and/or approaches the confirmation element, the screen can be immediately switched by the control device into the test mode, in which the brightness of the screen is preferably reduced and/or the lights of the screen are switched off. By switching the screen into the test mode immediately after the confirmation element is actuated, it is ensured that the user is still looking at the screen when the screen is in the test mode.

For example, after actuation, for example in the form of pressing the confirmation element, the lamps on the screen can be switched off. In addition, a message can be displayed on the screen beforehand that the surface of the screen should be examined for the presence of dirt or impurities. This notice can be combined with a further notice displayed on the screen that the screen will now be switched off or that the lamps on the screen will now be switched off. In this way, the user of the motor vehicle is easily informed that the screen is being transferred to test mode while the user continues to have the screen in view. After exiting the test mode, the user is preferably shown a further confirmation element via the screen. By activating the further confirmation element, completion of an examination of the surface of the screen for the presence of dirt can be confirmed. In this way it can be ensured that the user activating the further confirmation element has actually viewed the surface of the screen that is in the test mode. The user is therefore at least responsible for confirming that the screen or display was in test mode. This makes the process particularly reliable.

By obtaining confirmations from the user in this way, which the user makes, By the user activating the confirmation element or the further confirmation element, a self-test is carried out as to whether the driver has actually looked at the screen.

It can happen that the user simply activates the further confirmation element without paying particularly close attention to the screen that is in test mode. It is therefore advantageous if the user not only looks at the screen, but also analyzes what he is looking at or looks at the screen with increased attention, especially when the screen is in test mode.

Preferably, for the purpose of checking whether the surface of the screen should be cleaned, at least one image element is displayed to the user on the screen. Through an operating action by the user, feedback from the user regarding the detectability of the at least one control element can be output, the feedback being able to be evaluated by means of the control device. By displaying the at least one image element, the user can be specifically requested to provide feedback, which can be used to determine whether the user has recognized the at least one image element displayed on the screen. By evaluating the feedback from the control device, it can be determined whether image elements are displayed on the screen with sufficient visibility. In this way, a test in the manner of an eye test can be implemented, in which the control device can draw conclusions about the recognizability of the image elements displayed on the screen from the user's feedback or reactions.

In this way, it can be ensured in particular that the user actually looks at all parts of the screen, especially when the screen is still in the test mode or after the test mode has ended, in which the brightness is reduced or the lamps are switched off. This can be achieved, for example, by arranging a respective image element at different locations or positions on the screen, the user being able to provide feedback on its recognizability. Based on the user's reaction to the image elements and the associated feedback from the user regarding the recognizability of the image elements, it can be determined in particular whether all areas of the screen are functional or not impaired by dirt or the like.

Symbols, graphics or the like can be displayed on the screen as image elements, whereby such image elements can be displayed on the screen in particular in different sizes and/or in different color intensities and/or brightnesses. If such a display is combined with a question as to whether one of the image elements was larger and/or brighter and/or of a different color than another image element, the control device can very easily deduce from the answer given by the user to this question whether all of the image elements were clearly visible. Based on feedback in the form of such answers, the control device can therefore very easily assess the quality of the image output by the screen.

Furthermore, it can be determined very easily in this way whether, for example, at least a partial area of the screen is covered by an object, for example by a piece of clothing and/or paper and/or a sticker or the like that partially covers the surface of the screen.

Preferably, after carrying out at least one cleaning of the surface of the screen, a query is sent to the user as to whether the at least one cleaning was successful. In this way, the control device can be informed whether the user is satisfied with the cleaning of the surface of the screen or not. This is also advantageous with regard to the extensive usability of the screen by the user.

To check whether the at least one cleaning was successful, at least one test object can be displayed on the screen. In this case, feedback from the user regarding the detectability of the at least one test object can be output by an operating action by the user, and the feedback can be evaluated by means of the control device. Through the feedback, the user can express whether he was able to recognize at least one test object displayed on the screen. If this is the case, the control device can conclude that the cleaning of the surface of the screen was successful. This is very easy to implement.

Additionally or alternatively, in order to check the success of the at least one cleaning, image data which is transmitted to the screen for display can also be displayed on a second screen of the motor vehicle. Then, by comparing what is seen on the screen with what is seen on the second screen, the user can determine the quality of the display on the screen. This makes it very easy to check whether the cleaning was successful. Such a mirroring of the image data intended for display on the screen onto the second screen of the motor vehicle can also be implemented in a technically simple manner.

As part of this use of the second screen, it is also advantageous if the user can inform the control device of the success of the cleaning after comparing the image data displayed on the second screen with what is displayed on the screen. This can be done by the user answering at least one query addressed to the user and relating to the comparison. The answer can be given in particular by the user making an operating input on the screen.

By comparing the displays on the screen and the second screen, the user can in particular determine whether, for example, a partial area on the screen is not visible or is more difficult to see, which is visible or is better visible on the second screen. Such information can be used to assess the image quality of the image data output by the screen and taken into account when answering the query.

In particular, if the second screen is larger than the screen, it is very easy to determine whether all details on the screen are clearly visible or whether there are impairments in the display on the screen due to dirt or the like.

The second screen can in particular be located in a field of vision of the user of the motor vehicle, for example if the user is the driver of the motor vehicle. Accordingly, the second screen can be designed as a central screen arranged approximately in the central area of a cockpit or an instrument panel of the motor vehicle, which is particularly easy to see by the user and is often larger than the screen. This is particularly true if the screen is part of a mirror replacement system.

In addition, a second screen designed as a central screen can be comparatively close to the human eye of the user of the motor vehicle if the user is sitting on a vehicle seat designed in particular as a driver's seat. This is also advantageous in order to be able to clearly see what is displayed on the second screen.

The method is preferably applied to a screen which is designed to display image data captured by a camera of the motor vehicle. In particular, the screen can thus be designed as a part or component of a mirror replacement system. When using the screen in this way, it is particularly important to ensure that the surface of the screen is well cleaned and that what is displayed on the screen is clearly visible.

Preferably, the camera of the motor vehicle is designed to capture the surroundings to the rear of the motor vehicle at least in part. The mirror replacement system comprising the screen can accordingly be used as a replacement for at least one exterior mirror and/or at least one interior rearview mirror of the motor vehicle.

The motor vehicle according to the invention comprises a screen and a control device associated with the screen. The control device is designed to check whether a surface of the screen is to be cleaned, i.e. should be cleaned. At least one instruction can be issued to a user of the motor vehicle to clean the surface of the screen. The screen is designed to display the at least one instruction to the user. The screen is designed to display to the user how the user should move an object across the surface of the screen. The screen is designed to indicate at least one trajectory for moving the object on the surface of the screen. A sensor device on the screen can be used to detect whether the object deviates from the at least one trajectory when it is moved across the surface. The control device is designed to initiate at least one measure in the event of a deviation from the at least one trajectory. The surface of the screen can be cleaned in a particularly simple manner using the motor vehicle.

The advantages and preferred embodiments described for the method according to the invention also apply to the motor vehicle according to the invention and vice versa.

The invention therefore also includes further developments of the motor vehicle according to the invention, which have features as have already been described in connection with the further developments of the method according to the invention. For this reason, the corresponding Further developments of the motor vehicle according to the invention are not described again here.

The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and/or a request to enter user feedback is issued and/or a default setting and/or a predetermined initial state is set.

The invention also includes the control device of the motor vehicle. The control device can have a data processing device or a processor device that is set up to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and/or at least one microcontroller and/or at least one FPGA (Field Programmable Gate Array) and/or at least one DSP (Digital Signal Processor). Furthermore, the processor device can have program code that is designed to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device. The processor circuit of the processor device can, for example, have at least one circuit board and/or at least one SoC (System on Chip).

As a further solution, the invention also includes a computer-readable storage medium comprising program code which, when executed by a processor circuit of a computer or a computer network, causes it to carry out an embodiment of the method according to the invention. The storage medium can, for example, be provided at least partially as a non-volatile data storage (e.g. as a flash memory and/or as an SSD - solid state drive) and/or at least partially as a volatile data storage (e.g. as a RAM - random access memory). The storage medium can be arranged in the processor circuit in its data memory. The storage medium can also be operated on the Internet as a so-called app store server, for example. The computer or computer network can provide a processor circuit with at least one microprocessor. The program code can be provided as binary code or assembler and/or as source code of a programming language (e.g. C) and/or as a program script (e.g. Python).

The invention also includes combinations of the features of the described embodiments. The invention therefore also includes implementations that each have a combination of the features of several of the described embodiments, provided that the embodiments have not been described as mutually exclusive.

• 1 schematisch und ausschnittsweise ein Kraftfahrzeug mit meinem Spiegelersatzsystem, bei welchem mittels eines Bildschirms Kamerabilder darstellbar sind, welche eine Kamera des Spiegelersatzsystems in einer rückwärtigen Umgebung des Kraftfahrzeugs erfasst;
• 2 stark schematisiert den Bildschirm des Spiegelersatzsystems gemäß 1;
• 3 Schritte eines Verfahrens zum Betreiben des Bildschirms, bei welchem eine Reinigung der Oberfläche des Bildschirms vorgenommen wird;
• 4 in einer detaillierteren Aufschlüsselung Teilschritte des Verfahrens gemäß 3, wobei die Teilschritte ein Abholen von Bestätigungen eines Nutzers des Kraftfahrzeugs beinhalten;
• 5 in einer detaillierteren Aufschlüsselung weitere Teilschritte des Verfahrens gemäß 3, wobei die Teilschritte ein Ausgeben von Reaktionen des Nutzers auf eine Darstellung von Bildelementen auf dem Bildschirm umfassen;
• 6 in einer weiteren detaillierteren Aufschlüsselung Teilschritte des Verfahrens gemäß 3, wobei diese Teilschritte einen Reinigungsvorgang betreffen, welchen der Nutzer an der Oberfläche des Bildschirms vornimmt;
• 7 Schritte beim Durchführen der Reinigung des Bildschirms durch den Nutzer, wobei der Nutzer auf der Oberfläche des Bildschirms einer vorgegebenen Trajektorie folgt;
• 8 Schritte beim Durchführen der Reinigung des Bildschirms durch den Nutzer, wobei es zu Abweichungen von der Trajektorie kommt;
• 9 ein Ablaufdiagramm mit Schritten zum Überprüfen eines Erfolgs der Reinigung der Oberfläche des Bildschirms; und
• 10 ein Spiegeln von mittels des Bildschirms angezeigten Bilddaten auf einen Zweitbildschirm des Kraftfahrzeugs.

Examples of embodiments of the invention are described below. This shows:

• 1 schematically and in detail a motor vehicle with my mirror replacement system, in which camera images can be displayed using a screen, which a camera of the mirror replacement system captures in a rear area of the motor vehicle;
• 2 highly schematized the screen of the mirror replacement system according to 1 ;
• 3 Steps of a method for operating the screen, in which cleaning the surface of the screen is carried out;
• 4 in a more detailed breakdown of the sub-steps of the procedure 3 , wherein the sub-steps include collecting confirmations from a user of the motor vehicle;
• 5 in a more detailed breakdown further sub-steps of the procedure 3 , wherein the substeps include outputting user reactions to a display of image elements on the screen;
• 6 in a further more detailed breakdown of sub-steps of the procedure 3 , whereby these sub-steps relate to a cleaning process that the user carries out on the surface of the screen;
• 7 Steps in carrying out cleaning of the screen by the user, wherein the user follows a predetermined trajectory on the surface of the screen;
• 8th Steps when the user performs the cleaning of the screen, where deviations from the trajectory occur;
• 9 a flowchart with steps for verifying success of cleaning the surface of the screen; and
• 10 mirroring image data displayed on the screen onto a second screen of the motor vehicle.

The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the components of the embodiments described each represent individual features of the invention that are to be considered independently of one another and which also develop the invention independently of one another. Therefore, the disclosure should also include combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by other features of the invention already described.

In the figures, identical reference symbols designate functionally identical elements.

1 shows a schematic and partial view of a motor vehicle 10 with a screen 12 or display. The screen 12 or the display is part of a mirror replacement system of the motor vehicle 10. The mirror replacement system comprises a camera 14 which, during operation, at least partially captures the surroundings to the rear of the motor vehicle 10. The image data captured by the camera 14 are displayed on the screen 12.

In the 1 In the exemplary embodiment shown, the mirror replacement system is provided instead of an outside mirror on the left in the direction of travel. Here, as in 1 As shown by way of example, the screen 12 can be arranged on an inner side of a left door 16 of the motor vehicle 10, for example above a door handle 18 of the door 16. However, it is also possible to arrange the screen 12 at another location in the passenger compartment of the motor vehicle 10, where a user of the motor vehicle 10, in particular the driver of the motor vehicle 10, can see the screen 12, in particular when the user is on a vehicle seat, for example the driver's seat of the motor vehicle 10.

In such a mirror replacement system, it is important to ensure that a surface 20 of the screen 12 (see 2 ) is clean or not dirty. This is because it is possible to ensure that the image data provided by the camera 14 can be displayed by means of the screen 12 in such a way that the user of the motor vehicle 10 can easily recognize the corresponding images or a sequence of images, for example in the form of a video or the like. Accordingly, it is important to ensure that the user, in particular the driver, always clearly recognizes what images and/or videos are being output via the screen 12, with the corresponding image data being fed to the screen 12 from the camera 14.

If there are dirt and/or objects on the surface 20 of the screen 12 or at least parts of the surface 20 are covered, the information displayed on the screen 12 can no longer be recognized to a sufficient degree. This is counteracted as described below.

Basic steps of a method for operating the screen 12 and in particular cleaning the surface 20 of the screen 12 are intended with reference to 3 be explained. Accordingly, the method is first initiated 22, which preferably includes cleaning the surface 20 of the display or screen 12. The starting or initiation 22 can be effected by a control device 24 of the motor vehicle 10 assigned to the screen 12, which in 1 is shown schematically. For example, the control device 24 can first determine whether certain criteria are met in order to then check whether the surface 20 of the screen 12 needs to be cleaned, i.e. should be cleaned.

For example, the control device 24 can determine whether a predetermined state of the motor vehicle 10 exists in which the surface 20 of the screen 12 or display can be cleaned without any problem. The state can be reached, for example, when the motor vehicle is stationary and is expected to maintain this state for a certain period of time. Furthermore, the predetermined state can be reached when an automated or autonomous driving system of the motor vehicle 10 has sole control of the motor vehicle 10 and the driver and thus user of the screen 12 is not required to drive the motor vehicle 10 for the foreseeable future.

In particular, if such a condition of the motor vehicle exists, the control device 24 can determine whether at least one further criterion is met. This at least one further criterion can be the presence of a trigger 30 (see 4 ) or triggers. The trigger 30 can, for example, consist in the fact that the motor vehicle 10 has not been used for a long time and/or has been driven or parked with the windows open, so that the presence of dust or the like on the surface 20 of the screen 12 can be expected.

If it is determined that such a trigger 30 is present, according to 3 checking 26 the cleanliness or a ver The surface 20 of the screen 12 can be dirty. Partial steps preferably provided here should be with reference to 4 be explained. In 4 In addition, the steps of checking 28 whether the predetermined state of the motor vehicle 10 is present and checking the presence of the at least one trigger 30 are shown schematically. As with checking 26 according to 3 For example, what can be done should also be done with reference to 4 and up 2 be explained in more detail. For example, it can be provided that the start of checking 26 the cleanliness or contamination of the surface 20 of the screen 12 is confirmed by the user of the motor vehicle 10, in particular the driver of the motor vehicle 10. For this purpose, the user can use the screen 12 to receive a confirmation element 32 (see 2 ) are displayed. Approximately in such a way an announcement 34 is made by the control device 24 (see 4 ), that checking 26 according to 3 should be started.

For example, by displaying the confirmation element 32 on the screen 12, the user can be informed that the screen 12 should now be put into a test mode in which dirt present on the surface 20 of the screen 12 can be better recognized than in a normal mode Screen 12. By activating the confirmation element 32, for example in the form of tapping the confirmation element 32 (see 2 ), the user can cause the screen 12 to be put into test mode.

It is advantageous here that the confirmation, i.e. the actuation of the confirmation element 32, takes place on the surface 20 of the screen 12. This ensures that the user is looking at the surface 20 of the screen 12. The confirmation element 32 can be arranged at different positions on the screen 12 when the test mode is intended to be started. In this way, it can be ensured that the user is actually looking at the screen 12 in order to actuate the confirmation element 32, for example with a finger 36 (see 2 ) or similar part of the user’s body.

To put the screen 12 into the test mode, the brightness of the screen 12 can be reduced after pressing the confirmation element 32 or as soon as the finger 36 approaches the confirmation element 32. In particular, the lighting means (not shown) of the screen 12 can be switched off in order to darken the surface 20 of the screen 12 to a particularly great extent and thus provide the test mode. This is because dust or the like can be seen particularly well on the dark surface 20 of the screen 12. The screen 12 can be switched off after pressing or activating the confirmation element 32, or a message such as "Look for dirt" can be displayed on the screen 12 after pressing or activating the confirmation element 32, preferably together with the message that the screen 12 will now be switched off. A pickup 38 of the confirmation, which consists, for example, in the user activating the confirmation element 32 with the finger 36, for example (cf. 2 ), is in 4 as a further process step.

This pickup 38 is followed by changing 40 of the screen 12, for example in the form of reducing the brightness of the screen 12 and/or in the form of switching off the lamps of the screen 12. According to 4 It is advantageous to collect or obtain a further confirmation 42 from the user. This can be done by displaying a further confirmation element 44 (see 2 ) following the changing 40 (compare 4 ) of the screen 12 can be made, whereby the change 40 can be realized in particular by switching off the lamps of the screen 12.

In 2 the first confirmation element 32 and the second or further confirmation element 44 are shown together or at the same time on the screen 12. In fact, however, the first confirmation element 32 is displayed first and after the first confirmation element 32 has been activated, the screen 12 is first put into the test mode, for example by switching off the lights of the screen 12. If the screen 12 has been activated again after the test mode has ended and the second confirmation element 44 (see 2 ) is displayed on the screen 12, the user can express that the screen 12 was actually switched off and the surface 20 of the screen 12 could be examined for the presence of dirt by activating the second confirmation element 44. The confirmation elements 32, 44 are thus displayed one after the other on the screen 12.

In order to prevent the user of the motor vehicle 10 from simply pushing the second confirmation element 44 away, i.e. activating the second confirmation element 44, without actually having checked the cleanliness or soiling of the surface 20 of the screen 12, the checking 26 (cf. 3 ) may include further steps relating to 5 and 2 should be explained.

Thus, after starting 46 a visual inspection of the screen 12 on the surface 20 image elements 48, 50 (compare 2 ) in the form of symbols, graphics and the like. In 2 By way of example, a first image element 48 and a second image element 50 are shown, wherein the second image element 50 is similar to the first image element 48, but has a smaller size. The image elements 48, 50 can additionally or alternatively differ in color and/or color intensity and/or their brightness or the like.

The step of importing 52 such image elements 48, 50, for example in the form of symbols, graphics, videos or the like, is in 5 as a further sub-step of the process. In a further step 54, according to 5 a request to the user of the motor vehicle 10 to react to the playback 52 or display of the image elements 48, 50 on the screen 12. Accordingly, the user of the motor vehicle 10, in particular the driver of the motor vehicle 10, can provide feedback on the image elements 48, 50 or on the recognizability of the image elements 48, 50.

For example, graphics of different sizes and arranged in different places can be displayed on the screen 12, for example in the form of the image elements 48, 50 shown here as an example, and the user is asked for feedback in step 54. For example, the feedback can include the user specifying which of the image elements 48, 50 is larger and/or brighter than the other and/or whether the respective image element 48, 50 is even recognizable. Additionally or alternatively, such a request for reactions from the driver in step 54 can consist of the user having to specify whether he was able to recognize a certain graphic or an image of a certain real object on the screen 12, wherein the graphic or the image of the object is displayed in the form of the image element 48, 50.

The control device 24 can according to 5 carry out an analysis 56 of the user's reactions in the same way as is the case when carrying out an eye test. An eye test is also about providing feedback as to whether or how well certain elements can be recognized, for example on a screen.

In 2 the image elements 48, 50 are shown on the screen 12 together with the confirmation elements 32, 44. In fact, however, the image elements 48, 50 are preferably displayed on the screen 12 after the test mode has ended in order to ensure that the user has actually inspected or was able to inspect as many areas of the screen 12 as possible and not a partial area of the screen 12 was covered by an object.

The activation of the confirmation elements 32, 44 as well as the output of feedback or reactions by the user can be carried out in particular by means of a 2 sensor device 58 of the screen 12, which is only shown schematically. Accordingly, the screen 12 can be designed as a touchscreen, which is designed to detect user actions performed on the surface 20. Such detections are carried out by means of the sensor device 58.

Accordingly, for example, the user can make operating inputs and also the feedback in step 54 by activating the surface 20 of the screen 12. For example, the user can answer questions relating to the image elements 48, 50 by making inputs on the surface 20 of the screen 12 and thus generate the feedback that can be evaluated by the control device 24.

Regarding 6 as well as on 7 and 8th the step of implementation 60 (compare 3 ) of cleaning the surface 20 of the display or screen 12. The cleaning of the surface 20 of the screen 12 is preferably carried out by the user moving an object such as the finger 36 and/or a cleaning cloth or a rag or the like over the surface 20 of the screen 12. In this case, according to 6 first, starting 62 of the instructions for cleaning the surface 20 of the screen 12. Accordingly, a request 64 can be issued to the user of the motor vehicle 10 to begin cleaning the surface 20 of the screen 12.

For this purpose, cleaning symbols 66 can be activated on the screen 12, which in 7 are shown schematically. Activation 68 of the cleaning symbols 66 is in 6 as a further method step. By means of the cleaning symbols 66 and preferably by means of elements arranged between the individual cleaning symbols 66, for example in the form of arrows 70 or the like, a trajectory 72 for moving, for example, the finger 36 over the surface 20 of the screen 12 can be made known to the user. According to the illustrations in 7 can be activated after activating 68 the cleaning symbols 66 and the arrows 70, the user is thus prompted to touch the cleaning symbols 66 one after the other in the order specified by the arrows 70 and to move along the surface 20 of the screen 12.

In 7 For reasons of clarity, only some of the cleaning symbols 66 and the arrows 70 are provided with a reference number. However, from the representations in 7 It can be seen that the user moves his finger 36 along the trajectory 72 completely and correctly, i.e. from the first cleaning symbol 66 in the direction of the arrows 70 to the last cleaning symbol 66. A time sequence is shown here 7 illustrated by further arrows 74. In particular, according to 7 It can be provided that those cleaning symbols 66 and the arrows 70 disappear, which were touched one after the other when driving correctly along the trajectory 72 with the finger 36 or similar body part of the user of the motor vehicle 10. Since the screen 12 has the sensor device 58 and is therefore designed as a touchscreen, it can be easily determined using the screen 12 whether the user has actually stroked over all of the cleaning symbols 66 with the finger 36 or a similar part of the body.

By moving the finger 36 along the surface 20 of the screen 12 along the trajectory 72, the surface 20 of the screen 12 can be freed of dirt such as dust or the like. This applies in particular when the user moves a cleaning cloth or similar object along the trajectory 72 over the surface 20 of the screen 12 with his finger 36 or with his hand.

In particular, by pressing the first cleaning symbol 66, which is shown in 7 upper left corner of the screen 12, according to the procedure in 6 an input 76 of the user can be made, according to which he has started the cleaning process in the form of moving the object, for example in the form of the finger 36, along the trajectory 72. Moving over the other cleaning symbols 66 also corresponds to such inputs 76 (see 6 ) by the user of the motor vehicle 10. In particular, by reaching the last cleaning symbol 66 along the trajectory 72, which is in 7 shown at the bottom left, the user must enter 76 that the cleaning path has been traveled to the end. This travel 78 of the cleaning path or trajectory 72 is shown in 6 as a further step of the method, which is followed by an end or termination 80 of the cleaning process.

In 8th is an example of how to proceed if the user deviates from the trajectory 72 indicated on the surface 20 of the screen 12. Here too, the cleaning symbols 66 are preferably arranged with the additional use of the arrows 70 so that the trajectory 72 results from the arrangement of the cleaning symbols 66. However, it comes according to 8th When moving along the surface 20 of the screen 12 with the user's finger 36 or similar body part, two cleaning symbols 66, for example the two in 8th cleaning symbols 66 shown on the right. The user thus reaches the last cleaning symbol 66, omitting these two cleaning symbols 66. This state is in 8th illustrated in the lower, middle illustration.

If such a deviation from the trajectory 72 occurs, the user may be informed that he must select certain cleaning symbols 66, according to 8th the two right-hand cleaning symbols 66 arranged one above the other. For example, the omitted cleaning symbols 66 can then be displayed in a different way than before the trajectory 72 was followed with the finger 36.

Additionally or alternatively, an area of the screen 12 that is different from the cleaning symbols 66 can be displayed differently than after the trajectory 72 has been correctly traveled 7 . For example, an area of the screen 12 forming the background for the cleaning symbols 66 can be displayed in a signal color in order to inform the user that the cleaning was not carried out as suggested by identifying the trajectory 72 or was not successful.

After completing the cleaning process (see 3 ) a success control 82 can be carried out, which is shown schematically in 3 is shown, and its possible course is shown by means of 9 To determine whether the cleaning of the surface 20 of the screen 12 was successful, according to 9 a request 84 is sent to the user as to whether the cleaning was satisfactory or whether the recognizability of the representations of content on the screen 12 is now OK.

If the cleaning was satisfactory, the success control 82 is reached (see 3 ) to an end of 86 (compare 9 ). However, if the query 84 shows that the cleaning was not satisfactory, a request 88 for further checking 26 (see 3 ) the cleanliness or contamination of the display or screen 12 and then carrying out 60 another cleaning process (see 3 ) are suggested. Here, for example, the cleaning can take place along a different trajectory 72 or the user can be asked to carry out the cleaning according to his or her ideas. Then you can according to 9 A further query 90 can be made by the control device 24 as to whether the cleaning is now satisfactory or whether the surface 20 of the screen 12 has now been cleaned sufficiently well. If this is the case, the method again comes to the end 86. If this is not the case, 12 test objects 92 (compare 2 ) are displayed.

The display 94 of the test objects 92 and the checking of the visibility of the test objects 92 are in 9 as a further process step. In 2 only a single test object 92 is shown schematically. However, such test objects 92 can be displayed at a large number of locations, in particular those already touched or not yet touched by the user of the screen 12, in order to check whether they can be recognized by the user.

If it turns out that the test objects 92 are visible or recognizable, the method also comes to the end 86 (see 9 ). If, on the other hand, the display 94 of the test objects 92 was not successful, an abort 96 can occur and the control device 24 can cause a message to be output about the existence of an error. In particular, if there is stubborn dirt or grease on the surface 20 of the display or screen 12, cleaning the surface 20 of the screen 12 may not be satisfactory.

As with reference to 9 As explained, the driver or user can, for example, give feedback that the respective test object 92 is visible by tapping the respective test object 92. Such feedback can be evaluated by means of the control device 24.

Additionally or alternatively, another display or a second screen 98 of the motor vehicle 10 can be used (see 10 ) to enable the user of the motor vehicle 10 to check the quality of the cleaning he has carried out. For example, the second screen 98 can be designed as a central display of the motor vehicle 10.

Such a second screen 98 can be used using the camera 14 (see 1 ) recorded image data are transmitted, which are also transmitted to the screen 12 for the purpose of display. In this way, the user of the motor vehicle 10 can determine what he should actually see on the screen 12 by looking at the second screen 98. This can show the user to what extent dirt or errors may limit their viewing experience.

In particular, the user can be shown what he may not be able to see on the screen 12, for example because an area is dirty and/or because an area of the screen 12 is covered and/or has a crack and/or a pixel error or the like. Mirroring the image data from the camera 14 and thus transmitting the image data to the screen 12 on the one hand and to the second screen 98 on the other hand is useful so that the driver can decide whether the images displayed on the screen 12 and the second screen 98 match or correspond exactly to one another. This is particularly easy if, for example, the second screen 98 is larger than the screen 12 and accordingly the image displayed on the second screen 98 can also be shown larger than is possible on the screen 12.

In the present case, moving the body part such as the finger 36 over the surface 20 of the screen 12 ensures that the user of the motor vehicle 10 actually touches the surface 20 of the screen 12 and removes any dirt. However, it is also possible for the control device 24 to cause or initiate an automatic cleaning of the surface 20 of the screen 12.

Such automatic cleaning can be provided in particular in addition to the cleaning of the surface 20 by the user of the motor vehicle 10. For the automatic cleaning, for example, air outlets of a ventilation system (not shown in detail here) of the motor vehicle 10 can be used, by means of which an air flow can be directed onto the surface 20 of the screen 12. By blowing on the surface 20 in this way, for example, dust can be removed from the surface 20 of the screen 12.

Furthermore, it is possible to control 26 (see 3 ) the cleanliness or the degree of contamination of the surface surface 20 of the screen 12 by means of an interior camera (not shown) of the motor vehicle 10. This is advantageous if the interior camera is able to capture the surface 20 of the screen 12.

Furthermore, the user of the motor vehicle 10 can be encouraged to clean the surface 20 of the screen 12 by placing a film with adhesive properties or the like on it by issuing an instruction that is displayed on the screen 12. By peeling the film off the surface 20 of the screen 12, dirt can also be removed from the surface 20 of the screen 12. However, cleaning the surface 20 of the screen 12 with the user's body part, in the form of the finger 36, is particularly intuitive.

The method described above makes it particularly easy to ensure that images taken by the camera 14 can be easily and reliably recognized by the user of the motor vehicle 10. This increases the safety of the mirror replacement system comprising the camera 14. This is advantageously done by cleaning the surface 20 of the screen 12 and then displaying the corresponding instruction on the screen 12, whereby this display of the instruction can be effected by the control device 24.

In the example explained above, it is particularly advantageous if the sensor device 58 of the screen 12 is able to detect inputs made by the user on the surface 20 of the screen 12. This can be used to track the touch of the screen 12, which is designed as a touchscreen.

Overall, an intuitive and simple mechanism is presented here as to how the driver or user of the motor vehicle 10 can be made aware of the need to keep the surface 20 of the screen 12 clean and how it can also be ensured that the driver or user can perceive an image on the screen 12 that is as free from interference as possible.

Overall, the examples show how intuitive display cleaning or screen cleaning can be provided, especially for mirror replacement camera systems.

Claims (9)

Method for operating a screen (12) of a motor vehicle (10), in which a control device (24) assigned to the screen (12) is used to check whether a surface (20) of the screen (12) needs to be cleaned, wherein to a user of the motor vehicle (10) at least one instruction is issued to clean the surface (20) of the screen (12), the at least one instruction being displayed to the user using the screen (12), characterized in that the user is provided with the screen (12) 12) shows how the user has to move an object (36) over the surface (20) of the screen (12), with at least one trajectory (72) on the surface (20) of the screen (12) for moving the Object (36) is identified, using a sensor device (58) on the screen (12) to detect whether there is a deviation from the at least one trajectory (72) when the object (36) is moved over the surface (20). comes, and in the event of a deviation from the at least one trajectory (72), at least one measure is taken. Procedure according to Claim 1 , characterized in that the user is shown by means of the screen (12) how the user has to move a body part of the user and/or a cleaning cloth over the surface (20) of the screen (12). Method according to one of the preceding claims, characterized in that the control device (24) determines whether at least one criterion is met, and if the at least one criterion is met, a check is made as to whether the surface (20) of the screen (12) is closed is to be cleaned, and wherein the at least one criterion includes the presence of a predetermined state of the motor vehicle (10) and / or the presence of at least one trigger (30). Method according to one of the preceding claims, characterized in that a confirmation element (32), in particular arranged at varying positions of the screen (12), is displayed to the user by means of the screen (12), wherein actuating the confirmation element (32) can bring about a transfer of the screen (12) into a test mode, wherein in the test mode, dirt present on the surface (20) of the screen (12) can be better recognized than in a normal mode of the screen (12). Procedure according to Claim 4 , characterized in that the user is given one Ending the test mode provided, in particular by reducing the brightness of the screen (12) and/or by switching off the lamps of the screen (12), a further confirmation element (44) is displayed by means of the screen (12), wherein by actuating the further confirmation element (44) a completion of an examination of the surface (20) of the screen (12) can be confirmed for the presence of contamination. Method according to one of the preceding claims, characterized in that for the purpose of checking whether the surface (20) of the screen (12) should be cleaned, the user is shown at least one on the screen (12), in particular at varying positions of the screen (12 ) arranged image element (48, 50) is displayed, wherein feedback from the user regarding the recognizability of the at least one image element (48, 50) can be output by an operating action by the user, and wherein the feedback can be evaluated by means of the control device (24). Method according to one of the preceding claims, characterized in that after carrying out at least one cleaning of the surface (20) of the screen (12), a query (84) is sent to the user as to whether the at least one cleaning was successful, for checking one Success of the at least one cleaning - at least one test object (92) is displayed on the screen (12), wherein feedback from the user regarding the detectability of the at least one test object (92) can be output by an operator action by the user, and the feedback can be provided by means of the Control device (24) can be evaluated and / or - image data, which are transmitted to the screen (12) for display, are also displayed on a second screen (98) of the motor vehicle (10). Method according to one of the preceding claims, characterized in that the method is applied to a screen (12) which is designed to be monitored by means of a camera (14) of the motor vehicle (10) which is designed, in particular, to detect at least regions of the rear surroundings of the motor vehicle (10). Motor vehicle (10) to display captured image data. Motor vehicle (10) with a screen (12) and with a control device (24) assigned to the screen (12), wherein the control device (24) is designed to check whether a surface (20) of the screen (12) needs to be cleaned, wherein at least one instruction can be issued to a user of the motor vehicle (10) to clean the surface (20) of the screen (12), and wherein the screen (12) is designed to display the at least one instruction to the user, characterized in that the screen (12) is designed to display to the user how the user has to move an object (36) over the surface (20) of the screen (12), wherein the screen (12) is designed to indicate on the surface (20) of the screen (12) at least one trajectory (72) for moving the object (36), wherein it can be detected by means of a sensor device (58) of the screen (12) whether there is a movement of the object (36) over the surface (20) there is a deviation from the at least one trajectory (72), and wherein the control device (24) is designed to bring about the taking of at least one measure in the event of a deviation from the at least one trajectory (72).

Images