US20210261055A1 - Method for operating a display arrangement of a motor vehicle, and motor vehicle - Google Patents

Method for operating a display arrangement of a motor vehicle, and motor vehicle Download PDF

Info

Publication number
US20210261055A1
US20210261055A1 US17/253,801 US201917253801A US2021261055A1 US 20210261055 A1 US20210261055 A1 US 20210261055A1 US 201917253801 A US201917253801 A US 201917253801A US 2021261055 A1 US2021261055 A1 US 2021261055A1
Authority
US
United States
Prior art keywords
image
display
motor vehicle
camera
control device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US17/253,801
Other versions
US11097661B1 (en
Inventor
Matthias Geuß
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Audi AG
Original Assignee
Audi AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi AG filed Critical Audi AG
Assigned to AUDI AG reassignment AUDI AG ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GEUSS, Matthias
Application granted granted Critical
Publication of US11097661B1 publication Critical patent/US11097661B1/en
Publication of US20210261055A1 publication Critical patent/US20210261055A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02—Rear-view mirror arrangements
    • B60R1/08—Rear-view mirror arrangements involving special optical features, e.g. avoiding blind spots, e.g. convex mirrors; Side-by-side associations of rear-view and other mirrors
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • B60R2001/1253—Mirror assemblies combined with other articles, e.g. clocks with cameras, video cameras or video screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
    • B60R2300/305—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images merging camera image with lines or icons
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/70—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by an event-triggered choice to display a specific image among a selection of captured images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8046—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for replacing a rear-view mirror system
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/806—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for aiding parking
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8066—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring rearward traffic

Definitions

  • the invention relates to a method for operating a display arrangement of a motor vehicle, a camera continuously capturing camera images of a motor vehicle environment, and a display device showing the camera images in the form of an alternating image display.
  • the invention furthermore relates to a motor vehicle.
  • Classic exterior mirrors or rearview mirrors in motor vehicles are increasingly being replaced by virtual rearview mirrors. While in a classic exterior mirror a user or driver of the motor vehicle sees a mirror image of the surroundings of the motor vehicle in a permanent mirror, in a virtual rearview mirror an image of a particularly rearward surroundings of the motor vehicle is recorded by a recording device that is displayed to the user via a display device in the motor vehicle.
  • a frozen image in a virtual rearview mirror represents a risk, in particular when the motor vehicle is stationary. Situations are conceivable in which the user opens the driver's door of the motor vehicle and wants to get out while at this moment another motor vehicle or a bicycle passes the motor vehicle which is not displayed in the virtual rearview mirror due to a frozen image.
  • a frozen image of a virtual rearview mirror can also pose a particularly high risk if the motor vehicle is a truck or a bus that wants to make a right turn, and a cyclist is currently on a cycle path extending to the right of the motor vehicle. In order to minimize such hazards, some systems for detecting possible malfunctions of virtual rearview mirrors have already been disclosed in the prior art.
  • US 2017/094 268 A1 discloses a test method relating to a display system, in particular a virtual rearview mirror.
  • a test pattern is inserted into an image, with checksums being determined and evaluated as a function of the test pattern in order to detect a possible malfunction of the display system.
  • US 2016/210 861 A1 discloses a monitoring system relating in particular to an image recorded by a rearview camera The associated video signal is analyzed accordingly to determine whether there is a frozen still image. If this is the case, an optical or acoustic warning signal is output, for example.
  • the underlying object of the invention is to provide an improved way of outputting a malfunction of a virtual rearview mirror and therefore of informing a user accordingly.
  • this object is achieved in that, in a method of the type mentioned at the outset, an additional, continuously changing image element is displayed in or adjacent to the alternating image display, and if there is a malfunction of the camera and/or the display device and/or another component of the display arrangement, which malfunction leads to the display of a still image comprising a single camera image by the display device, that image element does not change.
  • the display of the constantly changing image element or throbber enables a user or driver to recognize a malfunction and thus the presence of a frozen still image in a comparatively simple manner
  • the constantly changing image element is additionally displayed.
  • the constantly changing image element is also coupled to the changing image display in such a way that, if there is a malfunction that leads to a freezing of the changing image display, that is, to a still image, the constantly changing image element no longer changes. This enables a user to easily recognize the presence of a respective malfunction. In particular, if the user has already got used to the presence of a constantly changing image element, the user can intuitively recognize that there is an error when the throbber no longer changes.
  • the method according to the invention has the advantage that the display of an error based on a non-changing image element is reliable.
  • warning signals to be output must first be generated by components of respective monitoring systems after an error has been detected.
  • these components are also affected by a possible malfunction, it is conceivable that the warning signal may not be available and the user is not informed of the malfunction.
  • a image element that does not change according to the invention also arises regardless of components that are necessary for generating a warning signal. If, for example, the display device, which can be a display or a touchscreen, freezes, then the image element does not automatically change either. But an optical warning signal is not displayed by the display device in this case, since an optical warning signal naturally cannot be displayed by a frozen image representation.
  • the representation according to the invention of a non-changing image element therefore represents a reliable way of informing the user about incorrect information from the virtual rearview mirror.
  • At least one piece of error information relating to the presence of the malfunction of the camera and/or the display device and/or a further component of the display arrangement is detected, the image element being generated as a function of the error information.
  • the non-changing image element is generated when respective error information is present. If, on the other hand, there is no error information, then the changing image element can be generated. Respective error information can be present, for example, if one of the components of the display arrangement or of the virtual rearview mirror fails. For example, the camera can be checked to determine whether the images sent by the camera are identical, that is to say, whether there is a malfunction in the camera that leads to a frozen still image.
  • the operating information relates to the state of motion of the motor vehicle, wherein the display condition is only met when the motor vehicle is moving.
  • the display condition is only met when the motor vehicle is moving.
  • the user can switch on the throbber anyway if, for example, he habitually prefers that the constantly changing image element is also displayed while driving.
  • an operating device of the motor vehicle such as a button, can be provided, for example.
  • a respective setting by the user via an operating menu is also conceivable.
  • the method according to the invention can allow a user to switch off the throbber accordingly.
  • a bar that changes its geometry or a number that represents an incremental sequence of numbers or an object that is moving and/or changing its color and/or its line thickness and/or its position in the image displayed by the display device can be used as a constantly changing image element.
  • the constantly changing image element can therefore be an animation which, for example, can be set as desired by the user.
  • the size and/or the type of change in the image element can be set by the user.
  • the constantly changing image element is a geometric shape that changes its geometry, it is conceivable that the image element is a periodically increasing and decreasing bar or a circle or the like that is pulsating and changes with respect to its radius, for example.
  • the color of the constantly changing image element changes, for example, every second.
  • the color can change between two or more colors, for example.
  • the color of the throbber can run through continuous color transitions, particularly the entire color spectrum. Different variants with regard to the change in the image element can be combined here.
  • the image element occupies a particularly rectangular partial area of the camera image displayed by the display device, preferably in a corner of the camera image. If displaying the camera image does not use the entire display area of the display device, the throbber can also be displayed next to the camera image.
  • the display device can also display at least one image segment that contains information relating to the driving operation of the motor vehicle.
  • the image segment can in particular be a rectangular image that is displayed by the display device in addition to the camera image.
  • the image segment and the camera image can be displayed next to one another or partially overlapping.
  • the image segment can also be embedded in the camera image or partially overlap it, especially if it represents writing consisting of letters and/or numbers.
  • the information relating to the driving operation of the motor vehicle relates to data from a navigation system and/or auxiliary lines of a parking assistance system and/or the current speed of the motor vehicle and/or the current time of day or the distance to a vehicle in front.
  • the information relating to the driving operation of the motor vehicle relates to a distance covered by the motor vehicle and/or a current fuel consumption and/or the like.
  • the constantly changing image element is the image segment or is contained in the image segment. If the information relating to the driving operation of the motor vehicle is displayed in the form of letters or numbers, the color and/or the line width of the font used for this can change.
  • the constantly changing image element which in this case is the image segment, can be embedded in the camera image.
  • the image segment contains information from a navigation system
  • the image segment displays another camera image showing the front surroundings of the motor vehicle or a map of the surroundings, with a navigation arrow also being displayed in the image segment.
  • the navigation arrow is preferably the continuously changing image element, which for example changes its color and/or pulsates.
  • the image segment can also consist of auxiliary lines of a parking assistance system that are superimposed on the camera images to support the user when parking.
  • the auxiliary lines can be the constantly changing image element, wherein the color and/or the width of the lines is changing.
  • a control device controls the image display mode, wherein this control device or another control device generates the image element.
  • the control device can either be provided as a separate component which is connected to the camera and to the display device, or as a component of the camera or the display device.
  • the control device can in particular be set up to detect the error information and/or the operating information and to control the image display mode as a function thereof.
  • this information also relates to the presence of a possible malfunction of the control device itself
  • the invention also relates to a motor vehicle comprising a display device for displaying the camera images in the form of an alternating image display and a control device, wherein the control device is set up to control the operation of the display arrangement of the motor vehicle according to the method explained above.
  • FIG. 1 schematically shows a top view of the front of an exemplary embodiment of a motor vehicle according to the invention
  • FIG. 2 schematically shows the image displayed by a display device of the embodiment of the vehicle according to the invention.
  • FIG. 3 schematically shows the image displayed by a display device of another exemplary embodiment of the motor vehicle according to the invention.
  • FIG. 1 schematically shows a motor vehicle 1 with a display arrangement 2 .
  • a camera 3 is provided for the ongoing detection of a motor vehicle environment 4 , in particular an environment behind the motor vehicle 1 , wherein a display device 6 is provided for displaying the camera images 5 in the form of a changing image display.
  • the display arrangement 2 can also be referred to as a virtual rearview mirror and comprises the camera 3 , the display device 6 , and a control device 7 of the motor vehicle 1 .
  • a continuously changing image element 8 is displayed. If due to a malfunction of the camera 3 and/or the display device 6 and/or another component of the display arrangement, the camera images from the display device 6 are no longer in the form of an alternating image display, but only in the form of a still image comprising a single camera image 5 , the image element does not change.
  • a user 9 or driver of the motor vehicle 1 is thus enabled, in the case of a frozen still image displayed by the display device 6 , to intuitively and immediately recognize the presence of a malfunction relating to the display arrangement 2 and therefore to be aware that he cannot trust the current display of the virtual rearview mirror or the display arrangement 2 .
  • the user 9 has already gotten used to the constantly changing image element 8 or the throbber, he can immediately conclude that a non-moving throbber means that the display device 6 is displaying a still image.
  • the image display operation is controlled by the controller 7 .
  • the camera 3 transmits the recordings of the motor vehicle environment 4 to the control device 7 , wherein the control device 7 in turn transmits the camera images 5 to the display arrangement 2 .
  • the control device 7 is provided as a separate component in the exemplary embodiment shown, it is conceivable that the control device 7 is alternatively a component of the camera 3 or of the display device 6 .
  • the control device 7 is therefore set up in the motor vehicle 1 , for example, to detect error information relating to the presence of a malfunction in the camera 3 and/or the display device 6 and/or the control device 7 itself and/or another component of the display arrangement 2 .
  • the image element 8 is generated by the control device 7 as a function of the error information.
  • control device 7 is set up, although this is not absolutely necessary, to record operational information relating to the operation of the motor vehicle 1 , wherein the image element 8 is only displayed when a display condition dependent on the operational information is met.
  • the image element 8 is only displayed when the motor vehicle 1 is not driving.
  • the user 9 it is clear to the user 9 that the camera images 5 must be displayed by the display device 6 in the form of an alternating image display. If there is a still image while driving, the user 9 intuitively concludes that there must be a malfunction in the display arrangement 2 .
  • the display of the image element 8 is unnecessary in this case.
  • FIG. 2 shows the view of the display device 6 from the perspective of a user 9 .
  • the entire display area of the display device 6 is filled, for example, by the camera image 5 , which represents the rearward motor vehicle environment 4 .
  • the continuously changing image element 8 is, for example, a rotating wheel that overlays the camera image 5 .
  • the constantly changing image element 8 is a bar that changes its geometry or a number that represents an incremental sequence of numbers, or an object that moves and/or changes its color and/or its line width and/or its position in the image displayed by the display device 6 .
  • FIG. 3 also shows the view of the display device 6 of another exemplary embodiment of the motor vehicle 1 according to the invention from the perspective of a user 9 .
  • the display device 6 shows an image segment 10 that contains information from a navigation system 11 of the motor vehicle 1 .
  • the data shown by the image segment 10 relating to the navigation system 11 are just exemplary, that is, the image segment 10 can alternatively also contain other information relating to the driving operation of the motor vehicle 1 .
  • the image segment 10 is arranged next to the camera image 5 by way of example, but can also be faded in or embedded in the camera image 5 .
  • the image segment 10 itself can be the constantly changing image element 8 .
  • FIG. 1 shows the view of the display device 6 of another exemplary embodiment of the motor vehicle 1 according to the invention from the perspective of a user 9 .
  • the display device 6 shows an image segment 10 that contains information from a navigation system 11 of the motor vehicle 1 .
  • the data shown by the image segment 10 relating to the navigation system 11 are just exemplary, that is,
  • the constantly changing image element 8 is a navigation arrow in the image segment 11 .
  • the navigation arrow constantly changes its color and pulsates.
  • a rotating wheel as shown in FIG. 2 is also displayed in the camera image 5 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)

Abstract

A method for operating a display arrangement of a motor vehicle. A camera continuously captures camera images of a motor vehicle environment and a display device shows the camera images in the form of an alternating image display. An additional, continuously changing image element is shown in or adjacent to the display of alternating images. The image element does not change if a malfunction of the camera and/or the display device and/or another component of the display arrangement results in the display of a still image comprising a single camera image by the display device.

Description

  • The invention relates to a method for operating a display arrangement of a motor vehicle, a camera continuously capturing camera images of a motor vehicle environment, and a display device showing the camera images in the form of an alternating image display. The invention furthermore relates to a motor vehicle.
  • Classic exterior mirrors or rearview mirrors in motor vehicles are increasingly being replaced by virtual rearview mirrors. While in a classic exterior mirror a user or driver of the motor vehicle sees a mirror image of the surroundings of the motor vehicle in a permanent mirror, in a virtual rearview mirror an image of a particularly rearward surroundings of the motor vehicle is recorded by a recording device that is displayed to the user via a display device in the motor vehicle.
  • In contrast to classic rearview mirrors, in which the user can always rely on the fact that the image visible in the permanent mirror actually represents the current situation, with a virtual rearview mirror it is conceivable that the image displayed by the display device does not show the current situation, but a frozen image. This is particularly conceivable when there is a technical defect or a malfunction of a component of the virtual rearview mirror system.
  • A frozen image in a virtual rearview mirror represents a risk, in particular when the motor vehicle is stationary. Situations are conceivable in which the user opens the driver's door of the motor vehicle and wants to get out while at this moment another motor vehicle or a bicycle passes the motor vehicle which is not displayed in the virtual rearview mirror due to a frozen image. A frozen image of a virtual rearview mirror can also pose a particularly high risk if the motor vehicle is a truck or a bus that wants to make a right turn, and a cyclist is currently on a cycle path extending to the right of the motor vehicle. In order to minimize such hazards, some systems for detecting possible malfunctions of virtual rearview mirrors have already been disclosed in the prior art.
  • US 2017/094 268 A1, for example, discloses a test method relating to a display system, in particular a virtual rearview mirror. A test pattern is inserted into an image, with checksums being determined and evaluated as a function of the test pattern in order to detect a possible malfunction of the display system.
  • US 2016/210 861 A1 discloses a monitoring system relating in particular to an image recorded by a rearview camera The associated video signal is analyzed accordingly to determine whether there is a frozen still image. If this is the case, an optical or acoustic warning signal is output, for example.
  • The underlying object of the invention is to provide an improved way of outputting a malfunction of a virtual rearview mirror and therefore of informing a user accordingly.
  • According to the invention, this object is achieved in that, in a method of the type mentioned at the outset, an additional, continuously changing image element is displayed in or adjacent to the alternating image display, and if there is a malfunction of the camera and/or the display device and/or another component of the display arrangement, which malfunction leads to the display of a still image comprising a single camera image by the display device, that image element does not change.
  • The display of the constantly changing image element or throbber enables a user or driver to recognize a malfunction and thus the presence of a frozen still image in a comparatively simple manner Thus, during the proper operation of the components of the display arrangement, if the display device consequently displays the alternating image representation, the constantly changing image element is additionally displayed. The constantly changing image element is also coupled to the changing image display in such a way that, if there is a malfunction that leads to a freezing of the changing image display, that is, to a still image, the constantly changing image element no longer changes. This enables a user to easily recognize the presence of a respective malfunction. In particular, if the user has already got used to the presence of a constantly changing image element, the user can intuitively recognize that there is an error when the throbber no longer changes.
  • In addition, the method according to the invention has the advantage that the display of an error based on a non-changing image element is reliable. In particular, warning signals to be output must first be generated by components of respective monitoring systems after an error has been detected. However, if these components are also affected by a possible malfunction, it is conceivable that the warning signal may not be available and the user is not informed of the malfunction. A image element that does not change according to the invention also arises regardless of components that are necessary for generating a warning signal. If, for example, the display device, which can be a display or a touchscreen, freezes, then the image element does not automatically change either. But an optical warning signal is not displayed by the display device in this case, since an optical warning signal naturally cannot be displayed by a frozen image representation. The representation according to the invention of a non-changing image element therefore represents a reliable way of informing the user about incorrect information from the virtual rearview mirror.
  • In a method according to the invention, at least one piece of error information relating to the presence of the malfunction of the camera and/or the display device and/or a further component of the display arrangement is detected, the image element being generated as a function of the error information.
  • It is therefore conceivable that the non-changing image element is generated when respective error information is present. If, on the other hand, there is no error information, then the changing image element can be generated. Respective error information can be present, for example, if one of the components of the display arrangement or of the virtual rearview mirror fails. For example, the camera can be checked to determine whether the images sent by the camera are identical, that is to say, whether there is a malfunction in the camera that leads to a frozen still image.
  • It is also conceivable that at least one piece of operating information relating to the operation of the motor vehicle is detected, the image element being displayed only when a display condition that depends on the operating information is met. In particular, situations are conceivable in which the throbber does not need to be displayed, since, for example, the camera image naturally changes constantly anyway and the user recognizes a malfunction solely through an unchanged image. In these cases, it makes sense that the image element is not generated.
  • In a further developed embodiment, the operating information relates to the state of motion of the motor vehicle, wherein the display condition is only met when the motor vehicle is moving. Thus, in the event that the motor vehicle is moving, it is not necessary to display the throbber, since in this case the camera image is constantly changing anyway. In this case, the user will immediately and intuitively associate a non-moving still image with a fault in the virtual rearview mirror. In this case, the display of the throbber, i.e. the generation of the image element, leads to redundant information for a user.
  • However, it is conceivable that the user can switch on the throbber anyway if, for example, he habitually prefers that the constantly changing image element is also displayed while driving. To this end, an operating device of the motor vehicle, such as a button, can be provided, for example. A respective setting by the user via an operating menu is also conceivable. Likewise, the method according to the invention can allow a user to switch off the throbber accordingly.
  • In the method according to the invention, a bar that changes its geometry or a number that represents an incremental sequence of numbers or an object that is moving and/or changing its color and/or its line thickness and/or its position in the image displayed by the display device can be used as a constantly changing image element. The constantly changing image element can therefore be an animation which, for example, can be set as desired by the user. In this context, it is also conceivable that the size and/or the type of change in the image element can be set by the user. In the event that the constantly changing image element is a geometric shape that changes its geometry, it is conceivable that the image element is a periodically increasing and decreasing bar or a circle or the like that is pulsating and changes with respect to its radius, for example. Alternatively or additionally, it is conceivable that the color of the constantly changing image element changes, for example, every second. The color can change between two or more colors, for example. In addition, the color of the throbber can run through continuous color transitions, particularly the entire color spectrum. Different variants with regard to the change in the image element can be combined here.
  • It is conceivable that the image element occupies a particularly rectangular partial area of the camera image displayed by the display device, preferably in a corner of the camera image. If displaying the camera image does not use the entire display area of the display device, the throbber can also be displayed next to the camera image.
  • In addition to the camera image, the display device can also display at least one image segment that contains information relating to the driving operation of the motor vehicle. The image segment can in particular be a rectangular image that is displayed by the display device in addition to the camera image. The image segment and the camera image can be displayed next to one another or partially overlapping. However, the image segment can also be embedded in the camera image or partially overlap it, especially if it represents writing consisting of letters and/or numbers.
  • In a further developed embodiment, it is conceivable that the information relating to the driving operation of the motor vehicle relates to data from a navigation system and/or auxiliary lines of a parking assistance system and/or the current speed of the motor vehicle and/or the current time of day or the distance to a vehicle in front. Alternatively or additionally, it is conceivable that the information relating to the driving operation of the motor vehicle relates to a distance covered by the motor vehicle and/or a current fuel consumption and/or the like. It is also conceivable that the constantly changing image element is the image segment or is contained in the image segment. If the information relating to the driving operation of the motor vehicle is displayed in the form of letters or numbers, the color and/or the line width of the font used for this can change. In this case, as already mentioned, the constantly changing image element, which in this case is the image segment, can be embedded in the camera image.
  • In the event that the image segment contains information from a navigation system, it is conceivable that the image segment displays another camera image showing the front surroundings of the motor vehicle or a map of the surroundings, with a navigation arrow also being displayed in the image segment. In this case, the navigation arrow is preferably the continuously changing image element, which for example changes its color and/or pulsates.
  • The image segment can also consist of auxiliary lines of a parking assistance system that are superimposed on the camera images to support the user when parking. In this case, the auxiliary lines can be the constantly changing image element, wherein the color and/or the width of the lines is changing.
  • The parallel or simultaneous use of several constantly changing image elements or throbbers is conceivable.
  • In the method according to the invention, it is conceivable that a control device controls the image display mode, wherein this control device or another control device generates the image element. The control device can either be provided as a separate component which is connected to the camera and to the display device, or as a component of the camera or the display device. The control device can in particular be set up to detect the error information and/or the operating information and to control the image display mode as a function thereof. With regard to the error information, it is also particularly conceivable that this information also relates to the presence of a possible malfunction of the control device itself
  • The invention also relates to a motor vehicle comprising a display device for displaying the camera images in the form of an alternating image display and a control device, wherein the control device is set up to control the operation of the display arrangement of the motor vehicle according to the method explained above.
  • The features described for the method according to the invention and the advantages mentioned can accordingly be transferred to the motor vehicle according to the invention.
  • Further advantages and details of the invention will be apparent from the exemplary embodiments described below and with reference to the drawings. Wherein:
  • FIG. 1 schematically shows a top view of the front of an exemplary embodiment of a motor vehicle according to the invention,
  • FIG. 2 schematically shows the image displayed by a display device of the embodiment of the vehicle according to the invention, and
  • FIG. 3 schematically shows the image displayed by a display device of another exemplary embodiment of the motor vehicle according to the invention.
    •
  • FIG. 1 schematically shows a motor vehicle 1 with a display arrangement 2. Here, a camera 3 is provided for the ongoing detection of a motor vehicle environment 4, in particular an environment behind the motor vehicle 1, wherein a display device 6 is provided for displaying the camera images 5 in the form of a changing image display. The display arrangement 2 can also be referred to as a virtual rearview mirror and comprises the camera 3, the display device 6, and a control device 7 of the motor vehicle 1.
  • In addition to the changing image display of the camera images 5 by the display device 6, a continuously changing image element 8 is displayed. If due to a malfunction of the camera 3 and/or the display device 6 and/or another component of the display arrangement, the camera images from the display device 6 are no longer in the form of an alternating image display, but only in the form of a still image comprising a single camera image 5, the image element does not change.
  • A user 9 or driver of the motor vehicle 1 is thus enabled, in the case of a frozen still image displayed by the display device 6, to intuitively and immediately recognize the presence of a malfunction relating to the display arrangement 2 and therefore to be aware that he cannot trust the current display of the virtual rearview mirror or the display arrangement 2. Particularly in the case when the user 9 has already gotten used to the constantly changing image element 8 or the throbber, he can immediately conclude that a non-moving throbber means that the display device 6 is displaying a still image.
  • The image display operation is controlled by the controller 7. For this, the camera 3 transmits the recordings of the motor vehicle environment 4 to the control device 7, wherein the control device 7 in turn transmits the camera images 5 to the display arrangement 2. Although the control device 7 is provided as a separate component in the exemplary embodiment shown, it is conceivable that the control device 7 is alternatively a component of the camera 3 or of the display device 6.
  • The control device 7 is therefore set up in the motor vehicle 1, for example, to detect error information relating to the presence of a malfunction in the camera 3 and/or the display device 6 and/or the control device 7 itself and/or another component of the display arrangement 2. The image element 8 is generated by the control device 7 as a function of the error information.
  • In addition, the control device 7 is set up, although this is not absolutely necessary, to record operational information relating to the operation of the motor vehicle 1, wherein the image element 8 is only displayed when a display condition dependent on the operational information is met. In particular, in the exemplary embodiment shown, the image element 8 is only displayed when the motor vehicle 1 is not driving. In this case, it is clear to the user 9 that the camera images 5 must be displayed by the display device 6 in the form of an alternating image display. If there is a still image while driving, the user 9 intuitively concludes that there must be a malfunction in the display arrangement 2. The display of the image element 8 is unnecessary in this case.
  • FIG. 2 shows the view of the display device 6 from the perspective of a user 9. The entire display area of the display device 6 is filled, for example, by the camera image 5, which represents the rearward motor vehicle environment 4. In the exemplary embodiment shown, the continuously changing image element 8 is, for example, a rotating wheel that overlays the camera image 5. Alternatively, it is conceivable that the constantly changing image element 8 is a bar that changes its geometry or a number that represents an incremental sequence of numbers, or an object that moves and/or changes its color and/or its line width and/or its position in the image displayed by the display device 6.
  • FIG. 3 also shows the view of the display device 6 of another exemplary embodiment of the motor vehicle 1 according to the invention from the perspective of a user 9. In addition to the camera image 5, the display device 6 shows an image segment 10 that contains information from a navigation system 11 of the motor vehicle 1. The data shown by the image segment 10 relating to the navigation system 11 are just exemplary, that is, the image segment 10 can alternatively also contain other information relating to the driving operation of the motor vehicle 1. In the other exemplary embodiment of the motor vehicle 1, the image segment 10 is arranged next to the camera image 5 by way of example, but can also be faded in or embedded in the camera image 5. In this case, the image segment 10 itself can be the constantly changing image element 8. In the exemplary embodiment shown in FIG. 3, the constantly changing image element 8 is a navigation arrow in the image segment 11. As an example, it is envisaged here that the navigation arrow constantly changes its color and pulsates. In addition, although not shown in FIG. 3, it is conceivable that a rotating wheel as shown in FIG. 2 is also displayed in the camera image 5.

Claims (18)

1-10. (canceled)
11. A method for operating a display arrangement of a motor vehicle, wherein a camera continuously captures camera images of a motor vehicle environment and a display device shows the camera images in the form of an alternating image display, wherein an additional, continuously changing image element is shown in or adjacent to the display of alternating images, wherein the image element does not change if a malfunction of the camera and/or the display device and/or another component of the display arrangement results in the display of a still image comprising a single camera image by the display device wherein at least one piece of operating information relating to the operation of the motor vehicle is detected, wherein the image element is only displayed if a display condition dependent on the operating information is met, wherein the operating information relates to the state of motion of the motor vehicle, wherein the display condition is only met when the motor vehicle is not moving.
12. The method according to claim 11, wherein at least one piece of error information relating to the presence of the malfunction of the camera and/or the display device and/or another component of the display arrangement is detected, wherein the image element is generated as a function of the error information.
13. The method according to claim 11, wherein a bar that changes its geometry or a number that represents an incrementing sequence of numbers, or an object which is moving and/or changing its color and/or its line width and/or its position in the image displayed by display device is displayed as the constantly changing image element.
14. The method according to claim 11, wherein the display device displays at least one image segment in addition to the camera image, which segment contains information relating to the driving operation of the motor vehicle.
15. The method according to claim 14, wherein the information relating to the driving operation of the motor vehicle relates to data from a navigation system and/or auxiliary lines of a parking assistance system and/or the current speed of the motor vehicle and/or the current time of day or the distance to a vehicle in front.
16. The method according to claim 14, wherein the constantly changing image element is the image segment or is contained in the image segment.
17. The method according to claim 11, wherein a control device controls the image display mode, wherein said or another control device generates the image element.
18. A motor vehicle, comprising a display arrangement with a camera for continuously capturing a camera image of a motor vehicle environment, a display device for displaying the camera images in the form of an alternating image display, and a control device, wherein the control device is set up to control the operation of the display arrangement of the motor vehicle according to the method according to claim 11.
19. The method according to claim 12, wherein a bar that changes its geometry or a number that represents an incrementing sequence of numbers, or an object which is moving and/or changing its color and/or its line width and/or its position in the image displayed by display device is displayed as the constantly changing image element.
20. The method according to claim 12, wherein the display device displays at least one image segment in addition to the camera image, which segment contains information relating to the driving operation of the motor vehicle.
21. The method according to claim 13, wherein the display device displays at least one image segment in addition to the camera image, which segment contains information relating to the driving operation of the motor vehicle.
22. The method according to claim 14, wherein the constantly changing image element is the image segment or is contained in the image segment.
23. The method according to claim 12, wherein a control device controls the image display mode, wherein said or another control device generates the image element.
24. The method according to claim 13, wherein a control device controls the image display mode, wherein said or another control device generates the image element.
25. The method according to claim 14, wherein a control device controls the image display mode, wherein said or another control device generates the image element.
26. The method according to claim 15, wherein a control device controls the image display mode, wherein said or another control device generates the image element.
27. The method according to claim 16, wherein a control device controls the image display mode, wherein said or another control device generates the image element.
US17/253,801 2018-08-06 2019-06-03 Method for operating a display arrangement of a motor vehicle, and motor vehicle Active US11097661B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102018213082.5A DE102018213082B3 (en) 2018-08-06 2018-08-06 Method for operating a display arrangement of a motor vehicle, motor vehicle
DE102018213082.5 2018-08-06
PCT/EP2019/064339 WO2020030318A1 (en) 2018-08-06 2019-06-03 Method for operating a display arrangement of a motor vehicle, and motor vehicle

Publications (2)

Publication Number Publication Date
US11097661B1 US11097661B1 (en) 2021-08-24
US20210261055A1 true US20210261055A1 (en) 2021-08-26

Family

ID=66770470

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/253,801 Active US11097661B1 (en) 2018-08-06 2019-06-03 Method for operating a display arrangement of a motor vehicle, and motor vehicle

Country Status (4)

Country Link
US (1) US11097661B1 (en)
CN (1) CN112512865B (en)
DE (1) DE102018213082B3 (en)
WO (1) WO2020030318A1 (en)

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006010480A1 (en) * 2006-03-07 2007-09-13 Robert Bosch Gmbh Method and arrangement for displaying a digital map section
DE102008034160A1 (en) * 2008-07-22 2010-03-18 Siemens Aktiengesellschaft Device for monitoring a spatial area, in particular in the environment or inside a vehicle
US20130265431A1 (en) * 2009-02-19 2013-10-10 Denso Corporation Outside view monitor system for vehicle
DE102009023435A1 (en) 2009-05-29 2010-01-14 Daimler Ag Camera system i.e. rearward-facing camera system, reproducing condition detecting method for e.g. lorry, involves displaying image flow with coupled control graphics e.g. Mercedes-star, in screen of camera system
JP2011117738A (en) * 2009-11-30 2011-06-16 Fujitsu Ten Ltd Device and program for diagnosing fault, and fault data collection device
NL2008475C2 (en) * 2012-03-13 2013-09-16 Expl Mij De Berghaaf B V DEVICE FOR CHECKING THE ACTIVITY OF A VISUAL OBSERVATION SYSTEM.
DE102013214698A1 (en) * 2013-07-26 2015-01-29 Bayerische Motoren Werke Aktiengesellschaft Activating the display of image information in a motor vehicle with a parking assistance system
DE102014106035A1 (en) 2014-04-30 2015-11-05 Connaught Electronics Ltd. Method for operating a driver assistance system with an electronic rearview mirror, driver assistance system and motor vehicle
US10000154B2 (en) 2014-08-07 2018-06-19 Ford Global Technologies, Llc Vehicle camera system having live video indication
DE102014016579B4 (en) * 2014-11-08 2019-06-19 Audi Ag Method for operating a driver assistance system after an accident and a motor vehicle
JP6421566B2 (en) * 2014-11-28 2018-11-14 株式会社デンソー Display device
DE102014119091A1 (en) * 2014-12-18 2016-06-23 Connaught Electronics Ltd. Method for optical representation of a functional state of a display device, driver assistance system and motor vehicle
JP6507660B2 (en) * 2015-01-15 2019-05-08 株式会社デンソー Vision support device
US10395541B2 (en) 2015-01-16 2019-08-27 Texas Instruments Incorporated Integrated fault-tolerant augmented area viewing system
US9955150B2 (en) * 2015-09-24 2018-04-24 Qualcomm Incorporated Testing of display subsystems
JP6459954B2 (en) * 2015-12-24 2019-01-30 株式会社デンソー Video transmission device mounted on vehicle, video reception device mounted on vehicle, and video communication system mounted on vehicle
JP2018056950A (en) * 2016-09-30 2018-04-05 パナソニックＩｐマネジメント株式会社 On-vehicle video image display system, on-vehicle video image display method, and program
JP6707476B2 (en) * 2017-01-26 2020-06-10 アルパイン株式会社 Display control device and display image freeze notification method

Also Published As

Publication number Publication date
WO2020030318A1 (en) 2020-02-13
DE102018213082B3 (en) 2019-08-08
CN112512865A (en) 2021-03-16
US11097661B1 (en) 2021-08-24
CN112512865B (en) 2024-05-17

Similar Documents

Publication Publication Date Title
US8045003B2 (en) Onboard display device, vehicle, display method, image display program and recording medium
EP1783035B1 (en) Parking assist method and a parking assist apparatus
JP4900232B2 (en) Vehicle parking assist device and video display method
JP5099451B2 (en) Vehicle periphery confirmation device
US8412413B1 (en) Vehicle windshield display with obstruction detection
EP2540578B1 (en) Parking assistance device
WO2013055513A1 (en) Virtual display system for a vehicle
WO2013015021A1 (en) Driving assistance apparatus for vehicle
US10991086B2 (en) Adhered substance detection apparatus
US11124117B2 (en) Imaging device, display system, and display method
US20190096359A1 (en) Display control device, display device, in-vehicle display system, and display control method
US20170297489A1 (en) Method and System for Representing Vehicle Surroundings of a Motor Vehicle on a Display Device Located in the Motor Vehicle
CN104396235A (en) Image monitoring device, mobile body, program, and failure determination method
JP5127063B2 (en) Display unit drive method for movable meter
WO2015182080A1 (en) In-vehicle display device, in-vehicle display device control method, and program
JP2005294878A (en) Video display device for vehicle environment monitoring unit
US11097661B1 (en) Method for operating a display arrangement of a motor vehicle, and motor vehicle
EP3296166A1 (en) Vehicular visual recognition device
CN109690559A (en) For providing the device of vehicle environmental information
JP5076819B2 (en) Vehicle driving support device and vehicle driving support method
JP6552285B2 (en) In-vehicle display device and vehicle rear image display method
JP6154193B2 (en) Display device
KR20190061693A (en) Integrated monitoring device of autonomous vehicle and method thereof
JP2017194929A (en) Display device
US20160335891A1 (en) Vehicle speed limit display device

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE