CN112937443A - Device and method for assisting the visualization of a surrounding environment by a vehicle driver - Google Patents

Device and method for assisting the visualization of a surrounding environment by a vehicle driver Download PDF

Info

Publication number
CN112937443A
CN112937443A CN202011431779.4A CN202011431779A CN112937443A CN 112937443 A CN112937443 A CN 112937443A CN 202011431779 A CN202011431779 A CN 202011431779A CN 112937443 A CN112937443 A CN 112937443A
Authority
CN
China
Prior art keywords
signal
driver
mirror
vehicle speed
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011431779.4A
Other languages
Chinese (zh)
Inventor
C·圭兰达
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZF Friedrichshafen AG
Original Assignee
ZF Friedrichshafen AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZF Friedrichshafen AG filed Critical ZF Friedrichshafen AG
Publication of CN112937443A publication Critical patent/CN112937443A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/10—Front-view mirror arrangements; Periscope arrangements, i.e. optical devices using combinations of mirrors, lenses, prisms or the like ; Other mirror arrangements giving a view from above or under the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • B60R2001/1253—Mirror assemblies combined with other articles, e.g. clocks with cameras, video cameras or video screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/302—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/70—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by an event-triggered choice to display a specific image among a selection of captured images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8066—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring rearward traffic
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8073—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for vehicle security, e.g. parked vehicle surveillance, burglar detection
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)

Abstract

A method for assisting a driver of a vehicle in visualizing a surrounding environment, comprising: a mirror image signal corresponding to the field of view of a conventional driving mirror is generated. A surrounding image signal corresponding to a field of view of a surrounding environment in the vicinity of the vehicle is generated. A vehicle speed signal is generated. The vehicle mirror image signal, the ambient image signal and the vehicle speed signal are received and at least one of a driver vehicle mirror signal and a driver ambient signal is generated in response. Selectively displaying a video image corresponding to at least one of the driver's vehicle mirror signal and the driver's surroundings signal to the driver. In response to the vehicle speed signal, a frame rate of at least one of the vehicle mirror image signal and the ambient image signal is adjusted by a signal processor. A driver assistance system is also provided.

Description

Device and method for assisting the visualization of a surrounding environment by a vehicle driver
Technical Field
The present disclosure relates to an apparatus and method for assisting a driver of a vehicle in visualizing a surrounding environment, and more particularly to a method and apparatus for visual signal processing to achieve a desired resource allocation.
Background
Vehicle driver assistance systems are known that use cameras to monitor the environment surrounding the vehicle. Driver assistance systems may assist a driver in operating a motor vehicle by providing operational information such as potential collisions, lane or road deviations, pedestrian location, road marking information, and the like. Data from the driver assistance system is provided to other vehicle systems to provide warnings, haptic or tactile feedback to the driver, and/or autonomous control of the vehicle.
Driver assistance systems in vehicles may include a camera that acquires information and provides the acquired information to vehicle safety systems designed to assist the driver. The camera may be mounted in any desired location in the vehicle, on the vehicle, or elsewhere associated with the vehicle, such as on a vehicle windshield to ensure a desired field of view. The camera includes a lens. An image sensor on a Printed Circuit Board (PCB) senses an image acquired by the lens.
The driver assistance system may comprise a plurality of cameras each for a specific purpose. For example, one camera may provide a view similar to that of currently known rear or side mirrors, while the other camera provides a view that is generally not readily perceptible to the driver (e.g., looking down to a laterally adjacent curb during parallel parking). However, the video signal from each camera must be received, processed and displayed to the driver at the expense of additional signal management time, power and bandwidth for each camera.
Disclosure of Invention
In one aspect, a method for assisting a driver of a vehicle in visualizing a surrounding environment is described. The method comprises the following steps: a mirror image signal corresponding to the field of view of a conventional driving mirror is generated. A surrounding image signal corresponding to a field of view of a surrounding environment in the vicinity of the vehicle is generated. A vehicle speed signal is generated. The vehicle mirror image signal, the ambient image signal and the vehicle speed signal are received and at least one of a driver vehicle mirror signal and a driver ambient signal is generated in response. Selectively displaying a video image corresponding to at least one of the driver's vehicle mirror signal and the driver's surroundings signal to the driver. In response to the vehicle speed signal, a frame rate of at least one of the vehicle mirror image signal and the ambient image signal is adjusted by a signal processor.
In one aspect, a driver assistance system is described. A mirror camera is provided for generating a mirror image signal corresponding to the field of view of a conventional driving mirror. A periphery camera is provided for generating a periphery image signal corresponding to a field of view of a periphery environment in the vicinity of the vehicle. The vehicle speed indicator generates a vehicle speed signal. A signal processor receives the vehicle mirror image signal, the ambient image signal and the vehicle speed signal and responsively generates at least one of a driver vehicle mirror signal and a driver ambient signal. A driver perceptible display selectively displays to the driver a video image corresponding to at least one of the driver mirror signal and the driver ambient signal. In response to the vehicle speed signal, a frame rate of at least one of the vehicle mirror image signal and the ambient image signal is adjusted by a signal processor.
Drawings
For a better understanding, reference may be made to the accompanying drawings in which:
FIG. 1 is a schematic illustration of a driver assistance system according to an exemplary aspect of the present disclosure; and
fig. 2 is a schematic graph of vehicle speed versus frame rate in an example embodiment of the aspect of fig. 1.
Detailed Description
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.
As used herein, the singular forms "a", "an" and "the" may include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used herein, may specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof.
As used herein, the term "and/or" may include any and all combinations of one or more of the associated listed items.
It will be understood that for ease of discussion, the following uses "deceleration"/"acceleration" or "decrease"/"increase" speed, but it will be understood that such time-related terms are relative and that a person of ordinary skill in the art will understand how to adjust the present system for various speed, acceleration, and deceleration conditions.
As used herein, the phrase "at least one of X and Y" may be interpreted to include X, Y or a combination of X and Y. For example, if an element is described as having at least one of X and Y, that element may include X, Y or a combination of X and Y at a particular time, the choice of which may vary from time to time. In contrast, the phrase "at least one of X" can be interpreted to include one or more X.
It will be understood that, although the terms first, second, etc. may be used herein to describe various elements and acts, these elements and acts should not be limited by these terms. These terms are only used to distinguish one element or action from another element or action. For example, a "first" element discussed below could also be termed a "second" element without departing from the teachings of the present disclosure. The sequence of operations (or steps) is not limited to the order presented in the claims or figures unless specifically indicated otherwise.
The invention includes, consists of, or consists essentially of the following features in any combination.
Fig. 1 schematically depicts a driver assistance system 100 comprising at least one mirror camera 102 for generating a mirror image signal MS corresponding to the field of view of a conventional driving rear view mirror. At least one ambience camera 104 of the driver assistance system 100 is provided for generating an ambience image signal SS corresponding to a field of view of an ambience near the vehicle (schematically shown at 106). A vehicle speed indicator 108 is provided for generating a vehicle speed signal VS. A signal processor 110 is provided for receiving the mirror image signal MS, the ambient image signal SS and the vehicle speed signal VS and responsively generating at least one of a driver mirror signal DMS and a driver ambient signal DSS.
A driver perceptible display 112 is provided at any desired location with respect to the vehicle and the driver for selectively displaying to the driver DSS a video image corresponding to at least one of the driver's vehicle mirror signals DMS and the driver's surroundings signals. Driver perceptible display 112 may include, for example, a vehicle mirror video display 114 for displaying a driver vehicle mirror signal DMS and a separate ambient video display 116 for displaying a driver ambient signal DSS. Typically, the mirror video display 114 is active throughout the movement of the vehicle 106 (and typically during a brief non-moving portion of the trip, such as at a stop sign). This is because the mirror video display 114 replaces one or more conventional driver rear and/or side view mirrors.
In contrast, the ambient video display 116 is typically only enabled at relatively low vehicle speeds (such as, but not limited to, a parking operation or a reverse operation when it is desired to see how close the vehicle is to a curb or wall). This is because, in addition to providing little/no useful information to the driver, the driver may be distracted or disoriented by seeing peripheral highway swishing during high speed driving.
Electronic Mirror replacement ("E-Mirror") type vehicular Mirror video displays 114 consume a significant amount of the system's video bandwidth due to the increased camera resolution and frame rate required to meet current vehicle regulations in many jurisdictions. For example, an E-Mirror system may use three (3) 60 frames per second (fps) 2.3 megapixel ("MP") car Mirror cameras 102. Processing such video information for a mirror system would require 2300000 pixels x 24 bits per pixel x 60 frames per second-9.94 gigabits per second (Gbps) for one (1) image signal processor 110 ("ISP") to generate the driver mirror signal DMS, which for the ISP is a large amount of data to process. For example, the ambient camera 104 system may include four (4) 1.2MP cameras at 30 fps. The video information of the surrounding system is 1200000 pixels × 24 bits per pixel × 30fps, which is 3.46 Gbps. One signal processor 110 would need to have a capacity of up to 13.4Gbps to process both the ambient video input and the mirror video input simultaneously. A processing video chip can hardly achieve this. In some systems, both the video input bandwidth and ISP processing bandwidth may need to be calculated, further increasing the computational load. However, the two-chip approach is expensive to implement in terms of both material and power consumption. Accordingly, the present driver assistance system 100 includes a signal processor 110 that adjusts a frame rate of at least one of the vehicle mirror image signal MS and the surrounding image signal SS in response to the vehicle speed signal VS.
More specifically, and as schematically illustrated in fig. 2, the frame rate of at least one of the mirror image signal MS and the ambient image signal SS may be reduced from an initial value by the signal processor 110 and the corresponding at least one of the mirror camera 102 or the ambient camera 104 in response to the vehicle speed signal VS indicating a reduced vehicle speed from the initial value. As an example, and referring again to fig. 2, as the vehicle speed decreases, the frame rate of the mirror image signal MS may be decreased from an initial value by the signal processor 110 in response to the vehicle speed signal VS indicating a vehicle speed that decreases from the initial value, while the frame rate of the ambient image signal SS is maintained at and/or increased from the initial value.
In most usage environments, it is desirable for the mirror image signal MS during highway speeds to have a high frame rate to reduce latency and allow the driver to experience an "E-mirror" mirror video display 114 that approximates a real-time view of a conventional mirror. At these same highway speeds, the ambient video display 116 may not be enabled to avoid unnecessarily distracting the driver. This is the case in fig. 2 at dashed line "a". Then, when the vehicle decelerates to, for example, a street speed or a parking lot speed, the frame rate of the mirror image signal MS may be reduced because the influence of the waiting time at a lower speed is not as great as that at a higher speed. The ambient image signal SS will be active at these lower speeds to provide the driver with an image of the surrounding conditions to assist in, for example, parking operations and/or reversing operations. This is the case in fig. 2 at dashed line "B". Due to this speed-dependent frame rate, less overall load is placed on the signal processor 110, which may allow the driver assistance system 100 to provide a desired image feed with fewer and/or less powerful image processing chips than the two-chip example given above.
For example, in the aforementioned system, for speeds below about 18KMH (about 11MPH) or at any other desired threshold speed (e.g., about 30KMH or about 18MPH), the frame rate of the mirror camera 102 may be reduced from 60fps to 30fps when latency is less important. The reduction in frame rate will allow the signal processor 110 to process both the E-Mirror view and the surrounding view at a lower speed, ultimately reducing the need for two image processing chips. The method can reduce the component cost in advance and reduce the system power consumption along with the time.
In some embodiments, the signal processor 110 may generate only selected ones of the driver vehicle mirror signal DMS and the driver ambient signal DSS in response to the vehicle speed signal VS. For example, the signal processor 110 may generate only selected ones of the driver vehicle mirror signal DMS and the driver surroundings signal DSS in response to the vehicle speed signal VS indicating highway driving, and may generate only the other one of the driver vehicle mirror signal DMS and the driver surroundings signal DSS in response to the vehicle speed signal VS indicating ground street driving. Alternatively, when the vehicle speed signal VS indicates a ground street driving and/or parking situation, the signal processor 110 may generate both the driver vehicle mirror signal DMS and the driver ambient signal DSS, but at least one of these signals has a frame rate lower than that of the signals generated during highway driving.
The signal processor 110 may control actuation of selected ones of the mirror camera 102 and the periphery camera 104 in response to the vehicle speed signal VS. For example, the signal processor 110 may deactivate the perimeter cameras 104 in response to the vehicle speed signal VS being above a predetermined value. However, it is contemplated that the mirror camera 102 and/or the ambient camera 104 may also or alternatively be enabled and provide the mirror image signal MS and the ambient image signal SS, respectively, to the signal processor 110 at substantially all times during vehicle operation, and that the signal processor 110 merely ignores or ignores signal streams from either of the mirror camera 102 and the ambient camera 104 that are not relevant to traveling at a given speed.
Fig. 2 shows that the vehicle mirror image signal MS and the surrounding image signal SS change the frame rate stepwise and "mirror" at a certain speed. However, it is contemplated that the frame rate changes of the mirror image signal MS and/or the ambient image signal SS may occur more gradually over time and/or may be asymmetric as desired for a particular use environment (e.g., in response to a rate of change of vehicle speed). One of ordinary skill in the art may readily provide a predetermined frame rate change "curve" or "chart" for a particular use environment, such as that shown in fig. 2, and it is contemplated that multiple such charts may be provided for different instances of a single driver assistance system 100.
Accordingly, a method for assisting a driver of a vehicle 106 in visualizing a surrounding environment may comprise: a mirror image signal MS corresponding to the field of view of a conventional driving mirror is generated (e.g., using the mirror camera 102). A surrounding image signal SS corresponding to the field of view of the surrounding environment in the vicinity of the vehicle 106 is generated. This may be a downward view showing a curb near the passenger side of the vehicle to assist in parallel parking, for example. A vehicle speed signal VS is also generated.
The vehicle mirror image signal MS, the ambient image signal SS and the vehicle speed signal VS are all received (e.g., by the signal processor 110) and at least one of the driver vehicle mirror signal DMS and the driver ambient signal DSS is generated in response. The driver is selectively displayed with a video image corresponding to at least one of the driver's vehicle mirror signal DMS and the driver's surrounding signal DSS. The frame rate of at least one of the mirror image signal MS and the ambient image signal SS is adjusted by the signal processor 110 in response to the vehicle speed signal VS.
The frame rate adjustment may include: reducing, by the signal processor 110, a frame rate of a selected one of the mirror image signal MS and the ambient image signal SS from an initial value in response to the vehicle speed signal VS indicating a vehicle speed reduced from the initial value; and/or increasing the frame rate of the other of the mirror image signal MS and the surrounding image signal SS from an initial value by the signal processor 110.
The driver mirror signal DMS may be displayed via a mirror video display 114 and/or any other component of the driver perceptible display 112. The driver ambient signal DSS may be displayed via an ambient video display 116 separate from the mirror video display 114 and/or any other component of the driver perceptible display 112. As shown in fig. 2, the perimeter cameras 104 may be deactivated in response to the vehicle speed signal VS being above a predetermined value.
While aspects of the present disclosure have been particularly shown and described with reference to the example aspects above, those of ordinary skill in the art will understand that various other aspects may be contemplated. For example, the particular methods described above for using the apparatus are merely illustrative; one of ordinary skill in the art may readily determine any number of tools, sequences of steps, or other means/options for placing the above-described apparatus or components thereof in a position substantially similar to that shown and described herein. The "predetermined" state may be determined at any time before the structure being manipulated actually reaches that state, the "predetermined" being reached at the latest just before the structure reaches that predetermined state. The term "substantially" as used herein refers to a substantial but not necessarily all amount, which means that the amount specified-a "substantial" amount, is allowed to include somewhat less than the non-quantitative term. Although certain components described herein are shown as having a particular geometry, all structures of the present disclosure may have any suitable shape, size, configuration, relative relationship, cross-sectional area, or any other physical characteristic as desired for a particular application. Any structure or feature described with reference to one aspect or configuration may be provided to any other aspect or configuration, alone or in combination with other structures or features, as it would not be practical to describe each aspect and configuration discussed herein as having all the options discussed with respect to all other aspects and configurations. An apparatus or method incorporating any of these features should be understood to fall within the scope of the present disclosure as determined in accordance with the appended claims and any equivalents thereof.
Other aspects, objects, and advantages can be obtained from a study of the drawings, the disclosure, and the appended claims.

Claims (16)

1. A method for assisting a driver of a vehicle in visualizing a surrounding environment, the method comprising:
generating a vehicle mirror image signal corresponding to the visual field of the traditional driving rearview mirror;
generating a surrounding image signal corresponding to a field of view of a surrounding environment in the vicinity of the vehicle;
generating a vehicle speed signal;
receiving the vehicle mirror image signal, the ambient image signal and the vehicle speed signal and responsively generating at least one of a driver vehicle mirror signal and a driver ambient signal;
selectively displaying a video image corresponding to at least one of the driver's vehicle mirror signal and the driver's surroundings signal to the driver; and
adjusting, by a signal processor, a frame rate of at least one of the vehicle mirror image signal and the ambient image signal in response to the vehicle speed signal.
2. The method of claim 1, comprising: in response to the vehicle speed signal indicating a vehicle speed decreased from an initial value, decreasing, by the signal processor, the frame rate of at least one of the mirror image signal and the surrounding image signal from an initial value.
3. The method of claim 2, comprising: in response to the vehicle speed signal indicating a vehicle speed that is reduced from an initial value, reducing, by the signal processor, the frame rate of the mirror image signal from an initial value while the frame rate of the surrounding image signal is at least one of maintained at and increased from an initial value.
4. The method of claim 1, comprising: only selected ones of the driver's mirror signal and the driver's ambient signal are generated in response to the vehicle speed signal.
5. The method of claim 4, comprising:
generating only the selected one of the driver's mirror signal and the driver's ambient signal in response to the vehicle speed signal indicative of highway driving, an
Generating only the other of the driver's mirror signal and the driver's ambient signal in response to the vehicle speed signal indicating driving for a ground street.
6. The method of claim 1, comprising:
displaying the driver's mirror signal via a mirror video display, an
Displaying the driver ambient signals via an ambient video display separate from the mirror video display.
7. The method of claim 1, comprising: controlling actuation of selected ones of a mirror camera and a perimeter camera in response to the vehicle speed signal.
8. The method of claim 7, comprising: deactivating the perimeter camera in response to the vehicle speed signal being above a predetermined value.
9. A driver assistance system comprising:
a mirror camera for generating a mirror image signal corresponding to a field of view of a conventional driving rearview mirror;
a periphery camera for generating a periphery image signal corresponding to a field of view of a periphery environment in the vicinity of the vehicle;
a vehicle speed indicator for generating a vehicle speed signal;
a signal processor for receiving the vehicle mirror image signal, the ambient image signal and the vehicle speed signal and responsively generating at least one of a driver vehicle mirror signal and a driver ambient signal; and
a driver perceptible display for selectively displaying to the driver a video image corresponding to at least one of the driver mirror signal and the driver ambient signal;
wherein a frame rate of at least one of the vehicle mirror image signal and the ambient image signal is adjusted by the signal processor in response to the vehicle speed signal.
10. The driver assistance system according to claim 9, wherein the frame rate of at least one of the mirror image signal and the surrounding image signal is reduced from an initial value by the signal processor in response to the vehicle speed signal being indicative of a vehicle speed reduced from an initial value.
11. The driver assistance system according to claim 10, wherein the frame rate of the mirror image signal is reduced from an initial value by the signal processor in response to the vehicle speed signal being indicative of a vehicle speed reduced from an initial value while the frame rate of the surrounding image signal is at least one of maintained at and increased from an initial value.
12. The driver assistance system of claim 9, wherein the signal processor generates only selected ones of a driver mirror signal and a driver ambient signal in response to the vehicle speed signal.
13. The driver assistance system of claim 12, wherein the signal processor generates only the selected one of the driver's mirror signal and the driver's ambient signal in response to the vehicle speed signal indicating highway driving, and generates only the other one of the driver's mirror signal and the driver's ambient signal in response to the vehicle speed signal indicating ground street driving.
14. The driver assistance system of claim 9, wherein the driver perceivable display includes a mirror video display for displaying the driver mirror signal and a separate ambient video display for displaying the driver ambient signal.
15. The driver assistance system of claim 9, wherein the signal processor controls actuation of selected ones of the mirror camera and the periphery camera in response to the vehicle speed signal.
16. The driver assistance system of claim 15, wherein the signal processor deactivates the periphery camera in response to the vehicle speed signal being above a predetermined value.
CN202011431779.4A 2019-12-10 2020-12-09 Device and method for assisting the visualization of a surrounding environment by a vehicle driver Pending CN112937443A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/708,480 2019-12-10
US16/708,480 US11541813B2 (en) 2019-12-10 2019-12-10 Apparatus and method for assisting a driver of a vehicle with visualization of an ambient environment

Publications (1)

Publication Number Publication Date
CN112937443A true CN112937443A (en) 2021-06-11

Family

ID=75962628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011431779.4A Pending CN112937443A (en) 2019-12-10 2020-12-09 Device and method for assisting the visualization of a surrounding environment by a vehicle driver

Country Status (3)

Country Link
US (2) US11541813B2 (en)
CN (1) CN112937443A (en)
DE (1) DE102020215180A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220185182A1 (en) * 2020-12-15 2022-06-16 Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America Target identification for vehicle see-through applications

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB201515527D0 (en) * 2015-09-02 2015-10-14 Jaguar Land Rover Ltd Vehicle imaging system and method
US10882398B2 (en) * 2019-02-13 2021-01-05 Xevo Inc. System and method for correlating user attention direction and outside view

Also Published As

Publication number Publication date
DE102020215180A1 (en) 2021-06-10
US20210170949A1 (en) 2021-06-10
US11541813B2 (en) 2023-01-03
US20230073601A1 (en) 2023-03-09

Similar Documents

Publication Publication Date Title
US11052823B2 (en) Vehicle rear monitoring system
US9620009B2 (en) Vehicle surroundings monitoring device
EP2687408B1 (en) Vehicle periphery monitoring device
WO2016178190A1 (en) Vehicle vision system with blind zone display and alert system
WO2012169029A1 (en) Lane departure avoidance assistance device, separator display method, and program
EP3383690B1 (en) Responsive human machine interface
US9758099B2 (en) Display system and method thereof
JP7327393B2 (en) vehicle display
KR20170142939A (en) Mirror replacement system for a vehicle
EP3717954A1 (en) Method for displaying the course of a trajectory in front of a vehicle or an object by means of a display unit, and device for carrying out the method
JP2004323005A (en) Method for depicting various image data on vehicle display device
US20230073601A1 (en) Apparatus and method for assisting a driver of a vehicle with visualization of an ambient environment
US10594934B2 (en) Vehicle display
JP6597282B2 (en) Vehicle display device
EP3582493B1 (en) In-vehicle image display system and image processing method
JP2006264574A (en) Car-mounted camera and car-mounted camera system
JP6573218B2 (en) VEHICLE IMAGE DISPLAY DEVICE AND SETTING METHOD
JP2022149734A (en) Vehicle control device, vehicle, vehicle control device operation method, and program
JP5157845B2 (en) Visual assistance device
CN112544066A (en) Image processing apparatus
EP4287146A1 (en) Monitoring system and method for monitoring
WO2010123403A2 (en) Virtual marker for a vehicle tv vision system
JP2012237725A (en) Display device for vehicle
JP7063086B2 (en) Vehicle display control device
DE102020122977A1 (en) Driver assistance system and driver assistance method for a vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination