GB2417847A

GB2417847A - Vehicle blind spot viewing system

Info

Publication number: GB2417847A
Application number: GB0419747A
Authority: GB
Inventors: Robert Mullins
Original assignee: ELAN HOUSE Ltd
Current assignee: ELAN HOUSE Ltd
Priority date: 2004-09-06
Filing date: 2004-09-06
Publication date: 2006-03-08
Also published as: GB0419747D0

Abstract

Cameras 20, 22, 24 are mounted in structural features of a vehicle 10 such pillars or frames A, B to capture the driver's view that would be obstructed by these features. The images are displayed on displays mounted on the internal surfaces of the structures so that the overall view as seen by the driver would be that as if the elements were transparent. The displays can be shaped to match that of the structural element and the images can be processed by stretching or contracting to suit this shape. The display may be made from flexible display technology such as light-emitting polymer (LEP), light-emitting diode (LED) or from clear cathode liquid crystal displays (LCD). A further embodiment discloses a system to display the view from the rear of the vehicle on the rear view mirror.

Description

1 241 7847 View enhancing system for a vehicle The present invention

relates to a view enhancing system for a vehicle.

Vehicles, in particular those with enclosed passenger / driver cabins (for example cars), typically have structural features such as pillars or uprights which obstruct the vehicle driver's view from the vehicle. Although modern vehicle design attempts to minimise the visual obstruction caused by such structural features, these attempts are limited by structural and safety considerations. The driver's field of view is therefore generally incomplete, to the detriment of driver and passenger safety.

Though rear view mirrors are provided on most vehicles to provide an improved view towards the rear of the vehicle, these only provide a limited field of vision which is still affected by the presence of obstructive structural elements as well as by passengers and objects inside the vehicle.

The present invention seeks to alleviate some of these problems.

Accordingly, in a first aspect of the invention, there is provided a view enhancing system for a vehicle having a structural element which in normal operation tends to obstruct a vehicle operator's view, comprising: a camera adapted to form an image of a region of the vehicle surroundings where the operator's view is obstructed by the structural element; and display means connected with the camera and mounted on the structural element for displaying an image representing the view that would be seen by the operator if the structural element were transparent or not present.

In this way, the vehicle operator's view can be enhanced, which can lead to greater visual and situational awareness and improved safety.

Preferably, the vehicle operator has a field of view centred around a horizontal plane substantially at eye level, and the structural element obstructs a portion of the view in that plane. The display means preferably covers substantially the entire operator-facing portion of the structural element in that plane, that is to say substantially the entire portion of the structural element in that plane which is visible to the operator. In this way, a substantially seamless or continuous view may be provided.

The structural element may, for example, be a pillar, in which case the display means preferably covers substantially the entire width of the pillar as - 2 seen by the operator. The vehicle preferably has a plurality of pillars for supporting a roof; and the system preferably comprises respective cameras and display means provided on at least two such pillars, preferably on two pillars provided either side of the vehicle's front windscreen. This can enhance the driver's main forward view. The system may of course be applied to cabriolet-type cars or other vehicles which do not have a roof but which nevertheless have pillars or obstructive structures.

The display means preferably comprises a flexible display screen (such as a flexible OLED (Organic Light Emitting Diode) screen), and is preferably shaped so as to approximately follow the contours of the structural element.

The system preferably comprises means for processing the image in accordance with the shape of the display, which preferably adapts the image to the display shape or contours. This can further enhance the illusion that the structural element is, in effect, transparent, and can provide a more accurate view of the vehicle surroundings.

In a further aspect of the invention, there is provided a rear view display system for a vehicle having a rear view mirror, comprising: at least one camera mounted on the outside of the vehicle adapted to receive an image of a rear view from the vehicle; and means for displaying the image received by the at least one camera on the rear view mirror. In this way, an enhanced rear view display can be provided which is not obstructed by the obstructions commonly visible in a conventional rear view mirror, such as structural elements or other objects in the vehicle interior.

The displaying means preferably comprises a display screen integrated into the rear view mirror. Preferably, the rear view mirror comprises a mirror display having a reflective layer and a display layer, and the display layer is preferably adapted to be substantially transparent when switched off or inactive so as to enable the mirror display to function as a conventional mirror.

In this way, a fail-safe system can be provided which functions as a conventional mirror if there is a failure in the display system.

Preferred features of the present invention will now be described, purely by way of example, with reference to the accompanying drawings, in which: Figure 1 is a top-down schematic view of a car; - 3 Figure 2 is a schematic cross-sectional view of a pillar; and Figure 3 is a block diagram of a view enhancing system.

The view enhancing system described herein comprises two main parts: a series of displays provided on those structural elements (such as pillars) which ordinarily obstruct the driver's view, and a rear view display system for providing an enhanced rear view display in place of the conventional rear view mirror. The system can allow the vehicle driver to have total, unobstructed vision all around the vehicle - essentially as if the uprights and pillars and other obstructions were transparent.

The first part of the system uses cameras and/or sensors facing outwards from the vehicle, the images from which are displayed on a number of displays visible to the driver. The displays are embedded in or attached to the obstructive structures (pillars, uprights, etc.) in the vehicle so that the driver can use the displays to get a clear view of the road and surroundings. In this way, driving safety can be improved by enhancing visual perception, as otherwise obstructed areas now become part of the total viewing area for the driver.

The second part of the system uses a mirror display in place of the conventional rear view mirror. The mirror display displays a rear view from the vehicle obtained by one or more cameras mounted at the rear of the vehicle.

Since the cameras are mounted on the outside of the vehicle, the image displayed is free from obstructions, further enhancing the driver's visual perception and situational awareness.

Figure 1 is a top-down schematic view of a car 10. Cars are commonly designed with three main sets of pillars for supporting the roof: A pair of "A"- pillars either side of the windscreen, a pair of "B"-pillars between the side windows and a pair of "C"-pillars at the rear of the vehicle.

The driver's view out of the front of the car is typically obstructed mainly by the "A"-pillars. To see out of the back of the car, rather than turning around, the driver usually makes use of a combination of rear view mirrors: a wing mirror 12 on either side of the vehicle and a central rear view mirror 14 mounted inside the car under the roof. The central rear view mirror 14 provides a view of the traffic behind the vehicle, though the view reflected usually also includes the "C"-pillars and any other obstructions (such as - 4 passengers, and luggage or other objects placed in front of the rear window).

Both the driver's front view as well as the view presented by the rear view mirror are therefore incomplete.

The view enhancing system comprises a series of cameras 20, 22, 24 which are mounted, preferably recessed, on each view-obstructing pillar facing outwards (cameras are provided on the pillars on both sides of the vehicle, though for clarity, only those on one side are labelled with reference numerals). Each camera is oriented so as to capture the portion of the surroundings which is obstructed by the pillar to which it is mounted, when seen from the perspective of the driver. Six cameras are provided in the present example (one in each pillar), though a different number may be used.

Alternatively, cameras may be located on the roof or in the wing mirrors.

The cameras are CCD or CMOS sensor devices, though any suitable image gathering devices can be used. The cameras typically provide resolutions of around 640x480 or higher, though lower resolution devices can also be used.

Cameras can be fixed or auto-focus and have an automatically adjusted iris for night / daytime operation.

Inside the vehicle, a display is provided on each view-obstructing pillar.

Each display receives the image from the camera mounted on the outside of the respective pillar and displays it, thereby enabling the driver to see the portion of the surroundings obstructed by the pillar as if the pillar were transparent.

Figure 2 shows, by way of example, a schematic cross-sectional view of an "A" pillar.

The "A" pillar is located between front windscreen 26 and side window 28. Recessed into the pillar is a camera 20 for forming an image of the portion of the view obstructed by the pillar. A display 52 is provided on the inside surface of the pillar. The display 52 faces the vehicle driver and receives the image of the obstructed portion of the view from camera 20.

The display may be a flat display of suitable dimensions fixed to or recessed into the pillar, such as an LCD / TFT display.

However, in preferred embodiments, the display is provided in the form of a shaped and/or flexible display which is attached to the pillar, and which is - 5 shaped so as to at least approximately follow the contours of the pillar. In the example of Figure 2, the screen 52 is of a convex shape, though, depending on the shape of the pillar, concave or more complex screen shapes may be used. The display covers substantially the entire width of the pillar as seen by the driver, so that the driver is provided with a continuous view in which the pillar display completes the view between adjacent windows as seamlessly as possible.

Curved microglass may be used to provide a rigid, shaped screen which is formed to fit the shape of the pillar. Alternatively, flexible display technology may be used to provide the shaped screen for the pillar displays.

Various flexible screen technologies can be used, including LEP (lightemitting polymer) / OLEP (organic light-emitting polymer) / LED (light emitting diode) / OLED (organic light emitting diode) / PolyOLED (polymer OLED) based displays, typically on flexible plastic substrates, as well as flexible LCD screens. Preferred examples use small molecule or polymer OLED based screens due to their comparatively low power consumption.

The displays are preferably designed to blend into the vehicle's interior design, for example by having a similar appearance to the surface material of the pillars, when inactive.

Figure 3 shows a block diagram of the view enhancement system.

Cameras 20, 22, 24 are connected to a video processing module 40.

The signals from the cameras are encoded into a suitable format by video encoding hardware (not shown) or software executed by the video processing module. The video processing module 40 is further connected to the displays 52, 54, 56 mounted inside the vehicle on view-obstructing pillars. Either cabled or RF (Radio Frequency) connections may be provided between the video processing module and the cameras and displays.

The video processing module 40 may further be connected to memory 48 and control processor 50. The control processor 50 may in turn be connected to a vehicle management system or vehicle network 58.

Alternatively the video processing module may be directly connected to a vehicle network. In alternative arrangements, the cameras and/or displays may also be connected to the video processing module via a vehicle network rather than directly. Persistent storage, such as Flash ROM, may be provided - 6 for storing program code for the control processor and/or the video processing module.

The video processing module 40 processes the image received from each camera and outputs the processed image to the associated display in real time. The image is processed so as to produce an approximation of what the driver would see if the pillar were not present. The processing performed includes modification of the image in dependence on the shape of the display.

Specifically, since in some examples the display is not flat but instead (approximately) follows the contours of the pillar to which it is attached, simply displaying the image received from the camera as if to a flat display may result in a warped image (from the point of view of the driver). In such cases, the video processing module therefore maps the image output from a camera to the given display shape. This involves stretching and/or contracting portions of the image in dependence on the screen contours.

The processing performed by the video processing module may be configurable to allow for adjustments to the image output in dependence on the exact viewing position of the driver, for example in dependence on the driver's height and seat adjustment. In some examples, this may be achieved automatically by way of sensors in the seat.

The video processing module may comprise a single image processor for processing the images for each of the camera / display pairs, or may comprise multiple image processors (for example, one per camera / display pair).

The video processing module may further comprise one or more image encoders for encoding the image output into a format suitable for display.

As mentioned above, the second part of the view enhancing system is a rear view display system comprising a mirror display provided in place of the conventional central rear view mirror.

The mirror display comprises a display layer and a reflective layer.

When switched off or in "standby" mode, the display layer is substantially transparent, and the mirror display functions as a conventional mirror. When active and receiving an image, the mirror display functions as a display, displaying the received image. - 7

The display is constructed using a clear cathode type LCD or LEP / OLED display.

One or more cameras are provided on the outside of the vehicle at the rear and obtain an image of the rear section of the vehicle's surroundings substantially the same view as shown by a conventional rear view mirror. The image thus obtained is displayed on the mirror display.

Because the cameras are mounted on the outside of the vehicle, instead of the reflection as seen in a conventional rear view mirror, including obstructions such as pillars, luggage and passengers, the driver sees an unobstructed view of the road / traffic behind the vehicle as received by the cameras.

The image may be provided by a single camera or by multiple cameras. A single camera may, for example, be mounted in a central position on the roof or another appropriate location and collect a complete rear image and send it to the mirror display. In another example, two cameras are provided on the outside of the "C"-pillars. The images produced by the cameras are spliced together by the video processing module 40 taking account of any overlap in the cameras' fields of view to produce a single image for display on the mirror display.

The display component of the mirror display can be turned off (for example if some other component of the system has failed), in which case the mirror display functions as a conventional mirror. Also, if the display itself fails, the mirror display will act as a conventional mirror, thus providing a fail-safe system.

The two parts of the view enhancing system - that is, the pillar displays and the enhanced rear view display - may be provided independently or in combination. By providing a combined system incorporating both the pillar displays and the enhanced rear view display, the driver can be provided with a complete unobstructed view of the vehicle surroundings. Since the driver mostly uses the rear view mirrors for obtaining a view to the rear of the vehicle, it will typically be sufficient to provide pillar displays only on the front or "A"-pillars, or alternatively on the "A" and "B" pillars, but not on the "C" pillars. An unobstructed rear view is then still provided by the enhanced rear view display.

Instead of the electronic displays as described above, both the pillar displays and the rear view mirror display may be provided by way of projection systems, using projectors mounted inside the vehicle along with non-active display areas on the pillars and the rear view mirror. In this case, the display areas on the pillars are provided in the form of reflective projection surfaces shaped to fit the pillars.

The projectors may use micro displays with a bright light shone on to the surface and the reflected image sent through a collection lens to the screen/display on the pillars and mirror (in full colour). To ensure correct projection, the image would in this case be inverted by the video processing module before projection.

Alternatively, small-scale projection systems including projection devices such as Texas Instruments (TM) digital light processors may be used.

The projection systems are installed in the roof of the car and receive the images recorded by the cameras mounted on the outside of the vehicle. The projection devices project the road image onto the projection surfaces on the pillars and the rear view mirror.

In the case of the pillar displays, a projection surface is provided on the pillars comprising a plastic surface with a reflective material or coating. The coating is preferably arranged to reflect only light originating from the direction of the projector, and to be otherwise substantially non-reflective or transparent to prevent spurious reflections (for example of ambient light) which could be distracting to the driver. The coating may, for example, use a material such as ITO (indium tin oxide), silver or gold. Preferably, the coating is chosen so as to provide a clear projected image in all environmental conditions including daylight, bright sunlight, or night time conditions.

The rear view obtained from the rear-facing camera(s) is similarly projected directly onto the rear view mirror, which may, for example, include a reflective coating as described above. The mirror can be used conventionally if the projection system fails or is deactivated. A sensor (for example an infrared sensor) can be provided to detect the orientation of (or adjustment to) the mirror so as to enable adjustment of the projection system in response to adjustment of the mirror by the driver. - 9 -

The displays used by the system (both the pillar displays and the rear view display) may also be used to display additional information, for example information about the vehicle surroundings or the vehicle status. Information about the vehicle surroundings may, for example, be obtained from cameras or other sensors mounted on the outside of the vehicle. The information displayed may include warnings about approaching vehicles, for example in the form of warning icons.

Information about vehicle status may be obtained from an engine / vehicle management system and displayed, including speed, fuel levels and the like. Warning icons may also be displayed in response to specific conditions, such as a low fuel indicator.

The pillar displays (especially in the front or "A"-pillars) are particularly suitable for the display of such additional information since the information can be made available to the driver without distracting the driver's attention away from the road, as would be the case if such information were displayed, for example, on the dashboard, and without detracting from the conventional view through the windscreen as would be the case if information displays were integrated into the windscreen.

It will be understood that the present invention has been described above purely by way of example, and modification of detail can be made within the scope of the invention.

For example, although a system using a mirror display provided in the central rear view mirror has been described, similar displays may also be used in the wing mirrors to provide an improved view.

Instead of a display integrated into the rear view mirror, the rear view may also be displayed on a portion of the front windscreen, either by way of a transparent display integrated into the windscreen, or by way of a projection system projecting the image onto the windscreen. Alternatively, the rear view can also be displayed or projected on an area of the dashboard to provide the driver with an unobstructed rear view whilst not being distracted from the road ahead.

The number of cameras and the number and shape of display screens used and the positioning of the cameras and display screens can be freely varied in dependence on requirements. The system is described above using - 10 the example of a car, but different camera / screen arrangements may be suitable for other types of vehicles.

Other types of sensors, for example infrared sensors, may be provided to enhance the driver's view, for example at night or in bad weather conditions. The video processing module may also provide image enhancement functions for this purpose.

In an alternative embodiment of the rear view display system, rather than displaying a complete rear view, two cameras (located, for example, on the "C" pillars) may capture the portion of the view obstructed by the respective pillar. In this example, the mirror display has display portions covering a left-hand and a right-hand portion of the mirror, the central portion being a conventional mirror. The left and right display portions then display the image from a respective one of the rear-facing cameras. The displayed images and central conventional mirror portion together provide a complete view. The two images may alternatively be collected using a triangular prism together with a single centrally mounted camera, the prism being arranged to collect two images of the obstructed portions of the view at the left and right- hand corners of the vehicle and deflect the images into the single camera to produce an image having separate left and right portions corresponding to the left and right portions of the view which are obstructed by the "C" pillars. The image can then be separated into separate left- and right-hand images by the video-processing module.

Aspects of the system may be applied to a wide range of different types of vehicles, including, for example, cars or vans, as well as aircraft cockpits, driver cabins on trains, and the like. In one example, the rear view display system could be applied to a motorcycle, to provide, for example, a rear view display on the instrument panel or windscreen.

In some examples, the video processing module may be omitted, so that the image from the cameras is displayed directly on the pillar displays.

This may, for example, be appropriate where the display is relatively (or completely) flat. Also, in the example described above, the videoprocessing module may be bypassed in certain circumstances (for example if there is a system failure). The video processing module itself may be adapted to simply - 11 pass the image received from a camera directly to the relevant screen under such circumstances. s - 12

Claims

1. A view enhancing system for a vehicle having a structural element which in normal operation tends to obstruct a vehicle operator's view, comprising: a camera adapted to form an image of a region of the vehicle surroundings where the operator's view is obstructed by the structural element; and display means connected with the camera and mounted on the structural element for displaying an image representing the view that would be seen by the operator if the structural element were transparent or not present.

2. A system according to Claim 1, wherein the vehicle operator has a field of view centred around a horizontal plane substantially at eye level, and wherein the structural element obstructs a portion of the view in that plane.

3. A system according to Claim 2, wherein the display means covers substantially the entire operator-facing portion of the structural element in that plane.

4. A system according to any of the preceding claims, wherein the structural element is a pillar.

5. A system according to any of the preceding claims, the vehicle having a plurality of pillars for supporting a roof; the system comprising respective cameras and display means provided on at least two such pillars.

6. A system according to any of the preceding claims, the vehicle having a front windscreen bounded by two pillars; the system comprising a respective camera and respective display means provided on each of the two pillars.

7. A system according to any of the preceding claims, wherein the display means comprises an electronic display. - 13

8. A system according to any of the preceding claims, wherein the display means comprises a flexible display screen.

9. A system according to any of the preceding claims, wherein the display means comprises an OLED (Organic Light Emitting Diode) screen.

10. A system according to any of Claims 1 to 6, wherein the display means comprises a projection surface, the system further comprising a projector for projecting the image onto the projection surface.

11. A system according to any of the preceding claims, wherein the display means is shaped according to the shape of the structural element.

12. A system according to Claim 11, wherein the display means is shaped so as to approximately follow the contours of the structural element.

13. A system according to Claim 11 or 12, further comprising means for processing the image in accordance with the shape of the display.

14. A system according to Claim 13, wherein the processing means adapts the image to the display shape or contours.

15. A system according to Claim 13 or 14, wherein the processing means is adapted to stretch or contract portions of the image.

16. A system according to any of the preceding claims, wherein the camera is mounted on the structural element.

17. A rear view display system for a vehicle having a rear view mirror, comprising: at least one camera mounted on the outside of the vehicle adapted to receive an image of a rear view from the vehicle; and means for displaying the image received by the at least one camera on the rear view mirror. - 14

18. A system according to Claim 17, comprising a plurality of such cameras each adapted to receive an image of part of the rear view, and processing means adapted to generate a single image of the rear view from the images received by the cameras.

19. A system according to Claim 17 or 18, wherein the displaying means comprises a display screen integrated into the rear view mirror.

20. A system according to Claim 19, wherein the rear view mirror comprises a mirror display having a reflective layer and a display layer.

21. A system according to Claim 20, wherein the display layer is adapted to be substantially transparent when switched off or inactive so as to enable the mirror display to function as a conventional mirror.

22. A system according to Claim 17 or 18, further comprising a projector for projecting the image onto the rear view mirror.

23. A view enhancing system for a vehicle substantially as herein described with reference to Figures 1 to 3 of the accompanying drawings.

24. A rear view display system for a vehicle substantially as herein described with reference to Figures 1 to 3 of the accompanying drawings.