SE541447C2 - An arrangement for monitoring the surrounding area of a vehicle, a vehicle comprising such an arrangement and a method for monitoring the surrounding area of a vehicle - Google Patents

An arrangement for monitoring the surrounding area of a vehicle, a vehicle comprising such an arrangement and a method for monitoring the surrounding area of a vehicle

Info

Publication number
SE541447C2
SE541447C2 SE1651509A SE1651509A SE541447C2 SE 541447 C2 SE541447 C2 SE 541447C2 SE 1651509 A SE1651509 A SE 1651509A SE 1651509 A SE1651509 A SE 1651509A SE 541447 C2 SE541447 C2 SE 541447C2
Authority
SE
Sweden
Prior art keywords
vehicle
view
image
wide angle
arrangement
Prior art date
Application number
SE1651509A
Other versions
SE1651509A1 (en
Inventor
Erik Asp
Hanna Staf
Paulo Eduardo Fragoso
Original Assignee
Scania Cv Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Scania Cv Ab filed Critical Scania Cv Ab
Priority to SE1651509A priority Critical patent/SE541447C2/en
Priority to DE102017010352.6A priority patent/DE102017010352B4/en
Publication of SE1651509A1 publication Critical patent/SE1651509A1/en
Publication of SE541447C2 publication Critical patent/SE541447C2/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/40Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components
    • B60R2300/402Image calibration

Abstract

The invention relates to an arrangement (2) for monitoring the surrounding area (3) of a vehicle (1), comprising at least one wide angle camera (4), an image processing unit (10) for correcting distortion in an image (9) produced by said camera (4) and a display device (12) for presenting the corrected image (9’) produced by said camera (4). The display device (12) is configured to display at least two fields of view on a common corrected image (9’). The invention also relates to a vehicle (1) that comprises such an arrangement (2), a method for monitoring the surrounding area (3) of a vehicle (1) by at least one wide angle camera (4), a computer program for performing the method and a computer program product comprising program code.

Description

AN ARRANGEMENT FOR MONITORING THE SURROUNDING AREA OF A VEHICLE, A VEHICLE COMPRISING SUCH AN ARRANGEMENT AND A METHOD FOR MONITORING THE SURROUNDING AREA OF A VEHICLE TECHNICAL FIELD The invention relates to an arrangement for monitoring the surrounding area of a vehicle according to the appended claims. The invention also relates to a vehicle comprising such an arrangement, a method for monitoring the surrounding area of a vehicle, a computer program for performing the method and a computer program product comprising program code according to the appended claims.
BACKGROUND AND PRIOR ART Conventional rear view mirrors in vehicles may be replaced by a camera monitor system comprising cameras which capture views of the surrounding area of the vehicle and presents an image of the surrounding area on a display which is arranged in the vehicle.
Such camera monitor systems aim to cover a large surrounding area of the vehicle, so that a driver of the vehicle is informed about the traffic and the overall situation at and around the vehicle. Also, there are fields of view of the vehicle which are legally-prescribed to be covered by the camera monitor system.
If a larger surrounding area of the vehicle should be monitored with a system based on a video camera it may be necessary to install several cameras, each of which monitors a different portion of the area surrounding the vehicle. As a result, the driver is presented several images produced from these cameras.
However, each image representing the different portion of the area surrounding the vehicle may increase the cognitive workload on the driver. Instead, the information from each camera may be combined into a total and complete image. Such system is however complex and may result in that parts of the combined image will not show objects in the area surrounding the vehicle.
Another solution to monitor a large surrounding area of the vehicle with a system based on a video camera is to use a single, pivotable camera which may cover the complete area. Such a solution comprises an expensive mechanism for pivoting the camera. Also, depending on the pivoting movement of the camera, objects in the area surrounding the vehicle may not be visible for the driver.
A large surrounding area of the vehicle may also be monitored with a system based on a wide angled camera. The distortion of the image resulting from the use of the wide angle lens of such camera is then corrected before the image is presented on a display.
Document US2002/0075387A1 discloses an arrangement for monitoring the surrounding area of a motor vehicle including at least one wide angle lens camera. A picture processing unit having means for eliminating distortion of the photograph produced from the camera before at least one picture is presented on a picture display unit.
Document US2012/0200664A1 discloses a display device for visuallydepicting fields of view of a commercial vehicle. At least two legally-prescribed fields of view are permanently displayed on at least one display unit disposed inside the vehicle cabin.
The known camera monitor systems are however designed for a specific vehicle having their unique dimensions and legally-prescribed fields of view.
SUMMARY OF THE INVENTION Despite prior art there is a need to develop an arrangement for monitoring the surrounding area of a vehicle, which arrangement makes it easier for the driver, in view of the improved ergonomics, to maintain an overview of the surrounding area of a vehicle. Also, there is a need to develop an arrangement for monitoring the surrounding area of a vehicle, which arrangement is adapted for different types of vehicles. Further, there is a need to develop an arrangement for monitoring the surrounding area of a vehicle, which arrangement may reduce the air drag and thus reduce the fuel consumption.
An object of the invention is thus to develop an arrangement for monitoring the surrounding area of a vehicle, which arrangement makes it easier for the driver, in view of the improved ergonomics, to maintain an overview of the surrounding area of a vehicle.
A further object is to develop an arrangement for monitoring the surrounding area of a vehicle, which arrangement is adapted for different types of vehicles.
A further object is to develop an arrangement for monitoring the surrounding area of a vehicle, which arrangement may reduce the air drag and thus reduce the fuel consumption.
The herein mentioned objects and also other objects are achieved by means of an arrangement for monitoring the surrounding area of a vehicle according to the appended claims.
According to an aspect of the invention the arrangement for monitoring the surrounding area of a vehicle comprises at least one wide angle camera; an image processing unit based on software for correcting distortion in an image produced by said wide angle camera; and a display device for presenting the corrected image produced by said camera. Said image processing unit is configured to correct different fields of view captured by the wide angle camera into at least two corrected fields of view. Said display device is configured to display at least two corrected fields of view on a common corrected image. Further said image processing unit is provided with an adaption unit based on software for adapting the arrangement to at least two different types of vehicles having different dimensions, wherein the images produced by said wide angel camera are adapted for said at least two different types of vehicels.
When at least two of the fields of view are displayed in a common corrected image on the display unit, it makes it easier for the driver, in view of the improved ergonomics, to maintain an overview of what is happening in the at least two displayed fields of view. Thus, the cognitive workload on the driver will be diminished. Also, when using a single wide angle camera instead of several cameras, the air drag may be reduced and thus also the fuel consumption may be reduced.
Said image processing unit is provided with an adaptation unit for adapting the arrangement to at least two different types of vehicles having different dimensions.
The number of wide angle cameras may be reduced to one on each side of the vehicle and still a large surrounding area of the vehicle can be monitored. By providing the image processing unit with an adaptation unit, which may be based on software, the images produced by said camera may be adapted for different types of vehicles. The adaptation unit may produce a new layer of control via the software, which straightens the image, produced by said camera, on specific areas of the image.
According to an aspect of the invention said adaptation unit comprises at least one parameter which is unique for each type of vehicle.
Different types of vehicles have different dimensions. Trucks, buses and cars for example have different dimensions and the driver of the vehicle must consider the dimensions and surrounding area of the vehicle depending on the type of vehicle. The parameter which is unique for each type of vehicle is related to the dimensions of the vehicle.
According to an aspect of the invention said at least one parameter is the position of a driver in the vehicle.
The driver of the vehicle may have a position in one vehicle which is different from the position in another type of vehicle. Often a driver in a car has a position closer to the roadway than a driver in a truck. For this reason the parameters are different for cars and trucks. Thus, the arrangement must be adapted to a car or to a truck by means of said adaptation unit when monitoring the surrounding area of a car or of a truck.
According to an aspect of the invention said at least one parameter is the length of the vehicle.
When monitoring the surrounding area of a vehicle a parameter to consider is the length of the vehicle. Since vehicles of different types may have different lengths the arrangement must be adapted to the length of the vehicle by means of said adaptation unit when monitoring the surrounding area of the vehicle.
According to an aspect of the invention said at least one parameter is the height of the vehicle.
When monitoring the surrounding area of a vehicle a parameter to consider is the height of the vehicle. Since vehicles of different types may have different heights the arrangement must be adapted to the height of the vehicle by means of said adaptation unit when monitoring the surrounding area of the vehicle.
According to an aspect of the invention said at least one parameter relates to legally-prescribed fields of view of the vehicle.
There are fields of view of the vehicle which are legally-prescribed to be covered by a monitor system. In contrast to a car, the driver of a truck must simultaneously maintain an overview of a plurality of not directly visible fields of view. In addition, the direct view around the truck is substantially limited in comparison to a car. For this reason the legally-prescribed fields of view may be different for different vehicles. Thus, the arrangement must be adapted to the legally-prescribed fields of view of the vehicle by means of said adaptation unit when monitoring the surrounding area of the vehicle.
According to an aspect of the invention said image processing unit may provide an image on said display device based on a selected image detail and based on a selected field of view.
The distortion resulting from the use of the wide angle camera is adaptively corrected on the basis of a selected image detail. In addition, the image processing unit for correcting distortions adaptively works on the basis of a selected line of vision. Thus, selective information can be presented to the driver, which information is the most informative, based on the distortion correction and an authentic representation of the surrounding area.
According to an aspect of the invention the camera is either a high dynamic range camera, or similar type of camera.
Such type of camera has a large number of pixels and a large brightness dynamic so that it can improve the image quality. A large number of pixels in the image are an advantage when correcting distortions in the image processing unit, since a large number of pixels will result in a corrected image which is similar to an authentic representation of the surrounding area.
The herein mentioned objects are also achieved by means of a vehicle that comprises an arrangement according to the appended claims.
The herein mentioned objects are also achieved by means of a method for monitoring the surrounding area of a vehicle according to the appended claims.The method comprises the steps of: a) providing an image processing unit based on software for correcting distortion in images produced by said wide angle camera, wherein the image processing unit is provided with an adaption unit based on software for adapting the arrangement to at least two different types of vehicles having different dimensions, b) correcting distortion in an image produced by said wide angle camera in the image processing unit, wherein the image processing unit is correcting different fields of view captured by said wide angle into at least two corrected fields of view and wherein said adaption unit is adapting the images produced by said wide angle camera for said at least two different types of vehicles, c) presenting the corrected image produced by said wide angle camera on a display device, and d) displaying the at least two corrected fields of view on a common corrected image on the display device.
This will make it easier for the driver, in view of the improved ergonomics, to maintain an overview of what is happening in the at least two displayed fields of view. Thus, the cognitive workload on the driver will be diminished.
According to an aspect of the invention the image processing unit in step a) is provided with an adaptation unit which comprises at least one parameter which is unique for the vehicle.
This will make it possible to adapt the arrangement for different types of vehicles. The adaptation unit may produce a new layer of control via the software, which straightens the image, produced by said camera, on specific areas of the image.
According to an aspect of the invention the method comprising the further step of: e) providing an image on said display device based on a selected image detail and based on a selected field of view.
The image processing unit for correcting distortions adaptively may work on the basis of a selected line of vision. Selected information can be presented to the driver, which information is the most informative, based on the distortion correction and an authentic representation of the surrounding area.
The herein mentioned objects are also achieved by means of a computer program for performing the method and a computer program product comprising program code according to the appended claims.
Further objects, advantages and novel features of the invention will become apparent to one skilled in the art from the following details, and also by putting the invention into practice. Whereas the invention is described below, it should be noted that it is not restricted to the specific details described. Specialists having access to the teachings herein will recognise further applications, modifications and incorporations within other fields, which are within the scope of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS Below is a description of, as examples, preferred embodiments of the invention with reference to the enclosed drawings, in which: Figures 1a and 1 b schematically show a side view and a view from above of a vehicle provided with an arrangement for monitoring the surrounding area of the vehicle according to the invention, Figure 2 schematically illustrates an arrangement for monitoring the surrounding area of a vehicle according to the invention, Figure 3 schematically shows a view from above of a vehicle provided with an arrangement for monitoring the surrounding area of the vehicle according to the invention, Figures 4a - 4c schematically illustrate the arrangement according to the invention mounted on different types of vehicles, Figures 5a and 5b schematically illustrate corrected images adapted for different types of vehicles by means of the arrangement according to the invention, and Figure 6 illustrates a flow chart for a method for monitoring the surrounding area of a vehicle according to the invention.
DETAILED DESCRIPTION OF THE DRAWINGS Figures 1 a and 1 b schematically show a side view and a view from above of a vehicle 1 provided with an arrangement 2 for monitoring the surrounding area 3 (figure 2) of the vehicle 1 according to the invention. The vehicle 1 may be a heavy vehicle 1 , such as a truck or a bus. The vehicle 1 may also be car. The arrangement 2 for monitoring the surrounding area 3 of a vehicle 1 comprises at least one wide angle camera 4, which may be attached to a body 6 of the vehicle 1. The wide angle camera 4 may positioned on the outside or on the inside of the body 6 of the vehicle 1 and directed to the surrounding area 3 of a vehicle 1. Instead of using only one wide angle camera 4, a number of wide angle cameras 4 may positioned at the vehicle 1. A first wide angle camera 4 may positioned on one side of the vehicle 1, a second wide angle camera 4 may positioned on the opposite side of the vehicle 1, and a third wide angle camera 4 may positioned so that it is monitoring the area behind the vehicle 1. The wide angle cameras 4 may be so positioned on the vehicle 1 that a trailer 22 (Figure 3) connected to the vehicle 1 may not obscure the field of view of the wide angle camera 4. Alternatively, the wide angle camera 4 may be positioned on the trailer 22. Also, the wide angle camera 4 may be positioned so that it is monitoring the field of view in front of the vehicle 1. The wide angle camera 4 may be a high dynamic range camera 4. Such type of camera 4 has a large number of pixels and a large brightness dynamic so that it can improve the image quality. A large number of pixels will result in a corrected image which is similar to an authentic representation of the surrounding area 3.
Figure 2 schematically illustrates an arrangement 2 according to the invention. The wide angle camera 4 is connected to an electronic control unit 7 which receives images 9 captured by the camera 4. Since the images 9 are captured by a wide angle camera 4 the images 9 are distorted and do not represent a correct image of the surrounding area 3. The electronic control unit 7 comprises an image processing unit 10 for correcting the distortion in the image 9 produced by the camera 4. A computer 8 may be connected to the electronic control unit 7. The electronic control unit 7 is also connected to a display device 12 for presenting the corrected or undistorted image 9’ produced by the camera 4. The display device 12 is arranged in the vehicle 1 and visible for the driver of the vehicle 1. The display device 12 is configured to display at least two fields of view on a common corrected image 9’. In Figure 2 three different fields of view 16, 18, 20 captured by the camera 4 are corrected and are displayed on a common corrected image 9’ by means of corrected fields of view 16’, 18’ 20’. The first field of view 16 may be the surrounding area 3 adjacent to and behind the vehicle 1, the second field of view 18 may be the surrounding area 3 just outside the vehicle 1 of the driver's side of the vehicle and the third field of view 20 may be the surrounding area 3 between the first and second fields of view 16, 18. The different fields of view 16, 18, 20 that are displayed in a common corrected image 9’ on the display device 12, makes it easier for the driver, in view of the improved ergonomics, to maintain an overview of what is happening in the displayed fields of view. Thus, the cognitive workload on the driver will be diminished. Also, when using a single wide angle camera 4 on each side of the vehicle 1 instead of several cameras 4 on each side of the vehicle 1 , the air drag may be reduced and thus also the fuel consumption of the vehicle 1 may be reduced.
The image processing unit 10 may provide an image 9’ on said display device 12 based on a selected image detail and based on a selected field of view. The distortion resulting from the use of the wide angle camera 4 is adaptively corrected on the basis of the selected image detail. In addition, the image processing unit 10 for correcting distortions adaptively works on the basis of a selected line of vision. Thus, selective information can be presented to the driver, which information is the most informative, based on the distortion correction and an authentic representation of the surrounding area 3.
The electronic control unit 7 may be a computer with appropriate software for this purpose. The electronic control unit 7 and/or the computer comprise a computer program P, which can include routines to control the arrangement 2 of the invention. The program P may be stored in an executable form or compressed form in a memory M and/or in a read/write memory. Preferably there is provided a computer program product comprising a program code stored on a, by a computer readable medium for performing the method steps according to the invention, when said program is run on the electronic control unit 7 or another computer 8 connected to the electronic control unit 7. Said code may be non-volatile, stored in said computer readable medium.
Figure 3 schematically show a view from above of a vehicle 1 provided with an arrangement 2 for monitoring the surrounding area 3 of the vehicle 1 according to the invention. A single wide angle camera 4 is arranged on each side of the vehicle 1. One of the cameras 4 captures the three different fields of view 16, 18, 20 of the surrounding area 3 on one side of the vehicle 1 , which fields of view 16, 18, 20 are corrected and displayed on a common corrected image 9’ by means of corrected fields of view 16’, 18’, 20’. The other camera 4 captures three different fields of view 24, 26, 28 of a surrounding area 3’ on the other side of the vehicle 1 , which fields of view 24, 26, 28 are corrected and displayed on a common corrected image by means of corrected fields of view 24’, 26’, 28’. However, the driver of the vehicle 1 may choose to view only two of the fields of view 16, 20 from one of the cameras 4 and three fields of view 24’, 26’, 28’ from the other camera 4. The corrected fields of view 16’, 18’ 20’ and 24’, 26’, 28’ may be displayed on a common display device 12 or on two separate display devices 12.
The vehicle 1 in Figure 3 may be a truck provided with a trailer 22. A further wide angle camera 4 may be arranged on the trailer 22 that is connected to the vehicle 1.
Figures 4a - 4c schematically illustrate the arrangement 2 according to the invention mounted on different types of vehicles 1. Figure 4a schematically illustrates a side view of a truck, Figure 4b schematically illustrates a side view of a bus and Figure 4c schematically illustrates a side view of a car. Different types of vehicles 1 have different dimensions. Trucks, buses and cars for example have different dimensions and the driver of the vehicle 1 must consider the dimensions and surrounding area 3 of the vehicle 1 depending on the type of vehicle 1. For this reason the image processing unit 10 is provided with an adaptation unit 14 (Figure 2) for adapting the arrangement 2 according to the invention to at least two different types of vehicles 1 having different dimensions. By providing the image processing unit 10 with an adaptation unit 14, which may be based on software, the images 9 produced by the camera 4 may be adapted for different types of vehicles 1. The adaptation unit 14 may produce a new layer of control via the software, which straightens the image 9, produced by said camera 4, on specific areas of the image 9. The number of wide angle cameras 4 may be reduced to one on each side of the vehicle 1 and still a large surrounding area 3 of the vehicle 1 can be monitored. The adaptation unit 14 may comprise at least one parameter which is unique for each type of vehicle 1. The parameter which is unique for each type of vehicle 1 may be related to the dimensions of the vehicle 1. Such dimensions of the vehide 1 may be the length of the vehicle 1 and the height of the vehicle 1. Since vehicles 1 of different types may have ferent lengths the arrangement 2 must be adapted to the length of the vehicle 1 by means of said adaptation unit 14 when monitoring the surrounding area 3 of the vehicle 1. Since vehicles 1 of different types may have different heights the arrangement 2 must be adapted to the height of the vehicle 1 by means of said adaptation unit 14 when monitoring the surrounding area 3 of the vehicle 1.
However, also the position of a driver in the vehicle 1 is a parameter to be considered. The driver of the vehicle 1 may have a position in one vehicle 1 which is different from the position in another type of vehicle 1. Often a driver in a car has a position closer to the roadway than a driver in a truck. For this reason the parameters are different for cars and trucks. Thus, the arrangement 2 must be adapted to a car or to a truck by means of said adaptation unit 14 when monitoring the surrounding area 3 of a car or of a truck.
In contrast to a car, the driver of a truck must simultaneously maintain an overview of a plurality of not directly visible fields of view. In addition, the direct view around the truck is substantially limited in comparison to a car. For this reason the legally-prescribed fields of view may be different for different vehicles 1. Thus, the arrangement 2 must be adapted to the legally-prescribed fields of view of the specific vehicle 1 by means of said adaptation unit 14 when monitoring the surrounding area 3 of the vehicle 1. Therefore, one parameter may relate to legally-prescribed fields of view of the vehicle 1.
Figures 5a and 5b schematically illustrate corrected images adapted for different types of vehicles 1 by means of the arrangement according to the invention. The display device 12 in Figure 5a displays three different fields of view 16’, 18’, 20’ on a common corrected image 9’ similar to the different fields of view 16’, 18’, 20’ that are displayed on the display device 12 in Figure 2. The first field of view 16 may be the surrounding area 3 adjacent to and behind the vehicle 1 , the second field of view 18 may be the surrounding area 3 just outside the vehicle 1 of the driver's side of the vehicle 1 and the third field of view 20 may be the surrounding area 3 between the first and second fields of view 16, 18. On the display device 12 in Figure 5b three different fields of view 16”, 18”, 20” are displayed on a common corrected image 9” on the display device 12. In Figure 5b the arrangement 2 according to the invention has been adapted to a different type of vehicle 1. As is evident from figure 5b is that the second field of view 18” is larger than the second field of view 18’ in figure 5a and that the third field of view 20” in figure 5b is smaller than the third field of view 20 in figure 5a.
Figure 6 illustrates a flow chart for a method for monitoring the surrounding area 3 of a vehicle 1 according to the invention. In the following the method according to the invention is described together with figures 1 a - 5b and figure 6. The method comprises the steps of: a) providing an image processing unit 10 for correcting distortion in images 9, b) correcting distortion in an image 9 produced by said wide angle camera 4 in the image processing unit 10, c) presenting the corrected image 9’ produced by said wide angle camera 4 on a display device 12, and d) displaying at least two fields of view on a common corrected image 9’ on the display device 12.
This will make it easier for the driver, in view of the improved ergonomics, to maintain an overview of what is happening in the at least two displayed fields of view. Thus, the cognitive workload on the driver will be diminished.
According to an aspect of the invention the image processing unit 10 in step a) is provided with an adaptation unit 14 which comprises at least one parameter which is unique for the vehicle 1.
This will make it possible to adapt the arrangement 2 for different types of vehicles 1. The adaptation unit 14 may produce a new layer of control via the software, which straightens the image 9, produced by said camera 4, on specific areas of the image 9.
According to an aspect of the invention the method comprising the further step of: e) providing a corrected image 9’ on said display device 12 based on a selected image detail and based on a selected field of view.
The image processing unit 10 for correcting distortions adaptively may work on the basis of a selected line of vision. Selected information can be presented to the driver, which information is the most informative, based on the distortion correction and an authentic representation of the surrounding area 3.
The foregoing description of the preferred embodiments of the invention is provided for illustrative and descriptive purposes. It is not intended to be exhaustive or to restrict the invention to the variants described. Many modifications and variations will obviously be apparent to one skilled in the art. The embodiments have been chosen and described in order best to explain the principles of the invention and its practical applications and hence make it possible for specialists to understand the invention for various embodiments and with the various modifications appropriate to the intended use.

Claims (14)

1. An arrangement (2) for monitoring the surrounding area of a vehicle (1), comprising: one wide angle camera (4) capturing a field of view (16, 18, 20) of the surrounding area; an image processing unit (10) based on software for correcting distortion in an image (9) produced by said wide angle camera (4); and a display device (12) for presenting the corrected image (9’) produced by said wide angle camera (4) and corrected by said image processing unit (10), characterized in that the image processing unit (10) is configured to correct different fields of view (16, 18, 20) captured by the wide angle camera (4) into at least two corrected fields of view (16’, 18’, 20’), wherein the display device (12) is configured to display the at least two corrected fields of view (16’, 18’, 20’) in a common corrected image (9’) and wherein said image processing unit (10) are provided with an adaptation unit (14) based on software for adapting the arrangement (2) to at least two different types of vehicles (1) having different dimensions, wherein the images (9) produced by said wide angle camera (4) is adapted for said at least two different types of vehicles.
2. The arrangement according to claim 1 , wherein said adaptation unit (14) comprises at least one parameter which is unique for each type of vehicle (1).
3. The arrangement according to claim 2, wherein said at least one parameter is the position of a driver in the vehicle (1).
4. The arrangement according to any of claims 2 or 3, wherein said at least one parameter is the length of the vehicle (1).
5. The arrangement according to any of claims 2 - 4, wherein said at least one parameter is the height of the vehicle (1).
6. The arrangement according to any of claims 2 - 5, wherein said at least one parameter relates to legally-prescribe elds of view of the vehicle (1).
7. The arrangement according to any of the preceding claims, wherein said image processing unit (10) may provide a corrected image (9’) on said display device (12) based on a selected image detail and based on a selected field of view.
8. The arrangement according to any of the preceding claims, wherein the camera (4) is a high dynamic range camera (4).
9. A vehicle, characterized in that the vehicle (1) comprises an arrangement (2) according to any of claims 1 - 8.
10. A method for monitoring the surrounding area of a vehicle (1) by at least one wide angle camera (4) capturing a field of view (16, 18, 20) of the surrounding area, said method comprises the steps of: a) providing an image processing unit (10) based on software for correcting distortion in images (9) produced by said wide angle camera (4), wherein the image processing unit (10) is provided with an adaptation unit (14) based on software for adapting the arrangement (2) to at least two different types of vehicles (1) having different dimensions, b) correcting distortion in an image (9) produced by said wide angle camera (4) in the image processing unit (10), wherein the image processing unit (10) is correcting different fields of view (16, 18, 20) captured by said wide angle camera (4) into at least two corrected fields of view (16’, 18’, 20’) and wherein said adaption unit (14) is adapting the images (9) produced by said wide angle camera (4) for said at least two different types of vehicles c) presenting the corrected image (9’) produced by said wide angle camera (4) on a display device (12), and d) displaying the at least two corrected fields of view (16’, 18’, 20’) on a common corrected image (9’) on the display device (12).
11. The method according to claim 10 herein the image processing unit (10) in step a) is provided with an adaptation unit (14) which comprises at least one parameter which is unique for the vehicle (1).
12. The method according to any of claims 10 and 11 , comprising the further step of: e) providing an corrected image (9’) on said display device (12) based on a selected image detail and based on a selected field of view.
13. A computer program (P), where the said computer program (P) comprises program code to cause an electronic control unit (7) or another computer (8) connected to the electronic control unit (7) to carry out the steps according to any one of claims 10-12.
14. A computer product comprising program code stored on a medium that can be read by a computer (8) in order to carry out the method steps according to any one of claims 10-12, when the said program code is run on an electronic control unit (7) or another computer (8) connected to the electronic control unit (7).
SE1651509A 2016-11-18 2016-11-18 An arrangement for monitoring the surrounding area of a vehicle, a vehicle comprising such an arrangement and a method for monitoring the surrounding area of a vehicle SE541447C2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
SE1651509A SE541447C2 (en) 2016-11-18 2016-11-18 An arrangement for monitoring the surrounding area of a vehicle, a vehicle comprising such an arrangement and a method for monitoring the surrounding area of a vehicle
DE102017010352.6A DE102017010352B4 (en) 2016-11-18 2017-11-08 Arrangement for monitoring the surrounding area of a vehicle, vehicle with such an arrangement and method for monitoring the surrounding area of a vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
SE1651509A SE541447C2 (en) 2016-11-18 2016-11-18 An arrangement for monitoring the surrounding area of a vehicle, a vehicle comprising such an arrangement and a method for monitoring the surrounding area of a vehicle

Publications (2)

Publication Number Publication Date
SE1651509A1 SE1651509A1 (en) 2018-05-19
SE541447C2 true SE541447C2 (en) 2019-10-01

Family

ID=62068720

Family Applications (1)

Application Number Title Priority Date Filing Date
SE1651509A SE541447C2 (en) 2016-11-18 2016-11-18 An arrangement for monitoring the surrounding area of a vehicle, a vehicle comprising such an arrangement and a method for monitoring the surrounding area of a vehicle

Country Status (2)

Country Link
DE (1) DE102017010352B4 (en)
SE (1) SE541447C2 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020075387A1 (en) * 2000-11-29 2002-06-20 Holger Janssen Arrangement and process for monitoring the surrounding area of an automobile
US20120200664A1 (en) * 2011-02-08 2012-08-09 Mekra Lang Gmbh & Co. Kg Display device for visually-depicting fields of view of a commercial vehicle
EP2858035A1 (en) * 2013-10-01 2015-04-08 Application Solutions (Electronics and Vision) Limited System, vehicle and method for online calibration of a camera on a vehicle
US20160280136A1 (en) * 2014-03-05 2016-09-29 Guy M. Besson Active-tracking vehicular-based systems and methods for generating adaptive image

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012001835B4 (en) * 2012-01-31 2023-03-02 Mekra Lang Gmbh & Co. Kg Vision system for a commercial vehicle for displaying legally required fields of vision of a main mirror and a wide-angle mirror
DE102014018040A1 (en) * 2014-12-05 2016-06-09 Mekra Lang Gmbh & Co. Kg vision system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020075387A1 (en) * 2000-11-29 2002-06-20 Holger Janssen Arrangement and process for monitoring the surrounding area of an automobile
US20120200664A1 (en) * 2011-02-08 2012-08-09 Mekra Lang Gmbh & Co. Kg Display device for visually-depicting fields of view of a commercial vehicle
EP2858035A1 (en) * 2013-10-01 2015-04-08 Application Solutions (Electronics and Vision) Limited System, vehicle and method for online calibration of a camera on a vehicle
US20160280136A1 (en) * 2014-03-05 2016-09-29 Guy M. Besson Active-tracking vehicular-based systems and methods for generating adaptive image

Also Published As

Publication number Publication date
SE1651509A1 (en) 2018-05-19
DE102017010352A1 (en) 2018-05-24
DE102017010352B4 (en) 2021-02-11

Similar Documents

Publication Publication Date Title
CN103568954B (en) The visor replacement system of vehicle
KR100936557B1 (en) Perimeter monitoring apparatus and image display method for vehicle
JP5671186B1 (en) Viewing system for transport vehicles for displaying legal field of view with main mirror and wide angle mirror
US9499099B2 (en) Motor vehicle having a camera monitoring system
US10007853B2 (en) Image generation device for monitoring surroundings of vehicle
US10860899B2 (en) Obstacle detection in vehicle using a wide angle camera and radar sensor fusion
KR101766077B1 (en) System and Method for Providing Vehicle Around View
US20190100156A1 (en) System and method for controlling a display
JP5321711B2 (en) Vehicle periphery monitoring device and video display method
JP4606322B2 (en) Vehicle driving support device
US11318884B2 (en) Video monitoring system for a motor vehicle
KR101765556B1 (en) Apparatus and method for processing the image according to the velocity of automobile
CN106993154B (en) Vehicle side and rear monitoring system with fail-safe function and method thereof
US11377027B2 (en) Image processing apparatus, imaging apparatus, driving assistance apparatus, mobile body, and image processing method
SE541447C2 (en) An arrangement for monitoring the surrounding area of a vehicle, a vehicle comprising such an arrangement and a method for monitoring the surrounding area of a vehicle
US20220408062A1 (en) Display control apparatus, display control method, and program
CN115278068A (en) Weak light enhancement method and device for vehicle-mounted 360-degree panoramic image system
JP4706896B2 (en) Wide-angle image correction method and vehicle periphery monitoring system
CN110576796A (en) Standard-definition 360-panorama system UI layout method
US11433811B2 (en) Method and device for operating a video monitoring system for a motor vehicle
US11400861B2 (en) Camera monitoring system
US11308336B2 (en) Method and device for operating a camera-monitor system for a motor vehicle
US20240114252A1 (en) Movable apparatus and installation method for imaging device
US20240007595A1 (en) Camera monitoring system, control method for camera monitoring system, and storage medium
US20230007190A1 (en) Imaging apparatus and imaging system