US20110228088A1 - Device for monitoring an environment of a vehicle - Google Patents

Device for monitoring an environment of a vehicle Download PDF

Info

Publication number
US20110228088A1
US20110228088A1 US13/130,074 US200913130074A US2011228088A1 US 20110228088 A1 US20110228088 A1 US 20110228088A1 US 200913130074 A US200913130074 A US 200913130074A US 2011228088 A1 US2011228088 A1 US 2011228088A1
Authority
US
United States
Prior art keywords
vehicle
wafer
environment
image
level cameras
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/130,074
Inventor
Joachim Gloger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mercedes Benz Group AG
Original Assignee
Daimler AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Daimler AG filed Critical Daimler AG
Assigned to DAIMLER AG reassignment DAIMLER AG ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GLOGER, JOACHIM
Publication of US20110228088A1 publication Critical patent/US20110228088A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/31—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing stereoscopic vision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/806—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for aiding parking

Definitions

  • the invention relates to a device for monitoring an environment of a vehicle according to the characteristics of the preamble of claim 1 .
  • Utility vehicles for goods or people transport are often characterized by large vehicle dimensions and a low viewing clarity.
  • Modern passenger motor vehicles often also have a low viewing clarity due to their outer design. From this, it results that particularly a maneuvering of these vehicles is very difficult for a driver. It is thus advantageous, to depict vehicles and their environment from a bird's-eye view on a screen, so that the vehicle and its entire environment are visible to the driver.
  • a device for monitoring an environment that cannot be viewed directly and/or for the forward-looking monitoring of the vehicle lane comprises a camera arranged in the front and/or rear region of the vehicle, a signal processing device and a display device in the viewing field of the driver, Furthermore, the device has means for transferring the at least one camera into a protected resting position with non-use and into at least one defined operating position in use and means for the forward-looking monitoring of the drive lane, on which the wheels of the vehicle roll, wherein these means comprise at least one sensing device at the vehicle for sensing ground unevenness, and an evaluation unit, which converts the signals of the at least one sensing unit into display signals and/or control commands for vehicle assemblies that can be controlled actively.
  • the at least one sensing device of the means for the forward-looking monitoring of the drive lane is formed by at least one camera present for monitoring the environment of a vehicle that cannot be viewed directly, wherein the means cooperating with the at least one camera for transferring the at least one camera into a protected resting position in non-use and into at least one defined operating position in use have a pivot device for the vertical and/or horizontal pivoting of the at least one camera.
  • EP 1 145 905 A2 is known a camera with a viewing field control for the dead angle monitoring with motor vehicles.
  • a prism for the reflection of incident light from a left and right image capturing device is arranged at a vehicle.
  • An alignment of an image capturing unit can be pivoted vertically and obliquely to a horizontal plane, so that objects above or below this horizontal plane can be captured with the image capturing unit.
  • a device for monitoring an environment of a movable body is known from DE 601 01 040 T2, wherein the movable body preferably transports persons or freight, that is, is a vehicle in particular.
  • the device comprises an image processor, which can be operated in such a manner that it transforms image data captured by at least one image capturing unit to a display of the mobile body and its environment in a bird's eye view in such a manner that a display unit displays an image of the body and its environment in the bird's eye view.
  • the displayed image can thereby also be determined by means of a combination of a first perspective image of a first image capturing unit and a second perspective image of a second image capturing unit.
  • a look-up table also known as look-up table or conversion table, is used for the transformation of the image data.
  • US 2008 043 113 A1 further discloses a device and a method, by means of which individual images from a front camera and a lateral camera, which are arranged at a front and left side of the vehicle, are converted to overall images, which show the vehicle and its environment from a bird's eye view.
  • the capturing ranges of the cameras overlap, wherein the overall image shown in a bird's eye view is formed by means of a combination of the individual images.
  • the conversion of the individual images to the overall image takes place by means of data of a conversion table.
  • WLC wafer-level camera
  • the optical lenses are placed directly on a wafer.
  • the production of the wafer-level cameras functions similar to applying circuits onto a wafer. Thereby, thousands of optical lenses are simultaneously applied onto a wafer, aligned thereafter and adhered thereto.
  • wafer stack technology the necessary but cost-intensive individual assembly and alignment of the lenses with the conventional production method is omitted.
  • the individual wafer-level cameras are finally cut out from the wafer and placed on a sensor module.
  • the big advantage of this technique are the low costs of production Furthermore, the wafer-level cameras with a strength of 2.5 millimeters are only approximately half the size of the smallest conventional camera modules.
  • the invention is based on the object to give an improved device for monitoring an environment of a vehicle.
  • the environment is captured by means of a plurality of image capturing units, the capture ranges thereof overlapping at least partially and forming an overlap range, wherein an overall image is generated from the individual images captured by means of the image capturing units by means of an image processing unit, which overall image shows the vehicle and the environment thereof from a bird's-eye view.
  • the image capturing units are formed as wafer-level cameras according to the invention.
  • the wafer-level cameras advantageously cause low production costs.
  • the installation space requirement of the camera is so low that several of these wafer-level cameras can be arranged adjacent to each other in the form of a line.
  • An improved panorama view is thereby created for the driver, which serves him as an assistance function or support during the drive operation, for example when maneuvering the vehicle. Furthermore, accidents can be avoided, which often occur due to a bad panorama view, particularly with large vehicles and whose view is limited.
  • FIG. 1 thereby shows a schematic depiction of a line of several wafer-level cameras according to the invention.
  • wafer-level cameras 1 are arranged in a line and integrated at the sides of a vehicle body, not shown in detail.
  • the wafer-level cameras 1 are produced by means of a so-called WLC technology (wafer-level camera). With the WLC technology, the optical lenses 4 are placed directly onto a wafer 5 .
  • the production of the wafer-level camera 1 functions similar to with applying circuits onto the wafer 5 . Thousands of optical lenses are thereby applied simultaneously onto a wafer 5 , aligned thereafter and adhered thereto.
  • a so-called wafer stack technology the necessary but cost-intensive individual assembly and alignment of the lenses 4 with the conventional production method is omitted.
  • the individual wafer-level cameras 1 are finally cut out from the wafer and placed on a sensor module 6 .
  • the big advantage of this technique are the low costs of production. Furthermore, the wafer-level cameras with a strength of 2.5 millimeters are only approximately half the size of the smallest conventional camera modules.
  • the wafer-level cameras 1 are arranged and aligned in such a manner that their respectively reproduced capture ranges 2 superpose partially, that is, partial regions of the reproduced environment of the vehicle are captured by several cameras and form an overlap range 3 .
  • an image processing unit In order to in particular ease a maneuvering of the vehicle for the driver or to for example to enable an improved overview of objects next or behind the vehicle at traffic light crossings, an image processing unit, not shown in detail, generates an overall image from individual images captured by means of the wafer-level cameras 1 , which overall image shows the vehicle and its environment from a bird's eye view. This overall image can preferably be issued to the driver of the vehicle on a screen.
  • the overall image is transferred to a display device, not shown in detail, which is arranged in the vehicle in viewing field of the driver.
  • a display device of a navigation system or of a reversing assistance system can for example be used as such a display device.
  • a depicted image of the wafer-level cameras 1 can be cross-faded with markings on the display device, which represent dimensions of the vehicle, for example a width and additionally also a height of the vehicle, so that the driver can detect quickly and clearly, if his vehicle can for example pass between obstacles or below an obstacle.
  • the monitoring device comprises for example additionally an image processing unit, in order to position the markings correctly corresponding to a respectively depicted image section.
  • the vehicle is depicted in the drive direction on the display unit, wherein the driver of the vehicle can choose in a preferred manner, in which depiction the vehicle and its environment shall be shown to him.
  • a stereoscopy can be used.
  • the images of two wafer-level cameras 1 are recorded from a line of wafer-level cameras 1 and are transferred to the image processing unit.
  • a distance between the two recording cameras is important.
  • This base width B is variable with a line of wafer-level cameras 1 .
  • the base width B can simply be varied by an actuation of different wafer-level cameras 1 .
  • Wafer-level cameras 1 lying far apart can for example record images with a large base width B.
  • wafer-level cameras 1 lying close to each other can record images with a small base width B.
  • This base width adjustment advantageously functions without an elaborate mechanics for adjusting a camera.
  • the wafer-level cameras 1 of a line are equipped with optical lenses 4 having different focal widths. Images with different focal widths can thereby be recorded by a simple switch-over between the different wafer-level cameras 1 .
  • the image processing unit Due to the large data amount by the recorded images, it is convenient to arrange the image processing unit in the vehicle in the immediate spatial proximity to the wafer-level cameras 1 , in order to keep the cable number and length low. Alternatively, a wireless data transfer between wafer-level cameras 1 and the image processing unit is also possible.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Signal Processing (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention relates to a device for monitoring an environment of a vehicle, wherein the environment is captured by means of a plurality of image capturing units, the capture ranges (2) thereof at least partially overlapping each other and forming an overlap range (3), wherein an overall image is generated from the individual images captured by means of the image capturing units by means of an image processing unit, said overall image showing the vehicle and the environment thereof from a bird's-eye view. According to the invention, the image capturing units are designed as wafer-level cameras (1).

Description

  • The invention relates to a device for monitoring an environment of a vehicle according to the characteristics of the preamble of claim 1.
  • Utility vehicles for goods or people transport are often characterized by large vehicle dimensions and a low viewing clarity. Modern passenger motor vehicles often also have a low viewing clarity due to their outer design. From this, it results that particularly a maneuvering of these vehicles is very difficult for a driver. It is thus advantageous, to depict vehicles and their environment from a bird's-eye view on a screen, so that the vehicle and its entire environment are visible to the driver.
  • From the state of the art are known different methods and devices for such a monitoring and depiction of an environment of a vehicle, wherein particularly an image of the vehicle and the environment thereof is issued to a driver of the vehicle from a bird's eye view. A better panorama view is thereby created for the driver, which view serves him as an assistance function or support during the drive operation, for example when maneuvering the vehicle. Furthermore, accidents can be avoided, which often occur due to a bad panorama view, particularly with large vehicles and those whose view is limited.
  • From the state of the art is known a monitoring device for a vehicle, as described in DE 100 59 786 B4. A device for monitoring an environment that cannot be viewed directly and/or for the forward-looking monitoring of the vehicle lane comprises a camera arranged in the front and/or rear region of the vehicle, a signal processing device and a display device in the viewing field of the driver, Furthermore, the device has means for transferring the at least one camera into a protected resting position with non-use and into at least one defined operating position in use and means for the forward-looking monitoring of the drive lane, on which the wheels of the vehicle roll, wherein these means comprise at least one sensing device at the vehicle for sensing ground unevenness, and an evaluation unit, which converts the signals of the at least one sensing unit into display signals and/or control commands for vehicle assemblies that can be controlled actively. The at least one sensing device of the means for the forward-looking monitoring of the drive lane is formed by at least one camera present for monitoring the environment of a vehicle that cannot be viewed directly, wherein the means cooperating with the at least one camera for transferring the at least one camera into a protected resting position in non-use and into at least one defined operating position in use have a pivot device for the vertical and/or horizontal pivoting of the at least one camera.
  • From EP 1 145 905 A2 is known a camera with a viewing field control for the dead angle monitoring with motor vehicles. A prism for the reflection of incident light from a left and right image capturing device is arranged at a vehicle. An alignment of an image capturing unit can be pivoted vertically and obliquely to a horizontal plane, so that objects above or below this horizontal plane can be captured with the image capturing unit.
  • A device for monitoring an environment of a movable body is known from DE 601 01 040 T2, wherein the movable body preferably transports persons or freight, that is, is a vehicle in particular. The device comprises an image processor, which can be operated in such a manner that it transforms image data captured by at least one image capturing unit to a display of the mobile body and its environment in a bird's eye view in such a manner that a display unit displays an image of the body and its environment in the bird's eye view. The displayed image can thereby also be determined by means of a combination of a first perspective image of a first image capturing unit and a second perspective image of a second image capturing unit. For the transformation of the image data, a look-up table, also known as look-up table or conversion table, is used.
  • US 2008 043 113 A1 further discloses a device and a method, by means of which individual images from a front camera and a lateral camera, which are arranged at a front and left side of the vehicle, are converted to overall images, which show the vehicle and its environment from a bird's eye view. For a capturing of the environment of the vehicle as completely as possible, the capturing ranges of the cameras overlap, wherein the overall image shown in a bird's eye view is formed by means of a combination of the individual images. The conversion of the individual images to the overall image takes place by means of data of a conversion table.
  • Furthermore, a so-called WLC technology (wafer-level camera) is known from the state of the art. With the WLC technology, the optical lenses are placed directly on a wafer. The production of the wafer-level cameras functions similar to applying circuits onto a wafer. Thereby, thousands of optical lenses are simultaneously applied onto a wafer, aligned thereafter and adhered thereto. By means of a so-called wafer stack technology, the necessary but cost-intensive individual assembly and alignment of the lenses with the conventional production method is omitted. The individual wafer-level cameras are finally cut out from the wafer and placed on a sensor module. The big advantage of this technique are the low costs of production Furthermore, the wafer-level cameras with a strength of 2.5 millimeters are only approximately half the size of the smallest conventional camera modules.
  • The invention is based on the object to give an improved device for monitoring an environment of a vehicle.
  • This object is solved according to the invention by a device with the characteristics of claim 1.
  • Preferred designs and further developments of the invention are given in the dependent claims.
  • With a device for monitoring an environment of a vehicle according to the invention, the environment is captured by means of a plurality of image capturing units, the capture ranges thereof overlapping at least partially and forming an overlap range, wherein an overall image is generated from the individual images captured by means of the image capturing units by means of an image processing unit, which overall image shows the vehicle and the environment thereof from a bird's-eye view. The image capturing units are formed as wafer-level cameras according to the invention.
  • The wafer-level cameras advantageously cause low production costs. The installation space requirement of the camera is so low that several of these wafer-level cameras can be arranged adjacent to each other in the form of a line.
  • By means of a large number of installed wafer-level cameras, a complete environment of the vehicle can conveniently be captured without requiring complicated pivot mechanisms for an individual camera.
  • An improved panorama view is thereby created for the driver, which serves him as an assistance function or support during the drive operation, for example when maneuvering the vehicle. Furthermore, accidents can be avoided, which often occur due to a bad panorama view, particularly with large vehicles and whose view is limited.
  • An embodiment of the invention is explained in more detail in the following by means of a drawing.
  • The only FIG. 1 thereby shows a schematic depiction of a line of several wafer-level cameras according to the invention.
  • Several, particularly 10 or more wafer-level cameras 1 are arranged in a line and integrated at the sides of a vehicle body, not shown in detail.
  • By means of the large number of wafer-level cameras 1, an environment of the vehicle, not shown in detail, is captured completely. Dead angles in the capture are avoided thereby.
  • The wafer-level cameras 1 are produced by means of a so-called WLC technology (wafer-level camera). With the WLC technology, the optical lenses 4 are placed directly onto a wafer 5. The production of the wafer-level camera 1 functions similar to with applying circuits onto the wafer 5. Thousands of optical lenses are thereby applied simultaneously onto a wafer 5, aligned thereafter and adhered thereto. By means of a so-called wafer stack technology, the necessary but cost-intensive individual assembly and alignment of the lenses 4 with the conventional production method is omitted. The individual wafer-level cameras 1 are finally cut out from the wafer and placed on a sensor module 6. The big advantage of this technique are the low costs of production. Furthermore, the wafer-level cameras with a strength of 2.5 millimeters are only approximately half the size of the smallest conventional camera modules.
  • In order to reproduce the environment of the vehicle or at least critical regions of this environment, which are not in the direct viewing field of the motorist, thus in the so-called dead angle, as completely as possible, the wafer-level cameras 1 are arranged and aligned in such a manner that their respectively reproduced capture ranges 2 superpose partially, that is, partial regions of the reproduced environment of the vehicle are captured by several cameras and form an overlap range 3.
  • In order to in particular ease a maneuvering of the vehicle for the driver or to for example to enable an improved overview of objects next or behind the vehicle at traffic light crossings, an image processing unit, not shown in detail, generates an overall image from individual images captured by means of the wafer-level cameras 1, which overall image shows the vehicle and its environment from a bird's eye view. This overall image can preferably be issued to the driver of the vehicle on a screen.
  • The overall image is transferred to a display device, not shown in detail, which is arranged in the vehicle in viewing field of the driver. A display device of a navigation system or of a reversing assistance system can for example be used as such a display device.
  • In a further embodiment, a depicted image of the wafer-level cameras 1 can be cross-faded with markings on the display device, which represent dimensions of the vehicle, for example a width and additionally also a height of the vehicle, so that the driver can detect quickly and clearly, if his vehicle can for example pass between obstacles or below an obstacle. In this embodiment, the monitoring device comprises for example additionally an image processing unit, in order to position the markings correctly corresponding to a respectively depicted image section.
  • In a further development of the invention, not shown in detail, the vehicle is depicted in the drive direction on the display unit, wherein the driver of the vehicle can choose in a preferred manner, in which depiction the vehicle and its environment shall be shown to him.
  • In a design of the invention not shown in detail, one can switch over, depending on the drive situation, from the depiction of the vehicle and its environment from a bird's eye view, to a display from another viewing angle, for example an image of a reversing camera, so that the driver of the vehicle can evaluate the drive situation in a better manner.
  • In a preferred embodiment, a stereoscopy can be used. For this, the images of two wafer-level cameras 1 are recorded from a line of wafer-level cameras 1 and are transferred to the image processing unit.
  • With the stereoscopy, a distance between the two recording cameras, also called base width B, is important. This base width B is variable with a line of wafer-level cameras 1. The base width B can simply be varied by an actuation of different wafer-level cameras 1. Wafer-level cameras 1 lying far apart can for example record images with a large base width B. Analogously, wafer-level cameras 1 lying close to each other can record images with a small base width B.
  • This base width adjustment advantageously functions without an elaborate mechanics for adjusting a camera.
  • In a further advantageous embodiment, the wafer-level cameras 1 of a line are equipped with optical lenses 4 having different focal widths. Images with different focal widths can thereby be recorded by a simple switch-over between the different wafer-level cameras 1.
  • Due to the large data amount by the recorded images, it is convenient to arrange the image processing unit in the vehicle in the immediate spatial proximity to the wafer-level cameras 1, in order to keep the cable number and length low. Alternatively, a wireless data transfer between wafer-level cameras 1 and the image processing unit is also possible.
    • LIST OF REFERENCE NUMERALS
    • 1 Wafer-level camera
    • 2 Capture range
    • 3 Overlap range
    • 4 Optical lens
    • 5 Wafer
    • 6 Sensor module
    • B Base width

Claims (8)

1. A device for monitoring an environment of a vehicle, wherein the environment is captured by means of a plurality of image capturing units, the capture ranges (2) thereof at least partially overlapping each other and forming an overlap range (3), wherein an overall image is generated from the individual images captured by means of the image capturing units by means of an image processing unit, which overall image shows the vehicle and the environment thereof from a bird's-eye view,
wherein the image capturing units are wafer-level cameras (1).
2. The device according to claim 1, wherein several wafer-level cameras (1) are arranged parallel adjacent to each other in the form of a line.
3. The device according to claim 1, wherein the wafer-level cameras (1) are arranged at the sides of a vehicle body in an integrated manner.
4. The device according to claim 1, wherein two wafer-level cameras (1) of a line simultaneously record an image and transfer it to the image processing unit.
5. The device according to claim 4, wherein the distance between two wafer-level cameras (1) is variable.
6. The device according to claim 1, wherein a display device for depicting the overall image is provided.
7. The device according to claim 1, wherein the image processing unit is arranged in the immediate spatial proximity to the wafer level cameras (1) in the vehicle.
8. The device according to claim 1, wherein the device is mounted on the vehicle, wherein the vehicle has a body, and wherein the wafer-level cameras (1) are integrated in the sides of the vehicle body.
US13/130,074 2008-12-12 2009-11-19 Device for monitoring an environment of a vehicle Abandoned US20110228088A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102008061760A DE102008061760A1 (en) 2008-12-12 2008-12-12 Device for monitoring an environment of a vehicle
DE102008061760.1 2008-12-12
PCT/EP2009/008234 WO2010066332A1 (en) 2008-12-12 2009-11-19 Device for monitoring an environment of a vehicle

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2009/008234 A-371-Of-International WO2010066332A1 (en) 2008-12-12 2009-11-19 Device for monitoring an environment of a vehicle

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/480,741 Division US9238435B2 (en) 2008-12-12 2014-09-09 Device for monitoring an environment of a vehicle with pairs of wafer level cameras using different base distances

Publications (1)

Publication Number Publication Date
US20110228088A1 true US20110228088A1 (en) 2011-09-22

Family

ID=41467062

Family Applications (3)

Application Number Title Priority Date Filing Date
US13/130,074 Abandoned US20110228088A1 (en) 2008-12-12 2009-11-19 Device for monitoring an environment of a vehicle
US14/480,741 Active US9238435B2 (en) 2008-12-12 2014-09-09 Device for monitoring an environment of a vehicle with pairs of wafer level cameras using different base distances
US14/694,097 Abandoned US20150224927A1 (en) 2008-12-12 2015-04-23 Device for monitoring an environment of a vehicle

Family Applications After (2)

Application Number Title Priority Date Filing Date
US14/480,741 Active US9238435B2 (en) 2008-12-12 2014-09-09 Device for monitoring an environment of a vehicle with pairs of wafer level cameras using different base distances
US14/694,097 Abandoned US20150224927A1 (en) 2008-12-12 2015-04-23 Device for monitoring an environment of a vehicle

Country Status (5)

Country Link
US (3) US20110228088A1 (en)
EP (1) EP2373521B1 (en)
CN (1) CN102245433B (en)
DE (1) DE102008061760A1 (en)
WO (1) WO2010066332A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140340510A1 (en) * 2011-11-28 2014-11-20 Magna Electronics Inc. Vision system for vehicle
JP2016218555A (en) * 2015-05-15 2016-12-22 三菱電機株式会社 Imaging device, imaging vehicle, and device for generating image along passage
US10336326B2 (en) * 2016-06-24 2019-07-02 Ford Global Technologies, Llc Lane detection systems and methods
CN110588516A (en) * 2019-09-19 2019-12-20 深圳市七洲电子有限公司 Digital communication control reversing radar image system
US11877054B2 (en) 2011-09-21 2024-01-16 Magna Electronics Inc. Vehicular vision system using image data transmission and power supply via a coaxial cable

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011010865A1 (en) * 2011-02-10 2012-03-08 Daimler Ag Vehicle with a device for detecting a vehicle environment
DE102012211791B4 (en) 2012-07-06 2017-10-12 Robert Bosch Gmbh Method and arrangement for testing a vehicle underbody of a motor vehicle
CN104683706A (en) * 2013-11-28 2015-06-03 财团法人金属工业研究发展中心 Image joint method
EP3210396B1 (en) 2014-10-20 2024-09-11 Axon Enterprise, Inc. Systems and methods for distributed control
US10192277B2 (en) 2015-07-14 2019-01-29 Axon Enterprise, Inc. Systems and methods for generating an audit trail for auditable devices
EP3144919B1 (en) * 2015-09-18 2020-06-24 Continental Automotive GmbH Device and method for start assistance for a motor vehicle
US10402670B2 (en) * 2016-04-19 2019-09-03 GM Global Technology Operations LLC Parallel scene primitive detection using a surround camera system
DE102018007838A1 (en) 2018-10-04 2019-03-28 Daimler Ag Method for detecting an environment of a vehicle

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050243171A1 (en) * 2003-10-22 2005-11-03 Ross Charles A Sr Data acquisition and display system and method of establishing chain of custody
US20070052827A1 (en) * 2005-09-07 2007-03-08 Omnivision Technologies, Inc. Coated wafer level camera modules and associated methods
US20070096010A1 (en) * 2005-09-19 2007-05-03 Nereo Pallaro Multifunctional optical sensor comprising a photodetectors matrix coupled to a microlenses matrix
US20080043113A1 (en) * 2006-08-21 2008-02-21 Sanyo Electric Co., Ltd. Image processor and visual field support device
US20080049100A1 (en) * 2006-08-24 2008-02-28 Real D Algorithmic interaxial reduction
US20080073734A1 (en) * 2006-09-22 2008-03-27 Samsung Electronics Co., Ltd. Camera module and method of fabricating the same
US20080231710A1 (en) * 2007-01-31 2008-09-25 Sanyo Electric Co., Ltd. Method and apparatus for camera calibration, and vehicle
US20080252729A1 (en) * 2007-01-03 2008-10-16 Delta Electronics, Inc. Advanced bird view visual system
US20090316273A1 (en) * 2008-06-20 2009-12-24 Micron Technology, Inc. Embedded lens for achromatic wafer-level optical module and methods of forming the same
US20090321861A1 (en) * 2008-06-26 2009-12-31 Micron Technology, Inc. Microelectronic imagers with stacked lens assemblies and processes for wafer-level packaging of microelectronic imagers

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6891563B2 (en) * 1996-05-22 2005-05-10 Donnelly Corporation Vehicular vision system
US6657176B2 (en) 2000-04-12 2003-12-02 Autonetworks Technologies, Ltd. On-vehicle image pick-up apparatus and method of setting image pick-up direction
JP3773433B2 (en) 2000-10-11 2006-05-10 シャープ株式会社 Ambient monitoring device for moving objects
US6535242B1 (en) * 2000-10-24 2003-03-18 Gary Steven Strumolo System and method for acquiring and displaying vehicular information
DE10059786B4 (en) 2000-12-01 2007-04-26 Volkswagen Ag Monitoring device for vehicles
DE102004061998A1 (en) * 2004-12-23 2006-07-06 Robert Bosch Gmbh Stereo camera for a motor vehicle
US7663662B2 (en) * 2005-02-09 2010-02-16 Flir Systems, Inc. High and low resolution camera systems and methods
US20070052050A1 (en) * 2005-09-07 2007-03-08 Bart Dierickx Backside thinned image sensor with integrated lens stack
JP4297132B2 (en) * 2006-05-12 2009-07-15 トヨタ自動車株式会社 Vehicle alarm device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050243171A1 (en) * 2003-10-22 2005-11-03 Ross Charles A Sr Data acquisition and display system and method of establishing chain of custody
US20070052827A1 (en) * 2005-09-07 2007-03-08 Omnivision Technologies, Inc. Coated wafer level camera modules and associated methods
US20070096010A1 (en) * 2005-09-19 2007-05-03 Nereo Pallaro Multifunctional optical sensor comprising a photodetectors matrix coupled to a microlenses matrix
US20080043113A1 (en) * 2006-08-21 2008-02-21 Sanyo Electric Co., Ltd. Image processor and visual field support device
US20080049100A1 (en) * 2006-08-24 2008-02-28 Real D Algorithmic interaxial reduction
US20080073734A1 (en) * 2006-09-22 2008-03-27 Samsung Electronics Co., Ltd. Camera module and method of fabricating the same
US20080252729A1 (en) * 2007-01-03 2008-10-16 Delta Electronics, Inc. Advanced bird view visual system
US20080231710A1 (en) * 2007-01-31 2008-09-25 Sanyo Electric Co., Ltd. Method and apparatus for camera calibration, and vehicle
US20090316273A1 (en) * 2008-06-20 2009-12-24 Micron Technology, Inc. Embedded lens for achromatic wafer-level optical module and methods of forming the same
US20090321861A1 (en) * 2008-06-26 2009-12-31 Micron Technology, Inc. Microelectronic imagers with stacked lens assemblies and processes for wafer-level packaging of microelectronic imagers

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11877054B2 (en) 2011-09-21 2024-01-16 Magna Electronics Inc. Vehicular vision system using image data transmission and power supply via a coaxial cable
US20140340510A1 (en) * 2011-11-28 2014-11-20 Magna Electronics Inc. Vision system for vehicle
US10071687B2 (en) * 2011-11-28 2018-09-11 Magna Electronics Inc. Vision system for vehicle
US20190001889A1 (en) * 2011-11-28 2019-01-03 Magna Electronics Inc. Vision system for vehicle
US10640040B2 (en) * 2011-11-28 2020-05-05 Magna Electronics Inc. Vision system for vehicle
US11142123B2 (en) * 2011-11-28 2021-10-12 Magna Electronics Inc. Multi-camera vehicular vision system
US20220041103A1 (en) * 2011-11-28 2022-02-10 Magna Electronics Inc. Multi-camera vehicular vision system
US11634073B2 (en) * 2011-11-28 2023-04-25 Magna Electronics Inc. Multi-camera vehicular vision system
US12100166B2 (en) * 2011-11-28 2024-09-24 Magna Electronics Inc. Vehicular vision system
JP2016218555A (en) * 2015-05-15 2016-12-22 三菱電機株式会社 Imaging device, imaging vehicle, and device for generating image along passage
US10336326B2 (en) * 2016-06-24 2019-07-02 Ford Global Technologies, Llc Lane detection systems and methods
CN110588516A (en) * 2019-09-19 2019-12-20 深圳市七洲电子有限公司 Digital communication control reversing radar image system

Also Published As

Publication number Publication date
US20150015715A1 (en) 2015-01-15
CN102245433B (en) 2015-08-19
DE102008061760A1 (en) 2010-06-17
US9238435B2 (en) 2016-01-19
WO2010066332A1 (en) 2010-06-17
EP2373521B1 (en) 2017-11-01
EP2373521A1 (en) 2011-10-12
US20150224927A1 (en) 2015-08-13
CN102245433A (en) 2011-11-16

Similar Documents

Publication Publication Date Title
US9238435B2 (en) Device for monitoring an environment of a vehicle with pairs of wafer level cameras using different base distances
US7697055B2 (en) Camera unit and apparatus for monitoring vehicle periphery
US7605856B2 (en) Camera unit and apparatus for monitoring vehicle periphery
US20090022423A1 (en) Method for combining several images to a full image in the bird's eye view
US8477191B2 (en) On-vehicle image pickup apparatus
JP3773433B2 (en) Ambient monitoring device for moving objects
US10000155B2 (en) Method and device for reproducing a lateral and/or rear surrounding area of a vehicle
JP4695167B2 (en) Method and apparatus for correcting distortion and enhancing an image in a vehicle rear view system
US8130270B2 (en) Vehicle-mounted image capturing apparatus
JP3627914B2 (en) Vehicle perimeter monitoring system
US7190259B2 (en) Surrounding surveillance apparatus and mobile body
US20140313335A1 (en) Vision system for vehicle with adjustable cameras
US20170153457A1 (en) Heads up display system for vehicle
US20020141086A1 (en) Rearview mirror assembly for a vehicle with monitor
US8878932B2 (en) System and method for detecting the surrounding environment of a motor vehicle using as adjustable infrared night vision system
US11678059B2 (en) Microlensing for real-time sensing of stray light
US11377027B2 (en) Image processing apparatus, imaging apparatus, driving assistance apparatus, mobile body, and image processing method
JP6179975B2 (en) Back monitor camera, vehicle, back monitor system, and back monitor method
JP4445370B2 (en) Vehicle periphery monitoring device
JP2007069777A (en) Obstacle detection system
JP2022168699A (en) Movable body, imaging system, and imaging apparatus
JP3147679B2 (en) Perimeter recognition device for vehicles
JP2002337605A (en) Periphery visually recognizing device for vehicle
KR20240105244A (en) Image capturing device, movable apparatus, and storage medium
EP2193047B1 (en) Assistance device for exiting a hidden lane

Legal Events

Date Code Title Description
AS Assignment

Owner name: DAIMLER AG, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GLOGER, JOACHIM;REEL/FRAME:026305/0331

Effective date: 20110429

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION