EP3488606A1 - Dispositif de prise de vues et procédé pour capter une zone environnante d'un véhicule équipé dudit dispositif - Google Patents

Dispositif de prise de vues et procédé pour capter une zone environnante d'un véhicule équipé dudit dispositif

Info

Publication number
EP3488606A1
EP3488606A1 EP17752280.2A EP17752280A EP3488606A1 EP 3488606 A1 EP3488606 A1 EP 3488606A1 EP 17752280 A EP17752280 A EP 17752280A EP 3488606 A1 EP3488606 A1 EP 3488606A1
Authority
EP
European Patent Office
Prior art keywords
resolution
image
images
output
camera device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP17752280.2A
Other languages
German (de)
English (en)
Inventor
Florian Dreier
Dieter KRÖKEL
Karsten Breuer
Boris Werthessen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Conti Temic Microelectronic GmbH
Original Assignee
Conti Temic Microelectronic GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Conti Temic Microelectronic GmbH filed Critical Conti Temic Microelectronic GmbH
Publication of EP3488606A1 publication Critical patent/EP3488606A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/445—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by skipping some contiguous pixels within the read portion of the array
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/42—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/46—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/186—Video door telephones
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/306—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using a re-scaling of images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Definitions

  • the invention relates to a camera device and a method for detecting an environmental region of a separate vehicle. Furthermore, the invention relates to the vehicle with such a camera device.
  • driver assistance devices such as a traffic sign recognition or a lane departure warning camera systems require a horizontal angle of view of about 50 degrees and a vertical angle of view of about 30 degrees.
  • new functions such as cross traffic or traffic light recognition when holding in the front row require a significantly larger viewing angle in order to be able to record the objects located in the peripheral area of the image when driving up close.
  • highly automated ⁇ overbased driving or lane departure warning requires the recognition of objects and road structures also at greater distances, for which a corresponding resolution is required.
  • camera systems with at least two Optroniken which differ at least in the image angle and / or in the angular resolution, so as to meet the conflicting requirements of the detection of the central area with long range and the detection of a wide-angle range for cross-traffic detection.
  • the publication DE102004061998A1 discloses a device for a motor vehicle with at least one first camera and at least one second camera, the first and the second camera being different in at least one camera characteristic.
  • a disadvantage of such camera systems for example, the amount of data to be processed and the considerable cost due to the plurality of Optroniken, which are the most expensive assemblies of a camera system.
  • the invention has for its object to provide a camera device that implements efficient image processing and simultaneously meets the requirements for a detailed recording and the largest possible coverage for the realization of driver assistance devices.
  • a camera device for detecting an environmental region of a separate vehicle.
  • the surrounding area is a lateral and / or rearward surrounding area lying ahead in the direction of travel of the own vehicle.
  • the camera apparatus has an Optronics, which is formed ⁇ receive a sequence of images of the surrounding area.
  • the image sequence preferably comprises at least two, in particular at least five, in particular at least 20 consecutively recorded images.
  • Optronics includes wide-angle optics.
  • the wide-angle optical system with a horizontal and / or vertical angle of view of z. At least + / - 50 degrees, in particular of at least + / - 70 degrees and / or of at most + / - 80 degrees formed to the optical axis.
  • a peripheral field such.
  • the Optronik includes a high-resolution image sensor.
  • the high-resolution image sensor is in particular an object evaluation such. B. allows the evaluation of traffic signs or lanes in the long-range, thus in particular in a distance range to the own vehicle of at least 50 meters.
  • the high-resolution image sensor is in particular an imaging sensor having a number of pixels of several megapixels, for example of at least five megapixels, preferably of at least seven megapixels, in particular of at least ten megapixels to understand.
  • the image pickup sensor has a homogeneous pixel / cm resolution.
  • High resolution image sensors are classified for automotive-scale use in particular in connection with a wide-angle lens to be unsuitable because they do not allow effi ⁇ cient processing of the large number of pixels for the complex image processing algorithms.
  • the optronics in particular the image acquisition sensor or an image processing device of the Optronics formed an image sequence of the surrounding area with a periodic change of high-resolution and low-resolution images z. B. to a Schmauswoke appeared the camera device output.
  • images of the image sequence are output in a fixed regularity alternately high-resolution and reduced resolution.
  • the optronics is formed, of the image sequence at least every tenth, in particular at least every fifth, It is particularly preferable to output every second image with reduced resolution. In particular, no arbitrary selection of an image to be reduced in the resolution takes place in the image sequence.
  • the high-resolution images have a higher resolution than the resolution-reduced images.
  • a high-resolution image is to be understood, at least in regions, as a resolution in the horizontal and / or vertical image angle of at least 40 pixels per degree, in particular of at least 50 pixels per degree.
  • the high ⁇ resolution image is output at the highest by the Optronics available resolution.
  • a resolution-reduced image is to be understood as a resolution-reduced image in the entire image area.
  • the resolution-reduced images each have, at least in some areas, a resolution in the horizontal and / or vertical image angle of at most 30 pixels per degree, in particular of at most 20 pixels per degree.
  • the images output with reduced resolution have at least approximately the same number of pixels and / or a uniform, in particular evenly distributed, pixel size distribution.
  • An essential advantage of the periodic change is the on average approximately the same or slightly higher Re ⁇ chenaufwand for the evaluation of images comparatively to vehicle cameras, which have so far to implement a realizable image processing effort either so low resolution rates that the evaluation in the remote area not or insufficient is possible or have due to an otherwise too high computational effort exclusively such a small detection range, which possibly at least could have a late evaluation of relevant targets.
  • the image sensor of the optronics is adapted to record the image sequence in the periodic change with the high-resolution and resolution-reduced images.
  • the image sequence is already recorded with the periodic change of high-resolution and low-resolution images, z.
  • the image pickup sensor formed to output the recorded image sequence at least in the resolution, optionally complementary in the field of view unchanged.
  • the image acquisition sensor is designed to record the image sequence with, in particular, exclusively high-resolution images.
  • the image processing device of the camera device is preferably formed by the High-resolution recorded images according to the periodic change to produce low-resolution images and as the image sequence with the periodic change in high-resolution and low-resolution images z. B. on the Optronics über- or directly z. B. to an image evaluation device.
  • a subsequent image-receiving ⁇ resolution reduction takes place in this embodiment, a subsequent image-receiving ⁇ resolution reduction.
  • the image acquisition sensor is connected to the image processing device for transmitting the recorded image sequence.
  • the resolution-reduced images output by the image processing device are at least partially reduced in resolution relative to the associated recorded images.
  • the image acquisition sensor or the image processing device is designed to generate the images to be recorded or recorded in the resolution to be reduced in size by means of pixel binning, in a resolution-reduced manner.
  • pixel binning adjacent pixels z. B. within a row and / or a column or in a z. B. rectangular portion of the respective captured image summarized and assigned to a new pixel.
  • the resulting pixel matrix of the resolution-reduced image thus has, in particular, a lower resolution than the associated recorded image.
  • the image acquisition sensor or the image processing device is designed to generate the images to be recorded or recorded, reduced in resolution, by means of pixel skipping, with reduced resolution.
  • pixel skipping pixels in the output image are skipped in a fixed sequence, so that preferably only a partial amount of the pixels is adopted for the resulting image. In this way, in particular, a smaller one Resolution of the result image implemented and thus achieved a Re ⁇ reduce the amount of data.
  • the high-resolution and resolution-reduced images output at least approximately the same number of pixels.
  • an at least approximately the same number of pixels means a deviation of a maximum of 0.5 megapixels.
  • each image of the output image sequence has a pixel number of, for example, two megapixels. Consequently, a high resolution and a resolution-reduced image with the same number of pixels, for example, output per proces ⁇ processing cycle.
  • At least three images, in particular at least two high-resolution and one resolution-reduced image are output per processing cycle, preferably the at least two high-resolution images jointly have at least approximately the same number of pixels as the image output with reduced resolution.
  • the images output in high-resolution have a smaller image size than the images outputted in a resolution-reduced manner.
  • the high-resolution and low-resolution images can have the same number of pixels without requiring a higher workload.
  • the camera device in particular the image acquisition sensor or the image processing processing device preferably formed to set the image size and / or location of the respective high-resolution output image depending on a determined preceding traffic space and / or the road category on which the own vehicle is currently set.
  • determining the preceding traffic space are relevant traffic areas with characteristic targets, such. B. an intersection with intersecting road users detectable.
  • the street category a distinction is made, for example, between a motorway, federal highway and / or a city center.
  • By determining the forward traffic space and / or the street category it is possible to adjust the image size and / or location of at least the high-resolution images as a function of the current vehicle environment and thus z. B. for the evaluated target objects individually.
  • the own vehicle has a locating device, such as a GPS sensor, which is designed to determine the current position, thus the current location of the own vehicle, in which the camera device can be integrated or integrated.
  • the own vehicle includes, for example, an in-vehicle navigation data server for retrieving electronic map material.
  • a Auswer ⁇ teiki of the own vehicle is designed to evaluate using the certain position of the own vehicle as well as by means of information data of the electronic card material to ahead traffic area and / or the road category on the basis of the current position of the own vehicle and the evaluated traffic space or Road category to the camera device to submit.
  • the recorded images each have at least partially a higher, in particular at least twice, resolution in the central image section than in the peripheral image section.
  • the central image section has a horizontal and / or vertical image angle of at most +/- 25 degrees and / or the peripheral image section adjoining the central image section has a horizontal and / or vertical image angle of at least +/- 50 degrees.
  • the resolution decreases with increasing horizontal and / or vertical image angles at least in sections.
  • target objects both near, game as evaluated at ⁇ located in the range between one and 50 meters, as well as in the long range, for example, at a range between 50 and 500 meters. Since located in the peripheral image section, especially in the vicinity of target objects, such. B. intersecting cyclists in the crossing area are evaluated, is a z. B. due to an anamorphic wide-angle optics lower resolution for the object evaluation possible.
  • the wide-angle optical system is designed with a non-uniform, in particular a non-linear distortion, in particular as an anamorphic wide-angle optical system.
  • ⁇ sondere can be achieved by means of the non-uniform distortion as a function of the resolution of the image sensor, a resolution of up to 50 pixels per degree.
  • the wide-angle optical system has at least or exactly one lens, which is at least partially cut-off, for example the spherical surface section is panamorphic, in particular anamorphic.
  • Panamorphic lenses in particular anamorphic lenses, at least in sections cause a distortion of the original image and, in particular because of the elliptical shape, allow a larger area coverage in comparison to other lens shapes, so that more pixels per depicted zone can be realized. In this way, despite the distortion, improved recognition of target objects is achieved in the central image section.
  • the camera device comprises a Schmauswer- te Mah.
  • the image evaluation device in particular a processor used in the automotive sector, is preferably embodied, from the images output by the optronics each at least one target object such. As lanes, pedestrians ⁇ , cyclists and / or other road users to evaluate.
  • a hierarchy also known as a pyramidal structure, calculated on images having different resolutions.
  • a hierarchy also known as a pyramidal structure, calculated on images having different resolutions.
  • the highest resolution image of the respectively output image for object recognition is first interrogated by the image evaluation device in order to keep the computational effort as low as possible. If a target object is to be recognized by the image evaluation device in the lowest resolution image, it is preferable to access the next higher resolution image. in particular to validate the object recognition.
  • the camera device preferably comprises at least one driver assistance device such.
  • B. a lane keeping or turning assistance device or is connectable to this.
  • the driver assistance device is designed in particular, depending on the at least one evaluated target object at least one passive and / or active driver assistance function such. As a distance warning, emergency braking or autonomous evasive maneuver perform.
  • Another object of the invention relates to a vehicle with a camera device according to the preceding description.
  • the invention relates to a method for detecting a surrounding area of an own vehicle with a camera ⁇ device according to the preceding description.
  • the image sequence is output with the periodic change, for example alternately or in a fixed Rei ⁇ hengol, at high resolution, and resolution-reduced images.
  • the image sequence is shot with the set ⁇ triggered images and output in the periodic changes with the same high-resolution images and aufatsredu- ed images.
  • the image sequence is already taken with the periodic change of high-resolution and low-resolution images and output unchanged.
  • the resolution reduction of the respective image takes place by means of electronic pixel binning and / or pixel skipping on the image recording sensor.
  • a partial amount of the total number of pixels is output by the image pickup sensor, wherein the Remaining amount of pixel number is hidden or merged.
  • a resolution of the image downstream of the resolution takes place, such.
  • the image sequence is output to an image evaluation device for the evaluation of at least one target object.
  • at least one target object is evaluated in each case from the images which are high-resolution and reduced-resolution output in the periodic change. For example, based on the at least one evaluated target object a rempliassis ⁇ tenzfunktion such. B. running a brake, warning and / or a steering assistance.
  • a vehicle comprising a camera device
  • FIG. 6 is a diagram of the resolution profile of a recorded image taken with a camera apparatus comprising an anamorphic optics.
  • FIG. 1 shows, in a schematic illustration, a vehicle 1 with a camera device 2 for detecting a region of surroundings lying ahead.
  • the camera device 2 is a camera arranged in the interior of the own vehicle 1 behind the windshield and directed in the direction of travel of the own vehicle 1.
  • the camera device 2 is designed as a mono camera device 2 with exactly one optronics.
  • the Optronics camera device 2 is adapted to receive 7 of the surrounding area, an image sequence, and the captured image sequence 7 as an image sequence 8 with a periodic change of Hochauf ⁇ dissolved and resolution-reduced images 3 to output.
  • 4 Purely by way of example, an alternating change is shown in FIGS. 2 and 3.
  • the periodic change of high-resolution and low-resolution images 3, 4 can advantageously be the utilization of an image evaluation device of the following Image processing be kept approximately the same.
  • the regular sequence of high resolution and definition ⁇ reduced images obtained 3, 4 averaging an amount of data which can process the image evaluation device for the evaluation of the target objects domestic ner Halb a scheduled processing cycle ⁇ .
  • the evaluation of target objects in the resolution-reduced images 4 at least in the near range and the evaluation of target objects in the high-resolution images 3 in the far range is ensured.
  • the optronics of the camera device 2 are designed to record an image sequence 7 with high-resolution images 3 of the preceding surrounding region.
  • the image sequence 7 comprises in FIG. 2, purely by way of example, six images 3, recorded in high resolution in a defined time interval, in succession.
  • the Optronics includes a wide-angle lens and a high-resolution image acquisition sensor.
  • the wide-angle optics has z. B. a horizontal and / or vertical angle of view, ß of + / - 50 degrees to the optical axis.
  • ß of + / - 50 degrees to the optical axis.
  • the image sensor has, for example, a resolution of at least five megapixels. This resolution realizes the evaluation of target objects also in the far range. In this way, z. B. on costly multiple Optroniken, which are provided in particular for the evaluation of either the edge image or the central image section omitted.
  • the camera device 2 is formed on the one hand with a far ⁇ angled detection range, which, for example, for the early detection of crossing road users may be required in the crossing area or for the traffic light detection in the front row.
  • the at least one output image is implemented with high resolution so that target objects can be evaluated both in the near range, for example in the distance range between one and 50 meters, and in the far range, for example in the distance range between 50 and 500 meters. Consequently, the conflict of objectives of the wide-angle and telephoto ranges is solved by using a single optronics.
  • the Optronics comprises an image processing device which is especially adapted to generate the periodic change in the high-resolution recorded by the image pickup sensor ⁇ images 3 as up solution reduced images.
  • the recorded images 3 are preferably reduced in resolution according to the predetermined periodic change, for example an alternating change in FIG. 2.
  • the image sequence 8 is output to the image evaluation device with the periodic change at high resolution and resolution reduced images 3, 4 in the resolution.
  • the image acquisition sensor is designed to record the image sequence 8 with the periodic change of high-resolution and low-resolution images 3, 4 and in particular output it unchanged to the image evaluation device.
  • the image sensor or the image on ⁇ supply means are designed to carry out the resolution reduction means Pixelbinnings.
  • pixel binning is meant in particular a summary of several, for example, four physical pixels to a pixel. In the case of combining the four pixels into a pixel, only H of the physical pixel number is to be processed as pixels.
  • the camera device 2 in particular the image acquisition sensor, comprises the image evaluation device, which is designed to evaluate at least one target object from the output images 3, 4. Furthermore, the camera device 2 z. B. at least one driver assistance device or is connected to this of the own vehicle 1. The driver assistance device is in particular designed to execute at least one driver assistance function on the basis of the target objects evaluated by the image evaluation device.
  • the high resolution and reduced resolution output images 3, 4 have at least approximately the same number of pixels of z. B. two megapixels. At the same time the images in high resolution 3 from ⁇ given in particular have a smaller image size than the pictures 4 Resolution reduced output, as exemplarily shown in Figures 4 and 5.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • FIG. 4 shows by way of example an exemplary embodiment of a high-resolution image and a resolution-reduced image 4, which z. B. within a processing cycle ⁇ 6 were recorded.
  • the number and size of the pixels P in the resolution-reduced image 4 are indicated comparatively to the high-resolution image 3 in order to illustrate the different resolution based on the image size differences despite the same number of pixels.
  • the high-resolution images 3 preferably have at least approximately the same number of pixels to achieve a constant on average utilization of Jardinauspitein- direction.
  • the definition of the image size and / or position of the respective image 3 to be output in high-resolution takes place within the total available recording surface area of the image recording sensor as a function of at least one image intensity area 5.
  • the image interest area 5 is a predefined search image area, thus in particular a statically defined search image area.
  • the image processing device or the image acquisition sensor is designed to have at least one image interest region 5, in particular in the resolution- reduced images 4, variably z. B. depending on the preceding traffic space, the currently located road category and / or the current vehicle speed fixed ⁇ .
  • the image processing device or the image acquisition sensor is formed, the at least one image interest region 5 in the case Evaluate the target object in at least the following image to follow up on the target object, so that an object tracking of the target object to be tracked is implemented.
  • the image area of interest 5 includes a target object, which is by way of example is a ⁇ Ver traffic signs.
  • an increasing resolution in the central image section is required, for example, when exceeding a speed limit of z. B. 100 km / h of the image area of interest 5 placed on a central image section 9. Since at lower speeds for the early cross traffic and / or traffic light detection at least a sufficient resolution in the peripheral image section 10 is to ensure, for example, when falling below a speed limit of z.
  • FIG. 5 schematically shows a low-resolution output image 4 and two subsequently high-resolution output images 3, which, for example, are shown in FIG. B. within a processing cycle ⁇ 6 were recorded.
  • two image areas of interest have been determined 5, each of which comprises a target, here by way of example ⁇ a road traffic sign and a pedestrian in the resolution-reduced image.
  • the two images 3, which are then output in high-resolution, each comprise one of the two image interest areas 5. In this way, a reliable evaluation of the target objects is achieved.
  • the image interest areas 5 are shown without overlap. It can, for. B., however, also be provided so that the image areas of interest 5 arranged overlapping and thus the two subsequent at least two high-resolution output ⁇ given images 3 have an overlap region.
  • the duration of the image evaluation should not exceed the specified time interval of the processing cycle 6 in order to ensure an early execution of the at least one driver assistance function.
  • the images 3 output in high resolution within the processing cycle ⁇ 6 preferably have at least approximately the same number of pixels as the image 4 output in a resolution-reduced manner.
  • z For example, one of the high-resolution output images 3 0.5 megapixels and the second of the 1.5 megapixel high-resolution output images thus make up 2 megapixels together and thus correspond to the exemplified number of pixels of the low-resolution image 4 of 2 megapixels. In this way a constant utilization of the image evaluation device is ensured.
  • the resolution profile over the horizontal angle of view of the invention is shown Camera device applied 2 recorded image.
  • the Optronics includes a high-resolution 7.23 megapixel image sensor in 16: 9 format and an anamorphic wide-angle lens with a horizontal image angle of + / - 50 degrees.
  • the resolution in the central image section 9 is raised at least in sections, in comparison to a linear wide-angle optical system, so that an even more far-reaching detection of target objects in the far field is made possible.
  • the central image section 9 has a higher resolution in this example than in the peripheral image section 10.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Mathematical Physics (AREA)
  • Transportation (AREA)
  • Traffic Control Systems (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un dispositif de prise de vues (2) servant à capter une zone environnante d'un véhicule (1) équipé dudit dispositif, comprenant un système optoélectronique pourvu d'un capteur d'acquisition d'images à haute résolution et d'une optique grand angle, ledit système optoélectronique étant conçu pour générer une séquence d'images (8) de la zone environnante en alternant périodiquement des images (3, 4) à haute résolution et à résolution réduite.
EP17752280.2A 2016-07-22 2017-07-04 Dispositif de prise de vues et procédé pour capter une zone environnante d'un véhicule équipé dudit dispositif Withdrawn EP3488606A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102016213494.9A DE102016213494A1 (de) 2016-07-22 2016-07-22 Kameravorrichtung sowie Verfahren zur Erfassung eines Umgebungsbereichs eines eigenen Fahrzeugs
PCT/DE2017/200060 WO2018014916A1 (fr) 2016-07-22 2017-07-04 Dispositif de prise de vues et procédé pour capter une zone environnante d'un véhicule équipé dudit dispositif

Publications (1)

Publication Number Publication Date
EP3488606A1 true EP3488606A1 (fr) 2019-05-29

Family

ID=59631505

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17752280.2A Withdrawn EP3488606A1 (fr) 2016-07-22 2017-07-04 Dispositif de prise de vues et procédé pour capter une zone environnante d'un véhicule équipé dudit dispositif

Country Status (7)

Country Link
US (1) US10742907B2 (fr)
EP (1) EP3488606A1 (fr)
JP (1) JP7144398B2 (fr)
KR (2) KR102535442B1 (fr)
CN (1) CN109479124B (fr)
DE (2) DE102016213494A1 (fr)
WO (1) WO2018014916A1 (fr)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016213493A1 (de) 2016-07-22 2018-01-25 Conti Temic Microelectronic Gmbh Kameravorrichtung zur Aufnahme eines Umgebungsbereichs eines eigenen Fahrzeugs sowie Verfahren zur Bereitstellung einer Fahrerassistenzfunktion
DE102017219791A1 (de) * 2017-11-08 2019-05-09 Conti Temic Microelectronic Gmbh Optisches Erfassungssystem für ein Fahrzeug
US11378956B2 (en) * 2018-04-03 2022-07-05 Baidu Usa Llc Perception and planning collaboration framework for autonomous driving
US11153482B2 (en) * 2018-04-27 2021-10-19 Cubic Corporation Optimizing the content of a digital omnidirectional image
JP2020204839A (ja) * 2019-06-14 2020-12-24 マツダ株式会社 外部環境認識装置
US11006068B1 (en) 2019-11-11 2021-05-11 Bendix Commercial Vehicle Systems Llc Video recording based on image variance
DE102020106967A1 (de) * 2020-03-13 2021-09-16 Valeo Schalter Und Sensoren Gmbh Festlegen eines aktuellen Fokusbereichs eines Kamerabildes basierend auf der Position der Fahrzeugkamera an dem Fahrzeug und einem aktuellen Bewegungsparameter
KR20210130330A (ko) 2020-04-21 2021-11-01 삼성전자주식회사 호스트 차량을 제어하는 전자 장치 및 이의 동작 방법
DE102020211023A1 (de) 2020-09-01 2022-03-03 Volkswagen Aktiengesellschaft Verfahren und Vorrichtung zur Umfeldwahrnehmung eines Umfeldes eines zumindest teilautomatisiert fahrenden Fahrzeugs
CN115918101A (zh) * 2020-10-08 2023-04-04 索尼半导体解决方案公司 摄像装置、信息处理装置、摄像系统和摄像方法
CN112428989B (zh) * 2020-10-30 2022-03-11 惠州华阳通用电子有限公司 一种车辆控制方法
US11899468B2 (en) * 2020-12-22 2024-02-13 Waymo Llc Sensor for flashing light detection
JP7250833B2 (ja) * 2021-03-09 2023-04-03 本田技研工業株式会社 物体認識装置、物体認識方法、およびプログラム
DE102021213757B3 (de) 2021-12-03 2023-02-02 Continental Autonomous Mobility Germany GmbH Verfahren zum Fusionieren von Bilddaten im Kontext eines künstlichen neuronalen Netzwerks
DE102021213756B3 (de) 2021-12-03 2023-02-02 Continental Autonomous Mobility Germany GmbH Verfahren zum Fusionieren von Sensordaten im Kontext eines künstlichen neuronalen Netzwerks
DE102022206757A1 (de) 2022-07-01 2024-01-04 Continental Autonomous Mobility Germany GmbH Dynamische Positionierung von Bildausschnitten zur effizienten Ausnutzung hochauflösender Kameras

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1184306A (ja) * 1997-09-01 1999-03-26 Minolta Co Ltd 映像観察装置
US20030048202A1 (en) * 2001-09-10 2003-03-13 Michael Francois Cockpit image recording system
US6917715B2 (en) 2002-04-19 2005-07-12 International Business Machines Corporation Foveal priority in stereoscopic remote viewing system
JP4084991B2 (ja) * 2002-11-29 2008-04-30 富士通株式会社 映像入力装置
JP2004288100A (ja) * 2003-03-25 2004-10-14 Minolta Co Ltd 撮像装置及び移動体カメラ
DE102004061998A1 (de) 2004-12-23 2006-07-06 Robert Bosch Gmbh Stereokamera für ein Kraftfahrzeug
JP2006333120A (ja) 2005-05-26 2006-12-07 Denso Corp 撮像モジュール
FR2912238B1 (fr) * 2007-02-01 2009-07-10 Valeo Vision Sa Procede de traitement d'images prises par une camera embarquee sur vehicule.
JP5188080B2 (ja) * 2007-03-06 2013-04-24 キヤノン株式会社 撮像装置、撮像装置の駆動方法、及び読み出し装置
JP2010283567A (ja) * 2009-06-04 2010-12-16 Alpine Electronics Inc 撮像装置及び車両周囲画像提供装置
JP5552000B2 (ja) * 2010-08-16 2014-07-16 富士フイルム株式会社 ファインダー装置および撮像装置
CN102801955A (zh) * 2011-08-17 2012-11-28 南京金柏图像技术有限公司 一种基于局部高清的数字视频传输方法
DE102011085194B3 (de) * 2011-09-08 2013-03-07 Cooper-Standard Automotive (Deutschland) Gmbh Abgaskühler für ein Abgasrückführsystem sowie ein Abgasrückführsystem mit einem derartigen Abgaskühler
WO2013067083A1 (fr) 2011-11-02 2013-05-10 Magna Electronics, Inc. Système de vision de véhicule avec lentille anamorphique asymétrique
DE102012001835B4 (de) * 2012-01-31 2023-03-02 Mekra Lang Gmbh & Co. Kg Sichtsystem für ein Nutzfahrzeug zur Darstellung von gesetzlich vorgeschriebenen Sichtfeldern eines Hauptspiegels und eines Weitwinkelspiegels
KR101912453B1 (ko) * 2012-02-17 2018-10-26 현대모비스 주식회사 장애물 검출 및 충돌 경보 장치 및 방법
WO2014083764A1 (fr) * 2012-11-27 2014-06-05 日産自動車株式会社 Dispositif de détermination d'accélération/de décélération accidentelle, dispositif de commande de limitation d'accélération/de décélération accidentelle, et procédé de détermination d'accélération/de décélération accidentelle
US10002561B1 (en) 2012-12-12 2018-06-19 Christopher Ralph Tridico Perceptually configured array of addressable electromagnetic emitter elements
US9826174B2 (en) * 2013-03-26 2017-11-21 Samsung Electronics Co., Ltd Image processing apparatus and method
US8934102B2 (en) * 2013-06-17 2015-01-13 Intellectual Reserves, LLC System and method for determining fluid parameters
US10946798B2 (en) * 2013-06-21 2021-03-16 Magna Electronics Inc. Vehicle vision system
DE102013214368A1 (de) 2013-07-23 2015-01-29 Application Solutions (Electronics and Vision) Ltd. Verfahren und Vorrichtung zur Wiedergabe eines seitlichen und/oder rückwärtigen Umgebungsbereichs eines Fahrzeugs
DE102013221882A1 (de) 2013-10-28 2015-04-30 Conti Temic Microelectronic Gmbh Kamera mit ungleichförmiger Winkelauflösung für ein Fahrzeug
DE102014215372A1 (de) * 2014-08-05 2016-02-11 Conti Temic Microelectronic Gmbh Fahrerassistenzsystem
DE102015208889A1 (de) * 2015-05-13 2016-11-17 Conti Temic Microelectronic Gmbh Kameravorrichtung und Verfahren zum Abbilden eines Umfeldes für ein Kraftfahrzeug
KR101625538B1 (ko) * 2015-07-16 2016-06-13 비원이미지 주식회사 도시방범이 가능한 다차선 자동차 번호판 인식시스템
US10334224B2 (en) * 2016-02-19 2019-06-25 Alcacruz Inc. Systems and method for GPU based virtual reality video streaming server
US10007854B2 (en) * 2016-07-07 2018-06-26 Ants Technology (Hk) Limited Computer vision based driver assistance devices, systems, methods and associated computer executable code
DE102016213493A1 (de) 2016-07-22 2018-01-25 Conti Temic Microelectronic Gmbh Kameravorrichtung zur Aufnahme eines Umgebungsbereichs eines eigenen Fahrzeugs sowie Verfahren zur Bereitstellung einer Fahrerassistenzfunktion

Also Published As

Publication number Publication date
DE102016213494A1 (de) 2018-01-25
KR20220162826A (ko) 2022-12-08
CN109479124A (zh) 2019-03-15
US10742907B2 (en) 2020-08-11
KR102535442B1 (ko) 2023-05-22
JP7144398B2 (ja) 2022-09-29
WO2018014916A1 (fr) 2018-01-25
US20200059613A1 (en) 2020-02-20
KR20190026773A (ko) 2019-03-13
DE112017003037A5 (de) 2019-02-28
CN109479124B (zh) 2021-03-16
JP2019525568A (ja) 2019-09-05

Similar Documents

Publication Publication Date Title
EP3488606A1 (fr) Dispositif de prise de vues et procédé pour capter une zone environnante d'un véhicule équipé dudit dispositif
WO2018103795A1 (fr) Dispositif formant caméra et procédé de détection adaptée à la situation d'une zone environnante d'un véhicule
EP3488607B1 (fr) Dispositif de caméra pour l'enregistrement d'une zone environnementale d'un véhicule, et procédé de fourniture d'une fonction d'assistance à un conducteur
EP2150939B1 (fr) Procédé et dispositif pour déterminer la position d'un panneau de signalisation
DE102017203838A1 (de) Verfahren und System zur Umfelderfassung
DE102016208025B4 (de) Verfahren zur Erfassung von Verkehrszeichen
WO2006063546A1 (fr) Procede et dispositif pour determiner la vitesse d'un vehicule
EP2963631B1 (fr) Procédé de détermination d'un stationnement à partir d'une pluralité de points de mesure
EP2033165B1 (fr) Procede pour la detection d'un espace de circulation
DE102011082379A1 (de) Verfahren zum Erfassen von Navigationsdaten
DE102006034122A1 (de) Fahrerassistenzsystem
DE102014111012A1 (de) Verfahren zum Unterstützen eines Fahrers eines Kraftfahrzeugs beim Ausparken, Fahrerassistenzsystem und Kraftfahrzeug
DE102015116542A1 (de) Verfahren zum Bestimmen einer Parkfläche zum Parken eines Kraftfahrzeugs, Fahrerassistenzsystem sowie Kraftfahrzeug
DE102017210845A1 (de) Kameravorrichtung sowie Verfahren zur umgebungsangepassten Erfassung eines Umgebungsbereichs eines Fahrzeugs
DE102019204196B4 (de) Verfahren zum Erfassen des Umfeldes eines Fortbewegungsmittels
DE102016222215A1 (de) Kraftfahrzeug mit einem Fahrerassistenzsystem, das eine Kamera aufweist
EP1962245B1 (fr) Procédé et dispositif de détermination de l'état de déplacement d'objets
DE102020101375A1 (de) Verfahren zur Querverkehrswarnung für ein Fahrzeug mit Erkennung von Fahrspuren, Recheneinrichtung sowie Fahrerassistenzsystem
DE102019000434A1 (de) Hinderniserfassungsvorrichtung für ein Fahrzeug sowie Verfahren zum Ausweichen eines Hindernisses für ein Fahrzeug
DE102018118757A1 (de) Verfahren zum Erkennen einer potenziellen Gefahrenstelle für ein Kraftfahrzeug, sowie elektronisches Fahrzeugführungssystem
DE102008062154B4 (de) Steuerung eines Kamera-Systems eines Kraftfahrzeugs und Fahrerassistenzsystem
DE102016218949A1 (de) Kameravorrichtung sowie Verfahren zur Objektdetektion in einem Umgebungsbereich eines Kraftfahrzeugs
EP3136367B1 (fr) Dispositif de camera de vehicule et procede de detection d'une zone environnante arriere d'un vehicule automobile
DE102020003924A1 (de) Verfahren zum kamerabasierten Erkennen wenigstens einer Fahrspur sowie ein das Verfahren nutzendes Fahrzeug
DE102015121504A1 (de) Verfahren zum Erkennen einer Längsparklücke zum Parken eines Kraftfahrzeugs anhand einer Fahrbahnmakierung, Fahrerassistenzsystem sowie Kraftfahrzeug

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20190222

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190917