EP3903286A1 - Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'assistance à la conduite - Google Patents

Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'assistance à la conduite

Info

Publication number
EP3903286A1
EP3903286A1 EP20711616.1A EP20711616A EP3903286A1 EP 3903286 A1 EP3903286 A1 EP 3903286A1 EP 20711616 A EP20711616 A EP 20711616A EP 3903286 A1 EP3903286 A1 EP 3903286A1
Authority
EP
European Patent Office
Prior art keywords
vehicle
display device
calibration pattern
calibration
image sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20711616.1A
Other languages
German (de)
English (en)
Inventor
Ralph KOLBERG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hella Gutmann Solutions GmbH
Original Assignee
Hella Gutmann Solutions GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hella Gutmann Solutions GmbH filed Critical Hella Gutmann Solutions GmbH
Publication of EP3903286A1 publication Critical patent/EP3903286A1/fr
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20068—Projection on vertical or horizontal image axis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Definitions

  • the invention relates to several methods, a device, a server and a system for calibrating at least one camera of a driver assistance system.
  • a first method for calibrating at least one image sensor of a driver assistance system is proposed.
  • the procedure consists of the following steps:
  • the calibration pattern is thus reproduced by the display device. This means that manufacturer-specific calibration tables with printed calibration samples are no longer necessary. You can also switch between different calibration patterns quickly and easily.
  • the display device is not part of the vehicle.
  • the display device is located outside the vehicle.
  • the image sensor can in particular be a camera or comprise a camera. Features of the present document which are only disclosed in connection with a camera can thus also be claimed with the image sensor and vice versa.
  • the display device usually comprises a control and processing unit and an electrically controlled display unit. Before mapping the display device can receive the calibration pattern, in particular from an external component that is not part of the display device. The method can thus have the step: receiving, by the display device, the calibration pattern from the external component.
  • the external component can e.g. away from the display device
  • the external component can e.g. comprise a database or a memory in which or in which the calibration pattern is stored.
  • the calibration pattern is transmitted to the display device, preferably via communication
  • the calibration pattern can also be retrieved from a memory.
  • the display device can receive the calibration pattern as a file or an image signal.
  • the step of obtaining the calibration pattern can include:
  • the file can be retrieved from a memory, transmitted to the display device by a communication device or downloaded from a server.
  • the calibration sample can be requested. If the calibration pattern is available as a file and is transmitted to the display device as a file, the file can be converted into an image signal.
  • the display device comprises, for example, means for converting the calibration pattern present as an image file into an image signal.
  • 25 pattern can e.g. as an image file, such as a raster graphic or a
  • the display device receives an analog or digital image signal which includes the calibration pattern.
  • the display device can process analog and / or digital image signals.
  • the calibration pattern is typically sent to the display device by a vehicle diagnostic device and / or a mobile terminal and / or a server.
  • the external component can include or include the vehicle diagnostic device, the mobile terminal and / or the server
  • the calibration signal can be used as
  • Image signal or file can be sent to the display device.
  • the driving The diagnostic device and / or the mobile terminal and / or the server can be connected to the display device in a wired or wireless manner, for example by means of a communication connection.
  • the method can include the following step:
  • the display device can send a confirmation to the vehicle diagnostic device and / or the mobile terminal and / or the server. Furthermore, it can be confirmed via an input by a user that the calibration pattern is displayed by the display device.
  • the input can e.g. take place via an input unit provided on the vehicle diagnostic device and / or on the mobile end device.
  • the control command can then be sent to the image sensor (or the camera).
  • the control command is automatically transmitted to the image sensor or the camera when the display device has received the calibration pattern, i.e. without explicit confirmation, preferably after a certain time.
  • the control command is sent to the image sensor or the camera, for example, by the display device, the vehicle diagnostic device, the mobile terminal or the server.
  • the control command can be generated by a control unit of the display device, the vehicle diagnostic device, the mobile terminal or the server.
  • the display device and / or the vehicle diagnostic device and / or the mobile terminal and / or the server can be wired or wirelessly connected to the image sensor or the camera, the driver assistance system and / or a vehicle control device be.
  • the driver assistance system and / or the vehicle Control units can be designed to forward the control command to the image sensor or the camera.
  • the vehicle diagnostic device is usually wired or can be connected to the vehicle control device and / or the driver assistance system via a vehicle diagnostic interface provided in the vehicle.
  • the wavelength of the imaged light depends on the image sensor or the camera.
  • the calibration pattern (or a complementary pattern) is imaged using visible light.
  • the display device is typically set up to image the calibration pattern (or a pattern complementary thereto) by means of visible light.
  • visible light means in particular that the wavelength of the light used for imaging is between 400 nm and 700 nm.
  • the calibration pattern is typically imaged in a plane or projected into a plane.
  • the plane can be oriented at a predetermined angle, for example essentially perpendicular, to the roadway, that is to say to the surface on which the vehicle is located.
  • the plane can be oriented at a predetermined angle, for example essentially perpendicular, to an optical axis of the image sensor or the camera.
  • the display device can for example have a screen for mapping the calibration pattern.
  • the screen is typically an electrically controlled display without moving parts for optical signaling of variable information such as images or characters.
  • the screen can e.g. an ELD (electroluminescent display), an LCD (liquid crystal display), an LED (light emitting diode) screen, a plasma screen or the like.
  • the display device may have a display panel and a projector for projecting the calibration pattern onto the display panel.
  • the projector can, for example, be a video projector (also known as a projector, digital projector, data video projector or beamer).
  • the projector usually comprises a light source and various optical elements, such as, for example, mirrors, lenses and / or diaphragms, for imaging the calibration pattern on the Scoreboard.
  • the projector can be designed as a back beam projector, for example.
  • the display device can also have at least one laser for imaging and / or projecting the calibration pattern.
  • the above-mentioned projector can have the laser. In some designs, however, the display panel can be dispensed with.
  • the calibration pattern can be projected into a plane in front of the image sensor or in front of the camera by means of the said projector, the plane being, for example, a perpendicular wall, a workshop wall or another suitable plane.
  • the calibration pattern is therefore projected to a position at which it can be detected by the image sensor.
  • the plane can be located at any suitable distance from the image sensor.
  • the plane can be arranged at a distance at which objects are typically located during a later use of the image sensor. Possible projection locations are, for example, walls in front of, behind and / or next to the vehicle.
  • calibration pattern e.g. other images or videos can also be displayed by the display device.
  • calibration instructions for a user would be conceivable.
  • the calibration pattern can e.g. be stored as a file in a memory.
  • the calibration pattern is obtained by requesting it from the memory and / or fetching it from the memory.
  • the memory can be part of the vehicle diagnostic device and / or the mobile terminal. Alternatively, the memory can be integrated into the display device.
  • the memory can also be connected to the display device by wire (e.g. USB stick or an external hard drive with a connected cable) or wirelessly (e.g. via Bluetooth or WLAN).
  • a database can also be provided which comprises several calibration patterns.
  • the database can, for example, be part of the memory or an external server (see below).
  • the procedure can include the following steps:
  • Obtaining the calibration pattern e.g. from the memory or the database.
  • the calibration pattern can be requested and / or downloaded from an external location, such as a server with a database and / or a vehicle diagnostic device.
  • an external location such as a server with a database and / or a vehicle diagnostic device.
  • the database comprises several calibration samples, it can be advantageous to provide information about vehicle data, since the calibration samples typically depend on the vehicle type and / or vehicle manufacturer and / or year of construction of the vehicle.
  • the vehicle data can e.g. Vehicle identification number (VIN), vehicle type, vehicle manufacturer and / or vehicle year.
  • the method preferably comprises the following steps:
  • the vehicle data can e.g. can be transmitted by the display device, the vehicle diagnostic device, the vehicle control device, the driver assistance system or the mobile terminal.
  • the vehicle-specific calibration pattern can be received by the vehicle diagnostic device or the mobile terminal before it is transmitted to the display device.
  • the following step can be provided: arranging the display device in a calibration position.
  • the display device Before the calibration image is displayed, the display device should be aligned and / or positioned in relation to the vehicle, in particular in relation to a vehicle-guiding vehicle axle or an unguided vehicle axle.
  • the display device is aligned and / or positioned in relation to the vehicle, preferably in relation to, before the calibration pattern is recorded the vehicle-guiding vehicle axle or the unguided vehicle axle.
  • the calibration pattern represented by the aligned and / or positioned display device can then be recorded by the image sensor or the camera of the driver assistance system.
  • Suitable methods for positioning and aligning and positioning means or alignment means are known to the person skilled in the art and are shown, for example, in the following publications by the applicant: DE 20 2015 008 954 U1, DE 10 2015 112 368 A1, DE 20 2016 103 584 U1, WO 2017 / 198264 A1, WO 2017/016541 A1, WO 2017/101912 A1, DE 20 2015 106 939 U1, the scope of which is hereby made part of the present application by means of reference.
  • the method can further comprise the following steps:
  • the orientation of the display device can be e.g. can be determined using an orientation sensor.
  • the orientation sensor can include an accelerometer, a gyroscope, and an earth's magnetic field sensor, each of which can provide precise acceleration, angular velocity (gyroscopic) and earth's magnetic field measurements in any spatial direction.
  • a tape measure and / or a position sensor can be used, which e.g. an inductive sensor, a capacitive sensor, a magnetic sensor, an ultrasonic sensor, an opto-electrical sensor, a laser sensor, a distance sensor, a fork light barrier, an angle light barrier and / or a magnetic cylinder sensor.
  • a measuring tape and / or a distance sensor can be used to determine the distance between the display device and the vehicle.
  • the method also comprises the following
  • the display device can shift, rotate, reduce and / or enlarge the calibration pattern to be imaged. This can e.g. by adjusting the optics of the display device. Alternatively or additionally, digital processing of the digital calibration pattern can be used
  • the display device 10 can display the calibration pattern shifted, rotated, reduced or enlarged with respect to a standard setting.
  • the input unit can e.g. Part of the display device, the vehicle diag
  • the input and output unit e.g. the distance, position and / or orientation of the display device in relation to the vehicle can be entered manually.
  • the vehicle data can also be entered manually via the input and output unit.
  • the method described above is carried out in particular by components (namely display device, external component, vehicle diagnosis device, mobile terminal and / or server) which are not part of the vehicle, and preferably outside the vehicle
  • the display device, the mobile terminal, the vehicle diagnostic device, the server, the image sensor or the camera and the vehicle control device are separate, but connectable (via a wireless and / or wired communication link) objects
  • the driver assistance system can be separated from the
  • Vehicle control device present or comprise the vehicle control device or form a unit with the vehicle control device.
  • the method can also have the following steps:
  • This step typically takes place after the camera has received the control command.
  • the calibration pattern recorded by the image sensor or the camera can then be sent to the vehicle control device for evaluation
  • the comparison and calibration steps can e.g. can be carried out by the driver assistance system and / or the vehicle control unit in the vehicle.
  • the stored target image (calibration pattern) is typically compared with the actual image recorded by the image sensor (recorded calibration pattern) and the image sensor is compared
  • the image sensor is then calibrated as intended and functional.
  • the calibration steps carried out in the vehicle are known from the prior art, which is why a detailed description of the calibration is dispensed with here.
  • the calibration pattern is typically stored in a memory in the vehicle and is usually compared by the vehicle control unit and / or the driver assistance system with the recorded image of the calibration pattern in order to carry out the calibration of the image sensor or the camera.
  • the present invention provides a second method for calibrating at least one image sensor or a camera of a driver assistance system.
  • the procedure consists of the following steps:
  • the second method can for example be carried out by the external component, such as the vehicle diagnostic device, the mobile terminal device and / or the server, in particular by an external server, which e.g. is arranged outside the workshop, where the display device and the vehicle are for calibration purposes.
  • the method is particularly suitable for remote calibration (remote calibration) of the driver assistance system.
  • the server can have a database which comprises a plurality of calibration patterns.
  • the second method can in particular be combined with the first method described above.
  • the calibration pattern is transmitted in particular by the external component to the display device arranged outside the vehicle.
  • the control command can be transmitted to the image sensor either by the external component or by the display device.
  • a control command can be sent to the display device to form the calibration pattern.
  • the method can also include the following steps:
  • a request to transmit the vehicle data can be sent.
  • the vehicle data can be sent to the server after input by a user.
  • the vehicle data is sent to the server by a vehicle diagnostic device or a mobile device.
  • components namely display device, external component, diagnostic device, server, database and / or memory
  • components namely display device, external component, diagnostic device, server, database and / or memory
  • the device comprises a display device for mapping a calibration pattern, a first communication unit designed to transmit a control command to record the calibration pattern mapped by the display device to the image sensor.
  • the display device can include a screen for displaying the calibration pattern or a display board and a projector for projecting the calibration pattern onto the display board (see also above), although the display board can also be dispensed with (see above).
  • the device is typically not part of the vehicle and in particular is arranged outside the vehicle.
  • the display device is arranged outside of the vehicle and not part of the vehicle.
  • the display device can receive the calibration pattern from an external component which does not exist
  • the device can have at least one control unit.
  • the control unit can be part of the display device, a vehicle diagnosis device, a server, and / or a mobile terminal (cf.
  • the control unit can generate a control command for
  • the device can furthermore have a memory with a first database which has a multiplicity of calibration patterns.
  • the memory can be part of the display device, the vehicle diagnostic device, the server and / or the
  • the display device may comprise means for obtaining a calibration pattern.
  • the display device can have the first communication unit. In this case it can be provided that the first communication unit is designed to receive the calibration pattern.
  • the device can also have an input and output unit for communication with a user. Via the input and output unit, e.g. Commands, data, inputs and / or queries can be entered.
  • the input and output unit can be part of the Fahr
  • the first communication unit is preferably designed to communicate with a driver assistance system and / or a vehicle control device.
  • the first communication unit can be designed to transmit data to the vehicle control device and / or the driver assistance system and / or a server.
  • a vehicle-side communication interface can be provided in some embodiments, which is connected or can be connected to the vehicle control device and / or the driver assistance system for communication on the one hand and can or is connected to the first communication unit on the other hand.
  • the connection can be wireless or wired.
  • the communication interface can thus enable communication between the first communication unit and the vehicle control device or the first communication unit and the driver assistance system.
  • the communication interface can be a vehicle communication interface (VCI) or an OBD interface (on-board diagnostics). In some embodiments, the VCI can be designed to be connected to the OBD interface.
  • the first communication unit can be designed to receive data from the vehicle control device and / or the driver assistance system and / or from the server.
  • the first communication unit preferably has a transmitting and receiving unit which enables bidirectional communication.
  • the first communication unit can be designed for wireless and / or wired communication.
  • the device can comprise a vehicle diagnostic device, which preferably has the input and output unit, the first communication unit, the memory and / or the control and processing unit. Additionally or alternatively, the device can have at least one mobile terminal.
  • the mobile terminal can have the control device, the first communication unit, the input and output unit and / or the memory.
  • the mobile terminal can be, for example, a tablet, a mobile phone, a smartphone, a laptop and / or a notebook.
  • Such devices usually have an input and output unit, a communication unit, a memory and / or a control and processing unit.
  • both the vehicle diagnostic device and the mobile terminal are provided. In this case, at least two input and output units, at least two memories, at least two communication units and / or at least two control and processing units
  • processing units can be provided.
  • the device can have means for determining a distance and / or a position and / or orientation of the display device to the vehicle, such as, for example, corresponding sensors (see above) and / or a dimension
  • positioning means and / or alignment means can be provided for positioning or aligning the display device with respect to the vehicle, preferably with respect to the vehicle-guiding vehicle axle or the unguided vehicle axle.
  • the device can have at least one wheel pickup for loading
  • the wheel pick-up can be fastened to a wheel of the vehicle.
  • positioning means and / or alignment means are sufficient from the
  • the device is designed in particular to carry out one of the above-described enclosed methods.
  • the invention also provides a server.
  • the server comprises a second communication unit, a second control and processing unit connected to the second communication unit, and a second database, the second database having a plurality of calibration modes
  • the BO tern includes.
  • the second communication unit is designed for
  • the second communication unit can also transmit a control command to the display device for mapping the calibration pattern.
  • the server is designed in particular to carry out individual or all steps of the first method and / or the second method.
  • a system which contains the device described above and the server described above.
  • the second communication unit of the server sends the control command to the first communication unit of the device, which then forwards the control command to the image sensor or the camera.
  • control devices control units or control and processing units mentioned in this document can e.g. Processors, microprocessors, controllers or microcontrollers be or include.
  • FIG. 1 shows a schematic representation of a vehicle and various components of a device and a system for calibrating an assistant driver system
  • FIG. 2 shows a schematic representation of a vehicle and various components of a device and a system for calibrating an assistant driver system
  • 3 shows a schematic representation of a vehicle and various components of a device and a system for calibrating an assistant driver system
  • FIG. 6 shows a side view of the display device of FIG. 5 and a vehicle positioned in front of the display device
  • FIG. 7 shows a perspective view of the display device of FIG. 5 and of a vehicle positioned in front of the display device.
  • FIGS. 4-7 show a display device 40 of a calibration device 10 for calibrating at least one camera 65 or image sensor of a driver assistance system 64.
  • the display device 40 is designed to display a calibration pattern 1.
  • the display device 40 comprises an electrically controlled optical display unit, the optical display unit in FIG. 4 including an optional display panel 44 and a projector 45 for projecting the calibration pattern 1 onto the display panel 44, and the optical display unit in FIG. 5 is configured as a screen 46.
  • the calibration pattern 1 is usually imaged using visible light.
  • the display panel 44 or the screen 46 are oriented perpendicular to the roadway and perpendicular to the optical axis of the display device 40.
  • the calibration pattern 1 is thus imaged in a plane which is oriented essentially perpendicular to the roadway and perpendicular to the optical axis of the display device 40.
  • the display device 40 is arranged outside the vehicle and is not part of the driving tool.
  • the projector 45 can, for example, comprise a light source and various optical elements, such as mirrors, lenses and / or diaphragms, for imaging the calibration pattern 1 on the display panel 44.
  • the projector 45 is designed as a back beam projector.
  • the display device 40 can also have at least one laser for imaging or projecting the calibration pattern.
  • the projector 45 includes such a laser.
  • the display device 40 can be fastened to a holding frame 15.
  • the holding frame 15 preferably stands on a chassis 12 provided with four wheels.
  • a horizontally arranged adjustment bar 4 is usually provided in the area between the calibration panel 1 and the chassis 12, which extends laterally on both sides over the optical display unit 44, 45, 46 .
  • the adjustment bar 4 is equipped with an adjustment bar scale 2 and an adjustment bar mirror 3 at each of its end regions.
  • the display device 40 can be positioned and / or aligned with respect to a vehicle 60, in particular with respect to a vehicle-guiding vehicle axle or an unguided vehicle axle (see also FIG. 6).
  • the chassis 12 can be equipped with four adjusting screws 5, each of which is arranged in a threaded hole of the parallel longitudinal rails 13, 13 ′′ of the chassis 12 that they stand up on the base of the chassis 12 so that they can be adjusted as intended 5, the optical display unit 44, 45, 46 can be aligned in such a way that its upper edge is horizontal and its side edges are vertical.
  • the correct alignment of the optical display unit 44, 45, 46 can be carried out by means of an adjustment bar vial 6 arranged on the adjustment bar 4 be checked as the
  • Adjustment bar 4 is also aligned horizontally.
  • the display panel 44 of FIG. 4 and the screen 46 of FIG. 5 can be fastened to the holding frame 15 in a height-adjustable manner.
  • the display panel 44 and the screen 46 can each be used in an intended manner Height can be fixed by means of a locking screw.
  • wheel mounts 20 can be provided, see FIG. Figures 6 and 7.
  • the wheel mounts 20 can be attached to the front or rear wheels of the vehicle 60 and comprise e.g. one laser 21 each for determining a position of the display device 40 relative to the vehicle 60.
  • the display device 40 can have an alignment sensor 47 and / or a position sensor 48 and / or a distance sensor 49 (see FIG. 6) and / or a measuring tape for distance measurement.
  • a relative or absolute orientation of the display device 40 can be determined with the orientation sensor 47.
  • the orientation sensor 48 can e.g. an accelerometer, a gyroscope and a geomagnetic field sensor, which can each offer precise acceleration, angular velocity (gyroscopic) and geomagnetic field measurements in any spatial direction.
  • the position sensor 48 can be used, which, for example, is an inductive sensor, a capacitive sensor, a magnetic sensor, an ultrasonic sensor, an opto-electrical sensor , a laser sensor, a distance sensor, a fork light barrier, a win- includes kellicht Hee and / or a magnetic cylinder sensor. Similar sensors can also be used for the distance sensor 49.
  • the distance sensor 49 is used to determine a distance between the display device 40 and the vehicle 60.
  • a tape measure can be used to determine the distance and / or the position of the display device 40 to the vehicle.
  • the alignment of the display device 40 can be carried out using at least one level indicator.
  • the aids disclosed in DE 10 2015 112 S68 A1 and / or other aids it can be ensured that the display device 40 can be positioned and aligned in front of a vehicle 60 in such a way that a camera 65 can be calibrated a driver assistance system 64 or an image sensor of a driver assistance system 64 can be carried out.
  • the display device 40 can be positioned at a defined distance and centrally in front of the vehicle 60 and at a right angle to the longitudinal axis of the vehicle.
  • FIGS. 1-3 show the display device 40, a vehicle diagnostic device 50, a vehicle 60 and a server 70.
  • a mobile terminal 80 is also shown in FIGS. 1 and 3.
  • Some of the components 40, 50, 70, 80 shown in FIG. 1 are parts of a calibration device 10 or a system 100 for calibrating a driver assistance system 64 procedures described below can be used.
  • FIGS. 1 and 2 show a vehicle 60 in which a vehicle control unit 61, which is also known as an ECU, a communication unit 62, a memory 63, a driver assistance system 64, a camera 65 and a diagnostic interface 66 can be provided.
  • vehicle control unit 61 which is also known as an ECU
  • communication unit 62 which is also known as an ECU
  • memory 63 a memory 63
  • driver assistance system 64 a camera 65
  • a diagnostic interface 66 a diagnostic interface
  • the diagnostic interface 66 is sometimes also called an OBD interface (on-board diagnostics interface). Usually the driving tool diagnostic cut parts 66 in a footwell of the vehicle 60 and is designed as a socket.
  • the vehicle diagnostic interface 66 is connected to at least one vehicle control device 61 located in the vehicle 60 via corresponding signal lines.
  • the vehicle control device 61 is in turn connected to at least one camera 65 of a driver assistance system 64, which is designed to capture images of the direct surroundings of the vehicle 60.
  • the at least one camera 65 can be arranged, for example, in or on a windshield of the vehicle 60.
  • the functioning of the driver assistance system 64, the camera 65 and the vehicle control device 61 and the communication between the driver assistance system 64 and the vehicle control device 61 are known from the prior art and are only briefly outlined below.
  • the camera 65 can be designed to take pictures at regular time intervals.
  • the camera 65 can also be designed to take pictures after receiving a control command.
  • the camera 65 generally receives the control command from the vehicle control device 61.
  • the vehicle control device 61 can be designed to receive the control command from another unit and to forward it to the camera 65.
  • the camera 65 can send the images to the vehicle control device 61 at regular time intervals, where they are then evaluated.
  • the vehicle control device 61 can also forward the digital images to other units.
  • the recorded images can be temporarily stored or permanently stored in the memory 63 of the vehicle 60 designed for this purpose.
  • the functionality of the driver assistance system 64, the camera 65 and the vehicle control device 61 is specified by the manufacturer of the driver assistance system and is therefore not necessarily part of the present invention.
  • FIG. 2 also shows a calibration device 10 for calibrating the camera 65 of the driver assistance system 64.
  • the device 10 comprises the display device 40 and the vehicle diagnostic device 50.
  • FIG. 1 shows schematically again the display device 40 of Figures 4-7, which a control and processing unit 41, a Communication unit 42, a memory 43 and the screen 46 aufwei sen.
  • the display panel 44 and the projector 45 can also be provided instead of the screen 46.
  • the control unit 41 of the display device 40 can process analog and / or digital image signals.
  • vehicle diagnostic device 50 which can include a control and processing unit 51, a communication unit 52, a memory 53 and an input and output unit 54 for communication with a user.
  • Vehicle diagnostic devices 50 are known from the prior art.
  • the vehicle diagnostic device 50 can usually be connected to the vehicle diagnostic interface 66 of the vehicle 60 by means of signal lines.
  • the vehicle diagnostic device 50 typically has a plug that is compatible with the vehicle diagnostic interface 66. When the connector is connected to the vehicle diagnostic interface 66, both are electrically and mechanically connected to one another.
  • the vehicle control device 50 can be configured to read error codes (diagnostic trouble code, DTC) stored in the vehicle.
  • error codes can then be analyzed by the vehicle diagnostic device 50 in order to diagnose whether and which vehicle components need to be repaired or replaced in order to rectify the problem.
  • DTC diagnostic trouble code
  • the communication unit 52 of the vehicle diagnostic device comprises a first transmitting and receiving unit (not shown), which is designed for wired communication with the vehicle control device 61.
  • the communication unit 52 can further comprise, for example, a second transmitting and receiving unit (not shown) for wireless communication with the display device 40 (or the communication unit 42 of the display device 40), which typically works according to a previously known radio standard or radio protocol.
  • the first transmitting and receiving unit and the second transmitting and receiving unit of the vehicle diagnostic device Devices 50 can be connected to one another, either directly or via the control unit 51, such as a processor or a controller.
  • the control unit 51 of the vehicle diagnostic device 50 can control a communication between the first transmitting and receiving unit and the second transmitting and receiving unit of the vehicle diagnostic device 50.
  • the communication unit 52 (or the second transmitting and receiving unit of the communication unit 52) can have a Bluetooth unit, a WLAN (e.g. in accordance with IEEE 802.11) or another unit that is designed to be connected to the communication unit 42 of the display device via a near-field connection 40 to communicate.
  • a Bluetooth unit e.g. in accordance with IEEE 802.11
  • WLAN e.g. in accordance with IEEE 802.11
  • Different types of wireless connections such as EnOcean, Z-Wave, ZigBee, WiMAX, UMTS / HSDPA, LTE (long term evolution), NanoNetm, UWB (Ultra Wideband), NB-loT (Narrowband Internet of Things), Sigfox or LoRa are also for communication of the first communication unit is possible and is known to the person skilled in the art.
  • the vehicle diagnostic device 50 can also communicate with the display device 40 by wire.
  • the transmitting and receiving units 52, 42 are therefore designed to communicate wirelessly or wired with one another.
  • the communication unit 52 can be designed to transmit a control command for recording the calibration pattern 1 imaged by the display device 40 to the camera 65.
  • the communication unit 52 can be configured to transmit or forward the calibration pattern 1 to the display device 40.
  • the memory 43 and / or the memory 53 have a database which comprises a multiplicity of calibration patterns 1.
  • a server 70 is also shown in FIGS. 1-3.
  • the server 70 can have, for example, a control and processing unit 71, a communication unit 72 and a database 73.
  • a large number of calibration patterns is preferably stored in the database 73.
  • associated vehicle data such as vehicle identification number (VIN), vehicle type, vehicle manufacturer and / or year of construction of vehicle 60, are stored in database 73.
  • the communication unit 72 can be designed to transmit the calibration pattern 1 to the display device 40.
  • the communication unit 72 can be designed to transmit a control command for recording the calibration pattern 1 depicted by the display device 40 to the camera 65.
  • the communication unit 52 of the vehicle diagnostic device 50 can further be designed for communication with the communication unit 72 of the server 70.
  • the communication between the vehicle diagnostic device 50 and the server 70 can be wired and / or wireless.
  • a person skilled in the art is familiar with the fact that communication with the communication unit 72 of the server 70 is carried out via interconnected network components, e.g. Base stations and / or other servers, can take place.
  • the control unit 51 of the vehicle diagnostic device 50 can be designed to process or process data received from the server 70 and / or from the vehicle control device 61. If necessary, data can be temporarily stored or buffered in a memory 53 designed for this purpose before they are forwarded to a further component.
  • a program for controlling the electronic components of the vehicle diagnostic device 50 can be stored in the memory 53.
  • the server 70 and the device 10 together form a system 100 which is particularly suitable and / or designed for calibrating the camera 65.
  • a vehicle communication interface (VCI, not shown) can also be connected to the vehicle diagnostic interface 66.
  • the vehicle communication interface can be, for example, an adapter which has a plug for mechanical and electrical connection to the vehicle diagnostic interface 66.
  • the adapter can have a communication unit for communicating with the communication unit 42 of the display device 40 and / or the communication unit 72 of the server.
  • the adapter can in particular be designed to have a Communication between the display device 40 and the vehicle control unit 61 or between the server 70 and the vehicle control unit 61 is possible.
  • FIG. 5 also shows a calibration device 10 for calibrating the camera 65 of the driver assistance system 64.
  • the device 10 comprises the display device 40, a vehicle diagnostic device 50 and a mobile terminal 80.
  • the mobile terminal 80 is also shown.
  • the mobile terminal 80 can e.g. be a tablet, a mobile phone, a smartphone, a laptop and / or a notebook.
  • the mobile terminal device 80 generally has a control and processing unit 81, a communication unit 82, a memory 83 and an input and output unit 84.
  • the communication unit 82 comprises a transmitting and receiving unit (not shown) for wireless communication with the communication units 42, 52 and 72 or the adapter mentioned above, which typically works according to a known radio standard or radio protocol. For possible wireless connections, reference is made to the connections mentioned in relation to the communication unit 52 (see above). Additionally or alternatively, the communication of the communication unit 82 with the communication units 42, 52, 72 or the adapter can also take place in a wired manner.
  • the mobile terminal 80 is designed to receive, forward and / or process data from the vehicle diagnostic device 50 and / or from the server 70 and / or from the adapter.
  • the vehicle diagnostic device 50 is configured to receive, forward and / or process data from the vehicle control device 61, the camera 65, the driver assistance system 64, the server 70, the display device 40 and / or from the mobile terminal 80.
  • the display device 40 is configured for receiving and / or processing data from the vehicle diagnostic device 50 and / or from the mobile terminal 80.
  • the following method for calibrating the camera 65 of the driver assistance system 64 can in particular be carried out with the device 10 and / or the system 100 of FIG. 2 or FIG. 3.
  • the display device 40 is aligned and positioned in front of the vehicle 60 in such a way that the camera 65 can be calibrated.
  • the display device 40 positioned and aligned in front of the vehicle 60 then images the calibration pattern 1.
  • a control command is then sent to the camera 65.
  • the control command causes the camera 65 to record the calibration pattern 1 imaged by the display device 40.
  • the control command can in particular be sent to the camera 65 by the communication unit 52 of the vehicle diagnostic device 50.
  • the vehicle control device 61 receives the control command from the vehicle diagnostic device 50 and forwards the control command to the camera 65.
  • the control command is sent from the server 70 to the camera 65.
  • control command is sent from the server 70 to the vehicle diagnostic device 50 and from there to the vehicle control device 61, which in turn forwards it to the camera 65.
  • the control command can also be sent to the camera by the mobile terminal device 80 via the vehicle diagnostic device 50 and the vehicle control device 61.
  • the camera 65 After receiving the control command, the camera 65 records the calibration pattern 1 imaged by the display device 40.
  • the images recorded by the camera can be evaluated in the vehicle by the control unit 61 in order to calibrate the camera 65.
  • the images from the camera 65 can be compared with a calibration pattern 1 stored in the vehicle memory 63. The camera 65 is then calibrated based on the comparison.
  • the images recorded by the camera 65 of the calibration pattern 1 depicted by the display device 40 are sent to the driving tool diagnostic device 50 and / or sent to the server 70, where then the images of the camera 65 are compared with the calibration pattern 1. For example, camera settings to be changed can be determined through the comparison. The camera settings to be changed are then sent to the vehicle control device 61 or the camera 65.
  • the display device 40 can request and receive the calibration pattern 1.
  • the vehicle diagnostic device 50 transmits the calibration pattern 1 stored in the memory 53 to the display device 40.
  • the display device 40 can retrieve the calibration pattern 1 from the memory 43.
  • the calibration pattern 1 can also be obtained from the database 73 of the server 70. In this case, the vehicle diagnostic device 50 forwards the calibration pattern 1 to the display device 40.
  • the mobile terminal 80 can also transmit the calibration pattern 1 to the display device 40
  • vehicle data such as VIN, vehicle type, vehicle manufacturer and / or year of construction of the vehicle can be transmitted to the components 50, 70, 80 beforehand. Then the calibration pattern 1 corresponding to the vehicle data is sent to the display device 40 by the corresponding components 50, 70, 80.
  • the display device 40 can receive the calibration pattern 1 as a file or image signal.
  • the step of obtaining the calibration pattern 1 may include:
  • a confirmation of receipt can be sent to the component that transmitted the calibration pattern 1 to the display device 40.
  • the corresponding component can transmit the control command to the camera 65.
  • the camera 65 takes an image of the calibration pattern 1 displayed by the display device 40. Alignment, position and distance of the display device 40 can be determined with the aid of the alignment sensor 47, the position sensor 48 or the distance sensor 49 or the measuring tape. Since the calibration pattern 1 is electronic or digital, the sensor data of the sensors 47,
  • the distance, position and / or orientation of the display device 40 relative to the vehicle 60 may e.g. can be entered manually via one of the input and output units 54, 84. Position, distance and alignment could thus also be determined and entered manually, e.g. by means of the tape measure.
  • the input unit can e.g. Be part of the display device 40, the vehicle diagnostic device 50 and / or the mobile terminal 80. In this way, the calibration pattern 1 can be mapped as a function of the distance, the position (left / right) and the alignment (orientation) of the display device 40 to the vehicle 60.
  • a size, position and / or orientation of the calibration pattern 1 mapped by the display device 40 can be set as a function of the position and / or orientation of the display device 40 in relation to the vehicle 60.
  • the display device 40 can modify the calibration pattern 1 to be displayed, e.g. move, rotate, reduce and / or enlarge, and map the modified calibration pattern 1.
  • the projector 45 can be rotated or displaced (to the left / right or to the rear / front) relative to the display wall 44 in order to modify the calibration pattern 1 shown on the display wall 44.
  • at least one optical component used in the projector 45 can be adjusted in order to modify the calibration pattern 1 projected onto the display panel 44.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Biomedical Technology (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Instrument Panels (AREA)
  • Mechanical Engineering (AREA)

Abstract

La présente invention concerne un procédé d'étalonnage d'au moins une caméra (65) d'un système d'assistance à la conduite (64), comprenant les étapes suivantes : - la représentation d'un modèle d'étalonnage (1) au moyen d'un dispositif d'affichage (40) et - le transfert d'une instruction de commande à la caméra (65) pour recevoir le modèle d'étalonnage (1) représenté par le dispositif d'affichage. La présente invention concerne en outre un autre procédé, un dispositif (10), un serveur (70) et un système (100) d'étalonnage d'au moins une caméra (65) d'un système d'assistance à la conduite (64).
EP20711616.1A 2019-03-26 2020-03-21 Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'assistance à la conduite Pending EP3903286A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP19165195.9A EP3716211A1 (fr) 2019-03-26 2019-03-26 Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'aide à la conduite
PCT/EP2020/057899 WO2020193442A1 (fr) 2019-03-26 2020-03-21 Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'assistance à la conduite

Publications (1)

Publication Number Publication Date
EP3903286A1 true EP3903286A1 (fr) 2021-11-03

Family

ID=65991614

Family Applications (2)

Application Number Title Priority Date Filing Date
EP19165195.9A Withdrawn EP3716211A1 (fr) 2019-03-26 2019-03-26 Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'aide à la conduite
EP20711616.1A Pending EP3903286A1 (fr) 2019-03-26 2020-03-21 Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'assistance à la conduite

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP19165195.9A Withdrawn EP3716211A1 (fr) 2019-03-26 2019-03-26 Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'aide à la conduite

Country Status (5)

Country Link
US (1) US20220191468A1 (fr)
EP (2) EP3716211A1 (fr)
AU (1) AU2020249324A1 (fr)
CA (1) CA3134425A1 (fr)
WO (1) WO2020193442A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11644350B2 (en) * 2019-12-30 2023-05-09 GM Cruise Holdings LLC. Illuminated vehicle sensor calibration target
US11870973B2 (en) * 2021-07-27 2024-01-09 Deere & Company Camera calibration tool

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006056232B4 (de) * 2006-11-29 2017-08-17 Bayerische Motoren Werke Aktiengesellschaft Vorrichtung zur Kalibrierung einer Kamera
DE102007021106B4 (de) * 2007-05-03 2016-11-17 Adc Automotive Distance Control Systems Gmbh Verfahren und Vorrichtung zum Kalibrieren eines Kamerasystems
US8489353B2 (en) * 2009-01-13 2013-07-16 GM Global Technology Operations LLC Methods and systems for calibrating vehicle vision systems
DE102015008551A1 (de) * 2015-07-07 2016-01-14 Daimler Ag Kalibrierung einer Kameraeinheit eines Kraftwagens
DE102015112368A1 (de) 2015-07-29 2017-02-02 Hella Gutmann Solutions GmbH Verfahren und Vorrichtung zur Kalibrierung von Assistenzsystemen von Fahrzeugen
DE202015106939U1 (de) 2015-07-29 2016-04-06 Hella Gutmann Solutions GmbH Vorrichtung zur Kalibrierung wenigstens eines Radarsensors
DE202015008954U1 (de) 2015-07-29 2016-04-26 Hella Gutmann Solutions GmbH Vorrichtung zur Kalibrierung von Assistenzsystemen von Fahrzeugen
DE202016103584U1 (de) 2016-05-19 2016-08-16 Hella Gutmann Solutions GmbH Vorrichtung zur Kalibrierung eines in die Windschutzscheibe eines Fahrzeuges integrierten Umfeldsensors

Also Published As

Publication number Publication date
AU2020249324A1 (en) 2021-10-21
WO2020193442A1 (fr) 2020-10-01
CA3134425A1 (fr) 2020-10-01
EP3716211A1 (fr) 2020-09-30
US20220191468A1 (en) 2022-06-16

Similar Documents

Publication Publication Date Title
EP1842382B1 (fr) Dispositif, procédé, programme et support d'informations associés permettant de déterminer les caractéristiques d'un objet basé sur des images prises par un appareil photo
EP1376051B1 (fr) Calibration d'un système de capteur d'images monté sur un véhicule par un objet de calibration et un capteur de position relative
EP1184640B1 (fr) Dispositif de mesure de la géométrie d' un véhicule
DE10066379B4 (de) Verfahren und Einrichtung zur Realisierung eines Informations- und Datenflusses für geodätische Geräte
WO2018153723A1 (fr) Dispositif et procédé d'étalonnage de systèmes d'aide à la conduite
DE102016219455B4 (de) Verfahren und aktive Infrastruktur zur Überprüfung einer Umfelderfassung eines Kraftfahrzeugs
WO2018050173A1 (fr) Banc d'essai pour véhicule destiné à étalonner et/ou tester les systèmes d'un véhicule qui comprennent au moins une caméra et procédé pour étalonner et/ou tester les systèmes d'un véhicule qui comprennent au moins une caméra
DE102017115318A1 (de) Heads-Up-Anzeige zum Beobachten von Fahrzeugwahrnehmungsaktivität
DE10308525A1 (de) Vermessungssystem
DE2948573A1 (de) Verfahren und anordnung zur beruehrungslosen achsvermessung an kraftfahrzeugen
DE102010004165A1 (de) Verfahren und Systeme zum Kalibrieren von Fahrzeugsichtsystemen
EP1141655B1 (fr) Dispositif de balisage
DE202012103986U1 (de) Komplex zur Videofixierung und Messung von Geschwindigkeit und Koordinaten von Fahrzeugen
EP3002578A1 (fr) Dispositif de verification et agencement de verification
DE102014226020A1 (de) Verfahren und Vorrichtung zur Kalibrierung mindestens einer mobilen Sensoreinrichtung
EP3903286A1 (fr) Procédé, dispositif, serveur et système d'étalonnage d'au moins une caméra d'un système d'assistance à la conduite
EP3052359A1 (fr) Procédé et dispositif pour surveiller le fonctionnement d'un système d'aide à la conduite
EP3475921B1 (fr) Procédé et système de commande de véhicule permettant de créer des images d'un modèle d'environnement et véhicule correspondant
EP2131598A2 (fr) Système de caméra stéréo et procédé de détermination d'au moins une erreur de calibrage d'un système de caméra stéréo
DE102006051539A1 (de) Verfahren und Vorrichtung zur luftbildgestützten Umgebungserfassung bei Kraftfahrzeugen
EP2180305A1 (fr) Procédé de test et/ou de vérification du fonctionnement d'au moins un capteur d'environnement intégré dans un véhicule automobile, ainsi qu'agencement correspondant
DE102012102600B3 (de) Verfahren zur Verifizierung der Ausrichtung eines Verkehrsüberwachungsgerätes
DE4322917A1 (de) Prüfsystem für Fahrzeugscheinwerfer
DE102021110287A1 (de) Verfahren und System zum automatisierten Kalibrieren von Sensoren
DE102022211656B3 (de) Verfahren und System zur Ermittlung wenigstens einer geometrischen Größe eines Fahrzeuggespanns zur Steuerung eines Fahrerassistenzsystems des Fahrzeugs

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210730

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230705