US10140531B2 - Detection of brake lights of preceding vehicles for adaptation of an initiation of active safety mechanisms - Google Patents

Detection of brake lights of preceding vehicles for adaptation of an initiation of active safety mechanisms Download PDF

Info

Publication number
US10140531B2
US10140531B2 US15/868,344 US201815868344A US10140531B2 US 10140531 B2 US10140531 B2 US 10140531B2 US 201815868344 A US201815868344 A US 201815868344A US 10140531 B2 US10140531 B2 US 10140531B2
Authority
US
United States
Prior art keywords
brake light
detection area
front camera
preceding vehicle
warning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US15/868,344
Other languages
English (en)
Other versions
US20180137380A1 (en
Inventor
Muhammad Alrefai
Mihai Baneu
Guido Fuchs
Mario Götz
Yasir Mannisseri
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Conti Temic Microelectronic GmbH
Original Assignee
Conti Temic Microelectronic GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Conti Temic Microelectronic GmbH filed Critical Conti Temic Microelectronic GmbH
Assigned to CONTI TEMIC MICROELECTRONIC GMBH reassignment CONTI TEMIC MICROELECTRONIC GMBH ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: Götz, Mario, Dr., BANEU, MIAHI, Mannisseri, Yasir, ALREFAI, Muhammad, FUCHS, Guido
Publication of US20180137380A1 publication Critical patent/US20180137380A1/en
Application granted granted Critical
Publication of US10140531B2 publication Critical patent/US10140531B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • G06K9/00825—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T7/00—Brake-action initiating means
    • B60T7/12—Brake-action initiating means for automatic initiation; for initiation not subject to will of driver or passenger
    • B60T7/22—Brake-action initiating means for automatic initiation; for initiation not subject to will of driver or passenger initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle, or by means of contactless obstacle detectors mounted on the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
    • B60W40/105—Speed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T2201/00—Particular use of vehicle brake systems; Special systems using also the brakes; Special software modules within the brake system controller
    • B60T2201/02—Active or adaptive cruise control system; Distance control
    • B60T2201/022—Collision avoidance systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T2210/00—Detection or estimation of road or environment conditions; Detection or estimation of road shapes
    • B60T2210/30—Environment conditions or position therewithin
    • B60T2210/32—Vehicle surroundings
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00—Input parameters relating to overall vehicle dynamics
    • B60W2520/28—Wheel speed

Definitions

  • a vehicle may autonomously decide to initiate an automatic emergency braking (AEB) or to modify the braking process. This decision is based on sensor data about the surroundings of the vehicle.
  • AEB automatic emergency braking
  • High-cost sensors such as, for example, radar sensors but also low-cost sensors such as, for example, an infrared short-range lidar are able to measure the position, distance and relative speed of a preceding vehicle and to derive an appropriate deceleration therefrom. These estimated values can be improved by using vehicle cameras or can be provided by the vehicle cameras.
  • the safety features of a vehicle can be categorized as passive and active safety features.
  • Passive safety features include means for protecting the passengers from injuries or for reducing the risk of injuries. In a broader sense, passive safety also includes protecting other road users.
  • Passive safety features include, inter alia, the safety belt system, airbags, passenger cell and crumple zones of the vehicle.
  • the active safety features include systems which actively intervene in the driving situation, in particular driver assistance systems such as the electronic stability program (ESP), braking assistance systems and driver assistance systems which are connected to surroundings monitoring devices such as, for example, cameras, radars, and lidars.
  • driver assistance systems such as the electronic stability program (ESP)
  • ESP electronic stability program
  • braking assistance systems and driver assistance systems which are connected to surroundings monitoring devices such as, for example, cameras, radars, and lidars.
  • the present specification relates to an active safety feature using a camera system or a camera system having data fusion.
  • the initiation decision or an initiation sensitivity of active safety systems is adapted by optically detecting that the preceding vehicle is braking or is performing an emergency braking.
  • Image processing of vehicle camera images can improve an estimated value of an intended deceleration by providing a detection of a brake light status of a preceding vehicle. This information is used to help to gauge a collision risk for the adaptation of the initiation sensitivity of active safety functions.
  • a required deceleration can be gauged more precisely than by simply estimating absolute or relative dimensions of detected image objects of a camera image. Furthermore, a deceleration of a preceding vehicle can be provided more promptly and more accurately, and the estimate is better suited to gauging the collision risk.
  • the camera images are evaluated and it is detected whether the brake lights of the preceding vehicle are activated or are being activated. Furthermore, an emergency braking is detected, which is indicated by the brake lights or brake lights and hazard flashing of the preceding vehicle, for example by a rapid flashing of the brake lights or a periodic flashing of the indicator lights on both sides of the vehicle (hazard flashing) in addition to activating the brake lights.
  • the brake light status of a vehicle which is driving in front of the present vehicle is used to derive a risk value or hazard value.
  • the risk value may depend on a deceleration of the present vehicle in the longitudinal direction, for example for the detection of downhill driving, or on a combination with a camera-based plausibility estimate.
  • the risk value may depend, inter alia, on the distance of the preceding vehicle at the moment of braking, or on an increase or decrease in the relative speed.
  • the risk value may also depend on a prediction of a lane orientation or respectively a lane profile and of a lane width. An initiation sensitivity of an active safety system is adapted accordingly.
  • initiation thresholds such as, for example, a threshold for initiating a warning, a brake prefill, a hydraulic brake assistance (HBA) or an automatic emergency braking (AEB), are lowered in order to arrive at an initiation decision earlier.
  • HBA hydraulic brake assistance
  • AEB automatic emergency braking
  • the lowering of the thresholds is only carried out for a predetermined period of time which is started by a status transition from the status “brake lights off” to the status “brake lights on”.
  • the brake lights (and optionally, in addition, the hazard warning lights) of the present vehicle are controlled directly or indirectly if a high risk value is detected, as a function of the brake light of the preceding vehicle, in order to warn the traffic behind of a possible collision or collision avoidance braking.
  • the controlling of the brake lights is initiated in addition to the weak initiation decision with respect to the warning, prefill, HBA, etc.
  • the option of controlling the brake lights can be activated or deactivated based on predetermined conditions.
  • the predetermined conditions may be provided by pre-configured settings such as, for example, a pre-configured table.
  • the option of controlling the brake lights may be activated for vehicles such as SUVs, minibuses or caravans, in the case of which the traffic behind may not be able to detect the third upper brake light of the preceding vehicle.
  • the pre-configured settings may depend on whether the traffic regulations in a sales region in which the vehicle is sold allow the brake lights to be controlled. In one embodiment, the warning lights are controlled one or multiple times instead, if controlling of the brake lights is deactivated based on the pre-configured settings.
  • active safety mechanisms such as a warning, a brake prefill or HBA, are activated and/or a confidence value of the object detection is raised if a result of the object detection is confirmed by a detection of the brake light status.
  • emergency brake lights or warning lights are activated autonomously if an emergency braking of the preceding vehicle is detected.
  • the autonomous activation may furthermore depend on the extent of the braking or deceleration of the present vehicle.
  • two top-of-the-range or mid-range vehicles which are both equipped with brake lights that indicate an emergency braking by an increased flashing rate and/or by an increased brightness, are driving one behind the other.
  • the preceding vehicle performs an emergency braking. If the driver in the vehicle behind responds in time and moderately, no activation of the active safety means is necessary. Nevertheless, the vehicle behind autonomously indicates an emergency braking to the traffic behind via the brake lights or the warning lights.
  • sensor data are fused or merged and the automatic risk assessment is applied to the fused data.
  • active and passive safety systems are integrated or combined and an image detection or a risk assessment according to the current specification is applied to active safety features and, if possible, also to passive safety features. For example, a threshold or an operating mode for initiating an airbag can be modified based on the risk assessment.
  • the current specification discloses, inter alia, a computer-implemented method for determining a warning condition on the basis of brake light detection of a car or vehicle driving in front of the present vehicle. If the warning condition is fulfilled, a warning signal is produced in order to initiate an active safety feature of the present car.
  • image data are received from a front camera of a present vehicle either by means of a separate connection cable or via a suitable automotive data bus such as, for example, the MOST bus.
  • MOST 150 is suitable for use by modern driver assistance systems.
  • the image data comprise image frames, which comprise pixels.
  • the pixels may correspond to grayscale pixels but also, for example, to pixels that comprise intensity and color data.
  • a brake light may be detected using an intensity in the red color range.
  • a detection area is identified in the image frames of the front camera.
  • the detection area comprises a location of a left brake light and of a right brake light of a preceding vehicle.
  • the detection area is identified with image detection and tracking.
  • the image detection can be based on the outer outline of the preceding vehicle or other characteristic features such as the license plate, the rear window or the rear lights.
  • Appropriate positions of the left brake light and of the right brake light are identified within the detection area.
  • the detection of the brake light positions may involve techniques such as edge detection and tracking, intensity detection, or detection of an intensity in a predefined color range.
  • the left brake light, the right brake light, or both is/are active by evaluating an intensity distribution in the detection area. This may also include tracking the brake light intensity over time, for example in order to detect a warning mode in which the intensity of the brake light changes periodically. In a further embodiment, time intervals of the changing intensity are determined.
  • the detection may include detecting whether the brake light flashes faster. By way of example, the flashing may indicate an emergency condition or that a warning is “forwarded” from another vehicle.
  • an initiation threshold is lowered if it is determined that at least one of the left or right brake lights of the preceding vehicle is active, and an estimated risk value is derived from at least the image data of the front camera.
  • sensor data such as radar and lidar data, etc.
  • Other sensor data such as radar and lidar data, etc. may also be used to derive the estimated risk value, if said data are available within the framework of a sensor data fusion.
  • image data By only using the image data, an inexpensive solution can be provided, which is simple to implement.
  • a premium vehicle camera with high-quality, high-resolution mono-vision images may be sufficient to derive the estimated risk value.
  • the at least one estimated risk value is derived from the image data of the front camera and, optionally, also from other measurements.
  • the estimated risk value is derived from at least one value consisting of a distance from the preceding vehicle, a relative or absolute speed of the preceding vehicle, and a relative or absolute deceleration of the preceding vehicle, or from a combination thereof.
  • a warning signal is initiated, if the estimated risk value exceeds the trigger threshold.
  • the absolute speed and deceleration of the preceding vehicle may be determined by using the camera ego-motion, which is determined by means of the image data and, indeed, using the speed relative to the ground or other stationary objects as reference or also by using other sensor data such as, for example, speedometer data.
  • a confidence value which relates to one or more estimated risk values is raised, if it is detected that a brake light of the preceding vehicle is active.
  • the confidence value assumes values between 0 and 100% and is an indication of a statistical probability that a given measurement or a combination of such measurements is correct.
  • the measurement may refer to a distance from the preceding vehicle, a relative or absolute speed of the preceding vehicle, and a relative or absolute deceleration of the preceding vehicle, or a combination thereof.
  • a warning signal is produced, if the estimated risk value exceeds the initiation threshold.
  • the confidence value is linked to a confidence interval around a measurement.
  • the increase in the confidence value relates to a reduction in the confidence interval by a predefined factor.
  • a warning signal is produced, if the confidence value exceeds a predefined confidence threshold.
  • the initiation threshold depends on a type of the present vehicle, on the operability of the present vehicle such as, for example, brake functionality, tire grip, tire pressure, and on the loading of the present vehicle.
  • the first and second aspect of the method can also be combined, for example by producing the warning signal if the initiation threshold and the confidence threshold are both exceeded. Furthermore, the features indicated below can be combined with the first and/or with the second aspect.
  • an active safety function is activated, if an estimated risk value exceeds the initiation threshold and/or if the confidence value exceeds the confidence threshold.
  • the active safety function is selected from a collision warning, a brake prefill, a hydraulic brake assistance and an active emergency braking, or from a combination thereof.
  • a second detection area is determined in the image frames of the front camera.
  • the second detection area comprises a position of the upper brake light of the preceding vehicle.
  • a position of the upper brake light is detected within the second detection area and a status of the upper brake light is detected.
  • the initiation threshold is lowered and/or the confidence value is raised if it is detected that the upper brake light is activated.
  • a speed signal is received from a vehicle speed sensor of the present vehicle such as, for example, a wheel speed sensor, and the estimated risk value is derived from the image data of the front camera and from the speed signal of the speed sensor.
  • the intensity of one of the detected brake lights is analyzed. Furthermore, it is detected whether a warning brake light function is activated, for example by reading out a setting from a computer memory. If it is detected that the warning brake light function is activated, a brake light of the present vehicle is placed in a warning mode, if the estimated risk value exceeds a second initiation threshold, wherein the second initiation threshold is higher than the first initiation threshold.
  • a geographical region of the present vehicle is detected and the warning brake light function is activated or deactivated depending on the detected geographical region, for example by using a satellite positioning system such as GPS, a stored map, motion and acceleration sensors, or position determination via a wireless network.
  • a satellite positioning system such as GPS, a stored map, motion and acceleration sensors, or position determination via a wireless network.
  • At least one brake light of the preceding vehicle in particular an upper brake light, is active and it is determined whether the active brake light is currently operating in an emergency braking mode.
  • a condition for activating a warning or an emergency brake light mode of the present vehicle is checked.
  • a brake light of the present vehicle is placed into a warning or emergency braking mode.
  • the warning mode is maintained for a predefined time or for as long as the condition is fulfilled.
  • the activation condition may be tested repeatedly. If it is detected that the active brake light of the preceding vehicle is no longer operating in emergency braking mode, the brake light mode of the present vehicle is switched back to normal.
  • the present specification discloses a computer program product for executing the steps of the aforementioned method.
  • the present specification discloses a controller for the activation of automotive safety features, wherein the automotive safety features comprise at least one active safety feature.
  • the controller comprises an input connection for receiving image data of a front camera of a present vehicle and an output connection for outputting a warning signal.
  • the controller is configured to execute a method for determining a warning condition, for example by providing suitable circuitry such as, for example, a microcontroller, an ASIC or another integrated circuit, and one or more computer-readable memory units connected thereto and a connection to a power supply of the present car, wherein the computer-readable memory comprises computer-readable instructions.
  • suitable circuitry such as, for example, a microcontroller, an ASIC or another integrated circuit, and one or more computer-readable memory units connected thereto and a connection to a power supply of the present car, wherein the computer-readable memory comprises computer-readable instructions.
  • the controller is configured to receive image data from a front camera of the present vehicle via the input connection, wherein the image data contain image frames.
  • the controller determines a detection area in the image frames of the front camera, wherein the detection area includes a position of a left brake light and of a right brake light of a preceding vehicle.
  • the controller estimates appropriate positions of the left brake light and of the right brake light within the detection area and determines whether at least one of the left brake light and the right brake light is active by evaluating an intensity distribution of the appropriate image pixels in the detection area.
  • the controller lowers or decreases an initiation threshold if it is established that at least one of the left brake light and the right brake light of the preceding vehicle is active.
  • the controller furthermore derives an estimated risk value from the image data of the front camera and from other sensor data such as radar and lidar, etc., if available.
  • the estimated risk value is derived from at least one of a distance from the preceding vehicle, a relative speed of the preceding vehicle and a deceleration of the preceding vehicle, or from a combination thereof.
  • the present specification discloses a kit with a controller and a front camera for a vehicle, wherein the front camera is connectable to the controller, either directly or via an automotive data bus.
  • the present specification discloses a vehicle with the kit, wherein the front camera is mounted on the vehicle and faces towards an area in front of the vehicle, and wherein the controller is installed in the vehicle and is connected directly or indirectly to the front camera.
  • the present specification discloses a controller for the activation of automotive safety features according to a second aspect, which involves the raising of a confidence value in response to a brake light detection, and wherein the automotive safety features include at least one active safety feature.
  • the controller according to the second aspect comprises an input connection for receiving image data of a front camera of a present vehicle and an output connection for outputting a warning signal.
  • the controller is configured to execute a method for determining a warning condition, for example by providing suitable circuitry such as, for example, a microcontroller, an ASIC or another integrated circuit, and one or more computer-readable memory units connected thereto and a connection to a power supply of the present car, wherein the computer-readable memory contains computer-readable instructions.
  • suitable circuitry such as, for example, a microcontroller, an ASIC or another integrated circuit, and one or more computer-readable memory units connected thereto and a connection to a power supply of the present car, wherein the computer-readable memory contains computer-readable instructions.
  • the controller is configured to receive image data from a front camera of a present vehicle via the input connection, wherein image data comprise image frames.
  • the controller determines a detection area in the image frames of the front camera, wherein the detection area comprises a position of a left brake light and of a right brake light of a preceding vehicle.
  • the controller estimates respective positions of the left brake light and of the right brake light within the detection area and determines whether at least one of the left brake light and the right brake light is active by evaluating an intensity distribution of appropriate image pixels in the detection area.
  • the controller raises a confidence value of at least one estimated risk value, which is derived from the image data of the front camera, initiates a warning signal, if the confidence value exceeds a predetermined confidence threshold and outputs the warning signal via the output connection.
  • the present specification discloses a kit with the controller and a front camera for a vehicle, wherein the front camera is connectable to the controller, either directly or via an automotive data bus.
  • the present specification discloses a vehicle with the kit, wherein the front camera is mounted on the vehicle and faces towards an area in front of the vehicle, and wherein the controller is installed in the vehicle and is connected directly or indirectly to the front camera.
  • FIG. 1 shows a detection of a car which is driving ahead of a present car
  • FIG. 2 shows a detection of brake light activation of the car of FIG. 1 ,
  • FIG. 3 illustrates an adaptation of a threshold in response to the detection of the brake light activation
  • FIG. 4 illustrates an adaptation of a confidence value in response to a detection of a brake light activation
  • FIG. 5 shows a control system for an active safety feature of the present car.
  • FIG. 1 illustrates a detection of brake lights 11 , 12 , 13 of a preceding car 10 .
  • the car 10 ahead is aligned exactly parallel to the present car.
  • a first rectangular detection area 14 comprises an area in which the lower two brake lights 11 , 12 are likely to be found.
  • a second rectangular detection area 15 comprises an area in which an upper brake light may be found, if present.
  • the car that comprises the brake light detection system according to the present specification and the vehicle camera, and which provides the images of the car ahead is also referred to as the “present car” or the “present vehicle”.
  • the extent of the first rectangular detection area 14 is defined by predefined dimensions such as, for example, a dimension of 2 m width and 1.10 m height.
  • the width or both dimensions of the first rectangular detection area 14 is/are determined by an image detection procedure.
  • an initial size of the first rectangular detection area 14 is provided, and the initial rectangular detection area 14 is adapted according to an image detection procedure.
  • the alignment of the first rectangular detection area 14 is provided by an image detection procedure.
  • the image detection procedure may depend, inter alia, on a brightness of the scene, which varies during the course of the day and depends on the cloud cover, weather, scenery and surrounding buildings or tunnel illumination.
  • the dimensions of the second rectangular detection area 15 can be provided by predefined dimensions, for example a predefined dimension of 2 m by 50 cm, by an image detection or by a combination of both.
  • FIG. 2 illustrates an activated status of the brake lights 11 , 12 , 13 of the preceding vehicle 10 .
  • the activated status can be detected based on a brightness threshold and/or on color detection.
  • the absolute brightness of the received light depends on various factors such as the distance and alignment of the preceding car 10 , the design and the working condition of the brake lights 11 , 12 , 13 and the ambient conditions. For example, fog, smog and rain may affect the visibility of the brake lights 11 , 12 , 13 .
  • the received light intensity also depends on the camera parameters, the working condition of the vehicle camera that receives the light, and on the condition of any objects in front of it such as, for example, a windscreen.
  • the image processing unit estimates the aforementioned factors and adapts the brightness threshold and/or the color threshold accordingly.
  • the image processing unit detects a relative change in brightness or color of camera image frames.
  • the image processing unit may identify brake light areas in the detection areas 14 , 15 and assign a higher weight to the identified brake light areas, or limit the detection of absolute or relative brightness or color to the identified brake light areas.
  • FIG. 3 shows a variation 20 of a criticality measure Cr over a time t, a first threshold 21 or upper threshold 21 and a second threshold 22 or lower threshold 22 .
  • the first threshold 21 is used for an automatic risk assessment without the use of a brake light detection according to the present specification.
  • the second threshold 22 is used for an automatic risk assessment, which makes use of a brake light detection according to the present specification.
  • the criticality measure Cr may be derived from a distance and a relative deceleration of the preceding car 10 and from a speed of the present vehicle.
  • FIG. 4 illustrates an increase in a confidence value or measure “Conf” as a consequence of a brake light detection according to the present specification.
  • a dashed line 23 indicates a confidence threshold 23 .
  • the confidence threshold 23 must be exceeded in order to trigger a safety mechanism.
  • a confidence value 24 according to the smaller rectangle corresponds to a method using image detection but no brake light status detection
  • the confidence value 25 according to the larger rectangle corresponds to a method using image detection and a brake light status detection according to the present specification.
  • the confidence value is raised by a predefined amount such as, for example, 5% if a brake light activation is detected.
  • FIG. 5 shows, by way of example, a control system 30 of a present vehicle which is not shown in FIG. 5 .
  • the control system 30 comprises a front camera 31 , a wheel speed sensor 32 and a front brake 33 of the present car and a controller 35 .
  • the front camera 31 , the wheel speed sensor 32 and the front brake 33 are connected to the controller 35 .
  • the controller 30 controls a brake shoe 34 of the front brake 33 such that the brake shoe 34 can be moved between an open position and a prefill position.
  • the movement of the brake shoe 34 is indicated by a double arrow.
  • the front brake 33 acts on a brake disk, which is not shown in FIG. 5 for the sake of simplicity.
  • a preceding vehicle 36 with brake lights 37 , 38 is arranged within a camera angle 39 of the front camera 31 .
  • the front camera 31 delivers image frames which contain an image of the preceding vehicle 36 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)
  • Lighting Device Outwards From Vehicle And Optical Signal (AREA)
  • Regulating Braking Force (AREA)
US15/868,344 2015-07-13 2018-01-11 Detection of brake lights of preceding vehicles for adaptation of an initiation of active safety mechanisms Active US10140531B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE102015213078.9A DE102015213078A1 (de) 2015-07-13 2015-07-13 Bremslichterkennung bei vorausfahrenden Fahrzeugen zur Anpassung einer Auslösung aktiver Sicherheitsmechanismen
DE102015213078.9 2015-07-13
DE102015213078 2015-07-13
PCT/DE2016/200310 WO2017008801A1 (de) 2015-07-13 2016-07-06 Bremslichterkennung bei vorausfahrenden fahrzeugen zur anpassung einer auslösung aktiver sicherheitsmechanismen

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2016/200310 Continuation WO2017008801A1 (de) 2015-07-13 2016-07-06 Bremslichterkennung bei vorausfahrenden fahrzeugen zur anpassung einer auslösung aktiver sicherheitsmechanismen

Publications (2)

Publication Number Publication Date
US20180137380A1 US20180137380A1 (en) 2018-05-17
US10140531B2 true US10140531B2 (en) 2018-11-27

Family

ID=56617967

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/868,344 Active US10140531B2 (en) 2015-07-13 2018-01-11 Detection of brake lights of preceding vehicles for adaptation of an initiation of active safety mechanisms

Country Status (5)

Country Link
US (1) US10140531B2 (de)
JP (1) JP7096150B2 (de)
KR (1) KR102657202B1 (de)
DE (2) DE102015213078A1 (de)
WO (1) WO2017008801A1 (de)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10133275B1 (en) 2017-03-01 2018-11-20 Zoox, Inc. Trajectory generation using temporal logic and tree search
US10671076B1 (en) 2017-03-01 2020-06-02 Zoox, Inc. Trajectory prediction of third-party objects using temporal logic and tree search
KR101988563B1 (ko) * 2017-10-26 2019-09-30 주식회사 만도 차량 충돌 방지 제어 장치, 차량 충돌 방지 제어 시스템 및 차량 충돌 방지 제어 방법
US10955851B2 (en) 2018-02-14 2021-03-23 Zoox, Inc. Detecting blocking objects
US10414395B1 (en) 2018-04-06 2019-09-17 Zoox, Inc. Feature-based prediction
US11126873B2 (en) * 2018-05-17 2021-09-21 Zoox, Inc. Vehicle lighting state determination
CN108922196B (zh) * 2018-06-10 2021-06-22 蚌埠科睿达机械设计有限公司 一种交叉口防碰撞系统
US10710560B2 (en) * 2018-08-03 2020-07-14 Toyota Motor Engineering & Manufacturing North America, Inc. Trailer brake controller (TBC) failsafe using detection camera
CN109635830B (zh) * 2018-10-24 2020-11-06 吉林大学 用于估算汽车质量的有效数据的筛选方法
JP7173702B2 (ja) * 2019-02-27 2022-11-16 トヨタ自動車株式会社 評価装置
KR20210012463A (ko) 2019-07-25 2021-02-03 엘지전자 주식회사 차량 단말 및 그의 동작 방법
KR20190098735A (ko) 2019-08-01 2019-08-22 엘지전자 주식회사 차량 단말 및 그의 동작 방법
CN111002904B (zh) * 2019-12-20 2022-04-22 铁将军汽车电子股份有限公司 前方碰撞预警系统及其配置方法和装置
DE102020114488B3 (de) 2020-05-29 2021-12-02 Sick Ag Optoelektronischer Sicherheitssensor und Verfahren zur Absicherung einer Maschine
DE102020212327A1 (de) 2020-09-30 2022-03-31 Robert Bosch Gesellschaft mit beschränkter Haftung Rekuperationseinrichtung und Verfahren zur Rekuperationssteuerung
DE102020214813A1 (de) 2020-11-25 2022-05-25 Zf Friedrichshafen Ag System, Verfahren und Computerprogramm zum adaptiven Regeln einer Längsregelung eines Egofahrzeuges in Abhängigkeit einer Position und/oder einer Geschwindigkeit eines vorausfahrenden Fremdfahrzeuges und automatisiert betreibbares Fahrzeug
JP2022091537A (ja) * 2020-12-09 2022-06-21 トヨタ自動車株式会社 運転支援装置
US20220281451A1 (en) * 2021-03-04 2022-09-08 GM Global Technology Operations LLC Target vehicle state identification for automated driving adaptation in vehicles control
US11639181B2 (en) * 2021-09-29 2023-05-02 Nissan North America, Inc. Lead vehicle braking warning system
DE102022200476A1 (de) 2022-01-18 2023-07-20 Zf Friedrichshafen Ag Schutzsystem und Schutzsystemverfahren für Umfeldverkehrsteilnehmer
KR102537901B1 (ko) 2023-01-27 2023-05-31 케이지모빌리티 주식회사 전방 차량 브레이크 연동 비상회피 운전시스템 및 방법

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006089498A1 (de) 2005-02-22 2006-08-31 Adc Automotive Distance Control Systems Gmbh Verfahren zur erkennung der aktivierung von bremsleuchten vorausfahrender fahrzeuge
US7365769B1 (en) 2000-07-06 2008-04-29 Donald Mager Activating a vehicle's own brake lights and/or brakes when brake lights are sensed in front of the vehicle, including responsively to the proximity of, and/or rate of closure with, a forward vehicle
DE102009025545A1 (de) 2009-06-15 2010-12-16 Hella Kgaa Hueck & Co. Verfahren und Vorrichtung zum Erkennen von Bremslichtsystemen
US20120044066A1 (en) * 2010-08-23 2012-02-23 Harman Becker Automotive Systems Gmbh System for vehicle braking detection
WO2014154213A1 (de) 2013-03-26 2014-10-02 Continental Automotive Gmbh Verfahren zur auslösung einer fahrerassistenzfunktion bei einer detektion eines bremslichtes mittels einer kamera
US20140379233A1 (en) * 2013-06-19 2014-12-25 Magna Electronics Inc. Vehicle vision system with collision mitigation

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3214938B2 (ja) * 1993-02-01 2001-10-02 富士通テン株式会社 画像情報を利用したｆｍ−ｃｗレーダシステム
JPH08221700A (ja) * 1995-02-17 1996-08-30 Suzuki Motor Corp ストップランプ認識装置
JPH0966822A (ja) * 1995-09-04 1997-03-11 Fuji Heavy Ind Ltd 自動ブレーキ装置
JP2001199260A (ja) 2000-01-20 2001-07-24 Matsushita Electric Ind Co Ltd 車間距離制御装置、車両走行状況表示装置、車速制御解除装置、及び車両急制動警告装置
JP2006335134A (ja) 2005-05-31 2006-12-14 Nissan Motor Co Ltd ブレーキ点灯形態制御装置、追突警報装置、車間制御装置、ブレーキランプ情報伝達システム及びブレーキランプ情報伝達方法
JP2007128430A (ja) 2005-11-07 2007-05-24 Toyota Motor Corp 車両用警報装置
JP4765844B2 (ja) 2006-08-31 2011-09-07 トヨタ自動車株式会社 運転支援装置
JP2009190686A (ja) 2008-02-18 2009-08-27 Mitsubishi Motors Corp 危険回避支援システム
JP2011057072A (ja) 2009-09-09 2011-03-24 Mitsubishi Fuso Truck & Bus Corp 自動制動装置
KR101829006B1 (ko) * 2011-09-09 2018-02-14 현대모비스 주식회사 차량 충돌 경보 제어 장치 및 방법
JP5767265B2 (ja) 2013-03-27 2015-08-19 富士重工業株式会社 車両の高電圧系制御装置

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7365769B1 (en) 2000-07-06 2008-04-29 Donald Mager Activating a vehicle's own brake lights and/or brakes when brake lights are sensed in front of the vehicle, including responsively to the proximity of, and/or rate of closure with, a forward vehicle
WO2006089498A1 (de) 2005-02-22 2006-08-31 Adc Automotive Distance Control Systems Gmbh Verfahren zur erkennung der aktivierung von bremsleuchten vorausfahrender fahrzeuge
EP1851681A1 (de) 2005-02-22 2007-11-07 A.D.C. Automotive Distance Control Systems GmbH Verfahren zur erkennung der aktivierung von bremsleuchten vorausfahrender fahrzeuge
DE102009025545A1 (de) 2009-06-15 2010-12-16 Hella Kgaa Hueck & Co. Verfahren und Vorrichtung zum Erkennen von Bremslichtsystemen
US20120044066A1 (en) * 2010-08-23 2012-02-23 Harman Becker Automotive Systems Gmbh System for vehicle braking detection
US20150123781A1 (en) 2010-08-23 2015-05-07 Harman Becker Automotive Systems Gmbh System for vehicle braking detection
WO2014154213A1 (de) 2013-03-26 2014-10-02 Continental Automotive Gmbh Verfahren zur auslösung einer fahrerassistenzfunktion bei einer detektion eines bremslichtes mittels einer kamera
US20160110620A1 (en) * 2013-03-26 2016-04-21 Continental Automotive Gmbh Method for Triggering a Driver Assistance Function Upon Detection of a Stop Light by Means of a Camera
US20140379233A1 (en) * 2013-06-19 2014-12-25 Magna Electronics Inc. Vehicle vision system with collision mitigation

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
International Search Report and Written Opinion dated Nov. 4, 2016 from corresponding International Patent Application No. PCT/DE2016/200310.
Search Report dated Jan. 22, 2016 for corresponding German Patent Application No. 10 2015 213 078.9.
Wei Liu et al; "Vision-Based Method for Forward Vehicle Brake Lights Recognition"; International Journal of Signal Processing, Image Processing and Pattern Recognition; Bd. 8, Nr. 6, Jun. 30, 2015, pp. 167-180, XP055270150, ISSN: 2005-4524, D0I: 10.14257/ijsip.2015.8.6.18.
WEI LIU, HONG BAO, JUN ZHANG, CHENG XU: "Vision-Based Method for Forward Vehicle Brake Lights Recognition", INTERNATIONAL JOURNAL OF SIGNAL PROCESSING, IMAGE PROCESSING AND PATTERN RECOGNITION, vol. 8, no. 6, 30 June 2015 (2015-06-30), pages 167 - 180, XP055270150, ISSN: 2005-4254, DOI: 10.14257/ijsip.2015.8.6.18

Also Published As

Publication number Publication date
JP2018524730A (ja) 2018-08-30
US20180137380A1 (en) 2018-05-17
KR20180030823A (ko) 2018-03-26
KR102657202B1 (ko) 2024-04-15
DE112016002078A5 (de) 2018-02-08
DE102015213078A1 (de) 2017-01-19
JP7096150B2 (ja) 2022-07-05
WO2017008801A1 (de) 2017-01-19

Similar Documents

Publication Publication Date Title
US10140531B2 (en) Detection of brake lights of preceding vehicles for adaptation of an initiation of active safety mechanisms
EP3342661B1 (de) Auf sensorintegration basierende fussgängerdetektion und fussgängerkollisionsverhinderungsvorrichtung und -verfahren
KR101996415B1 (ko) 자세 정보 기반 보행자 탐지 및 보행자 충돌 방지 장치 및 방법
KR101996419B1 (ko) 센서 융합 기반 보행자 탐지 및 보행자 충돌 방지 장치 및 방법
US9827956B2 (en) Method and device for detecting a braking situation
US9797734B2 (en) Object recognition apparatus
CN106537180B (zh) 用于用针对行人的主动制动的摄影机输入缓解雷达传感器限制的方法
US11410556B2 (en) Vehicle front blind spot detection and warning system
US9358984B2 (en) Driver intention estimation arrangement
US9020747B2 (en) Method for recognizing a turn-off maneuver
CN109891262B (zh) 物体探测装置
US9346401B2 (en) Motor vehicle and method for operating a motor vehicle
KR101996417B1 (ko) 자세 정보 기반 보행자 탐지 및 보행자 충돌 방지 장치 및 방법
CN105473402A (zh) 车载控制装置
US9802565B2 (en) Safety system and method for operating a safety system of a vehicle
EP2913234A1 (de) Automatische Bremsung bei Rückwärtsfahren
JP2005202878A (ja) 物体検出装置
US11878670B2 (en) Apparatus and method for controlling vehicle to perform occupant assistance according to detection accuracy of autonomous sensor
US20230034560A1 (en) Method for tracking a remote target vehicle in an area surrounding a motor vehicle by means of a collision detection device
JP6011395B2 (ja) 車両の運転支援装置
CN112721806A (zh) 用于坡度路段的盲区辅助的方法和装置
US10717436B2 (en) Method and device for monitoring an area ahead of a vehicle
US20190315349A1 (en) Collision determination apparatus and method
US11195029B2 (en) Driver assistance system
CN116605245A (zh) 车辆转向辅助控制方法与系统

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: CONTI TEMIC MICROELECTRONIC GMBH, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ALREFAI, MUHAMMAD;BANEU, MIAHI;FUCHS, GUIDO;AND OTHERS;SIGNING DATES FROM 20171127 TO 20171220;REEL/FRAME:044964/0552

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4