US20200307453A1 - Driver assistance system, and control method for the same - Google Patents
Driver assistance system, and control method for the same Download PDFInfo
- Publication number
- US20200307453A1 US20200307453A1 US16/707,416 US201916707416A US2020307453A1 US 20200307453 A1 US20200307453 A1 US 20200307453A1 US 201916707416 A US201916707416 A US 201916707416A US 2020307453 A1 US2020307453 A1 US 2020307453A1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- warning
- time
- hands
- predetermined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 33
- 238000004904 shortening Methods 0.000 claims description 43
- 230000004044 response Effects 0.000 claims description 31
- 230000008859 change Effects 0.000 claims description 16
- 230000001133 acceleration Effects 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 8
- 230000003111 delayed effect Effects 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 2
- 230000001960 triggered effect Effects 0.000 claims 2
- 230000006399 behavior Effects 0.000 description 26
- 230000005540 biological transmission Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
- B60K28/066—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/095—Predicting travel path or likelihood of collision
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
- B60W40/06—Road conditions
- B60W40/072—Curvature of the road
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/025—Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation
-
- G06K9/00798—
-
- G06K9/00805—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo or light sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B60W2420/408—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/10—Longitudinal speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/10—Longitudinal speed
- B60W2520/105—Longitudinal acceleration
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/12—Lateral speed
- B60W2520/125—Lateral acceleration
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/14—Yaw
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
- B60W2552/30—Road curve radius
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2300/00—Purposes or special features of road vehicle drive control systems
- B60Y2300/08—Predicting or avoiding probable or impending collision
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/867—Combination of radar systems with cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9318—Controlling the steering
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9322—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles using additional data, e.g. driver condition, road state or weather data
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9323—Alternative operation using light waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9327—Sensor installation details
- G01S2013/93271—Sensor installation details in the front of the vehicles
Definitions
- the present invention relates to a driver assistance system and a control method for the same.
- the Advanced Driver Assistance System is a system that assists the driver in driving.
- a steering assistance system such as a lane keeping assist system or a lane following assist system, recognizes the lane in which the vehicle travels to maintain the vehicle in the lane without the driver's steering wheel manipulation.
- the conventional art warns the driver at a predetermined time when a hands-off situation is sensed from the steering wheel.
- the present invention provides a driver assistance system and a control method for the same, which can provide a warning message for a hands-off to a driver by adjusting a warning time-point for the hands-off according to a driving situation.
- a driver assistance system includes an image acquisition device configured to acquire image data of an area outside of the vehicle, a sensor configured to acquire behavior data of the vehicle, a hands-off detector configured to detect that a hand of the driver is off of a steering wheel, and a controller.
- the controller is configured to determine a driving situation of the vehicle based on the image data acquired by the image acquisition device and the behavior data acquired by the sensor, and to control a warning time-point for the hands-off detector based on the determined driving situation.
- the controller may determine whether the driving situation satisfies a warning point delay condition, may determine a delay time when the warning point delay condition is satisfied, and may control the warning time-point to be delayed by the delay time from a predetermined reference warning time-point.
- the controller may determine that the warning point delay condition is satisfied.
- the controller may adjust the delay time based on at least one of a current speed and a distance to an external object.
- the controller may determine whether the driving situation satisfies a warning point shortening condition, may determine a shortening time when the warning point shortening condition is satisfied, and may control the warning time-point to be ahead of a predetermined reference warning time-point by the shortening time.
- the controller may determine that the warning point shortening condition is satisfied.
- the controller may determine a different shortening time for each of a plurality of warning point shortening conditions.
- the driver assistance system may further include a warning device for outputting a warning message, and/or a radar configured to acquire radar data about an object outside the vehicle.
- the controller may determine the driving situation of the vehicle based on the radar data acquired by the radar, and/or the controller may control the warning device to output a warning message for the hands-off at the determined warning time-point.
- the warning device may output a warning message including at least one of a text, a voice, and an image.
- the behavior data may include yaw rate change amount, lateral acceleration change amount and longitudinal acceleration change amount.
- a control method of a driver assistance system may include acquiring image data of an area exterior to a vehicle, acquiring behavior data of the vehicle; detecting that a hand of the driver is off of a steering wheel, and determining a driving situation of the vehicle based on the acquired image data and the acquired behavior data.
- a warning time-point is determined for a hands-off notification based on the determined driving situation when the hand is detected to be off of the steering wheel.
- the determining of the warning time-point for the hands-off may include determining whether the driving situation satisfies a warning point delay condition, determining a delay time when the warning point delay condition is satisfied, and controlling the warning time-point to be delayed by the determined delay time from a predetermined reference warning time-point.
- the determining whether the driving situation satisfies a warning point delay condition may include determining that the warning point delay condition is satisfied when the vehicle is located within a predetermined distance from a center of a lane, a reliability of a lane is greater than a predetermined reliability, a risk of collision with an external object is less than a predetermined risk, and a curvature of a road ahead is less than a predetermined curvature.
- the determining a delay time may include adjusting the delay time based on at least one of a current speed and a distance to an external object.
- the determining of the warning time-point for the hands-off may include determining whether the driving situation satisfies a warning point shortening condition; determining a shortening time when the warning point shortening condition is satisfied; and controlling the warning time-point to be ahead of a predetermined reference warning time-point by the shortening time.
- the determining whether the driving situation satisfies a warning point shortening condition may include determining that the warning point shortening condition is satisfied in case of at least one of the vehicle is located outside a predetermined distance from a center of a lane, a reliability of at least one lane is less than a predetermined reliability, a risk of collision with an external object is greater than a predetermined risk, a curvature of the road ahead is more than a predetermined curvature, and behavior data of the vehicle is outside of a predetermined safety range.
- the determining of the shortening time may include determining a different shortening time for each of a plurality of different warning time-point shortening conditions.
- the control method of the driver assistance system may further include outputting a warning message for the hands-off at the determined warning point.
- the warning message may include at least one of a text, a voice, and an image.
- the behavior data may include a yaw rate change amount, a lateral acceleration change amount and a longitudinal acceleration change amount.
- a driver assistance system of a vehicle includes one or more sensors configured to acquire sensing data of an area outside of the vehicle, a hands-off detector configured to detect a hands-off condition in which a hand of a driver is off of a steering wheel of the vehicle, and a controller including at least one processor configured to process the sensing data.
- the controller is configured to monitor an environment surrounding the vehicle based on the acquired sensing data to determine a driving situation of the vehicle, adjust a warning time for providing a hands-off response based on the determined driving situation of the vehicle, and trigger the hands-off response after the adjusted warning time has elapsed following detection of the hands-off condition by the hands-off detector.
- a vehicle may include an engine, a braking system, a steering system, and the driver assistance system.
- a method for providing a driver hands-off response includes monitoring an environment surrounding a vehicle to determine a driving situation of the vehicle, adjusting a warning time for providing a hands-off response based on the determined driving situation of the vehicle, and triggering the hands-off response after the adjusted warning time has elapsed following detection of a hands-off condition in which a hand of a driver is off of a steering wheel of the vehicle.
- a warning message about a hands-off may be provided to a driver by adjusting a warning time-point for a hands-off according to a driving situation.
- the driver can also increase satisfaction and can increase the reliability of autonomous driving.
- the safety of running can be improved.
- FIG. 1 illustrates a configuration of a vehicle according to an embodiment.
- FIG. 2 illustrates a configuration of a driver assistance system according to an embodiment.
- FIG. 3 illustrates sensing fields of camera(s) and radar(s) included in a driver assistance system according to an embodiment.
- FIGS. 4 and 5 are flowcharts illustrating a control method of a driver assistance system according to an exemplary embodiment.
- part when a part “includes” or “comprises” an element, unless there is a particular description contrary thereto, the part may further include other elements, not excluding the other elements.
- FIG. 1 illustrates a configuration of a vehicle according to an embodiment.
- the vehicle 1 includes an engine 10 , a transmission 20 , a braking device 30 , and a steering device 40 .
- the engine 10 includes a cylinder and a piston and may generate power for the vehicle 1 to travel.
- the transmission 20 includes a plurality of gears, and may transmit power generated by the engine 10 to the wheels.
- the braking device 30 may decelerate the vehicle 1 or stop the vehicle 1 through friction with the wheels.
- the steering device 40 may change the driving direction of the vehicle 1 .
- the vehicle 1 may comprise a plurality of electrical components.
- the vehicle 1 includes an Engine Management System (EMS) 11 , a Transmission Control Unit (TCU) 21 , and an Electronic Brake Control Module 31 , an Electronic Power Steering (EPS) 41 , a Body Control Module (BCM) 51 , and a Driver Assistance System (DAS) 100 .
- EMS Engine Management System
- TCU Transmission Control Unit
- EPS Electronic Power Steering
- BCM Body Control Module
- DAS Driver Assistance System
- the engine management system 11 may control the engine 10 in response to the driver's acceleration intention through the accelerator pedal or a request from the driver assistance system 100 .
- the engine management system 11 may control the torque of the engine 10 .
- the transmission control unit 21 may control the transmission 20 in response to the driver's shift command through the shift lever and/or the driving speed of the vehicle 1 .
- the transmission control unit 21 can adjust the shift ratio from the engine 10 to the wheels.
- the electronic brake control module 31 may control the braking device 30 in response to the driver's braking intention through the brake pedal and/or slip of the wheels. For example, the electronic brake control module 31 may temporarily release the braking of the wheel in response to the slip of the wheel sensed during braking of the vehicle 1 (e.g., as part of the operation of an Anti-lock Braking Systems, ABS). The electronic brake control module 31 may selectively release the braking of one or more selected wheels in response to oversteering and/or understeering sensed during steering of the vehicle 1 (e.g., as part of providing an Electronic stability control, ESC, capability). In addition, the electronic brake control module 31 may temporarily brake the wheels in response to slippage of the wheels sensed during driving of the vehicle 1 (Traction Control System, TCS).
- TCS Traction Control System
- the electronic power steering device 41 may assist the operation of the steering device 40 so that the driver can easily operate the steering wheel in response to the driver's steering intention through the steering wheel.
- the electronic power steering device 41 may assist the operation of the steering device 40 to reduce the steering force provided by the driver when driving at low speeds or to increase the steering force provided by the driver when driving at high speeds.
- the body control module 51 may control the operation of the electronic components that provide convenience to the driver or ensure the safety of the driver.
- the body control module 51 may control a head lamp, a wiper, a cluster, a multifunction switch, a direction indicator lamp, and the like.
- the driver assistance system 100 may assist the driver in operating (e.g., driving, braking, steering) the vehicle 1 .
- the driver assistance system 100 may detect an environment (e.g., other vehicles, pedestrians, cyclists, lanes, road signs, etc.) around the vehicle 1 , and control the driving and/or braking and/or steering of the vehicle 1 in response to the sensed environment.
- an environment e.g., other vehicles, pedestrians, cyclists, lanes, road signs, etc.
- the driver assistance system 100 may provide various functions to the driver.
- the driver assistance system 100 may provide Lane Departure Warning (LDW), Lane Keeping Assist (LKA), High Beam Assist (HBA), and Automatic Emergency Braking (LDB), Autonomous Emergency Braking (AEB), Traffic Sign Recognition (TSR), Smart Cruise Control (SCC), Blind Spot Detection (BSD), and the like.
- LDW Lane Departure Warning
- LKA Lane Keeping Assist
- HBA High Beam Assist
- LLB Automatic Emergency Braking
- AEB Autonomous Emergency Braking
- TSR Traffic Sign Recognition
- SCC Smart Cruise Control
- BSD Blind Spot Detection
- the lane keeping assistance system detects the driving lane and generates the auxiliary steering torque by controlling a steering system 42 provided in the vehicle 1 so that the vehicle 1 does not depart from the driving lane.
- the driver assistance system 100 includes an image acquisition device, such as camera module 101 , configured to acquire image data around the vehicle 1 and a radar module 102 configured acquire object data around the vehicle 1 .
- an image acquisition device such as camera module 101
- a radar module 102 configured acquire object data around the vehicle 1 .
- the image acquisition device such as camera module 101 , may include one or more camera(s) 101 a and a controller (Electronic Control Unit, ECU) 101 b , and may photograph an area in front of the vehicle 1 and recognize other vehicles, pedestrians, cyclists, lanes, road signs, and the like.
- the image acquisition device may additionally or alternatively include one or more alternative image sensors, such as a charge-coupled device (CCD), a CMOS image sensor, or a photo sensor including photodiodes.
- CCD charge-coupled device
- CMOS image sensor or a photo sensor including photodiodes.
- the radar module 102 may include a radar 102 a and a controller 102 b , and may acquire relative positions, relative speeds, and the like of objects (e.g., other vehicles, pedestrians, cyclists, etc.) around the vehicle 1 .
- objects e.g., other vehicles, pedestrians, cyclists, etc.
- the above electronic components may communicate with each other through the vehicle communication network NT.
- the electronic components may transmit and receive data through Ethernet, Most Oriented Systems Transport (MOST), Flexray, CAN (Controller Area Network), LIN (Local Interconnect Network), etc.
- the driver assistance system 100 may transmit a drive control signal, a braking signal, and/or a steering signal to the engine management system 11 , the electronic brake control module 31 , and/or the electronic power steering device 41 through the vehicle communication network NT, respectively.
- FIG. 2 illustrates a configuration of a driver assistance system according to an embodiment.
- FIG. 3 illustrates a camera and a radar included in a driver assistance system according to an embodiment.
- the vehicle 1 may include a braking system 32 , a steering system 42 , a driver assistance system 100 , and a warning device 170 .
- the braking system 32 may include an electronic brake control module 31 (see FIG. 1 ) and a braking device 30 (see FIG. 1 ) described with reference to FIG. 1
- the steering system 42 may include an electronic power steering device 41 (see FIG. 1 ) and the steering device 40 (see FIG. 1 ).
- the driver assistance system 100 may include a camera 110 , a front radar 120 , a plurality of corner radars 130 , a sensor 150 , and a hands-off detector 160 .
- the camera 110 may have a field of view including an area exterior to the vehicle 1 , in particular a field of view 110 a facing forward of the vehicle 10 .
- the camera 110 may be installed in, for example, the front windshield of the vehicle 1 .
- the camera 110 may photograph the area in front of the vehicle 1 and acquire image data of the area in front of the vehicle 1 .
- the image data of the area in front of the vehicle 1 may include location information about another vehicle or a pedestrian or a cyclist or a lane located in front of the vehicle 1 .
- the camera 110 may include a plurality of lenses and an image sensor.
- the image sensor may include a plurality of photodiodes for converting light into an electrical signal, and the plurality of photodiodes may be arranged in a two-dimensional matrix.
- the camera 110 may be electrically connected to a controller 140 .
- the camera 110 may be connected to the controller 140 through a vehicle communication network (NT), or connected to the controller 140 through a hard wire, or connected to the controller 140 through a printed circuit board (PCB).
- the camera 110 may transmit image data of the area in front of the vehicle 1 to the controller 140 .
- the front radar 120 may have a field of sensing 120 a extending in front of the vehicle 1 .
- the front radar 120 may be installed on, for example, a grill or bumper of the vehicle 1 .
- the front radar 120 may include a transmit antenna (or transmit antenna array) for radiating transmitted radio waves toward the area extending in front of the vehicle 1 , and a receiving antenna (or receiving antenna array) for receiving received radio wave(s) reflected by object(s) in the area extending in front of the vehicle 1 .
- the front radar 120 may acquire the front radar data from the transmitted radio waves transmitted by the transmitting antenna and the received radio waves received by the receiving antenna.
- the front radar data may include distance information and speed information about other vehicles or pedestrians or cyclists located in front of the vehicle 1 .
- the front radar 120 may calculate the state distance to the object based on the phase difference (or time difference) between the transmitted radio wave and the received radio wave, and calculate the relative speed of the object based on the frequency difference between the transmitted radio wave and the received radio wave.
- the front radar 120 may be connected to the controller 140 through, for example, a vehicle communication network NT or a hard wire or a printed circuit board.
- the front radar 120 may transmit the front radar data to the controller 140 .
- the plurality of corner radars 130 may include a first corner radar 131 installed at the front right side of the vehicle 1 ; a second corner radar 132 installed at the front left side of the vehicle 1 ; a third corner radar 133 installed at the rear right side of the vehicle 1 ; and a fourth corner radar 134 installed at the rear left side of the vehicle 1 .
- the first corner radar 131 may have a field of sensing 131 a facing the front right side of the vehicle 1 and may be installed, for example, on the right side of the front bumper of the vehicle 1 .
- the second corner radar 132 may have a field of sensing 132 a facing the front left side of the vehicle 1 , and may be installed on the left side of the front bumper of the vehicle 1 , for example.
- the third corner radar 133 may have a field of sensing 133 a facing rear right of the vehicle 1 , and may be installed on the right side of the rear bumper of the vehicle 1 , for example.
- the fourth corner radar 134 may have a field of sensing 134 a facing the rear left side of the vehicle 1 , and may be installed at the left side of the rear bumper of the vehicle 1 , for example.
- Each of the first, second, third, and fourth corner radars 131 , 132 , 133 , and 134 may include a transmitting antenna and a receiving antenna.
- the first, second, third and fourth corner radars 131 , 132 , 133 , and 134 may acquire first corner radar data, second corner radar data, third corner radar data, and fourth corner radar data, respectively.
- the first corner radar data may include distance information and speed information about another vehicle or a pedestrian or a cyclist (hereinafter referred to as an “object”) located in front of the vehicle 1 and to the right side.
- the second corner radar data may include distance information and speed information of an object located on the front left side of the vehicle 1 .
- the third and fourth corner radar data may include distance information and speed information of an object located at the rear right side of the vehicle 1 and the rear left side of the vehicle 1 , respectively.
- Each of the first, second, third, and fourth corner radars 131 , 132 , 133 , and 134 may be connected to the controller 140 through, for example, a vehicle communication network NT or a hard wire or a printed circuit board.
- the first, second, third, and fourth corner radars 131 , 132 , 133 , and 134 may transmit the first, second, third, and fourth corner radar data to the controller 140 , respectively.
- Such radars may be implemented in a lidar.
- the vehicle 1 may be provided with various sensor(s) 150 for acquiring behavior data of the vehicle 1 .
- the vehicle 1 may further include a speed sensor for detecting the speed of a wheel, an acceleration sensor for detecting the lateral acceleration and the longitudinal acceleration of the vehicle, a yaw rate sensor for detecting the change in the angular speed of the vehicle, and a gyro sensor for detecting the inclination of the vehicle, and a steering angle sensor for detecting a rotation and a steering angle of the steering wheel, and the like.
- the behavior data may include the speed, longitudinal acceleration, lateral acceleration, steering angle, driving direction, yaw rate, inclination, and the like of the vehicle 1 .
- the hands-off detector 160 may detect a hands-off situation in which hands of the driver are off of (e.g., not in contact with) the steering wheel.
- the hands-off detector 160 may sense a hands-off situation of a driver by measuring capacitance using a conductive material provided on a steering wheel.
- the hands-off detector 160 may detect the hands-off of the driver using various methods.
- the hands-off detector 160 may determine within a short time whether the driver is holding the steering wheel with both hands, and transmit a hands-off detection signal to the controller 140 .
- the warning device 170 may output a warning message.
- the warning device 170 may output a warning message about the hands-off.
- the warning device 170 may output a warning message including at least one of a text, a voice, an alarm, and an image. That is, the warning device 170 may include an audio device and/or a display device.
- the controller 140 determines a warning point for hands-off and controls the warning device 170 to output a warning message at the determined warning point.
- the controller 140 may determine as a warning time-point for hands-off an adjustable length of a time-interval during which the hands-off condition should be maintained in order to cause output of the warning message.
- the controller 140 may cause the warning device 170 to output the warning message after the determined warning time-point has elapsed following the initial detection of the hands-off situation.
- the controller 140 may include a controller 101 b (see FIG. 1 ) of the camera module 101 (see FIG. 1 ) and/or controller 102 b (see FIG. 1 ) of the radar module 102 (see FIG. 1 ) and/or separate integrated controller(s).
- the controller 140 includes a processor 141 and a memory 142 .
- the controller 140 may include one or more processors 141 .
- the processor(s) 141 may process image data of the camera 110 , front radar data of the front radar 120 , corner radar data of the plurality of corner radars 130 , and behavior data acquired by the sensor(s) 150 , and may generate control signals for controlling the braking system 32 , the steering system 42 , and the warning device 170 .
- the processor 141 may include an image signal processor for processing front image data of the front camera 110 ; and/or a digital signal processor for processing radar data of the radars 120 , 130 and behavior data acquired by the sensor(s) 150 ; and/or a micro control unit (Micro Control Unit, MCU) for generating a control signal.
- MCU Micro Control Unit
- the controller 140 may be configured to sense or identify the objects (e.g., other vehicles, pedestrians, cyclists, etc.) in front of the vehicle 1 based on the front image data of the camera 110 and the front radar data of the front radar 120 .
- the objects e.g., other vehicles, pedestrians, cyclists, etc.
- the controller 140 may acquire location information (distance and direction) and speed information (relative speed) of objects in front of the vehicle 1 based on the front radar data of the front radar 120 .
- the controller 140 may acquire location information (direction) and type information (e.g., whether the object is another vehicle, a pedestrian, or a cyclist) of the objects in front of the vehicle 1 based on the front image data of the camera 110 .
- the controller 140 may match the objects detected by the front image data to the detected objects detected by the front radar data, and may acquire the type information, the location information, and the speed information of the objects detected in front of the vehicle 1 based on the matching result.
- the controller 140 may acquire location information (distance and direction) and speed information (relative speed) of objects on the side(s) (front right, front left, rear right, rear left) of the vehicle 1 based on the corner radar data of the plurality of corner radars 130 .
- the memory 142 may store a program for the processor 141 to process various data and a program for the processor 141 to generate a control signal.
- the memory 142 may store the image data acquired by the camera 110 , the radar data acquired by the radars 120 , 130 , and/or the behavior data acquired by the sensor(s) 150 , and may store a result of processing data by the processor(s) 141 .
- the memory 142 may include a nonvolatile memory such as a flash memory, a read only memory (ROM), an erasable programmable read only memory (EPROM), or the like, as well as a volatile memory such as an S-RAM or a D-RAM.
- a nonvolatile memory such as a flash memory, a read only memory (ROM), an erasable programmable read only memory (EPROM), or the like, as well as a volatile memory such as an S-RAM or a D-RAM.
- One or more processor(s) 141 included in the controller 140 may be integrated on one chip or may be physically separated.
- the processor(s) 141 and the memory 142 may be implemented as a single chip.
- the controller 140 may identify one or more object(s) outside the vehicle 1 by processing the image data acquired by the camera 110 .
- the controller 140 may identify the type of the object(s).
- Objects outside the vehicle 1 may include lanes, curbs, guardrails, structures on roads such as median dividers, surrounding vehicles, obstacles on driving lanes, pedestrians, and the like.
- the controller 140 may obtain location information of the object(s).
- the location information of each object may include at least one of a current location of the object, a distance to the object, a moving speed of the object, and an expected moving path of the object.
- the controller 140 when identifying each moving object, may detect the moving speed of the object and predict the moving path of the object based on the current position of the object and the position predicted after a predetermined time.
- the controller 140 may process the image data to detect a curved section, a shoulder, a side slope of a road, and the like.
- the side slope of a road is a concept that includes terrain that is not continuous with the lane, such as scarps or cliffs.
- the controller 140 may process the image data to calculate the curvature of the road ahead.
- FIGS. 4 and 5 are flowcharts illustrating a control method of a driver assistance system according to an exemplary embodiment.
- the controller 140 may operate the driver assistance system 100 ( 401 ).
- the controller 140 may operate a lane keeping assist system or a lane following assist system.
- the hands-off detector 160 detects ( 402 ) that the driver's hands are off of the steering wheel.
- the hands-off detector 160 may determine whether the driver holds the steering wheel with both hands within a short time (for example, 0.1 second) and transmit a hands-off detection signal to the controller 140 when the driver does not hold the steering wheel with both hands (e.g., when at least one hand is off of the steering wheel).
- the hands-off detector 160 may determine whether the driver holds the steering wheel with at least one hand within a short time (for example, 0.1 second) and transmit the hands-off detection signal to the controller 140 upon determining that all hand(s) of the driver are off of the steering wheel (e.g., when no hands of the driver are holding the steering wheel).
- the controller 140 may process image data obtained by the camera 110 , radar data obtained by radar(s) 120 and 130 , and behavior data acquired by the sensor(s) 150 , to determine the driving situation of the vehicle 1 .
- the controller 140 may detect the position of the vehicle 1 in the lane based on the image data.
- the controller 140 may calculate a distance by which the vehicle 1 is spaced from the center of the lane, and a distance by which the vehicle 1 is spaced from the left lane and/or the right lane.
- the controller 140 may calculate the reliability of the lane based on the image data.
- the reliability of the lane is an indicator of the clarity of both lanes, such as the quality or reliability of sensing of the positions and other characteristics of the lanes obtained from the driver assistance system.
- the controller 140 may calculate the reliability of the lane by using correlation data between the degree of clarity of the lane previously stored in the memory 142 and the reliability of the lane. For example, when the lane does not exist (e.g., lane markings to not exist or are not visible), the reliability of the lane may correspond to zero, and when the lane is clearly detected above a predetermined reference clarity, the reliability of the lane may correspond to 10.
- the controller 140 may calculate a collision risk with external object(s) based on the radar data.
- the controller 140 may calculate a time to collision (TTC), which is a time until a collision between the vehicle 1 and the front object, based on the position information (distance) and the speed information (relative speed) of the front object(s).
- TTC time to collision
- the controller 140 may determine the collision risk with the external object(s) based on the time to collision. For example, it may be determined that the collision risk is 30% when the time to collision is 5 seconds, and the collision risk is 80% when the time to collision is 2 seconds. Such numerical values are exemplary and the disclosure is not limited thereto.
- the controller 140 may calculate a distance to collision (DTC) based on speed information (relative speed) of the front objects.
- the controller 140 may calculate the collision risk based on a comparison result between the distance to the collision and the distance to the front objects.
- the controller 140 may process the behavior data to calculate the behavior safety of the vehicle 1 .
- the controller 140 may determine that the behavior safety degree is low when the behavior data is out of a predetermined safety range. For example, the controller 140 may calculate a low level of the behavior safety when the yaw rate change amount, the lateral acceleration change amount, and the longitudinal acceleration change amount included in the behavior data each exceed a predetermined change amount for a predetermined time.
- Correlation data between the behavior data and the behavior safety may be previously stored in the memory 142 .
- the controller 140 may determine the driving situation based on at least one of the position of the vehicle 1 in the lane, the reliability of the lane, the risk of collision with an external object, and the behavior safety of the vehicle 1 .
- the controller 140 may determine whether the driving situation satisfies a warning point delay condition under which the length/duration of the warning time-point may be extended, and determine whether the driving situation satisfies a warning point shortening condition under which the length/duration of the warning time-point may be shortened.
- the controller 140 may determine or adjust a warning time-point for the hands-off based on the driving situation ( 403 ).
- the controller 140 may control the warning device 170 to output a warning message for hands-off at the determined or adjusted warning time-point, such as after the determined or adjusted warning time-point has elapsed following detection of the hands-off condition.
- the controller 140 may receive the hands-off detection signal from the hands-off detector 160 ( 501 ).
- the controller 140 determines the driving situation based on at least one of the position of the vehicle 1 in the lane, the reliability of the lane, the risk of collision with an external object, and the behavior safety of the vehicle 1 , and determines whether the driving situation satisfies the warning point delay condition or the warning point shortening condition ( 502 , 504 ).
- the controller 140 may determine that the warning point delay condition is satisfied.
- the controller 140 may determine the delay time when the warning point delay condition is satisfied. In addition, the controller 140 may adjust the delay time based on at least one of a current speed and a distance to the external object.
- the maximum delay time may be set to two minutes from a predetermined reference warning point.
- the predetermined reference warning point or time-point may be defined as a time point when 12 seconds have elapsed from when the hands-off is detected, such as a time point occurring when the hands-off is maintained/detected continuously for 12 seconds. This delay time is illustrative, and this disclosure is not limited thereto.
- the controller 140 may determine a time point delayed by a delay time from the predetermined reference warning point as the warning point for the hands-off, and control the warning device 170 to output a warning message after the delayed time has elapsed since the initially detected hands-off ( 503 ).
- the controller 140 may determine that the warning point shortening condition is satisfied.
- the controller 140 may determine a shortening time when the warning point shortening condition is satisfied.
- the controller 140 may determine a shortening time differently for each warning point shortening condition. That is, when the vehicle is located outside the predetermined distance from the center of the lane, when the reliability of at least one of both lanes is less than the predetermined reliability, when the risk of collision with the external object is more than the predetermined risk, when the curvature of the road ahead is greater than or equal to the predetermined curvature, and when the behavior data of the vehicle is outside the predetermined safety range, the controller 140 may determine a shortening time for each condition differently. For example, when the reference warning point is 12 seconds, in each case, the shortening time may be determined to be 9 seconds, 5 seconds, 10 seconds, 7 seconds, 11 seconds.
- the controller 140 may determine a time point ahead of the predetermined reference warning point by the shortening time as a warning point for hands-off, and may control the warning device 170 to output a warning message after the shortened time has elapsed after detecting the hands-off ( 505 ).
- the controller 140 may control the warning device 170 to output a warning message for a hand-off at the reference warning point after detecting the hands-off ( 506 ).
- a warning message for the hands-off may be provided to the driver by adjusting the warning point for the hands-off according to the driving situation.
- the warning point for the hands-off may be suspended, thereby reducing the fatigue that the driver may feel due to the warning.
- the safety can be increased by shortening the warning point for the hands-off.
- the driver can also increase satisfaction and can increase the reliability of autonomous driving.
- the safety of driving can be improved.
- the present disclosure as described above may be implemented as computer-readable codes in a non-transitory recording medium on which a program is recorded which, when executed by a processor, cause the processor to perform functions including functions described as performed herein by the controller 140 and other components of the driver assistance system 100 .
- the computer-readable mediums include all types of recording devices which may be read by a computer system and on which data are stored.
- Examples of the computer-readable medium include a Hard Disk Drive (HDD), a Solid State Disk (SSD), Silicon Disk Drive (SDD), a Read Only Memory (ROM), a Random Access Memory (RAM), CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, and may also include things implemented in the form of carrier wave (e.g. transmission through the Internet).
- HDD Hard Disk Drive
- SSD Solid State Disk
- SDD Silicon Disk Drive
- ROM Read Only Memory
- RAM Random Access Memory
- CD-ROM compact disc-read only Memory
- magnetic tape e.g. transmission through the Internet
- floppy disk e.g. transmission through the Internet
- optical data storage device e.g. transmission through the Internet
Abstract
Description
- This application is based on and claims priority under 35 U.S.C. § 119 to Korean Patent Application No. 2019-0034975, filed on Mar. 27, 2019 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.
- The present invention relates to a driver assistance system and a control method for the same.
- The Advanced Driver Assistance System (ADAS) is a system that assists the driver in driving. In particular, a steering assistance system, such as a lane keeping assist system or a lane following assist system, recognizes the lane in which the vehicle travels to maintain the vehicle in the lane without the driver's steering wheel manipulation.
- However, when the driver is not touching the steering wheel, safety may be lowered. Therefore, the conventional art warns the driver at a predetermined time when a hands-off situation is sensed from the steering wheel.
- However, when a warning about a hands-off occurs frequently regardless of the driving situation, the driver's satisfaction may be lowered.
- The present invention provides a driver assistance system and a control method for the same, which can provide a warning message for a hands-off to a driver by adjusting a warning time-point for the hands-off according to a driving situation.
- As a technical means for achieving the above technical problem, a driver assistance system according to an embodiment includes an image acquisition device configured to acquire image data of an area outside of the vehicle, a sensor configured to acquire behavior data of the vehicle, a hands-off detector configured to detect that a hand of the driver is off of a steering wheel, and a controller. The controller is configured to determine a driving situation of the vehicle based on the image data acquired by the image acquisition device and the behavior data acquired by the sensor, and to control a warning time-point for the hands-off detector based on the determined driving situation.
- The controller may determine whether the driving situation satisfies a warning point delay condition, may determine a delay time when the warning point delay condition is satisfied, and may control the warning time-point to be delayed by the delay time from a predetermined reference warning time-point.
- When the vehicle is located within a predetermined distance from a center of a lane, a reliability of a lane is greater than a predetermined reliability, a risk of collision with an external object is less than a predetermined risk, and a curvature of a road ahead is less than a predetermined curvature, the controller may determine that the warning point delay condition is satisfied.
- The controller may adjust the delay time based on at least one of a current speed and a distance to an external object.
- The controller may determine whether the driving situation satisfies a warning point shortening condition, may determine a shortening time when the warning point shortening condition is satisfied, and may control the warning time-point to be ahead of a predetermined reference warning time-point by the shortening time.
- In case of at least one of when the vehicle is located outside a predetermined distance from a center of a lane, when a reliability of at least one lane is less than a predetermined reliability, when a risk of collision with an external object is greater than a predetermined risk, when a curvature of the road ahead is more than a predetermined curvature, and when behavior data of the vehicle is outside a predetermined safety range, the controller may determine that the warning point shortening condition is satisfied.
- The controller may determine a different shortening time for each of a plurality of warning point shortening conditions.
- The driver assistance system according to an embodiment may further include a warning device for outputting a warning message, and/or a radar configured to acquire radar data about an object outside the vehicle. The controller may determine the driving situation of the vehicle based on the radar data acquired by the radar, and/or the controller may control the warning device to output a warning message for the hands-off at the determined warning time-point. The warning device may output a warning message including at least one of a text, a voice, and an image.
- The behavior data may include yaw rate change amount, lateral acceleration change amount and longitudinal acceleration change amount.
- According to an exemplary embodiment, a control method of a driver assistance system may include acquiring image data of an area exterior to a vehicle, acquiring behavior data of the vehicle; detecting that a hand of the driver is off of a steering wheel, and determining a driving situation of the vehicle based on the acquired image data and the acquired behavior data. A warning time-point is determined for a hands-off notification based on the determined driving situation when the hand is detected to be off of the steering wheel.
- The determining of the warning time-point for the hands-off may include determining whether the driving situation satisfies a warning point delay condition, determining a delay time when the warning point delay condition is satisfied, and controlling the warning time-point to be delayed by the determined delay time from a predetermined reference warning time-point.
- The determining whether the driving situation satisfies a warning point delay condition may include determining that the warning point delay condition is satisfied when the vehicle is located within a predetermined distance from a center of a lane, a reliability of a lane is greater than a predetermined reliability, a risk of collision with an external object is less than a predetermined risk, and a curvature of a road ahead is less than a predetermined curvature.
- The determining a delay time may include adjusting the delay time based on at least one of a current speed and a distance to an external object.
- The determining of the warning time-point for the hands-off may include determining whether the driving situation satisfies a warning point shortening condition; determining a shortening time when the warning point shortening condition is satisfied; and controlling the warning time-point to be ahead of a predetermined reference warning time-point by the shortening time.
- The determining whether the driving situation satisfies a warning point shortening condition may include determining that the warning point shortening condition is satisfied in case of at least one of the vehicle is located outside a predetermined distance from a center of a lane, a reliability of at least one lane is less than a predetermined reliability, a risk of collision with an external object is greater than a predetermined risk, a curvature of the road ahead is more than a predetermined curvature, and behavior data of the vehicle is outside of a predetermined safety range.
- The determining of the shortening time may include determining a different shortening time for each of a plurality of different warning time-point shortening conditions.
- The control method of the driver assistance system according to an embodiment may further include outputting a warning message for the hands-off at the determined warning point.
- The warning message may include at least one of a text, a voice, and an image.
- The behavior data may include a yaw rate change amount, a lateral acceleration change amount and a longitudinal acceleration change amount.
- According to another exemplary embodiment, a driver assistance system of a vehicle includes one or more sensors configured to acquire sensing data of an area outside of the vehicle, a hands-off detector configured to detect a hands-off condition in which a hand of a driver is off of a steering wheel of the vehicle, and a controller including at least one processor configured to process the sensing data. The controller is configured to monitor an environment surrounding the vehicle based on the acquired sensing data to determine a driving situation of the vehicle, adjust a warning time for providing a hands-off response based on the determined driving situation of the vehicle, and trigger the hands-off response after the adjusted warning time has elapsed following detection of the hands-off condition by the hands-off detector.
- A vehicle may include an engine, a braking system, a steering system, and the driver assistance system.
- According to a further exemplary embodiment, a method for providing a driver hands-off response includes monitoring an environment surrounding a vehicle to determine a driving situation of the vehicle, adjusting a warning time for providing a hands-off response based on the determined driving situation of the vehicle, and triggering the hands-off response after the adjusted warning time has elapsed following detection of a hands-off condition in which a hand of a driver is off of a steering wheel of the vehicle.
- According to the driver assistance system of the present invention and a control method of the same, a warning message about a hands-off may be provided to a driver by adjusting a warning time-point for a hands-off according to a driving situation.
- Accordingly, the driver can also increase satisfaction and can increase the reliability of autonomous driving. In addition, the safety of running can be improved.
- These and/or other aspects of the invention will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
-
FIG. 1 illustrates a configuration of a vehicle according to an embodiment. -
FIG. 2 illustrates a configuration of a driver assistance system according to an embodiment. -
FIG. 3 illustrates sensing fields of camera(s) and radar(s) included in a driver assistance system according to an embodiment. -
FIGS. 4 and 5 are flowcharts illustrating a control method of a driver assistance system according to an exemplary embodiment. - In the following description, like reference numerals refer to like elements throughout the specification. Well-known functions or constructions are not described in detail since they would obscure the one or more exemplary embodiments with unnecessary detail. Terms such as “unit”, “module”, “member”, and “block” may be embodied as hardware or software. According to embodiments, a plurality of “units”, “modules”, “members”, and “blocks” may be implemented as a single component or a single “unit”, “module”, “member”, and “block” may include a plurality of components.
- It will be understood that when an element is referred to as being “connected” to another element, it can be directly or indirectly connected to the other element, wherein the indirect connection includes “connection via a wireless communication network”.
- Also, when a part “includes” or “comprises” an element, unless there is a particular description contrary thereto, the part may further include other elements, not excluding the other elements.
- It will be understood that, although the terms first, second, third, etc., may be used herein to describe various elements, the elements should not be interpreted as being limited by these terms. These terms are only used to distinguish one element from another element.
- As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
- An identification numeral or code is used for the convenience of the description but is not intended to illustrate the order of various steps. The steps may be implemented in an order different from the illustrated order unless the context clearly indicates otherwise.
- Reference will now be made in detail to embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings.
-
FIG. 1 illustrates a configuration of a vehicle according to an embodiment. - As shown in
FIG. 1 , thevehicle 1 includes anengine 10, atransmission 20, abraking device 30, and asteering device 40. Theengine 10 includes a cylinder and a piston and may generate power for thevehicle 1 to travel. Thetransmission 20 includes a plurality of gears, and may transmit power generated by theengine 10 to the wheels. Thebraking device 30 may decelerate thevehicle 1 or stop thevehicle 1 through friction with the wheels. Thesteering device 40 may change the driving direction of thevehicle 1. - The
vehicle 1 may comprise a plurality of electrical components. For example, thevehicle 1 includes an Engine Management System (EMS) 11, a Transmission Control Unit (TCU) 21, and an ElectronicBrake Control Module 31, an Electronic Power Steering (EPS) 41, a Body Control Module (BCM) 51, and a Driver Assistance System (DAS) 100. - The
engine management system 11 may control theengine 10 in response to the driver's acceleration intention through the accelerator pedal or a request from thedriver assistance system 100. For example, theengine management system 11 may control the torque of theengine 10. - The
transmission control unit 21 may control thetransmission 20 in response to the driver's shift command through the shift lever and/or the driving speed of thevehicle 1. For example, thetransmission control unit 21 can adjust the shift ratio from theengine 10 to the wheels. - The electronic
brake control module 31 may control thebraking device 30 in response to the driver's braking intention through the brake pedal and/or slip of the wheels. For example, the electronicbrake control module 31 may temporarily release the braking of the wheel in response to the slip of the wheel sensed during braking of the vehicle 1 (e.g., as part of the operation of an Anti-lock Braking Systems, ABS). The electronicbrake control module 31 may selectively release the braking of one or more selected wheels in response to oversteering and/or understeering sensed during steering of the vehicle 1 (e.g., as part of providing an Electronic stability control, ESC, capability). In addition, the electronicbrake control module 31 may temporarily brake the wheels in response to slippage of the wheels sensed during driving of the vehicle 1 (Traction Control System, TCS). - The electronic
power steering device 41 may assist the operation of thesteering device 40 so that the driver can easily operate the steering wheel in response to the driver's steering intention through the steering wheel. For example, the electronicpower steering device 41 may assist the operation of thesteering device 40 to reduce the steering force provided by the driver when driving at low speeds or to increase the steering force provided by the driver when driving at high speeds. - The
body control module 51 may control the operation of the electronic components that provide convenience to the driver or ensure the safety of the driver. For example, thebody control module 51 may control a head lamp, a wiper, a cluster, a multifunction switch, a direction indicator lamp, and the like. - The
driver assistance system 100 may assist the driver in operating (e.g., driving, braking, steering) thevehicle 1. For example, thedriver assistance system 100 may detect an environment (e.g., other vehicles, pedestrians, cyclists, lanes, road signs, etc.) around thevehicle 1, and control the driving and/or braking and/or steering of thevehicle 1 in response to the sensed environment. - The
driver assistance system 100 may provide various functions to the driver. For example, thedriver assistance system 100 may provide Lane Departure Warning (LDW), Lane Keeping Assist (LKA), High Beam Assist (HBA), and Automatic Emergency Braking (LDB), Autonomous Emergency Braking (AEB), Traffic Sign Recognition (TSR), Smart Cruise Control (SCC), Blind Spot Detection (BSD), and the like. - The lane keeping assistance system detects the driving lane and generates the auxiliary steering torque by controlling a
steering system 42 provided in thevehicle 1 so that thevehicle 1 does not depart from the driving lane. - The
driver assistance system 100 includes an image acquisition device, such ascamera module 101, configured to acquire image data around thevehicle 1 and aradar module 102 configured acquire object data around thevehicle 1. - The image acquisition device, such as
camera module 101, may include one or more camera(s) 101 a and a controller (Electronic Control Unit, ECU) 101 b, and may photograph an area in front of thevehicle 1 and recognize other vehicles, pedestrians, cyclists, lanes, road signs, and the like. The image acquisition device may additionally or alternatively include one or more alternative image sensors, such as a charge-coupled device (CCD), a CMOS image sensor, or a photo sensor including photodiodes. - The
radar module 102 may include aradar 102 a and acontroller 102 b, and may acquire relative positions, relative speeds, and the like of objects (e.g., other vehicles, pedestrians, cyclists, etc.) around thevehicle 1. - The above electronic components may communicate with each other through the vehicle communication network NT. For example, the electronic components may transmit and receive data through Ethernet, Most Oriented Systems Transport (MOST), Flexray, CAN (Controller Area Network), LIN (Local Interconnect Network), etc. For example, the
driver assistance system 100 may transmit a drive control signal, a braking signal, and/or a steering signal to theengine management system 11, the electronicbrake control module 31, and/or the electronicpower steering device 41 through the vehicle communication network NT, respectively. -
FIG. 2 illustrates a configuration of a driver assistance system according to an embodiment.FIG. 3 illustrates a camera and a radar included in a driver assistance system according to an embodiment. - Referring to
FIG. 2 , thevehicle 1 may include abraking system 32, asteering system 42, adriver assistance system 100, and awarning device 170. - The
braking system 32 may include an electronic brake control module 31 (seeFIG. 1 ) and a braking device 30 (seeFIG. 1 ) described with reference toFIG. 1 , and thesteering system 42 may include an electronic power steering device 41 (seeFIG. 1 ) and the steering device 40 (seeFIG. 1 ). - The
driver assistance system 100 may include acamera 110, afront radar 120, a plurality ofcorner radars 130, asensor 150, and a hands-offdetector 160. - Referring to
FIG. 3 , thecamera 110 may have a field of view including an area exterior to thevehicle 1, in particular a field ofview 110 a facing forward of thevehicle 10. Thecamera 110 may be installed in, for example, the front windshield of thevehicle 1. - The
camera 110 may photograph the area in front of thevehicle 1 and acquire image data of the area in front of thevehicle 1. The image data of the area in front of thevehicle 1 may include location information about another vehicle or a pedestrian or a cyclist or a lane located in front of thevehicle 1. - The
camera 110 may include a plurality of lenses and an image sensor. The image sensor may include a plurality of photodiodes for converting light into an electrical signal, and the plurality of photodiodes may be arranged in a two-dimensional matrix. - The
camera 110 may be electrically connected to acontroller 140. For example, thecamera 110 may be connected to thecontroller 140 through a vehicle communication network (NT), or connected to thecontroller 140 through a hard wire, or connected to thecontroller 140 through a printed circuit board (PCB). Thecamera 110 may transmit image data of the area in front of thevehicle 1 to thecontroller 140. - Referring to
FIG. 3 , thefront radar 120 may have a field of sensing 120 a extending in front of thevehicle 1. Thefront radar 120 may be installed on, for example, a grill or bumper of thevehicle 1. - The
front radar 120 may include a transmit antenna (or transmit antenna array) for radiating transmitted radio waves toward the area extending in front of thevehicle 1, and a receiving antenna (or receiving antenna array) for receiving received radio wave(s) reflected by object(s) in the area extending in front of thevehicle 1. Thefront radar 120 may acquire the front radar data from the transmitted radio waves transmitted by the transmitting antenna and the received radio waves received by the receiving antenna. The front radar data may include distance information and speed information about other vehicles or pedestrians or cyclists located in front of thevehicle 1. Thefront radar 120 may calculate the state distance to the object based on the phase difference (or time difference) between the transmitted radio wave and the received radio wave, and calculate the relative speed of the object based on the frequency difference between the transmitted radio wave and the received radio wave. - The
front radar 120 may be connected to thecontroller 140 through, for example, a vehicle communication network NT or a hard wire or a printed circuit board. Thefront radar 120 may transmit the front radar data to thecontroller 140. - The plurality of
corner radars 130 may include afirst corner radar 131 installed at the front right side of thevehicle 1; asecond corner radar 132 installed at the front left side of thevehicle 1; athird corner radar 133 installed at the rear right side of thevehicle 1; and afourth corner radar 134 installed at the rear left side of thevehicle 1. - As illustrated in
FIG. 3 , thefirst corner radar 131 may have a field of sensing 131 a facing the front right side of thevehicle 1 and may be installed, for example, on the right side of the front bumper of thevehicle 1. Thesecond corner radar 132 may have a field of sensing 132 a facing the front left side of thevehicle 1, and may be installed on the left side of the front bumper of thevehicle 1, for example. Thethird corner radar 133 may have a field of sensing 133 a facing rear right of thevehicle 1, and may be installed on the right side of the rear bumper of thevehicle 1, for example. Thefourth corner radar 134 may have a field of sensing 134 a facing the rear left side of thevehicle 1, and may be installed at the left side of the rear bumper of thevehicle 1, for example. - Each of the first, second, third, and
fourth corner radars fourth corner radars vehicle 1 and to the right side. The second corner radar data may include distance information and speed information of an object located on the front left side of thevehicle 1. The third and fourth corner radar data may include distance information and speed information of an object located at the rear right side of thevehicle 1 and the rear left side of thevehicle 1, respectively. - Each of the first, second, third, and
fourth corner radars controller 140 through, for example, a vehicle communication network NT or a hard wire or a printed circuit board. The first, second, third, andfourth corner radars controller 140, respectively. - Such radars may be implemented in a lidar.
- Referring back to
FIG. 2 , thevehicle 1 may be provided with various sensor(s) 150 for acquiring behavior data of thevehicle 1. For example, thevehicle 1 may further include a speed sensor for detecting the speed of a wheel, an acceleration sensor for detecting the lateral acceleration and the longitudinal acceleration of the vehicle, a yaw rate sensor for detecting the change in the angular speed of the vehicle, and a gyro sensor for detecting the inclination of the vehicle, and a steering angle sensor for detecting a rotation and a steering angle of the steering wheel, and the like. - The behavior data may include the speed, longitudinal acceleration, lateral acceleration, steering angle, driving direction, yaw rate, inclination, and the like of the
vehicle 1. - The hands-off
detector 160 may detect a hands-off situation in which hands of the driver are off of (e.g., not in contact with) the steering wheel. The hands-offdetector 160 may sense a hands-off situation of a driver by measuring capacitance using a conductive material provided on a steering wheel. In addition, the hands-offdetector 160 may detect the hands-off of the driver using various methods. The hands-offdetector 160 may determine within a short time whether the driver is holding the steering wheel with both hands, and transmit a hands-off detection signal to thecontroller 140. - The
warning device 170 may output a warning message. For example, thewarning device 170 may output a warning message about the hands-off. Thewarning device 170 may output a warning message including at least one of a text, a voice, an alarm, and an image. That is, thewarning device 170 may include an audio device and/or a display device. Thecontroller 140 determines a warning point for hands-off and controls thewarning device 170 to output a warning message at the determined warning point. For example, thecontroller 140 may determine as a warning time-point for hands-off an adjustable length of a time-interval during which the hands-off condition should be maintained in order to cause output of the warning message. In the example, when thecontroller 140 determines that the hands-off condition has been detected continuously for the length/duration of the warning time-point, the controller may cause thewarning device 170 to output the warning message after the determined warning time-point has elapsed following the initial detection of the hands-off situation. - The
controller 140 may include acontroller 101 b (seeFIG. 1 ) of the camera module 101 (seeFIG. 1 ) and/orcontroller 102 b (seeFIG. 1 ) of the radar module 102 (seeFIG. 1 ) and/or separate integrated controller(s). - The
controller 140 includes aprocessor 141 and amemory 142. Thecontroller 140 may include one ormore processors 141. - The processor(s) 141 may process image data of the
camera 110, front radar data of thefront radar 120, corner radar data of the plurality ofcorner radars 130, and behavior data acquired by the sensor(s) 150, and may generate control signals for controlling thebraking system 32, thesteering system 42, and thewarning device 170. For example, theprocessor 141 may include an image signal processor for processing front image data of thefront camera 110; and/or a digital signal processor for processing radar data of theradars - The
controller 140 may be configured to sense or identify the objects (e.g., other vehicles, pedestrians, cyclists, etc.) in front of thevehicle 1 based on the front image data of thecamera 110 and the front radar data of thefront radar 120. - In detail, the
controller 140 may acquire location information (distance and direction) and speed information (relative speed) of objects in front of thevehicle 1 based on the front radar data of thefront radar 120. - The
controller 140 may acquire location information (direction) and type information (e.g., whether the object is another vehicle, a pedestrian, or a cyclist) of the objects in front of thevehicle 1 based on the front image data of thecamera 110. - In addition, the
controller 140 may match the objects detected by the front image data to the detected objects detected by the front radar data, and may acquire the type information, the location information, and the speed information of the objects detected in front of thevehicle 1 based on the matching result. - The
controller 140 may acquire location information (distance and direction) and speed information (relative speed) of objects on the side(s) (front right, front left, rear right, rear left) of thevehicle 1 based on the corner radar data of the plurality ofcorner radars 130. - The
memory 142 may store a program for theprocessor 141 to process various data and a program for theprocessor 141 to generate a control signal. - In addition, the
memory 142 may store the image data acquired by thecamera 110, the radar data acquired by theradars - The
memory 142 may include a nonvolatile memory such as a flash memory, a read only memory (ROM), an erasable programmable read only memory (EPROM), or the like, as well as a volatile memory such as an S-RAM or a D-RAM. - One or more processor(s) 141 included in the
controller 140 may be integrated on one chip or may be physically separated. In addition, the processor(s) 141 and thememory 142 may be implemented as a single chip. - The
controller 140 may identify one or more object(s) outside thevehicle 1 by processing the image data acquired by thecamera 110. - In addition, the
controller 140 may identify the type of the object(s). Objects outside thevehicle 1 may include lanes, curbs, guardrails, structures on roads such as median dividers, surrounding vehicles, obstacles on driving lanes, pedestrians, and the like. - The
controller 140 may obtain location information of the object(s). The location information of each object may include at least one of a current location of the object, a distance to the object, a moving speed of the object, and an expected moving path of the object. Thecontroller 140, when identifying each moving object, may detect the moving speed of the object and predict the moving path of the object based on the current position of the object and the position predicted after a predetermined time. - In addition, the
controller 140 may process the image data to detect a curved section, a shoulder, a side slope of a road, and the like. The side slope of a road is a concept that includes terrain that is not continuous with the lane, such as scarps or cliffs. Thecontroller 140 may process the image data to calculate the curvature of the road ahead. - Referring to
FIGS. 4 and 5 , a method of adjusting a warning point for hands-off according to driving situations will be described in detail below. -
FIGS. 4 and 5 are flowcharts illustrating a control method of a driver assistance system according to an exemplary embodiment. - Referring to
FIG. 4 , thecontroller 140 may operate the driver assistance system 100 (401). For example, thecontroller 140 may operate a lane keeping assist system or a lane following assist system. - When operation of the
driver assistance system 100 starts, the hands-offdetector 160 detects (402) that the driver's hands are off of the steering wheel. The hands-offdetector 160 may determine whether the driver holds the steering wheel with both hands within a short time (for example, 0.1 second) and transmit a hands-off detection signal to thecontroller 140 when the driver does not hold the steering wheel with both hands (e.g., when at least one hand is off of the steering wheel). Alternatively or additionally, the hands-offdetector 160 may determine whether the driver holds the steering wheel with at least one hand within a short time (for example, 0.1 second) and transmit the hands-off detection signal to thecontroller 140 upon determining that all hand(s) of the driver are off of the steering wheel (e.g., when no hands of the driver are holding the steering wheel). - The
controller 140 may process image data obtained by thecamera 110, radar data obtained by radar(s) 120 and 130, and behavior data acquired by the sensor(s) 150, to determine the driving situation of thevehicle 1. - In detail, the
controller 140 may detect the position of thevehicle 1 in the lane based on the image data. Thecontroller 140 may calculate a distance by which thevehicle 1 is spaced from the center of the lane, and a distance by which thevehicle 1 is spaced from the left lane and/or the right lane. - In addition, the
controller 140 may calculate the reliability of the lane based on the image data. The reliability of the lane is an indicator of the clarity of both lanes, such as the quality or reliability of sensing of the positions and other characteristics of the lanes obtained from the driver assistance system. Thecontroller 140 may calculate the reliability of the lane by using correlation data between the degree of clarity of the lane previously stored in thememory 142 and the reliability of the lane. For example, when the lane does not exist (e.g., lane markings to not exist or are not visible), the reliability of the lane may correspond to zero, and when the lane is clearly detected above a predetermined reference clarity, the reliability of the lane may correspond to 10. - The
controller 140 may calculate a collision risk with external object(s) based on the radar data. Thecontroller 140 may calculate a time to collision (TTC), which is a time until a collision between thevehicle 1 and the front object, based on the position information (distance) and the speed information (relative speed) of the front object(s). - The
controller 140 may determine the collision risk with the external object(s) based on the time to collision. For example, it may be determined that the collision risk is 30% when the time to collision is 5 seconds, and the collision risk is 80% when the time to collision is 2 seconds. Such numerical values are exemplary and the disclosure is not limited thereto. - In addition, the
controller 140 may calculate a distance to collision (DTC) based on speed information (relative speed) of the front objects. Thecontroller 140 may calculate the collision risk based on a comparison result between the distance to the collision and the distance to the front objects. - The
controller 140 may process the behavior data to calculate the behavior safety of thevehicle 1. Thecontroller 140 may determine that the behavior safety degree is low when the behavior data is out of a predetermined safety range. For example, thecontroller 140 may calculate a low level of the behavior safety when the yaw rate change amount, the lateral acceleration change amount, and the longitudinal acceleration change amount included in the behavior data each exceed a predetermined change amount for a predetermined time. - Correlation data between the behavior data and the behavior safety may be previously stored in the
memory 142. - The
controller 140 may determine the driving situation based on at least one of the position of thevehicle 1 in the lane, the reliability of the lane, the risk of collision with an external object, and the behavior safety of thevehicle 1. - The
controller 140 may determine whether the driving situation satisfies a warning point delay condition under which the length/duration of the warning time-point may be extended, and determine whether the driving situation satisfies a warning point shortening condition under which the length/duration of the warning time-point may be shortened. - When the hands-off is detected by the hands-off
detector 160, thecontroller 140 may determine or adjust a warning time-point for the hands-off based on the driving situation (403). Thecontroller 140 may control thewarning device 170 to output a warning message for hands-off at the determined or adjusted warning time-point, such as after the determined or adjusted warning time-point has elapsed following detection of the hands-off condition. - Referring to
FIG. 5 , thecontroller 140 may receive the hands-off detection signal from the hands-off detector 160 (501). - The
controller 140 determines the driving situation based on at least one of the position of thevehicle 1 in the lane, the reliability of the lane, the risk of collision with an external object, and the behavior safety of thevehicle 1, and determines whether the driving situation satisfies the warning point delay condition or the warning point shortening condition (502, 504). - When the
vehicle 1 is located within a predetermined distance from the center of the lane, the reliability of both lanes is greater than the predetermined reliability, the risk of collision with the external object is less than the predetermined risk, and the curvature of the road ahead is less than the predetermined curvature, thecontroller 140 may determine that the warning point delay condition is satisfied. - The
controller 140 may determine the delay time when the warning point delay condition is satisfied. In addition, thecontroller 140 may adjust the delay time based on at least one of a current speed and a distance to the external object. The maximum delay time may be set to two minutes from a predetermined reference warning point. Here, the predetermined reference warning point or time-point may be defined as a time point when 12 seconds have elapsed from when the hands-off is detected, such as a time point occurring when the hands-off is maintained/detected continuously for 12 seconds. This delay time is illustrative, and this disclosure is not limited thereto. - The
controller 140 may determine a time point delayed by a delay time from the predetermined reference warning point as the warning point for the hands-off, and control thewarning device 170 to output a warning message after the delayed time has elapsed since the initially detected hands-off (503). - In case of at least one of when the
vehicle 1 is located outside the predetermined distance from the center of the lane, when the reliability of at least one of both lanes is less than the predetermined reliability, when the risk of collision with the external object is greater than a predetermined risk, when the curvature of the road ahead is more than the predetermined curvature, and when the behavior data of the vehicle is outside the predetermined safety range, thecontroller 140 may determine that the warning point shortening condition is satisfied. - The
controller 140 may determine a shortening time when the warning point shortening condition is satisfied. Thecontroller 140 may determine a shortening time differently for each warning point shortening condition. That is, when the vehicle is located outside the predetermined distance from the center of the lane, when the reliability of at least one of both lanes is less than the predetermined reliability, when the risk of collision with the external object is more than the predetermined risk, when the curvature of the road ahead is greater than or equal to the predetermined curvature, and when the behavior data of the vehicle is outside the predetermined safety range, thecontroller 140 may determine a shortening time for each condition differently. For example, when the reference warning point is 12 seconds, in each case, the shortening time may be determined to be 9 seconds, 5 seconds, 10 seconds, 7 seconds, 11 seconds. - The
controller 140 may determine a time point ahead of the predetermined reference warning point by the shortening time as a warning point for hands-off, and may control thewarning device 170 to output a warning message after the shortened time has elapsed after detecting the hands-off (505). - If the driving situation does not correspond to the warning point delay condition or the warning point shortening condition, the
controller 140 may control thewarning device 170 to output a warning message for a hand-off at the reference warning point after detecting the hands-off (506). - As described above, according to the driver assistance system and the control method thereof, a warning message for the hands-off may be provided to the driver by adjusting the warning point for the hands-off according to the driving situation.
- That is, even when the hands-off is detected, if the driving situation is a safe situation, the warning point for the hands-off may be suspended, thereby reducing the fatigue that the driver may feel due to the warning.
- On the contrary, when the driving situation where the hands-off is detected is an unstable situation, the safety can be increased by shortening the warning point for the hands-off.
- Therefore, the driver can also increase satisfaction and can increase the reliability of autonomous driving. In addition, the safety of driving can be improved.
- The present disclosure as described above may be implemented as computer-readable codes in a non-transitory recording medium on which a program is recorded which, when executed by a processor, cause the processor to perform functions including functions described as performed herein by the
controller 140 and other components of thedriver assistance system 100. The computer-readable mediums include all types of recording devices which may be read by a computer system and on which data are stored. - Examples of the computer-readable medium include a Hard Disk Drive (HDD), a Solid State Disk (SSD), Silicon Disk Drive (SDD), a Read Only Memory (ROM), a Random Access Memory (RAM), CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, and may also include things implemented in the form of carrier wave (e.g. transmission through the Internet).
- The above description and the accompanying drawings provide an example of the technical idea of the present disclosure for illustrative purposes only. Those having ordinary knowledge in the technical field, to which the present disclosure pertains, will appreciate that various modifications and changes in form, such as combination, separation, substitution, and change of a configuration, are possible without departing from the essential features of the present disclosure. Therefore, the embodiments disclosed in the present disclosure are intended to illustrate the scope of the technical idea of the present disclosure, and the scope of the present disclosure is not limited by the embodiments.
Claims (30)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020190034975A KR20200115827A (en) | 2019-03-27 | 2019-03-27 | Driver assistance system, and control method for the same |
KR10-2019-0034975 | 2019-03-27 |
Publications (2)
Publication Number | Publication Date |
---|---|
US10787123B1 US10787123B1 (en) | 2020-09-29 |
US20200307453A1 true US20200307453A1 (en) | 2020-10-01 |
Family
ID=72606909
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/707,416 Active US10787123B1 (en) | 2019-03-27 | 2019-12-09 | Driver assistance system, and control method for the same |
Country Status (4)
Country | Link |
---|---|
US (1) | US10787123B1 (en) |
KR (1) | KR20200115827A (en) |
CN (1) | CN111746552A (en) |
DE (1) | DE102020202937A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220024462A1 (en) * | 2020-07-21 | 2022-01-27 | Toyota Jidosha Kabushiki Kaisha | Control device for vehicle, control method for automated driven vehicle, and nontransitory recording medium provided with computer program |
US20220101022A1 (en) * | 2020-09-29 | 2022-03-31 | Rivian Ip Holdings, Llc | Vehicle cliff and crevasse detection systems and methods |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112706710B (en) * | 2021-01-27 | 2022-07-22 | 南京工程学院 | Intelligent recognition and warning system and method for safe driving of motor vehicle |
CN113022578B (en) * | 2021-04-02 | 2023-04-07 | 中国第一汽车股份有限公司 | Passenger reminding method and system based on vehicle motion information, vehicle and storage medium |
CN113246997A (en) * | 2021-06-28 | 2021-08-13 | 智道网联科技(北京)有限公司 | Safety monitoring method and device in intelligent driving, electronic equipment and storage medium |
DE102022206603A1 (en) | 2022-06-29 | 2024-01-04 | Volkswagen Aktiengesellschaft | Hand detection method, computer program, and device |
US11840265B1 (en) * | 2023-05-02 | 2023-12-12 | Plusai, Inc. | Variable safe steering hands-off time and warning |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102006060628A1 (en) * | 2006-12-21 | 2008-06-26 | Robert Bosch Gmbh | Method for adjusting a steering system in a vehicle |
KR101424421B1 (en) * | 2009-11-27 | 2014-08-01 | 도요타지도샤가부시키가이샤 | Drive assistance device and drive assistance method |
JP5622104B2 (en) | 2010-12-24 | 2014-11-12 | トヨタ自動車株式会社 | Driving assistance device |
EP2591942B1 (en) * | 2011-11-11 | 2015-02-25 | Volvo Car Corporation | Arrangement and method for safeguarding driver attentiveness |
KR101384522B1 (en) | 2011-12-15 | 2014-04-14 | 현대자동차주식회사 | Auto Steering Control Method Relating to the Driver's Driving Pattern |
US9096262B2 (en) * | 2012-05-25 | 2015-08-04 | Ford Global Technologies, Llc | Hands-on-off steering wheel detection for motor vehicle |
US9751534B2 (en) * | 2013-03-15 | 2017-09-05 | Honda Motor Co., Ltd. | System and method for responding to driver state |
CN104794856B (en) * | 2014-01-22 | 2018-06-22 | 径卫视觉科技(上海)有限公司 | Driver attention's compositive appraisement system |
US9335178B2 (en) * | 2014-01-28 | 2016-05-10 | GM Global Technology Operations LLC | Method for using street level images to enhance automated driving mode for vehicle |
EP2907730B1 (en) * | 2014-01-29 | 2017-09-06 | Steering Solutions IP Holding Corporation | Hands on steering wheel detect |
US9620018B2 (en) * | 2014-10-17 | 2017-04-11 | Hyundai Motor Company | Apparatus and method for controlling lane keeping of vehicle |
KR101621747B1 (en) * | 2014-12-15 | 2016-05-17 | 주식회사 만도 | Electric Steering Apparatus and Controlling Method of the Same |
JP6341149B2 (en) * | 2015-07-07 | 2018-06-13 | トヨタ自動車株式会社 | Vehicle driving support device |
JP2017144776A (en) * | 2016-02-15 | 2017-08-24 | 株式会社Subaru | Vehicle traveling control device |
KR102498243B1 (en) * | 2016-12-16 | 2023-02-08 | 현대자동차주식회사 | Hands On/Off Detecting System Using Steering Wheel Heating Wire |
CN107161146B (en) * | 2017-04-05 | 2019-09-24 | 吉利汽车研究院(宁波)有限公司 | A kind of highway auxiliary system |
-
2019
- 2019-03-27 KR KR1020190034975A patent/KR20200115827A/en active Search and Examination
- 2019-12-09 US US16/707,416 patent/US10787123B1/en active Active
-
2020
- 2020-03-06 DE DE102020202937.7A patent/DE102020202937A1/en active Pending
- 2020-03-23 CN CN202010206787.2A patent/CN111746552A/en active Pending
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220024462A1 (en) * | 2020-07-21 | 2022-01-27 | Toyota Jidosha Kabushiki Kaisha | Control device for vehicle, control method for automated driven vehicle, and nontransitory recording medium provided with computer program |
US11897482B2 (en) * | 2020-07-21 | 2024-02-13 | Toyota Jidosha Kabushiki Kaisha | Autonomous vehicle control for changing grip completion status in real-time to prevent unnecessary warning issuance |
US20220101022A1 (en) * | 2020-09-29 | 2022-03-31 | Rivian Ip Holdings, Llc | Vehicle cliff and crevasse detection systems and methods |
Also Published As
Publication number | Publication date |
---|---|
KR20200115827A (en) | 2020-10-08 |
DE102020202937A1 (en) | 2020-10-01 |
US10787123B1 (en) | 2020-09-29 |
CN111746552A (en) | 2020-10-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10787123B1 (en) | Driver assistance system, and control method for the same | |
US10919525B2 (en) | Advanced driver assistance system, vehicle having the same, and method of controlling the vehicle | |
US10460182B1 (en) | Driver assistance system and control method thereof | |
US10926764B2 (en) | Lane keeping assistance apparatus, vehicle having the same and method for controlling the same | |
US11772655B2 (en) | Advanced driver assistance system, vehicle having the same, and method of controlling vehicle | |
US20200369264A1 (en) | Collision avoidance device, vehicle having the same and method of controlling the vehicle | |
US11479269B2 (en) | Apparatus for assisting driving of a vehicle and method thereof | |
KR20200094378A (en) | Driver assistance system and controlling method thereof | |
US11518373B2 (en) | Vehicle and control method thereof | |
KR102440255B1 (en) | Driver assistance system and method thereof | |
US11235741B2 (en) | Vehicle and control method for the same | |
US20200242941A1 (en) | Driver assistance system, and control method the same | |
KR20210080032A (en) | Driver assistance apparatus and method of thereof | |
US11890939B2 (en) | Driver assistance system | |
KR20210084713A (en) | Driver assistance system and driver assistance method | |
US20210323550A1 (en) | Driver assistance apparatus | |
KR20200094629A (en) | Driver assistance system, and control method for the same | |
KR20210114689A (en) | Vehicle and method of controlling the same | |
US20230101872A1 (en) | Vehicle and control method thereof | |
US11970167B2 (en) | Driver assistance apparatus and driver assistance method | |
US11798287B2 (en) | Driver assistance apparatus and method of controlling the same | |
US11718293B2 (en) | Driver assistance apparatus | |
US11840220B2 (en) | Driver assistance system and control method thereof | |
US20220203974A1 (en) | Vehicle and method of controlling the same | |
US20220396266A1 (en) | Driver assistance system and method of controlling the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MANDO CORPORATION, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KIM, HEONG TAE;REEL/FRAME:051229/0502 Effective date: 20191113 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: MANDO MOBILITY SOLUTIONS CORPORATION, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MANDO CORPORATION;REEL/FRAME:058598/0480 Effective date: 20211026 |
|
AS | Assignment |
Owner name: HL KLEMOVE CORP., KOREA, REPUBLIC OF Free format text: MERGER;ASSIGNOR:MANDO MOBILITY SOLUTIONS CORPORATION;REEL/FRAME:061148/0166 Effective date: 20211202 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |