US20200298846A1 - Apparatus for preventing pedestrian collision accident, system having the same, and method thereof - Google Patents

Apparatus for preventing pedestrian collision accident, system having the same, and method thereof Download PDF

Info

Publication number
US20200298846A1
US20200298846A1 US16/898,995 US202016898995A US2020298846A1 US 20200298846 A1 US20200298846 A1 US 20200298846A1 US 202016898995 A US202016898995 A US 202016898995A US 2020298846 A1 US2020298846 A1 US 2020298846A1
Authority
US
United States
Prior art keywords
pedestrian
vehicle
collision
ttc
subject vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US16/898,995
Inventor
Byung Yong YOU
Ki Cheol Shin
Myung Seon Heo
Young Chul Oh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hyundai Motor Co
Kia Corp
Original Assignee
Hyundai Motor Co
Kia Motors Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hyundai Motor Co, Kia Motors Corp filed Critical Hyundai Motor Co
Priority to US16/898,995 priority Critical patent/US20200298846A1/en
Assigned to KIA MOTORS CORPORATION, HYUNDAI MOTOR COMPANY reassignment KIA MOTORS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HYUNDAI MOTOR COMPANY
Publication of US20200298846A1 publication Critical patent/US20200298846A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/50Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
    • B60Q1/525Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking automatically indicating risk of collision between vehicles in traffic or with pedestrians, e.g. after risk assessment using the vehicle sensor data
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q5/00Arrangement or adaptation of acoustic signal devices
    • B60Q5/005Arrangement or adaptation of acoustic signal devices automatically actuated
    • B60Q5/006Arrangement or adaptation of acoustic signal devices automatically actuated indicating risk of collision between vehicles or with pedestrians
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/34Protecting non-occupants of a vehicle, e.g. pedestrians
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/18Conjoint control of vehicle sub-units of different type or different function including control of braking systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/09Taking automatic action to avoid collision, e.g. braking and steering
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/095Predicting travel path or likelihood of collision
    • B60W30/0956Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
    • B60W30/18Propelling the vehicle
    • B60W30/18009Propelling the vehicle related to particular drive situations
    • B60W30/18109Braking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/10Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
    • B60W40/105Speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • G06K9/00369
    • G06K9/00805
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/161Decentralised systems, e.g. inter-vehicle communication
    • G08G1/162Decentralised systems, e.g. inter-vehicle communication event-triggered
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/166Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • B60K2360/21
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2370/00Details of arrangements or adaptations of instruments specially adapted for vehicles, not covered by groups B60K35/00, B60K37/00
    • B60K2370/20Optical features of instruments
    • B60K2370/21Optical features of instruments using cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R2021/003Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks characterised by occupant or pedestian
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8033Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for pedestrian protection
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo or light sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/42Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/45External transmission of data to or from the vehicle
    • B60W2556/65Data transmitted between vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2710/00Output or target parameters relating to a particular sub-units
    • B60W2710/18Braking system
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2720/00Output or target parameters relating to overall vehicle dynamics
    • B60W2720/10Longitudinal speed

Definitions

  • the present disclosure relates to an apparatus for preventing a pedestrian collision accident, a system having the same, and a method thereof, and more particularly, to a technology capable of preventing a pedestrian, which is hidden by parked and stopped vehicles, from colliding with a traveling vehicle.
  • a pedestrian accident often occurs when vehicles 10 illegally park or stop in line with each other along a road as illustrated in FIG. 1 , or when a traveling vehicle 30 collides with a pedestrian 20 while the pedestrian 20 is hidden or blocked by the vehicles 10 parked or stopped illegally and then suddenly stepping out in front of the vehicles 10 as illustrated in FIG. 2 .
  • the present disclosure provides an apparatus for preventing a pedestrian collision accident, a system having the same, and a method thereof, capable of sensing a pedestrian in advance, which is hidden by (e.g., not readily visible) drivers in parked or stopped vehicles, such that the collision between the pedestrian and a traveling vehicle may be predicted in advance and the pedestrian and the traveling vehicle may be warned, thereby preventing a pedestrian collision accident in advance.
  • an apparatus for preventing a pedestrian collision accident may include a pedestrian sensing unit configured to sense a pedestrian moving into a dangerous area and calculate velocity and direction information of the pedestrian, a communication unit configured to transmit the velocity and direction information of the pedestrian to a surrounding vehicle, a time-to-collision (TTC) calculating unit configured to calculate a time to collision (TTC) using velocity and direction information of a subject vehicle (e.g., a traveling vehicle) and second velocity and direction information of the pedestrian, when the time-to-collision calculating unit receives the second velocity and direction information of the pedestrian from another vehicle, a controller configured to operate a warning unit to output, based on the time to collision (TTC), a warning notification to a driver regarding the subject vehicle or the pedestrian.
  • TTC time-to-collision
  • the pedestrian sensing unit may be configured to sense the pedestrian based on image data and sensing data on a periphery of the subject vehicle.
  • the apparatus may further include a dangerous area defining unit configured to distinguish between a road and a sidewalk based on the image data and the sensing data on the periphery of the subject vehicle and define the road as the dangerous area.
  • the pedestrian sensing unit may further be configured to sense whether the pedestrian moves along the sidewalk or moves into the dangerous area.
  • the time-to-collision calculating unit may be configured to calculate a moving direction and a velocity vector of the pedestrian based on the second velocity and direction information of the pedestrian, calculate a moving direction and a velocity vector of the subject vehicle, calculate an interconnecting point between the velocity vector of the pedestrian and the velocity vector of the subject vehicle, and calculate a time, in which the subject vehicle arrives at the interconnecting point, as the time to collision (TTC).
  • the controller may be configured to operate a brake device of the subject vehicle to forcibly decelerate or stop the subject vehicle and request a parking or stopping vehicle to warn the pedestrian, when the time to collision (TTC) is less than a first threshold value.
  • the controller may be configured to provide a warning or notification to the driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, and request the parking or stopping vehicle to warn the pedestrian, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than a second threshold value.
  • the controller may further be configured to request the parking or stopping vehicle to warn the pedestrian, when the time to collision (TTC) is equal to or greater than the second threshold value and is less than a third threshold value.
  • the controller may be configured to determine a present situation as being an emergency situation to request the parking or stopping vehicle to warn the pedestrian by simultaneously operating a horn and an emergency lamp, when the time to collision (TTC) is less than the first threshold value, and may be configured to request the parking or stopping vehicle to warn the pedestrian by operating one of the horn and the emergency lamp, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than a third threshold value.
  • TTC time to collision
  • a method of preventing a pedestrian collision accident may include sensing a pedestrian moving into a dangerous area, calculating velocity and direction information of the pedestrian, transmitting the velocity and direction information of the pedestrian to surrounding vehicles, and warning the pedestrian when a command for warning the pedestrian is received from a traveling vehicle among the surrounding vehicles.
  • the sensing of the pedestrian may include sensing the pedestrian based on image data and sensing data on a periphery of a subject vehicle.
  • the calculating of the velocity and direction information of the pedestrian may include distinguishing between a road and a sidewalk based on the image data and the sensing data on the periphery of the subject vehicle, defining the road as a dangerous area, and calculating a velocity of the pedestrian moving into the dangerous area.
  • a horn or an emergency lamp may be used.
  • a method of preventing a pedestrian collision accident may include receiving velocity and direction information of a pedestrian from a vehicle parked or stopped along a street, calculating a time to collision (TTC) using velocity and direction information of a subject vehicle, which is traveling, and the velocity and direction information of the pedestrian, and transmitting a command for warning the pedestrian to the vehicle parked or stopped along the street or warning a driver of the subject vehicle, based on the time to collision (TTC).
  • TTC time to collision
  • the method may further include operating the subject vehicle to automatically decelerate or stop.
  • a brake device of the subject vehicle may be operated to forcibly decelerate or stop the subject vehicle, when the time to collision (TTC) is less than a first threshold value.
  • TTC time to collision
  • the driver of the subject vehicle may be warned such that the driver drives the subject vehicle at a reduced speed, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than a second threshold value.
  • the parked or stopped vehicle may be requested to warn the pedestrian, when the time to collision (TTC) is equal to or greater than the second threshold value and is less than a third threshold value.
  • the command for warning the pedestrian by simultaneously operating a horn and an emergency lamp may be transmitted when the time to collision (TTC) is less than the first threshold value, and the command for warning the pedestrian by operating the horn or the emergency lamp may be transmitted when the time to collision (TTC) is equal to or greater than the first threshold value and is less than the third threshold value, when the command for warning the pedestrian is transmitted to the vehicle parked or stopped along the street.
  • the calculating of the time to collision may include calculating a moving direction and a velocity vector of the pedestrian, calculating a moving direction and a velocity vector of the subject vehicle, calculating an interconnecting point between the velocity vector of the pedestrian and the velocity vector of the subject vehicle, and calculating a time, in which the subject vehicle arrives at the interconnecting point, as the time to collision (TTC).
  • FIG. 1 is a view illustrating vehicles illegally parked or stopped along a street according to the related art
  • FIG. 2 is a view illustrating the movement of a pedestrian and a traveling vehicle between the vehicles illegally parked or stopped along the street according to the related art
  • FIG. 3 is a block diagram illustrating a system for preventing a pedestrian collision accident, according to an exemplary embodiment of the present disclosure
  • FIG. 4 is a view illustrating image data, according to an exemplary embodiment of the present disclosure.
  • FIG. 5A is a view illustrating a pedestrian moving in a transverse direction, according to an exemplary embodiment of the present disclosure
  • FIGS. 5B-5E are views illustrating images of a sensed pedestrian which is displayed on an around view monitor (AVM) screen, according to an exemplary embodiment of the present disclosure
  • FIG. 6 is a view illustrating a method of calculating a time to collision of a pedestrian moving into a dangerous area, according to an exemplary embodiment of the present disclosure
  • FIG. 7 is a view illustrating a method of preventing a collision accident of a pedestrian stopping, according to an exemplary embodiment of the present disclosure
  • FIG. 8 is a view illustrating a method of preventing a collision accident of a pedestrian moving into a dangerous area, according to an exemplary embodiment of the present disclosure
  • FIG. 9 is a flowchart illustrating a method of preventing a pedestrian collision accident, according to an exemplary embodiment of the present disclosure.
  • FIG. 10 is a flowchart illustrating a warning method based on a time to collision, according to an exemplary embodiment of the present disclosure.
  • FIG. 11 is a block diagram illustrating a computer system, to which the method of preventing the pedestrian collision accident is applied, according to an exemplary embodiment of the present disclosure.
  • vehicle or “vehicular” or other similar term as used herein is inclusive of motor vehicles in general such as passenger automobiles including sports utility vehicles (SUV), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft, and the like, and includes hybrid vehicles, electric vehicles, combustion, plug-in hybrid electric vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g. fuels derived from resources other than petroleum).
  • motor vehicles in general such as passenger automobiles including sports utility vehicles (SUV), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft, and the like, and includes hybrid vehicles, electric vehicles, combustion, plug-in hybrid electric vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g. fuels derived from resources other than petroleum).
  • SUV sports utility vehicles
  • plug-in hybrid electric vehicles e.g. fuels derived from resources other than petroleum
  • controller/controller refers to a hardware device that includes a memory and a processor.
  • the memory is configured to store the modules and the processor is specifically configured to execute said modules to perform one or more processes which are described further below.
  • control logic of the present disclosure may be embodied as non-transitory computer readable media on a computer readable medium containing executable program instructions executed by a processor, controller/controller or the like.
  • the computer readable mediums include, but are not limited to, ROM, RAM, compact disc (CD)-ROMs, magnetic tapes, floppy disks, flash drives, smart cards and optical data storage devices.
  • the computer readable recording medium can also be distributed in network coupled computer systems so that the computer readable media is stored and executed in a distributed fashion, e.g., by a telematics server or a Controller Area Network (CAN).
  • a telematics server or a Controller Area Network (CAN).
  • CAN Controller Area Network
  • the term “about” is understood as within a range of normal tolerance in the art, for example within 2 standard deviations of the mean. “About” can be understood as within 10%, 9%, 8%, 7%, 6%, 5%, 4%, 3%, 2%, 1%, 0.5%, 0.1%, 0.05%, or 0.01% of the stated value. Unless otherwise clear from the context, all numerical values provided herein are modified by the term “about.”
  • the terms ‘first’, ‘second’, ‘A’, ‘B’, ‘(a)’, and ‘(b)’ may be used.
  • the terms are used only to distinguish relevant elements from other elements, and the nature, the order, or the sequence of the relevant elements is not limited to the terms.
  • all terms used herein, including technical or scientific terms have the same meanings as those generally understood by those skilled in the art to which the present disclosure pertains. Such terms as those defined in a generally used dictionary are to be interpreted as having meanings equal to the contextual meanings in the relevant field of art, and are not to be interpreted as having ideal or excessively formal meanings unless clearly defined as having such in the present application.
  • FIG. 3 is a block diagram illustrating a system for preventing a pedestrian collision accident, according to an exemplary embodiment of the present disclosure.
  • the system for presenting the pedestrian collision accident may include an apparatus 100 for preventing the pedestrian collision accident (hereinafter, referred to as “anti-pedestrian collision apparatus”), an image acquiring unit 200 , a sensor device 300 , and a brake device 400 .
  • the components of the apparatus 100 may be operated by an overall controller of the vehicle.
  • the image acquiring unit 200 may be configured to photograph (e.g., capture an image of) a periphery of a vehicle and transmit image data regarding the periphery or surrounding environment to the anti-pedestrian collision apparatus 100 .
  • photograph e.g., capture an image of
  • image data regarding the periphery or surrounding environment to the anti-pedestrian collision apparatus 100 .
  • an image of a front portion of a vehicle and a detailed image of the vehicle may be displayed together, and a sidewalk 410 and a road 420 may be distinguished therebetween and displayed on a screen within the vehicle.
  • the image acquiring unit 200 may be configured to use an imaging device or camera of an around view monitor (AVM) device to capture the image.
  • AVM around view monitor
  • the sensor device 300 may be configured to sense or detect obstacles (e.g., pedestrian, vehicle, and the like) around the vehicle and transmit the sensing result to the anti-pedestrian collision apparatus 100 .
  • the sensor device 300 may include an ultrasonic sensor or a lidar sensor.
  • the sensor device 300 may include a wheel sensor or a global positioning system (GPS) sensor to calculate the velocity of a subject vehicle.
  • the brake device 400 may be configured to decelerate or top the vehicle under the control of the anti-pedestrian collision apparatus 100 .
  • the anti-pedestrian collision apparatus 100 may be mounted in a parked or stopped vehicle or a traveling vehicle.
  • the anti-pedestrian collision apparatus 100 may be configured to calculate a moving direction and a velocity of the pedestrian based on image data and sensing data, transmit information regarding the moving direction and velocity of the pedestrian to a surrounding vehicle, and warn the pedestrian by operating a horn or an emergency lamp when the anti-pedestrian collision apparatus 100 receives a request for the warning to the pedestrian from the surrounding vehicle.
  • the anti-pedestrian collision apparatus 100 may be configured to calculate a time to collision (TTC) using the information regarding the moving direction and velocity of the pedestrian received from the parked or stopped vehicle and the velocity and direction information of a subject vehicle, forcibly brake the subject vehicle based on the TTC, warn a driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, and request the vehicle, which transmits the information on the moving direction and velocity of the pedestrian, to warn the pedestrian.
  • TTC time to collision
  • the anti-pedestrian collision apparatus 100 may include an information collecting unit 110 , a dangerous area defining unit 120 , a pedestrian sensing unit 130 , a time-to-collision calculating unit 140 , a communication unit 150 , a warning unit 160 , a display unit 170 , a storage unit 180 , and a controller 190 .
  • the information collecting unit 110 may be configured to collect the image data from the image acquiring unit 200 and collect the sensing data from the sensor device 300 .
  • the dangerous area defining unit 120 may be configured to distinguish between the road 420 and the sidewalk 410 in the image data of FIG. 4 and define the road 420 as a dangerous area (e.g., an area in which pedestrian collision is possible).
  • FIG. 4 is a view illustrating the image data, according to an exemplary embodiment of the present disclosure, that is, a view illustrating an AVM screen.
  • the pedestrian sensing unit 130 may be configured to sense or detect a pedestrian moving along the sidewalk or moving into the dangerous area and calculate the velocity and direction information of the pedestrian. Particularly, the pedestrian sensing unit 130 may be configured to sense the pedestrian based on the image data and the sensing data of a periphery or surrounding environment of the subject vehicle as illustrated in FIGS. 5A-5E . In other words, the pedestrian sensing unit 130 may be configured to sense whether the pedestrian moves along the sidewalk, is stopped, or moves into the dangerous area.
  • FIG. 5A is a view illustrating that the pedestrian moves rightward, and it may be recognized from FIG. 5A that the pedestrian moves in a transverse direction or a longitudinal direction.
  • the sensing of the pedestrian may be performed by detecting motion candidates from the image data and estimating the positions of the motion candidates.
  • a vector based on an optical flow is analyzed to detect the motion candidates and to estimate the positions of the motion candidates.
  • the motion of the candidates is analyzed according to heights of the camera and features of a fixed object are extracted, thereby sensing the pedestrian.
  • the time-to-collision calculating unit 140 may be configured to calculate a TTC using the velocity and direction information of the subject vehicle and received velocity and direction information of the pedestrian, when the subject vehicle receives the velocity and direction information of the pedestrian from another vehicle.
  • the time-to-collision calculating unit 140 may be configured to calculate a moving direction and a velocity vector of the pedestrian based on the velocity and direction information of the pedestrian, calculate a moving direction and a velocity vector of the subject vehicle, and calculate the interconnecting point between the velocity vector of the pedestrian and the velocity vector of the subject vehicle.
  • FIG. 6 is a view illustrating a method of calculating the TTC of the pedestrian moving into the dangerous area, according to an exemplary embodiment of the present disclosure.
  • a road 12 and a sidewalk 13 are divided from each other by a curb 11 , and a pedestrian 21 moves into a dangerous area while a vehicle (subject vehicle or traveling vehicle) 30 is traveling.
  • the time-to-collision calculating unit 140 of the traveling vehicle 30 may be configured to determine an interconnecting point 40 between a velocity vector 41 of the pedestrian 21 and a velocity vector 42 of the traveling vehicle 30 as a collision point between the pedestrian 21 and the vehicle 30 . Accordingly, a time point in which the traveling vehicle 30 arrives at or reaches the interconnecting point 40 may be determined as the TTC.
  • the communication unit 150 may be configured to communicate with a surrounding vehicle.
  • the communication unit 150 may be configured to transmit the velocity and direction information of the pedestrian to the surrounding vehicle, or transmit a command for warning the pedestrian to the surrounding vehicle.
  • the warning unit 160 may be operated by the controller 190 to warn a driver of the subject vehicle or the pedestrian.
  • the warning unit 160 may be configured to warn the driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, or may be configured to output a warning sound or a warning sentence (e.g., a verbal message through a speaker or a visual message output on a screen).
  • the display unit 170 may be configured to display the image data, the warning sentence, and the like.
  • the storage unit 180 may be configured to store the image data, the sensing data, the warning sentence, the information (e.g., moving direction, velocity, and the like) of the pedestrian, and the TTC.
  • the controller 190 may be configured to output a warning to the driver of the subject vehicle or the pedestrian based on the TTC. In other words, when the TTC is less than a first threshold value, the controller 190 may be configured to operate the brake device 400 of the subject vehicle to forcibly decelerate or stop the subject vehicle, and request the surrounding parked or stopped vehicle to warn the pedestrian. In particular, the forcibly decelerating or stopping of the subject vehicle may be performed using an autonomous emergency braking (AEB) system.
  • AEB autonomous emergency braking
  • the controller 190 may be configured to warn the driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, and may be configured to request the parked or stopped vehicle (e.g., the surrounding vehicle) to warn the pedestrian, when the TTC is equal to or greater than the first threshold value and is less than a second threshold value.
  • the controller 190 may be configured to request the parked or stopped vehicle to warn the pedestrian, when the TTC is equal to or greater than the second threshold value and is less than a third threshold value.
  • the controller 190 may be configured to determine a present situation as being an emergency situation to request the parked or stopped vehicle to warn the pedestrian by simultaneously operating a horn and an emergency lamp when the TTC is less than the first threshold value.
  • the controller 190 may be configured to request the parked or stopped vehicle to warn the pedestrian by operating one of the horn and the emergency lamp when the TTC is equal to or greater than the first threshold value and is less than the second threshold value, and when the TTC is equal to or greater than the second threshold value and is less than the third threshold value.
  • the first threshold value may be set by adding a certain margin to the time required to reach the point where the pedestrian 21 and the vehicle 30 can stop before reaching the collision point when the brake control is operated and decelerated in the moving vehicle 30 .
  • the second threshold value and the third threshold value may set to a value greater than the first threshold value, depending on how soon the system warns collision.
  • the pedestrian may be recognized and the TTC may be calculated through the communication between the parked or stopped vehicle (e.g., surrounding vehicle) and the traveling vehicle. Accordingly, the pedestrian or the driver may be warned, and the vehicle may be forcibly decelerated or stopped based on the TTC, thereby preventing the pedestrian accident.
  • a method of preventing the pedestrian collision accident according to an exemplary embodiment of the present disclosure will be described with reference to FIG. 9 . The method described herein below may be executed by the controller having a memory and a processor.
  • An anti-pedestrian collision apparatus of a parked or stopped vehicle 10 may be configured to distinguish between a road and a sidewalk based on image data of vehicles parked or stopped along a street and define a dangerous area (S 101 ). Thereafter, the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 may be configured to sense a pedestrian moving into the dangerous area and calculate a moving velocity of the pedestrian (S 102 ). Then, the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 may be configured to transmit pedestrian information including a moving direction and a moving velocity of the pedestrian (S 103 ).
  • an anti-pedestrian collision apparatus of a traveling vehicle 30 which is traveling in the proximity of the parked or stopped vehicle 10 , receives the pedestrian information and calculates the velocity of a subject vehicle (S 104 ). Thereafter, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to calculate a TTC of the collision between the subject vehicle and the pedestrian (S 105 ). When the TTC is less than a preset reference value, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to request the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 to warn the pedestrian (S 106 ).
  • the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 may be configured to warn the pedestrian by operating a horn or an emergency lamp (S 107 ).
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to warn the driver such that the driver is requested to drive the subject vehicle at a reduced speed, or transmit a command for forcibly decelerating or stopping the subject vehicle to the brake device 400 (S 108 ).
  • FIG. 10 is a flowchart illustrating a warning method based on the TTC, according to an exemplary embodiment of the present disclosure.
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to determine whether the TTC is less than the first threshold (S 202 ).
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to transmit a command for forcibly decelerating or stopping the subject vehicle to the brake device and request the parked or stopped vehicle 10 to warn the pedestrian by simultaneously operating the horn and the emergency lamp (S 203 ).
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to determine whether the TTC is equal to or greater than the first threshold value and is less than a second threshold value (S 204 ).
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to warn the driver of the traveling vehicle 30 by outputting a warning sound or a warning sentence such that the driver drives the subject vehicle at a reduced speed.
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to request the parked or stopped vehicle 10 to warn the pedestrian by operating one of the horn and the emergency lamp (S 205 ).
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to determine whether the TTC is equal to or greater than the second threshold value and is less than a third threshold value (S 206 ).
  • the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to request the subject vehicle to warn the pedestrian by operating the horn or the emergency lamp (S 207 ).
  • the pedestrian may be recognized and the TTC may be calculated through the communication between the parked or stopped vehicle and the traveling vehicle. Accordingly, the pedestrian or the driver may be warned, and the vehicle may be forcibly decelerated or stopped based on the TTC, thereby preventing the pedestrian accident.
  • FIG. 11 is a block diagram illustrating a computer system, to which the method of preventing the pedestrian collision accident is applied, according to an exemplary embodiment of the present disclosure.
  • a computing system 1000 may include at least one processor 1100 , a memory 1300 , a user interface input device 1400 , a user interface output device 1500 , a storage 1600 , and a network interface 1700 , which are connected with each other via a bus 1200 .
  • the processor 1100 may be a central processing unit (CPU) or a semiconductor device which processes instructions stored in the memory 1300 and/or the storage 1600 .
  • Each of the memory 1300 and the storage 1600 may include various types of volatile or non-volatile storage media.
  • the memory 1300 may include a read only memory (ROM) and a random access memory (RAM).
  • the operations of the methods or algorithms described in connection with the exemplary embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or combinations thereof, executed by the processor 1100 .
  • the software module may reside on a storage medium (i.e., the memory 1300 and/or the storage 1600 ), such as a RAM, a flash memory, a ROM, an erasable and programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disc, a removable disc, or a compact disc-ROM (CD-ROM).
  • the storage medium may be coupled to the processor 1100 .
  • the processor 1100 may read out information from the storage medium and may write information in the storage medium.
  • the storage medium may be integrated with the processor 1100 .
  • the processor and storage medium may reside in an application specific integrated circuit (ASIC).
  • the ASIC may reside in a user terminal.
  • the integrated processor and storage medium may reside as a separate component of the user terminal.
  • a pedestrian which is blocked (e.g., not visible or hidden) by parked or stopped vehicles, may be sensed in advance such that the collision between the pedestrian and a traveling vehicle may be predicted and the pedestrian and the traveling vehicle may be warned, thereby preventing the pedestrian collision accident in advance.

Abstract

An apparatus for preventing a pedestrian collision accident, a system having the same, and a method thereof are provided. The apparatus includes a pedestrian sensing unit that senses a pedestrian moving into a dangerous area and calculates velocity and direction information of the pedestrian. A communication unit transmits the velocity and direction information of the pedestrian to a surrounding vehicle. A time-to-collision (TTC) calculating unit calculates a TTC using velocity and direction information of a subject vehicle and second velocity and direction information of the pedestrian, when the TTC calculating unit receives the second velocity and direction information of the pedestrian from another vehicle. A controller outputs based on the TTC a warning to a driver of the subject vehicle or the pedestrian.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application is based on and claims the benefit of priority to Korean Patent Application No. 10-2016-0169620, filed on Dec. 13, 2016, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.
  • TECHNICAL FIELD
  • The present disclosure relates to an apparatus for preventing a pedestrian collision accident, a system having the same, and a method thereof, and more particularly, to a technology capable of preventing a pedestrian, which is hidden by parked and stopped vehicles, from colliding with a traveling vehicle.
  • BACKGROUND
  • According to traffic accident records of the National Police Agency, fatalities of pedestrian accidents occupy more than 40% of the total traffic accident fatalities. The most common cause of pedestrian accidents is pedestrian jaywalking. In particular, a pedestrian accident often occurs when vehicles 10 illegally park or stop in line with each other along a road as illustrated in FIG. 1, or when a traveling vehicle 30 collides with a pedestrian 20 while the pedestrian 20 is hidden or blocked by the vehicles 10 parked or stopped illegally and then suddenly stepping out in front of the vehicles 10 as illustrated in FIG. 2.
  • In this regard, conventionally, techniques have been developed to prevent a pedestrian accident by sensing a suddenly appearing pedestrian using a technology of sensing a pedestrian. However, the conventional technology of sensing a pedestrian merely recognizes the suddenly appearing pedestrian, but is not capable of sensing the movement of the pedestrian in advance and predicting and preventing the collision between the pedestrian and a traveling vehicle in advance.
  • SUMMARY
  • The present disclosure provides an apparatus for preventing a pedestrian collision accident, a system having the same, and a method thereof, capable of sensing a pedestrian in advance, which is hidden by (e.g., not readily visible) drivers in parked or stopped vehicles, such that the collision between the pedestrian and a traveling vehicle may be predicted in advance and the pedestrian and the traveling vehicle may be warned, thereby preventing a pedestrian collision accident in advance.
  • The technical problems to be solved by the present inventive concept are not limited to the aforementioned problems, and any other technical problems not mentioned herein will be clearly understood from the following description by those skilled in the art to which the present disclosure pertains.
  • According to an aspect of the present disclosure, an apparatus for preventing a pedestrian collision accident may include a pedestrian sensing unit configured to sense a pedestrian moving into a dangerous area and calculate velocity and direction information of the pedestrian, a communication unit configured to transmit the velocity and direction information of the pedestrian to a surrounding vehicle, a time-to-collision (TTC) calculating unit configured to calculate a time to collision (TTC) using velocity and direction information of a subject vehicle (e.g., a traveling vehicle) and second velocity and direction information of the pedestrian, when the time-to-collision calculating unit receives the second velocity and direction information of the pedestrian from another vehicle, a controller configured to operate a warning unit to output, based on the time to collision (TTC), a warning notification to a driver regarding the subject vehicle or the pedestrian.
  • According to an exemplary embodiment, the pedestrian sensing unit may be configured to sense the pedestrian based on image data and sensing data on a periphery of the subject vehicle. The apparatus may further include a dangerous area defining unit configured to distinguish between a road and a sidewalk based on the image data and the sensing data on the periphery of the subject vehicle and define the road as the dangerous area. The pedestrian sensing unit may further be configured to sense whether the pedestrian moves along the sidewalk or moves into the dangerous area.
  • Additionally, the time-to-collision calculating unit may be configured to calculate a moving direction and a velocity vector of the pedestrian based on the second velocity and direction information of the pedestrian, calculate a moving direction and a velocity vector of the subject vehicle, calculate an interconnecting point between the velocity vector of the pedestrian and the velocity vector of the subject vehicle, and calculate a time, in which the subject vehicle arrives at the interconnecting point, as the time to collision (TTC). The controller may be configured to operate a brake device of the subject vehicle to forcibly decelerate or stop the subject vehicle and request a parking or stopping vehicle to warn the pedestrian, when the time to collision (TTC) is less than a first threshold value.
  • According to an exemplary embodiment, the controller may be configured to provide a warning or notification to the driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, and request the parking or stopping vehicle to warn the pedestrian, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than a second threshold value. The controller may further be configured to request the parking or stopping vehicle to warn the pedestrian, when the time to collision (TTC) is equal to or greater than the second threshold value and is less than a third threshold value.
  • Additionally, the controller may be configured to determine a present situation as being an emergency situation to request the parking or stopping vehicle to warn the pedestrian by simultaneously operating a horn and an emergency lamp, when the time to collision (TTC) is less than the first threshold value, and may be configured to request the parking or stopping vehicle to warn the pedestrian by operating one of the horn and the emergency lamp, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than a third threshold value.
  • According to another aspect of the present disclosure, a method of preventing a pedestrian collision accident may include sensing a pedestrian moving into a dangerous area, calculating velocity and direction information of the pedestrian, transmitting the velocity and direction information of the pedestrian to surrounding vehicles, and warning the pedestrian when a command for warning the pedestrian is received from a traveling vehicle among the surrounding vehicles. According to an exemplary embodiment, the sensing of the pedestrian may include sensing the pedestrian based on image data and sensing data on a periphery of a subject vehicle. The calculating of the velocity and direction information of the pedestrian may include distinguishing between a road and a sidewalk based on the image data and the sensing data on the periphery of the subject vehicle, defining the road as a dangerous area, and calculating a velocity of the pedestrian moving into the dangerous area. In the warning of the pedestrian, a horn or an emergency lamp may be used.
  • According to another aspect of the present disclosure, a method of preventing a pedestrian collision accident may include receiving velocity and direction information of a pedestrian from a vehicle parked or stopped along a street, calculating a time to collision (TTC) using velocity and direction information of a subject vehicle, which is traveling, and the velocity and direction information of the pedestrian, and transmitting a command for warning the pedestrian to the vehicle parked or stopped along the street or warning a driver of the subject vehicle, based on the time to collision (TTC).
  • According to an exemplary embodiment, the method may further include operating the subject vehicle to automatically decelerate or stop. In particular, a brake device of the subject vehicle may be operated to forcibly decelerate or stop the subject vehicle, when the time to collision (TTC) is less than a first threshold value. In the transmitting of the command for warning the pedestrian to the vehicle parked or stopped along the street or the warning of the driver of the subject vehicle, based on the time to collision (TTC), the driver of the subject vehicle may be warned such that the driver drives the subject vehicle at a reduced speed, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than a second threshold value. Additionally, in the transmitting of the command for warning the pedestrian to the vehicle parked or stopped along the street or the warning of the driver of the subject vehicle, based on the time to collision (TTC), the parked or stopped vehicle may be requested to warn the pedestrian, when the time to collision (TTC) is equal to or greater than the second threshold value and is less than a third threshold value.
  • The command for warning the pedestrian by simultaneously operating a horn and an emergency lamp may be transmitted when the time to collision (TTC) is less than the first threshold value, and the command for warning the pedestrian by operating the horn or the emergency lamp may be transmitted when the time to collision (TTC) is equal to or greater than the first threshold value and is less than the third threshold value, when the command for warning the pedestrian is transmitted to the vehicle parked or stopped along the street. The calculating of the time to collision (TTC) may include calculating a moving direction and a velocity vector of the pedestrian, calculating a moving direction and a velocity vector of the subject vehicle, calculating an interconnecting point between the velocity vector of the pedestrian and the velocity vector of the subject vehicle, and calculating a time, in which the subject vehicle arrives at the interconnecting point, as the time to collision (TTC).
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and other objects, features and advantages of the present disclosure will be more apparent from the following detailed description taken in conjunction with the accompanying drawings:
  • FIG. 1 is a view illustrating vehicles illegally parked or stopped along a street according to the related art;
  • FIG. 2 is a view illustrating the movement of a pedestrian and a traveling vehicle between the vehicles illegally parked or stopped along the street according to the related art;
  • FIG. 3 is a block diagram illustrating a system for preventing a pedestrian collision accident, according to an exemplary embodiment of the present disclosure;
  • FIG. 4 is a view illustrating image data, according to an exemplary embodiment of the present disclosure;
  • FIG. 5A is a view illustrating a pedestrian moving in a transverse direction, according to an exemplary embodiment of the present disclosure;
  • FIGS. 5B-5E are views illustrating images of a sensed pedestrian which is displayed on an around view monitor (AVM) screen, according to an exemplary embodiment of the present disclosure;
  • FIG. 6 is a view illustrating a method of calculating a time to collision of a pedestrian moving into a dangerous area, according to an exemplary embodiment of the present disclosure;
  • FIG. 7 is a view illustrating a method of preventing a collision accident of a pedestrian stopping, according to an exemplary embodiment of the present disclosure;
  • FIG. 8 is a view illustrating a method of preventing a collision accident of a pedestrian moving into a dangerous area, according to an exemplary embodiment of the present disclosure;
  • FIG. 9 is a flowchart illustrating a method of preventing a pedestrian collision accident, according to an exemplary embodiment of the present disclosure;
  • FIG. 10 is a flowchart illustrating a warning method based on a time to collision, according to an exemplary embodiment of the present disclosure; and
  • FIG. 11 is a block diagram illustrating a computer system, to which the method of preventing the pedestrian collision accident is applied, according to an exemplary embodiment of the present disclosure.
  • DETAILED DESCRIPTION
  • It is understood that the term “vehicle” or “vehicular” or other similar term as used herein is inclusive of motor vehicles in general such as passenger automobiles including sports utility vehicles (SUV), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft, and the like, and includes hybrid vehicles, electric vehicles, combustion, plug-in hybrid electric vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g. fuels derived from resources other than petroleum).
  • Although exemplary embodiment is described as using a plurality of units to perform the exemplary process, it is understood that the exemplary processes may also be performed by one or plurality of modules. Additionally, it is understood that the term controller/controller refers to a hardware device that includes a memory and a processor. The memory is configured to store the modules and the processor is specifically configured to execute said modules to perform one or more processes which are described further below.
  • Furthermore, control logic of the present disclosure may be embodied as non-transitory computer readable media on a computer readable medium containing executable program instructions executed by a processor, controller/controller or the like. Examples of the computer readable mediums include, but are not limited to, ROM, RAM, compact disc (CD)-ROMs, magnetic tapes, floppy disks, flash drives, smart cards and optical data storage devices. The computer readable recording medium can also be distributed in network coupled computer systems so that the computer readable media is stored and executed in a distributed fashion, e.g., by a telematics server or a Controller Area Network (CAN).
  • The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
  • Unless specifically stated or obvious from context, as used herein, the term “about” is understood as within a range of normal tolerance in the art, for example within 2 standard deviations of the mean. “About” can be understood as within 10%, 9%, 8%, 7%, 6%, 5%, 4%, 3%, 2%, 1%, 0.5%, 0.1%, 0.05%, or 0.01% of the stated value. Unless otherwise clear from the context, all numerical values provided herein are modified by the term “about.”
  • Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals will be assigned to the same elements even though the elements are shown in different drawings. In addition, in the following description, a detailed description of well-known features or functions will be ruled out in order not to unnecessarily obscure the gist of the present disclosure.
  • In the following description of elements according to an exemplary embodiment of the present disclosure, the terms ‘first’, ‘second’, ‘A’, ‘B’, ‘(a)’, and ‘(b)’ may be used. The terms are used only to distinguish relevant elements from other elements, and the nature, the order, or the sequence of the relevant elements is not limited to the terms. In addition, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meanings as those generally understood by those skilled in the art to which the present disclosure pertains. Such terms as those defined in a generally used dictionary are to be interpreted as having meanings equal to the contextual meanings in the relevant field of art, and are not to be interpreted as having ideal or excessively formal meanings unless clearly defined as having such in the present application.
  • Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to FIGS. 3 to 11. FIG. 3 is a block diagram illustrating a system for preventing a pedestrian collision accident, according to an exemplary embodiment of the present disclosure. According to an exemplary embodiment of the present disclosure, the system for presenting the pedestrian collision accident may include an apparatus 100 for preventing the pedestrian collision accident (hereinafter, referred to as “anti-pedestrian collision apparatus”), an image acquiring unit 200, a sensor device 300, and a brake device 400. The components of the apparatus 100 may be operated by an overall controller of the vehicle.
  • Particularly, the image acquiring unit 200 may be configured to photograph (e.g., capture an image of) a periphery of a vehicle and transmit image data regarding the periphery or surrounding environment to the anti-pedestrian collision apparatus 100. As illustrated in FIG. 4, based on the image data, an image of a front portion of a vehicle and a detailed image of the vehicle may be displayed together, and a sidewalk 410 and a road 420 may be distinguished therebetween and displayed on a screen within the vehicle. The image acquiring unit 200 may be configured to use an imaging device or camera of an around view monitor (AVM) device to capture the image. The sensor device 300 may be configured to sense or detect obstacles (e.g., pedestrian, vehicle, and the like) around the vehicle and transmit the sensing result to the anti-pedestrian collision apparatus 100. In particular, the sensor device 300 may include an ultrasonic sensor or a lidar sensor. Although not illustrated in the present disclosure, the sensor device 300 may include a wheel sensor or a global positioning system (GPS) sensor to calculate the velocity of a subject vehicle. The brake device 400 may be configured to decelerate or top the vehicle under the control of the anti-pedestrian collision apparatus 100.
  • Further, the anti-pedestrian collision apparatus 100 may be mounted in a parked or stopped vehicle or a traveling vehicle. When the anti-pedestrian collision apparatus 100 is mounted in the parked or stopped vehicle, the anti-pedestrian collision apparatus 100 may be configured to calculate a moving direction and a velocity of the pedestrian based on image data and sensing data, transmit information regarding the moving direction and velocity of the pedestrian to a surrounding vehicle, and warn the pedestrian by operating a horn or an emergency lamp when the anti-pedestrian collision apparatus 100 receives a request for the warning to the pedestrian from the surrounding vehicle. Meanwhile, when the anti-pedestrian collision apparatus 100 is mounted in the traveling vehicle, the anti-pedestrian collision apparatus 100 may be configured to calculate a time to collision (TTC) using the information regarding the moving direction and velocity of the pedestrian received from the parked or stopped vehicle and the velocity and direction information of a subject vehicle, forcibly brake the subject vehicle based on the TTC, warn a driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, and request the vehicle, which transmits the information on the moving direction and velocity of the pedestrian, to warn the pedestrian.
  • Accordingly, the anti-pedestrian collision apparatus 100 may include an information collecting unit 110, a dangerous area defining unit 120, a pedestrian sensing unit 130, a time-to-collision calculating unit 140, a communication unit 150, a warning unit 160, a display unit 170, a storage unit 180, and a controller 190. The information collecting unit 110 may be configured to collect the image data from the image acquiring unit 200 and collect the sensing data from the sensor device 300. The dangerous area defining unit 120 may be configured to distinguish between the road 420 and the sidewalk 410 in the image data of FIG. 4 and define the road 420 as a dangerous area (e.g., an area in which pedestrian collision is possible). In particular, FIG. 4 is a view illustrating the image data, according to an exemplary embodiment of the present disclosure, that is, a view illustrating an AVM screen.
  • The pedestrian sensing unit 130 may be configured to sense or detect a pedestrian moving along the sidewalk or moving into the dangerous area and calculate the velocity and direction information of the pedestrian. Particularly, the pedestrian sensing unit 130 may be configured to sense the pedestrian based on the image data and the sensing data of a periphery or surrounding environment of the subject vehicle as illustrated in FIGS. 5A-5E. In other words, the pedestrian sensing unit 130 may be configured to sense whether the pedestrian moves along the sidewalk, is stopped, or moves into the dangerous area. FIG. 5A is a view illustrating that the pedestrian moves rightward, and it may be recognized from FIG. 5A that the pedestrian moves in a transverse direction or a longitudinal direction. The sensing of the pedestrian may be performed by detecting motion candidates from the image data and estimating the positions of the motion candidates. In particular, a vector based on an optical flow is analyzed to detect the motion candidates and to estimate the positions of the motion candidates. In addition, the motion of the candidates is analyzed according to heights of the camera and features of a fixed object are extracted, thereby sensing the pedestrian.
  • The time-to-collision calculating unit 140 may be configured to calculate a TTC using the velocity and direction information of the subject vehicle and received velocity and direction information of the pedestrian, when the subject vehicle receives the velocity and direction information of the pedestrian from another vehicle. In other words, the time-to-collision calculating unit 140 may be configured to calculate a moving direction and a velocity vector of the pedestrian based on the velocity and direction information of the pedestrian, calculate a moving direction and a velocity vector of the subject vehicle, and calculate the interconnecting point between the velocity vector of the pedestrian and the velocity vector of the subject vehicle.
  • FIG. 6 is a view illustrating a method of calculating the TTC of the pedestrian moving into the dangerous area, according to an exemplary embodiment of the present disclosure. Referring to FIG. 6, a road 12 and a sidewalk 13 are divided from each other by a curb 11, and a pedestrian 21 moves into a dangerous area while a vehicle (subject vehicle or traveling vehicle) 30 is traveling. In particular, the time-to-collision calculating unit 140 of the traveling vehicle 30 may be configured to determine an interconnecting point 40 between a velocity vector 41 of the pedestrian 21 and a velocity vector 42 of the traveling vehicle 30 as a collision point between the pedestrian 21 and the vehicle 30. Accordingly, a time point in which the traveling vehicle 30 arrives at or reaches the interconnecting point 40 may be determined as the TTC.
  • In addition, the time-to-collision calculating unit 140 may be configured to calculate a relative longitudinal-direction distance using GPS information, and calculate a relative transverse-direction distance using information regarding a lane of the vehicle 30 (e.g., a lane in which the subject vehicle 30 is traveling). For example, based on the assumption that the vehicle 30 is traveling in a second road lane among three lanes, and a lane width may be about 3.5 m, when the parked or stopped vehicle is present along the third lane, the relative transverse-direction distance may be about 5.25 m since 3.5+3.5/2=5.25 m.
  • As illustrated in FIG. 8, the communication unit 150 may be configured to communicate with a surrounding vehicle. In particular, the communication unit 150 may be configured to transmit the velocity and direction information of the pedestrian to the surrounding vehicle, or transmit a command for warning the pedestrian to the surrounding vehicle. The warning unit 160 may be operated by the controller 190 to warn a driver of the subject vehicle or the pedestrian. In particular, the warning unit 160 may be configured to warn the driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, or may be configured to output a warning sound or a warning sentence (e.g., a verbal message through a speaker or a visual message output on a screen).
  • The display unit 170 may be configured to display the image data, the warning sentence, and the like. The storage unit 180 may be configured to store the image data, the sensing data, the warning sentence, the information (e.g., moving direction, velocity, and the like) of the pedestrian, and the TTC. The controller 190 may be configured to output a warning to the driver of the subject vehicle or the pedestrian based on the TTC. In other words, when the TTC is less than a first threshold value, the controller 190 may be configured to operate the brake device 400 of the subject vehicle to forcibly decelerate or stop the subject vehicle, and request the surrounding parked or stopped vehicle to warn the pedestrian. In particular, the forcibly decelerating or stopping of the subject vehicle may be performed using an autonomous emergency braking (AEB) system. When the driver does not manipulate or engage a brake pedal after the wanting to the driver, an automatic braking operation may be performed.
  • In addition, the controller 190 may be configured to warn the driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, and may be configured to request the parked or stopped vehicle (e.g., the surrounding vehicle) to warn the pedestrian, when the TTC is equal to or greater than the first threshold value and is less than a second threshold value. The controller 190 may be configured to request the parked or stopped vehicle to warn the pedestrian, when the TTC is equal to or greater than the second threshold value and is less than a third threshold value.
  • Particularly, as the TTC decreases, collision risk increases and as the TTC increases, the collision risk decreases. When the TTC is equal to or greater than the third threshold value, the pedestrian may be stopped (see reference number 23) or may move along the sidewalk (see reference number 22) as illustrated in FIG. 7. In addition, the controller 190 may be configured to determine a present situation as being an emergency situation to request the parked or stopped vehicle to warn the pedestrian by simultaneously operating a horn and an emergency lamp when the TTC is less than the first threshold value. The controller 190 may be configured to request the parked or stopped vehicle to warn the pedestrian by operating one of the horn and the emergency lamp when the TTC is equal to or greater than the first threshold value and is less than the second threshold value, and when the TTC is equal to or greater than the second threshold value and is less than the third threshold value. The first threshold value may be set by adding a certain margin to the time required to reach the point where the pedestrian 21 and the vehicle 30 can stop before reaching the collision point when the brake control is operated and decelerated in the moving vehicle 30. The second threshold value and the third threshold value may set to a value greater than the first threshold value, depending on how soon the system warns collision.
  • As described above, according to the present disclosure, the pedestrian may be recognized and the TTC may be calculated through the communication between the parked or stopped vehicle (e.g., surrounding vehicle) and the traveling vehicle. Accordingly, the pedestrian or the driver may be warned, and the vehicle may be forcibly decelerated or stopped based on the TTC, thereby preventing the pedestrian accident. Hereinafter, a method of preventing the pedestrian collision accident according to an exemplary embodiment of the present disclosure will be described with reference to FIG. 9. The method described herein below may be executed by the controller having a memory and a processor.
  • An anti-pedestrian collision apparatus of a parked or stopped vehicle 10 may be configured to distinguish between a road and a sidewalk based on image data of vehicles parked or stopped along a street and define a dangerous area (S101). Thereafter, the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 may be configured to sense a pedestrian moving into the dangerous area and calculate a moving velocity of the pedestrian (S102). Then, the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 may be configured to transmit pedestrian information including a moving direction and a moving velocity of the pedestrian (S103).
  • Accordingly, an anti-pedestrian collision apparatus of a traveling vehicle 30, which is traveling in the proximity of the parked or stopped vehicle 10, receives the pedestrian information and calculates the velocity of a subject vehicle (S104). Thereafter, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to calculate a TTC of the collision between the subject vehicle and the pedestrian (S105). When the TTC is less than a preset reference value, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to request the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 to warn the pedestrian (S106).
  • In particular, the anti-pedestrian collision apparatus of the parked or stopped vehicle 10 may be configured to warn the pedestrian by operating a horn or an emergency lamp (S107). In addition, when the TTC is less than the preset reference value, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to warn the driver such that the driver is requested to drive the subject vehicle at a reduced speed, or transmit a command for forcibly decelerating or stopping the subject vehicle to the brake device 400 (S108).
  • FIG. 10 is a flowchart illustrating a warning method based on the TTC, according to an exemplary embodiment of the present disclosure. After the TTC of the collision between the pedestrian and the traveling vehicle 30 is calculated (S201), the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to determine whether the TTC is less than the first threshold (S202). When the TTC is determined as being less than the first threshold value, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to transmit a command for forcibly decelerating or stopping the subject vehicle to the brake device and request the parked or stopped vehicle 10 to warn the pedestrian by simultaneously operating the horn and the emergency lamp (S203).
  • Meanwhile, when the TTC is not less than the first threshold value (e.g., is greater than the first threshold value), the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to determine whether the TTC is equal to or greater than the first threshold value and is less than a second threshold value (S204). When the TTC is determined to be equal to or greater than the first threshold value and is less than the second threshold value, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to warn the driver of the traveling vehicle 30 by outputting a warning sound or a warning sentence such that the driver drives the subject vehicle at a reduced speed. In addition, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to request the parked or stopped vehicle 10 to warn the pedestrian by operating one of the horn and the emergency lamp (S205).
  • When the TTC is neither equal to nor greater than the first threshold value and is not less than the second threshold value (e.g., is less than the first threshold value and is equal to or greater than the second threshold value), the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to determine whether the TTC is equal to or greater than the second threshold value and is less than a third threshold value (S206). When the TTC is equal to or greater than the second threshold value and is less than the third threshold value, the anti-pedestrian collision apparatus of the traveling vehicle 30 may be configured to request the subject vehicle to warn the pedestrian by operating the horn or the emergency lamp (S207).
  • As described above, according to the present disclosure, the pedestrian may be recognized and the TTC may be calculated through the communication between the parked or stopped vehicle and the traveling vehicle. Accordingly, the pedestrian or the driver may be warned, and the vehicle may be forcibly decelerated or stopped based on the TTC, thereby preventing the pedestrian accident.
  • FIG. 11 is a block diagram illustrating a computer system, to which the method of preventing the pedestrian collision accident is applied, according to an exemplary embodiment of the present disclosure. Referring to FIG. 11, a computing system 1000 may include at least one processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, a storage 1600, and a network interface 1700, which are connected with each other via a bus 1200.
  • The processor 1100 may be a central processing unit (CPU) or a semiconductor device which processes instructions stored in the memory 1300 and/or the storage 1600. Each of the memory 1300 and the storage 1600 may include various types of volatile or non-volatile storage media. For example, the memory 1300 may include a read only memory (ROM) and a random access memory (RAM).
  • Thus, the operations of the methods or algorithms described in connection with the exemplary embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or combinations thereof, executed by the processor 1100. The software module may reside on a storage medium (i.e., the memory 1300 and/or the storage 1600), such as a RAM, a flash memory, a ROM, an erasable and programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disc, a removable disc, or a compact disc-ROM (CD-ROM).
  • The storage medium may be coupled to the processor 1100. The processor 1100 may read out information from the storage medium and may write information in the storage medium. Alternatively, the storage medium may be integrated with the processor 1100. The processor and storage medium may reside in an application specific integrated circuit (ASIC). The ASIC may reside in a user terminal. Alternatively, the integrated processor and storage medium may reside as a separate component of the user terminal.
  • According to exemplary embodiments of the present disclosure, a pedestrian, which is blocked (e.g., not visible or hidden) by parked or stopped vehicles, may be sensed in advance such that the collision between the pedestrian and a traveling vehicle may be predicted and the pedestrian and the traveling vehicle may be warned, thereby preventing the pedestrian collision accident in advance.
  • Hereinabove, although the present disclosure has been described with reference to exemplary embodiments and the accompanying drawings, the present disclosure is not limited thereto, but may be variously modified and altered by those skilled in the art to which the present disclosure pertains without departing from the spirit and scope of the present disclosure claimed in the following claims. Therefore, exemplary embodiments of the present disclosure are not intended to limit the technical spirit of the present disclosure, but provided only for the illustrative purpose. The scope of protection of the present disclosure should be construed by the attached claims, and all equivalents thereof should be construed as being included within the scope of the present disclosure.

Claims (8)

1.-13. (canceled)
14. A method of preventing a pedestrian collision accident, comprising:
receiving, by a controller, velocity and direction information of a pedestrian from a vehicle parked or stopped along a street;
calculating, by the controller, a time to collision (TTC) by using velocity and direction information of a subject vehicle, which is traveling, and the velocity and direction information of the pedestrian; and
transmitting, by the controller, a command for warning the pedestrian to the vehicle parked or stopped along the street or warning a driver of the subject vehicle, based on the time to collision (TTC).
15. The method of claim 14, further comprising:
operating, by the controller, the subject vehicle to automatically decelerate or stop.
16. The method of claim 15, wherein the operating of the subject vehicle to automatically decelerate or stop includes:
operating, by the controller, a brake device of the subject vehicle to forcibly decelerate or stop the subject vehicle, when the time to collision (TTC) is less than a first threshold value.
17. The method of claim 16, wherein the transmitting of the command for warning the pedestrian to the vehicle parked or stopped along the street or the warning of the driver of the subject vehicle, based on the time to collision (TTC) includes:
warning, by the controller, the driver of the subject vehicle such that the driver drives the subject vehicle at a reduced speed, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than a second threshold value.
18. The method of claim 17, wherein the transmitting of the command for warning the pedestrian to the vehicle parked or stopped along the street or the warning of the driver of the subject vehicle, based on the time to collision (TTC) further includes:
requesting, by the controller, the parked or stopped vehicle to warn the pedestrian, when the time to collision (TTC) is equal to or greater than the second threshold value and is less than a third threshold value.
19. The method of claim 18, further comprising:
transmitting, by the controller, the command for warning the pedestrian by simultaneously operating a horn and an emergency lamp, when the time to collision (TTC) is less than the first threshold value; and
transmitting, by the controller, the command for warning the pedestrian by operating the horn or the emergency lamp, when the time to collision (TTC) is equal to or greater than the first threshold value and is less than the third threshold value, when the command for warning the pedestrian is transmitted to the vehicle parked or stopped along the street.
20. The method of claim 14, wherein the calculating of the time to collision (TTC) includes:
calculating, by the controller, a moving direction and a velocity vector of the pedestrian;
calculating, by the controller, a moving direction and a velocity vector of the subject vehicle;
calculating, by the controller, an interconnecting point between the velocity vector of the pedestrian and the velocity vector of the subject vehicle; and
calculating, by the controller, a time, in which the subject vehicle arrives at the interconnecting point, as the time to collision (TTC).
US16/898,995 2016-12-13 2020-06-11 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof Pending US20200298846A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/898,995 US20200298846A1 (en) 2016-12-13 2020-06-11 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2016-0169620 2016-12-13
KR1020160169620A KR102441060B1 (en) 2016-12-13 2016-12-13 Apparatus for preventing pedestrian collision, system having the same and method thereof
US15/496,585 US10717434B2 (en) 2016-12-13 2017-04-25 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof
US16/898,995 US20200298846A1 (en) 2016-12-13 2020-06-11 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/496,585 Division US10717434B2 (en) 2016-12-13 2017-04-25 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof

Publications (1)

Publication Number Publication Date
US20200298846A1 true US20200298846A1 (en) 2020-09-24

Family

ID=62201553

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/496,585 Active 2038-07-06 US10717434B2 (en) 2016-12-13 2017-04-25 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof
US16/898,995 Pending US20200298846A1 (en) 2016-12-13 2020-06-11 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US15/496,585 Active 2038-07-06 US10717434B2 (en) 2016-12-13 2017-04-25 Apparatus for preventing pedestrian collision accident, system having the same, and method thereof

Country Status (4)

Country Link
US (2) US10717434B2 (en)
KR (1) KR102441060B1 (en)
CN (1) CN108615407A (en)
DE (1) DE102017207968A1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BR112018015498A2 (en) * 2016-01-29 2019-01-22 Nissan Motor method for controlling the displacement of a vehicle and device for controlling the displacement of a vehicle
DE112018001106T5 (en) * 2017-03-02 2019-11-21 Panasonic Intellectual Property Management Co., Ltd. Driver assistance system, driver assistance device and driver assistance system using this method
DE102017209240A1 (en) * 2017-05-31 2018-12-06 Volkswagen Aktiengesellschaft Method for controlling at least one device of a motor vehicle
US20190114920A1 (en) * 2017-10-13 2019-04-18 Aptiv Technologies Limited Automated vehicle safety system that protects pedestrians
KR102610729B1 (en) * 2018-08-20 2023-12-07 현대자동차주식회사 Appartus and method for driving control of vehicle
US10347132B1 (en) * 2018-10-30 2019-07-09 GM Global Technology Operations LLC Adjacent pedestrian collision mitigation
KR102210519B1 (en) 2019-02-08 2021-02-02 배민재 Device and method for controlliing sound singal of vehicle, and device of outputting soung signal
EP3703029A1 (en) * 2019-02-26 2020-09-02 Ningbo Geely Automobile Research & Development Co. Ltd. Mitigating collision risk with an obscured object
IL265495B (en) * 2019-03-19 2022-09-01 Rober Ohrenstein Traffic allowance method
JP2020152522A (en) * 2019-03-20 2020-09-24 本田技研工業株式会社 Delivery system, delivery method and program
CN112133128A (en) * 2019-06-25 2020-12-25 奥迪股份公司 Curve anti-collision early warning method and device, computer equipment and storage medium
CN112572462B (en) * 2019-09-30 2022-09-20 阿波罗智能技术(北京)有限公司 Automatic driving control method and device, electronic equipment and storage medium
KR20210053385A (en) * 2019-11-01 2021-05-12 엘지전자 주식회사 Vehicle Having a Dangerous Situation Notification Function and Control Method thereof
US11062610B1 (en) 2020-03-06 2021-07-13 Toyota Motor Engineering & Manufacturing North America, Inc. Methods and systems for using parked vehicles to notify rideshare drivers of passenger pickup locations
US11491976B2 (en) * 2020-04-21 2022-11-08 Baidu Usa Llc Collision warning system for safety operators of autonomous vehicles
JP7343844B2 (en) * 2020-05-26 2023-09-13 トヨタ自動車株式会社 Driving support device
KR20220001029A (en) * 2020-06-26 2022-01-05 현대모비스 주식회사 System for forward collision avoidance of vehicle passing low speed limit area and method thereof
US11682272B2 (en) * 2020-07-07 2023-06-20 Nvidia Corporation Systems and methods for pedestrian crossing risk assessment and directional warning
KR20220033653A (en) * 2020-09-09 2022-03-17 현대모비스 주식회사 Pedestrian collision prevent system and method for vehicle
CN112339758B (en) * 2020-10-27 2022-02-01 东风汽车集团有限公司 Multi-working-condition self-adaptive early warning braking system
CN112572291A (en) * 2020-12-22 2021-03-30 的卢技术有限公司 Vehicle door opening early warning method
CN112918469B (en) * 2021-03-01 2022-02-11 长沙理工大学 Automatic emergency braking system with active and passive safety function for pedestrians
CN112918470B (en) * 2021-03-01 2022-03-04 长沙理工大学 Intelligent automatic emergency braking method for protecting pedestrians
US11589386B2 (en) * 2021-03-19 2023-02-21 Huawei Technologies Co., Ltd. Method and system for Wi-Fi sensing
KR102592665B1 (en) * 2021-07-01 2023-10-24 현대모비스 주식회사 Apparatus for collision waring and vehicle including the same

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100231368A1 (en) * 2009-03-11 2010-09-16 Denso Corporation Vehicle presence notification apparatus
US20150039218A1 (en) * 2013-07-31 2015-02-05 Elwha, Llc Systems and methods for adaptive vehicle sensing systems
US20170120804A1 (en) * 2015-11-04 2017-05-04 Zoox, Inc. Active lighting control for communicating a state of an autonomous vehicle to entities in a surrounding environment
US20170182934A1 (en) * 2014-09-01 2017-06-29 Mitsubishi Electric Corporation Vehicle projection control system and method of controlling image projection
US20170222612A1 (en) * 2016-01-28 2017-08-03 Harman Becker Automotive Systems Gmbh System and method for external sound synthesis of a vehicle
US20170253177A1 (en) * 2016-03-07 2017-09-07 Toyota Jidosha Kabushiki Kaisha Vehicle lighting system
US20170345292A1 (en) * 2016-05-30 2017-11-30 Autotalks Ltd. Wireless pedestrian notification
US20180050635A1 (en) * 2016-08-19 2018-02-22 2236008 Ontario Inc. System and method for pedestrian alert

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6223125B1 (en) 1999-02-05 2001-04-24 Brett O. Hall Collision avoidance system
JP3174832B2 (en) * 1999-10-27 2001-06-11 建設省土木研究所長 Crossing pedestrian collision prevention system
JP4628683B2 (en) * 2004-02-13 2011-02-09 富士重工業株式会社 Pedestrian detection device and vehicle driving support device including the pedestrian detection device
JP4506220B2 (en) 2004-03-18 2010-07-21 株式会社アドヴィックス Warning device for vehicle, warning control device for vehicle, and warning method
JP2006323666A (en) 2005-05-19 2006-11-30 Denso Corp Pedestrian running-out alarm system
JP2007310457A (en) * 2006-05-16 2007-11-29 Denso Corp Inter-vehicle communication system, inter-vehicle communication device and controller
JP2009104230A (en) 2007-10-19 2009-05-14 Hitachi Ltd Communication system between vehicle/vehicle and between person/vehicle, onboard communication device and mobile communication device
KR101141874B1 (en) * 2008-06-04 2012-05-08 주식회사 만도 Apparatus, Method for Dectecting Critical Areas and Pedestrian Detection Apparatus Using Same
JP5345992B2 (en) * 2010-09-08 2013-11-20 本田技研工業株式会社 Vehicle periphery monitoring device
US8527172B2 (en) * 2010-10-20 2013-09-03 GM Global Technology Operations LLC Vehicle collision avoidance and warning system
CN102529962B (en) * 2010-12-08 2014-11-05 安尼株式会社 Moving body anti-collision device and moving body
US9233659B2 (en) * 2011-04-27 2016-01-12 Mobileye Vision Technologies Ltd. Pedestrian collision warning system
DE102011111899A1 (en) * 2011-08-30 2013-02-28 Gm Global Technology Operations, Llc Detection device and method for detecting a carrier of a transceiver, motor vehicle
CN105324804A (en) * 2013-05-31 2016-02-10 日立汽车系统株式会社 Vehicular risk alert control device
JPWO2015008380A1 (en) * 2013-07-19 2017-03-02 本田技研工業株式会社 Vehicle travel safety device, vehicle travel safety method, and vehicle travel safety program
JP6429368B2 (en) * 2013-08-02 2018-11-28 本田技研工業株式会社 Inter-vehicle communication system and method
US9336436B1 (en) * 2013-09-30 2016-05-10 Google Inc. Methods and systems for pedestrian avoidance
US9199668B2 (en) * 2013-10-28 2015-12-01 GM Global Technology Operations LLC Path planning for evasive steering maneuver employing a virtual potential field technique
KR101498114B1 (en) * 2013-11-28 2015-03-05 현대모비스 주식회사 Device and method for detecting pedestrains
KR101553143B1 (en) 2014-02-25 2015-09-14 조선대학교산학협력단 Vehicle alarm system and the method for protecting pedestrians
US9925980B2 (en) 2014-09-17 2018-03-27 Magna Electronics Inc. Vehicle collision avoidance system with enhanced pedestrian avoidance
US9718405B1 (en) * 2015-03-23 2017-08-01 Rosco, Inc. Collision avoidance and/or pedestrian detection system
US10002536B2 (en) * 2015-07-14 2018-06-19 Samsung Electronics Co., Ltd. Apparatus and method for providing service in vehicle to everything communication system
EP3144919B1 (en) * 2015-09-18 2020-06-24 Continental Automotive GmbH Device and method for start assistance for a motor vehicle
WO2017130642A1 (en) * 2016-01-29 2017-08-03 日産自動車株式会社 Vehicle travel control method and vehicle travel control device
US10196058B2 (en) * 2016-11-28 2019-02-05 drive.ai Inc. Method for influencing entities at a roadway intersection

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100231368A1 (en) * 2009-03-11 2010-09-16 Denso Corporation Vehicle presence notification apparatus
US20150039218A1 (en) * 2013-07-31 2015-02-05 Elwha, Llc Systems and methods for adaptive vehicle sensing systems
US20170182934A1 (en) * 2014-09-01 2017-06-29 Mitsubishi Electric Corporation Vehicle projection control system and method of controlling image projection
US20170120804A1 (en) * 2015-11-04 2017-05-04 Zoox, Inc. Active lighting control for communicating a state of an autonomous vehicle to entities in a surrounding environment
US20170222612A1 (en) * 2016-01-28 2017-08-03 Harman Becker Automotive Systems Gmbh System and method for external sound synthesis of a vehicle
US20170253177A1 (en) * 2016-03-07 2017-09-07 Toyota Jidosha Kabushiki Kaisha Vehicle lighting system
US20170345292A1 (en) * 2016-05-30 2017-11-30 Autotalks Ltd. Wireless pedestrian notification
US20180050635A1 (en) * 2016-08-19 2018-02-22 2236008 Ontario Inc. System and method for pedestrian alert

Also Published As

Publication number Publication date
DE102017207968A1 (en) 2018-06-14
US20180162388A1 (en) 2018-06-14
US10717434B2 (en) 2020-07-21
KR102441060B1 (en) 2022-09-06
CN108615407A (en) 2018-10-02
KR20180068045A (en) 2018-06-21

Similar Documents

Publication Publication Date Title
US20200298846A1 (en) Apparatus for preventing pedestrian collision accident, system having the same, and method thereof
US9925989B2 (en) Vehicle control apparatus and method for operation in passing lane
US8447484B2 (en) Branch-lane entry judging system
CN108263324B (en) Pedestrian detection and pedestrian collision prevention device and method based on posture information
WO2022007655A1 (en) Automatic lane changing method and apparatus, and device and storage medium
JP6206120B2 (en) Confluence support system
US20170274876A1 (en) Side collision avoidance system and method for vehicle
US9168929B2 (en) System and method for providing vehicle driving information
US20190111930A1 (en) Vehicle controller
US9517755B1 (en) Autonomous braking system and autonomous braking method
CN106257556B (en) Detecting and communicating lane splitting maneuvers
US20210309232A1 (en) Driving assistance apparatus and data collection system
US20140297107A1 (en) Parking assistance system and method
US20220032906A1 (en) Device and method for reducing collision risk
CN113453969A (en) Method for protecting a vehicle
JP2022543936A (en) Automated crowdsourcing of road environment information
JP2011028415A (en) Driving support device
US20200198626A1 (en) Vehicle controller, vehicle, and vehicle control method
US20210035451A1 (en) Platooning controller, system including the same, and method thereof
CN111886167A (en) Autonomous vehicle control via collision risk map
CN114333414A (en) Parking yield detection device, parking yield detection system, and recording medium
JP7282115B2 (en) Driving support device
WO2023132055A1 (en) Evaluation device, evaluation method, and program
US20240017750A1 (en) Autonomous driving control apparatus and method thereof
US11511734B2 (en) Apparatus and method for controlling vehicle driving

Legal Events

Date Code Title Description
AS Assignment

Owner name: HYUNDAI MOTOR COMPANY, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HYUNDAI MOTOR COMPANY;REEL/FRAME:052910/0863

Effective date: 20200522

Owner name: KIA MOTORS CORPORATION, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HYUNDAI MOTOR COMPANY;REEL/FRAME:052910/0863

Effective date: 20200522

STPP Information on status: patent application and granting procedure in general

Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED