US11260864B2 - Path generation apparatus at intersection, and method and apparatus for controlling vehicle at intersection - Google Patents
Path generation apparatus at intersection, and method and apparatus for controlling vehicle at intersection Download PDFInfo
- Publication number
- US11260864B2 US11260864B2 US16/595,813 US201916595813A US11260864B2 US 11260864 B2 US11260864 B2 US 11260864B2 US 201916595813 A US201916595813 A US 201916595813A US 11260864 B2 US11260864 B2 US 11260864B2
- Authority
- US
- United States
- Prior art keywords
- vehicle
- intersection
- lane
- intersection point
- travel path
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000012545 processing Methods 0.000 claims description 14
- 230000008569 process Effects 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 description 21
- 230000006870 function Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 15
- 238000004891 communication Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/18—Propelling the vehicle
- B60W30/18009—Propelling the vehicle related to particular drive situations
- B60W30/18154—Approaching an intersection
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
- B60W40/06—Road conditions
- B60W40/072—Curvature of the road
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3658—Lane guidance
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/0088—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
- G05D1/0274—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/06—Direction of travel
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2201/00—Application
- G05D2201/02—Control of position of land vehicles
- G05D2201/0213—Road vehicle, e.g. car or truck
Definitions
- the present invention relates to a vehicle path generation apparatus at an intersection and an apparatus and method for controlling a vehicle at an intersection, and more specifically, to a technology for calculating the position of an intersection point in an intersection and generating a vehicle movement path so that a vehicle movement at the intersection is automatically controlled through the vehicle movement path.
- the steering related DAS system may include a lane keeping assistance system (LKAS) for assisting the vehicle to maintain the travel lane, a lane change assistance system (LCAS) for preventing a collision with another vehicles when changing lanes and warning the vehicle, and the like.
- LKAS lane keeping assistance system
- LCAS lane change assistance system
- the braking related DAS system may include an autonomous emergency braking (AEB) system that automatically brakes a vehicle without a driver's intervention when a forward or rearward collision of the vehicle is predicted.
- AEB autonomous emergency braking
- CTA cross traffic alter or assist
- one-way road such as a straight line or a curved line
- left/right turn or straightforward driving at an intersection may have a high risk of colliding with an obstacle, and in order to prevent the risk of collision from being increased, precise control is needed for the vehicle travel at the intersection.
- an intersection area has various types of travel guide lanes (e.g. straightforward guiding line, left turn guiding line, and the like) in a mixed form, and in some intersection areas, any guide lane may not exist, which makes the autonomous driving control significantly difficult.
- travel guide lanes e.g. straightforward guiding line, left turn guiding line, and the like
- an apparatus for controlling a vehicle includes: an image sensor disposed on a vehicle to have a field of view of an exterior of the vehicle and configured to capture image data; a map storage configured to store map information of a surrounding of the vehicle; and a controller comprising a processor for processing the image data captured by the image sensor, wherein the controller is configured to: identify an intersection area based on at least part of the processing of the image data captured by the image sensor; determined intersection point information about a plurality of intersection points in the intersection area based on at least part of the processing of the image data captured by the image sensor, and determined a vehicle travel path in the intersection area using the determined intersection point information and control travel of the vehicle based on the determined vehicle travel path.
- the controller may identify an intersection area based on at least one of the map information or image sensor information, determine positions and a number of a plurality of intersection points based on a lane continuing characteristic and a lane crossing characteristic in the intersection area, and determine the vehicle travel path in the intersection area based on the determined positions and the number of the intersection points.
- the lane continuing characteristic may include information about a lane cut position in which a lane is cut by a predetermined length or more in the intersection area, the lane crossing characteristic includes information about a lane crossing position in which two lanes cross each other, and the controller may determine the lane cut position and the lane crossing position to be the intersection point.
- the controller may determine a number of available travel lanes at the intersection and a shape of the intersection based on of at least one of information about a number of lanes sensed in the intersection area and information about a type of a signal lamp.
- the controller may, among the intersection points: set positions of a 1-1 intersection point and a 1-2 intersection point corresponding to a left side intersection point and a right side intersection point of a travel lane on which the vehicle travels as a first reference position; set one of positions of a 2-1 intersection point and a 2-2 intersection point corresponding to a left side intersection point and a right side intersection point of a left side distant lane located on a left distant side of the travel lane, a position of a 3-1 intersection point corresponding to a left side intersection point of a right side near lane located on a right near side of the travel lane, and positions of a 4-1 intersection point and a 4-2 intersection point corresponding to a left side intersection point and a right side intersection point of an opposite lane of the travel lane as a second reference position; and generate vehicle travel path information passing through the first reference position and the second reference position.
- the vehicle travel path information may include left turn travel path information comprising a 1-1 curve having a predetermined first radius of curvature and passing through the 1-1 intersection point and the 2-1 intersection point and a 1-2 curve having a predetermined second radius of curvature and passing through the 1-2 intersection point and the 2-2 intersection point.
- the first radius of curvature may be a first distance between the 1-1 intersection point and the 2-1 intersection point
- the second radius of curvature may be a second distance between the 1-2 intersection point and the 2-2 intersection point.
- the controller may determine a vehicle travel path in a lane based on lateral offset information of the vehicle immediately before entering the intersection, heading angle information of the vehicle with respect to the lane, and a curvature of the vehicle travel path at the intersection.
- an apparatus for calculating a path of a vehicle comprises: an intersection identifying unit configured to identify an intersection area using at least part of image data from an image sensor disposed on a vehicle to have a field of view of an exterior of the vehicle and configured to capture image data; an intersection point information calculating unit configured to calculate positions and a number of a plurality of intersection points, based on a lane continuing characteristic and a lane crossing characteristic in the intersection area; and a travel path calculating unit configured to calculate one or more vehicle travel paths in the intersection area based on the positions and the number of the intersection points.
- the lane continuing characteristic may comprise information about a lane cut position in which a lane is cut by a predetermined length or more in the intersection area
- the lane crossing characteristic may include information about a lane crossing position in which two lanes cross each other
- the intersection point information calculating unit may determine the lane cut position and the lane crossing position as the intersection point.
- a method of controlling a vehicle comprises: identifying an intersection area based on at least one of map information and image data captured by an image sensor; determining positions and a number of a plurality of intersection points based on a lane continuing characteristic and a lane crossing characteristic in the intersection area; determining a vehicle travel path in the intersection area based on the positions and the number of the intersection points; and controlling travel of the vehicle based on the determined vehicle travel path.
- the lane continuing characteristic may comprise information about a lane cut position in which a lane is cut by a predetermined length or more in the intersection area
- the lane crossing characteristic may include information about a lane crossing position in which two lanes cross each other
- the determining positions and a number of the plurality of intersection points may include determining the lane cut position and the lane crossing position to be the intersection point.
- the method of controlling the vehicle may further comprises determining a number of available travel lanes at the intersection and a shape of the intersection based on at least one of information about a number of lanes sensed in the intersection area and information about a type of a signal lamp.
- the determining the vehicle travel path in the intersection area may include, among the intersection points: setting positions of a 1-1 intersection point and a 1-2 intersection point corresponding to a left side intersection point and a right side intersection point of a travel lane on which the vehicle travels as a first reference position; setting one of positions of a 2-1 intersection point and a 2-2 intersection point corresponding to a left side intersection point and a right side intersection point of a left side distant lane located on a left distant side of the travel lane, a position of a 3-1 intersection point corresponding to a left side intersection point of a right side near lane located on a right near side of the travel lane, and positions of a 4-1 intersection point and a 4-2 intersection point corresponding to a left side intersection point and a right side intersection point of an opposite lane of the travel lane as a second reference position; and generating vehicle travel path information passing through the first reference position and the second reference position.
- the vehicle travel path information may include left turn travel path information comprising a 1-1 curve having a predetermined first radius of curvature and passing through the 1-1 intersection point and the 2-1 intersection point and a 1-2 curve having a predetermined second radius of curvature and passing through the 1-2 intersection point and the 2-2 intersection point.
- the first radius of curvature may be a first distance between the 1-1 intersection point and the 2-1 intersection point
- the second radius of curvature may be a second distance between the 1-2 intersection point and the 2-2 intersection point.
- the determining the vehicle travel path in the intersection area may include determining a vehicle travel path in a lane based on lateral offset information of the vehicle immediately before entering the intersection, heading angle information of the vehicle with respect to the lane, and a curvature of the vehicle travel path at the intersection.
- an apparatus for controlling a vehicle comprises: an image sensor disposed on a vehicle to have a field of view of an exterior of the vehicle and configured to capture image data; a non-image sensor disposed on the vehicle and configured to capture sensing data to sense one of objects around the vehicle; a vehicle dynamics sensor disposed on the vehicle and configured to sense information related to travel of a vehicle; and an integrated controller configured to process at least one of image data captured by the image sensor and sensing data captured by the non-image sensor, wherein the integrated controller is configured to, based on at least part of the processing of the image data captured by the image sensor (i) identify an intersection area, (ii) determine intersection point information comprising positions and a number of a plurality of intersection points based on a lane continuing characteristic and a lane crossing characteristic in the intersection area, (iii) determine one or more vehicle travel path in the intersection area using the determined intersection point information, and iv) control travel of the vehicle based on the determined vehicle travel path.
- FIG. 1 is a diagram illustrating the overall system configuration of an apparatus for generating a vehicle path and an apparatus for controlling a vehicle having the same according to the present embodiment
- FIG. 2 is a diagram illustrating a state of an intersection to which the present embodiment is applied
- FIG. 3 is a diagram illustrating a configuration that specifies a plurality of intersection points in an intersection area according to the present embodiment
- FIG. 4 is a diagram illustrating an example in which a left turn travel path of a vehicle is calculated on the basis of an intersection point at an intersection according to the present embodiment
- FIG. 5 is a diagram illustrating an example in which a right turn travel path of a vehicle is calculated on the basis of an intersection point at an intersection according to the present embodiment
- FIG. 6 is a diagram illustrating an example of an intersection point and a vehicle travel path in an intersection environment that is different from that shown in FIGS. 3 to 5 ;
- FIG. 7 is a diagram illustrating a lane modeling for calculating a vehicle travel path according to the present embodiment.
- FIG. 8 is a flowchart showing the overall flow of a method of controlling a vehicle according to the present embodiment.
- first,” “second,” “A,” “B,” “(a)”, “(b)”, etc. may be used to describe various components, the terms do not limit the corresponding components and the nature, order, sequence, or number thereof, but are used only for the purpose of distinguishing one component from another component. It will be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element or intervening elements may be present.
- ⁇ may be embodied as hardware or software. According to embodiments, a plurality of “unit”, “module”, “member”, and “block” may be implemented as a single component or a single “unit”, “module”, “member”, and “block” may include a plurality of components.
- part when a part “includes” or “comprises” an element, unless there is a particular description contrary thereto, the part may further include other elements, not excluding the other elements.
- FIG. 1 is a diagram illustrating the overall system configuration of an apparatus for generating a vehicle path and an apparatus for controlling a vehicle having the same according to the present embodiment.
- the apparatus for controlling the vehicle includes a camera 120 serving as an image sensor, a vehicle dynamics sensor 140 , and other vehicle sensor, a navigation device 110 including map information, a vehicle path generating device 200 identifying an intersection, recognizing an intersection point at an intersection, and generating a vehicle path, and a vehicle travel control unit 300 controlling an engine unit, a steering unit, a braking unit, and the like of the vehicle for the vehicle to travel according to the generated vehicle path.
- the camera 120 performs a function of recognizing an object around the vehicle by analyzing a surrounding image of the vehicle.
- the camera 120 according to the embodiment performs a function of generating/outputting lane information by recognizing a lane from a front image and front lateral side images of the vehicle, a function of providing stop line information of a stop line around the vehicle, and a function of generating/outputting signal lamp information about the type of a signal lamp (e.g., the number of green signals) by sensing signal lamps in front of the vehicle.
- a signal lamp e.g., the number of green signals
- the camera for the vehicle used in the present embodiment may be expressed by different terms, such as an image system, a vision system, an image sensor, and the like.
- the camera for the vehicle may include a front camera having a field of view corresponding to a front of the vehicle, a rear camera having a field of view corresponding to a rear of the vehicle, and a rear lateral side camera having a field of view corresponding to sides and rear of the vehicle, and in some cases, may selectively include at least one of the cameras of such various directions.
- the camera performs a function of capturing image data of a surrounding of a vehicle and delivering the captured image data to a processor or a controller.
- the vision system or image sensor may further include an electronic control unit (ECU) or an image processor configured to process the captured image data and display the processing result on a display.
- ECU electronice control unit
- image processor configured to process the captured image data and display the processing result on a display.
- the vision system or image sensor according to the present embodiment may further include an appropriate data link or communication link, such as a vehicle network bus or the like, for data transmission or signal communication from the camera to the image processor.
- the vehicle to which the present embodiment is applied may further include a non-image sensor 104 , such as a radar sensor or an ultrasonic sensor.
- lane information may include lane continuing characteristic information and lane crossing characteristic information such that the intersection point information calculation unit identifies an intersection point in an intersection area, as will be described below.
- the lane continuing characteristic information may include information about whether a lane (including a middle lane and a shoulder lane) has a discontinuous section of a predetermined length or longer, and in the case of existence of the discontinuous section, include position information of a start point and an end point of the discontinuous section.
- the lane crossing characteristic information may include information about whether a leftmost or rightmost lane among lanes crosses another lane perpendicular thereto, and in the case of the crossing, include position information of the crossing position.
- Map information included in the navigation device 110 includes information about coordinates of a travel road on which the vehicle travels, the number and shape (curvature) of lanes of the travel road, and the like, and the navigation device is provided with a function of displaying the current position of the vehicle recognized through a GPS (global positioning system) on the map information.
- GPS global positioning system
- the apparatus for controlling the vehicle according to the present embodiment may further include a non-image sensor for detecting an object around the vehicle, such as a radar sensor 130 and an ultrasonic sensor, in addition to the image sensor.
- a non-image sensor for detecting an object around the vehicle, such as a radar sensor 130 and an ultrasonic sensor, in addition to the image sensor.
- the radar sensor represents a sensor for transmitting a high frequency radar signal of several tens of GHz, receiving a signal returning by being reflected from the object, and calculating the distance, angle, relative velocity of the object from a period between a reception time point of the received reflection signal and a transmission time point, a phase change of electromagnetic waves, and the like.
- the radar sensor or radar system used for the present invention may include at least one radar sensor unit, for example, may include one or more of a front radar sensor mounted in the front of the vehicle, a rear radar sensor mounted in the rear of the vehicle, and a side or side-rear radar sensor mounted in each side of the vehicle.
- a radar sensor or radar system analyzes the transmitted signal and the received signal to process data to thereby detect information about an object, for which an ECU or a processor may be provided.
- Data transmission or signal communication from the radar sensor to the ECU may be implemented using a communication link, such as an appropriate vehicle network bus.
- Such a radar sensor includes one or more transmission antennas for transmitting radar signals and one or more reception antennas for receiving reflected signals received from an object.
- the radar sensor according to the present embodiment may adopt a multi-dimensional antenna array and a signal transmission/reception scheme of multiple input multiple output (MIMO) to form an imaginary antenna aperture larger than an actual antenna aperture.
- MIMO multiple input multiple output
- a two-dimensional antenna array is used to achieve horizontal and vertical angle precision and resolution.
- signals are transmitted and received by two individual scans of horizontal and vertical scans (time multiplexed), and MIMO may be used separately from the two-dimensional radar horizontal and vertical scans (time multiplexed).
- the radar sensor according to the present embodiment may employ a two-dimensional antenna array configuration including a transmission antenna unit including a total of 12 transmission antennas (Tx) and a reception antenna unit including a total of 16 reception antennas (Rx), resulting in an arrangement of a total of 192 imaginary reception antennas.
- the reception antenna unit may include four reception antenna groups each including four reception antennas, and the respective reception antenna groups are disposed to be spaced in the vertical direction, and such a reception antenna unit may be disposed between the first transmission antenna group and the third transmission antenna group spaced in the horizontal direction.
- the two-dimensional antenna array may include a V-shape antenna array in which a plurality of radiating patches are arranged in a V-shape, and more specifically include two V-shape antenna arrays. At this time, a single feed is made to an apex of each V-shape antenna array.
- the radar sensor according to the present embodiment may use a MIMO antenna system to implement sensing accuracy or resolution in the vertical and horizontal directions.
- the transmission antennas may transmit signals having independent waveforms that are distinguished from each other. That is, each transmission antenna transmits an independent waveform signal that is distinguished from that of another transmission antenna, and each reception antenna may identify a transmission antenna from which a reflected signal from an object is transmitted among the transmission antennas, on the basis of the distinct waveforms of the signals.
- the radome of the radar sensor may be disposed inside the vehicle grille, the bumper, the vehicle body, or the like, and may be disposed as a part forming the exterior surface of the vehicle, such as the vehicle grille, the bumper, the vehicle body, thereby improving the aesthetic quality of the vehicle while providing a convenience of mounting a radar sensor.
- the ultrasonic sensor represents a sensor that emits ultrasonic waves having a frequency higher than that of sound waves and calculates the distance, the angle, and the relative velocity of the object by receiving and analyzing a reflected signal reflected from an object.
- the image sensor, the radar sensor, or the ultrasonic sensor according to the present embodiment may be implemented using an image sensor, a radar sensor or a ultrasonic sensor that are widely used for a general vehicle, a detailed description thereof will be omitted.
- the vehicle dynamics sensor 140 may include a vehicle velocity sensor, a yaw rate sensor, an acceleration sensor (G sensor), and the like, but is not limited thereto, and may include all types of sensors used to sense the behavior of a vehicle when the vehicle travels along a vehicle travel path generated according to the present embodiment.
- G sensor acceleration sensor
- the vehicle path generating device 200 may include an intersection identifying unit 210 configured to identify an intersection area on the basis of at least one of map information and image sensor information, an intersection point information calculating unit 220 configured to calculate the positions and the number of a plurality of intersection points on the basis of a lane continuing characteristic and a lane crossing characteristic in an intersection area, and a travel path calculating unit 230 configured to calculate one or more vehicle travel paths in the intersection area on the basis of the positions and the number of the intersection points.
- an intersection identifying unit 210 configured to identify an intersection area on the basis of at least one of map information and image sensor information
- an intersection point information calculating unit 220 configured to calculate the positions and the number of a plurality of intersection points on the basis of a lane continuing characteristic and a lane crossing characteristic in an intersection area
- a travel path calculating unit 230 configured to calculate one or more vehicle travel paths in the intersection area on the basis of the positions and the number of the intersection points.
- intersection identifying unit 210 may be integrated and operate as a single controller, and such a controller may include a processor for processing image data captured by the camera.
- such a controller may be operable to identify the intersection area on the basis of at least part of the processing of the image data captured by the image sensor, calculate intersection point information about a plurality of intersection points in the intersection area, calculate one or more vehicle travel paths in the intersection area using the calculated intersection point information, and control travel of the vehicle according to the calculated vehicle travel path.
- Such a controller may be implemented as an integrated control unit (e.g., a domain control unit: DCU) or an integrated controller that integrates a function of receiving and processing pieces of information of various vehicle sensors or relaying transmission and reception of sensor signals, a function of generating a vehicle travel path at an intersection, generating a vehicle travel control signal on the basis of the generated vehicle travel path, and transmitting the generated vehicle travel control to a steering control mode or braking control mode to control the behavior of the vehicle according to the present disclosure, and other function, but the implementation of the controller is not limited thereto.
- DCU domain control unit
- Such an integrated controller is operable to, on the basis of the function of processing image data captured by the image sensor and sensing data captured by the non-image sensor and at least part of the processing of the image data captured by the image sensor, (i) identify an intersection area, (ii) calculate the positions and the number of a plurality of intersection points on the basis of a lane continuing characteristic and a lane crossing characteristic in the intersection area, (iii) calculate one or more vehicle travel paths in the intersection area using the calculated intersection point information, and (iv) control travel of the vehicle according to the calculated vehicle travel path.
- the intersection identifying unit 210 may determine that the vehicle enters an intersection area in response to satisfying at least one condition of: an intersection area exists in front of the vehicle from the map information received from a navigation system and the current position of the vehicle through the GPS; and vehicle frontal image information received from the image sensor includes signal lamp information and stop line information.
- the navigation device 110 includes map information, and the current position information of the vehicle is calculated using a GPS receiving device mounted on the vehicle such that a position at which the vehicle is located in the map information is identified. Accordingly, the intersection identifying unit 210 may determine whether the vehicle enters the intersection area on the basis of the map information received from the navigation device 110 and the current position information of the vehicle.
- the image sensor 120 may identify a stop line and a crosswalk that are distant from or adjacent to the vehicle in the front or sides of the vehicle from the photographed image, and may identify the existence and type of the signal lamp located in front of the vehicle using a traffic signal recognition (TSR).
- TSR traffic signal recognition
- intersection point information calculating unit 220 included in the vehicle path generating device 200 performs a function of calculating the positions and the number of a plurality of intersection points on the basis of the lane continuing characteristic and the lane crossing characteristic in the intersection area.
- the lane continuing characteristic may include information about whether a discontinuous lane that is cut by a predetermined length or more exists in an intersection area and information about a cut position of the discontinuous lane cut by the predetermined length.
- the lane crossing characteristic may include information about a lane crossing position in which two lanes cross each other in the intersection area.
- intersection point information calculating unit 220 may determine the cut position of the discontinuous lane and the crossing position as the intersection point.
- the lane continuing characteristic and the lane crossing characteristic may be identified from the map information received from the navigation device or the image sensing information received from the image sensor.
- intersection point information calculating unit 220 may identify whether a discontinuous lane exists and the coordinates of the cut position of the discontinuous lane on the basis of the received map information, or may obtain information about whether a lane is cut and information about the cut position from the image captured by the image sensor.
- intersection point information calculating unit 220 may calculate the coordinate information of an intersection point with respect to the current position of the vehicle, and information about the number of intersection points existing in a straightforward area/left side area/right side area. Details thereof will be described below with reference to FIG. 3 and other drawings.
- the vehicle path generating device 200 may further include an intersection form determining unit configured to determine the number of available travel lanes in the intersection area on the basis of information about the number of lanes sensed in the intersection area and the information about the type of the signal lamp.
- intersection form determining unit may further determine the form of the intersection, that is, the number of roads crossing each other, in addition to the information about the number of available travel lanes at the intersection.
- the intersection form determining unit may recognize that the number of lanes in a travelling direction in which the subject travels in the intersection area, and the number of straightforward travel lanes on the opposite side at the intersection correspond to one of a one-way one lane road, a one-way two lane road, and a one-way three road, and similarly recognize the number of lanes on the left side and the right side in a travelling direction of the vehicle also corresponds to one of a one-way one lane road, a one-way two lane road, and a one-way three road.
- intersection form determining unit may further use information about the type of the signal lamp included in the image sensor information to determine the form of the intersection in addition to the information about the number of available travel lanes.
- the form of the intersection is determined to be a three-way street in which a left turn lane diverges from a straightforward lane or a four-way street in which a straightforward lane crosses left and right side travel lanes.
- the signal lamp type information included in the image sensor information includes five types of signals including a green signal (straight), a left turn signal, a right turn signal, a yellow signal (standby), and a red signal (stop), the form of the intersection is determined to be a five-way street in which five roads cross each other.
- the information about the number of available travel lanes or the intersection form information determined by the intersection form determining unit may be used for a process of calculating the vehicle travel path at the intersection by the travel path calculating unit, which will be described below.
- the travel path calculating unit 230 included in the vehicle path generating device 200 serves to calculate one or more vehicle travel paths in the intersection area on the basis of the positions and the number of the intersection points in the intersection area calculated by the intersection point information calculating unit 220 .
- the travel path calculating unit 230 may further use turn signal operation information of the vehicle to set the travelling direction of the vehicle.
- the travel path calculating unit 230 among the intersection points: set positions of a 1-1 intersection point and a 1-2 intersection point corresponding to a left side intersection point and a right side intersection point of a travel lane on which the vehicle travels as a first reference position; set one of, positions of a 2-1 intersection point and a 2-2 intersection point corresponding to a left side intersection point and a right side intersection point of a left side distant lane located on a left distant side of the travel lane, a position of a 3-1 intersection point corresponding to a left side intersection point of a right side near lane located on a right near side of the travel lane, and positions of a 4-1 intersection point and a 4-2 intersection point corresponding to a left side intersection point and a right side intersection point of an opposite lane of the travel lane as a second reference position; and generate vehicle travel path information passing through the first reference position and the second reference position.
- the vehicle travel path information may include left turn travel path information including a 1-1 curve having a predetermined first radius of curvature and passing the 1-1 intersection point and the 2-1 intersection point and a 1-2 curve having a predetermined second radius of curvature and passing the 1-2 intersection point and the 2-2 intersection point.
- the first radius of curvature is a first distance that is a straight line distance between the first-first intersection point and the second-first intersection point
- the second radius of curvature is the first-second intersection point and the second-second intersection point.
- the first distance and the second curvature may be the inverse of the radius of the first and second curvatures.
- the vehicle travel control unit 300 included in the apparatus for controlling the vehicle according to the present embodiment may serve to control the engine, steering, and braking units of the vehicle for the vehicle to travel according to the vehicle travel path generated by the travel path calculating unit 230 , and to this end, may provide control commands to an engine control unit 310 , a steering control unit 330 , and a braking control unit 320 .
- intersection identifying unit 210 the intersection point information calculating unit 220 , the travel path calculating unit 230 , and the vehicle travel control unit 300 included in the apparatus for controlling the vehicle or the vehicle path generating device 200 may be implemented as constituent modules of a vehicle control system according to the present embodiment or modules of an ECU therefor.
- the constituent modules of the vehicle control system or the ECU may include a processor, a storage device, such as a memory, and a computer program capable of performing a specific function, and the intersection identifying unit 210 , the intersection point information calculating unit 220 , the travel path calculating unit 230 , and the vehicle travel control unit 300 may be implemented as a software module capable of performing the respective unique functions.
- FIG. 2 is a diagram illustrating a state of an intersection to which the present embodiment is applied
- FIG. 3 is a diagram illustrating a configuration that specifies a plurality of intersection points in an intersection area according to the present embodiment.
- FIG. 2 illustrates a four-way intersection in which four roads cross each other and the lower part of FIG. 2 illustrates a T-shaped three-way intersection.
- a right side forward travelling lane is located on the right near side in the travelling direction of the vehicle
- a right side reverse travelling lane is located on the right distant side
- a right side stop line mark 414 is displayed on the right side reverse travelling lane.
- a stop line is generally shown only on a reverse travelling lane on which the vehicle is unable to travel among straight/left/right lanes.
- FIG. 3 is a diagram illustrating a configuration for specifying a plurality of intersection points in an intersection area in the case of a one-way one lane road according to the present embodiment.
- the intersection point information calculating unit 220 may calculate the positions and the number of a plurality of intersection points on the basis of the lane continuing characteristic and the lane crossing characteristic in the intersection area from the map information received from the navigation device and/or the image sensor information, in which the intersection points are denoted as P 1C , P 1L , P 1R and the like.
- the intersection point information calculating unit 220 may determine the coordinates of a plurality of intersection points P ij with respect to the current position of the vehicle, on the basis of coordinates of a cut position of a discontinuous lane or a lane crossing position obtained from the map information or the image information.
- intersection point information calculating unit 220 identifies that a center line on a lane on which the vehicle travels is cut into a near center line 512 ′ and a distant center line 512 by a predetermined distance or more, and specifies the cut positions P 1C and P 3C as intersection points.
- intersection points are specified at the four-way intersection with one lane for each way as shown in FIG. 3 .
- the positions of three intersection points P 1C , P 1R , and P 1L are specified on the vehicle travelling side
- the positions of three intersection points P 3C , P 3R , and P 3L are specified on the opposite side of the vehicle travelling side
- the positions of three intersection points P 2C , P 2R , and P 2L are specified on the left side of the vehicle travelling side
- the positions of three intersection points P 4C , P 4R , and P 4L are specified on the right side of the vehicle traveling side.
- intersection point at which two sides cross each other may be denoted as two different indications.
- P 3R denoting the rightmost intersection point of the opposite side may be used in the same sense as P 2R denoting the rightmost intersection point of the left side.
- Each of the intersection points may be represented by a coordinate value (x, y) in a two-dimensional coordinate system having the current position of the vehicle or one of the intersection points of the vehicle traveling lane as the origin.
- left and right intersection points of a travel lane on which the vehicle travels are P 1C and P 1R , respectively, and left and right intersection points of a straight forward travelling lane LS on the opposite side on which the vehicle is able to travel straightforward are P 3C and P 3L , left and right intersection points of a left side forward travelling lane LL on which the vehicle turns left and travels are P 2C and P 2L , and left and right intersection points of a right side forward travelling lane LR on which the vehicle turns right and travels are P 4C and F 1R .
- intersection point information calculating unit 220 and the travel path calculating unit 230 may use the existence of a stop line mark to distinguish the forward travelling lane, which is an available travel lane, from the reverse travelling lane with respect to the current position of the vehicle.
- coordinate information of the specified intersection points may be stored/managed as intersection index information in the intersection area, and the travel path calculating unit 230 calculates an available travel path of the vehicle on the basis of the coordinate information of the intersection points.
- FIG. 4 is a diagram illustrating an example in which a left turn travel path of a vehicle is calculated on the basis of an intersection point at an intersection according to the present embodiment
- FIG. 5 is a diagram illustrating an example in which a right turn travel path of a vehicle is calculated on the basis of an intersection point at an intersection according to the present embodiment.
- the travel path calculating unit 230 calculates one or more vehicle travel paths in the intersection area on the basis of the positions and the number of the intersection points in the intersection area calculated by the intersection point information calculating unit 220 , and details thereof will be described with reference to FIGS. 4 to 6 .
- FIGS. 4 and 5 illustrate an intersection area of a one-way one lane road as shown in FIG. 3 .
- FIG. 4 shows an example of calculating a left turn travel path
- FIG. 5 shows an example of calculating a right turn travel path.
- the travel path calculating unit 230 predicts a travelling direction of the vehicle at the intersection using turn signal operation information of the vehicle to determine the travelling direction of the vehicle, and when a left turn signal is activated, the travel path calculating unit 230 sets, among the intersection points, the positions of a 1-1 intersection point P 1C and a 1-2 intersection point P 1R corresponding to a left side intersection point and a right side intersection point of a lane on which the vehicle is currently being travelled as a first reference position, sets the positions of a 2-1 intersection point P 2C and a 2-2 intersection point P 2R corresponding to a left side intersection point and a right side intersection point of a left side distant lane (that is, a left side forward travelling lane) located on a left distant side of the travel lane as a second reference position, and generates vehicle travel path information passing through the first reference position and the second reference position.
- the travel path calculating unit 230 calculates a travel path including: a 1-1 curve C 1 connecting the 1-1 intersection point P 1C , which is the left side intersection point of the lane on which the vehicle is currently travelled, to the 2-1 intersection point P 2C , which is the left side intersection point of the left side forward travelling lane, and having a first radius of curvature; and a 1-2 curve C 2 connecting the 1-2 intersection point P 1R , which is the right side intersection point of the lane on which the vehicle is currently travelled, to the 2-2 intersection point P 2R , which is the right side intersection point of the left side forward travelling lane, and having a second radius of curvature.
- the first radius of curvature R 1 of the 1-1 curve C 1 may be a first distance that is a straight line distance between the 1-1 intersection point P 1C and the 2-1 intersection point P 2C
- the second radius of curvature R 2 of the 1-2 curve C 2 may be a second distance that is a straight line between the 1-2 intersection point P 1R and the 2-2 intersection point P 2R , but the radius of curvature of each curve is not limited thereto.
- the travel path calculating unit 230 calculates a travel path including a 1-3 curve C 3 connecting the 1-1 intersection point P 1C , which is the left side intersection point of the lane on which the vehicle is currently travelled, to the 4-1 intersection point P 4C , which is the left side intersection point of the right side forward travelling lane, with respect to the 1-2 intersection point P 1R , which is the right side intersection point of the lane on which the vehicle is currently travelled, and having a third radius of curvature.
- the third radius of curvature R 3 of the 1-3 curve C 3 may be a third distance that is a straight line distance between the 1-1 intersection point P 1C and the 4-1 intersection point P 4C , but the radius of curvature of each curve is not limited thereto.
- FIG. 6 is a diagram illustrating an example of an intersection point and a vehicle travel path in an intersection environment that is different from that shown in FIGS. 3 to 5 , in the case of having a one-way two lane road in a travelling direction and a one-way three lane road in the leftward and rightward directions.
- intersection point information calculating unit 220 specifies a total of twenty intersection points on the basis of information about whether a lane is cut, the position of the cut position, information about whether lanes cross each other, and the crossing position.
- two or more left turn travel paths may be generated.
- a first left turn travel path C 4 and C 5 for the vehicle to travel from the current travelling lane along a first left side forward travelling lane LL 1 , which is the inner most lane among left side forward travelling lanes, and a second left turn travel path C 4 ′ and C 5 ′ for the vehicle to travel from the current travelling lane along a second left side forward travelling lane LL 2 , which is an outside lane among the left side forward travelling lanes may be generated.
- a 4-1 curve C 4 forming the first left turn travel path connects the intersection point P 1C to the intersection point P 2 CC is a curve having a radius of curvature corresponding to a straight line distance between the intersection points P 1C -P 2CC
- a 4-2 curve C 5 forming the first left turn travel path connects the intersection point P 1CR to the intersection point P 2CL is a curve having a radius of curvature corresponding to a straight line distance between the intersection points P 1CR -P 2CL .
- the travel path calculating unit 230 may generate a straightforward travel path including straight lines L 1 and L 2 connecting a left side intersection point P 1CR and a right side intersection point P 1RR of the travel lane to a left side intersection point P 3CL and a right side intersection point P 3LL of a forward travelling lane on the opposite side, respectively, to perform a straightforward travel.
- FIG. 7 is a diagram illustrating a lane modeling for calculating a vehicle travel path according to the present embodiment.
- the travel path calculating unit 230 may calculate a vehicle travel path in a lane on the basis of lateral offset information of the vehicle immediately before entering the intersection, heading angle information of the vehicle with respect to the lane, and a radius of curvature of the vehicle travel path at the intersection. To this end, the travel path calculating unit 230 may use a path generation model as shown in FIG. 7 .
- a vehicle travel path in a lane may be additionally calculated for a precise position control of the vehicle in the corresponding lane or travel path.
- lateral offset information of the vehicle immediately before entering the intersection may be used.
- a vehicle travel path may include an imaginary center line 710 , a left lane 712 , and a right lane 714 .
- a vehicle travel path in a lane Y may be determined on the basis of a current heading angle C 11 of the vehicle, a lateral offset value C 10 of the vehicle with respect to the lane, and a curvature C 21 of the lane, according to a lane model as shown in Equation 1 below.
- Y C 0I +C 1I X+C 2I X 2 +C 3I X 3 [Equation 1]
- C 01 denotes the amount of lateral offset of a center of a vehicle with respect to a lane, and represents the degree of lateral displacement of the center of the vehicle from one of a left line, an imaginary centerline, and a right line.
- C 11 denotes a heading angle, that is, an angle between the vehicle travelling direction and the imaginary center line 710 or between the left and right lines 712 and 714 , which are straight line sections, and the lane.
- C 21 denotes the curvature of a curve section of the lane
- C 31 denotes a time variable (a differential value) of the curvature.
- the vehicle travel control unit 300 included in the apparatus for controlling the vehicle controls the engine control unit, the steering control unit, and the braking control unit such that the vehicle autonomously travels along the vehicle travel path in the lane.
- the exact positions of intersection points, which are crossing points of lanes at the intersection, and the vehicle travel path (straight, left turn, right turn) in the intersection may be precisely calculated.
- safe autonomous driving at an intersection is provided.
- FIG. 8 is a flowchart showing the overall flow of a method of controlling a vehicle according to the present embodiment.
- the method of controlling a vehicle includes an information receiving operation for receiving map information and image sensor information (S 810 ), an intersection identifying operation for identifying an intersection area on the basis of the map information and the image sensor information (S 820 ), an intersection point information calculating operation for calculating the positions and the number of a plurality of intersection points on the basis of a lane continuing characteristic and a lane crossing characteristic in the intersection area (S 830 ), a travel path calculating operation for calculating one or more vehicle travel paths in the intersection area on the basis of the positions and the number of the intersection points (S 840 ), and a vehicle travel control operation for controlling a travel of the vehicle according to the calculated vehicle travel path (S 850 ).
- an information receiving operation for receiving map information and image sensor information (S 810 )
- an intersection identifying operation for identifying an intersection area on the basis of the map information and the image sensor information
- S 830 an intersection point information calculating operation for calculating the positions and the number of a plurality of intersection points on the basis of a lane continuing
- the lane continuing characteristic includes information about a lane cut position in which a lane is cut by a predetermined length or more in the intersection area
- the lane crossing characteristic includes information about a lane crossing position in which two lanes cross each other
- the intersection point information calculating unit may determine the lane cut position and the lane crossing position as the intersection point.
- the method of controlling the vehicle according to the present embodiment may further include an intersection form determining operation for determining one of the number of available travel lanes at the intersection and the shape of the intersection on the basis of at least one of information about the number of lanes sensed in the intersection area and information about the type of a signal lamp.
- one of a straightforward travel path, a left turn travel path, and a right turn travel path may be generated using the information about intersection points calculated in the intersection point information calculating operation S 830 and vehicle turn signal operation information.
- an in-lane vehicle travel path which is a target movement path of a vehicle within a calculated vehicle travel path (a lane)
- the in-lane vehicle travel path may be determined on the basis of lateral offset information of the vehicle, heading angle information of the vehicle with respect to the lane, and a curvature of the vehicle travel path at the intersection, according to the lane model as shown in Equation 1.
- the vehicle path calculating device for identifying an intersection area and calculating intersection point information and a vehicle travel path based on the intersection point information will be construed as being included in the present disclosure.
- the vehicle path generating device 200 includes the intersection identifying unit 210 configured to identify an intersection area on the basis of at least one of received map information and image sensor information, the intersection point information calculating unit 220 configured to calculate the positions and the number of a plurality of intersection points on the basis of a lane continuing characteristic and a lane crossing characteristic in the intersection area, and the travel path calculating unit 230 configured to calculate one or more vehicle travel paths in the intersection area on the basis of the positions and the number of the intersection points.
- the vehicle path generating device 200 does not need to be used only for a vehicle travel control system at an intersection, and may be used in association with all other systems and apparatuses in the field in which a precise vehicle path at an intersection needs to be generated, such as a driver assistance system (DAS) or a traffic control system.
- DAS driver assistance system
- traffic control system a traffic control system
- the precise position of an intersection point that is, a cut position of a lane or a crossing point of lanes at an intersection, and a vehicle travel path (straightforward, left turn, right turn) within an intersection may be precisely calculated, and a travel of the vehicle may be automatically controlled on the basis of the calculated position of the intersection point and the vehicle travel path, thereby providing safe autonomous driving at the intersection.
- the embodiment of the present invention can enhance the precision of a vehicle movable path in an intersection area by calculating a precise position of an intersection point corresponding to a crossing point of lanes at an intersection and calculating a vehicle travel path on the basis of the calculated position of the intersection point.
- the embodiment of the present invention can provide safe autonomous driving at an intersection by calculating the positions of a plurality of intersection points at an intersection, calculating a vehicle movement path through the calculated positions, and automatically controlling the travel of the vehicle on the basis of the vehicle movement path.
Abstract
Description
Y=C 0I +C 1I X+C 2I X 2 +C 3I X 3 [Equation 1]
Claims (16)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2018-0120040 | 2018-10-08 | ||
KR1020180120040A KR102132899B1 (en) | 2018-10-08 | 2018-10-08 | Route Generation Apparatus at Crossroad, Method and Apparatus for Controlling Vehicle at Crossroad |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200108833A1 US20200108833A1 (en) | 2020-04-09 |
US11260864B2 true US11260864B2 (en) | 2022-03-01 |
Family
ID=69886370
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/595,813 Active 2040-06-19 US11260864B2 (en) | 2018-10-08 | 2019-10-08 | Path generation apparatus at intersection, and method and apparatus for controlling vehicle at intersection |
Country Status (4)
Country | Link |
---|---|
US (1) | US11260864B2 (en) |
KR (1) | KR102132899B1 (en) |
CN (1) | CN111016896A (en) |
DE (1) | DE102019215403A1 (en) |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102115915B1 (en) * | 2018-10-08 | 2020-05-27 | 주식회사 만도 | Apparatus and method for determining distortion in road lane recognition |
JP7083306B2 (en) * | 2018-12-17 | 2022-06-10 | 本田技研工業株式会社 | Travel track determination processing and automatic driving device |
US11217090B2 (en) * | 2018-12-27 | 2022-01-04 | Continental Automotive Systems, Inc. | Learned intersection map from long term sensor data |
US11465620B1 (en) * | 2019-07-16 | 2022-10-11 | Apple Inc. | Lane generation |
US11279349B2 (en) * | 2019-09-26 | 2022-03-22 | Intel Corporation | Safety module, automated driving system, and methods thereof |
US11834045B2 (en) * | 2019-10-08 | 2023-12-05 | Motional Ad Llc | Navigating multi-way stop intersections with an autonomous vehicle |
KR20210042537A (en) * | 2019-10-10 | 2021-04-20 | 엘지전자 주식회사 | Method of estimating position in local area in large sapce and robot and cloud server implementing thereof |
CN113587952A (en) * | 2020-04-30 | 2021-11-02 | 福特全球技术公司 | Navigation system and display method of navigation map |
CN113879295B (en) * | 2020-07-02 | 2024-04-12 | 华为技术有限公司 | Track prediction method and device |
US11618444B2 (en) * | 2020-10-01 | 2023-04-04 | Argo AI, LLC | Methods and systems for autonomous vehicle inference of routes for actors exhibiting unrecognized behavior |
CN114475642B (en) * | 2020-11-12 | 2023-12-05 | 上海海拉电子有限公司 | Automatic driving-oriented intersection detection early warning method |
KR20220078772A (en) | 2020-12-03 | 2022-06-13 | 현대모비스 주식회사 | Intersection driving system and method for vehicle |
CN116588112B (en) * | 2023-07-11 | 2024-01-30 | 广汽埃安新能源汽车股份有限公司 | Intersection vehicle control method and device and vehicle |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100815153B1 (en) | 2006-11-08 | 2008-03-19 | 한국전자통신연구원 | Apparatus and method for guiding a cross road of car navigation using a camera |
JP2013088409A (en) | 2011-10-24 | 2013-05-13 | Nissan Motor Co Ltd | Travel support device for vehicle |
US20140118552A1 (en) * | 2011-06-13 | 2014-05-01 | Taku Takahama | Road shape determining device, in-vehicle image recognizing device, imaging axis adjusting device, and lane recognizing method |
KR101392850B1 (en) | 2012-04-04 | 2014-05-09 | 모본주식회사 | Method and system for lane departure warning based on image recognition |
JP2016075905A (en) | 2014-10-07 | 2016-05-12 | トヨタ モーター エンジニアリング アンド マニュファクチャリング ノース アメリカ,インコーポレイティド | Joint probabilistic modeling and inference of intersection structure |
KR101704405B1 (en) | 2016-03-31 | 2017-02-15 | (주)와이파이브 | System and method for lane recognition |
US9802529B2 (en) * | 2014-05-22 | 2017-10-31 | Hella Kgaa Hueck & Co. | Method for controlling a cornering light and lighting device |
KR20180040760A (en) | 2016-10-12 | 2018-04-23 | 한국전자통신연구원 | Apparatus and method for searching path of autonomous driving vehicle |
WO2018126228A1 (en) * | 2016-12-30 | 2018-07-05 | DeepMap Inc. | Sign and lane creation for high definition maps used for autonomous vehicles |
US20180208183A1 (en) * | 2017-01-20 | 2018-07-26 | Trw Automotive Gmbh | Horizon-stabilized lateral control for a vehicle |
US20180349715A1 (en) * | 2017-05-31 | 2018-12-06 | Carmera, Inc. | System of vehicles equipped with imaging equipment for high-definition near real-time map generation |
US10829121B1 (en) * | 2018-08-02 | 2020-11-10 | GM Global Technology Operations LLC | Controlling an autonomous vehicle based upon computed lane boundaries |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9751506B2 (en) * | 2015-10-27 | 2017-09-05 | GM Global Technology Operations LLC | Algorithms for avoiding automotive crashes at left and right turn intersections |
KR102581779B1 (en) * | 2016-10-11 | 2023-09-25 | 주식회사 에이치엘클레무브 | Apparatus and method for prevention of collision at crossroads |
-
2018
- 2018-10-08 KR KR1020180120040A patent/KR102132899B1/en active IP Right Grant
-
2019
- 2019-10-08 US US16/595,813 patent/US11260864B2/en active Active
- 2019-10-08 DE DE102019215403.4A patent/DE102019215403A1/en active Pending
- 2019-10-08 CN CN201910991089.5A patent/CN111016896A/en active Pending
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100815153B1 (en) | 2006-11-08 | 2008-03-19 | 한국전자통신연구원 | Apparatus and method for guiding a cross road of car navigation using a camera |
US20140118552A1 (en) * | 2011-06-13 | 2014-05-01 | Taku Takahama | Road shape determining device, in-vehicle image recognizing device, imaging axis adjusting device, and lane recognizing method |
JP2013088409A (en) | 2011-10-24 | 2013-05-13 | Nissan Motor Co Ltd | Travel support device for vehicle |
KR101392850B1 (en) | 2012-04-04 | 2014-05-09 | 모본주식회사 | Method and system for lane departure warning based on image recognition |
US9802529B2 (en) * | 2014-05-22 | 2017-10-31 | Hella Kgaa Hueck & Co. | Method for controlling a cornering light and lighting device |
JP2016075905A (en) | 2014-10-07 | 2016-05-12 | トヨタ モーター エンジニアリング アンド マニュファクチャリング ノース アメリカ,インコーポレイティド | Joint probabilistic modeling and inference of intersection structure |
KR101704405B1 (en) | 2016-03-31 | 2017-02-15 | (주)와이파이브 | System and method for lane recognition |
KR20180040760A (en) | 2016-10-12 | 2018-04-23 | 한국전자통신연구원 | Apparatus and method for searching path of autonomous driving vehicle |
WO2018126228A1 (en) * | 2016-12-30 | 2018-07-05 | DeepMap Inc. | Sign and lane creation for high definition maps used for autonomous vehicles |
US20180208183A1 (en) * | 2017-01-20 | 2018-07-26 | Trw Automotive Gmbh | Horizon-stabilized lateral control for a vehicle |
US10723345B2 (en) * | 2017-01-20 | 2020-07-28 | Trw Automotive Gmbh | Horizon-stabilized lateral control for a vehicle |
US20180349715A1 (en) * | 2017-05-31 | 2018-12-06 | Carmera, Inc. | System of vehicles equipped with imaging equipment for high-definition near real-time map generation |
US20210216794A1 (en) * | 2017-05-31 | 2021-07-15 | Carmera, Inc. | System of vehicles equipped with imaging equipment for high-definition near real-time map generation |
US20210216795A1 (en) * | 2017-05-31 | 2021-07-15 | Carmera, Inc. | System of vehicles equipped with imaging equipment for high-definition near real-time map generation |
US10829121B1 (en) * | 2018-08-02 | 2020-11-10 | GM Global Technology Operations LLC | Controlling an autonomous vehicle based upon computed lane boundaries |
Non-Patent Citations (6)
Title |
---|
D. Zhou, Z. Ma and J. Sun, "Autonomous Vehicles' Turning Motion Planning for Conflict Areas at Mixed-Flow Intersections," in IEEE Transactions on Intelligent Vehicles, vol. 5, No. 2, pp. 204-216, Jun. 2020, doi: 10.1109/TIV.2019.2955854. (Year 2020). * |
K. Shu et al., "Autonomous Driving at Intersections: A Critical-Turning-Point Approach for Left Turns," 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), 2020, pp. 1-6, doi: 10.1109/ITSC45102.2020.9294754. (Year: 2020). * |
Korean Office Action dated Sep. 30, 2019 issued in Korean Patent Application No. 10-2018-0120040. |
M. Zhang, R. Fu, D. D. Morris and C. Wang, "A Framework for Turning Behavior Classification at Intersections Using 3D LIDAR," in IEEE Transactions on Vehicular Technology, vol. 68, No. 8, pp. 7431-7442, Aug. 2019, doi: 10.1109/TVT.2019.2926787. (Year: 2019). * |
Office Action issued in Korean Patent Application No. 10-2018-0120040 dated Sep. 30, 2019. |
P. Cai, Y. Sun, Y. Chen and M. Liu, "Vision-Based Trajectory Planning via Imitation Learning for Autonomous Vehicles," 2019 IEEE Intelligent Transportation Systems Conference (ITSC), 2019, pp. 2736-2742, doi: 10.1109/ITSC.2019.8917149. (Year: 2019). * |
Also Published As
Publication number | Publication date |
---|---|
DE102019215403A1 (en) | 2020-04-09 |
CN111016896A (en) | 2020-04-17 |
US20200108833A1 (en) | 2020-04-09 |
KR102132899B1 (en) | 2020-07-21 |
KR20200044193A (en) | 2020-04-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11260864B2 (en) | Path generation apparatus at intersection, and method and apparatus for controlling vehicle at intersection | |
CN109669451B (en) | Autonomous driving support apparatus and method | |
JP7291158B2 (en) | Information processing method, system, device, program and computer storage medium | |
US11027653B2 (en) | Apparatus, system and method for preventing collision | |
US10775799B2 (en) | Autonomous cruise control apparatus and method | |
US11313976B2 (en) | Host vehicle position estimation device | |
US9514648B2 (en) | Alerting apparatus | |
US9880554B2 (en) | Misrecognition determination device | |
KR102637599B1 (en) | Apparatus and Method for Controlling Lane Changing using Vehicle-to-Vehicle Communication and Tendency Information Calculation Apparatus therefor | |
JP2900737B2 (en) | Inter-vehicle distance detection device | |
EP3888985A1 (en) | Lane changing method and system for autonomous vehicles, and vehicle | |
KR102505471B1 (en) | Apparatus and method for detecting mounting angle of radar | |
JP7324057B2 (en) | Vehicle object detection device | |
US7142130B2 (en) | Driving support system for vehicle, driving support apparatus for vehicle, and driving support method for vehicle | |
US11042759B2 (en) | Roadside object recognition apparatus | |
US20200290605A1 (en) | Apparatus, system, and method for vehicle collision avoidance control | |
JP2019067116A (en) | Solid object ground discrimination device | |
KR102115905B1 (en) | Driver assistance system and control method for the same | |
KR102611507B1 (en) | Driving assistance method and driving assistance device | |
US11608071B2 (en) | Vehicle control device | |
JP7435513B2 (en) | Vehicle control device and vehicle control method | |
US11548504B2 (en) | Driver assistance system and control method thereof | |
KR20220056299A (en) | Radar control system and method of vehicle | |
WO2022130720A1 (en) | Dividing line recognition device | |
WO2022259644A1 (en) | Vehicle control device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MANDO CORPORATION, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SIM, SANGKYUN;REEL/FRAME:050657/0861 Effective date: 20191007 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: KIA MOTORS CORPORATION, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BAE, JUNGNAM;REEL/FRAME:051041/0313 Effective date: 20191001 Owner name: HYUNDAI MOTOR COMPANY, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BAE, JUNGNAM;REEL/FRAME:051041/0313 Effective date: 20191001 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
AS | Assignment |
Owner name: MANDO MOBILITY SOLUTIONS CORPORATION, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MANDO CORPORATION;REEL/FRAME:058598/0480 Effective date: 20211026 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: HL KLEMOVE CORP., KOREA, REPUBLIC OF Free format text: MERGER;ASSIGNOR:MANDO MOBILITY SOLUTIONS CORPORATION;REEL/FRAME:061148/0166 Effective date: 20211202 |