KR102566596B1 - Method and apparatus for determining a driving route of a vehicle - Google Patents

Abstract

The present invention relates to a method and apparatus for determining the travel path of a vehicle. According to the method according to an embodiment of the present invention, a first driving route estimated to be in which a vehicle is driving is obtained from a vector map in which a plurality of driving routes are displayed based on a GPS signal, and based on a front image obtained by photographing the front of the vehicle to obtain a second driving path estimated that the vehicle is driving, correct the first driving path based on the second driving path, and correct the first driving path on the vector map to obtain a final driving path in which the vehicle is driving can decide

Description

Method and apparatus for determining a driving route of a vehicle

The present invention relates to a method and apparatus for determining the travel path of a vehicle.

A vehicle driving on a road travels between any two lanes among a plurality of lanes included in the road, and the vehicle may frequently change its driving path while driving.

A GPS device may be used to determine which driving route the vehicle is currently traveling on. An apparatus for determining a driving route of a vehicle may receive a GPS signal from an artificial satellite and derive an absolute position value on latitude and longitude of the vehicle from the GPS signal. Through this, the apparatus for determining the driving route of the vehicle may estimate which driving route the vehicle is currently on based on the GPS signal.

However, an error may exist in the location information of the vehicle estimated from the GPS signal. Accordingly, there is a need for research on a method for more accurately determining a driving path of a vehicle.

The foregoing background art is technical information that the inventor possessed for derivation of the present invention or acquired during the derivation process of the present invention, and cannot necessarily be said to be known art disclosed to the general public prior to filing the present invention.

SUMMARY OF THE INVENTION The present invention provides a method and apparatus for determining a travel path of a vehicle. The problem to be solved by the present invention is not limited to the above-mentioned problems, and other problems and advantages of the present invention that are not mentioned can be understood by the following description and more clearly understood by the embodiments of the present invention. It will be. In addition, it will be appreciated that the problems and advantages to be solved by the present invention can be realized by the means and combinations indicated in the claims.

As a technical means for achieving the above-described technical problem, a first aspect of the present disclosure is a method for determining a driving route of a vehicle, in which the vehicle is traveling on a vector map displaying a plurality of driving routes based on a GPS signal. obtaining a first driving route estimated to be the first driving route; obtaining a second driving path estimated to be in which the vehicle is driving based on a front image obtained by photographing the front of the vehicle; correcting the first driving route based on the second driving route; and determining a final driving path on which the vehicle is driving as a result of correcting the first driving path on the vector map.

In addition, in the correcting step, when the number of lanes located on the right or left side of the first driving path is different from the number of lanes located on the right or left side of the second driving path, the first driving path is changed to the first driving path. and correcting the first driving path into a third driving path in the vector map so as to correspond to the two driving paths, wherein the third driving path corresponds to the number of lanes located on the right or left of the second driving path. Based on this, it may correspond to a driving route on the vector map that positionally corresponds to the second driving route.

In addition, the correcting may include, when a stop line is not included in lane information acquired based on the front image, a lateral correction value of the third driving path so that the third driving path matches the second driving path and deriving a heading angle correction value; and correcting the third driving path into a fourth driving path by applying the lateral direction correction value and the heading angle correction value to the third driving path. Including, in the step of determining the final driving route, the fourth driving route may be determined as the final driving route.

In addition, the correcting may include, when a stop line is included in the lane information acquired based on the front image, a lateral correction value of the third driving path so that the third driving path matches the second driving path; deriving a longitudinal correction value and a heading angle correction value; and correcting the third driving path into a fourth driving path by applying the horizontal direction correction value, the longitudinal direction correction value, and the heading angle correction value to the third driving path. Including, in the step of determining the final driving route, the fourth driving route may be determined as the final driving route.

The obtaining of the first driving route may include obtaining a current location of the vehicle based on the GPS signal; converting the vector map into a local vector map based on an orthogonal coordinate system having the current location of the vehicle as an origin; and acquiring a first driving route among at least one driving route included in the local vector map. can include

The acquiring of the second driving path may include inputting the forward image to a deep neural network (DNN) and predicting lanes in the forward image; and displaying the lanes in the forward image on a Cartesian coordinate system with the current location of the vehicle as an origin. and obtaining the second driving path based on lanes displayed on the Cartesian coordinate system.

A second aspect of the present disclosure is an apparatus for determining a driving route of a vehicle, comprising: a memory in which at least one program is stored; and a processor that performs an operation by executing the at least one program, wherein the processor selects a first driving route determined as the vehicle is driving from a vector map including a plurality of driving routes based on a GPS signal. obtaining a second driving path determined that the vehicle is driving based on a front image obtained by capturing the front of the vehicle; correcting the first driving path based on the second driving path; It is possible to provide an apparatus for determining a final driving route in which the vehicle is driving as a result of correcting the first driving route on a map.

A third aspect of the present disclosure may provide a computer-readable recording medium recording a program for executing the method according to the first aspect on a computer.

In addition to this, another method for implementing the present invention, another system, and a computer readable recording medium storing a computer program for executing the method may be further provided.

Other aspects, features and advantages other than those described above will become apparent from the following drawings, claims and detailed description of the invention.

According to the above-mentioned problem solving means of the present disclosure, the vehicle can more accurately provide the current travel route.

In addition, according to the problem solving means of the present disclosure, it is possible to provide a simple and reliable vehicle driving path correction method using only a lane recognition result based on an image in front of the vehicle.

In addition, according to the problem solving means of the present disclosure, a lane recognition result based on a front image of the vehicle and a correction value derived based on a GPS signal are stored in a memory, and the vehicle is detected by using the correction value even in a section where lane recognition is not possible. The driving path of the can be corrected.

1 is a diagram illustrating a driving path of a vehicle according to an exemplary embodiment.
2 is a block diagram of a device for determining a driving path of a vehicle according to an exemplary embodiment.
FIG. 3 is a diagram illustrating a method of obtaining a first driving path estimated in which a vehicle is driving in a vector map according to an exemplary embodiment.
FIG. 4 is a diagram illustrating a method of obtaining a first driving path estimated in which a vehicle is driving based on a front image of the vehicle according to an exemplary embodiment.
5 is a diagram illustrating lanes predicted by a lane recognizing unit according to an exemplary embodiment.
6 is a diagram exemplarily illustrating a method of correcting a first driving path based on a second driving path according to an exemplary embodiment.
7 is a diagram exemplarily illustrating a method of correcting a position and a heading angle of a driving path according to an exemplary embodiment.
8 is a diagram exemplarily illustrating a method of correcting a position and a heading angle of a driving path according to an exemplary embodiment.
9 is a diagram exemplarily illustrating a method of correcting a driving path of a vehicle using a lane keeping assistance system according to an exemplary embodiment.
10 is a flowchart of a method for determining a driving path of a vehicle according to an embodiment.
11 is a block diagram of a server for determining a driving path of a vehicle according to an exemplary embodiment.

Advantages and features of the present invention, and methods for achieving them will become clear with reference to the detailed description of embodiments in conjunction with the accompanying drawings. However, it should be understood that the present invention is not limited to the embodiments presented below, but may be implemented in a variety of different forms, and includes all conversions, equivalents, and substitutes included in the spirit and scope of the present invention. . The embodiments presented below are provided to complete the disclosure of the present invention and to fully inform those skilled in the art of the scope of the invention to which the present invention belongs. In describing the present invention, if it is determined that a detailed description of related known technologies may obscure the gist of the present invention, the detailed description will be omitted.

Terms used in this application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Some embodiments of the present disclosure may be represented as functional block structures and various processing steps. Some or all of these functional blocks may be implemented as a varying number of hardware and/or software components that perform specific functions. For example, functional blocks of the present disclosure may be implemented by one or more microprocessors or circuit configurations for a predetermined function. Also, for example, the functional blocks of this disclosure may be implemented in various programming or scripting languages. Functional blocks may be implemented as an algorithm running on one or more processors. In addition, the present disclosure may employ prior art for electronic environment setup, signal processing, and/or data processing, etc. Terms such as “mechanism,” “element,” “means,” and “composition” will be used broadly. It can be, and is not limited to mechanical and physical configurations.

In addition, connecting lines or connecting members between components shown in the drawings are only examples of functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that can be replaced or added.

Hereinafter, 'vehicle' may refer to all types of transportation means such as a car, bus, motorcycle, kickboard, or truck that are used to move people or objects with engines.

In addition, a road means a road on which vehicles travel, and may include, for example, various types of roads, such as expressways, national highways, local roads, expressways, and automobile-only roads. A lane refers to a road space that is divided from each other through division lines displayed on a road surface. The division line refers to a solid line or a dotted line marked on the road surface for distinguishing lanes.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a driving path of a vehicle according to an exemplary embodiment.

A vehicle driving on the road travels between any two lanes among a plurality of lanes included in the road, and a path on which the vehicle is currently traveling may be referred to as a driving path. Meanwhile, the vehicle may frequently change its driving route while driving.

A GPS device may be used to determine which driving route the vehicle is currently traveling on. An apparatus for determining a driving route of a vehicle may receive a GPS signal from an artificial satellite and derive an absolute position value on latitude and longitude of the vehicle from the GPS signal. Through this, the apparatus for determining the driving route of the vehicle may estimate which driving route the vehicle is currently on based on the GPS signal.

However, an error may exist in the location information of the vehicle estimated from the GPS signal. Accordingly, the driving route of the vehicle estimated based on the GPS signal may be different from the actual driving route of the vehicle. For example, referring to FIG. 1 , the driving route 120 of the vehicle 100 estimated from a GPS signal and the driving route 110 on which the vehicle 100 is actually driving on the road may be different. Accordingly, there is a need to correct the driving path of the vehicle estimated based on the GPS signal.

2 is a block diagram of a device for determining a driving path of a vehicle according to an exemplary embodiment.

Referring to FIG. 2 , an apparatus 200 for determining a driving path of a vehicle may include a memory 210 , a sensor unit 220 , a communication unit 230 and a processor 240 . In the apparatus 200 for determining a driving path of a vehicle of FIG. 2 , only components related to the embodiment are shown. Accordingly, those skilled in the art can understand that other general-purpose components may be further included in addition to the components shown in FIG. 2 .

The memory 210 is hardware for storing various data processed in the device 200 for determining a driving path of the vehicle, and may store programs for processing and control of the processor 240 . For example, the memory 210 may store a vector map in which a plurality of driving routes along which a vehicle can be driven are displayed.

The memory 210 may include random access memory (RAM) such as dynamic random access memory (DRAM) and static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and CD-ROM. ROM, Blu-ray or other optical disk storage, hard disk drive (HDD), solid state drive (SSD), or flash memory.

The sensor unit 220 may include a photographing device for capturing the surroundings of the vehicle, a sensor for measuring the driving distance of the vehicle (eg, a vehicle speedometer, an odometer, an accelerometer, etc.) or a sensor for measuring the rotation angle of the vehicle (eg, a sensor unit 220). magnetic sensor, gyro sensor, etc.) may be included. The device for photographing the surroundings of the vehicle may be a still camera or video camera configured to record the environment outside the vehicle. The imaging device may include multiple cameras, and the multiple cameras may be disposed at multiple locations on the interior and exterior of the vehicle. The sensor unit 220 may transmit, to the processor 240 , a front image of the vehicle acquired from a device for photographing the surroundings of the vehicle.

The communication unit 230 may include one or more components that enable wired/wireless communication with an external server or external device. For example, the communication unit 230 may include at least one of a short-range communication unit (not shown), a mobile communication unit (not shown), and a broadcast reception unit (not shown). For example, the communication unit 230 may receive a GPS signal from a Global Positioning System (GPS) satellite.

The processor 240 controls the overall operation of the device 200 for determining the driving path of the vehicle. For example, the processor 240 may generally control an input unit (not shown), a display (not shown), the communication unit 230, the memory 210, etc. by executing programs stored in the memory 210. The processor 240 may control the operation of the device 200 for determining a driving path of the vehicle by executing programs stored in the memory 210 . For example, the processor 240 may include a lane recognizing unit 250, a GPS signal processing unit 260, and a driving path correcting unit 270.

The lane recognizing unit 250 may receive a front image of the vehicle from the sensor unit 220 and obtain a driving path estimated to be in which the vehicle is driving based on the front image of the vehicle.

In addition, the GPS signal processing unit 260 may obtain a GPS signal from the communication unit 230 and obtain a vector map displaying a plurality of driving routes along which the vehicle may travel from the memory 210 . The GPS signal processing unit 260 may obtain a driving route estimated to be in which the vehicle is driving from a vector map displaying a plurality of driving routes based on the GPS signal.

Meanwhile, since there may be an error in the location information of the vehicle estimated from the GPS signal, the driving path estimated by the GPS signal processing unit 260 that the vehicle is driving on the vector map may be different from the driving path in which the vehicle is actually driving.

Accordingly, the driving path correction unit 270 may correct the driving path obtained from the GPS signal processing unit 260 based on the driving path obtained from the lane recognizing unit 250 . Finally, the driving path correction unit 270 may determine the final driving path on which the vehicle is driving as a result of correcting the driving path obtained from the GPS signal processing unit 260 on the vector map.

The processor 240 may include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, and microcontrollers. It may be implemented using at least one of micro-controllers, microprocessors, and electrical units for performing other functions.

As an example, the device 200 for determining the driving path of the vehicle may be a mobile electronic device. For example, the device 200 for determining a driving route of a vehicle may be a smart phone, a tablet PC, a PC, a smart TV, a personal digital assistant (PDA), a laptop, a media player, a navigation device, a device equipped with a camera, and other mobile electronic devices. It can be implemented as a device. In addition, the device 200 for determining the driving route of the vehicle may be implemented as a wearable device having a communication function and data processing function, such as a watch, glasses, a hair band, and a ring.

As another embodiment, the device 200 for determining the driving path of the vehicle may be an electronic device embedded in the vehicle. For example, the device 200 for determining the driving path of the vehicle may be an electronic device inserted into the vehicle through tuning after the production process.

As another embodiment, the device 200 for determining the driving path of the vehicle may be a server located outside the vehicle. A server may be implemented as a computer device or a plurality of computer devices that communicate over a network to provide commands, codes, files, content, services, and the like. The server may receive data necessary for determining a current driving path in which the vehicle is traveling from devices installed in the vehicle, and determine a driving path of the vehicle based on the received data.

FIG. 3 is a diagram illustrating a method of obtaining a first driving path estimated in which a vehicle is driving in a vector map according to an exemplary embodiment.

According to an embodiment, an apparatus for determining a driving route of a vehicle may obtain a current location of the vehicle based on a GPS signal. In addition, the apparatus for determining the driving route of the vehicle converts the vector map into a local vector map based on an orthogonal coordinate system having the current location of the vehicle as an origin, and the vehicle is traveling among at least one driving route included in the local vector map. It is possible to obtain a first driving route that is estimated to be the first driving route.

Referring to FIG. 3 , the GPS signal processing unit 260 may receive the vector map 300 stored in the memory 210 . For example, the vector map 300 may correspond to a driving route map in which a plurality of driving routes along which a vehicle can be driven are displayed. An arbitrary vector on the vector map 300 passes through the middle of the lanes located on both sides of the arbitrary vector, and may be parallel to the lanes located on both sides of the arbitrary vector. The vector map 300 may correspond to a map based on a spherical coordinate system in the form of longitude, latitude, and height. For example, the vector map 300 may be a map based on the World Geodetic System 1984 (WGS 84) coordinate system, but is not limited thereto.

In addition, the GPS signal processing unit 260 converts a vector map based on a spherical coordinate system to a local ENU (north-east) coordinate system corresponding to an orthogonal coordinate system in order to obtain a driving path estimated to be in which the vehicle is traveling in the vector map 300. Convert to vector map.

Meanwhile, the GPS signal processing unit 260 may receive a GPS signal from the communication unit 230 and may obtain the current location of the vehicle based on the GPS signal. The current position of the vehicle based on the GPS signal may be expressed in the form of a spherical coordinate system. The GPS signal processing unit 260 may convert the current position of the vehicle expressed in a spherical coordinate system format into a local ENU coordinate system format.

Finally, the GPS signal processing unit 260 may convert the vector map based on the local ENU coordinate system into a local vector map 310 having a predetermined size with the current location of the vehicle converted to the local ENU coordinate system format as an origin.

The GPS signal processing unit 260 may obtain a first driving route estimated to be in which the vehicle is driving from among at least one driving route included in the local vector map 310 . For example, as shown in FIG. 3 , the local vector map 310 may include driving routes a1, a2, and a3, and finally, the GPS signal processing unit 260 considers the current location of the vehicle so that the vehicle travels. It can be assumed that it is located on path a2.

Meanwhile, as described above, the vector map may correspond to a precise lane map rather than a driving route map in which a plurality of driving routes are displayed. The precise lane map may correspond to a map including only lane information among information of the precise road map. The precision road map may correspond to a 3D digital map including lane information, regulatory and safety information, and various road facilities.

FIG. 4 is a diagram illustrating a method of obtaining a first driving path estimated in which a vehicle is driving based on a front image of the vehicle according to an exemplary embodiment.

According to an embodiment, an apparatus for determining a driving path of a vehicle inputs a forward image photographing the front of the vehicle to a deep neural network (DNN), predicts lanes in the forward image, and maps the lanes in the forward image to a current image of the vehicle. It can be displayed on the Cartesian coordinate system with the position as the origin. The apparatus for determining the driving path of the vehicle may obtain a second driving path estimated to be in which the vehicle is driving based on the lanes displayed on the Cartesian coordinate system.

Referring to FIG. 4 , the lane recognizing unit 250 may receive a front image 400 photographing the front of the vehicle from the sensor unit 220 . The lane detecting unit 250 may include a deep neural network (DNN) module.

The DNN module may receive the forward image 400 and learn to predict positions or properties of lanes included in the forward image 400 . For example, the range of correction that can be performed by the driving path correction unit 270 to be described later may vary depending on the type of learning data used for learning of the DNN module.

For example, training data used for learning of the DNN module may correspond to data labeled with locations in an image of respective lanes on both sides of the path on which the vehicle is currently driving. That is, training data used for learning of the DNN module may correspond to data labeled with locations of two lanes in an image.

Alternatively, the learning data may correspond to data labeled with positions in an image of each of a plurality of lanes, including both lanes of the path on which the vehicle is currently driving, as well as other lanes.

Alternatively, the learning data may correspond to data labeled with positions and attributes of each of a plurality of lanes including both lanes of the path on which the vehicle is currently driving as well as other lanes. For example, the attribute of the lane may correspond to 'center line', 'stop line', or 'general lane', but is not limited thereto.

As shown in FIG. 4 , the DNN module may include an encoder 410, a next best instance decoder 420, and a next best attribute decoder 430. The encoder 410 of the DNN module may convert the input low-level forward image 400 into high-level features. The lane instance decoder 420 may predict lane instances pixel by pixel in the forward image converted into high-level features. The lane attribute decoder 430 may predict which attribute each lane instance in the forward image has.

5 is a diagram illustrating lanes predicted by a lane recognizing unit according to an exemplary embodiment.

Referring to FIG. 5 , the lane recognizing unit 250 may obtain lane instances included in an image in front of the vehicle from the DNN module. Meanwhile, the acquired lane instances may correspond to lane instances 500 displayed on an image coordinate system having a device for capturing a front image as an origin.

The lane recognizing unit 250 may convert the lane instances 500 displayed on the image coordinate system to be displayed on the vehicle coordinate system. The vehicle coordinate system may correspond to a Cartesian coordinate system having the current location of the vehicle as an origin. That is, the lane recognizing unit 250 may convert lane instances 500 displayed on the image coordinate system into lane instances 510 displayed on the vehicle coordinate system. Also, each of the lane instances 510 displayed on the vehicle coordinate system may be expressed in a polynomial form.

The lane recognizing unit 250 may obtain at least one driving path 520 displayed on the vehicle coordinate system based on the lane instances 510 displayed on the vehicle coordinate system. The lane recognizing unit 250 may obtain a second driving path estimated in which the vehicle is driving among at least one driving path 520 displayed on the vehicle coordinate system. For example, as shown in FIG. 3 , the driving paths 520 on the vehicle coordinate system obtained based on the front image of the vehicle may include b1, b2, and b3, and finally, the lane recognizing unit 250 determines the vehicle It can be estimated that the vehicle is located on the driving path b3 by considering the current location of .

6 is a diagram exemplarily illustrating a method of correcting a first driving path based on a second driving path according to an exemplary embodiment.

According to an embodiment, the apparatus 200 for determining a driving path of a vehicle may set a first driving path estimated to be in which the vehicle is driving based on a GPS signal and a second driving path estimated to be in which the vehicle is driving based on a front image of the vehicle. 2 Can be corrected based on the driving route. First, the apparatus 200 for determining a driving path of a vehicle determines a first driving path when the number of lanes located on the right or left side of a first driving path and the number of lanes located on the right or left side of a second driving path are different from each other. The first driving path may be corrected into a third driving path in the vector map to correspond to the second driving path.

For example, it may be assumed that the lane recognizing unit 250 is capable of recognizing a position in an image of each of a plurality of lanes including both lanes of the current driving route as well as other lanes. In this case, the driving path correction unit 270 calculates the number of lanes located to the right of the first driving path estimated that the vehicle is driving in the local vector map and the second driving path estimated that the vehicle is driving in the image in front of the vehicle. The number of lanes located to the right of can be compared. If the number of lanes located on the right side of the first driving path is K (K is a natural number) and the number of lanes located on the right side of the second driving path is L (L is a natural number), the lane recognizing unit 250 can recognize The maximum number of lanes present may be M. In this case, the maximum number of right lanes that can be recognized by the lane recognizing unit 250 may be 0.5M.

For example, when K is greater than L and L is less than 0.5M, the first travel path may be corrected to a third travel path at a position moved to the left by (K-L) travel paths from the first travel path. . Alternatively, when K is less than L, the first travel path may be corrected to a third travel path at a position moved to the right by (L-K) travel paths from the first travel path.

For example, when K is greater than L and L corresponds to 0.5M, the number of lanes located on the right side of the first driving route is greater than the maximum number of right lanes that the lane recognizing unit 250 can recognize. , It is not possible to correct the first driving route to a driving route on the vector map corresponding to the second driving route. In addition, since it is not determined whether the lane located on the left side of the first driving route is a reverse driving lane beyond the center line, it may not be considered when correcting the driving route.

Meanwhile, it may be assumed that the lane recognizing unit 250 is capable of recognizing the position and attribute of each of a plurality of lanes including both lanes and other lanes of the current driving route in an image. In this case, since the property of the center line can be used, the driving path can be corrected by considering the lanes located on the left. That is, when the lane recognizing unit 250 can recognize the position and attribute of each of a plurality of lanes including both lanes of the current driving route and other lanes, the location and property of the lane located on the right or left The driving path may be corrected as described above in consideration of the number.

Meanwhile, it may be assumed that the lane recognizing unit 250 can recognize the positions in the image of only the lanes on both sides of the current driving route. In this case, the first driving route is converted into a vector map corresponding to the second driving route. It may not be corrected by the driving route on the image.

Referring to FIG. 6 , the local vector map 600 may include driving routes a1, a2, and a3, and the GPS signal processing unit 260 determines that the vehicle is located on the first driving route a2 in consideration of the current location of the vehicle. can be estimated Meanwhile, b1, b2, and b3 may be included in the driving paths 610 on the vehicle coordinate system obtained based on the front image of the vehicle, and the lane recognizing unit 250 considers the current position of the vehicle to determine whether the vehicle is driving in the second driving direction. It can be assumed that it is located on path b3. In this case, the driving path correction unit 270 trusts the estimation result of the lane recognizing unit 250 and converts the driving path of the vehicle in the vector map so that the first driving path a2 corresponds to the second driving path b3. It can be corrected from a2 to the third travel path a3. That is, the third driving path corresponds to a driving path on the local vector map that is positionally corresponding to the second driving path estimated by the lane recognizer 250 that the vehicle is driving on the vehicle coordinate system based on the front image of the vehicle. can do. For example, the third driving route may correspond to a driving route on a local vector map that is positionally corresponding to the second driving route based on the number of lanes located on the left or right side of the second driving route.

7 is a diagram exemplarily illustrating a method of correcting a position and a heading angle of a driving path according to an exemplary embodiment.

According to an embodiment, the apparatus 200 for determining a driving path of a vehicle may, as described above with reference to FIG. 6 , determine the number of lanes located on the right or left side of the first driving path and the number of lanes located on the right or left side of the second driving path. If the number of is different from each other, the first driving path may be corrected to the third driving path in the vector map so that the first driving path corresponds to the second driving path. After correcting the first driving path to the third driving path, the device 200 for determining the driving path of the vehicle may correct the position and heading angle so that the third driving path matches the second driving path.

According to an embodiment, when the stop line is not included in the lane information acquired by the lane recognizing unit 250 based on the front image, the driving path correction unit 270 matches the third driving path to the second driving path. A lateral direction correction value and a heading angle correction value of the third driving path may be derived. The driving path correction unit 270 may correct the third driving path into a fourth driving path by applying the lateral direction correction value and the heading angle correction value to the third driving path. Finally, the fourth driving route may be determined as a final driving route in which the vehicle is driving.

As described above with reference to FIG. 6 , the driving path correction unit 270 adjusts the driving path of the vehicle on the local vector map 600 so that the first driving path a2 on the local vector map 600 corresponds to the second driving path b3. The first travel path a2 can be corrected to the third travel path a3.

Also, the driving path correction unit 270 may derive the lateral direction correction value Tx and the heading angle correction value θ of the third driving path a3 so that the third driving path a3 matches the second driving path b3. The lateral correction value Tx is a position difference in the lateral direction between the second driving path b3 and the third driving path a3 on the local vector map 600 among the driving paths 610 on the vehicle coordinate system obtained based on the front image of the vehicle is a value representing In addition, the heading angle correction value θ is the tilt angle difference between the second driving path b3 and the third driving path a3 on the local vector map 600 among the driving paths 610 on the vehicle coordinate system obtained based on the front image of the vehicle. is a value representing

The driving path correction unit 270 may apply the lateral direction correction value Tx and the heading angle correction value θ to the third driving path a3. Finally, the driving path compensator 270 may correct the third driving path a3 into the fourth driving path a4 and determine the fourth driving path a4 as the final driving path in which the vehicle is driving.

As described above, when the stop line is not included in the lane information obtained by the lane recognizing unit 250 based on the forward image, vertical direction correction may not be performed.

8 is a diagram exemplarily illustrating a method of correcting a position and a heading angle of a driving path according to an exemplary embodiment.

According to an embodiment, when a stop line is included in the lane information acquired by the lane recognizing unit 250 based on the front image, the driving path correcting unit 270 adjusts the third driving path to match the second driving path. 3 The lateral direction correction value, the longitudinal direction correction value, and the heading angle correction value of the driving path can be derived. The driving path correction unit 270 may correct the third driving path into a fourth driving path by applying the horizontal direction compensation value, the vertical direction compensation value, and the heading angle compensation value to the third driving path. Finally, the fourth driving route may be determined as a final driving route in which the vehicle is driving.

As described above with reference to FIG. 6 , the driving path correction unit 270 adjusts the driving path of the vehicle on the local vector map 600 so that the first driving path a2 on the local vector map 600 corresponds to the second driving path b3. The first travel path a2 can be corrected to the third travel path a3.

The driving path correction unit 270 may derive the lateral direction correction value Tx, the vertical direction correction value Ty, and the heading angle correction value θ of the third driving path a3 so that the third driving path a3 matches the second driving path b3. . The lateral correction value Tx is a position difference in the lateral direction between the second driving path b3 and the third driving path a3 on the local vector map 600 among the driving paths 610 on the vehicle coordinate system obtained based on the front image of the vehicle is a value representing The vertical direction correction value Ty is the positional difference in the longitudinal direction between the second driving path b3 and the third driving path a3 on the local vector map 600 among the driving paths 610 on the vehicle coordinate system obtained based on the front image of the vehicle. is a value representing In addition, the heading angle correction value θ is the tilt angle difference between the second driving path b3 and the third driving path a3 on the local vector map 600 among the driving paths 610 on the vehicle coordinate system obtained based on the front image of the vehicle. is a value representing

That is, the driving path correction unit 270 performs ICP (Iterative Closest Point) matching between the third driving path a3 and the second driving path b3 to obtain a lateral correction value Tx, a vertical direction correction value Ty, and a heading angle correction value θ. can be derived.

The driving path correction unit 270 may apply the lateral direction correction value Tx, the vertical direction correction value Ty, and the heading angle correction value θ to the third driving path a3. Finally, the driving path compensator 270 may correct the third driving path a3 into the fourth driving path a4 and determine the fourth driving path a4 as the final driving path in which the vehicle is driving.

9 is a diagram exemplarily illustrating a method of correcting a driving path of a vehicle using a lane keeping assistance system according to an exemplary embodiment.

According to an embodiment, unlike the above described with reference to FIGS. 1 to 8 , when a function for recognizing a lane does not exist in the device 200 for determining a driving path of a vehicle, the driving path may be corrected. For example, when a lane keeping assist system (LKAS) is activated, it may be assumed that the driver is driving along the center of a lane located on both sides of the current driving route.

Referring to FIG. 9 , the local vector map 600 may include driving routes a1 , a2 , and a3 , and the GPS signal processing unit 260 determines that the vehicle is driving along the first driving route a2 in consideration of the current location of the vehicle. can be presumed to be Meanwhile, when the lane keeping assistance system is activated, it may be estimated that the vehicle is driving along the second driving path b.

The driving path correction unit 270 may derive the lateral direction correction value Tx and the heading angle correction value θ of the first driving path a2 so that the first driving path a2 matches the second driving path b. The lateral direction correction value Tx is a value representing a positional difference in the lateral direction between the second driving path b estimated by the lane keeping assistance system as the vehicle is driving and the first driving path a2 on the local vector map 600 . Also, the heading angle correction value θ is a value indicating an inclined angle difference between the second driving path b estimated by the lane keeping assistance system that the vehicle is driving and the first driving path a2 on the local vector map 600 .

The driving path correction unit 270 may apply the lateral direction correction value Tx and the heading angle correction value θ to the first driving path a2. Finally, the driving path correction unit 270 may correct the first driving path a2 into the third driving path a4 and determine the third driving path a4 as the final driving path in which the vehicle is driving.

10 is a flowchart of a method for determining a driving path of a vehicle according to an embodiment.

Since the method for determining the current lane of the vehicle shown in FIG. 10 is related to the embodiments described in the drawings described above, even if omitted below, the contents described in the drawings are the same as those described in the drawings. method can also be applied.

Referring to FIG. 10 , in step 1010, the processor may obtain a first driving route estimated to be on which the vehicle is driving from a vector map displaying a plurality of driving routes based on a GPS signal.

According to an embodiment, the processor may obtain a current location of the vehicle based on a GPS signal and convert the vector map into a local vector map based on an orthogonal coordinate system having the current location of the vehicle as an origin. The processor may obtain a first driving route from among at least one driving route included in the local vector map.

In operation 1020, the processor may obtain a second driving path estimated to be in which the vehicle is driving based on a front image obtained by photographing the front of the vehicle.

According to an embodiment, the processor may predict lanes in the forward image by inputting the forward image to a deep neural network (DNN), and display the lanes in the forward image on a Cartesian coordinate system having the current location of the vehicle as an origin. The processor may obtain the second driving path based on the lanes displayed on the Cartesian coordinate system.

In operation 1030, the processor may correct the first driving path based on the second driving path.

According to an embodiment, the processor determines whether the first driving path is connected to the second driving path when the number of lanes located on the right or left side of the first driving path is different from the number of lanes located on the right or left side of the second driving path. Correspondingly, the first driving path may be corrected to the third driving path in the vector map.

According to an embodiment, when the stop line is not included in lane information obtained based on the front image, the processor corrects the lateral direction correction value and the heading angle of the third driving path so that the third driving path matches the second driving path. value can be derived. The processor may correct the third driving path into a fourth driving path by applying the lateral direction correction value and the heading angle correction value to the third driving path, and may determine the fourth driving path as the final driving path.

According to an exemplary embodiment, when a stop line is included in lane information acquired based on a front image, the processor determines a lateral correction value and a longitudinal correction value of the third driving path so that the third driving path matches the second driving path. and a heading angle correction value may be derived. The processor may correct the third driving path into a fourth driving path by applying the horizontal direction correction value, the vertical direction correction value, and the heading angle correction value to the third driving path, and determine the fourth driving path as a final driving path. can

In operation 1040, the processor may determine a final driving path on which the vehicle is driving as a result of correcting the first driving path on the vector map.

11 is a block diagram of a server for determining a driving path of a vehicle according to an exemplary embodiment.

Referring to FIG. 11 , a server 1100 that determines a driving path of a vehicle may include a communication unit 1110, a processor 1120, and a DB 1130. In the server 1100 for determining the driving path of the vehicle of FIG. 11 , only components related to the embodiment are shown. Accordingly, those skilled in the art can understand that other general-purpose components may be further included in addition to the components shown in FIG. 11 .

The communication unit 1110 may include one or more components that enable wired/wireless communication with an external server or external device. For example, the communication unit 1110 may include at least one of a short-range communication unit (not shown), a mobile communication unit (not shown), and a broadcast reception unit (not shown).

The DB 1130 is hardware for storing various data processed in the server 1100 that determines the driving path of the vehicle, and may store programs for processing and controlling the processor 1120 .

The DB 1130 includes random access memory (RAM) such as dynamic random access memory (DRAM) and static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and CD-ROM. ROM, Blu-ray or other optical disk storage, hard disk drive (HDD), solid state drive (SSD), or flash memory.

The processor 1120 controls the overall operation of the server 1100 that determines the driving path of the vehicle. For example, the processor 1120 may generally control an input unit (not shown), a display (not shown), a communication unit 1110, and the DB 1130 by executing programs stored in the DB 1130. The processor 1120 may control the operation of the server 1100 that determines the driving path of the vehicle by executing programs stored in the DB 1130 .

The processor 1120 may control at least a part of operations of the server 1100 for determining the travel path of the vehicle described above with reference to FIGS. 1 to 10 .

The processor 1120 may include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, and microcontrollers. It may be implemented using at least one of micro-controllers, microprocessors, and electrical units for performing other functions.

Embodiments according to the present invention may be implemented in the form of a computer program that can be executed on a computer through various components, and such a computer program may be recorded on a computer-readable medium. At this time, the medium is a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM and a DVD, a magneto-optical medium such as a floptical disk, and a ROM hardware devices specially configured to store and execute program instructions, such as RAM, flash memory, and the like.

Meanwhile, the computer program may be specially designed and configured for the present invention, or may be known and usable to those skilled in the art of computer software. An example of a computer program may include not only machine language code generated by a compiler but also high-level language code that can be executed by a computer using an interpreter or the like.

According to one embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or between two user devices. It can be distributed (e.g., downloaded or uploaded) directly or online. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

The steps constituting the method according to the present invention may be performed in any suitable order unless an order is explicitly stated or stated to the contrary. The present invention is not necessarily limited according to the order of description of the steps. The use of all examples or exemplary terms (eg, etc.) in the present invention is simply to explain the present invention in detail, and the scope of the present invention is limited due to the examples or exemplary terms unless limited by the claims. it is not going to be In addition, those skilled in the art can appreciate that various modifications, combinations and changes can be made according to design conditions and factors within the scope of the appended claims or equivalents thereof.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments and should not be determined, and all scopes equivalent to or equivalently changed from the claims as well as the claims described below are within the scope of the spirit of the present invention. will be said to belong to

Claims (8)

As a method for determining a driving route of a vehicle,
obtaining a first driving route estimated to be in which the vehicle is driving based on a GPS signal from a vector map displaying a plurality of driving routes;
obtaining a second driving path estimated to be in which the vehicle is driving based on a front image obtained by photographing the front of the vehicle;
determining whether or not to correct the first driving route based on the second driving route; and
determining a final travel path in which the vehicle is traveling;
including,
The step of determining the final driving route,
in response to determining to perform the correction, deriving a lateral correction value and a heading angle correction value of the first travel path such that the first travel path matches the second travel path;
correcting the first driving path into a third driving path by applying the lateral direction correction value and the heading angle correction value to the first driving path; and
And determining the third driving route as the final driving route. According to claim 1,
Obtaining the second driving route,
Acquiring a second driving route based on the forward image and a vehicle maintenance assistance system (Lane Keeping Assist System). delete According to claim 1,
The step of determining whether or not to correct is,
When the number of lanes located on the right or left of the second driving path is less than half of the maximum number of lanes that can be recognized based on the forward image, it is determined that the correction is performed;
and determining not to perform the correction when the number of lanes located on the right or left of the second driving path is equal to or greater than half of the maximum number of recognizable lanes. According to claim 1,
The step of determining whether or not to correct is,
When the location of only both lanes of the path on which the vehicle is traveling can be recognized based on the forward image, it is determined that the correction is not performed;
Determining that the correction is performed when the location of a plurality of lanes including not only the both lanes but also other lanes of the path on which the vehicle is traveling can be recognized based on the forward image; , method. According to any one of claims 4 and 5,
The step of determining the final driving route,
and in response to determining not to perform the correction, determine the final driving route based on the first driving route. A device for determining a driving route of a vehicle, comprising:
a memory in which at least one program is stored; and
a processor that performs calculations by executing the at least one program;
the processor,
Obtaining a first driving route estimated to be in which the vehicle is driving from a vector map in which a plurality of driving routes are displayed based on a GPS signal;
Obtaining a second driving path estimated that the vehicle is driving based on a front image obtained by photographing the front of the vehicle;
determine whether to correct the first driving route based on the second driving route;
Determining a final driving route in which the vehicle is traveling,
The processor determines the final driving route,
in response to determining to perform the correction, derive a lateral correction value and a heading angle correction value of the first travel path such that the first travel path matches the second travel path;
correcting the first driving path into a third driving path by applying the lateral direction correction value and the heading angle correction value to the first driving path;
and determining the third travel route as the final travel route. A computer-readable recording medium recording a program for executing the method of claim 1 on a computer.