EP4220601A1 - Method and device for locating a traffic participant, and vehicle - Google Patents
Method and device for locating a traffic participant, and vehicle Download PDFInfo
- Publication number
- EP4220601A1 EP4220601A1 EP22153728.5A EP22153728A EP4220601A1 EP 4220601 A1 EP4220601 A1 EP 4220601A1 EP 22153728 A EP22153728 A EP 22153728A EP 4220601 A1 EP4220601 A1 EP 4220601A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- traffic
- traffic lane
- lane
- participant
- probability distribution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000009826 distribution Methods 0.000 claims abstract description 63
- 238000005259 measurement Methods 0.000 claims abstract description 32
- 230000006870 function Effects 0.000 claims description 24
- 239000011159 matrix material Substances 0.000 claims description 10
- 230000007704 transition Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010801 machine learning Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 8
- 238000013459 approach Methods 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000007476 Maximum Likelihood Methods 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0108—Measuring and analyzing of parameters relative to traffic conditions based on the source of data
- G08G1/0112—Measuring and analyzing of parameters relative to traffic conditions based on the source of data from the vehicle, e.g. floating car data [FCD]
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0125—Traffic data processing
- G08G1/0133—Traffic data processing for classifying traffic situation
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/163—Decentralised systems, e.g. inter-vehicle communication involving continuous checking
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
Definitions
- the invention relates to a device and a computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes.
- the invention further relates to a vehicle comprising such a device for locating a traffic participant.
- ADAS Advanced driver-assistance systems
- the road model typically comprises several traffic lanes that are detected by different sensors.
- the most critical interrelation between the traffic participants and the road model is the association of traffic participants to the traffic lanes on which they are moving or driving. In other words, one needs to know the traffic lane that each traffic participant occupies.
- the geometric relation between a traffic participant and a traffic lane can be calculated by using polygons, which tells the traffic lane occupancy for that traffic participant.
- a drawback of this approach is that it does not compute the uncertainty in the traffic lane assignment, i.e., the amount of trust in the assignment.
- the sensor detections of traffic participants and road traffic lanes have much uncertainty, it is not possible to tell that a traffic participant is moving on a certain traffic lane with reliable confidence.
- kuhnl et al. "Visual ego-vehicle traffic lane assignment using Spatial Ray features," 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, QLD, Australia, 2013, pp. 1101-1106 , relates to a method for ego-lane index estimation, using only a monocular camera. However, the approach relates only to the ego lane without considering other traffic participants and other traffic lanes.
- a computer-implemented method and a device for locating a traffic participant on a traffic lane of a plurality of traffic lanes, a vehicle, a computer program product and a non-transitory, computer-readable storage medium as recited in the independent claims are provided.
- Various preferred features of the invention are recited in the dependent claims.
- the invention provides a computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes.
- a discrete probability distribution is provided which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane.
- a likelihood function is provided which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane.
- the discrete probability distribution at a next cycle is predicted, based on the discrete probability distribution at a current cycle and using a dynamic model of the traffic participant.
- a measured lateral position of the traffic participant is determined, based on measurement data from at least one sensor.
- the predicted discrete probability distribution is updated by Bayesian updating, using the likelihood function and the measured lateral position.
- the invention provides a device for locating a traffic participant on a traffic lane of a plurality of traffic lanes.
- the device comprises an interface configured to receive measurement data from at least one sensor.
- the device further comprises a computing device configured to provide a discrete probability distribution which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane.
- the computing device is further configured to provide a likelihood function which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane.
- the computing device is further configured to predict the discrete probability distribution at a next cycle, based on the discrete probability distribution at a current cycle and using a dynamic model of the traffic participant.
- the computing device is further configured to determine a measured lateral position of the traffic participant based on the measurement data received from said at least one sensor.
- the computing device is further configured to update the predicted discrete probability distribution by Bayesian updating, using the likelihood function and the measured
- the invention provides a vehicle with a device for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the second aspect.
- the invention provides a computer program product comprising executable program code configured to, when executed by a computing device, perform the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect.
- the invention provides a non-transitory, computer-readable storage medium comprising executable program code configured to, when executed by a computing device, perform the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect.
- the invention allows to consistently and smoothly track the association of a traffic participant to the associated traffic lane.
- the invention uses a statistical way to determine the location of traffic participants. For each traffic lane, a probability can be computed that a respective traffic participant is located on said traffic lane. Therefore, not only is the traffic lane determined that a traffic participant is associated to, but the probability of said association is also computed.
- the invention therefore provides all uncertainties in the traffic lane associations by a probabilistic distribution.
- each traffic participant is described by a Markov chain model.
- the Markov chain model comprises two kinds of random variables that are connected by directed arrows.
- the first random variables are hidden variables Xt that need to be inferred by using the measurements, representing the traffic lane association for the corresponding traffic participant (i.e. the discrete probability distribution).
- the second random variables Yt correspond to the measurements, which are the measured signals like the position and other relevant signals that describe a traffic participant.
- the dynamic model is represented by a state transition matrix.
- the state transition matrix indicates the probability of finding the traffic participant at a next cycle in a second state, given that the traffic participant has been in the current cycle in a first state.
- the states are defined by the respective discrete probability distributions.
- the state transition matrix is determined using a machine learning algorithm.
- the machine learning algorithm may comprise a maximum likelihood method, artificial neural network or the like.
- the machine learning algorithm may be trained using the training data obtained by real driving data.
- the dynamic model depends on a road model modelling the traffic lanes.
- the dynamic model may take the number of the traffic lanes, the type of the traffic lanes (e.g. turning lane or motorway access), a width of the traffic lanes, a type of road and/or traffic rules (e.g. if overtaking is allowed or not) into account.
- the probability of finding the traffic participant in a second state can depend on said parameters. For instance, if overtaking is not allowed, the probability of finding the traffic participant in a next cycle on an opposite traffic lane is very low.
- the probability of moving in a next cycle to an adjacent lane is relatively high.
- the exact position of the traffic participant on the acceleration lane can be taken into account. For example, the probability of changing traffic lanes increases when the traffic participant is approaching an end of the acceleration lane.
- the dynamic model depends on a velocity of the traffic participant. For example, the probability of changing lanes can reduce with increasing velocity.
- the likelihood function comprises for each traffic lane a Gaussian distribution.
- the Gaussian distribution can be centered at a center of the traffic lane in the lateral direction.
- a Gaussian distribution models the assumption that the probability of measuring a location of the traffic participant at or close to the center of the traffic lane is relatively high and decreases the farther away the lateral distance is from the center of the traffic lane.
- a variance of the Gaussian distribution depends on a width of said traffic lane. Taking the width of the traffic lane into account takes care of the fact that the traffic participant has more freedom to move inside the traffic lane if the width of the traffic lane is higher.
- the variance of the Gaussian distribution is proportional to the width of said traffic lane.
- a proportionality factor can be predetermined but can also depend on additional parameters, e.g., a driving velocity of the traffic participant.
- the measurement data is obtained from at least one sensor of an ego vehicle, wherein the traffic participant is located in a surrounding of the ego vehicle.
- the sensors may comprise radar sensors, cameras sensors, lidar sensors and the like.
- the method is performed by a driver assistance system of said ego vehicle.
- the method further comprises controlling at least one function of an ego vehicle based on the discrete probability distribution.
- a driver assistance system of the ego vehicle may provide features like lane changing, lane keeping or collision avoidance by taking the current discrete probability distribution into account.
- a plurality of traffic participants are associated with respective traffic lanes.
- each traffic participant is treated separately according to the method outlined above and explained further below in the illustrated embodiments.
- Figure 1 schematically illustrates a block diagram of a vehicle 1 with a device 2 for locating a traffic participant in a traffic lane of a plurality of traffic lanes.
- the traffic participants can be other vehicles, cyclists, or the like.
- the device 2 comprises an interface 4 and a computing device 5.
- the computing device 5 can comprise at least one of a central processing unit (CPU) or graphics processing unit (GPU) like a microcontroller ( ⁇ C), an integrated circuit (IC), an application-specific integrated circuit (ASIC), an application-specific standard product (ASSP), a digital signal processor (DSP), a field programmable gate array (FPGA) and the like.
- the computing device 5 may further comprise a storage device which may be a volatile or non-volatile data memory, e.g. a solid-state disk, memory card or the like.
- the interface 4 can be a wireless or wired connection, e.g. a CAN bus or the like.
- the device 2 receives recent measurement data from vehicle sensors 3.
- the sensors 3 may comprise radar sensors, cameras sensors, lidar sensors and the like.
- the computing device 5 is configured to locate the traffic participant based on the sensor data.
- the computing device 5 locates the traffic participant based on a Markov chain model as will be explained in the following.
- Figure 2 illustrates the structure of the Markov chain model used for locating the traffic participant on a traffic lane.
- the Markov chain model is a probabilistic graphic model with a chain shape. If a plurality of traffic participants is considered, each traffic participant has a corresponding Markov chain model.
- the first hidden variables Xt need to be inferred by using the measurements, representing the traffic lane association for the corresponding traffic participant.
- the hidden variables Xt describe the current state of the traffic participant and are given by a discrete distribution at a given cycle (or time stamp) t which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane.
- the second variables are variables Yt corresponding to the measurements obtained from the vehicle sensors 3.
- the measurements may comprise a position and other relevant signals that describe the traffic participant.
- the computing device 5 infers an optimal value for Xt in the sense of probability, using the measurements that are obtained up to this cycle.
- the optimal value is given by the posterior discrete probability distribution p(x t
- the computing device 5 In order to compute the posterior distribution p(xt
- the first variables Xt are associated with a dynamic model p(xt
- the dynamic model characterizes how the traffic lane association changes from one cycle to the next cycle.
- the state corresponds to the discrete probability distribution of the traffic participant at a given cycle.
- the second variables Yt are associated with a measurement model p(yt
- the measurement model shows how the measurements are generated, given a value of the current hidden state variable.
- the measurement model can be represented by a Gaussian distribution given a value to the traffic lane association, i.e., knowing on which traffic lane the traffic participant is moving.
- the measurement model defines a likelihood function which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane.
- the dynamic model and the measurement model can each either be modeled precisely or learned using artificial intelligence or machine learning algorithms from training data.
- the computing device 5 For each measurement cycle, the computing device 5 first predicts the discrete probability distribution at a next cycle, based on the discrete probability distribution at the current cycle and using the dynamic model of the traffic participant. At the current cycle, the estimation of the traffic lane association p(x t-1
- the computing device 5 then analyzes the latest measurement data received from the sensors 3.
- the computing device 5 computes a measured lateral position of the traffic participant based on the measurement data.
- the computation may involve fusion of sensor data from different vehicle sensors 3.
- the computation may also involve additional information, such as a road model.
- the computing device 5 then updates the predicted discrete probability distribution by Bayesian updating, using the likelihood function and the measured lateral position.
- the traffic lane association is updated by applying the Bayesian update rule to the predicated traffic lane association, using the measurement model as the likelihood function.
- the computing device thereby computes the updated estimate of the traffic lane association, i.e., p(xt
- the device 2 for locating a traffic participant in a traffic lane of a plurality of traffic lanes has been illustrated as being a component of the vehicle 1.
- the data can be transmitted to a remote server.
- sensor data from a plurality of vehicles can be obtained by a remote server and the locations of the traffic participants is determined by first fusing the sensor data into fused sensor data and by updating the predicted discrete probability distribution using the fused sensor data.
- FIG 3 shows an exemplary traffic scenario for illustrating measurement models used for locating the traffic participant on a traffic lane.
- each traffic lane has an associated measurement model, which describes the statistical distribution of the traffic participants TP1 to TP4 on that traffic lane.
- the measurement model for each traffic lane is given by a Gaussian distribution 61 to 64, located in the middle of the traffic lane, where most traffic participants TP1 to TP4 drive.
- the variance can be selected proportional to a traffic lane width.
- Figure 4 illustrates a flow diagram of a method for locating a traffic participant in a traffic lane of a plurality of traffic lanes.
- the method can be carried out by a computing device, such as the computing device 5 of the device 2 for locating a traffic participant on a traffic lane of a plurality of traffic lanes described above with reference to Figure 1 .
- a discrete probability distribution is provided which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane.
- the discrete probability distribution can be part of a Markov chain model, describing the first (hidden) random variables Xt.
- a likelihood function which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane.
- the likelihood function can correspond to a measurement model of the Markov chain model.
- the likelihood function may comprise a Gaussian distribution for each traffic lane.
- the variance of the Gaussian distribution may depend on a width of said traffic lane. For example, the variance can be proportional to the width of the traffic lane.
- the discrete probability distribution at a next cycle is predicted, S3, based on the discrete probability distribution at the current cycle and using a dynamic model of the traffic participant.
- the dynamic model can be represented by a state transition matrix.
- the state transition matrix can be computed exactly, based on the modeling assumptions.
- the state transition matrix is determined using a machine learning algorithm.
- the dynamic model may depend on a road model modelling the lane.
- a measured lateral position of the traffic participant is determined.
- measurement data from at least one vehicle sensor 3 is received.
- the sensor data may be received from a plurality of vehicle sensors 3 and may then first be fused into fused sensor data.
- the vehicle sensors 3 may comprise vehicle sensors of an ego vehicle 1, for instance vehicle cameras, radar sensors, lidar sensors and the like.
- the lateral position can be obtained for example by projecting three-dimensional or two-dimensional coordinates on the lateral dimension.
- the lateral direction can be defined as being orthogonal to the driving direction of the vehicle 1.
- step S5 the predicted discrete probability distribution is updated by Bayesian updating, using the likelihood function and the measured lateral position.
- the probability distribution at each cycle may be used by a driver assistance system to control vehicle functions, S6. For example, at least some of adaptive cruise control, lane keeping, lane changing, collision avoidance, collision warning and the like may be performed, taking the present probability distribution into account.
- Figure 5 schematically illustrates a block diagram illustrating a computer program product P comprising executable program code PC.
- the executable program code PC is configured to perform, when executed (e.g. by a computing device 5 described above), the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect.
- Figure 6 schematically illustrates a block diagram illustrating a non-transitory, computer-readable storage medium M comprising executable program code MC configured to, when executed (e.g. by a computing device), perform the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect.
- the terms “comprise”, “comprising”, “include”, “including”, “contain”, “containing”, “have”, “having”, and any variations thereof, are intended to be understood in an inclusive (i.e. non-exclusive) sense, such that the process, method, device, apparatus or system described herein is not limited to those features or parts or elements or steps recited but may include other elements, features, parts or steps not expressly listed or inherent to such process, method, article, or apparatus.
- the terms “a” and “an” used herein are intended to be understood as meaning one or more unless explicitly stated otherwise.
- the terms “first”, “second”, “third”, etc. are used merely as labels, and are not intended to impose numerical requirements on or to establish a certain ranking of importance of their objects.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
- The invention relates to a device and a computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes. The invention further relates to a vehicle comprising such a device for locating a traffic participant.
- Advanced driver-assistance systems (ADAS) require a comprehensive understanding of the environment surrounding the ego vehicle. As two indispensable parts, a good knowledge of the traffic participants (TP) and the road is required. Accordingly, the traffic participants and the road must be precisely and accurately detected and modeled.
- Common driving functions, like a forward collision avoidance system and an emergency brake assist, demand a precise detection of the interrelation between traffic participants and the road model. The road model typically comprises several traffic lanes that are detected by different sensors. The most critical interrelation between the traffic participants and the road model is the association of traffic participants to the traffic lanes on which they are moving or driving. In other words, one needs to know the traffic lane that each traffic participant occupies.
- According to one solution, the geometric relation between a traffic participant and a traffic lane can be calculated by using polygons, which tells the traffic lane occupancy for that traffic participant. However, a drawback of this approach is that it does not compute the uncertainty in the traffic lane assignment, i.e., the amount of trust in the assignment. Furthermore, as the sensor detections of traffic participants and road traffic lanes have much uncertainty, it is not possible to tell that a traffic participant is moving on a certain traffic lane with reliable confidence. In addition, it is hardly feasible to track these geometric assignments. Consequently, pure geometric approaches have problems with reliability and robustness.
- Kühnl et al., "Visual ego-vehicle traffic lane assignment using Spatial Ray features," 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, QLD, Australia, 2013, pp. 1101-1106, relates to a method for ego-lane index estimation, using only a monocular camera. However, the approach relates only to the ego lane without considering other traffic participants and other traffic lanes.
- A general approach of assigning traffic participants to traffic lanes is therefore needed which can also quantify how much the assignment can be trusted.
- In view of the above, it is therefore an object of the present invention to provide a way for assigning traffic participants to traffic lanes which can also quantify the reliability of the assignment.
- In accordance with the invention, a computer-implemented method and a device for locating a traffic participant on a traffic lane of a plurality of traffic lanes, a vehicle, a computer program product and a non-transitory, computer-readable storage medium as recited in the independent claims are provided. Various preferred features of the invention are recited in the dependent claims.
- According to a first aspect, therefore, the invention provides a computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes. A discrete probability distribution is provided which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane. Further, a likelihood function is provided which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane. The discrete probability distribution at a next cycle is predicted, based on the discrete probability distribution at a current cycle and using a dynamic model of the traffic participant. A measured lateral position of the traffic participant is determined, based on measurement data from at least one sensor. The predicted discrete probability distribution is updated by Bayesian updating, using the likelihood function and the measured lateral position.
- According to the second aspect, the invention provides a device for locating a traffic participant on a traffic lane of a plurality of traffic lanes. The device comprises an interface configured to receive measurement data from at least one sensor. The device further comprises a computing device configured to provide a discrete probability distribution which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane. The computing device is further configured to provide a likelihood function which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane. The computing device is further configured to predict the discrete probability distribution at a next cycle, based on the discrete probability distribution at a current cycle and using a dynamic model of the traffic participant. The computing device is further configured to determine a measured lateral position of the traffic participant based on the measurement data received from said at least one sensor. The computing device is further configured to update the predicted discrete probability distribution by Bayesian updating, using the likelihood function and the measured lateral position.
- According to a third aspect, the invention provides a vehicle with a device for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the second aspect.
- According to a fourth aspect, the invention provides a computer program product comprising executable program code configured to, when executed by a computing device, perform the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect.
- According to a fifth aspect, the invention provides a non-transitory, computer-readable storage medium comprising executable program code configured to, when executed by a computing device, perform the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect.
- The invention allows to consistently and smoothly track the association of a traffic participant to the associated traffic lane. The invention uses a statistical way to determine the location of traffic participants. For each traffic lane, a probability can be computed that a respective traffic participant is located on said traffic lane. Therefore, not only is the traffic lane determined that a traffic participant is associated to, but the probability of said association is also computed. The invention therefore provides all uncertainties in the traffic lane associations by a probabilistic distribution.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, each traffic participant is described by a Markov chain model. The Markov chain model, comprises two kinds of random variables that are connected by directed arrows. The first random variables are hidden variables Xt that need to be inferred by using the measurements, representing the traffic lane association for the corresponding traffic participant (i.e. the discrete probability distribution). The second random variables Yt correspond to the measurements, which are the measured signals like the position and other relevant signals that describe a traffic participant.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the dynamic model is represented by a state transition matrix. The state transition matrix indicates the probability of finding the traffic participant at a next cycle in a second state, given that the traffic participant has been in the current cycle in a first state. Herein, the states are defined by the respective discrete probability distributions.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the state transition matrix is determined using a machine learning algorithm. The machine learning algorithm may comprise a maximum likelihood method, artificial neural network or the like. The machine learning algorithm may be trained using the training data obtained by real driving data.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the dynamic model depends on a road model modelling the traffic lanes. The dynamic model may take the number of the traffic lanes, the type of the traffic lanes (e.g. turning lane or motorway access), a width of the traffic lanes, a type of road and/or traffic rules (e.g. if overtaking is allowed or not) into account. The probability of finding the traffic participant in a second state, given that the traffic participant has previously been in the first state, can depend on said parameters. For instance, if overtaking is not allowed, the probability of finding the traffic participant in a next cycle on an opposite traffic lane is very low. As another example, if the traffic participant is currently driving on an acceleration lane joining a motorway, the probability of moving in a next cycle to an adjacent lane is relatively high. Herein, the exact position of the traffic participant on the acceleration lane can be taken into account. For example, the probability of changing traffic lanes increases when the traffic participant is approaching an end of the acceleration lane.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the dynamic model depends on a velocity of the traffic participant. For example, the probability of changing lanes can reduce with increasing velocity.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the likelihood function comprises for each traffic lane a Gaussian distribution. The Gaussian distribution can be centered at a center of the traffic lane in the lateral direction. A Gaussian distribution models the assumption that the probability of measuring a location of the traffic participant at or close to the center of the traffic lane is relatively high and decreases the farther away the lateral distance is from the center of the traffic lane.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, a variance of the Gaussian distribution depends on a width of said traffic lane. Taking the width of the traffic lane into account takes care of the fact that the traffic participant has more freedom to move inside the traffic lane if the width of the traffic lane is higher.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, for each traffic lane, the variance of the Gaussian distribution is proportional to the width of said traffic lane. A proportionality factor can be predetermined but can also depend on additional parameters, e.g., a driving velocity of the traffic participant.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the measurement data is obtained from at least one sensor of an ego vehicle, wherein the traffic participant is located in a surrounding of the ego vehicle. The sensors may comprise radar sensors, cameras sensors, lidar sensors and the like.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the method is performed by a driver assistance system of said ego vehicle.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, the method further comprises controlling at least one function of an ego vehicle based on the discrete probability distribution. For example, a driver assistance system of the ego vehicle may provide features like lane changing, lane keeping or collision avoidance by taking the current discrete probability distribution into account.
- According to a further embodiment of the computer-implemented method for locating the traffic participant on a traffic lane of the plurality of traffic lanes, a plurality of traffic participants are associated with respective traffic lanes. In this case, each traffic participant is treated separately according to the method outlined above and explained further below in the illustrated embodiments.
- For a more complete understanding of the invention and the advantages thereof, exemplary embodiments of the invention are explained in more detail in the following description with reference to the accompanying drawing figures, in which like reference characters designate like parts and in which:
- Fig. 1
- schematically illustrates a block diagram of a vehicle with a device for locating a traffic participant in a traffic lane of a plurality of traffic lanes according to an embodiment of the invention;
- Fig. 2
- shows an exemplary Markov chain model used for locating the traffic participant on a traffic lane;
- Fig. 3
- shows an exemplary traffic scenario for illustrating measurement models used for locating the traffic participant on a traffic lane;
- Fig. 4
- illustrates a flow diagram of a method for locating a traffic participant in a traffic lane of a plurality of traffic lanes according to an embodiment of the invention;
- Fig. 5
- schematically illustrates a block diagram illustrating a computer program product according to an embodiment of the invention; and
- Fig. 6
- schematically illustrates a block diagram illustrating a non-transitory, computer-readable storage medium according to an embodiment of the invention.
- The accompanying drawings are included to provide a further understanding of the present invention and are incorporated in and constitute a part of this specification. The drawings illustrate particular embodiments of the invention and together with the description serve to explain the principles of the invention. Other embodiments of the invention and many of the attendant advantages of the invention will be readily appreciated as they become better understood with reference to the following detailed description.
- It will be appreciated that common and well understood elements that may be useful or necessary in a commercially feasible embodiment are not necessarily depicted in order to facilitate a more abstracted view of the embodiments. The elements of the drawings are not necessarily illustrated to scale relative to each other. It will further be appreciated that certain actions and/or steps in an embodiment of a method may be described or depicted in a particular order of occurrences while those skilled in the art will understand that such specificity with respect to sequence is not actually required. It will also be understood that the terms and expressions used in the present specification have the ordinary meaning as is accorded to such terms and expressions with respect to their corresponding respective areas of inquiry and study, except where specific meanings have otherwise been set forth herein.
-
Figure 1 schematically illustrates a block diagram of avehicle 1 with adevice 2 for locating a traffic participant in a traffic lane of a plurality of traffic lanes. Herein, the traffic participants can be other vehicles, cyclists, or the like. - The
device 2 comprises aninterface 4 and acomputing device 5. Thecomputing device 5 can comprise at least one of a central processing unit (CPU) or graphics processing unit (GPU) like a microcontroller (µC), an integrated circuit (IC), an application-specific integrated circuit (ASIC), an application-specific standard product (ASSP), a digital signal processor (DSP), a field programmable gate array (FPGA) and the like. Thecomputing device 5 may further comprise a storage device which may be a volatile or non-volatile data memory, e.g. a solid-state disk, memory card or the like. - The
interface 4 can be a wireless or wired connection, e.g. a CAN bus or the like. Thedevice 2 receives recent measurement data fromvehicle sensors 3. Herein, thesensors 3 may comprise radar sensors, cameras sensors, lidar sensors and the like. - The
computing device 5 is configured to locate the traffic participant based on the sensor data. Thecomputing device 5 locates the traffic participant based on a Markov chain model as will be explained in the following. -
Figure 2 illustrates the structure of the Markov chain model used for locating the traffic participant on a traffic lane. The Markov chain model is a probabilistic graphic model with a chain shape. If a plurality of traffic participants is considered, each traffic participant has a corresponding Markov chain model. - In the Markov chain model, there are two kinds of random variables that are connected by directed arrows. The first hidden variables Xt need to be inferred by using the measurements, representing the traffic lane association for the corresponding traffic participant. The hidden variables Xt describe the current state of the traffic participant and are given by a discrete distribution at a given cycle (or time stamp) t which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane.
- The second variables are variables Yt corresponding to the measurements obtained from the
vehicle sensors 3. The measurements may comprise a position and other relevant signals that describe the traffic participant. - At each cycle, the
computing device 5 infers an optimal value for Xt in the sense of probability, using the measurements that are obtained up to this cycle. The optimal value is given by the posterior discrete probability distribution p(xt | yt). - In order to compute the posterior distribution p(xt | yt), the
computing device 5 first associates each node in the chain with a probabilistic model. The first variables Xt are associated with a dynamic model p(xt | xt-1). The dynamic model characterizes how the traffic lane association changes from one cycle to the next cycle. The dynamic model can be represented by a state transition matrix Pij = p(xj | xi), denoting the probability to transit from state i at the current cycle to state j at the next cycle. Herein, the state corresponds to the discrete probability distribution of the traffic participant at a given cycle. - The second variables Yt are associated with a measurement model p(yt | xt). The measurement model shows how the measurements are generated, given a value of the current hidden state variable. The measurement model can be represented by a Gaussian distribution given a value to the traffic lane association, i.e., knowing on which traffic lane the traffic participant is moving. The measurement model defines a likelihood function which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane.
- The dynamic model and the measurement model can each either be modeled precisely or learned using artificial intelligence or machine learning algorithms from training data.
- For each measurement cycle, the
computing device 5 first predicts the discrete probability distribution at a next cycle, based on the discrete probability distribution at the current cycle and using the dynamic model of the traffic participant. At the current cycle, the estimation of the traffic lane association p(xt-1 | yt-1) is available. Thecomputing device 5 may predict the traffic lane association p(xt | yt-1) in the next cycle using the sum-product rule, i.e., integrating after multiplying the state transition matrix. - The
computing device 5 then analyzes the latest measurement data received from thesensors 3. Thecomputing device 5 computes a measured lateral position of the traffic participant based on the measurement data. The computation may involve fusion of sensor data fromdifferent vehicle sensors 3. The computation may also involve additional information, such as a road model. - The
computing device 5 then updates the predicted discrete probability distribution by Bayesian updating, using the likelihood function and the measured lateral position. Herein, the traffic lane association is updated by applying the Bayesian update rule to the predicated traffic lane association, using the measurement model as the likelihood function. The computing device thereby computes the updated estimate of the traffic lane association, i.e., p(xt | yt) which is the posterior discrete probability distribution. - In
Figure 1 , thedevice 2 for locating a traffic participant in a traffic lane of a plurality of traffic lanes has been illustrated as being a component of thevehicle 1. According to further embodiments, at least some or even all of the functions of thedevice 2 can be carried out by devices outside of the vehicle. For instance, the data can be transmitted to a remote server. According to further embodiments, sensor data from a plurality of vehicles can be obtained by a remote server and the locations of the traffic participants is determined by first fusing the sensor data into fused sensor data and by updating the predicted discrete probability distribution using the fused sensor data. -
Figure 3 shows an exemplary traffic scenario for illustrating measurement models used for locating the traffic participant on a traffic lane. In this exemplary case, there are four traffic lanes and each traffic lane has an associated measurement model, which describes the statistical distribution of the traffic participants TP1 to TP4 on that traffic lane. The measurement model for each traffic lane is given by aGaussian distribution 61 to 64, located in the middle of the traffic lane, where most traffic participants TP1 to TP4 drive. The variance can be selected proportional to a traffic lane width. -
Figure 4 illustrates a flow diagram of a method for locating a traffic participant in a traffic lane of a plurality of traffic lanes. The method can be carried out by a computing device, such as thecomputing device 5 of thedevice 2 for locating a traffic participant on a traffic lane of a plurality of traffic lanes described above with reference toFigure 1 . - In a first step S1, a discrete probability distribution is provided which indicates for each traffic lane a probability that the traffic participant is located on said traffic lane. The discrete probability distribution can be part of a Markov chain model, describing the first (hidden) random variables Xt.
- In a second step S2, a likelihood function is provided which comprises for each traffic lane a probability distribution which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant is located on said traffic lane. The likelihood function can correspond to a measurement model of the Markov chain model. The likelihood function may comprise a Gaussian distribution for each traffic lane. The variance of the Gaussian distribution may depend on a width of said traffic lane. For example, the variance can be proportional to the width of the traffic lane.
- Given the discrete probability distribution at a certain time stamp (cycle), the discrete probability distribution at a next cycle is predicted, S3, based on the discrete probability distribution at the current cycle and using a dynamic model of the traffic participant. The dynamic model can be represented by a state transition matrix. The state transition matrix can be computed exactly, based on the modeling assumptions. According to further embodiments, the state transition matrix is determined using a machine learning algorithm. The dynamic model may depend on a road model modelling the lane.
- In step S4, a measured lateral position of the traffic participant is determined. In order to compute the lateral position, measurement data from at least one
vehicle sensor 3 is received. The sensor data may be received from a plurality ofvehicle sensors 3 and may then first be fused into fused sensor data. Thevehicle sensors 3 may comprise vehicle sensors of anego vehicle 1, for instance vehicle cameras, radar sensors, lidar sensors and the like. - Based on the sensor data or fused sensor data, the lateral position can be obtained for example by projecting three-dimensional or two-dimensional coordinates on the lateral dimension. The lateral direction can be defined as being orthogonal to the driving direction of the
vehicle 1. - In step S5, the predicted discrete probability distribution is updated by Bayesian updating, using the likelihood function and the measured lateral position.
- The probability distribution at each cycle may be used by a driver assistance system to control vehicle functions, S6. For example, at least some of adaptive cruise control, lane keeping, lane changing, collision avoidance, collision warning and the like may be performed, taking the present probability distribution into account.
-
Figure 5 schematically illustrates a block diagram illustrating a computer program product P comprising executable program code PC. The executable program code PC is configured to perform, when executed (e.g. by acomputing device 5 described above), the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect. -
Figure 6 schematically illustrates a block diagram illustrating a non-transitory, computer-readable storage medium M comprising executable program code MC configured to, when executed (e.g. by a computing device), perform the computer-implemented method for locating a traffic participant on a traffic lane of a plurality of traffic lanes according to the first aspect. - Although specific embodiments of the invention have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that a variety of alternate and/or equivalent implementations exist. It should be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration in any way. Rather, the foregoing summary and detailed description will provide those skilled in the art with a convenient road map for implementing at least one exemplary embodiment, it being understood that various changes may be made in the function and arrangement of elements described in an exemplary embodiment without departing from the scope as set forth in the appended claims and their legal equivalents. Generally, this application is intended to cover any adaptations or variations of the specific embodiments discussed herein.
- In this document, the terms "comprise", "comprising", "include", "including", "contain", "containing", "have", "having", and any variations thereof, are intended to be understood in an inclusive (i.e. non-exclusive) sense, such that the process, method, device, apparatus or system described herein is not limited to those features or parts or elements or steps recited but may include other elements, features, parts or steps not expressly listed or inherent to such process, method, article, or apparatus. Furthermore, the terms "a" and "an" used herein are intended to be understood as meaning one or more unless explicitly stated otherwise. Moreover, the terms "first", "second", "third", etc. are used merely as labels, and are not intended to impose numerical requirements on or to establish a certain ranking of importance of their objects.
-
- 1
- vehicle
- 2
- device
- 3
- vehicle sensor(s)
- 4
- interface
- 5
- computing device
- 61-64
- likelihood functions
- M
- non-transitory, computer-readable storage medium
- MC
- program code
- P
- computer program
- PC
- program code
- S1-S6
- method steps
- TP1-TP4
- traffic participants
- Xi
- first hidden variables
- Yi
- second hidden variables
Claims (15)
- A computer-implemented method for locating a traffic participant (TP1-TP4) on a traffic lane of a plurality of traffic lanes, the method comprising the steps of:providing (S1) a discrete probability distribution which indicates for each traffic lane a probability that the traffic participant (TP1-TP4) is located on said traffic lane;providing (S2) a likelihood function which comprises for each traffic lane a probability distribution (61-64) which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant (TP1-TP4) is located on said traffic lane;predicting (S3) the discrete probability distribution at a next cycle, based on the discrete probability distribution at a current cycle and using a dynamic model of the traffic participant (TP1-TP4);determining (S4) a measured lateral position of the traffic participant (TP1-TP4) based on measurement data from at least one sensor (3); andupdating (S5) the predicted discrete probability distribution by Bayesian updating, using the likelihood function and the measured lateral position.
- The method according to claim 1, wherein the dynamic model is represented by a state transition matrix.
- The method according to claim 2, wherein the state transition matrix is determined using a machine learning algorithm.
- The method according to any of the preceding claims, wherein the dynamic model depends on a road model modelling the traffic lanes.
- The method according to any of the preceding claims, wherein the dynamic model depends on a velocity of the traffic participant (TP1-TP4).
- The method according to any of the preceding claims, wherein, for each traffic lane, the likelihood function comprises a Gaussian distribution.
- The method according to claim 6, wherein, for each traffic lane, a variance of the Gaussian distribution depends on a width of said traffic lane.
- The method according to claim 7, wherein, for each traffic lane, the variance of the Gaussian distribution is proportional to the width of said traffic lane.
- The method according to any of the preceding claims, wherein the measurement data is obtained from at least one sensor (3) of an ego vehicle (1), and wherein the traffic participant (TP1-TP4) is located in a surrounding of the ego vehicle (1).
- The method according to claim 9, wherein the method is performed by a driver assistance system of said ego vehicle (1).
- The method according to any of the preceding claims, further comprising controlling at least one function of an ego vehicle (1) based on the discrete probability distribution.
- A device (2) for locating a traffic participant (TP1-TP4) on a traffic lane of a plurality of traffic lanes, comprising:an interface (4) configured to receive measurement data from at least one sensor (3); anda computing device (5) configured to:provide a discrete probability distribution which indicates for each traffic lane a probability that the traffic participant (TP1-TP4) is located on said traffic lane;provide a likelihood function which comprises for each traffic lane a probability distribution (61-64) which indicates the probability for each lateral position that said lateral position is measured, under the assumption that the traffic participant (TP1-TP4) is located on said traffic lane;predict the discrete probability distribution at a next cycle, based on the discrete probability distribution at a current cycle and using a dynamic model of the traffic participant (TP1-TP4);determine a measured lateral position of the traffic participant (TP1-TP4) based on the measurement data received from said at least one sensor (3); andupdate the predicted discrete probability distribution by Bayesian updating, using the likelihood function and the measured lateral position.
- A vehicle (1) with a device (2) for locating a traffic participant (TP1-TP4) on a traffic lane of a plurality of traffic lanes according to claim 12.
- A computer program product (P) comprising executable program code (PC) configured to, when executed by a computing device (5), perform the method according to any of claims 1 to 11.
- A non-transitory, computer-readable storage medium (M) comprising executable program code (MC) configured to, when executed by a computing device (5), perform the method according to any of claims 1 to 11.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22153728.5A EP4220601A1 (en) | 2022-01-27 | 2022-01-27 | Method and device for locating a traffic participant, and vehicle |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22153728.5A EP4220601A1 (en) | 2022-01-27 | 2022-01-27 | Method and device for locating a traffic participant, and vehicle |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4220601A1 true EP4220601A1 (en) | 2023-08-02 |
Family
ID=80121816
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP22153728.5A Pending EP4220601A1 (en) | 2022-01-27 | 2022-01-27 | Method and device for locating a traffic participant, and vehicle |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP4220601A1 (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2289754A1 (en) * | 2009-08-31 | 2011-03-02 | Toyota Motor Europe NV/SA | Vehicle or traffic control method and system |
EP2615598A1 (en) * | 2012-01-11 | 2013-07-17 | Honda Research Institute Europe GmbH | Vehicle with computing means for monitoring and predicting traffic participant objects |
US20190329763A1 (en) * | 2016-10-31 | 2019-10-31 | Toyota Motor Europe | Driving assistance method and system |
-
2022
- 2022-01-27 EP EP22153728.5A patent/EP4220601A1/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2289754A1 (en) * | 2009-08-31 | 2011-03-02 | Toyota Motor Europe NV/SA | Vehicle or traffic control method and system |
EP2615598A1 (en) * | 2012-01-11 | 2013-07-17 | Honda Research Institute Europe GmbH | Vehicle with computing means for monitoring and predicting traffic participant objects |
US20190329763A1 (en) * | 2016-10-31 | 2019-10-31 | Toyota Motor Europe | Driving assistance method and system |
Non-Patent Citations (2)
Title |
---|
CHRISTIAN LAUGIER ET AL: "Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving Safety", IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, vol. 3, no. 4, 1 January 2011 (2011-01-01), pages 4 - 19, XP055184312, ISSN: 1939-1390, DOI: 10.1109/MITS.2011.942779 * |
KUHNL ET AL.: "Visual ego-vehicle traffic lane assignment using Spatial Ray features", IEEE INTELLIGENT VEHICLES SYMPOSIUM, vol. IV, 2013, pages 1101 - 1106, XP032501869, DOI: 10.1109/IVS.2013.6629613 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11726477B2 (en) | Methods and systems for trajectory forecasting with recurrent neural networks using inertial behavioral rollout | |
CN111670468B (en) | Moving body behavior prediction device and moving body behavior prediction method | |
JP7200371B2 (en) | Method and apparatus for determining vehicle speed | |
US9784592B2 (en) | Turn predictions | |
US20220097720A1 (en) | Map information system | |
US10229363B2 (en) | Probabilistic inference using weighted-integrals-and-sums-by-hashing for object tracking | |
Tanzmeister et al. | Evidential grid-based tracking and mapping | |
EP2615598B1 (en) | Vehicle with computing means for monitoring and predicting traffic participant objects | |
CN112888612A (en) | Autonomous vehicle planning | |
US11364899B2 (en) | Driving assistance method and system | |
JP2022514975A (en) | Multi-sensor data fusion method and equipment | |
Dietmayer | Predicting of machine perception for automated driving | |
JP2015081083A (en) | Confidence estimation for predictive driver assistance systems based on plausibility rules | |
US11400942B2 (en) | Vehicle lane trajectory probability prediction utilizing kalman filtering with neural network derived noise | |
JP2021504222A (en) | State estimator | |
US20230053459A1 (en) | Vehicle-based data processing method and apparatus, computer, and storage medium | |
US20230343107A1 (en) | Behavior prediction of surrounding agents | |
JP2021504218A (en) | State estimator | |
EP4060626A1 (en) | Agent trajectory prediction using context-sensitive fusion | |
Otto | Fusion of data from heterogeneous sensors with distributed fields of view and situation evaluation for advanced driver assistance systems | |
Do et al. | Lane change–intention inference and trajectory prediction of surrounding vehicles on highways | |
Kuhnt et al. | Lane-precise localization of intelligent vehicles using the surrounding object constellation | |
EP4220601A1 (en) | Method and device for locating a traffic participant, and vehicle | |
Aoudé | Threat assessment for safe navigation in environments with uncertainty in predictability | |
JP2020076726A (en) | Map information system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20240202 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |