EP2370965B1 - Traffic information unit, traffic information system, vehicle management system, vehicle and method of controlling a vehicle - Google Patents

Traffic information unit, traffic information system, vehicle management system, vehicle and method of controlling a vehicle Download PDF

Info

Publication number
EP2370965B1
EP2370965B1 EP09771424.0A EP09771424A EP2370965B1 EP 2370965 B1 EP2370965 B1 EP 2370965B1 EP 09771424 A EP09771424 A EP 09771424A EP 2370965 B1 EP2370965 B1 EP 2370965B1
Authority
EP
European Patent Office
Prior art keywords
vehicle
traffic
motion state
state information
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP09771424.0A
Other languages
German (de)
French (fr)
Other versions
EP2370965A1 (en
Inventor
Zoltan Papp
Gerardus Johannes Nicolaas Doodeman
Martin Willem Nelisse
Joris Sijs
Johannes Adrianus Cornelis Theeuwes
Bartholomeus Joannes Franciscus Driessen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nederlandse Organisatie voor Toegepast Natuurwetenschappelijk Onderzoek TNO
Original Assignee
Nederlandse Organisatie voor Toegepast Natuurwetenschappelijk Onderzoek TNO
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nederlandse Organisatie voor Toegepast Natuurwetenschappelijk Onderzoek TNO filed Critical Nederlandse Organisatie voor Toegepast Natuurwetenschappelijk Onderzoek TNO
Priority to EP09771424.0A priority Critical patent/EP2370965B1/en
Publication of EP2370965A1 publication Critical patent/EP2370965A1/en
Application granted granted Critical
Publication of EP2370965B1 publication Critical patent/EP2370965B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/164Centralised systems, e.g. external to vehicles
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/22Platooning, i.e. convoy of communicating vehicles

Definitions

  • the present invention relates to a traffic information unit.
  • the present invention further relates to a traffic information system.
  • the present invention further relates to a vehicle management system.
  • the present invention further relates to a vehicle provided with a vehicle management system.
  • the present invention further relates to a method of controlling a vehicle.
  • Cruise control systems that maintain the speed of a target vehicle at a predetermined velocity are well-known. More recently adaptive cruise control systems were developed that also adapt the speed of the target vehicle to the state (e.g. relative position and speed) of a lead vehicle, directly in front of the target vehicle. The (partial) relative motion state of the lead vehicle is for example determined by radar measurements. Still more recently cooperative cruise control systems were developed that not only take into account the state of the lead vehicle but also from the state of one or more vehicles in front of the lead vehicle. Cooperative cruise control has the potential to improve traffic safety as well as traffic flow, as the control system can better anticipate the traffic situation than an adaptive cruise control system.
  • a target vehicle provided with a cooperative cruise control system can also react to a change in state of another vehicle not directly leading the target vehicle provided with a cooperative cruise control system. This allows the target vehicle to more gradually adapt its state, e.g. its velocity. This is favorable for traffic flow and traffic safety. It is however a drawback of this system that it is dependent from input data from the motion state estimator mounted at other vehicles in the neighbourhood (the motion state estimator is typically part of the CACC installed, thus this input is available via the cooperation between CACCs (hence the name)).
  • DE19956455 discloses a method for transmitting signals into a vehicle when passing a certain locality with local detection and transmission equipment to automatically influence the speed and/or distance regulated operation of the vehicle.
  • the local detection and transmission equipment can be controlled from a central point. The method makes it possible to timely reduce the speed of vehicles that approach a traffic jam.
  • US 2007 102165 28 describes a navigation system displaying the position of other vehicles, based on information provided by a road side transmitter with a camera.
  • a traffic information unit associated with a traffic infrastructure is provided according to claim 1.
  • a vehicle management system is provided according to claim 7.
  • a vehicle with such a vehicle management system is provided.
  • the present traffic information unit and system according to the invention provide vehicle state information of individual vehicles present at the vehicle infrastructure. This makes it possible for the vehicle management system of the target vehicle not only to react to global traffic disruptions, but also to events that could potentially result in a traffic disruption such as a sudden braking of vehicles in front of the target vehicle, including such vehicles that are out of sight of the driver of the target vehicle. This improves the safety of the target vehicle and also vehicles following the target vehicle. Additionally an efficient managing of other traffic phenomena is made possible, such as a shockwave damping on highways.
  • the instantaneous position of the surrounding vehicle provides the vehicle management system of the target vehicle sufficient information to derive also other motion state information of those surrounding vehicles such as velocity, orientation, and acceleration. Alternatively this other motion state information may also be provided by the traffic information unit and system in addition to the instantaneous position.
  • the traffic control system comprises a traffic information system that builds and maintains a real-time database of all vehicles currently using a traffic infrastructure. This enables a vehicle provided with a vehicle control system to receive status information of vehicles in its environment. In an embodiment said status information is only provided upon request. This allows for a power reduction as the transmitters do not have to be active when no such requests are received. Alternatively the transmitters may be active permanently and transmit this information unconditionally on a unidirectional basis. This is favorable if a large number of vehicles instrumented with a vehicle management system is present.
  • the traffic information unit may have a first mode wherein vehicle status information is only transmitted upon request, e.g. when a low traffic density is detected and a second mode wherein the vehicle status information is permanently transmitted, e.g. during rush hours.
  • the traffic information system may broadcasts vehicle state information for the part of the infrastructure observed by the traffic information system. If desired the information may be restricted to information related to vehicles within a predetermined radius of a transmitter.
  • Information to be transmitted may include not only vehicle state information relating to the lead vehicle (i.e. the vehicle directly in front of the target vehicle), but also vehicle state information relating to other vehicles in front of the lead vehicle that could not be observed by an on-board radar system. Also vehicle state information relating to vehicles behind the target vehicle may be included in the query set.
  • the traffic control system can provide status information, not only of the lead vehicle, but also of other vehicles in front of the target vehicle, the vehicle control system can better anticipate for events occurring at the road in front of the target vehicle, allowing for a smoother and safer control. It is not necessary that a large fraction of vehicle at the traffic infrastructure is provided with a vehicle control system according to the invention.
  • each instrumented vehicle will operate reliably using the information transmitted by the traffic information system.
  • Each of these instrumented vehicles can use the full vehicle map provided by the traffic information system according to the present invention and therewith reliable adapt its own motion to the motion of preceding and possibly succeeding vehicles. If only a relatively modest fraction of the vehicles present at the road is provided with the inventive vehicle control system, these vehicles will already act as a buffer for smoothing traffic flow.
  • the smoother traffic flow allows for a reduction in fuel consumption and air pollution. This would not be the case if the same number of vehicles were provided with a cooperative cruise control system, as the functioning of the cooperative cruise control system relies on the presence of other vehicles having the same cooperative cruise control system.
  • the necessary traffic data is provided by the traffic information system coupled to the traffic infrastructure, it becomes more attractive for owners of vehicles not provided with a vehicle management system according to the invention to achieve such a vehicle management system.
  • the traffic information system provides the vehicles instrumented with a vehicle control system with state information in its environment, and therewith allows the vehicle control system to anticipate for events ahead of the target vehicle, the vehicle control system can maintain short distances to its predecessor.
  • Incident management is a further example.
  • the traffic management system can provide information to a target vehicle about incidents ahead of the target vehicle and enforce safety measures.
  • the safety measures may include a gradual braking of the target vehicle, a deviation of the target vehicle to an alternative route, a warning to the driver of the vehicle and/or a warning to other drivers by light signals.
  • the sensor system comprises a plurality of sensor nodes that each provides a message indicative for an occupancy status of a detection area of a traffic infrastructure monitored by said sensor node.
  • the traffic information system further comprises at least one message interpreter that includes:
  • vehicles can be tracked with relatively simple and cheap means. It is sufficient that the sensor nodes merely provide a message that indicates whether a detection area associated with the sensor node is occupied by a vehicle or not. This makes it economically feasible to apply the traffic information unit to large traffic infrastructures.
  • Suitable sensor elements for use in a sensor node are for example magnetic loop sensors, magneto restrictive sensors. These sensor elements determine whether their associated detection area is occupied by detection of a perturbation of the earth magnetic field.
  • each sensor node is provided with a wireless transmission facility that transmits the sensed data to a receiver facility coupled to the association facility.
  • a wireless transmission facility that transmits the sensed data to a receiver facility coupled to the association facility.
  • a sensor node may have a set of sensor elements that are clustered in a sensor module.
  • a sensor module is for example a camera that monitors a part of the traffic infrastructure, wherein each photosensitive element of the camera serves as a sensor element of the vehicle tracking system.
  • a camera may be used for example if a perturbation of the earth magnetic field can not be measured. This is the case for example if (parts of) the infra structure comprises metal components e.g. a bridge.
  • the detection areas of the sensor elements are complementary.
  • the detection areas may overlap, or spaces may exist between the detection areas. It is sufficient that the detection areas have a scale that is smaller than the vehicle to be tracked, e.g. a size of at most 1 m 2 and a maximum diameter of not more than 1 m.
  • the sensor elements are randomly distributed over the traffic infrastructure. As compared to an arrangement wherein the sensor elements are regularly distributed with the same average number of sensor elements per unit of area, a more accurate estimation of the state of the vehicles can be obtained.
  • Independent traffic information units are particularly suitable for providing vehicle state information for relatively small traffic infrastructures.
  • a traffic information system is provided that comprises at least a first and a second traffic information unit according to the present invention.
  • the first and the second traffic information unit are associated with mutually neighbouring sections of the traffic infrastructure and are arranged to mutually exchange state information.
  • a traffic information system is provided that can be easily expanded with one or more additional traffic information units if required.
  • a new traffic information unit needs only to communicate with the traffic information units arranged for neighbouring sections. For example if a certain road is already provided with a traffic information system, it is sufficient to provide for a communication facility between the information unit for the last section of said traffic information system and the new traffic information unit for the appended section.
  • the traffic information units merely exchange state information and not the unprocessed messages from the sensor nodes the amount of communication between the traffic information units is modest.
  • An embodiment of a vehicle management system further comprises communication means for exchanging vehicle state information with surrounding vehicles and a selection facility for selecting one or more of vehicle state information obtained from the surrounding vehicles and information received from the traffic information system as the vehicle state information to be used by the control system.
  • the selection made by the selection facility may for example depend on the availability of reliable information. For example in an area where the traffic infrastructure is provided with a traffic information system, the selection facility may automatically select the traffic information system as the source of state information. In an area where no traffic information system is present, it may select the information provided by surrounding vehicles. Alternatively the selection may be more fine grained. It may select for example to receive velocity information from the surrounding vehicles themselves if such information is available and to receive the remaining information from the traffic information system.
  • a method is provided of controlling a vehicle according to claim 10.
  • Figure 1 and 2 schematically show a traffic information system comprising a plurality of traffic information units.
  • Figure 1 schematically shows how in an example embodiment various components of the system are arranged.
  • Figure 2 shows a functional relationship between various units of the system.
  • the traffic information units comprise a sensor system with a plurality of sensors (indicated as black dots) for sensing vehicles (indicated by open hexagons) arranged in the vicinity of a traffic infrastructure 80 for carrying vehicles.
  • the sensors are provided with communication means to transmit sensed information to a facility MI for identifying and tracking states of individual vehicles using information communicated by the sensors.
  • the sensors are only capable of transmitting information towards the facilities MI, in another embodiment, they may also be capable of bidirectional communication.
  • sensors can form a network, that can guide the information in an indirect way to the facilities MI.
  • each of the facilities MI is responsible for monitoring a particular section 80A, 80B, 80C, 80D of the infrastructure 80.
  • Figure 1 and 2 only four facilities MI are shown for clarity.
  • FIG 3 is another schematic view of the traffic information system.
  • Figure 3 shows how sensor nodes 10 transmit (detection) messages D to a message interpreter MI in their neighbourhood.
  • the message interpreters MI may also communicate to each other via a communication channel 60 to indicate that a vehicle crosses a boundary between their respective sections and to exchange a status of such a vehicle.
  • the traffic information system comprises a plurality of traffic information units MD1, MD2, MD3.
  • Each traffic information unit MD1, MD2, MD3 comprises a respective subset of the plurality of sensor nodes 10 for monitoring a respective section of the traffic infrastructure and a respective respective message interpreter MI.
  • the traffic information system further has a communication facility 60 for enabling traffic information units MD1, MD2, MD3 of mutually neighboring sections to exchange state information.
  • the traffic information system further comprises client information modules CIM for providing status information related to the infrastructure 80.
  • the status comprises for example statistical information, such as an occupation density and an average speed as a function of a position at the traffic infrastructure 80.
  • the facilities MI and the client information modules CIM are coupled to each other via a communication backbone. This allows the client information modules CIM to request said information for arbitrary regions (indicated by dashed boxes) of the infrastructure 80 that may extend beyond the boundaries for individual facilities MI.
  • Figure 4 schematically shows a part of the traffic infrastructure that is provided with a plurality of sensor nodes j having position Cj.
  • the sensor nodes have a detection area with radius R.
  • a vehicle i is present at the infrastructure having a position (v i x , v i y ). In this case if the vehicle substantially covers the detection area, e.g. more than 50%, the sensor node sends a message D that the detection area is occupied (indicated in gray). Otherwise the sensor node sends a message that the detection area is not occupied (white).
  • the traffic information system is further provided with a facility T for transmitting state information derived by the traffic information system to a particular vehicle upon request.
  • Each transmitter T has a transmission range TR.
  • the transmission ranges of the transmitters together define a continuous area having a substantial length and over a full width of the infrastructure where state information is available.
  • a plurality of transmitters may be coupled to each traffic information unit MD1, MD2, MD3.
  • the transmitters T selectively transmit vehicle state information related to vehicles within their transmission range and optionally in a neighbourhood thereof.
  • the vehicle management system C comprises a communication system R arranged for receiving vehicle state information relating to surrounding vehicles from the traffic information system, e.g. here from the traffic information unit MD1.
  • the traffic information unit MD1 transmits the motion state of the surrounding vehicles to the target vehicle (e.g. 70B) provided with a vehicle management system C, using the wireless link between the transmitter T and the communication system R of the vehicle management system C. This information is stored in a local vehicle status data base C0.
  • the vehicle management system C further has inputs C1 for receiving state information from the target vehicle 70B.
  • the state information may include information related to a momentaneous position, e.g. obtained by GPS, speed obtained by GPS or using odometry, an acceleration derived by odometry or by an inertial sensor and a direction e.g by using a compass or a by a gyro.
  • a momentaneous position e.g. obtained by GPS, speed obtained by GPS or using odometry, an acceleration derived by odometry or by an inertial sensor and a direction e.g by using a compass or a by a gyro.
  • a control system C2 uses this information in the local vehicle status database C0 and the state information received at inputs C1 to provide control signals at output C3 for controlling a state of the target vehicle, e.g. a speed or an orientation of the target vehicle (70B).
  • the vehicle management system C also has a bidirectional link C4 for additional communication purposes.
  • This link can be used to negotiate and coordinate actions among vehicles (e.g. requesting/granting free space, joining/leaving platoon, etc.).
  • the system C further has an input C5 for receiving user control commands.
  • This allows the user to set an authorization level, i.e. control the extent to which the system C controls the vehicle, e.g. the user may allow the system only to provide warnings, may allow the system to regulate a speed, to break the vehicle up to a predetermined maximum deceleration, and to control a travelling direction. In the latter case a user may for example instruct the system to carry out certain maneuvers, e.g. a merging between a sequence of vehicles in a neighbouring lane.
  • a further input C6 is present to receive navigation information.
  • This information may be used for global control.
  • the control system C2 may control the vehicle to another lane, taking into account the state of neighbouring vehicles in local vehicle status data base C0.
  • Output C7 may provide the user information about the current authorization level, about a current activity of the system C, to show warnings, and to request for input.
  • the C7 output represents a man-machine interface and may be implemented in any form; it may use auditory, visual or sensory channels.
  • the traffic information system only provides the state information of neighbouring vehicles upon request has the advantage that power is saved during intervals that no information is requested.
  • the transmitters T may permanently transmit the information relating to the vehicles present in its neighbourhood.
  • the vehicle control system C can better anticipate for events occurring at the road in front of the target vehicle 70B. This allows for a smoother and safer control.
  • the traffic information system will also transmit the status information of vehicle 70D, indicating that this vehicle intends to change from the rightmost lane to the middle lane of the traffic infrastructure 80.
  • the traffic control system C of vehicle 70B may respond more gradually to the maneuver of vehicle 70D, than would be the case if vehicle 70B had only a simple cruise control system that merely responds to the behavior of a vehicle immediately in front.
  • vehicle control system of each vehicle will operate reliably using the information transmitted by the traffic information system. If only a relatively modest fraction of the vehicles present at the road is provided with the inventive vehicle control system, these vehicles will already act as a buffer for smoothing traffic flow. This can be illustrated by way of the following example. Presume that the vehicles 70A, ..., 70E are driving in the same lane, and that none of the vehicles 70A, ..., 70E is instrumented with a vehicle control system or is only instrumented with an adaptive cruise control system. In that case a sudden breaking of vehicle 70E would result in a shock effect that ripples through the chain of vehicles.
  • the set of vehicles for which vehicle status information is transmitted by a transmitter T in the neighbourhood of a target vehicle may include vehicles 70C,...,70E, may additionally or alternatively include vehicles 70A behind the target vehicle 70B.
  • This vehicle status information may be used by the control system C2 to of vehicle 70B to moderate a breaking power of said vehicle 70B to prevent that a collision occurs with a vehicle 70A succeeding it.
  • FIG. 6 shows a further embodiment of a vehicle management system C according to the invention. Parts therein corresponding to those in Figure 5 have the same reference.
  • the vehicle management system of Figure 6 further comprises communication means R1 for exchanging vehicle state information VS2 with surrounding vehicles.
  • the vehicle management system C shown therein further comprises a selection facility SL for selecting one or more of vehicle state information VS2 obtained from the surrounding vehicles and vehicle state information VS1 received from the traffic information system as the vehicle state information VS to be used by the control system C2.
  • the control system C2 further receives state information from the target vehicle (ST).
  • the selection made by the selection facility SL may for example depend on the availability of reliable information. For example in an area where the traffic infrastructure is provided with a traffic information system, the selection facility may automatically select the state information VS1 provided by said traffic information system as the source of state information VS. In an area where no traffic information system is present, it may select the information VS2 provided by surrounding vehicles. Alternatively the selection may be more fine grained. For example it may select for example to receive velocity information from the surrounding vehicles themselves if such information is available and to receive the remaining information from the traffic information system.
  • FIG. 7 shows an example of a sensor node 10.
  • the sensor node 10, shown in Figure 7 is an assembly of a sensor element 12, a processing unit 14 (with memory), a clock-module 18 and a radio link 16.
  • the sensor element 12 is capable of sensing the proximity of the vehicles to be tracked.
  • the processing unit 14 determines if an object (vehicle) is present or absent on the basis of the signals from the sensor element 12. If an occupancy status of the detection area of the sensor changes, the processing unit 14 initiates a transmission of a message D indicating the new occupancy status and including a time stamp indicative of the time t at which the new occupancy status occurred.
  • the message D sent should reach at least one message interpreter MI.
  • a concrete implementation of the sensor node 10 is used for road vehicle tracking: in this case the sensor element 12 is a magnetoresistive component, which measures the disturbance on the earth magnetic field induced by the vehicles. Alternatively, a magnetic rod or loop antenna may be used for this purpose.
  • FIG 8 shows a possible implementation of the hardware involved for the sensor node 10 of Figure 7 .
  • the sensor element 12 is coupled via an A/D converter 13 to a microcontroller 14 that has access to a memory 15, and that further controls a radio transmitter 16 coupled to an antenna 17.
  • Figure 9 schematically shows a method performed by a sensor node to generate a message indicative for occupancy status of a detection area of the sensor node.
  • Step S1 Starting (Step S1) from an off-state of the sensor node, input from the A/D converter is received (Step S2). In a next step S3, offset is removed from the sensed value.
  • step S4 it is determined whether the occupancy state of the detection area as reported by the last message transmitted by the sensor node was ON (selection YES) (vehicle present in the detection range) or OFF (selection NO) (no vehicle present in the detection range. This occupancy state is internally stored in the sensor node.
  • step S5 it is determined whether a signal value v obtained from the A/D converter, and indicative for an occupied status of the detection area is below a first predetermined value T L . If this is not the case program flow continues with step S2. If however the value is lower than said first predetermined value then program flow continues with step S6. In step S6 it is verified whether the signal value v remains below the first predetermined value T L for a first predetermined time period. During step S6 the retrieval of input from the A/D convertor is continued. If the signal value v returns to a value higher then said predetermined value T L before the end of said predetermined time-period then processing flow continues with step S2. Otherwise the value for the occupancy state is internally saved as unoccupied in step S7, and a message signaling this is transmitted in step S8.
  • step S9 it is determined whether the signal value v obtained from the A/D converter, and indicative for an occupied status of the detection area exceeds a second predetermined value T H .
  • the second predetermined value T H may be higher than the first predetermined value T L . If the signal value does not exceed the second predetermined value T H program flow continues with step S2. If however the value is higher than said second predetermined value T H then program flow continues with step S10.
  • step S10 it is verified whether the signal value v remains above the second predetermined value T H for a second predetermined time period, which may be equal to the first predetermined time period. During step S10 the retrieval of input from the A/D convertor is continued.
  • step S2 If the signal value v returns to a value lower then said predetermined value T H before the end of said predetermined time-period then processing flow continues with step S2. Otherwise the value for the occupancy state is internally saved as occupied in step S11, and a message signaling this is transmitted in step S12.
  • a message interpreter shown in Figure 10 , consists of a radio receiver 20, coupled to antenna 22, a processing unit 24 (with memory 28) and a network interface 65, as well as a real-time clock 26.
  • the network interface 65 couples the message interpreter MI via the communication channel 60 to other message interpreters.
  • the radio receiver 20 receives the binary "object present" signals D (with timestamp) from the sensor nodes 10 via the radio link and runs a model based state estimator algorithm to calculate the motion states of the objects individually (i.e. each real world object is represented in the message interpreter).
  • the accuracy and the uncertainty of the estimation depends on the sensor density. For accurate object tracking it is preferred to have coverage of multiple sensors per object.
  • the message interpreter MI has a vehicle database facility 32, 34 that comprises state information of vehicles present at the traffic infrastructure.
  • the message interpreter MI further has a sensor map 45 indicative for the spatial location of the sensor nodes 10.
  • the sensor nodes may transmit their location or their position could even be derived by a triangulation method.
  • the message interpreter MI further has an association facility 40 for associating the messages D provided by the sensor nodes 10 with the state information present in the vehicle data base facility 32, 34.
  • the association facility 40 may associate the messages received with state information for example with one of the methods Gating, Nearest Neighbor (NN), (Joint) Probabilistic Data Association ((J)DPA), Multiple Hypothesis Tracker (MHT) and the MCMCDA.
  • the message interpreter further has a state updating facility 50 for updating the state information on the basis of the messages D associated therewith by the association facility 40. Once the messages D are associated with a particular vehicle the state of that vehicle in a local vehicle data base is updated by the update facility 50.
  • a global map builder 65 may exchange this updated information with global map builders of neighbouring message interpreters via network interface 60 (wired or wireless), for example to exchange the motion state of crossing objects.
  • the microcontroller 24 of Figure 10 processes the received messages D.
  • the memory 28 stores the local and global vehicle map and the sensor map as well as the software for carrying out the data estimation and state estimation tasks.
  • separate memories may be present for storing each of these maps and for the software.
  • dedicated hardware may be present to perform one or more of these tasks.
  • the result of the processing i.e. the estimation of the motion states of all sensed objects
  • the result of the processing is present in the memory of the message interpreters in a distributed way.
  • Message interpreters may run additional (cooperative) algorithms to deduct higher level motion characteristics and/or estimate additional object characteristics (e.g. geometry).
  • the vehicle tracking system may comprise only a single traffic information unit.
  • the global map builder is superfluous, and local vehicle map is identical to the global vehicle map.
  • each message interpreter MI for a respective traffic information unit MD1, MD2, MD3 comprises hardware as described with reference to Figure 10 and 11 .
  • Figure 12 schematically shows a part of a traffic infrastructure 80 having sections R j-1 , R j , R j+1 .
  • a vehicle moves in a direction indicated by arrow X from R j-1 , via R j , to R j+1 .
  • Figure 13 shows an overview of a method for detecting the vehicle performed by the message interpreter for section R j , using the messages obtained from the sensor nodes.
  • step S20 the method waits for a message D from a sensor node.
  • program flow continues with step S21, where the time t associated with the message is registered.
  • the registered time t associated with the message may be a time-stamp embedded in the message or a time read from an internal clock of the message interpreter.
  • messages are indirectly transmitted to a message interpreter, e.g. by a network formed by sensor nodes it is advantageous if the embeds the time stamp in the message, so that it is guaranteed that the registered time corresponds to the observed occupancy status regardless any delays in the transmission of the message.
  • step S22 it is verified whether the detection is made by a sensor node in a location of section Rj that neighbours one of the neighbouring sections R j-1 or R j+1 . If that is the case, then in step S23 the event is communicated via the communication network interface to the message interpreter for that neighbouring section.
  • step S24 it is determined which vehicle O in the vehicle data base facility is responsible for the detected event. An embodiment of a method used to carry out step S24 is described in more detail in Figure 14 . After the responsible object O is identified in step S25, i.e. an association is made with existing object state information, it is determined in Step 26 whether it is present in the section Rj. If that is the case, control flow continues with Step S27.
  • step S28 it is determined whether the state information implies that the vehicle O has a position in a neighboring region R j-1 or R j+1 . In that case the updated state information is transmitted in step S29 to the message interpreter for the neighbouring region and control flow returns to step S20. Otherwise the control flow returns immediately to Step S20.
  • the current state known for the vehicle with that index i is retrieved from the vehicle database facility.
  • a probability is determined that the vehicle O caused the detection reported by the message D at time t.
  • the vehicle index i is incremented in step S43 and if it is determined in step S44 that i is less than the number of vehicles, the steps S41 to S43 are repeated. Otherwise in step S45 it is determined which vehicle caused the detection reported by the message D at time t with the highest probability.
  • the index of that vehicle is returned as the result if the method.
  • step S60 the messages D 1 ,...,D n associated with vehicle O are selected?
  • step S61 a probability density function is constructed on the basis of the associated messages.
  • step S62 the current state So and time to for object O are determined.
  • step S63 it is determined whether the time for which the state S of the vehicle O has to be determined is less than the time to associated with the current state So.
  • the state S determined by the estimation method is the state update of S0 to t, performed in step S65. If that is not the case, the state S determined by the estimation method is the state update of S0 to S0 in step S64. What does it mean?
  • vehicles could be provided with a transponder that signals their momentaneous position to the traffic information system.
  • A1 Estimation and association for multiple target tracking based on spatially, distributed detections
  • multiple target tracking [1-3] one aims to track all the objects/targets, which are moving in a certain area.
  • Section 2 defines background knowledge such as the notation of (object) variables and functions that are used throughout this paper. After that the problem is formulated in section 3 together with existing methods. Section 4 describes the approach which is taken in the design. A more detailed description of the estimation and associated is presented in Section 5 and 6 respectively. Finally both methods are tested in a small application example presented in Section 6 and conclusions are drawn in section 7. But let's start with the background information.
  • R defines the set of real numbers whereas the set R + defines the non-negative real numbers.
  • the set Z defines the integer values and Z + defines the set of non-negative integer numbers.
  • the variable 0 is used either as null, the null-vector or the null-matrix. Its size will become clear from the context.
  • Vector x ( t ) ⁇ R n is defined as a vector depending on time t and is sampled using some sampling method.
  • the time t at sampling instant k ⁇ Z + is defined as t k ⁇ R .
  • the matrix A ( t 2 -t 1 ) ⁇ R a ⁇ b depends on the difference between two time instants t 2 > t 1 and is shortly denotes as A t 2- t 1
  • each object also has a certain shape or geometry which covers a certain set of positions in R xy , i.e. the grey area of Figure 16 .
  • To define the vectors ⁇ i we equidistant sample the rectangular box defined by C 0 using a grid with a distance r .
  • Each ⁇ i is a grid point within the set S as graphically depicted in Figure 17 .
  • a total of E objects are observed within the set R xy .
  • T i represents the i th object's rotation-matrix dependent on ⁇ i .
  • the objects are observed in R xy by a camera or a network of sensors. For that M 'detection' points are marked within R xy and collected in the set D ⁇ R xy .
  • the position of a detection point is denoted as d ⁇ D .
  • Figure 18 shows an example of object i which is detected by multiple detection points. The covariance ⁇ of each detection point is also indicated.
  • the sampling method of the observation vectors z 0: k is a form of event sampling [2, 10, 12]. For a new observation vector is sampled whenever an event, i.e. object detection, takes place. With these event samples all N objects are to be tracked. To accomplish that three methods are needed. The first one is the association of the new observation-vector z k to an object i and therefore denote it with z k i . Suppose that all associated observation-vectors z n i are collected in the set Z k i ⁇ z 0 : k . Then the second method is to estimate m k i from the observation-set Z k i . This is used in the third method, which is a state-estimator.
  • Z k i is defined as the set with all observation-vectors from z 0: k that were associated with object i .
  • Z k i is defined as the set with all observation-vectors from z 0: k that were associated with object i .
  • the set Z k i ⁇ z 0 : k is defined as the set of all observation-vectors z n which were associated with object i , from which their detection point is still covered by the object. We will first show how this is done. At time step k we have the observation-set Z k - 1 i and the observation z k was associated to object i , i.e. z k i . Now if the object's edge is detected at d k for the first time, then z k i is added to the set Z k - 1 i .
  • orientations then at each orientation we have a set O N which has to contain the object's position o k i . From all these orientations we can calculate p m k i
  • Estimation of the measurement-vector m k i given the observation set Z k i results in calculating p m k i
  • the set Z consists of the observation vectors z n , for all n ⁇ N ⁇ [0, k ], that were associated to the same object.
  • the main aspect of equation (17) is to determine p ( o
  • O n ( ⁇ ) ⁇ R xy to be equal to all possible object positions o , given that the object is detected at position d n ⁇ z n ( ⁇ Z ) and that the object's rotation is equal to ⁇ .
  • Z , ⁇ ) and ⁇ l are related to the set O N ( ⁇ ) due to the fact that it O N ( theta ) defines the set of possible object positions o for a given ⁇ .
  • O N ( theta ) defines the set of possible object positions o for a given ⁇ .
  • Z, ⁇ ) f o
  • z n , ⁇ : ⁇ 0 if o ⁇ O N ⁇ , 1 if o ⁇ O n ⁇ , g o
  • Z , ⁇ : ⁇ n ⁇ N f o
  • z n , ⁇ ⁇ 0 if o ⁇ O N ⁇ , 1 if o ⁇ O N ⁇ ,
  • Z ) is calculated according to (13).
  • the rest of this section is divided into two parts. The first part derives the probability function based on a single detection, i.e. f ( o
  • Figure 22 (right) graphically depicts the determination of ⁇ n from the set A for a given ⁇ and detection point d n .
  • z n , ⁇ ), as defined in (15), is approximated by placing a Gaussian function at each sampled position ô i ⁇ ⁇ n with a certain covariance dependent on the grid-size r : f o
  • the aim of this section is to calculate the function g ( o
  • Equation (28) If N contains m elements, then calculating equation (28) would result in K m products of m Gaussian functions and sum them afterwards. This would take too much processing power if m is large. That is why equation (28) is calculated differently.
  • each detection point d n defines a rectangular set denoted with C n ( ⁇ ) dependent on rotation ⁇ .
  • the intersection of all these rectangular sets is defined with the set C N ( ⁇ ).
  • the first set, O n ( ⁇ ), shown in Figure 19 defines all possible object positions o based on a single detection at d n .
  • the second set, i.e. O N ( ⁇ ), shown in Figure 20 defines all possible object positions o based on all detections at d n , ⁇ n ⁇ N .
  • O n ( ⁇ ) ⁇ C n ( ⁇ )
  • Equation (6.2) is reduced to: g o
  • the calculation of (26) is done by applying the following two propositions.
  • the first one i.e. Proposition 2
  • the second one i.e. Proposition 3, proofs that a product of Gaussians results in a single Gaussian.
  • Proposition 2 The product of a summation of Gaussians can be written into a summation of a product of Gaussian:
  • Equation (29) is approximated as a single Gaussian function: g o
  • Equation (30) is substituted into equation (16) together with f ( o
  • Z ) also gives us the probability that a new observation vector is generated by an certain object i . This is discussed in the next section.
  • the total probability that a new observation vector z k is generated by object i is equal to the total probability of the measurement-vector m k i given the observation set Z k - 1 i ⁇ z k .
  • Z k - 1 i , z k which is equal to equation (31).
  • the definition of a PDF is that its total probability, i.e. its integral from to ⁇ , is equal to 1.
  • ⁇ i and K i are equal to ⁇ and K respectively, which define the approximation of the function f ( m k i
  • the probability of (42) one can design a method which associates an observation-vector due to a new detection, to its most probable object i.
  • the estimation method requires a certain amount of processing power, one can reduce this by reducing the number of samples in the set A. Meaning that association and estimation can be done with different sizes of A.
  • the objects have a rectangular shape, then with some tricks one can reduce the amount of processing power to a level at which both association as well as estimation can run real-time.
  • the simulation case is made such that it contains two interesting situation.
  • the objects are tracked using two different association methods.
  • the first one is a combination of Gating and detection association of 7.
  • the second one is a combination of Gating and Nearest Neighbor.
  • This paper presents a method for estimating the position- and rotation-vector of objects from spatially, distributed detections of that object. Each detection is generated at the event that the edge of an object crosses a detection point. From the estimation method a detection associator is also designed. This association method calculates the probability that a new detection was generated by an object i .
  • An example of a parking lot shows that the detection association method has no incorrect associated detections in the case that two vehicles cross each other both in parallel as well as orthogonal. If the association method of Nearest Neighbor was used, a large amount of incorrect associated detections were noticed, resulting in a higher state-estimation error.
  • the data-assimilation can be further improved with two adjustments.
  • the first one is replacing the set S with S E only at the time-instants that the observation vector is received.
  • the second improvement is to take the detection points that have not detected anything also in account.
  • x ⁇ p x d x ⁇ - ⁇ ⁇ ⁇ G m , ⁇ ⁇ x , M ⁇ G x ⁇ u ⁇ U d x .
  • R defines the set of real numbers whereas the set R + defines the non-negative real numbers.
  • the set Z defines the integer numbers and Z + defines the set of non-negative integer numbers.
  • the notation 0 is used to denote either the null-vector or the null-matrix. Its size will become clear from the context.
  • a vector x ( t ) ⁇ R n is defined to depend on time t ⁇ R and is sampled using some sampling method. Two different sampling methods are discussed. The first one is time sampling in which samples are generated whenever time t equals some predefined value. This is either synchronous in time or asynchronous. In the synchronous case the time between two samples is constant and defined as t s ⁇ R + .
  • the second sampling method is event sampling, in which samples are taken when an event occurred.
  • the i th and maximum eigenvalue of a square matrix A are denoted as ⁇ i ( A ) and ⁇ max ( A ) respectively.
  • a ⁇ R n ⁇ n and B ⁇ R n ⁇ n are positive definite, denoted with A ⁇ 0 and B ⁇ 0, then A ⁇ B denotes A - B ⁇ 0.
  • a ⁇ 0 denotes A is positive semi-definite.
  • PDF probability density function
  • the exact description of the set H k e ( z k e -1, t) depends on the actual sampling method.
  • H k e ( z k e -1 , t ) is derived for the method "Send-on-Delta", with y ( t ) ⁇ R.
  • the event instant k e occurs whenever
  • exceeds a predefined level Z, see Figure 28 , which results in H k e ( z k e -1, t ) ⁇ y ⁇ e RI - ⁇ y - y k e - 1 ⁇ .
  • H k e ( z k e -1 , t should contain the set of all possible values that y ( t ) can take in between the event instants k e -1 and k e . Meaning that if t k e -1 ⁇ t ⁇ t k e , then y ( t ) ⁇ H k e ( z k e -1 , t ) .
  • a sufficient condition is that y k e -1 ⁇ H k e ( z k e -1 , t which for "Send-on-Delta" results in y ( t ) ⁇ [ y k e -1 - ⁇ , y e -1 + ⁇ ] for all t k e -1 ⁇ t ⁇ t k e .
  • the state vector x ( t ) of this system is to be estimated from the observation vectors z 0 e : k e .
  • the estimator calculates the PDF of the state-vector x n given all the observations until t n . This results in a hybrid state-estimator, for at time t n an event can either occur or not, which further implies that measurement data is received or not, respectively. In both cases the estimated state must be updated (not predicted) with all information until t n .
  • n define the shape of this Gaussian function. Together with x n
  • the problem of interest in this paper is to construct a state-estimator suitable for the general event sampling method introduced in Section 4 and which is computationally tractable. Furthermore, it is desirable to guarantee that P n
  • Existing state estimators can be divided into two categories.
  • the first one contains estimators based on time sampling: the (a)synchronous Kalman filter [12, 13] (linear process, Gaussian PDF), the Particle filter [14] and the Gaussian sum filter [4, 5] (nonlinear process, non-Gaussian PDF). These estimators cannot be directly employed in event based sampling as if no new observation vector z k e is received, then t n -t k e ⁇ and ⁇ i ( p n
  • the second category contains estimators based on event sampling. In fact, to the best of our knowledge, only the method proposed in [15] fits this category.
  • Proposition 1 [12, 14] Let there exist two Gaussians of random vectors x ⁇ R" and m ⁇ R q , with ⁇ R q ⁇ n : G ( m, ⁇ x,M ) and G ( x, u, U ) .
  • Equation (33) is explicitly solved by applying Proposition 1: p ⁇ x n
  • n - 1 + C T ⁇ R n i - 1 ⁇ y n i , P n i : P n
  • n - 1 - 1 + C T ⁇ R n i - 1 ⁇ C - 1 and ⁇ n i : G ⁇ y n i , Cx n
  • the third step is to approximate (27) as a single Gaussian to retrieve a computationally tractable algorithm. For if both p ( x n -1
  • y 0: n ⁇ Y 0: n ) of (27) is approximated as a single Gaussian with an equal expectation and covariance matrix, i.e.: p x n
  • n : ⁇ i 1 N ⁇ n i ⁇ ⁇ n i ⁇ P n i + x n
  • the first two estimators are the EBSE and the asynchronous Kalman filter (AKF) of [13].
  • the AKF estimates the states only at the event instants t k e - The states at t k a are calculated by applying the prediction. step of (14b).
  • the third estimator is based on the quantized Kalman filter (QKF) introduced in [21] that uses synchronous time sampling of y k a .
  • the QKF can deal with quantized data, which also results in less data transfer, and therefore can be considered as an alternative to EBSE.
  • y k a is the quantized version of y k a with quantization level 0.1, which corresponds to the "Send-on-Delta" method. Hence, a comparison can be made.
  • ⁇ ⁇ R + x i - x i
  • the last aspect on which the three estimators are compared is the total amount of processing time which was needed to estimate all state-vectors.
  • both x k e and x k a were estimated and it took 0.094 seconds.
  • 1 2 N 1, in (39) we have that P 1
  • V 1 : A ⁇ 1 P 0 ⁇ A ⁇ 1 T + B ⁇ 1 ⁇ Q ⁇ B ⁇ 1 T
  • V 2 : A t s P 0 ⁇ A t s T + B t s ⁇ Q ⁇ B t s T
  • 1 1 and U 2 : P 1
  • 1 2 , N 1, yields P 1
  • the second and last step of induction is to show that if P n - 1
  • V 1 : A ⁇ n P n - 1
  • V 2 : A t s P n - 1
  • the second condition of Lemma 6.4, i.e. V 1 o V 2 also holds by applying Lemma 6.4, i.e.
  • N 1, which yields (see e.g., [20]) ⁇ max P ⁇ 1 ⁇ ⁇ ⁇ max P ⁇ 2 .
  • P n P ⁇ K
  • P ⁇ K P ⁇ K

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Description

    BACKGROUND OF THE INVENTION Field of the invention
  • The present invention relates to a traffic information unit.
  • The present invention further relates to a traffic information system.
  • The present invention further relates to a vehicle management system.
  • The present invention further relates to a vehicle provided with a vehicle management system.
  • The present invention further relates to a method of controlling a vehicle.
  • Related Art
  • Cruise control systems that maintain the speed of a target vehicle at a predetermined velocity are well-known. More recently adaptive cruise control systems were developed that also adapt the speed of the target vehicle to the state (e.g. relative position and speed) of a lead vehicle, directly in front of the target vehicle. The (partial) relative motion state of the lead vehicle is for example determined by radar measurements. Still more recently cooperative cruise control systems were developed that not only take into account the state of the lead vehicle but also from the state of one or more vehicles in front of the lead vehicle. Cooperative cruise control has the potential to improve traffic safety as well as traffic flow, as the control system can better anticipate the traffic situation than an adaptive cruise control system. In case of traffic of vehicles only provided with adaptive cruise control a sudden breaking of one of the vehicles tends to cause a shock-wave, as each vehicle only changes its state in response to the change of state of its immediate predecessor. Contrary thereto, a target vehicle provided with a cooperative cruise control system can also react to a change in state of another vehicle not directly leading the target vehicle provided with a cooperative cruise control system. This allows the target vehicle to more gradually adapt its state, e.g. its velocity. This is favorable for traffic flow and traffic safety. It is however a drawback of this system that it is dependent from input data from the motion state estimator mounted at other vehicles in the neighbourhood (the motion state estimator is typically part of the CACC installed, thus this input is available via the cooperation between CACCs (hence the name)). Although the implementation of a cooperative cruise control system potentially allows for an improved traffic safety and traffic flow, such a control system is unreliable unless a relatively high fraction of the vehicles is provided with such a control system. Accordingly there is a need to provide a more reliable solution for improving traffic safety and traffic flow.
  • DE19956455 discloses a method for transmitting signals into a vehicle when passing a certain locality with local detection and transmission equipment to automatically influence the speed and/or distance regulated operation of the vehicle. The local detection and transmission equipment can be controlled from a central point. The method makes it possible to timely reduce the speed of vehicles that approach a traffic jam.
  • US 2007 102165 28 describes a navigation system displaying the position of other vehicles, based on information provided by a road side transmitter with a camera.
  • SUMMARY OF THE INVENTION
  • According to an aspect of the invention a traffic information unit associated with a traffic infrastructure is provided according to claim 1.
  • According to a further aspect of the invention a vehicle management system is provided according to claim 7.
  • According to a further aspect of the invention a vehicle with such a vehicle management system is provided.
    Contrary to what is described in DE19956455 the present traffic information unit and system according to the invention provide vehicle state information of individual vehicles present at the vehicle infrastructure. This makes it possible for the vehicle management system of the target vehicle not only to react to global traffic disruptions, but also to events that could potentially result in a traffic disruption such as a sudden braking of vehicles in front of the target vehicle, including such vehicles that are out of sight of the driver of the target vehicle. This improves the safety of the target vehicle and also vehicles following the target vehicle.
    Additionally an efficient managing of other traffic phenomena is made possible, such as a shockwave damping on highways. In this way oscillating speed patterns in high density highway traffic (one of the sources of typical highway accidents) can be prevented or efficiently dissolved. The instantaneous position of the surrounding vehicle provides the vehicle management system of the target vehicle sufficient information to derive also other motion state information of those surrounding vehicles such as velocity, orientation, and acceleration. Alternatively this other motion state information may also be provided by the traffic information unit and system in addition to the instantaneous position.
  • The traffic control system according to the present invention comprises a traffic information system that builds and maintains a real-time database of all vehicles currently using a traffic infrastructure. This enables a vehicle provided with a vehicle control system to receive status information of vehicles in its environment. In an embodiment said status information is only provided upon request. This allows for a power reduction as the transmitters do not have to be active when no such requests are received. Alternatively the transmitters may be active permanently and transmit this information unconditionally on a unidirectional basis. This is favorable if a large number of vehicles instrumented with a vehicle management system is present. In an embodiment the traffic information unit may have a first mode wherein vehicle status information is only transmitted upon request, e.g. when a low traffic density is detected and a second mode wherein the vehicle status information is permanently transmitted, e.g. during rush hours.
  • Basically the traffic information system may broadcasts vehicle state information for the part of the infrastructure observed by the traffic information system. If desired the information may be restricted to information related to vehicles within a predetermined radius of a transmitter.
  • Information to be transmitted may include not only vehicle state information relating to the lead vehicle (i.e. the vehicle directly in front of the target vehicle), but also vehicle state information relating to other vehicles in front of the lead vehicle that could not be observed by an on-board radar system. Also vehicle state information relating to vehicles behind the target vehicle may be included in the query set. As the traffic control system can provide status information, not only of the lead vehicle, but also of other vehicles in front of the target vehicle, the vehicle control system can better anticipate for events occurring at the road in front of the target vehicle, allowing for a smoother and safer control. It is not necessary that a large fraction of vehicle at the traffic infrastructure is provided with a vehicle control system according to the invention. The vehicle control system of each instrumented vehicle will operate reliably using the information transmitted by the traffic information system. Each of these instrumented vehicles can use the full vehicle map provided by the traffic information system according to the present invention and therewith reliable adapt its own motion to the motion of preceding and possibly succeeding vehicles. If only a relatively modest fraction of the vehicles present at the road is provided with the inventive vehicle control system, these vehicles will already act as a buffer for smoothing traffic flow. The smoother traffic flow allows for a reduction in fuel consumption and air pollution. This would not be the case if the same number of vehicles were provided with a cooperative cruise control system, as the functioning of the cooperative cruise control system relies on the presence of other vehicles having the same cooperative cruise control system. Moreover as it is guaranteed that the necessary traffic data is provided by the traffic information system coupled to the traffic infrastructure, it becomes more attractive for owners of vehicles not provided with a vehicle management system according to the invention to achieve such a vehicle management system.
  • Other applications of the present invention are possible. One of them is formation driving. Because the traffic information system provides the vehicles instrumented with a vehicle control system with state information in its environment, and therewith allows the vehicle control system to anticipate for events ahead of the target vehicle, the vehicle control system can maintain short distances to its predecessor.
  • Incident management is a further example. The traffic management system can provide information to a target vehicle about incidents ahead of the target vehicle and enforce safety measures. The safety measures may include a gradual braking of the target vehicle, a deviation of the target vehicle to an alternative route, a warning to the driver of the vehicle and/or a warning to other drivers by light signals.
  • In an embodiment of the traffic information unit the sensor system comprises a plurality of sensor nodes that each provides a message indicative for an occupancy status of a detection area of a traffic infrastructure monitored by said sensor node. The traffic information system further comprises at least one message interpreter that includes:
    • a vehicle database facility comprising motion state information of vehicles present at the traffic infrastructure, the state information of the vehicles including at least the vehicle position,
    • an association facility for associating the messages provided by the sensor nodes with the state information present in the vehicle data base facility,
    • a state updating facility for updating the state information on the basis of the messages associated therewith.
  • In the traffic information unit according to this embodiment vehicles can be tracked with relatively simple and cheap means. It is sufficient that the sensor nodes merely provide a message that indicates whether a detection area associated with the sensor node is occupied by a vehicle or not. This makes it economically feasible to apply the traffic information unit to large traffic infrastructures.
  • Suitable sensor elements for use in a sensor node are for example magnetic loop sensors, magneto restrictive sensors. These sensor elements determine whether their associated detection area is occupied by detection of a perturbation of the earth magnetic field.
  • Preferably each sensor node is provided with a wireless transmission facility that transmits the sensed data to a receiver facility coupled to the association facility. This facilitates installation of the sensor nodes. Furthermore it is attractive if the sensor nodes provide their message at an event basis, e.g. if a perturbation of the earth magnetic message interpreter and minimizes power consumption of the sensor nodes.
  • In an embodiment a sensor node may have a set of sensor elements that are clustered in a sensor module. Such a sensor module is for example a camera that monitors a part of the traffic infrastructure, wherein each photosensitive element of the camera serves as a sensor element of the vehicle tracking system. A camera may be used for example if a perturbation of the earth magnetic field can not be measured. This is the case for example if (parts of) the infra structure comprises metal components e.g. a bridge.
  • It is not necessary that the detection areas of the sensor elements are complementary. The detection areas may overlap, or spaces may exist between the detection areas. It is sufficient that the detection areas have a scale that is smaller than the vehicle to be tracked, e.g. a size of at most 1 m2 and a maximum diameter of not more than 1 m.
  • Surprisingly it has been found that it is advantageous if the sensor elements are randomly distributed over the traffic infrastructure. As compared to an arrangement wherein the sensor elements are regularly distributed with the same average number of sensor elements per unit of area, a more accurate estimation of the state of the vehicles can be obtained.
  • Independent traffic information units are particularly suitable for providing vehicle state information for relatively small traffic infrastructures. Particularly for larger traffic infrastructures a traffic information system is provided that comprises at least a first and a second traffic information unit according to the present invention. The first and the second traffic information unit are associated with mutually neighbouring sections of the traffic infrastructure and are arranged to mutually exchange state information.
  • In this way a traffic information system is provided that can be easily expanded with one or more additional traffic information units if required. A new traffic information unit needs only to communicate with the traffic information units arranged for neighbouring sections. For example if a certain road is already provided with a traffic information system, it is sufficient to provide for a communication facility between the information unit for the last section of said traffic information system and the new traffic information unit for the appended section. As the traffic information units, merely exchange state information and not the unprocessed messages from the sensor nodes the amount of communication between the traffic information units is modest.
  • An embodiment of a vehicle management system further comprises communication means for exchanging vehicle state information with surrounding vehicles and a selection facility for selecting one or more of vehicle state information obtained from the surrounding vehicles and information received from the traffic information system as the vehicle state information to be used by the control system.
  • The selection made by the selection facility may for example depend on the availability of reliable information. For example in an area where the traffic infrastructure is provided with a traffic information system, the selection facility may automatically select the traffic information system as the source of state information. In an area where no traffic information system is present, it may select the information provided by surrounding vehicles. Alternatively the selection may be more fine grained. It may select for example to receive velocity information from the surrounding vehicles themselves if such information is available and to receive the remaining information from the traffic information system.
  • According to a further aspect of the invention, a method is provided of controlling a vehicle according to claim 10.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • These and other aspects are described in more detail with reference to the drawings. Therein:
    • Figure 1 schematically shows a spatial arrangement for various components of a traffic information system according to the invention,
    • Figure 2 shows a functional relationship between various units of the system of Figure 1,
    • Figure 3 shows another schematic view of the traffic information system,
    • Figure 4 schematically shows a part of the traffic infrastructure provided with a plurality of sensor elements,
    • Figure 5 schematically shows an overview of interactions between a traffic information system for a traffic infrastructure and a vehicle management system of vehicles using the traffic infrastructure,
    • Figure 6 shows an embodiment of a vehicle management system according to the invention,
    • Figure 7 shows an example of an embodiment of a sensor node in a traffic information system according to the invention,
    • Figure 8 shows a possible hardware implementation of the sensor node of Figure 7,
    • Figure 9 schematically shows a method performed by the sensor node of Figures 7 and 8,
    • Figure 10 shows a message interpreter in a traffic information system according to the invention,
    • Figure 11 shows a possible hardware implementation of the message interpreter of Figure 10,
    • Figure 12 schematically shows a part of a traffic infrastructure,
    • Figure 13 shows an overview of a method performed by the message interpreter,
    • Figure 14 shows a first aspect of the method in more detail,
    • Figure 15 shows a second aspect of the method in more detail.
    • Figure 16 shows an example of an object to be detected at a reference position and orientation and at a different position and orientation,
    • Figure 17 shows a definition of a set S and the equidistant sampled set A,
    • Figure 18 shows detection of an object at multiple detection points,
    • Figure 19 shows a definition of the set On of possible positions oi k for a single detection point,
    • Figure 20 shows a definition of the set ON of possible positions Oi k for multiple detection points,
    • Figure 21 shows a derivation of ON(q) given 2 detections and 2 different samples of q,
    • Figure 22 shows (Left) determination of -A, (right) the object's possible position set On given dn and q,
    • Figure 23 shows (left) the mean of all Gaussians from f(o| z1, θ) and f(o| z2, θ); (right) The selection of means of the Gaussians from f(o| z1, θ) and f(o |z2, θ), of which their mean Ôni is close or in CN(θ ),
    • Figure 24 shows an association result with event-based data-association,
    • Figure 25 shows an association result with Nearest Neighbor data-association,
    • Figure 26 shows time sampling of a signal y(t),
    • Figure 27 shows event sampling of a signal y(t),
    • Figure 28 shows event sampling: Send-on-Delta,
    • Figure 29 shows the Gaussian function,
    • Figure 30 shows a top view of the Gaussian function,
    • Figure 31 shows an approximation of Λ Hke (yn ) as a sum of Gaussian functions,
    • Figure 32 shows position, speed and acceleration of a simulated object,
    • Figure 33 shows a position estimation error for various methods,
    • Figure 34 shows a speed estimation speed for various methods,
    • Figure 35 shows a factor of increase in estimation error after zke , or y ka .
    DETAILED DESCRIPTION OF EMBODIMENTS
  • Figure 1 and 2 schematically show a traffic information system comprising a plurality of traffic information units. Therein Figure 1 schematically shows how in an example embodiment various components of the system are arranged. Figure 2 shows a functional relationship between various units of the system.
  • As shown in Figure 1, the traffic information units comprise a sensor system with a plurality of sensors (indicated as black dots) for sensing vehicles (indicated by open hexagons) arranged in the vicinity of a traffic infrastructure 80 for carrying vehicles. The sensors are provided with communication means to transmit sensed information to a facility MI for identifying and tracking states of individual vehicles using information communicated by the sensors. Although in this embodiment the sensors are only capable of transmitting information towards the facilities MI, in another embodiment, they may also be capable of bidirectional communication. In that embodiment sensors can form a network, that can guide the information in an indirect way to the facilities MI. In this embodiment each of the facilities MI is responsible for monitoring a particular section 80A, 80B, 80C, 80D of the infrastructure 80. In Figure 1 and 2 only four facilities MI are shown for clarity.
  • Figure 3 is another schematic view of the traffic information system. Figure 3 shows how sensor nodes 10 transmit (detection) messages D to a message interpreter MI in their neighbourhood. The message interpreters MI may also communicate to each other via a communication channel 60 to indicate that a vehicle crosses a boundary between their respective sections and to exchange a status of such a vehicle. As shown in Figure 3, the traffic information system comprises a plurality of traffic information units MD1, MD2, MD3. Each traffic information unit MD1, MD2, MD3 comprises a respective subset of the plurality of sensor nodes 10 for monitoring a respective section of the traffic infrastructure and a respective respective message interpreter MI. The traffic information system further has a communication facility 60 for enabling traffic information units MD1, MD2, MD3 of mutually neighboring sections to exchange state information.
  • The traffic information system further comprises client information modules CIM for providing status information related to the infrastructure 80. The status comprises for example statistical information, such as an occupation density and an average speed as a function of a position at the traffic infrastructure 80. The facilities MI and the client information modules CIM are coupled to each other via a communication backbone. This allows the client information modules CIM to request said information for arbitrary regions (indicated by dashed boxes) of the infrastructure 80 that may extend beyond the boundaries for individual facilities MI.
  • Figure 4 schematically shows a part of the traffic infrastructure that is provided with a plurality of sensor nodes j having position Cj. The sensor nodes have a detection area with radius R. A vehicle i is present at the infrastructure having a position (vi x, vi y). In this case if the vehicle substantially covers the detection area, e.g. more than 50%, the sensor node sends a message D that the detection area is occupied (indicated in gray). Otherwise the sensor node sends a message that the detection area is not occupied (white).
  • As shown in Figures 3 and 5, the traffic information system is further provided with a facility T for transmitting state information derived by the traffic information system to a particular vehicle upon request. Each transmitter T has a transmission range TR. Preferably the transmission ranges of the transmitters together define a continuous area having a substantial length and over a full width of the infrastructure where state information is available. A plurality of transmitters may be coupled to each traffic information unit MD1, MD2, MD3. Preferably the transmitters T selectively transmit vehicle state information related to vehicles within their transmission range and optionally in a neighbourhood thereof.
  • As shown in Figure 5 some 70B, 70E of the vehicles 70A,...,70E present at the traffic infrastructure 80 are provided with a vehicle management system C. The vehicle management system C comprises a communication system R arranged for receiving vehicle state information relating to surrounding vehicles from the traffic information system, e.g. here from the traffic information unit MD1. The traffic information unit MD1 transmits the motion state of the surrounding vehicles to the target vehicle (e.g. 70B) provided with a vehicle management system C, using the wireless link between the transmitter T and the communication system R of the vehicle management system C. This information is stored in a local vehicle status data base C0. The vehicle management system C further has inputs C1 for receiving state information from the target vehicle 70B. The state information may include information related to a momentaneous position, e.g. obtained by GPS, speed obtained by GPS or using odometry, an acceleration derived by odometry or by an inertial sensor and a direction e.g by using a compass or a by a gyro.
  • A control system C2 uses this information in the local vehicle status database C0 and the state information received at inputs C1 to provide control signals at output C3 for controlling a state of the target vehicle, e.g. a speed or an orientation of the target vehicle (70B).
  • In the embodiment shown, the vehicle management system C also has a bidirectional link C4 for additional communication purposes. This link can be used to negotiate and coordinate actions among vehicles (e.g. requesting/granting free space, joining/leaving platoon, etc.). The system C further has an input C5 for receiving user control commands. This allows the user to set an authorization level, i.e. control the extent to which the system C controls the vehicle, e.g. the user may allow the system only to provide warnings, may allow the system to regulate a speed, to break the vehicle up to a predetermined maximum deceleration, and to control a travelling direction. In the latter case a user may for example instruct the system to carry out certain maneuvers, e.g. a merging between a sequence of vehicles in a neighbouring lane.
  • In the embodiment shown a further input C6 is present to receive navigation information. This information may be used for global control. For example dependent on a particular route to follow as indicated by the navigation information, the control system C2 may control the vehicle to another lane, taking into account the state of neighbouring vehicles in local vehicle status data base C0.
  • Output C7 may provide the user information about the current authorization level, about a current activity of the system C, to show warnings, and to request for input. The C7 output represents a man-machine interface and may be implemented in any form; it may use auditory, visual or sensory channels.
  • An embodiment, wherein the traffic information system only provides the state information of neighbouring vehicles upon request has the advantage that power is saved during intervals that no information is requested. Alternatively however, the transmitters T may permanently transmit the information relating to the vehicles present in its neighbourhood.
  • As the traffic information system can provide status information to an instrumented vehicle, e.g. 70B, not only of the lead vehicle 70C, but also of other vehicles 70D, ..., 70E in front of the target vehicle 70B, the vehicle control system C can better anticipate for events occurring at the road in front of the target vehicle 70B. This allows for a smoother and safer control. For example the traffic information system will also transmit the status information of vehicle 70D, indicating that this vehicle intends to change from the rightmost lane to the middle lane of the traffic infrastructure 80. Using this information, the traffic control system C of vehicle 70B may respond more gradually to the maneuver of vehicle 70D, than would be the case if vehicle 70B had only a simple cruise control system that merely responds to the behavior of a vehicle immediately in front. It is not necessary that a large fraction of the vehicle present at the traffic infrastructure is provided with a vehicle control system according to the invention. The vehicle control system of each vehicle will operate reliably using the information transmitted by the traffic information system. If only a relatively modest fraction of the vehicles present at the road is provided with the inventive vehicle control system, these vehicles will already act as a buffer for smoothing traffic flow. This can be illustrated by way of the following example. Presume that the vehicles 70A, ..., 70E are driving in the same lane, and that none of the vehicles 70A, ..., 70E is instrumented with a vehicle control system or is only instrumented with an adaptive cruise control system. In that case a sudden breaking of vehicle 70E would result in a shock effect that ripples through the chain of vehicles. However, even if only a part of the vehicles is instrumented with a vehicle management system according to the present invention say 70B, the situation is different. In that case, substantially at the moment that vehicle 70E breaks, this change in vehicle status information 70E is detected by the traffic information system and communicated to the vehicle 70B instrumented with vehicle management system according to the present invention. This allows vehicle 70B to anticipate for the shockwave that ripples through the sequence of vehicles 70C, 70D, 70E preceding it. Therewith the control system C2 of vehicle 70B can initiate a smooth breaking procedure starting substantially at the moment of the sudden breaking of vehicle 70E. This not only has positive consequences for the vehicle 70B itself, but also for the vehicles 70A behind it.
  • The set of vehicles for which vehicle status information is transmitted by a transmitter T in the neighbourhood of a target vehicle, e.g. 70B may include vehicles 70C,...,70E, may additionally or alternatively include vehicles 70A behind the target vehicle 70B. This vehicle status information may be used by the control system C2 to of vehicle 70B to moderate a breaking power of said vehicle 70B to prevent that a collision occurs with a vehicle 70A succeeding it.
  • Figure 6 shows a further embodiment of a vehicle management system C according to the invention. Parts therein corresponding to those in Figure 5 have the same reference. The vehicle management system of Figure 6 further comprises communication means R1 for exchanging vehicle state information VS2 with surrounding vehicles. The vehicle management system C shown therein further comprises a selection facility SL for selecting one or more of vehicle state information VS2 obtained from the surrounding vehicles and vehicle state information VS1 received from the traffic information system as the vehicle state information VS to be used by the control system C2. The control system C2 further receives state information from the target vehicle (ST).
  • The selection made by the selection facility SL may for example depend on the availability of reliable information. For example in an area where the traffic infrastructure is provided with a traffic information system, the selection facility may automatically select the state information VS1 provided by said traffic information system as the source of state information VS. In an area where no traffic information system is present, it may select the information VS2 provided by surrounding vehicles. Alternatively the selection may be more fine grained. For example it may select for example to receive velocity information from the surrounding vehicles themselves if such information is available and to receive the remaining information from the traffic information system.
  • In the sequel an embodiment of a traffic information system is described. Therein Figure 7 shows an example of a sensor node 10. The sensor node 10, shown in Figure 7, is an assembly of a sensor element 12, a processing unit 14 (with memory), a clock-module 18 and a radio link 16.
  • The sensor element 12 is capable of sensing the proximity of the vehicles to be tracked. The processing unit 14 determines if an object (vehicle) is present or absent on the basis of the signals from the sensor element 12. If an occupancy status of the detection area of the sensor changes, the processing unit 14 initiates a transmission of a message D indicating the new occupancy status and including a time stamp indicative of the time t at which the new occupancy status occurred. The message D sent should reach at least one message interpreter MI. A concrete implementation of the sensor node 10 is used for road vehicle tracking: in this case the sensor element 12 is a magnetoresistive component, which measures the disturbance on the earth magnetic field induced by the vehicles. Alternatively, a magnetic rod or loop antenna may be used for this purpose.
  • Figure 8 shows a possible implementation of the hardware involved for the sensor node 10 of Figure 7. The sensor element 12 is coupled via an A/D converter 13 to a microcontroller 14 that has access to a memory 15, and that further controls a radio transmitter 16 coupled to an antenna 17.
  • Figure 9 schematically shows a method performed by a sensor node to generate a message indicative for occupancy status of a detection area of the sensor node.
  • Starting (Step S1) from an off-state of the sensor node, input from the A/D converter is received (Step S2). In a next step S3, offset is removed from the sensed value.
  • In step S4 it is determined whether the occupancy state of the detection area as reported by the last message transmitted by the sensor node was ON (selection YES) (vehicle present in the detection range) or OFF (selection NO) (no vehicle present in the detection range. This occupancy state is internally stored in the sensor node.
  • In the first case, program flow continues with step S5. In the second case processing flow continues with step S9. In step S5 it is determined whether a signal value v obtained from the A/D converter, and indicative for an occupied status of the detection area is below a first predetermined value TL. If this is not the case program flow continues with step S2. If however the value is lower than said first predetermined value then program flow continues with step S6. In step S6 it is verified whether the signal value v remains below the first predetermined value TL for a first predetermined time period. During step S6 the retrieval of input from the A/D convertor is continued. If the signal value v returns to a value higher then said predetermined value TL before the end of said predetermined time-period then processing flow continues with step S2. Otherwise the value for the occupancy state is internally saved as unoccupied in step S7, and a message signaling this is transmitted in step S8.
  • In step S9 it is determined whether the signal value v obtained from the A/D converter, and indicative for an occupied status of the detection area exceeds a second predetermined value TH. The second predetermined value TH may be higher than the first predetermined value TL. If the signal value does not exceed the second predetermined value TH program flow continues with step S2. If however the value is higher than said second predetermined value TH then program flow continues with step S10. In step S10 it is verified whether the signal value v remains above the second predetermined value TH for a second predetermined time period, which may be equal to the first predetermined time period. During step S10 the retrieval of input from the A/D convertor is continued. If the signal value v returns to a value lower then said predetermined value TH before the end of said predetermined time-period then processing flow continues with step S2. Otherwise the value for the occupancy state is internally saved as occupied in step S11, and a message signaling this is transmitted in step S12.
  • A message interpreter, shown in Figure 10, consists of a radio receiver 20, coupled to antenna 22, a processing unit 24 (with memory 28) and a network interface 65, as well as a real-time clock 26. The network interface 65 couples the message interpreter MI via the communication channel 60 to other message interpreters.
  • As shown in more detail in Figure 10, the radio receiver 20 receives the binary "object present" signals D (with timestamp) from the sensor nodes 10 via the radio link and runs a model based state estimator algorithm to calculate the motion states of the objects individually (i.e. each real world object is represented in the message interpreter). The accuracy and the uncertainty of the estimation depends on the sensor density. For accurate object tracking it is preferred to have coverage of multiple sensors per object.
  • The message interpreter MI has a vehicle database facility 32, 34 that comprises state information of vehicles present at the traffic infrastructure.
  • The message interpreter MI further has a sensor map 45 indicative for the spatial location of the sensor nodes 10. Alternatively, the sensor nodes may transmit their location or their position could even be derived by a triangulation method.
  • The message interpreter MI further has an association facility 40 for associating the messages D provided by the sensor nodes 10 with the state information present in the vehicle data base facility 32, 34. The association facility 40 may associate the messages received with state information for example with one of the methods Gating, Nearest Neighbor (NN), (Joint) Probabilistic Data Association ((J)DPA), Multiple Hypothesis Tracker (MHT) and the MCMCDA.
  • The message interpreter further has a state updating facility 50 for updating the state information on the basis of the messages D associated therewith by the association facility 40. Once the messages D are associated with a particular vehicle the state of that vehicle in a local vehicle data base is updated by the update facility 50.
  • In the embodiment shown a global map builder 65 may exchange this updated information with global map builders of neighbouring message interpreters via network interface 60 (wired or wireless), for example to exchange the motion state of crossing objects.
  • In the embodiment shown the microcontroller 24 of Figure 10 processes the received messages D. The memory 28 stores the local and global vehicle map and the sensor map as well as the software for carrying out the data estimation and state estimation tasks. In an alternative embodiment separate memories may be present for storing each of these maps and for the software. Likewise dedicated hardware may be present to perform one or more of these tasks.
  • There is no communication or any other interaction between the objects tracked. The result of the processing (i.e. the estimation of the motion states of all sensed objects) is present in the memory of the message interpreters in a distributed way.
  • Message interpreters may run additional (cooperative) algorithms to deduct higher level motion characteristics and/or estimate additional object characteristics (e.g. geometry).
  • For applications in relative small area, e.g. a parking place, or a traffic node, the vehicle tracking system may comprise only a single traffic information unit. In that case the global map builder is superfluous, and local vehicle map is identical to the global vehicle map.
  • In the embodiment shown in Figure 3, each message interpreter MI for a respective traffic information unit MD1, MD2, MD3 comprises hardware as described with reference to Figure 10 and 11.
  • Operation of the message interpreter is further illustrated with respect to Figures 12-15.
  • Figure 12 schematically shows a part of a traffic infrastructure 80 having sections Rj-1, Rj, Rj+1. By way of example it is presumed that a vehicle moves in a direction indicated by arrow X from Rj-1, via Rj, to Rj+1.
  • Figure 13 shows an overview of a method for detecting the vehicle performed by the message interpreter for section Rj, using the messages obtained from the sensor nodes.
  • In step S20 the method waits for a message D from a sensor node. At the moment that a message D is received, program flow continues with step S21, where the time t associated with the message is registered. The registered time t associated with the message may be a time-stamp embedded in the message or a time read from an internal clock of the message interpreter.
  • In embodiments wherein messages are indirectly transmitted to a message interpreter, e.g. by a network formed by sensor nodes it is advantageous if the embeds the time stamp in the message, so that it is guaranteed that the registered time corresponds to the observed occupancy status regardless any delays in the transmission of the message.
  • In step S22, it is verified whether the detection is made by a sensor node in a location of section Rj that neighbours one of the neighbouring sections Rj-1 or Rj+1. If that is the case, then in step S23 the event is communicated via the communication network interface to the message interpreter for that neighbouring section. In step S24 it is determined which vehicle O in the vehicle data base facility is responsible for the detected event. An embodiment of a method used to carry out step S24 is described in more detail in Figure 14. After the responsible object O is identified in step S25, i.e. an association is made with existing object state information, it is determined in Step 26 whether it is present in the section Rj. If that is the case, control flow continues with Step S27. Otherwise control flow returns to step S20, where the state of object O is estimated. A procedure for estimating the state is described in more detail with reference to Figure 15. In step S28 it is determined whether the state information implies that the vehicle O has a position in a neighboring region Rj-1 or Rj+1. In that case the updated state information is transmitted in step S29 to the message interpreter for the neighbouring region and control flow returns to step S20. Otherwise the control flow returns immediately to Step S20.
  • A method to associate a message D at time t, with an object O is now described in more detail with reference to Figure 14.
  • In a first step S40, a vehicle index i is initialized (e.g. i=1). In a next step S41, the current state known for the vehicle with that index i is retrieved from the vehicle database facility. In the next step S42 a probability is determined that the vehicle O caused the detection reported by the message D at time t. The vehicle index i is incremented in step S43 and if it is determined in step S44 that i is less than the number of vehicles, the steps S41 to S43 are repeated. Otherwise in step S45 it is determined which vehicle caused the detection reported by the message D at time t with the highest probability. In step S46 the index of that vehicle is returned as the result if the method.
  • A method to estimate (update the present estimation of) the state of a vehicle is now described in more detail with reference to Figure 15.
  • In step S60 the messages D1,...,Dn associated with vehicle O are selected?
  • In step S61 a probability density function is constructed on the basis of the associated messages.
  • In step S62 the current state So and time to for object O are determined.
  • In step S63 it is determined whether the time for which the state S of the vehicle O has to be determined is less than the time to associated with the current state So.
  • If that is the case, the state S determined by the estimation method is the state update of S0 to t, performed in step S65. If that is not the case, the state S determined by the estimation method is the state update of S0 to S0 in step S64. What does it mean?
  • It is noted that other methods are possible to track vehicle state information of individual vehicles. For example vehicles could be provided with a transponder that signals their momentaneous position to the traffic information system.
  • In the claims the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single component or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope. Further, unless expressly stated to the contrary, "or" refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by any one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).
  • More details relevant for the present invention are described in the following Annexes:
    • A1: Estimation and association for multiple target tracking based on spatially, distributed detections
    • A2: On Event Based State Estimation
    A1: Estimation and association for multiple target tracking based on spatially, distributed detections
  • Summary. In this paper we consider the multiple object tracking problem with event-based observations. For that we predefine a number detection points which are spatially distributed along the road. Whenever the edge of an object crosses one of the detection points, the position of that detection point together with the time of the event are received by our tracking algorithm. We assume that objects can cover multiple detection points and propose a method to estimate the object's position and orientation from these detections using the shape of the object. Beside that another method is designed which associates newly received detections with a known object. The objects are tracked with an event-based state-estimator that uses the estimated position and orientation, although its design is out of the scope of this paper. Finally our tracking algorithm is critically assessed in a simulation of a parking lot.
  • 1 Introduction
  • In multiple target tracking [1-3] one aims to track all the objects/targets, which are moving in a certain area. Three basic problems arise from tracking objects. The first one is how to measure the object's position. The second one is to associate a certain measurement with its correct object and the third one is a state-estimator to keep track of all the objects. This paper considers the first 2 issues when objects are not measured but detected.
  • Consider a system in which objects are detected when they cross a predefined 'detection' point. These detectors are triggered by the event that the object's edge crosses its position. However, they cannot distinguish between the objects. This paper describes a method in which a new detection is associated with the object that most probable generated it. Also, a method is described which estimates the position and orientation of the object given the observations in position and time due to the detections. Other examples in which sensor-data is generated due to an event can be found in [4, 5].
  • This paper is organized as follows. Section 2 defines background knowledge such as the notation of (object) variables and functions that are used throughout this paper. After that the problem is formulated in section 3 together with existing methods. Section 4 describes the approach which is taken in the design. A more detailed description of the estimation and associated is presented in Section 5 and 6 respectively. Finally both methods are tested in a small application example presented in Section 6 and conclusions are drawn in section 7. But let's start with the background information.
  • 2 Background
  • In order to be clear about notations and variables this section describes those that can be found throughout this paper.
  • 2.1 Variables
  • R defines the set of real numbers whereas the set R+ defines the non-negative real numbers. R xy defines the set spanned by the vectors ex and ey , the point p:=x·ex +y·ey is shortly denoted as p = (x,y) T. The set Z defines the integer values and Z+ defines the set of non-negative integer numbers. The variable 0 is used either as null, the null-vector or the null-matrix. Its size will become clear from the context.
  • Vector x(t) R n is defined as a vector depending on time t and is sampled using some sampling method. The time t at sampling instant k ∈ Z+ is defined as tk ∈ R . The variables τ k , ∈ R , xk ∈ R n and x0:k ∈ R n×k+1 are defined as: τ k : = t k - t k - 1 ,
    Figure imgb0001
    x k : = x t k ,
    Figure imgb0002
    x 0 : k : = x t 0 x t 1 x t k .
    Figure imgb0003
  • The matrix A(t 2 -t 1)∈ R a×b depends on the difference between two time instants t 2 > t 1 and is shortly denotes as A t2-t1
  • 2.2 Functions
  • The transpose, inverse and determinant of a matrix A ∈ R n×n are denoted as AT , A -1 and |A| respectively.
  • Let us define the probability of the random vector x∈ R n as the scalar Pr(x)∈ {0,1} and the conditional probability of x given the vector u∈R m as the scalar Pr(x|u)∈{0,1}. The probability density function (PDF), as defined in [6] section B2, of the vector x∈R n is denoted as p(x) and the conditional PDF of x given u∈R q is denoted as p(x|u). The expectation and covariance of x are denoted as E[x] and cov(x) respectively. The conditional expectation of x given a vector u is denoted as E[x|u]. The definitions of E[x], E[x|u] and cov(x) can be found in [6] sections B4 and B7.
  • The Gaussian function, shortly noted as Gaussian, depending on vectors x ∈ R n and u ∈ R n and on matrix P ∈ R n×m is defined as: G x u P : R n × R n × R n × m R , = 1 2 π n / 2 P e - 0.5 x - u T P - 1 x - u .
    Figure imgb0004
  • If p(x) = G(x, u, P), then by definition it holds that E[x] = u and cov(x) = P.
  • Assume we have the set C c R q and the vectors x ∈ R q and y∈ R q . Then the function ||x - y||∈R is defined as the distance between vectors x and y. The function |〈x-C〉 |∈ R is defined as the shortest distance from vector x to set C : x - C : R q R , : = min x - c , c C .
    Figure imgb0005
  • 2.3 Object variables
  • Assume there exist an object which is moving in the 3D world space. This object is observed with, for example, a camera or sensors in the road. Meaning that the object is projected to a 2D space, i.e. R xy . If we assume that the shape of the projected object is constant and known, then we can draw a smallest, rectangular box around the object. For the box we define a position-vector o = (x, y) T ∈ R xy , equal to the center of the box, and an orientation-vector θ∈ R. In the case of o = 0 and θ = 0 the corners of this box, as shown in Figure 16, are defined in the set C0 : C 0 : = c 1 c 2 c 3 c 4 , with c i R xy .
    Figure imgb0006
  • Notice that for an object having a certain o and θ the new corner-positions of the object's box are calculated with C0. For that a rotation matrix T ∈ R q×q is used as defined in (7). An example of the object's box for a certain o and θ is graphically depicted in Figure 16. T k = cos θ k sin θ k - sin θ k cos θ k .
    Figure imgb0007
  • Beside the positions o and θ each object also has a certain shape or geometry which covers a certain set of positions in R xy , i.e. the grey area of Figure 16. This closed set is denoted with S ⊂ R xy and is defined as the union of the open set of the object's body SB ⊂ R xy and the closed set of the object's edge SE ⊂ R xy , i.e. S := SB SE The set S is approximated by a set of sampled position-vectors Λ = [λ12,...λ k ], with λ i R xy . To define the vectors λ i we equidistant sample the rectangular box defined by C0 using a grid with a distance r. Each λ i is a grid point within the set S as graphically depicted in Figure 17.
  • The aim is to estimate position, speed and rotation of the object in the case that its acceleration and rotational speed are unknown. Therefore the object's state-vector s(t) ∈ R5 and process-noise w(t) ∈ R2 are defined as: s t : = o t θ t δ o t δ t T , w t : = δ o 2 t δ t 2 δθ t δ t T .
    Figure imgb0008
  • Next the problem is formulated using this background knowledge.
  • 3 Problem formulation
  • A total of E objects are observed within the set R xy. The vectors o i = (xi ,yi ) T and θ i are the ith object's position- and rotation-vector respectively. Ti represents the ith object's rotation-matrix dependent on θ i . The dynamical process of object i with state-vector si , process-noise wi and measurement-vector mi is defined with the following state-space model: s k i : = A τ k s k - 1 i + B τ k w k - 1 i ,
    Figure imgb0009
    m k i : = o k i θ k i = C s k i + v k i ,
    Figure imgb0010
    C : = I 3 × 3 0 , p w k i : = G w k i 0 Q i , p v k : = f v k .
    Figure imgb0011
  • The definition of the elements of state-vector si (t), also shown in Figure 18, are: s i t : = x i t y i t θ i t dx i t dt dy i t dt T .
    Figure imgb0012
  • The objects are observed in R xy by a camera or a network of sensors. For that M 'detection' points are marked within R xy and collected in the set D⊂R xy . The position of a detection point is denoted as dD. The kth detection of the system generates the observation vector z k i R xy R
    Figure imgb0013
    if the edge of the ith object covers one of the detection points dk D at time tk : z k i : = d k t k , if T k i - 1 d k - o k i S E i .
    Figure imgb0014
  • However, the system does not know which object was detected for it can be any object. As a result the system will not generate z k i
    Figure imgb0015
    but a general observation vector z k ∈ {R xy ,R}, which is yet to be associated with an object. Therefore, due to the kth detection, the observation vector zk is generated whenever one of the E object covers a detection point dk D at time tk : z k : = d k t k , if i : T k i - 1 d k - o k i S E i .
    Figure imgb0016
  • From equations (13) and (14) we conclude that z k i
    Figure imgb0017
    of (13) is the result after the received observation vector zk (14) is associated with object i. Notice that both definitions of zk and z k i
    Figure imgb0018
    assume that the object's edge is detected exactly at a detection point d. In reality the detection will be affected by noise. The object therefore has some probability to be detected at a position v∈ R xy which is close to d . This is modeled by defining that the object's position at the instant of the detection, i.e. v, is a random vector with mean d and covariance ε∈ R : p υ : = G υ , d , ε I .
    Figure imgb0019
  • Figure 18 shows an example of object i which is detected by multiple detection points. The covariance ε of each detection point is also indicated.
  • The sampling method of the observation vectors z 0:k is a form of event sampling [2, 10, 12]. For a new observation vector is sampled whenever an event, i.e. object detection, takes place. With these event samples all N objects are to be tracked. To accomplish that three methods are needed. The first one is the association of the new observation-vector zk to an object i and therefore denote it with z k i .
    Figure imgb0020
    Suppose that all associated observation-vectors z n i
    Figure imgb0021
    are collected in the set Z k i z 0 : k .
    Figure imgb0022
    Then the second method is to estimate m k i
    Figure imgb0023
    from the observation-set Z k i .
    Figure imgb0024
    This is used in the third method, which is a state-estimator.
  • Present association methods are: Gating and Nearest Neighbor (NN) [3], (Joint) Probabilistic Data Association ((J)DPA) [3, 7], Multiple Hypothesis Tracker (MHT) [14] and the MCMCDA [15]. Although these can be transformed for associating the event samples z 0: k, this paper will show that the estimation of m k i
    Figure imgb0025
    results in a probability that zk is in fact z k i ,
    Figure imgb0026
    i.e. Pr z k = z k i .
    Figure imgb0027
    Therefore the problem which is covered in this paper is the estimation of m k i
    Figure imgb0028
    from the set Z k i ,
    Figure imgb0029
    which also results in the probability Pr z k = z k i .
    Figure imgb0030
    For that we assume that the shape of the object is known and that it is samples as shown in Section 3.3. The state-estimation is not covered in this paper, although it is used in the application example. Before going into the mathematical details of the estimation we will first describe the approach that is taken.
  • 4 Approach measurement estimation
  • In the problem formulation we stated that Z k i
    Figure imgb0031
    is defined as the set with all observation-vectors from z 0:k that were associated with object i. We will first redefine this set before continuing with the approach for estimating m k i .
    Figure imgb0032
  • The set Z k i z 0 : k
    Figure imgb0033
    is defined as the set of all observation-vectors zn which were associated with object i, from which their detection point is still covered by the object. We will first show how this is done. At time step k we have the observation-set Z k - 1 i
    Figure imgb0034
    and the observation zk was associated to object i, i.e. z k i .
    Figure imgb0035
    Now if the object's edge is detected at dk for the first time, then z k i
    Figure imgb0036
    is added to the set Z k - 1 i .
    Figure imgb0037
    However, if the object's edge is detected at dk for the second time, then z k i
    Figure imgb0038
    is not added to the set Z k - 1 i
    Figure imgb0039
    and the vector z n i ,
    Figure imgb0040
    for which holds that dn = dk. is removed from Z k - 1 i .
    Figure imgb0041
    This because in the second case, it means that object i drove off the detection point positioned at dn = dk. Therefore Z k i
    Figure imgb0042
    is defined as: Z k i : = { Z k - 1 i z k , if d k d n , Z n i Z k - 1 i , Z k - 1 i \ Z n , if n | d k = d n z n i = d n t n Z k - 1 i .
    Figure imgb0043
  • With this definition of Z k i
    Figure imgb0044
    the approach for estimating m k i ,
    Figure imgb0045
    i.e. p m k i | Z k i ,
    Figure imgb0046
    is given. For clarity we assume that the object's shape is rectangular and that all its detection points are denoted with dn, with nN ⊂ [0, k].
    1. 1. The first step is to position the object on each detection point dn and mirror its set S into the set On , as shown in Figure 19 for a single detection. This way we transform the points that are covered by the object, into possible vectors of the object's position o k i O n
      Figure imgb0047
      given that it is detected at the detection point dn .
    2. 2. The second step, graphically depicted in Figure 20, is to turn all sets On simultaneously around their detection point dn . This way, each possible orientation θ k i
      Figure imgb0048
      of the object results in a corresponding possible object's position o k i .
      Figure imgb0049
      For o k i
      Figure imgb0050
      must be inside all the sets On , ∀nN, and therefore thus inside the intersection of all sets On , ∀nN, which is denoted as ON .
  • Therefore if we apply these two steps for a number of θ k i ,
    Figure imgb0051
    orientations then at each orientation we have a set ON which has to contain the object's position o k i .
    Figure imgb0052
    From all these orientations we can calculate p m k i | Z k i
    Figure imgb0053
    as shown in the next section.
  • 5 Measurement estimation
  • Estimation of the measurement-vector m k i
    Figure imgb0054
    given the observation set Z k i
    Figure imgb0055
    results in calculating p m k i | Z k i .
    Figure imgb0056
    Because both m k i
    Figure imgb0057
    and Z k i
    Figure imgb0058
    always belong to the same object and at sample instant k throughout this section we will remove the sub- and superscripts i and k in the rest of this section. Therefore we have; m k i m
    Figure imgb0059
    and Z k i Z .
    Figure imgb0060
    The set Z consists of the observation vectors z n, for all nN ⊂ [0,k], that were associated to the same object.
  • Although the measurement vector is defined as m= (o, θ) T , with o ∈ R xy and θ ∈ R, the detection point at time-step n are defined as dn ∈ R xy . Meaning that the objects orientation is not directly. However, because every observation vector zn Z detects the object for one and the same θ, the PDF p(m|Z) is approximated by sampling in θ, i.e.: p m | Z l = 1 L α l - 1 l = 1 L α l p o | Z , θ = l Δ ,
    Figure imgb0061
    Δ : = 2 π L and α l : = Pr θ = l Δ | Z .
    Figure imgb0062
  • The main aspect of equation (17) is to determine p(o|Z,θ). To do that we define the set On (θ) ∈ R xy to be equal to all possible object positions o , given that the object is detected at position dn zn (∈Z) and that the object's rotation is equal to θ. The determination of On (θ) ∈ R xy is presented in the n the next section. Therefore, if one object is detected at multiple detection points dn,nN, then the set of all possible object positions o given a certain θ equals On (θ) : O N θ : = n N O n θ .
    Figure imgb0063
  • Equation (14) is graphically explained in Figure 21 for two different values of θ and N = {1,2}.
  • Both p(o|Z, θ) and α l are related to the set ON (θ) due to the fact that it ON (theta) defines the set of possible object positions o for a given θ. To calculate p(o|Z,θ) and α l , we define the functions f(o|Z,θ) and g(o|Z,θ) : f o | z n , θ : = { 0 if o O N θ , 1 if o O n θ , g o | Z , θ : = n N f o | z n , θ = { 0 if o O N θ , 1 if o O N θ ,
    Figure imgb0064
  • Therefore the PDF p(o|Z,θ) and probability α1 are: p o | Z , θ : = g o | Z , θ - g o | Z , θ do , α l : = - g o | Z , θ do - f o | Z n , θ do .
    Figure imgb0065
  • With (16) both p(m|Z) is calculated according to (13). The rest of this section is divided into two parts. The first part derives the probability function based on a single detection, i.e. f(o|Zn ,θ). While the second part derives the probability function based on a multiple detections, i.e. g(o|Z,θ).
  • 5.1 Single event detection
  • In order to derive f(o|zn , θ) we will use the set A , defined in 2.3, which contains the sampled positions λ i that are covered by the object if o = 0 and θ = 0. Notice that if the object covers the origin, i.e. (x, y) T = 0, then the possible values of the object position o are given by the set - Λ. This is graphically depicted in Figure 22 (left). From that we can conclude that if the object covers the detection point dn , given a certain orientation θ and rotation-matrix T, the sampled set A can be transformed into a sampled set of On , denoted with Ôn : O ^ n : = o ^ 1 , o ^ 2 , , o ^ K , with o ^ i : = d - T λ i O n .
    Figure imgb0066
  • Figure 22 (right) graphically depicts the determination of Ôn from the set A for a given θ and detection point dn .
  • The function f(o|zn ,θ), as defined in (15), is approximated by placing a Gaussian function at each sampled position ôi Ôn with a certain covariance dependent on the grid-size r : f o | z n , θ 2 π γ 2 i = 1 K G o o ^ i γ I 2 × 2 ,
    Figure imgb0067
    γ : = 2 Δ K 2 0.25 - 0.05 e 4 K - 1 15 - 0.08 e 4 K - 1 180 .
    Figure imgb0068
  • The approximation of (18) assumes that the object is detected exactly at dn . In Section 4 we stated that the detection can be a bit of a detection point. The PDF that the object is detected at position v ∈ R xy given the detection point dn is defined in (15). Inserting this uncertainty into (18) results in the final f(o|zn ,θ) : f o | z n , θ 2 π γ 2 i = 1 K - G υ , d , ε I G o , υ - T λ i , γ I d υ .
    Figure imgb0069
  • Equation (19) is solved with the following Proposition and the fact that G(x, a + b, C) = G(x- b,a, C) :
  • Proposition 1. Let there exist two Gaussian functions of the random vectors x ∈ R n and me R q and the matrix Γ∈R q×n ; G(x,u,U) and G(m, Γx, M). Then they have the following property: - G x u U G m , Γ x , M dx = G Γ u , m , Γ U Γ T + M .
    Figure imgb0070

    Proof. The proof can be found in Section 9.
  • Applying Proposition 1 to (19) results in: f o | z n , θ 2 π γ 2 i = 1 K G o o ^ i R , with R : = ε + γ I 2 × 2 .
    Figure imgb0071
  • From f(olzn , θ) based on a single detection, the next step to multiple detections, i.e. g (o I Z, θ), is taken.
  • 5.2 Multiple event detections
  • The aim of this section is to calculate the function g(o | Z, θ) by substituting equation (21) in the definition of g(o|Z,θ) as shown in (15): g o | Z , θ n N 2 π γ 2 i = 1 K G o o ^ i n R , with o ^ i n : = d n - T λ i .
    Figure imgb0072
  • If N contains m elements, then calculating equation (28) would result in Km products of m Gaussian functions and sum them afterwards. This would take too much processing power if m is large. That is why equation (28) is calculated differently.
  • Instead of using all detection points dn we will use a subset of them. The derivation of this subset is graphically depicted in Figure 23 for N = {1,2}. For that consider the rectangular set C 0 ∈ R xy of Section 3.3 defined by its corners [c 1,c 2,c 3,c 4]. For each detection point dn we define the set Cn (θ) ⊂ R xy with corner-points [c n1(θ), c n2(θ), c n3(θ), c n4(θ)] defined as: c n i θ : = Tc i + d n .
    Figure imgb0073
  • Let us define the rectangular set C N (θ) ⊂ R xy as the intersection of the sets C n (θ), ∀nN , i.e.: C N θ : = n N C n θ .
    Figure imgb0074
  • Meaning that each detection point dn defines a rectangular set denoted with C n (θ) dependent on rotation θ. The intersection of all these rectangular sets is defined with the set C N (θ).
  • In the beginning of this section we defined two different sets shown in Figures 19 and 20. The first set, On (θ), shown in Figure 19 defines all possible objet positions o based on a single detection at dn . The second set, i.e. ON (θ), shown in Figure 20, defines all possible object positions o based on all detections at dn,nN. Notice that as a result On (θ) ⊂ Cn (θ) and ON (θ) ⊂ CN (θ). Meaning that only within the set C N (θ) all the functions f(o|Zn , θ) have an overlapping area in which they are 1. Outside C N (θ) there is always at least one f(o|zn , θ) which is 0 and therefore makes g(o|Z,θ) outside CN (θ) equal to 0. Therefore g(o|Z,θ) of (28) can be approximated by taking only those Gaussians of the functions f(o|Zn ,θ) into account of which their mean, i.e. o ^ i n ,
    Figure imgb0075
    is close or in the set C N (θ). We define that close to C N (θ) means a distance of at most γ + ε, which defined R in (27). The function g(o|Z,θ) of (28) is therefore approximated as: g o | Z , θ n N 2 π γ 2 i = l n G o o ^ i n R ,
    Figure imgb0076
    | n : | o ^ i n - C N θ | γ + ε , i | j .
    Figure imgb0077

    We can even decrease the number of Gaussians of (6.2) even further. This because if for a certain detection point dn it holds C N (θ) ⊂ On (θ), it means that when we remove the detection point dn it will not affect the set CN (θ). Therefore equation (6.2) is reduced to: g o | Z , θ n = N 2 π γ 2 i = l n G o o ^ i n R ,
    Figure imgb0078
    N N : C N θ O n θ , n N \ N .
    Figure imgb0079
  • The calculation of (26) is done by applying the following two propositions. The first one, i.e. Proposition 2, shows how to rewrite a product of a summation of Gaussians into a summation of a product of Gaussians. The second one, i.e. Proposition 3, proofs that a product of Gaussians results in a single Gaussian.
  • Proposition 2. The product of a summation of Gaussians can be written into a summation of a product of Gaussian:
  • j = 1 C ρ j i = 1 c j G x x j i R = j = 1 C ρ j C j m j = 1 C C j j = 1 C G x x j f j m R ,
    Figure imgb0080
    f j m : = 3 - r = 1 j f r - 1 , m - 1 r C + 1 ρ r r = j + 1 C + 1 ρ r , f 0 m : = 1 , ρ j + 1 : = 1.
    Figure imgb0081
  • The proof is given by writing out the left hand side of (27a) and restructuring it.
  • Proposition 3. The product of Gaussians is again a Gaussian:
  • j = 1 C G x x j R = β G x , j = 1 C x j C R C and β = j = 2 C G x j n = 1 j - 1 x n j - 1 j R j - 1 .
    Figure imgb0082
  • The proof is given in Section 10.
  • Now applying Propositions 6.2 and 6.2 on (6.2) results in a solution of g(o|Z,θ) as a summation of Gaussians of the form: g o | Z , θ = i = 1 H β i θ G o , o i θ , R i θ ,
    Figure imgb0083
  • Equation (29) is approximated as a single Gaussian function: g o | Z , θ β θ G o , o θ , R θ , with β θ : = i = 1 H β i θ , o θ : = i = 1 H β i θ β o i θ , R θ : = i = 1 H β i θ β R i θ + o θ - o i θ o θ - o i θ T .
    Figure imgb0084
  • With the result of (30) we can approximate g(o|Z,θ). In order to calculate the PDF p(m|Z), equation (30) is substituted into equation (16) together with f(o|Zn ,θ) of (27) to calculate p(o|Z,θ) and α i . Substituted these results into (13) gives: p m | Z = l = 1 L β l Δ l = 1 L B l Δ G o , o l Δ , R l Δ .
    Figure imgb0085
  • As was mentioned in the problem formulation, the PDF p(m |Z) also gives us the probability that a new observation vector is generated by an certain object i. This is discussed in the next section.
  • 6 Detection association
  • The total probability that a new observation vector zk is generated by object i is equal to the total probability of the measurement-vector m k i
    Figure imgb0086
    given the observation set Z k - 1 i z k .
    Figure imgb0087
    For this probability we can use p m k i | Z k - 1 i , z k
    Figure imgb0088
    which is equal to equation (31). The definition of a PDF is that its total probability, i.e. its integral from to ∞, is equal to 1. To make sure that p m k i | Z k - 1 i , z k
    Figure imgb0089
    of equation (41) has a total probability of 1, it is divided by its true probability Pr m k i | Z k - 1 i , z k .
    Figure imgb0090
    In order to be able to compare these different measurement-vector per object, we normalize each probability with the surface covered by the object. As a result, Pr z k = z k i
    Figure imgb0091
    is equal to: Pr z k = z k i = 1 2 π γ i 2 K i l = 1 L β l Δ .
    Figure imgb0092
  • The variables γ i and Ki are equal to γ and K respectively, which define the approximation of the function f ( m k i | , z n i , θ k i
    Figure imgb0093
    as shown in (6.1). With the probability of (42) one can design a method which associates an observation-vector due to a new detection, to its most probable object i. Although the estimation method requires a certain amount of processing power, one can reduce this by reducing the number of samples in the set A. Meaning that association and estimation can be done with different sizes of A. Moreover, if the objects have a rectangular shape, then with some tricks one can reduce the amount of processing power to a level at which both association as well as estimation can run real-time.
  • Now that both the measurement estimation as well as the detection association are designed, both are tested in a multiple object tracking application.
  • 7 Application example
  • As an application example we take a parking lot of 50 by 50 meters with a network of wireless sensors distributed randomly along the road's surface. Each sensor can detect a crossing vehicle. A total of 2500 sensors was used resulting in a density of one sensor per square meter. The vehicles are all assumed rectangular shaped objects with a length of 5 meters and a width of 2 meters. A total of 4 vehicles manoeuvre within the parking lot and are tracked using a data-associator followed with an event state-estimator.
  • The simulation case is made such that it contains two interesting situation. One in which two vehicles cross each other in parallel and one where two vehicles cross perpendicular. For comparison the objects are tracked using two different association methods. The first one is a combination of Gating and detection association of 7. The second one is a combination of Gating and Nearest Neighbor.
  • The result of the detection associator (DA) for both crossings is shown in Figure 24 while the result of the Nearest Neighbor (NN) associator is shown in Figure 25. In both results the real object is plotted in a thick, solid line while its estimated one is plotted in a thin, solid line. The associated detections of each object are given with a symbol which is different for each object; '□' if associated with vehicle 1, ' o' if associated with vehicle 2 , ' ∇' if associated with vehicle 3 and ' *' if associated with vehicle 4. Figure 24 shows with the DA all detections were correctly associated to the one object, while If NN is used as an association method, we see that a lot of incorrect associated detections. Therefore we can concluded that using the detection association of 7 results in less estimation-error compared to NN.
  • A second simulation is done to compare the percentage of incorrect associated detections. Again for the both DA as well as NN only now 4 different amount of detection points were used: 3000, 2500, 2000 and 1500. This table shows that the detection association has a better performance compared to Nearest Neighbor. Table 1: Percentage of incorrect association
    amount of detection points DA NN
    3000 0 % 4.5 %
    2500 0 % 5.6 %
    2000 0 % 7.8 %
    1500 0 % 2.2 %
  • 8 Conclusions
  • This paper presents a method for estimating the position- and rotation-vector of objects from spatially, distributed detections of that object. Each detection is generated at the event that the edge of an object crosses a detection point. From the estimation method a detection associator is also designed. This association method calculates the probability that a new detection was generated by an object i .
  • An example of a parking lot shows that the detection association method has no incorrect associated detections in the case that two vehicles cross each other both in parallel as well as orthogonal. If the association method of Nearest Neighbor was used, a large amount of incorrect associated detections were noticed, resulting in a higher state-estimation error.
  • The data-assimilation can be further improved with two adjustments. The first one is replacing the set S with SE only at the time-instants that the observation vector is received. The second improvement is to take the detection points that have not detected anything also in account.
  • References
    1. 1. Poore and S. Gadaleta, "Some assignment problems arising from multiple target tracking," Mathematical and Computer Modelling, vol. 43, pp. 1074-1091, 2006.
    2. 2. Y. Bar-Shalom and R. Li, Multitarget-Multisensor Tracking: Principles and Techniques. YBS, 1995.
    3. 3. S. Blackman and R. Popoli, Design and Analysis of Modern Tracking Systems. Artech house, Norwood, MA, 1999.
    4. 4. V. Nguyen and Y. Suh, "Improving estimation performance in Networked Control Systems applying the Send-on-delta transmission method," Sensors, vol. 7 pp. 2128-2138, 2007.
    5. 5. K. Åström and B. Bernhardsson, "Comparison of Riemann and Lebesque sampling for first order stochastic systems," in 41st IEEE Conference on Decision and Control, Las Vegas, Nevada, USA, 2002.
    6. 6. N. Johnson and S. Kotz, and A. Kemp, Univariate discrete distributions. JOHN WILEY and SONS, Inc, 1992.
    7. 7. M. Miskowicz, "Send-on-delta concept: an event-based data-reporting strategy," Sensors, vol. 6, pp. 49-63, 2006.
    8. 8. R. Karlsson and F. Gustafsson, "Monte Carlo data association for multiple target tracking," in IEE International Seminar on Target Tracking: Algorithms and Applications, 2001.
    9. 9. Ristic, S. arulampalam and N. Gordon, Beyond the Kalman filter: Particle filter for tracking applications, 2002.
    10. 10. Songhwai, S. Sastry, and L. Schenato, "A Hierarchical Multiple-Target Tracking Algorithm for Sensor Networks," in Proc. of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005.
    11. 11. K. Mardia, J. Kent, and J. Bibby, Mutlivariate analysis. Academic press, Inc. London, 1979.
    12. 12. Kelly, Introduction to probability. Macmillan Publishing Company, 1994.
    13. 13. H. Durant-Whyte, B. Rao, and H. Hu, "Towards a fully decentralized architecture for multi-sensor data fusion," in 1990 IEEE Int. Conf. on Robotics and Automation, Cincinnati, Ohio, USA, 1990, pp. 1331-1336.
    9 Proof of Proposition 1
  • Proof. Defined are two Gaussian functions with the vectors x∈ R n , u ∈ R n , m ∈ R q and matrices U ∈ R n×m , MR q× q, Γ∈ R q×n : G(x,u,U) and G(mx,M). Suppose we define the following PDFs and relation of m with some c∈ R q : m = Γ x + c , with p c : = G m 0 M and p x : = G x u U .
    Figure imgb0094
  • Then from probability theory [6] p(m) is equal to: p m : = - p m | x p x x = - G m , Γ x , M G x u U x .
    Figure imgb0095
  • Applying theorem 3.2.1 of [9] on (44) we have that px) = GxuUΓ T ). Now if we have the random vectors a ∈ R n and b ∈ R n with p(a) = G(a,u 1, U 1) and p(b) = G(b,u 2,U 2) then they have the property p(a+b) = G(a+b,u 1+u 2,U 1+U 2) as proven in [12]. Applying this on (33a) results in: p m = G m , Γ u , Γ U Γ T + M ,
    Figure imgb0096
    - G m , Γ x , M G x u U x = G m , Γ u , Γ U Γ T + M .
    Figure imgb0097
  • 10 Proof of Proposition 3
  • Proof. A product of Gaussians can be written as: j = 1 N G x x j R = G x x N R = j = 1 N - 1 G x x j R , = β N - 1 G x x N R G x j = 1 N - 1 x j N - 1 R N - 1 .
    Figure imgb0098
  • From Proposition 1 and the Kalman filter in Information form [13], a product of 2 Gaussians equals: G x , , u , U G m x M = G m , u , U + M G x d D , 37 a with D - 1 = U - 1 + M - 1 , d = DU - 1 u + DM - 1 m . 37 b
    Figure imgb0099
  • Applying (37) on (36b), together with the fact that G(x,y,Z) = G(y,x,Z) we have: j = 2 N G x x j R = β N - 1 G x N j = 1 N - 1 x j N - 1 NR N - 1 G x j = 1 N x j N R N .
    Figure imgb0100
  • Equation (38) is equal to (28) for: β N = β N - 1 G x N j = 1 N - 1 x j N - 1 NR N - 1 ,
    Figure imgb0101
    = i = 2 N G x i j = 1 i - 1 x j i - 1 iR i - 1 .
    Figure imgb0102
  • A2: One Event Based State Estimation
  • Summary. To reduce the amount of data transfer in networked control systems and wireless sensor networks, measurements are usually taken only when an event occurs, rather that at each synchronous sampling instant. However, this complicates estimation and control problems considerably. The goal of this paper is to develop a state estimation algorithm that can successfully cope with event based measurements. Firstly, we propose a general methodology for defining event based sampling. Secondly, we develop a state estimator with a hybrid update, i.e. when an event occurs the estimated state is updated using measurements; otherwise the update is based on the knowledge that the monitored variable is within a bounded set used to define the event. A sum of Gaussians approach is employed to obtain a computationally tractable algorithm.
  • 1 Introduction
  • Different methods for state estimation have been introduced during the last decades. Each method is specialized in the type of process, the type of noise or the type of system architecture. In this paper we focus on the design of a state estimator that can efficiently cope with event based sampling. By even sampling we mean that measurements are generated only when an a priori defined event occurs in the data monitored by sensors. Such an effective estimator is very much needed in both networked control systems and wireless sensor networks (WSNs) [1]. Especially in WSNs, where the limiting resource is energy, data transfer and processing power must be minimized. The existing estimators that could be used in this framework are discussed in Section 5. For related research on event based control, the interested reader is referred to the recent works [2], [3].
  • The contribution of this paper is twofold. Firstly, we introduce a general mathematical description of event based sampling. We assume that the estimator does not know when new measurements are available, which usually results in unbounded eigenvalues of its error-covariance matrix. To obtain an estimator with a bounded error-covariance matrix, we develop an estimation algorithm with hybrid update, which is the second main contribution. The developed event based estimator is updated both when an event occurs, with received measurements, as well as at sampling instants synchronous in time. Then the update is based on the knowledge that the monitored variable is within a bounded set used to define the event. In order to meet the requirements of a low processing power, the proposed state estimator is based on the Gaussian sum filter [4, 5], which is known for its computational tractability.
  • 2 Background notions and notation
  • R defines the set of real numbers whereas the set R+ defines the non-negative real numbers. The set Z defines the integer numbers and Z+ defines the set of non-negative integer numbers. The notation 0 is used to denote either the null-vector or the null-matrix. Its size will become clear from the context.
  • A vector x(t) ∈R n is defined to depend on time t ∈R and is sampled using some sampling method. Two different sampling methods are discussed. The first one is time sampling in which samples are generated whenever time t equals some predefined value. This is either synchronous in time or asynchronous. In the synchronous case the time between two samples is constant and defined as ts ∈R+.
    If the time t at sampling instant ka Z + is defined as tka , with t 0a :=0 , we define: x k a : = x t k a and x 0 a : k a : = x t 0 a , x t 1 a , , x t k a .
    Figure imgb0103

    The second sampling method is event sampling, in which samples are taken when an event occurred. If t at event instant ke ∈ Z+ is defined as tke , with t 0 e := 0, we define: x k e : = x t k e and x 0 e : k e : = x t 0 e , x t 1 e , , x t k e .
    Figure imgb0104

    A transition-matrix A t2-t 1 ∈R a×b is defined to relate the vector u(t 1)∈ R b to a vector x(t 2) ∈ R a as follows: x(t 2) = A t2-t1 U(t 1).
  • The transpose, inverse and determinant of a matrix A ∈ R n×m are denoted as AT , A -1 and |A| respectively. The ith and maximum eigenvalue of a square matrix A are denoted as λ i (A) and λmax(A) respectively. Given that A ∈ R n×n and B∈ R n×n are positive definite, denoted with A ≻ 0 and B ≻ 0, then AB denotes A - B ≻ 0. A ± 0 denotes A is positive semi-definite.
  • The probability density function (PDF), as defined in [6] section B2, of the vector x∈ R n is denoted with p(x) and the conditional PDF of x given uRq is denoted as p(x|u). The expectation and covariance of x are denoted as E[x] and cov(x) respectively. The conditional expectation of x given u is denoted as E[x|u]. The definitions of E[x], E[x|u] and cov(x) can be found in [6] sections B4 and B7.
  • The Gaussian function (shortly noted as Gaussian) of vectors x∈ R n and uRn and matrix P∈ R n×n is defined as G(x,u, P) : R n × R n × R n×n → R , i.e.: G x u P = 1 2 π n / 2 P e - 0.5 x - u T P - 1 x - u .
    Figure imgb0105
  • If p(x) = G(x,u, P), then by definition it holds that E[x] = u and cov(x) = P.
  • The element-wise Dirac-function of vector x ∈ R n , denoted as δ(x) : R n → {0,1} , satisfies: δ x = { 0 if x 0 ̲ , 1 if x 0 ̲ , and - δ x x = 1.
    Figure imgb0106
  • For a vector x ∈ R n and a bounded Borel set [7] Y ⊂ R n , the set PDF is defined as Λ y (x) : R n →{0,v} with v∈ R defined as the Lebesque measure [8] of the set Y , i.e.: Λ Y x = { 0 if x Y , v - 1 if x Y .
    Figure imgb0107
  • 3 Event sampling
  • Many different methods for sampling a vector y(t)∈ Rq can be found in literature. The one mostly used is time sampling in which the k a th
    Figure imgb0108
    sampling instant is defined at time tka := t k a -1k a -1 for some τ k a -1R +. Recall that if y(t) is sampled at ta it is denoted as yka . This method is formalized by defining the observation vector z k a - 1 : = y k a - 1 T t k a - 1 T R q + 1
    Figure imgb0109
    at sampling instant k a-1. Let us define the set Hka (z ka-1)⊂ R containing all the values that t can take between t ka-1 and t ka-1 + τka-1 , i.e.: H k a z k a - 1 : = t R | t k a - 1 t < t k a - 1 + τ k a - 1 .
    Figure imgb0110
  • Then time sampling defines that the next sampling instant, i.e. ka , takes place whenever present time t exceeds the set Hka (z ka-1). Therefore zka is defined as: z k a : = y k a t k a if t H k a z k a - 1 .
    Figure imgb0111
  • In the case of synchronous time sampling τ ka = ts , ∀ka ∈ Z+, which is graphically depicted in Figure 26. Notice that with time sampling, the present time t specifies when samples of y(t) are taken, but time t itself is independent of y(t). As a result y(t) in between the two samples can have any value within R q . Recently, asynchronous sampling methods have emerged, such as, for example "Send-on-Delta" [9, 10] and "Integral sampling" [11]. Opposed to time sampling, these sampling methods are not controlled by time t, but by y(t) itself.
  • Next, we present a general definition of event based sampling, which recovers the above mentioned asynchronous methods, for a particular choice of ingredients. Let us define the observation vector at sampling instant ke -1 as z k e - 1 : = y k e - 1 T t k e - 1 T R q + 1 .
    Figure imgb0112
    With that we define the following bounded Borel set in time-measurement-space, i.e. Hke (z ke-1) ⊂ R q+1 , which depends on both z ke-1 and t. In line with time sampling the next event instant, i.e. ke , takes place whenever y(t) leaves the set Hke (z k e-1, t) as shown in Figure 27 for q = 2. Therefore zke is defined as: z k e : = y k e t k e if y t H k e z k e - 1 t .
    Figure imgb0113
    The exact description of the set Hke (z ke-1, t) depends on the actual sampling method. As an example Hke (z ke-1,t) is derived for the method "Send-on-Delta", with y(t)∈ R. In this case the event instant ke occurs whenever |y(t) - y ke-1| exceeds a predefined level Z, see Figure 28, which results in Hke (z ke-1, t) = {y∈ e RI -Δ<y - y k e -1 <Δ}.
  • In event sampling, a well designed Hke (z ke-1,t should contain the set of all possible values that y(t) can take in between the event instants ke -1 and ke . Meaning that if t ke-1t< tke , then y(t) ∈ Hke (z ke-1,t). A sufficient condition is that y ke-1Hke (z ke-1,t which for "Send-on-Delta" results in y(t)∈ [y ke-1-Δ,y e-1 +Δ] for all t ke-1 ≤ t < tke .
  • 4 Problem formulation: State estimation based on event sampling
  • Assume a perturbed, dynamical system with state-vector x(t)∈ R n , process-noise w(t)∈ R m , measurement-vector y(t)∈ R q and measurement-noise v(t) ∈ R q . This process is described by a state-space model with A τ∈ R n× n , Bτ R n×n and C ∈ R q× n. An event sampling method is used to sample y(t). The model of this process becomes: x t + τ = A τ x t + B τ w t ,
    Figure imgb0114
    y t = Cx t + v t ,
    Figure imgb0115
    z k e = y k e T t k e T if y t H k e z k e - 1 t ,
    Figure imgb0116
    p w t : = G w t , 0 , Q and p v t : = G v t , 0 , V .
    Figure imgb0117
    The state vector x(t) of this system is to be estimated from the observation vectors z0e : ke . Notice that the estimated states are usually required at all synchronous time samples ka , with ts = tka - t ka-1 , e.g., as input to a controller that runs synchronously in time. As such our goal is to construct an event-based state-estimator (EBSE) that provides an estimate of x(t) not only at the event instants tke but also at the sampling instants tka . Therefore, we define a new set of sampling instants tn as the combination of sampling instants due to event sampling, i.e. ke , and time sampling, i.e. ka : t 0 : n - 1 : = t 0 a : k a - 1 t 0 e : k e - 1 and t n : = { t k a if t k a < t k e , t k e if t k a t k e .
    Figure imgb0118
    t 0 < t 1 < < t n , x n : = x t n , y n : = y t n .
    Figure imgb0119
  • The estimator calculates the PDF of the state-vector xn given all the observations until tn . This results in a hybrid state-estimator, for at time tn an event can either occur or not, which further implies that measurement data is received or not, respectively. In both cases the estimated state must be updated (not predicted) with all information until tn . Therefore, depending on t n a different PDF must be calculated, i.e.: if t n = t k a p x n | z 0 e : k e - 1 with t k e - 1 < t k a < t k e ,
    Figure imgb0120
    if t n = t k e p x n | z 0 e : k e .
    Figure imgb0121
    The important parameters for the performance of any state-estimator are the expectation and error-covariance matrix of its calculated PDF. Therefore, from (9) we define: x n | n : = { E x n | z 0 e : k e - 1 if t n = t k a E x n | z 0 e : k e if t n = t k e and P n | n : = cov x n - x n | n .
    Figure imgb0122
    The PDFs of (5) can be described as the Gaussian G(xn,x n|n ,P n|n ). The square root of the eigenvalues of P n|n , i.e. λ i P n | n ,
    Figure imgb0123
    define the shape of this Gaussian function. Together with x n|n they indicate the bound which surrounds 63% of the possible values for xn . This is graphically depicted in Figure 29 for the 1D case and Figure 30 for a 2D case, in a top view. The smaller the eigenvalues λ i (P n|n ) are, the smaller the estimation-error is.
  • As such, the problem of interest in this paper is to construct a state-estimator suitable for the general event sampling method introduced in Section 4 and which is computationally tractable. Furthermore, it is desirable to guarantee that P n|n has bounded eigenvalues for all n.
  • Existing state estimators can be divided into two categories. The first one contains estimators based on time sampling: the (a)synchronous Kalman filter [12, 13] (linear process, Gaussian PDF), the Particle filter [14] and the Gaussian sum filter [4, 5] (nonlinear process, non-Gaussian PDF). These estimators cannot be directly employed in event based sampling as if no new observation vector z ke is received, then tn -tke →∞ and λi (p n|ke-1)→∞. The second category contains estimators based on event sampling. In fact, to the best of our knowledge, only the method proposed in [15] fits this category. However, this EBSE is only applicable in the case of "Send-on-Delta" event sampling and it requires that any PDF is approximated as a single Gaussian function. Moreover, the asymptotic property of P n|n is not investigated in [15].
  • In the next section we propose a novel event-based state-estimator, suitable for any event sampling method, together with a preliminary result on asymptotic analysis.
  • 5 An event-based state estimator
  • The EBSE estimates xn given the received observation vectors until time tn . Notice that due to the definition of event sampling we can extract information of all the measurement vectors y 0:n For with ti ∈ {t 0:n and tje ∈ {t 0e:ke } it follows that: { y i H j e z j e - 1 t i if t j e - 1 t i < t j e , y i = y j e if t i = t j e .
    Figure imgb0124
  • Therefore, from the observation vectors z 0e:ke and (11) the PDFs of the hybrid state-estimation of (5), with the bounded, Borel set Yi c R q , results in: p x n | y 0 Y 0 , y 1 Y 1 , , y n Y n with 12 a Y i : = { H j e z j e - 1 t i if t j e - 1 < t i < t j e , y j e if t i = t j e . 12 b
    Figure imgb0125
  • For brevity (12a) is denoted as P(xn | y 0:n Y 0:n ) and with Bayes-rule [16] yields: p x n | y 0 : n Y 0 : n : = p x n | y 0 : n - 1 Y 0 : n - 1 p y n Y n | x n p y n Y n | y 0 : n - 1 Y 0 : n - 1 .
    Figure imgb0126
  • To have an EBSE with low processing demand, multivariate probability theory [17] is used to make (13) recursive: p a | b : = - p a | c p c | b c
    Figure imgb0127
    p x n | y 0 : n - 1 Y 0 : n - 1 = - p x n | x n - 1 p x n - 1 | y 0 : n - 1 Y 0 : n - 1 x n - 1 ,
    Figure imgb0128
    p y n Y n | y 0 : n - 1 Y 0 : n - 1 : = - p x n | y 0 : n - 1 Y 0 : n - 1 p y n Y n | x n x n .
    Figure imgb0129
  • The calculation of p(xn |y 0:n Y 0:n ) is done in three steps: 1. Assimilate p(yn Yn |xn ) for both tn = tke and tn =tka . 2. Calculate p(xn | y 0:n Y 0:n ) as a summation of N Gaussians. 3. Approximate p(xn | y 0:n Y 0:n ) as a single Gaussian function. The reason for this last step is to design an algorithm in which p(xn I y 0:n Y0:n ) is described by a finite set of Gaussians and therefore attain computational tractability. Notice that (19) gives a unified description of the hybrid state-estimator, which makes an asymptotic analysis of the EBSE possible, as it will be shown later in this section.
  • 5.1 Step 1: measurement assimilation
  • This section gives a unified formula of the PDF p(yn ∈ Yn | xn ) valid for both tn = tke e and tn = tka . From multivariate probability theory [17] and (7b8) we have: p y n Y n | x n : = - p y n | x n p y n Y n y n and p y n | x n = G y n Cx n V .
    Figure imgb0130
  • The PDF p(yn Yn ) is modeled as a uniform distribution for all yn Yn . Therefore, depending on the type of instant, i.e. event or not, we have: p y n Y n : = { Λ H k e y n if t k e - 1 < t n < t k e , δ y n - y k e if t n = t k e .
    Figure imgb0131
  • Substitution of (16) into (15) gives that p(yn Yn |xn )=G(yke ,Cxn,V) if tn = tke . However, if tn = tka then p(yn Yn |xn ) equals Λ H k e
    Figure imgb0132
    (yn ), which is not necessarily Gaussian. Moreover, it depends on the set Hke and therefore on the actual event sampling method that is employed. In order to have a unified expression of p(yn Yn | xn ) for both types of tn , independent of the event sampling method, Λ H k e
    Figure imgb0133
    (yn ) can be approximated as a summation of N Gaussians, i.e. Λ H k e y n ) i = 1 N α n i G y n y n i V n i and i = 1 N α n i : = 1.
    Figure imgb0134

    This is graphically depicted in Figure 31 for yn ∈ R2. The interested reader is referred to [4] for more details.
  • Substituting (17) into (16) yields the following p(yn Yn | xn ) if tn = tka : p y n Y n | x n i = 1 N α n i - G y n Cx n V G y n y n i V n i d y n .
    Figure imgb0135
  • Proposition 1. [12, 14] Let there exist two Gaussians of random vectors x∈ R" and m ∈ Rq, with Γ∈ R q×n : G(m,Γx,M) and G(x, u, U). Then they satisfy: - G x u U G m , Γ x , M dx = G Γ u , m , Γ U Γ T + M ,
    Figure imgb0136
    G x u U G m , Γ x , M dx = G x d D G m , Γ u , Γ U Γ T + M , with D : = U - 1 + Γ T M - 1 Γ - 1 and d : = DU - 1 u + D Γ T M - 1 m .
    Figure imgb0137
  • Applying Proposition 1 ((19) to be precise) and G(x, y,Z) = G(y,x,Z) on (18) yields: p y n Y n | x n i = 1 N α n i G y n i , Cx n , V + V n i , if t n = t k a .
    Figure imgb0138
  • In conclusion we can state that the unified expression of the PDF p(yn Yn |xn ), at both tn = tk and tn = tka , for any event sampling method results in: p y n Y n | x n i = 1 N α n i G y n i Cx n R n i with R n i : = V + V n i .
    Figure imgb0139
  • If tn = tke the variables of (30) are: N = 1, α n 1 = 1 , y n 1 = y k e
    Figure imgb0140
    and V n 1 = 0 ̲ .
    Figure imgb0141
    If tn = tka the variables depend on Λ H k e
    Figure imgb0142
    (yn ) and its approximation. As an example these variables are calculated for the method "Send-on-Delta" with y ∈ R. In "Send-on-Delta", for certain N , the approximation of Λ H k e
    Figure imgb0143
    (yn ), as presented in (17), is obtained with i∈ {1,2,..., N} and: y n i = y k e - 1 - N - 2 i - 1 - 1 2 N 2 Δ and α n i = 1 / N , V n i = 2 Δ N 2 0.25 - 0.05 e - 4 N - 1 15 - 0.08 e - 4 N - 1 180 , i .
    Figure imgb0144
  • With the result of (22), p( Xn |y 0:n Y 0:n ) can also be expressed as a sum of N Gaussians.
  • 5.2 Step 2: state estimation
  • First the PDF p(xn |y0:n∈Y0:n-1 ) of (14b) is calculated. From the EBSE we have p(xn-1 | y 0:n-1)∈ Y 0:n-1) := G(xn-1, x n-1|n-1|n-1, Pn-1|n-1|n-1) and from (7) with τ n := tn - tn-1, we have p x n | y n - 1 : = G x n , A τ n , x n - 1 , B τ n Q τ n T .
    Figure imgb0145
    Therefore using (19) in (14b) yields: p x n | y 0 : n - 1 Y 0 : n - 1 = G x n x n | n - 1 P n , n - 1 with x n | n - 1 : = A τ n x n - 1 | n - 1 and P n | n - 1 : = A τ n P n - 1 | n - 1 A τ n T + B τ n Q B τ n T .
    Figure imgb0146
  • Next p(xn |y 0:n Y 0:n ), defined in (13), is calculated after multiplying (22) and (24): p x n | y n - 1 Y 0 : n - 1 p y n Y n | x n i = 1 N α n i G x n x n | n - 1 P n | n - 1 G y n i Cx n R n i .
    Figure imgb0147
  • Equation (33) is explicitly solved by applying Proposition 1: p x n | y 0 : n - 1 Y 0 : n - 1 p y n Y n | x n i = 1 N α n i β n i G x n x n i P n i
    Figure imgb0148
    x n i : = P n i P n | n - 1 - 1 x n | n - 1 + C T R n i - 1 y n i , P n i : = P n | n - 1 - 1 + C T R n i - 1 C - 1 and β n i : = G y n i , Cx n | n - 1 , CP n | n - 1 C T + R n i .
    Figure imgb0149
  • The expression of p(xn | y 0:n Y 0:n ) as a sum of N Gaussians is the result of the following substitutions: (26) into (13), (26) into (14c) to obtain p(yn ∈ Yn | y 0:n-1Y 0:n-1) and the latter into (13) again. This yields p x n | y 0 : n Y 0 : n i = 1 N α n i β n i i = 1 N α n i β n i G x n x n i P n i .
    Figure imgb0150
  • The third step is to approximate (27) as a single Gaussian to retrieve a computationally tractable algorithm. For if both p(x n-1 |y 0:n-1Y 0:n-1) and p(yn Yn |xn ) are approximated using N Gaussians, the estimate of xn in (36) is described with Mn Gaussians. The value of Mn equals M n-1 N, meaning that Mn increases after each sample instant and with it also the processing demand of the EBSE increases.
  • 5.3 Step 3: state approximation
  • p(xn |y 0:n Y 0:n ) of (27) is approximated as a single Gaussian with an equal expectation and covariance matrix, i.e.: p x n | y 0 : n Y 0 : n G x n x n | n P n | n
    Figure imgb0151
    x n | n : = i = 1 N α n i β n i x n i i = 1 N α n i β n i , P n | n : i = 1 N α n i β n i i = 1 N α n i β n i P n i + x n | n - x n i x n | n - x n i T .
    Figure imgb0152
  • The expectation an covariance of (27), equal to x n|n and P n|n of (28), can be derived from the corresponding definitions. Notice that because the designed EBSE is based on the equations of the Kalman filter, the condition of computational tractability is met.
  • 5.4 Asymptotic analysis of the error-covariance matrix
  • In this section we investigate the asymptotic analysis of the error-covariance matrix of the developed EBSE. By this we mean that we analyze lim n→∞ P n|n, which for convenience is denoted as P . Note that for the classical Kalman filter (KF) [12] such an analysis is already available. However, for any other type of estimator asymptotic analysis remains a very challenging problem, which is why in most cases it is not even considered.
  • Let us first recall the result on the asymptotic analysis of the Kalman filter. If x(t) of (7) is estimated, directly from y(t), with the KF at synchronous sampling times tn :=n ts ' then P n|n is updated as follows: P n | n = A t s P n - 1 | n - 1 A t s T + B t s Q B t s T - 1 + C T V - 1 C - 1 .
    Figure imgb0153
  • In [18, 19] it is proven that if the eigenvalues of Ats , are within the unit circle and (Ats , C) is observable, then P = PK . The matrix PK equals the solution of: P K = A t s P K A t s T + B t s Q B t s T - 1 + V - 1 - 1 .
    Figure imgb0154
  • For the EBSE however, we cannot prove that P equals a constant matrix. Instead we will prove that all the eigenvalues of P are bounded, i.e. that λ max (P ) <∞. As described in Section 4 this is a valid indication of an estimator's performance.
  • The main result of this section is obtained under the standing assumption that Λ Hke is approximated using a single Gaussian. Note that the result then also e applies to the estimator presented in [15], as a particular case. We assume that the eigenvalues of the A τn -matrix are within the unit-circle and (Aτn , C) is an observable pair. The following technical Lemmas will be of use.
  • Lemma 1. Given the process model (7) and covariance matrices P ≻0 0 and Q≻0 0 , then for any 0 < τ1≤τ2 we have that N = 1, and N = 1, See the Appendix for the proof.
  • Lemma 2. Let any square matrices V 1 ºV 2 and W 1 ºW 2, with V 1 ±0 and W 1 ±0 be given.
  • Suppose that the matrices U 1 and U 2 are defined as U 1 := (V 1 -1 +CTW 1 -1 C)-1 and U 2 : = V 2 - 1 + C T W 2 - 1 C - 1 ,
    Figure imgb0155
    for any C of suitable size. Then it holds that U 1 °U2.
  • Proof. From [20] we have that V 1 -1 ±V 2 -1 and CTW 1 -1 C± CTW 2 -1 C . Hence, it follows that V 1 -1 + CTW 1 -1 C±V 2 -1 +CTW 2 -1 C, which yields N = 1, Thus, U 1 ºU 2' which concludes the proof. □
  • Next, recall that H k e (yn ) is assumed to be a bounded set. Therefore, it is reasonable to further assume that H k e
    Figure imgb0156
    can be approximated using the formula (17), for N =1, and that there exists a constant matrix V such that V n l V
    Figure imgb0157
    for all n.
  • Theorem 1. Suppose that the EBSE, as presented in Section 5, approximates H k e
    Figure imgb0158
    according to (17) with N =1 and the above assumptions hold. Then λmax (P ) < λmax (PK ), where K is equal to the solution of P ˜ K = A t S P ˜ K A t S + B t S Q B t S T - 1 + V + V - 1 - 1 .
    Figure imgb0159
  • See the Appendix for the proof.
  • 6 Illustrative example
  • In this section we illustrate the effectiveness of the developed EBSE in terms of state-estimation error, sampling efficiency and computational tractability. The case study is a 1D object-tracking system. The states x(t) of the object are position and speed while the measurement vector y(t) is position. The process-noise w(t) represents the object's acceleration. Then given a maximum acceleration of 0.5[m/s 2] its corresponding Q, according to [21], equals 0.02. Therefore the model as presented in (7) yields A = 1 τ 0 1 , B = τ 2 τ 2 ̲ ,
    Figure imgb0160
    N = 1, C = (1 0) and D = 0, which is in fact a discrete-time double integrator. The acceleration in time is shown in Figure 32 together with the object's position and speed. The sampling time is ts = 0.1 and the measurement-noise covariance is V = 0.1 10-3.
  • Three different estimators are tested. The first two estimators are the EBSE and the asynchronous Kalman filter (AKF) of [13]. For simplicity, in both estimators we used the "Send-on-Delta" method with Δ= 0.1 [m] . For the EBSE we approximated Λ Hke (yn ) using (23) with N = 5. The AKF estimates the states only at the event instants tke - The states at tka are calculated by applying the prediction. step of (14b). The third estimator is based on the quantized Kalman filter (QKF) introduced in [21] that uses synchronous time sampling of yka . The QKF can deal with quantized data, which also results in less data transfer, and therefore can be considered as an alternative to EBSE. In the QKF y ka is the quantized version of yka with quantization level 0.1, which corresponds to the "Send-on-Delta" method. Hence, a comparison can be made.
  • In Figure 33 and Figure 34 the state estimation-error of the three estimators is plotted. They show that the QKF estimates the position of the object with the least error. However, its error in speed is worse compared to the EBSE. Further, the plot of the AKF clearly shows that prediction of the state-estimates gives a significant growth in estimation-error when the time between the event sampling-instants increases (t > 4).
  • Beside estimation error, sampling efficiency η is also important due to the increased interest in WSNs. For these systems communication is expensive and one aims to have the least data transfer. We define η R + as η : = x i - x i | i T x i - x i | i x i - x i | i - 1 T x i - x i | i - 1 ,
    Figure imgb0161
    which is a measure of the change in the estimation-error after the measurement update with either zke or y ka was done. Notice that if η < 1 the estimation error decreased after an update, if η > 1 the error increased and if η =1 the error remained the same. For the EBSE i = ke with i -1 equal to ke -1 or ka -1. For the AKF i = ke with i -1= ke -1. For the QKF i = ka and i -1= ka -1. Figure 35 shows that for the EBSE η < 1 at all instants n. The AKF has one instant, t = 3.4, at which η > 1. In case of the QKF the error sometimes decreases but it can also increase considerably after an update. Also notice that η of the QKF converges to 1. Meaning that for t > 5.5 the estimation error does not change after an update and new samples are mostly used to bound λi(P kalka ). The EBSE has the same property, although for this method the last sample was received at t = 4.9.
  • The last aspect on which the three estimators are compared is the total amount of processing time which was needed to estimate all state-vectors. For the EBSE, both xke and xka were estimated and it took 0.094 seconds. The AKF estimated xke and predicted xka in a total time of 0.016 seconds and the QKF estimated xka and its total processing time equaled 0.022 seconds. This means that although the EBSE results in the most processing time, it is computationally comparable to the AKF and QKF, while it provides an estimation-error similar to the QKF, but with significantly less data transmission. As such, it is most suited for usage in networks in general and WSNs in particular.
  • 7 Conclusions
  • In this paper a general event-based state-estimator was presented. The distinguishing feature of the proposed EBSE is that estimation of the states is performed at two different type of time instants, i.e. at event instants tke , when measurement data is used for update, and at synchronous time sampling tka , when no measurement is received, but an update is performed based on the knowledge that the monitored variable lies within a set used to define the event. As a result, it could be proven that, under certain assumptions, for the error-covariance matrix of the EBSE it holds that λmax (P ) < ∞, even in the situation when no new observation Zke is received anymore. Its effectiveness for usage in WSNs has been demonstrated on an application example.
  • References
    1. 1. I.F. Akyildiz, W. Su, Y. Sankarasubramaniam and E. Cayirci, "Wireless Sensor Networks: a survey," Elsevier, Computer Networks, vol. 38, pp. 393-422, 2002.
    2. 2. E. Johannesson, T. Henningsson, and A. Cervin, "Sporadic control of first-order lineair stochastic systems," in Hybrid Systems: Computation and Control, ser. Lecture Notes in Computer Science, vol. 4416. Pisa, Italy: springer Verlag, 2007, pp. 301-314.
    3. 3. W.P.M.H. Heemels, J.H. Sandee, and P.P.J. van den Bosch, "Analysis of event-driven controllers for lineair systems," International Journal of Control, vol. 81, no. 4, 2008.
    4. 4. H.W. Sorenson and D.L. Alspach, "Recursive Bayesianestimation using Gaussian sums," Automatica, vol. 7, pp. 465-479, 1971.
    5. 5. J.H. Kotecha and P.M. Djurié, "Gaussian sum particle filtering," IEEE Transaction Signal Processing, vol. 51, no. 10, pp. 2602-2612, 2003.
    6. 6. N.L. Johnson, S. Kotz, and W. Kemp, Univariate discrete distributions. John Wiley and Sons, 1992.
    7. 7. L. Aggoun and R. Elliot, Measure Theory and Filtering. Cambridge University Press 2004.
    8. 8. H.L. Lebesque, "Integrale, longueur, aire," Ph.D. dissertation, University of Nancy, 1902.
    9. 9. K.J. Åström and B.M. Bernhardsson, "Comparison of Riemann and Lebesque sampling for first order stochastic systems," in 41st IEEE Conf. on Dec. and Contr., Las Vegas, USA, 2002.
    10. 10. M. Miskowicz, "Send-on-Delta concept: an event-based data-reporting strategy," Sensors, vol. 6, pp. 49-63, 2006.
    11. 11. , "Asymptotic Effectiveness of the Event-Based Sampling according to the Integral Criterion," Sensors, vol. 7, pp. 16-37, 2007.
    12. 12. R.E. Kalman, "A new approach to lineair filtering and prediction problems," Transaction of the ASME Journal of Basic engineering, vol. 82, no. D, pp. 35-42, 1960.
    13. 13. M. Mallick, S. Coraluppi, and C. Carthel, "Advances in Asynchronous and Decentralized Estimation," in Proceeding of the 2001 Aerospace Conference, Big Sky, MT, USA, 2001.
    14. 14. B. Ristic, S. Arulampalam, and N. Gordon, Beyond the Kalman filter: Particle filter for tracking applications. Boston, Massachusetts: Artech House, 2004.
    15. 15. V.H. Nguyen and Y.S. Suh, "Improving estimation performance in Networked Control Systems applying the Send-on-delta transmission method," Sensors, vol. 7, pp. 2128-2138, 2007.
    16. 16. K.V. Mardia, J.T. Kent, and J.M. Bibby, Multivariate analysis. Academic press, London, 1979.
    17. 17. D.C. Montgomery and G.C. Runger, Applied Statistics and Probability for Engineers. John Wiley and Sons, 2007.
    18. 18. M.L.J. Hautus, "Controllability and observability conditions of lineair autonomous systems," in Indagationes Mathemathicae, vol. 32, pp. 448-455.
    19. 19. A.V. Balakrishnan, Kalman Filtering Theory. Optimization Software, New York, 1987.
    20. 20. D.S. Bernstein, Matrix Mathematics. Princeton University Press, 2005.
    21. 21. R.E. Curry, Estimation and control with quantized measurements. Boston, Massachusetts: MIT Press, 1970.
    22. 22. G.F. Franklin, J.D. Powel, and A. Emami Naeini, Feedback control dynamic systems. Addison-Wesley, 1995.
    A Proof of Lemma 1
  • Suppose that AR n×n and B∈ R n×m are defined as the state-space matrices for the time-continuous counterpart of (7). Then it is known [22] that for any sampling period τ > 0 , A τ and B τ of (7) are obtained from their corresponding continuous-time matrices A and B as follows: A τ : = e A τ : = i = 0 A i τ i i ! and B τ : = 0 τ e A η d η B : = i = 0 A i B τ i + 1 i + 1 ! .
    Figure imgb0162
  • Using (31) one obtains: A τ 2 PA τ 2 T - A τ 1 PA τ 1 T = i = 0 A i τ 2 i i ! P j = 0 A T j τ 2 i j ! - i = 0 A i τ 1 i i ! P j = 0 A T j τ 1 i j ! =
    Figure imgb0163
    i = 0 j = 0 A i P A T j τ 2 i i ! τ 2 j j ! - i = 0 j = 0 A i P A T j τ 1 i i ! τ 1 j j ! = i = 0 j = 0 A i P A T j τ 1 i + j - τ 1 i + j i ! j !
    Figure imgb0164
  • As for any τ>0 the series e Aτ converges [22], then A τ 2 P A τ 2 T - A τ 1 P A τ 1 T
    Figure imgb0165
    also converges. Then, since 0 <τ1≤τ2 and P ≻ 0, for any fixed i, j , we have A i P A T j τ 2 i + j - τ 1 i + j i ! j ! ± 0
    Figure imgb0166
    for any matrix A and thus, it follows that A τ 2 P A τ 2 T ± A τ 1 P A τ 1 T .
    Figure imgb0167
    The same reasoning can be used to prove that N = 1,
  • B Proof of Theorem 1
  • Under the hypothesis, for the proposed EBSE, P n|n of (6.3), with τ n := tn -t n-1 and N = 1, becomes: P n | n = A τ s P n - 1 | n - 1 A τ n T + B τ n Q B τ n T - 1 + C T R n - 1 C - 1 .
    Figure imgb0168
  • The upper bound on λmax (P ) is proven by induction, considering the asymptotic behavior of a KF that runs in parallel with the EBSE, as follows. The EBSE calculates P n | n 1
    Figure imgb0169
    as (42) and the KF calculates P n | n 2
    Figure imgb0170
    N = 1, as (39) in which V is replaced with R := V + V . Notice that for these estimators we have that τ n ts and Rn °R, for all n. Let the EBSE and the KF start with the same initial covariance matrix P 0.
  • The first step of induction is to prove that N = 1, From the definition of P 1 | 1 1
    Figure imgb0171
    in (42) and P 1 | 1 2
    Figure imgb0172
    N = 1, in (39) we have that P 1 | 1 1 = A τ 1 P 0 A τ 1 T + B τ 1 Q B τ 1 T - 1 + C T R 1 - 1 C - 1
    Figure imgb0173
    N = 1, and
  • Suppose we define V 1 : = A τ 1 P 0 A τ 1 T + B τ 1 Q B τ 1 T , V 2 : = A t s P 0 A t s T + B t s Q B t s T , W 1 : = R 1
    Figure imgb0174
    and W 2:= R. Then W 1 °W 2 and from Lemma 6.4 it follows that V 1ºV 2. Therefore applying Lemma 6.4, with U 1 : = P 1 | 1 1 and U 2 : = P 1 | 1 2 ,
    Figure imgb0175
    N = 1, yields P 1 | 1 1 P 1 | 1 2 .
    Figure imgb0176
  • The second and last step of induction is to show that if P n - 1 | n - 1 1 P n - 1 | n - 1 2 ,
    Figure imgb0177
    then P n | n 1 P n | n 2 .
    Figure imgb0178
    Let V 1 : = A τ n P n - 1 | n - 1 1 A τ n T + B τ n Q B τ n T , V 2 : = A t s P n - 1 | n - 1 2 A t s T + B t s Q B t s T ,
    Figure imgb0179
    and let W 1 := Rn, W 2 := R . Notice that this yields W 1 °W 2. The second condition of Lemma 6.4, i.e. V 1 ºV 2 also holds by applying Lemma 6.4, i.e.
  • N = 1, Hence, applying Lemma 2, with N = 1, and N = 1, yields N = 1,
  • This proves that N = 1, which yields (see e.g., [20]) λ max P 1 λ max P 2 .
    Figure imgb0180
    As P n | n 2
    Figure imgb0181
    N = 1, was calculated with the KF it follows from (30) that P 2 = P ˜ K ,
    Figure imgb0182
    with K as the solution of P ˜ K = A t S P ˜ K A t S T + B t S Q B t S T - 1 + R - 1 - 1 ,
    Figure imgb0183
    which completes the proof.

Claims (10)

  1. Traffic information unit (MD1, MD2, MD3,...) associated with a traffic infrastructure comprising
    - a sensor system comprising a plurality of sensor nodes (10) for sensing vehicles (70A, ...,70E) arranged in the vicinity of a traffic infrastructure (80) for carrying vehicles, communication means (16) being coupled to the sensors, wherein the sensor nodes (10) provide a message (D) indicative for an occupancy status of a detection area of a traffic infrastructure monitored by the sensor nodes,
    - a facility (MI) with a message interpreter (M1) at uses information (D) communicated by the sensor nodes,
    - a facility (T) for transmitting motion state information to a vehicle (70B, 70E) at the traffic infrastructure, the motion state information including motion state information of individual vehicles, including at least the instantaneous position of said individual vehicles,
    characterized in that
    the message interpreter (M1) is a facility for tracking motion state information of traffic present at the traffic infrastructure, wherein the message interpreter further comprises
    - a vehicle database facility (32, 34) comprising motion state information of vehicles present at the traffic infrastructure
    - an association facility (40) for associating the messages (D) provided by the sensor elements (10) with the motion state information present in the vehicle data base facility,
    - a state updating facility (50) for updating the motion state information on the basis of the messages associated therewith,
  2. Traffic information unit according to claim 1, wherein the sensor nodes (10) provide spatial occupancy information with a density higher than 0.6 m-2.
  3. Traffic information unit according to claim 1, wherein the sensor nodes (10) transmit data upon detection of an event indicating the change in their own occupation state.
  4. Traffic information unit according to claim 1, wherein the sensor nodes (10) are embedded in the traffic infrastructure.
  5. Traffic information system comprising at least a first and a second traffic information unit (MD1, MD2, MD3) according to one of the previous claims, the first and the second traffic information unit being associated with mutually neighbouring sections of the traffic infrastructure and being arranged to mutually exchange motion state information of vehicles.
  6. A traffic information system according to claim 5, further comprising at least one client information module (CIM) for providing status information related to the infrastructure (80), the status comprising at least one of an occupation density and an average speed as a function of a position at the traffic infrastructure
  7. A vehicle management system (C) for a target vehicle (70B) comprising a communication system (R) arranged for receiving motion state information relating to surrounding vehicles from a traffic information unit (MD1, MD2, MD3) according to one of the claims 1-4 or from a traffic information system according to claim 5 or 6, inputs (C1) for receiving motion state information from the target vehicle (70B, 70E), and a control system (C2), the motion state information used by the control system comprising motion state information of individual vehicles, including at least the instantaneous position of said individual vehicles,
    characterized in that the control system (C2) has outputs (C3) for providing control signals for controlling a motion state of the vehicle using the motion state information retrieved from the traffic information unit or from the traffic information system.
  8. A vehicle management system (C) according to claim 7, further comprising communication means (R1) for exchanging motion state information with surrounding vehicles and a selection facility (SL) for selecting one or more of motion state information obtained from the surrounding vehicles (VS2) and motion state information received (VS1) from the traffic information system as the motion state information (VS) to be used by the control system (C2).
  9. A vehicle (70B, 70E) comprising a vehicle management system (C) according to claim 7 or 8.
  10. Method of controlling a vehicle instrumented with a vehicle management system according to claim 7 on a traffic infrastructure for carrying vehicles, comprising the steps of
    - observing vehicles from a fixed position by a sensor system comprising a plurality of sensor nodes for sensing vehicles arranged in the vicinity of the traffic infrastructure,
    - communicating the observations by messages to a message interpreter,
    - transmitting said motion state information to the instrumented vehicle, the transmitted motion state information used by the instrumented vehicle comprising motion state information of individual vehicles, including at least the instantaneous position of said individual vehicles.
    characterized in that said message interpreter tracks motion state information of vehicles present at the traffic infrastructure using the communicated observations, by associating the observations communicated to the message interpreter with the motion state information present in a vehicle data base facility, and updating the motion state information on the basis of the messages associated therewith,
    - the instrumented vehicle controlling its own motion state using the vehicle state information.
EP09771424.0A 2008-12-12 2009-12-11 Traffic information unit, traffic information system, vehicle management system, vehicle and method of controlling a vehicle Active EP2370965B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP09771424.0A EP2370965B1 (en) 2008-12-12 2009-12-11 Traffic information unit, traffic information system, vehicle management system, vehicle and method of controlling a vehicle

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP08171579A EP2196973A1 (en) 2008-12-12 2008-12-12 Traffic information unit, traffic information system, vehicle management system, vehicle, and method of controlling a vehicle
EP09771424.0A EP2370965B1 (en) 2008-12-12 2009-12-11 Traffic information unit, traffic information system, vehicle management system, vehicle and method of controlling a vehicle
PCT/NL2009/050760 WO2010068107A1 (en) 2008-12-12 2009-12-11 Traffic information unit, traffic information system, vehicle management system, vehicle, and method of controlling a vehicle

Publications (2)

Publication Number Publication Date
EP2370965A1 EP2370965A1 (en) 2011-10-05
EP2370965B1 true EP2370965B1 (en) 2013-07-31

Family

ID=40627423

Family Applications (2)

Application Number Title Priority Date Filing Date
EP08171579A Withdrawn EP2196973A1 (en) 2008-12-12 2008-12-12 Traffic information unit, traffic information system, vehicle management system, vehicle, and method of controlling a vehicle
EP09771424.0A Active EP2370965B1 (en) 2008-12-12 2009-12-11 Traffic information unit, traffic information system, vehicle management system, vehicle and method of controlling a vehicle

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP08171579A Withdrawn EP2196973A1 (en) 2008-12-12 2008-12-12 Traffic information unit, traffic information system, vehicle management system, vehicle, and method of controlling a vehicle

Country Status (3)

Country Link
EP (2) EP2196973A1 (en)
DK (1) DK2370965T3 (en)
WO (1) WO2010068107A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102021134196B3 (en) 2021-12-22 2022-11-10 Audi Aktiengesellschaft Method for detecting at least a partial area of an area surrounding a motor vehicle with a sensor device, sensor device and motor vehicle

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2974233A1 (en) 2013-03-15 2016-01-20 Dana Limited System and method for data collection and analysis using a multi-level network
CN103578295B (en) * 2013-11-20 2016-04-06 东南大学 A kind of tail of expressway queue rear-end collision risk real-time estimate and prevention method
US9272711B1 (en) 2014-12-31 2016-03-01 Volkswagen Ag Congestion-friendly adaptive cruise control
CN106327919B (en) * 2015-06-20 2020-04-10 联芯科技有限公司 Method for realizing driving warning and system for realizing automatic driving warning
JP7069944B2 (en) * 2018-03-28 2022-05-18 住友電気工業株式会社 Environment detectors, environment detection systems, environment detection methods, and computer programs
KR20210047707A (en) 2019-10-22 2021-04-30 현대자동차주식회사 Platooning management apparatus for providing Platooning information interactively, Server for managing platooning history and method thereof
GB2584964B (en) * 2020-06-29 2021-05-26 I R Kinetics Ltd Systems and methods for interactive vehicle transport networks
GB2585165B (en) * 2020-09-25 2021-08-11 I R Kinetics Ltd Systems and methods for interactive vehicle transport networks

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2002A (en) 1841-03-12 Tor and planter for plowing
DE19956455A1 (en) * 1999-11-24 2001-05-31 Volkswagen Ag Speed and/or distance-regulated driving method involves transmitting signals into vehicle from local detection and transmission equipment to automatically influence vehicle operation
JP3735720B2 (en) * 2003-01-27 2006-01-18 国土交通省国土技術政策総合研究所長 Method for ensuring system safety in a driving support system
DE102004008895A1 (en) * 2004-02-24 2005-09-08 Robert Bosch Gmbh System for controlling and / or regulating driver assistance systems and method related thereto
JP2007241726A (en) * 2006-03-09 2007-09-20 Denso Corp Driving support system, transmitter and receiver
JP4984974B2 (en) * 2007-03-02 2012-07-25 富士通株式会社 Driving support system and in-vehicle device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102021134196B3 (en) 2021-12-22 2022-11-10 Audi Aktiengesellschaft Method for detecting at least a partial area of an area surrounding a motor vehicle with a sensor device, sensor device and motor vehicle

Also Published As

Publication number Publication date
EP2196973A1 (en) 2010-06-16
WO2010068107A1 (en) 2010-06-17
DK2370965T3 (en) 2013-11-04
EP2370965A1 (en) 2011-10-05

Similar Documents

Publication Publication Date Title
EP2370965B1 (en) Traffic information unit, traffic information system, vehicle management system, vehicle and method of controlling a vehicle
Wei et al. A survey on traffic signal control methods
El Faouzi et al. Data fusion for ITS: techniques and research needs
CN111292540B (en) Method, control device and system for determining specific state information
El Faouzi et al. Data fusion in intelligent transportation systems: Progress and challenges–A survey
Buchholz et al. Handling occlusions in automated driving using a multiaccess edge computing server-based environment model from infrastructure sensors
US11891087B2 (en) Systems and methods for generating behavioral predictions in reaction to autonomous vehicle movement
US11715371B2 (en) Collaborative distributed agent-based traffic light system and method of use
US11210937B2 (en) Method for un-signalized intersection traffic flow management
Tan et al. Prediction of transit vehicle arrival time for signal priority control: Algorithm and performance
Bender et al. Predicting driver intent from models of naturalistic driving
US20210146949A1 (en) Localization with Diverse Dataset for Autonomous Vehicles
KR20230156414A (en) Method for generating a map showing collision probability
CN109211247B (en) Space-time partition model and use method thereof
US20210256849A1 (en) Process and system for local traffic approximation through analysis of cloud data
CN117387647A (en) Road planning method integrating vehicle-mounted sensor data and road sensor data
EP2374117B1 (en) Vehicle tracking system, vehicle infrastructure provided with vehicle tracking system and method for tracking vehicles
Worrall et al. A probabilistic method for detecting impending vehicle interactions
US20230182734A1 (en) Vehicle localization
Wang et al. Hierarchical speed planner for automated vehicles: A framework for lagrangian variable speed limit in mixed autonomy traffic
Kaur et al. RFID based Intelligent Transport System with RSU Communication for Emergency Vehicles in Urbanization
Daaif et al. An efficient distributed traffic events generator for smart highways
Peng et al. A kalman filter based information fusion method for traffic speed estimation
Formosa et al. An experiment and simulation study on developing algorithms for CAVs to navigate through roadworks
Hajbabaie et al. Dynamic Speed Harmonization in Connected Urban Street Networks: Improving Mobility

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110629

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIN1 Information on inventor provided before grant (corrected)

Inventor name: NELISSE, MARTIN WILLEM

Inventor name: THEEUWES, JOHANNES ADRIANUS CORNELIS

Inventor name: DRIESSEN, BARTHOLOMEUS, JOANNES, FRANCISCUS

Inventor name: SIJS, JORIS

Inventor name: DOODEMAN, GERARDUS JOHANNES NICOLAAS

Inventor name: PAPP, ZOLTAN

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 625033

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602009017672

Country of ref document: DE

Effective date: 20130926

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20131031

Ref country code: DK

Ref legal event code: T3

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: NL

Ref legal event code: T3

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 625033

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130731

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131202

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131130

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131101

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20140502

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602009017672

Country of ref document: DE

Effective date: 20140502

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131211

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131211

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20091211

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130731

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230522

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231220

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20231220

Year of fee payment: 15

Ref country code: NL

Payment date: 20231220

Year of fee payment: 15

Ref country code: FR

Payment date: 20231221

Year of fee payment: 15

Ref country code: DK

Payment date: 20231227

Year of fee payment: 15

Ref country code: DE

Payment date: 20231214

Year of fee payment: 15