EP3671687A1 - Traffic light prediction - Google Patents
Traffic light prediction Download PDFInfo
- Publication number
- EP3671687A1 EP3671687A1 EP18213035.1A EP18213035A EP3671687A1 EP 3671687 A1 EP3671687 A1 EP 3671687A1 EP 18213035 A EP18213035 A EP 18213035A EP 3671687 A1 EP3671687 A1 EP 3671687A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- traffic light
- cloud
- vehicle
- green
- intersection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0108—Measuring and analyzing of parameters relative to traffic conditions based on the source of data
- G08G1/0112—Measuring and analyzing of parameters relative to traffic conditions based on the source of data from the vehicle, e.g. floating car data [FCD]
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0137—Measuring and analyzing of parameters relative to traffic conditions for specific applications
- G08G1/0145—Measuring and analyzing of parameters relative to traffic conditions for specific applications for active traffic flow control
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096766—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
- G08G1/096775—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is a central station
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0137—Measuring and analyzing of parameters relative to traffic conditions for specific applications
- G08G1/0141—Measuring and analyzing of parameters relative to traffic conditions for specific applications for traffic information dissemination
Definitions
- the present disclosure relates generally to the field of traffic light prediction. More particularly, it relates to detecting patterns in traffic light behaviours.
- An objective of traffic lights may typically be to control competing flows of traffic.
- Conventional traffic light systems use pre-programmed timing schedules.
- Another way to improve traffic flow where pre-programmed timing schedules are used is to suggest suitable speeds to vehicles, allowing them to pass through an intersection during the green interval.
- information about the traffic light state must be available. Typically, this information is provided either by infrastructure-to-vehicle communication or infrastructure-to-cloud-to-vehicle communication meaning that the traffic light must be connected in some way to the infrastructure.
- the physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
- An object of some embodiments is to provide alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure.
- this is achieved by a method for detecting patterns in traffic light behaviours.
- the method comprises scanning an intersection by a cloud connected vehicle using on-board sensors and analysing the scanning information in the cloud.
- the method further comprises predicting a traffic light state in the cloud based on the analysis of the scanning information and displaying the predicted traffic light state in the vehicle.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
- the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
- the predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- the scanning of the intersection comprises scanning traffic light states and traffic flows.
- An advantage of some embodiments is that the scanning information provides data for training the modelling of the traffic conditions and competing flows of traffic in the cloud.
- the scanning information of the traffic flows comprises time, position of vehicles, number of vehicles and direction of vehicles.
- An advantage of some embodiments is that the scanning information provides further detailed data for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
- the scanning of the intersection comprises any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
- An advantage of some embodiments is that the scanning information provides data at different points in time and at different points in the intersection for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
- the method further comprises sending a continuous stream of scanning information from the vehicle to the cloud in response to the scanning of the intersection.
- An advantage of some embodiments is that the continuous scanning information provides a non-interrupted stream of data for a more correct training of the modelling of the traffic conditions and competing flows of traffic in the cloud.
- the analysing of the scanning information in the cloud comprises analysis patterns.
- An advantage of some embodiments is that patterns in traffic light behaviours may be discerned.
- the method further comprises receiving at the vehicle the predicted traffic light state from the cloud.
- vehicle speed may be adapted according to the predicted traffic light state e.g. for autonomous driving.
- the predicted traffic light state comprises a recommended velocity so that that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
- a second aspect is a computer program product comprising a non-transitory computer readable medium, having thereon a computer program comprising program instructions.
- the computer program is loadable into a data processing unit and configured to cause execution of the method according to the first aspect when the computer program is run by the data processing unit.
- a third aspect is an apparatus for detecting patterns in traffic light behaviours.
- the apparatus comprises a memory comprising executable instructions and one or more processors configured to communicate with the memory.
- the one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a cloud in response to the scan.
- the one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the cloud and display the predicted traffic light state.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
- the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
- the predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- the one or more processors are further configured to cause the apparatus to further receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
- the one or more processors are further configured to cause the apparatus to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
- the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
- a fourth aspect is a vehicle comprising the apparatus of the third aspect.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
- the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
- the predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- the cloud service comprises controlling circuitry configured to receive a continuous stream of scanning information of an intersection obtained from on-board sensors from a cloud connected vehicle and analyse the scanning information in response to reception of the stream of scanning information.
- the controlling circuitry of the cloud service is further configured to predict a traffic light state based on the analysis of the scanning information and provide the predicted traffic light state to the cloud connected vehicle.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
- the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
- the predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- controlling circuitry of the cloud service is further configured to provide a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
- a sixth aspect is a system for detecting patterns in traffic light behaviours.
- the system comprises a scanning module configured to scan an intersection and a transmitting module configured to send a continuous stream of scanning information.
- the system further comprises an analysis module configured to analyse the scanning information and a prediction module configured to predict a traffic light state based on the analysis of the scanning information.
- the system furthermore comprises a receiving module configured to receive the predicted traffic light state and a display module configured to display the predicted traffic light state.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
- the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
- the predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- the receiving module is further configured to receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green e.g. for autonomous driving.
- the display module is further configured to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
- the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
- any of the above aspects may additionally have features identical with or corresponding to any of the various features as explained above for any of the other aspects.
- Traffic lights which are not connected to the infrastructure are hereinafter denoted as non-connected traffic lights.
- a pattern comprises regularities in data and classification of data into different categories to discern the way in which something happens or is done.
- FIG. 1 is a flowchart illustrating example method steps according to some embodiments.
- the pattern detection method 100 is for detecting patterns in traffic light behaviours.
- the pattern detection method 100 may, for example, be performed by the pattern detection system 200 of Figure 2 for detecting patterns in traffic light behaviours.
- the pattern detection method 100 comprises following steps.
- step 110 an intersection is scanned, i.e., monitored, by a cloud connected vehicle using on-board sensors.
- a cloud connected vehicle is capable of Vehicle to Cloud (V2C) communication.
- V2C Vehicle to Cloud
- the V2C technology enables an exchange of information of the vehicle or information obtained by the vehicle with a cloud system or a cloud service. This allows the vehicle to use information from other cloud connected vehicles, though the common cloud system or cloud service.
- the on-board sensors may comprise detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
- the cloud connected vehicle may comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization.
- step 130 the scanning information is analysed in the cloud.
- the analysis may be performed in a scalable cloud system or cloud service configured for big data analytics.
- Big data analytics is often a complex process of examining large and varied data sets, i.e., big data, to uncover information including hidden patterns, unknown correlations, trends and preferences for making informed decisions or predictions.
- a traffic light state is predicted in the cloud based on the analysis of the scanning information.
- step 160 the predicted traffic light state is displayed in the cloud connected vehicle e.g. on the dashboard, in a head-up display or in a Human Machine Interface in the vehicle.
- the pattern detection method 100 further comprises the following step.
- a continuous stream of scanning information is sent from the cloud connected vehicle to the cloud in response to the scanning of the intersection.
- the continuous stream of scanning information may form part of big data to be analysed by a cloud service.
- the pattern detection method 100 further comprises the following step.
- step 150 the predicted traffic light state from the cloud is received at the cloud connected vehicle.
- the receiving may be performed by receiving circuitry configured for V2C comprised in the vehicle.
- the scanning of the intersection may comprise scanning traffic light states and traffic flows.
- the scanning information of the traffic flows may comprise time, position of vehicles, number of vehicles and direction of vehicles.
- the scanning of the intersection may comprise any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
- the analysing of the scanning information in the cloud may comprise analysis patterns, i.e., software analysis patterns in software engineering being conceptual models, which capture an abstraction of a situation often encountered in modelling.
- An analysis pattern can be represented as a group of related, generic objects (e.g. meta-classes) with stereotypical attributes (e.g. data definitions), behaviours (e.g. method signatures), and expected interactions defined in a domain-neutral manner.
- Examples of analysis patterns may be a time to change traffic light state, a sequence of traffic light states (depending on e.g. time, date, holidays etc.), discrepancies of patterns, cause of discrepancies of patterns (e.g. priority to busses, road construction, emergency vehicles, pedestrian crossing road etc.)
- the predicted traffic light state may comprise a recommended velocity so that that cloud connected vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- An example of the recommended velocity may be "Maintain speed at 30km/h” and an example of a probability value may be "95%", i.e., a probability of 95% that the traffic light state will be green at arrival at the intersection.
- Figure 2 is a schematic overview illustrating an example system according to some embodiments.
- the pattern detection system 200 is for detecting patterns in traffic light behaviours.
- the pattern detection system 200 may, for example, be utilized for an environment 300a of Figure 3a and/or for an environment 300b of Fig 3b .
- a cloud connected vehicle 201 comprises an apparatus for detecting patterns in traffic light behaviours.
- the apparatus comprises a memory comprising executable instructions, wherein one or more processors are configured to communicate with the memory.
- the one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a cloud 202 in response to the scan.
- the one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the cloud 202 and display the predicted traffic light state in the vehicle 201.
- the cloud connected vehicle 201 scans, i.e., monitors, the environment in proximity of the vehicle 201, e.g. lane markings, other vehicles in other lanes or in the same lane, pedestrians, cyclists, road signs, the intersection, the non-connected traffic lights 205 and their current states using the on-board sensors which may comprise e.g. detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
- the on-board sensors may comprise e.g. detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
- the cloud connected vehicle 201 may, in addition, comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization.
- the cloud connected vehicle 201 may send a continuous stream of scanning information 206 obtained by the on-board sensors, as described above, to the cloud 202 for analysis and prediction.
- the cloud 202 comprises at least one cloud database 204 and/or at least one server database 203 which are databases that typically run on a cloud computing platform and access to it is provided as a service.
- the database services may provide scalability and high availability of the at least one database.
- the cloud 202 may be comprised in a one separate cloud service or in a plurality of associated cloud services.
- Any cloud connected vehicle 201 may be connected to the cloud 202 for data measuring and information consumption.
- the cloud connected vehicle 201 may obtain data e.g. via the on-board sensors, and send the data to the cloud 202 for data measuring.
- the cloud connected vehicle 201 may consume data/information from the cloud 202 even if the cloud connected vehicle 201 has not sent data to the cloud 202, e.g. because of lack on-board sensors, but is still capable of consuming data/information from the cloud 202 as long as it is connected to the cloud 202 and able to position itself.
- An example of a data/information consuming connected vehicle 201 may be a bus or a truck etc.
- algorithms e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, create a model capable of predicting the state of the traffic lights including a probability estimate for an environment, e.g. an intersection, based on input parameters, i.e., scanning information, such as where other vehicles are detected in relation to the cloud connected vehicle 201 and how many other vehicles there are, which vehicles are currently driving through e.g. an intersection indicating which traffic light 205 is green, time of day, pedestrians at crosswalks (waiting or walking) and how many pedestrians there are.
- scanning information such as where other vehicles are detected in relation to the cloud connected vehicle 201 and how many other vehicles there are, which vehicles are currently driving through e.g. an intersection indicating which traffic light 205 is green, time of day, pedestrians at crosswalks (waiting or walking) and how many pedestrians there are.
- the cloud 202 can then provide other cloud connected vehicles approaching the same non-connected traffic light 205 a prediction of the state of the non-connected traffic light 205 so that the cloud connected vehicle 201 is able to adapt by e.g. adapting its speed (manually or automatically) to an optimal speed from e.g. an energy or an environment perspective.
- the cloud 202 receives a continuous stream of scanning information 206 of an environment, e.g. an intersection, obtained from the on-board sensors from the cloud connected vehicle 201.
- the cloud 202 analyses the scanning information in response to reception of the stream of scanning information.
- the cloud 202 predicts a traffic light state based on the analysis of the scanning information.
- the cloud 202 may predict the traffic light state based on the scanning information obtained from the cloud connected vehicle 201 and also from scanning information obtained by other cloud connected vehicles of which scanning information may be comprised in the databases 203,204.
- the analysis of the scanning information is performed by algorithms, e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, which create a model of the intersection's traffic lights statuses which is continuously improved, i.e. trained, as long as new scanning information becomes available.
- algorithms e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, which create a model of the intersection's traffic lights statuses which is continuously improved, i.e. trained, as long as new scanning information becomes available.
- An example of this may be a cloud connected vehicle 201 that is capable of detecting necessary parameters of e.g. an intersection reports that it is standing still at a red non-connected traffic light but no other vehicles are detected, a rudimentary model in this case is to just assume (or based on previous experience from other intersections) that non-connected traffic light will turn green shortly. This information can be used to roughly estimate a recommended vehicle speed for other cloud connected vehicles that are approaching the intersection in the same direction.
- the cloud 202 provides the predicted traffic light state 207 to the cloud connected vehicle 201.
- the cloud connected vehicle 201 may further receive a recommended velocity to keep such that cloud connected vehicle 201 reaches the non-connected traffic light 205 at green and/or a probability value of reaching the traffic light at green.
- the cloud connected vehicle 201 may further display the recommended velocity to keep such that cloud connected vehicle 201 reaches the non-connected traffic light 205 at green and/or the probability value of reaching the traffic light at green.
- Figure 3a is a schematic drawing illustrating an example environment according to some embodiments.
- the pattern detection system 200 illustrated in Figure 2 may, for example, be utilized for an environment 300a of Figure 3a .
- Figure 3a illustrates an environment comprising a cloud connected vehicle 301, connected to cloud 302, driving on a road towards a non-connected traffic light 305.
- the cloud connected vehicle 301 receives from the cloud 302 a predicted traffic light state e.g. a recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or a probability value of reaching the non-connected traffic light 305 at green.
- the cloud connected vehicle 301 is further configured to display the received recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light 305 at green.
- the predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic 305 light at green.
- Figure 3b is a schematic drawing illustrating an example environment according to some embodiments.
- the pattern detection system 200 illustrated in Figure 2 may, for example, be utilized for an environment 300b of Figure 3b .
- Figure 3b illustrates an environment comprising a plurality of cloud connected vehicles 301, connected to cloud 302, driving towards/through/leaving an intersection in different directions.
- the cloud connected vehicle 301 scans, i.e., monitors, the state of the non-connected traffic lights 305 for each direction, senses or approximates the number of other vehicles in its proximity with respect to the non-connected traffic lights 305 and senses any pedestrians next to the road or crossing the road, including their position.
- the cloud connected vehicle 301 may sense arrows on the road or on road signs, indicating e.g. a lane direction, or any other relevant signs for modelling a traffic light behaviour of an intersection e.g. yield signs such as OK to turn at red etc.
- the cloud connected vehicle 301 may continuously send the scanning information to the cloud 302.
- the cloud connected vehicle 301 may alternatively send the scanning information to the cloud 302 at specifically determined points in time or at regular time intervals e.g. each 5 seconds.
- the cloud connected vehicle 301 When the cloud connected vehicle 301 reaches the non-connected traffic lights 305 and when driving through the intersection, the cloud connected vehicle 301 senses or approximates the number of other vehicles and their locations in the intersection as well as other vehicles driving through the intersection including their position, direction and vehicle speed. Also all visible non-connected traffic lights 305 are sensed around the cloud connected vehicle 301.
- the cloud connected vehicle 301 senses pedestrians next to the road or crossing the road, including their position.
- the cloud connected vehicle 301 senses the number of oncoming vehicles i.e. vehicles that are about to enter the intersection, senses the state of the non-connected traffic lights 305 behind the vehicle (e.g. using rearward facing vision sensors).
- the cloud connected vehicle 301 may continuously send the scanning information to the cloud 302 until e.g. 200 meters after the intersection or until end of sight.
- the cloud connected vehicles 301 receive from the cloud 302 predicted traffic light states e.g. a recommended velocity for each cloud connected vehicle 301 to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or a probability value of reaching the non-connected traffic light 305 at green.
- the cloud connected vehicles 301 are further configured to display the received recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light 305 at green.
- the predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light at green.
- Figure 4 is a schematic block diagram illustrating an example arrangement according to some embodiments.
- the example arrangement is a pattern detection arrangement 410 for detecting patterns in traffic light behaviours.
- the pattern detection arrangement 410 comprises controlling circuitry CNTR 400, which may in turn comprise a scanning arrangement SCAN 401, e.g. scanning circuitry, configured to scan or monitor an intersection, an analysing arrangement ANLS 402, e.g. analysing circuitry, configured to analyse the scanning information, an prediction arrangement PRED 403, e.g. prediction circuitry, configured to predict a traffic light state, a receiving arrangement REC 404, e.g. receiving circuitry, configured to receive the predicted traffic light state, and a display arrangement DSPL 405, e.g. display circuitry, configured to display the received traffic light state.
- a scanning arrangement SCAN 401 e.g. scanning circuitry, configured to scan or monitor an intersection
- an analysing arrangement ANLS 402 e.g. analysing circuitry, configured to analyse the scanning information
- a receiving arrangement REC 404 e.g. receiving circuitry, configured to receive the predicted
- the pattern detection arrangement 410 may be comprised in the pattern detection system 200 described in connection with Figure 2 and/or the pattern detection arrangement 410 may be configured to perform method steps of any of the methods described in connection with Figure 1 .
- Figure 5 is a schematic drawing illustrating an example computer readable medium according to some embodiments.
- the computer program product comprises a non-transitory computer readable medium 500 having thereon a computer program 510 comprising program instructions, wherein the computer program being loadable into a data processing unit and configured to cause execution of the method steps of any of the methods described in connection with Figure 1 .
- the physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
- the described embodiments and their equivalents may be realized in software or hardware or a combination thereof.
- the embodiments may be performed by general purpose circuitry. Examples of general purpose circuitry include digital signal processors (DSP), central processing units (CPU), co-processor units, field programmable gate arrays (FPGA) and other programmable hardware.
- DSP digital signal processors
- CPU central processing units
- FPGA field programmable gate arrays
- the embodiments may be performed by specialized circuitry, such as application specific integrated circuits (ASIC).
- ASIC application specific integrated circuits
- the general purpose circuitry and/or the specialized circuitry may, for example, be associated with or comprised in an apparatus such as a vehicle.
- Embodiments may appear within an electronic apparatus (associated with or comprised in a vehicle) comprising arrangements, circuitry, and/or logic according to any of the embodiments described herein.
- an electronic apparatus associated with or comprised in a vehicle
- an electronic apparatus may be configured to perform methods according to any of the embodiments described herein.
- a computer program product comprises a computer readable medium such as, for example a universal serial bus (USB) memory, a plug-in card, an embedded drive or a read only memory (ROM).
- Figure 5 illustrates an example computer readable medium in the form of a compact disc (CD) ROM 500.
- the computer readable medium has stored thereon a computer program comprising program instructions.
- the computer program is loadable into a data processor (PROC) 520, which may, for example, be comprised in an apparatus or vehicle 510.
- PROC data processor
- the computer program may be stored in a memory (MEM) 530 associated with or comprised in the data-processing unit.
- the computer program may, when loaded into and run by the data processing unit, cause execution of method steps according to, for example, any of the methods illustrated in Figure 1 or otherwise described herein.
- the method embodiments described herein discloses example methods through steps being performed in a certain order. However, it is recognized that these sequences of events may take place in another order without departing from the scope of the claims. Furthermore, some method steps may be performed in parallel even though they have been described as being performed in sequence. Thus, the steps of any methods disclosed herein do not have to be performed in the exact order disclosed, unless a step is explicitly described as following or preceding another step and/or where it is implicit that a step must follow or precede another step.
Abstract
A method for detecting patterns in traffic light behaviours. The method comprises scanning (110) an intersection by a cloud connected vehicle using on-board sensors and analysing (130) the scanning information in the cloud. The method further comprises predicting (140) a traffic light state in the cloud based on the analysis of the scanning information and displaying (160) the predicted traffic light state in the vehicle.Corresponding apparatus, service and system are also disclosed.
Description
- The present disclosure relates generally to the field of traffic light prediction. More particularly, it relates to detecting patterns in traffic light behaviours.
- An objective of traffic lights may typically be to control competing flows of traffic. Conventional traffic light systems use pre-programmed timing schedules.
- In areas where traffic flows are unpredictable or rapidly changing, smoother flows can be created by means of adaptive traffic signals. Such signals adjust signal timing parameters in real-time, to adapt to traffic conditions.
- Another way to improve traffic flow where pre-programmed timing schedules are used is to suggest suitable speeds to vehicles, allowing them to pass through an intersection during the green interval. For this to work, information about the traffic light state must be available. Typically, this information is provided either by infrastructure-to-vehicle communication or infrastructure-to-cloud-to-vehicle communication meaning that the traffic light must be connected in some way to the infrastructure.
- Therefore, there is a need for alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure.
- It should be emphasized that the term "comprises/comprising" when used in this specification is taken to specify the presence of stated features, integers, steps, or components, but does not preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
- Generally, when an arrangement is referred to herein, it is to be understood as a physical product; e.g., an apparatus. The physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
- An object of some embodiments is to provide alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure.
- According to a first aspect, this is achieved by a method for detecting patterns in traffic light behaviours.
- The method comprises scanning an intersection by a cloud connected vehicle using on-board sensors and analysing the scanning information in the cloud.
- The method further comprises predicting a traffic light state in the cloud based on the analysis of the scanning information and displaying the predicted traffic light state in the vehicle.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- In some embodiments, the scanning of the intersection comprises scanning traffic light states and traffic flows.
- An advantage of some embodiments is that the scanning information provides data for training the modelling of the traffic conditions and competing flows of traffic in the cloud.
- In some embodiments, the scanning information of the traffic flows comprises time, position of vehicles, number of vehicles and direction of vehicles.
- An advantage of some embodiments is that the scanning information provides further detailed data for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
- In some embodiments, the scanning of the intersection comprises any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
- An advantage of some embodiments is that the scanning information provides data at different points in time and at different points in the intersection for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
- In some embodiments, the method further comprises sending a continuous stream of scanning information from the vehicle to the cloud in response to the scanning of the intersection.
- An advantage of some embodiments is that the continuous scanning information provides a non-interrupted stream of data for a more correct training of the modelling of the traffic conditions and competing flows of traffic in the cloud.
- In some embodiments, the analysing of the scanning information in the cloud comprises analysis patterns.
- An advantage of some embodiments is that patterns in traffic light behaviours may be discerned.
- In some embodiments, the method further comprises receiving at the vehicle the predicted traffic light state from the cloud.
- An advantage of some embodiments is that the vehicle speed may be adapted according to the predicted traffic light state e.g. for autonomous driving.
- In some embodiments, the predicted traffic light state comprises a recommended velocity so that that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
- A second aspect is a computer program product comprising a non-transitory computer readable medium, having thereon a computer program comprising program instructions. The computer program is loadable into a data processing unit and configured to cause execution of the method according to the first aspect when the computer program is run by the data processing unit.
- A third aspect is an apparatus for detecting patterns in traffic light behaviours.
- The apparatus comprises a memory comprising executable instructions and one or more processors configured to communicate with the memory.
- The one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a cloud in response to the scan.
- The one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the cloud and display the predicted traffic light state.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- In some embodiments, the one or more processors are further configured to cause the apparatus to further receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
- In some embodiments, the one or more processors are further configured to cause the apparatus to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
- An advantage of some embodiments is that the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
- A fourth aspect is a vehicle comprising the apparatus of the third aspect.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- The cloud service comprises controlling circuitry configured to receive a continuous stream of scanning information of an intersection obtained from on-board sensors from a cloud connected vehicle and analyse the scanning information in response to reception of the stream of scanning information.
- The controlling circuitry of the cloud service is further configured to predict a traffic light state based on the analysis of the scanning information and provide the predicted traffic light state to the cloud connected vehicle.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- In some embodiments, the controlling circuitry of the cloud service is further configured to provide a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
- A sixth aspect is a system for detecting patterns in traffic light behaviours.
- The system comprises a scanning module configured to scan an intersection and a transmitting module configured to send a continuous stream of scanning information.
- The system further comprises an analysis module configured to analyse the scanning information and a prediction module configured to predict a traffic light state based on the analysis of the scanning information.
- The system furthermore comprises a receiving module configured to receive the predicted traffic light state and a display module configured to display the predicted traffic light state.
- An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
- Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
- Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
- In some embodiments, the receiving module is further configured to receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green e.g. for autonomous driving.
- In some embodiments, the display module is further configured to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
- An advantage of some embodiments is that the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
- In some embodiments, any of the above aspects may additionally have features identical with or corresponding to any of the various features as explained above for any of the other aspects.
- Further objects, features and advantages will appear from the following detailed description of embodiments, with reference being made to the accompanying drawings. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the example embodiments.
-
Figure 1 is a flowchart illustrating example method steps according to some embodiments; -
Figure 2 is a schematic overview illustrating an example system according to some embodiments; -
Figure 3a is a schematic drawing illustrating an example environment according to some embodiments; -
Figure 3b is a schematic drawing illustrating an example environment according to some embodiments; -
Figure 4 is a schematic block diagram illustrating an example arrangement according to some embodiments; and -
Figure 5 is a schematic drawing illustrating an example computer readable medium according to some embodiments. - As already mentioned above, it should be emphasized that the term "comprises/comprising" when used in this specification is taken to specify the presence of stated features, integers, steps, or components, but does not preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
- Embodiments of the present disclosure will be described and exemplified more fully hereinafter with reference to the accompanying drawings. The solutions disclosed herein can, however, be realized in many different forms and should not be construed as being limited to the embodiments set forth herein.
- In the following, embodiments will be described where alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
- Traffic lights which are not connected to the infrastructure are hereinafter denoted as non-connected traffic lights.
- A pattern comprises regularities in data and classification of data into different categories to discern the way in which something happens or is done.
-
Figure 1 is a flowchart illustrating example method steps according to some embodiments. Thepattern detection method 100 is for detecting patterns in traffic light behaviours. Thus, thepattern detection method 100 may, for example, be performed by thepattern detection system 200 ofFigure 2 for detecting patterns in traffic light behaviours. - The
pattern detection method 100 comprises following steps. - In
step 110, an intersection is scanned, i.e., monitored, by a cloud connected vehicle using on-board sensors. - A cloud connected vehicle is capable of Vehicle to Cloud (V2C) communication. The V2C technology enables an exchange of information of the vehicle or information obtained by the vehicle with a cloud system or a cloud service. This allows the vehicle to use information from other cloud connected vehicles, though the common cloud system or cloud service.
- The on-board sensors may comprise detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
- In addition, the cloud connected vehicle may comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization.
- In
step 130, the scanning information is analysed in the cloud. - The analysis may be performed in a scalable cloud system or cloud service configured for big data analytics. Big data analytics is often a complex process of examining large and varied data sets, i.e., big data, to uncover information including hidden patterns, unknown correlations, trends and preferences for making informed decisions or predictions.
- In
step 140, a traffic light state is predicted in the cloud based on the analysis of the scanning information. - In
step 160, the predicted traffic light state is displayed in the cloud connected vehicle e.g. on the dashboard, in a head-up display or in a Human Machine Interface in the vehicle. - In some embodiments, the
pattern detection method 100 further comprises the following step. - In
step 120, a continuous stream of scanning information is sent from the cloud connected vehicle to the cloud in response to the scanning of the intersection. The continuous stream of scanning information may form part of big data to be analysed by a cloud service. - In some embodiments, the
pattern detection method 100 further comprises the following step. - In
step 150, the predicted traffic light state from the cloud is received at the cloud connected vehicle. The receiving may be performed by receiving circuitry configured for V2C comprised in the vehicle. - In some embodiments, the scanning of the intersection may comprise scanning traffic light states and traffic flows.
- In some embodiments, the scanning information of the traffic flows may comprise time, position of vehicles, number of vehicles and direction of vehicles.
- In some embodiments, the scanning of the intersection may comprise any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
- In some embodiments, the analysing of the scanning information in the cloud may comprise analysis patterns, i.e., software analysis patterns in software engineering being conceptual models, which capture an abstraction of a situation often encountered in modelling. An analysis pattern can be represented as a group of related, generic objects (e.g. meta-classes) with stereotypical attributes (e.g. data definitions), behaviours (e.g. method signatures), and expected interactions defined in a domain-neutral manner.
- Examples of analysis patterns may be a time to change traffic light state, a sequence of traffic light states (depending on e.g. time, date, holidays etc.), discrepancies of patterns, cause of discrepancies of patterns (e.g. priority to busses, road construction, emergency vehicles, pedestrian crossing road etc.)
- In some embodiments, the predicted traffic light state may comprise a recommended velocity so that that cloud connected vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green. An example of the recommended velocity may be "Maintain speed at 30km/h" and an example of a probability value may be "95%", i.e., a probability of 95% that the traffic light state will be green at arrival at the intersection.
-
Figure 2 is a schematic overview illustrating an example system according to some embodiments. Thepattern detection system 200 is for detecting patterns in traffic light behaviours. Thus, thepattern detection system 200 may, for example, be utilized for anenvironment 300a ofFigure 3a and/or for anenvironment 300b ofFig 3b . - A cloud connected
vehicle 201 comprises an apparatus for detecting patterns in traffic light behaviours. The apparatus comprises a memory comprising executable instructions, wherein one or more processors are configured to communicate with the memory. - The one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a
cloud 202 in response to the scan. - The one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the
cloud 202 and display the predicted traffic light state in thevehicle 201. - The cloud connected
vehicle 201 scans, i.e., monitors, the environment in proximity of thevehicle 201, e.g. lane markings, other vehicles in other lanes or in the same lane, pedestrians, cyclists, road signs, the intersection, thenon-connected traffic lights 205 and their current states using the on-board sensors which may comprise e.g. detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle. - The cloud connected
vehicle 201 may, in addition, comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization. - The cloud connected
vehicle 201 may send a continuous stream of scanninginformation 206 obtained by the on-board sensors, as described above, to thecloud 202 for analysis and prediction. - The
cloud 202 comprises at least onecloud database 204 and/or at least oneserver database 203 which are databases that typically run on a cloud computing platform and access to it is provided as a service. The database services may provide scalability and high availability of the at least one database. Thecloud 202 may be comprised in a one separate cloud service or in a plurality of associated cloud services. - Any cloud connected
vehicle 201 may be connected to thecloud 202 for data measuring and information consumption. The cloud connectedvehicle 201 may obtain data e.g. via the on-board sensors, and send the data to thecloud 202 for data measuring. The cloud connectedvehicle 201 may consume data/information from thecloud 202 even if the cloud connectedvehicle 201 has not sent data to thecloud 202, e.g. because of lack on-board sensors, but is still capable of consuming data/information from thecloud 202 as long as it is connected to thecloud 202 and able to position itself. An example of a data/information consuming connectedvehicle 201 may be a bus or a truck etc. - In the
cloud 202, algorithms, e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, create a model capable of predicting the state of the traffic lights including a probability estimate for an environment, e.g. an intersection, based on input parameters, i.e., scanning information, such as where other vehicles are detected in relation to the cloud connectedvehicle 201 and how many other vehicles there are, which vehicles are currently driving through e.g. an intersection indicating whichtraffic light 205 is green, time of day, pedestrians at crosswalks (waiting or walking) and how many pedestrians there are. - The
cloud 202 can then provide other cloud connected vehicles approaching the same non-connected traffic light 205 a prediction of the state of thenon-connected traffic light 205 so that the cloud connectedvehicle 201 is able to adapt by e.g. adapting its speed (manually or automatically) to an optimal speed from e.g. an energy or an environment perspective. - The
cloud 202 receives a continuous stream of scanninginformation 206 of an environment, e.g. an intersection, obtained from the on-board sensors from the cloud connectedvehicle 201. - The
cloud 202 analyses the scanning information in response to reception of the stream of scanning information. Thecloud 202 predicts a traffic light state based on the analysis of the scanning information. Thecloud 202 may predict the traffic light state based on the scanning information obtained from the cloud connectedvehicle 201 and also from scanning information obtained by other cloud connected vehicles of which scanning information may be comprised in the databases 203,204. - More specifically, the analysis of the scanning information is performed by algorithms, e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, which create a model of the intersection's traffic lights statuses which is continuously improved, i.e. trained, as long as new scanning information becomes available.
- Until the model is fully trained, a more rudimentary model one will be used. An example of this may be a cloud connected
vehicle 201 that is capable of detecting necessary parameters of e.g. an intersection reports that it is standing still at a red non-connected traffic light but no other vehicles are detected, a rudimentary model in this case is to just assume (or based on previous experience from other intersections) that non-connected traffic light will turn green shortly. This information can be used to roughly estimate a recommended vehicle speed for other cloud connected vehicles that are approaching the intersection in the same direction. - The
cloud 202 provides the predictedtraffic light state 207 to the cloud connectedvehicle 201. - In some embodiments, the cloud connected
vehicle 201 may further receive a recommended velocity to keep such that cloud connectedvehicle 201 reaches thenon-connected traffic light 205 at green and/or a probability value of reaching the traffic light at green. - In some embodiments, the cloud connected
vehicle 201 may further display the recommended velocity to keep such that cloud connectedvehicle 201 reaches thenon-connected traffic light 205 at green and/or the probability value of reaching the traffic light at green. -
Figure 3a is a schematic drawing illustrating an example environment according to some embodiments. Thepattern detection system 200 illustrated inFigure 2 may, for example, be utilized for anenvironment 300a ofFigure 3a . -
Figure 3a illustrates an environment comprising a cloud connectedvehicle 301, connected to cloud 302, driving on a road towards anon-connected traffic light 305. The cloud connectedvehicle 301 receives from the cloud 302 a predicted traffic light state e.g. a recommended velocity to keep such that cloud connectedvehicle 301 reaches thenon-connected traffic light 305 at green and/or a probability value of reaching thenon-connected traffic light 305 at green. The cloud connectedvehicle 301 is further configured to display the received recommended velocity to keep such that cloud connectedvehicle 301 reaches thenon-connected traffic light 305 at green and/or the probability value of reaching thenon-connected traffic light 305 at green. The predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connectedvehicle 301 reaches thenon-connected traffic light 305 at green and/or the probability value of reaching thenon-connected traffic 305 light at green. -
Figure 3b is a schematic drawing illustrating an example environment according to some embodiments. Thepattern detection system 200 illustrated inFigure 2 may, for example, be utilized for anenvironment 300b ofFigure 3b . -
Figure 3b illustrates an environment comprising a plurality of cloud connectedvehicles 301, connected to cloud 302, driving towards/through/leaving an intersection in different directions. - When a cloud connected
vehicle 301 approaches the intersection, the cloud connectedvehicle 301 scans, i.e., monitors, the state of thenon-connected traffic lights 305 for each direction, senses or approximates the number of other vehicles in its proximity with respect to thenon-connected traffic lights 305 and senses any pedestrians next to the road or crossing the road, including their position. - Further, the cloud connected
vehicle 301 may sense arrows on the road or on road signs, indicating e.g. a lane direction, or any other relevant signs for modelling a traffic light behaviour of an intersection e.g. yield signs such as OK to turn at red etc. - The cloud connected
vehicle 301 may continuously send the scanning information to thecloud 302. The cloud connectedvehicle 301 may alternatively send the scanning information to thecloud 302 at specifically determined points in time or at regular time intervals e.g. each 5 seconds. - When the cloud connected
vehicle 301 reaches thenon-connected traffic lights 305 and when driving through the intersection, the cloud connectedvehicle 301 senses or approximates the number of other vehicles and their locations in the intersection as well as other vehicles driving through the intersection including their position, direction and vehicle speed. Also all visiblenon-connected traffic lights 305 are sensed around the cloud connectedvehicle 301. - Further, the cloud connected
vehicle 301 senses pedestrians next to the road or crossing the road, including their position. - When the cloud connected
vehicle 301 leaves the intersection, the cloud connectedvehicle 301 senses the number of oncoming vehicles i.e. vehicles that are about to enter the intersection, senses the state of thenon-connected traffic lights 305 behind the vehicle (e.g. using rearward facing vision sensors). - The cloud connected
vehicle 301 may continuously send the scanning information to thecloud 302 until e.g. 200 meters after the intersection or until end of sight. - The cloud connected
vehicles 301 receive from thecloud 302 predicted traffic light states e.g. a recommended velocity for each cloud connectedvehicle 301 to keep such that cloud connectedvehicle 301 reaches thenon-connected traffic light 305 at green and/or a probability value of reaching thenon-connected traffic light 305 at green. The cloud connectedvehicles 301 are further configured to display the received recommended velocity to keep such that cloud connectedvehicle 301 reaches thenon-connected traffic light 305 at green and/or the probability value of reaching thenon-connected traffic light 305 at green. The predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connectedvehicle 301 reaches thenon-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light at green. -
Figure 4 is a schematic block diagram illustrating an example arrangement according to some embodiments. The example arrangement is apattern detection arrangement 410 for detecting patterns in traffic light behaviours. - The
pattern detection arrangement 410 comprises controllingcircuitry CNTR 400, which may in turn comprise ascanning arrangement SCAN 401, e.g. scanning circuitry, configured to scan or monitor an intersection, an analysingarrangement ANLS 402, e.g. analysing circuitry, configured to analyse the scanning information, anprediction arrangement PRED 403, e.g. prediction circuitry, configured to predict a traffic light state, a receivingarrangement REC 404, e.g. receiving circuitry, configured to receive the predicted traffic light state, and adisplay arrangement DSPL 405, e.g. display circuitry, configured to display the received traffic light state. - The
pattern detection arrangement 410 may be comprised in thepattern detection system 200 described in connection withFigure 2 and/or thepattern detection arrangement 410 may be configured to perform method steps of any of the methods described in connection withFigure 1 . -
Figure 5 is a schematic drawing illustrating an example computer readable medium according to some embodiments. The computer program product comprises a non-transitory computerreadable medium 500 having thereon acomputer program 510 comprising program instructions, wherein the computer program being loadable into a data processing unit and configured to cause execution of the method steps of any of the methods described in connection withFigure 1 . - Generally, when an arrangement is referred to herein, it is to be understood as a physical product; e.g., an apparatus. The physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
- The described embodiments and their equivalents may be realized in software or hardware or a combination thereof. The embodiments may be performed by general purpose circuitry. Examples of general purpose circuitry include digital signal processors (DSP), central processing units (CPU), co-processor units, field programmable gate arrays (FPGA) and other programmable hardware. Alternatively or additionally, the embodiments may be performed by specialized circuitry, such as application specific integrated circuits (ASIC). The general purpose circuitry and/or the specialized circuitry may, for example, be associated with or comprised in an apparatus such as a vehicle.
- Embodiments may appear within an electronic apparatus (associated with or comprised in a vehicle) comprising arrangements, circuitry, and/or logic according to any of the embodiments described herein. Alternatively or additionally, an electronic apparatus (associated with or comprised in a vehicle) may be configured to perform methods according to any of the embodiments described herein.
- According to some embodiments, a computer program product comprises a computer readable medium such as, for example a universal serial bus (USB) memory, a plug-in card, an embedded drive or a read only memory (ROM).
Figure 5 illustrates an example computer readable medium in the form of a compact disc (CD)ROM 500. The computer readable medium has stored thereon a computer program comprising program instructions. The computer program is loadable into a data processor (PROC) 520, which may, for example, be comprised in an apparatus orvehicle 510. When loaded into the data processing unit, the computer program may be stored in a memory (MEM) 530 associated with or comprised in the data-processing unit. According to some embodiments, the computer program may, when loaded into and run by the data processing unit, cause execution of method steps according to, for example, any of the methods illustrated inFigure 1 or otherwise described herein. - Generally, all terms used herein are to be interpreted according to their ordinary meaning in the relevant technical field, unless a different meaning is clearly given and/or is implied from the context in which it is used.
- Reference has been made herein to various embodiments. However, a person skilled in the art would recognize numerous variations to the described embodiments that would still fall within the scope of the claims.
- For example, the method embodiments described herein discloses example methods through steps being performed in a certain order. However, it is recognized that these sequences of events may take place in another order without departing from the scope of the claims. Furthermore, some method steps may be performed in parallel even though they have been described as being performed in sequence. Thus, the steps of any methods disclosed herein do not have to be performed in the exact order disclosed, unless a step is explicitly described as following or preceding another step and/or where it is implicit that a step must follow or precede another step.
- In the same manner, it should be noted that in the description of embodiments, the partition of functional blocks into particular units is by no means intended as limiting. Contrarily, these partitions are merely examples. Functional blocks described herein as one unit may be split into two or more units. Furthermore, functional blocks described herein as being implemented as two or more units may be merged into fewer (e.g. a single) unit.
- Any feature of any of the embodiments disclosed herein may be applied to any other embodiment, wherever suitable. Likewise, any advantage of any of the embodiments may apply to any other embodiments, and vice versa.
- Hence, it should be understood that the details of the described embodiments are merely examples brought forward for illustrative purposes, and that all variations that fall within the scope of the claims are intended to be embraced therein.
Claims (18)
- A method for detecting patterns in traffic light behaviours, comprising the steps of:scanning (110) an intersection by a cloud connected vehicle using on-board sensors,analysing (130) the scanning information in the cloud,predicting (140) a traffic light state in the cloud based on the analysis of the scanning information, anddisplaying (160) the predicted traffic light state in the vehicle.
- The method according to claim 1, wherein the scanning of the intersection comprises scanning traffic light states and traffic flows.
- The method according to claim 2, wherein the scanning information of the traffic flows comprises time, position of vehicles, number of vehicles and direction of vehicles.
- The method according to any of claims 1-3, wherein the scanning of the intersection comprises any one of: scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
- The method according to any of claims 1-4, further comprising the step of:sending (120) a continuous stream of scanning information from the vehicle to the cloud in response to the scanning of the intersection.
- The method according to any of claims 1-5, wherein the analysing of the scanning information in the cloud comprises analysis patterns.
- The method according to any of claims 1-6, further comprising the step of:receiving (150) at the vehicle the predicted traffic light state from the cloud.
- The method according to any of claims 1-7, wherein the predicted traffic light state comprises a recommended velocity so that that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- A computer program product comprising a non-transitory computer readable medium (500), having thereon a computer program (510) comprising program instructions, the computer program being loadable into a data processing unit and configured to cause execution of the method according to any of claims 1 through 8 when the computer program is run by the data processing unit.
- An apparatus for detecting patterns in traffic light behaviours, comprising:a memory comprising executable instructions,one or more processors configured to communicate with the memory wherein the one or more processors are configured to cause the apparatus to:scan an intersection using on-board sensors,send a continuous stream of scanning information to a cloud in response to the scan,receive a predicted traffic light state from the cloud, anddisplay the predicted traffic light state.
- The apparatus according to claim 10, wherein the one or more processors are further configured to cause the apparatus to further receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- The apparatus according to any of claims 10-11, wherein the one or more processors are further configured to cause the apparatus to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
- A vehicle (201) comprising the apparatus according to any of claims 10-12.
- A cloud service (202) for detecting patterns in traffic light behaviours, wherein the cloud service comprises controlling circuitry configured to:receive (206) a continuous stream of scanning information of an intersection obtained from on-board sensors from a cloud connected vehicle,analyse (203,204) the scanning information in response to reception of the stream of scanning information,predict (203, 204) a traffic light state based on the analysis of the scanning information, andprovide (207) the predicted traffic light state to the cloud connected vehicle.
- The cloud service 202 according to claim 14, wherein the controlling circuitry of the cloud service is further configured to:provide a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- A system for detecting patterns in traffic light behaviours, comprising:a scanning module (401) configured to scan an intersection,a transmitting module (430) configured to send a continuous stream of scanning information,an analysis module (402) configured to analyse the scanning information,a prediction module (403) configured to predict a traffic light state based on the analysis of the scanning information,a receiving module (404) configured to receive the predicted traffic light state, anda display module (405) configured to display the predicted traffic light state.
- The system according to claim 16, wherein the receiving module (404) is further configured to receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
- The system according to any of claims 16-17, wherein the display module (405) is further configured to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP18213035.1A EP3671687A1 (en) | 2018-12-17 | 2018-12-17 | Traffic light prediction |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP18213035.1A EP3671687A1 (en) | 2018-12-17 | 2018-12-17 | Traffic light prediction |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3671687A1 true EP3671687A1 (en) | 2020-06-24 |
Family
ID=64744424
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18213035.1A Withdrawn EP3671687A1 (en) | 2018-12-17 | 2018-12-17 | Traffic light prediction |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP3671687A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113053141A (en) * | 2021-03-23 | 2021-06-29 | 长安大学 | Adaptive traffic signal control method and device based on CV data |
WO2022245436A1 (en) * | 2021-05-17 | 2022-11-24 | Micron Technology, Inc. | Autonomous vehicle object detection |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150379869A1 (en) * | 2012-09-19 | 2015-12-31 | Google Inc. | Use of Relationship between Activities of Different Traffic Signals in a Network to Improve Traffic Signal State Estimation |
US9779621B1 (en) * | 2013-03-15 | 2017-10-03 | Waymo Llc | Intersection phase map |
DE102017003346A1 (en) * | 2017-04-06 | 2017-10-26 | Daimler Ag | Method for providing traffic signal phase switching data |
US20180075739A1 (en) * | 2009-08-11 | 2018-03-15 | Connected Signals, Inc. | Traffic Routing Display System with Multiple Signal Lookahead |
-
2018
- 2018-12-17 EP EP18213035.1A patent/EP3671687A1/en not_active Withdrawn
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180075739A1 (en) * | 2009-08-11 | 2018-03-15 | Connected Signals, Inc. | Traffic Routing Display System with Multiple Signal Lookahead |
US20150379869A1 (en) * | 2012-09-19 | 2015-12-31 | Google Inc. | Use of Relationship between Activities of Different Traffic Signals in a Network to Improve Traffic Signal State Estimation |
US9779621B1 (en) * | 2013-03-15 | 2017-10-03 | Waymo Llc | Intersection phase map |
DE102017003346A1 (en) * | 2017-04-06 | 2017-10-26 | Daimler Ag | Method for providing traffic signal phase switching data |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113053141A (en) * | 2021-03-23 | 2021-06-29 | 长安大学 | Adaptive traffic signal control method and device based on CV data |
WO2022245436A1 (en) * | 2021-05-17 | 2022-11-24 | Micron Technology, Inc. | Autonomous vehicle object detection |
US11783595B2 (en) | 2021-05-17 | 2023-10-10 | Micron Technology, Inc. | Autonomous vehicle object detection |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3547215A1 (en) | Systems and methods for automatically training neural networks | |
US10629080B2 (en) | Autonomous vehicles featuring vehicle intention system | |
EP4086578A1 (en) | Vehicle behavior prediction method and apparatus, electronic device, and storage medium | |
US11618467B2 (en) | Dynamic route information interface | |
CN107450529A (en) | improved object detection for automatic driving vehicle | |
US11648936B2 (en) | Method and apparatus for controlling vehicle | |
JP7278484B2 (en) | Attention-based control of vehicle traffic | |
CN113228040A (en) | Multi-level object heading estimation | |
CN111094095B (en) | Method and device for automatically sensing driving signal and vehicle | |
US20200074851A1 (en) | Control device and control method | |
EP3671687A1 (en) | Traffic light prediction | |
WO2023011331A1 (en) | Method and apparatus for controlling formation driving, medium, and electronic device | |
CN111386563A (en) | Teacher data collection device | |
WO2023064693A1 (en) | Verifying reproducibility for a vehicle controller | |
CN110654380A (en) | Method and device for controlling a vehicle | |
CN116917827A (en) | Proxy conversion in driving simulation | |
US20220266859A1 (en) | Simulated agents based on driving log data | |
Ke et al. | Lightweight edge intelligence empowered near-crash detection towards real-time vehicle event logging | |
US20220028257A1 (en) | Understanding road signs | |
Wirthmüller et al. | A fleet learning architecture for enhanced behavior predictions during challenging external conditions | |
CN113327219B (en) | Image processing method and system based on multi-source data fusion | |
CN115675479A (en) | Method and processor device for operating an automatic driving function in a motor vehicle using an object classifier, and motor vehicle | |
CN111710175B (en) | Control method and device of traffic signal lamp | |
US20230334876A1 (en) | End-to-end learned lane boundary detection based on a transformer | |
US11697435B1 (en) | Hierarchical vehicle action prediction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20181217 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20210112 |