EP3671687A1 - Traffic light prediction - Google Patents

Traffic light prediction Download PDF

Info

Publication number
EP3671687A1
EP3671687A1 EP18213035.1A EP18213035A EP3671687A1 EP 3671687 A1 EP3671687 A1 EP 3671687A1 EP 18213035 A EP18213035 A EP 18213035A EP 3671687 A1 EP3671687 A1 EP 3671687A1
Authority
EP
European Patent Office
Prior art keywords
traffic light
cloud
vehicle
green
intersection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP18213035.1A
Other languages
German (de)
French (fr)
Inventor
Magnus Brandin
Per LANDFORS
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ningbo Geely Automobile Research and Development Co Ltd
Original Assignee
Ningbo Geely Automobile Research and Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ningbo Geely Automobile Research and Development Co Ltd filed Critical Ningbo Geely Automobile Research and Development Co Ltd
Priority to EP18213035.1A priority Critical patent/EP3671687A1/en
Publication of EP3671687A1 publication Critical patent/EP3671687A1/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0108Measuring and analyzing of parameters relative to traffic conditions based on the source of data
    • G08G1/0112Measuring and analyzing of parameters relative to traffic conditions based on the source of data from the vehicle, e.g. floating car data [FCD]
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0137Measuring and analyzing of parameters relative to traffic conditions for specific applications
    • G08G1/0145Measuring and analyzing of parameters relative to traffic conditions for specific applications for active traffic flow control
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/04Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096766Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
    • G08G1/096775Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is a central station
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0137Measuring and analyzing of parameters relative to traffic conditions for specific applications
    • G08G1/0141Measuring and analyzing of parameters relative to traffic conditions for specific applications for traffic information dissemination

Definitions

  • the present disclosure relates generally to the field of traffic light prediction. More particularly, it relates to detecting patterns in traffic light behaviours.
  • An objective of traffic lights may typically be to control competing flows of traffic.
  • Conventional traffic light systems use pre-programmed timing schedules.
  • Another way to improve traffic flow where pre-programmed timing schedules are used is to suggest suitable speeds to vehicles, allowing them to pass through an intersection during the green interval.
  • information about the traffic light state must be available. Typically, this information is provided either by infrastructure-to-vehicle communication or infrastructure-to-cloud-to-vehicle communication meaning that the traffic light must be connected in some way to the infrastructure.
  • the physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
  • An object of some embodiments is to provide alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure.
  • this is achieved by a method for detecting patterns in traffic light behaviours.
  • the method comprises scanning an intersection by a cloud connected vehicle using on-board sensors and analysing the scanning information in the cloud.
  • the method further comprises predicting a traffic light state in the cloud based on the analysis of the scanning information and displaying the predicted traffic light state in the vehicle.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
  • the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
  • the predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • the scanning of the intersection comprises scanning traffic light states and traffic flows.
  • An advantage of some embodiments is that the scanning information provides data for training the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • the scanning information of the traffic flows comprises time, position of vehicles, number of vehicles and direction of vehicles.
  • An advantage of some embodiments is that the scanning information provides further detailed data for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • the scanning of the intersection comprises any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
  • An advantage of some embodiments is that the scanning information provides data at different points in time and at different points in the intersection for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • the method further comprises sending a continuous stream of scanning information from the vehicle to the cloud in response to the scanning of the intersection.
  • An advantage of some embodiments is that the continuous scanning information provides a non-interrupted stream of data for a more correct training of the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • the analysing of the scanning information in the cloud comprises analysis patterns.
  • An advantage of some embodiments is that patterns in traffic light behaviours may be discerned.
  • the method further comprises receiving at the vehicle the predicted traffic light state from the cloud.
  • vehicle speed may be adapted according to the predicted traffic light state e.g. for autonomous driving.
  • the predicted traffic light state comprises a recommended velocity so that that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
  • a second aspect is a computer program product comprising a non-transitory computer readable medium, having thereon a computer program comprising program instructions.
  • the computer program is loadable into a data processing unit and configured to cause execution of the method according to the first aspect when the computer program is run by the data processing unit.
  • a third aspect is an apparatus for detecting patterns in traffic light behaviours.
  • the apparatus comprises a memory comprising executable instructions and one or more processors configured to communicate with the memory.
  • the one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a cloud in response to the scan.
  • the one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the cloud and display the predicted traffic light state.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
  • the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
  • the predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • the one or more processors are further configured to cause the apparatus to further receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
  • the one or more processors are further configured to cause the apparatus to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
  • the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
  • a fourth aspect is a vehicle comprising the apparatus of the third aspect.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
  • the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
  • the predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • the cloud service comprises controlling circuitry configured to receive a continuous stream of scanning information of an intersection obtained from on-board sensors from a cloud connected vehicle and analyse the scanning information in response to reception of the stream of scanning information.
  • the controlling circuitry of the cloud service is further configured to predict a traffic light state based on the analysis of the scanning information and provide the predicted traffic light state to the cloud connected vehicle.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
  • the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
  • the predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • controlling circuitry of the cloud service is further configured to provide a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
  • a sixth aspect is a system for detecting patterns in traffic light behaviours.
  • the system comprises a scanning module configured to scan an intersection and a transmitting module configured to send a continuous stream of scanning information.
  • the system further comprises an analysis module configured to analyse the scanning information and a prediction module configured to predict a traffic light state based on the analysis of the scanning information.
  • the system furthermore comprises a receiving module configured to receive the predicted traffic light state and a display module configured to display the predicted traffic light state.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure.
  • the real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure.
  • the predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • the receiving module is further configured to receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green e.g. for autonomous driving.
  • the display module is further configured to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
  • the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
  • any of the above aspects may additionally have features identical with or corresponding to any of the various features as explained above for any of the other aspects.
  • Traffic lights which are not connected to the infrastructure are hereinafter denoted as non-connected traffic lights.
  • a pattern comprises regularities in data and classification of data into different categories to discern the way in which something happens or is done.
  • FIG. 1 is a flowchart illustrating example method steps according to some embodiments.
  • the pattern detection method 100 is for detecting patterns in traffic light behaviours.
  • the pattern detection method 100 may, for example, be performed by the pattern detection system 200 of Figure 2 for detecting patterns in traffic light behaviours.
  • the pattern detection method 100 comprises following steps.
  • step 110 an intersection is scanned, i.e., monitored, by a cloud connected vehicle using on-board sensors.
  • a cloud connected vehicle is capable of Vehicle to Cloud (V2C) communication.
  • V2C Vehicle to Cloud
  • the V2C technology enables an exchange of information of the vehicle or information obtained by the vehicle with a cloud system or a cloud service. This allows the vehicle to use information from other cloud connected vehicles, though the common cloud system or cloud service.
  • the on-board sensors may comprise detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
  • the cloud connected vehicle may comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization.
  • step 130 the scanning information is analysed in the cloud.
  • the analysis may be performed in a scalable cloud system or cloud service configured for big data analytics.
  • Big data analytics is often a complex process of examining large and varied data sets, i.e., big data, to uncover information including hidden patterns, unknown correlations, trends and preferences for making informed decisions or predictions.
  • a traffic light state is predicted in the cloud based on the analysis of the scanning information.
  • step 160 the predicted traffic light state is displayed in the cloud connected vehicle e.g. on the dashboard, in a head-up display or in a Human Machine Interface in the vehicle.
  • the pattern detection method 100 further comprises the following step.
  • a continuous stream of scanning information is sent from the cloud connected vehicle to the cloud in response to the scanning of the intersection.
  • the continuous stream of scanning information may form part of big data to be analysed by a cloud service.
  • the pattern detection method 100 further comprises the following step.
  • step 150 the predicted traffic light state from the cloud is received at the cloud connected vehicle.
  • the receiving may be performed by receiving circuitry configured for V2C comprised in the vehicle.
  • the scanning of the intersection may comprise scanning traffic light states and traffic flows.
  • the scanning information of the traffic flows may comprise time, position of vehicles, number of vehicles and direction of vehicles.
  • the scanning of the intersection may comprise any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
  • the analysing of the scanning information in the cloud may comprise analysis patterns, i.e., software analysis patterns in software engineering being conceptual models, which capture an abstraction of a situation often encountered in modelling.
  • An analysis pattern can be represented as a group of related, generic objects (e.g. meta-classes) with stereotypical attributes (e.g. data definitions), behaviours (e.g. method signatures), and expected interactions defined in a domain-neutral manner.
  • Examples of analysis patterns may be a time to change traffic light state, a sequence of traffic light states (depending on e.g. time, date, holidays etc.), discrepancies of patterns, cause of discrepancies of patterns (e.g. priority to busses, road construction, emergency vehicles, pedestrian crossing road etc.)
  • the predicted traffic light state may comprise a recommended velocity so that that cloud connected vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • An example of the recommended velocity may be "Maintain speed at 30km/h” and an example of a probability value may be "95%", i.e., a probability of 95% that the traffic light state will be green at arrival at the intersection.
  • Figure 2 is a schematic overview illustrating an example system according to some embodiments.
  • the pattern detection system 200 is for detecting patterns in traffic light behaviours.
  • the pattern detection system 200 may, for example, be utilized for an environment 300a of Figure 3a and/or for an environment 300b of Fig 3b .
  • a cloud connected vehicle 201 comprises an apparatus for detecting patterns in traffic light behaviours.
  • the apparatus comprises a memory comprising executable instructions, wherein one or more processors are configured to communicate with the memory.
  • the one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a cloud 202 in response to the scan.
  • the one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the cloud 202 and display the predicted traffic light state in the vehicle 201.
  • the cloud connected vehicle 201 scans, i.e., monitors, the environment in proximity of the vehicle 201, e.g. lane markings, other vehicles in other lanes or in the same lane, pedestrians, cyclists, road signs, the intersection, the non-connected traffic lights 205 and their current states using the on-board sensors which may comprise e.g. detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
  • the on-board sensors may comprise e.g. detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
  • the cloud connected vehicle 201 may, in addition, comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization.
  • the cloud connected vehicle 201 may send a continuous stream of scanning information 206 obtained by the on-board sensors, as described above, to the cloud 202 for analysis and prediction.
  • the cloud 202 comprises at least one cloud database 204 and/or at least one server database 203 which are databases that typically run on a cloud computing platform and access to it is provided as a service.
  • the database services may provide scalability and high availability of the at least one database.
  • the cloud 202 may be comprised in a one separate cloud service or in a plurality of associated cloud services.
  • Any cloud connected vehicle 201 may be connected to the cloud 202 for data measuring and information consumption.
  • the cloud connected vehicle 201 may obtain data e.g. via the on-board sensors, and send the data to the cloud 202 for data measuring.
  • the cloud connected vehicle 201 may consume data/information from the cloud 202 even if the cloud connected vehicle 201 has not sent data to the cloud 202, e.g. because of lack on-board sensors, but is still capable of consuming data/information from the cloud 202 as long as it is connected to the cloud 202 and able to position itself.
  • An example of a data/information consuming connected vehicle 201 may be a bus or a truck etc.
  • algorithms e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, create a model capable of predicting the state of the traffic lights including a probability estimate for an environment, e.g. an intersection, based on input parameters, i.e., scanning information, such as where other vehicles are detected in relation to the cloud connected vehicle 201 and how many other vehicles there are, which vehicles are currently driving through e.g. an intersection indicating which traffic light 205 is green, time of day, pedestrians at crosswalks (waiting or walking) and how many pedestrians there are.
  • scanning information such as where other vehicles are detected in relation to the cloud connected vehicle 201 and how many other vehicles there are, which vehicles are currently driving through e.g. an intersection indicating which traffic light 205 is green, time of day, pedestrians at crosswalks (waiting or walking) and how many pedestrians there are.
  • the cloud 202 can then provide other cloud connected vehicles approaching the same non-connected traffic light 205 a prediction of the state of the non-connected traffic light 205 so that the cloud connected vehicle 201 is able to adapt by e.g. adapting its speed (manually or automatically) to an optimal speed from e.g. an energy or an environment perspective.
  • the cloud 202 receives a continuous stream of scanning information 206 of an environment, e.g. an intersection, obtained from the on-board sensors from the cloud connected vehicle 201.
  • the cloud 202 analyses the scanning information in response to reception of the stream of scanning information.
  • the cloud 202 predicts a traffic light state based on the analysis of the scanning information.
  • the cloud 202 may predict the traffic light state based on the scanning information obtained from the cloud connected vehicle 201 and also from scanning information obtained by other cloud connected vehicles of which scanning information may be comprised in the databases 203,204.
  • the analysis of the scanning information is performed by algorithms, e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, which create a model of the intersection's traffic lights statuses which is continuously improved, i.e. trained, as long as new scanning information becomes available.
  • algorithms e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, which create a model of the intersection's traffic lights statuses which is continuously improved, i.e. trained, as long as new scanning information becomes available.
  • An example of this may be a cloud connected vehicle 201 that is capable of detecting necessary parameters of e.g. an intersection reports that it is standing still at a red non-connected traffic light but no other vehicles are detected, a rudimentary model in this case is to just assume (or based on previous experience from other intersections) that non-connected traffic light will turn green shortly. This information can be used to roughly estimate a recommended vehicle speed for other cloud connected vehicles that are approaching the intersection in the same direction.
  • the cloud 202 provides the predicted traffic light state 207 to the cloud connected vehicle 201.
  • the cloud connected vehicle 201 may further receive a recommended velocity to keep such that cloud connected vehicle 201 reaches the non-connected traffic light 205 at green and/or a probability value of reaching the traffic light at green.
  • the cloud connected vehicle 201 may further display the recommended velocity to keep such that cloud connected vehicle 201 reaches the non-connected traffic light 205 at green and/or the probability value of reaching the traffic light at green.
  • Figure 3a is a schematic drawing illustrating an example environment according to some embodiments.
  • the pattern detection system 200 illustrated in Figure 2 may, for example, be utilized for an environment 300a of Figure 3a .
  • Figure 3a illustrates an environment comprising a cloud connected vehicle 301, connected to cloud 302, driving on a road towards a non-connected traffic light 305.
  • the cloud connected vehicle 301 receives from the cloud 302 a predicted traffic light state e.g. a recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or a probability value of reaching the non-connected traffic light 305 at green.
  • the cloud connected vehicle 301 is further configured to display the received recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light 305 at green.
  • the predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic 305 light at green.
  • Figure 3b is a schematic drawing illustrating an example environment according to some embodiments.
  • the pattern detection system 200 illustrated in Figure 2 may, for example, be utilized for an environment 300b of Figure 3b .
  • Figure 3b illustrates an environment comprising a plurality of cloud connected vehicles 301, connected to cloud 302, driving towards/through/leaving an intersection in different directions.
  • the cloud connected vehicle 301 scans, i.e., monitors, the state of the non-connected traffic lights 305 for each direction, senses or approximates the number of other vehicles in its proximity with respect to the non-connected traffic lights 305 and senses any pedestrians next to the road or crossing the road, including their position.
  • the cloud connected vehicle 301 may sense arrows on the road or on road signs, indicating e.g. a lane direction, or any other relevant signs for modelling a traffic light behaviour of an intersection e.g. yield signs such as OK to turn at red etc.
  • the cloud connected vehicle 301 may continuously send the scanning information to the cloud 302.
  • the cloud connected vehicle 301 may alternatively send the scanning information to the cloud 302 at specifically determined points in time or at regular time intervals e.g. each 5 seconds.
  • the cloud connected vehicle 301 When the cloud connected vehicle 301 reaches the non-connected traffic lights 305 and when driving through the intersection, the cloud connected vehicle 301 senses or approximates the number of other vehicles and their locations in the intersection as well as other vehicles driving through the intersection including their position, direction and vehicle speed. Also all visible non-connected traffic lights 305 are sensed around the cloud connected vehicle 301.
  • the cloud connected vehicle 301 senses pedestrians next to the road or crossing the road, including their position.
  • the cloud connected vehicle 301 senses the number of oncoming vehicles i.e. vehicles that are about to enter the intersection, senses the state of the non-connected traffic lights 305 behind the vehicle (e.g. using rearward facing vision sensors).
  • the cloud connected vehicle 301 may continuously send the scanning information to the cloud 302 until e.g. 200 meters after the intersection or until end of sight.
  • the cloud connected vehicles 301 receive from the cloud 302 predicted traffic light states e.g. a recommended velocity for each cloud connected vehicle 301 to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or a probability value of reaching the non-connected traffic light 305 at green.
  • the cloud connected vehicles 301 are further configured to display the received recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light 305 at green.
  • the predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light at green.
  • Figure 4 is a schematic block diagram illustrating an example arrangement according to some embodiments.
  • the example arrangement is a pattern detection arrangement 410 for detecting patterns in traffic light behaviours.
  • the pattern detection arrangement 410 comprises controlling circuitry CNTR 400, which may in turn comprise a scanning arrangement SCAN 401, e.g. scanning circuitry, configured to scan or monitor an intersection, an analysing arrangement ANLS 402, e.g. analysing circuitry, configured to analyse the scanning information, an prediction arrangement PRED 403, e.g. prediction circuitry, configured to predict a traffic light state, a receiving arrangement REC 404, e.g. receiving circuitry, configured to receive the predicted traffic light state, and a display arrangement DSPL 405, e.g. display circuitry, configured to display the received traffic light state.
  • a scanning arrangement SCAN 401 e.g. scanning circuitry, configured to scan or monitor an intersection
  • an analysing arrangement ANLS 402 e.g. analysing circuitry, configured to analyse the scanning information
  • a receiving arrangement REC 404 e.g. receiving circuitry, configured to receive the predicted
  • the pattern detection arrangement 410 may be comprised in the pattern detection system 200 described in connection with Figure 2 and/or the pattern detection arrangement 410 may be configured to perform method steps of any of the methods described in connection with Figure 1 .
  • Figure 5 is a schematic drawing illustrating an example computer readable medium according to some embodiments.
  • the computer program product comprises a non-transitory computer readable medium 500 having thereon a computer program 510 comprising program instructions, wherein the computer program being loadable into a data processing unit and configured to cause execution of the method steps of any of the methods described in connection with Figure 1 .
  • the physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
  • the described embodiments and their equivalents may be realized in software or hardware or a combination thereof.
  • the embodiments may be performed by general purpose circuitry. Examples of general purpose circuitry include digital signal processors (DSP), central processing units (CPU), co-processor units, field programmable gate arrays (FPGA) and other programmable hardware.
  • DSP digital signal processors
  • CPU central processing units
  • FPGA field programmable gate arrays
  • the embodiments may be performed by specialized circuitry, such as application specific integrated circuits (ASIC).
  • ASIC application specific integrated circuits
  • the general purpose circuitry and/or the specialized circuitry may, for example, be associated with or comprised in an apparatus such as a vehicle.
  • Embodiments may appear within an electronic apparatus (associated with or comprised in a vehicle) comprising arrangements, circuitry, and/or logic according to any of the embodiments described herein.
  • an electronic apparatus associated with or comprised in a vehicle
  • an electronic apparatus may be configured to perform methods according to any of the embodiments described herein.
  • a computer program product comprises a computer readable medium such as, for example a universal serial bus (USB) memory, a plug-in card, an embedded drive or a read only memory (ROM).
  • Figure 5 illustrates an example computer readable medium in the form of a compact disc (CD) ROM 500.
  • the computer readable medium has stored thereon a computer program comprising program instructions.
  • the computer program is loadable into a data processor (PROC) 520, which may, for example, be comprised in an apparatus or vehicle 510.
  • PROC data processor
  • the computer program may be stored in a memory (MEM) 530 associated with or comprised in the data-processing unit.
  • the computer program may, when loaded into and run by the data processing unit, cause execution of method steps according to, for example, any of the methods illustrated in Figure 1 or otherwise described herein.
  • the method embodiments described herein discloses example methods through steps being performed in a certain order. However, it is recognized that these sequences of events may take place in another order without departing from the scope of the claims. Furthermore, some method steps may be performed in parallel even though they have been described as being performed in sequence. Thus, the steps of any methods disclosed herein do not have to be performed in the exact order disclosed, unless a step is explicitly described as following or preceding another step and/or where it is implicit that a step must follow or precede another step.

Abstract

A method for detecting patterns in traffic light behaviours. The method comprises scanning (110) an intersection by a cloud connected vehicle using on-board sensors and analysing (130) the scanning information in the cloud. The method further comprises predicting (140) a traffic light state in the cloud based on the analysis of the scanning information and displaying (160) the predicted traffic light state in the vehicle.Corresponding apparatus, service and system are also disclosed.

Description

    TECHNICAL FIELD
  • The present disclosure relates generally to the field of traffic light prediction. More particularly, it relates to detecting patterns in traffic light behaviours.
  • BACKGROUND
  • An objective of traffic lights may typically be to control competing flows of traffic. Conventional traffic light systems use pre-programmed timing schedules.
  • In areas where traffic flows are unpredictable or rapidly changing, smoother flows can be created by means of adaptive traffic signals. Such signals adjust signal timing parameters in real-time, to adapt to traffic conditions.
  • Another way to improve traffic flow where pre-programmed timing schedules are used is to suggest suitable speeds to vehicles, allowing them to pass through an intersection during the green interval. For this to work, information about the traffic light state must be available. Typically, this information is provided either by infrastructure-to-vehicle communication or infrastructure-to-cloud-to-vehicle communication meaning that the traffic light must be connected in some way to the infrastructure.
  • Therefore, there is a need for alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure.
  • SUMMARY
  • It should be emphasized that the term "comprises/comprising" when used in this specification is taken to specify the presence of stated features, integers, steps, or components, but does not preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
  • Generally, when an arrangement is referred to herein, it is to be understood as a physical product; e.g., an apparatus. The physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
  • An object of some embodiments is to provide alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure.
  • According to a first aspect, this is achieved by a method for detecting patterns in traffic light behaviours.
  • The method comprises scanning an intersection by a cloud connected vehicle using on-board sensors and analysing the scanning information in the cloud.
  • The method further comprises predicting a traffic light state in the cloud based on the analysis of the scanning information and displaying the predicted traffic light state in the vehicle.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • In some embodiments, the scanning of the intersection comprises scanning traffic light states and traffic flows.
  • An advantage of some embodiments is that the scanning information provides data for training the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • In some embodiments, the scanning information of the traffic flows comprises time, position of vehicles, number of vehicles and direction of vehicles.
  • An advantage of some embodiments is that the scanning information provides further detailed data for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • In some embodiments, the scanning of the intersection comprises any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
  • An advantage of some embodiments is that the scanning information provides data at different points in time and at different points in the intersection for further training the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • In some embodiments, the method further comprises sending a continuous stream of scanning information from the vehicle to the cloud in response to the scanning of the intersection.
  • An advantage of some embodiments is that the continuous scanning information provides a non-interrupted stream of data for a more correct training of the modelling of the traffic conditions and competing flows of traffic in the cloud.
  • In some embodiments, the analysing of the scanning information in the cloud comprises analysis patterns.
  • An advantage of some embodiments is that patterns in traffic light behaviours may be discerned.
  • In some embodiments, the method further comprises receiving at the vehicle the predicted traffic light state from the cloud.
  • An advantage of some embodiments is that the vehicle speed may be adapted according to the predicted traffic light state e.g. for autonomous driving.
  • In some embodiments, the predicted traffic light state comprises a recommended velocity so that that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
  • A second aspect is a computer program product comprising a non-transitory computer readable medium, having thereon a computer program comprising program instructions. The computer program is loadable into a data processing unit and configured to cause execution of the method according to the first aspect when the computer program is run by the data processing unit.
  • A third aspect is an apparatus for detecting patterns in traffic light behaviours.
  • The apparatus comprises a memory comprising executable instructions and one or more processors configured to communicate with the memory.
  • The one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a cloud in response to the scan.
  • The one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the cloud and display the predicted traffic light state.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • In some embodiments, the one or more processors are further configured to cause the apparatus to further receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
  • In some embodiments, the one or more processors are further configured to cause the apparatus to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
  • An advantage of some embodiments is that the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
  • A fourth aspect is a vehicle comprising the apparatus of the third aspect.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • The cloud service comprises controlling circuitry configured to receive a continuous stream of scanning information of an intersection obtained from on-board sensors from a cloud connected vehicle and analyse the scanning information in response to reception of the stream of scanning information.
  • The controlling circuitry of the cloud service is further configured to predict a traffic light state based on the analysis of the scanning information and provide the predicted traffic light state to the cloud connected vehicle.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • In some embodiments, the controlling circuitry of the cloud service is further configured to provide a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green.
  • A sixth aspect is a system for detecting patterns in traffic light behaviours.
  • The system comprises a scanning module configured to scan an intersection and a transmitting module configured to send a continuous stream of scanning information.
  • The system further comprises an analysis module configured to analyse the scanning information and a prediction module configured to predict a traffic light state based on the analysis of the scanning information.
  • The system furthermore comprises a receiving module configured to receive the predicted traffic light state and a display module configured to display the predicted traffic light state.
  • An advantage of some embodiments is that alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Another advantage of some embodiments is that a real-time adaption to traffic conditions and competing flows of traffic is provided even for environments where traffic lights are not connected to the infrastructure. The real-time adaption ensures for detecting faults in traffic lights which are not connected to the infrastructure as well as any potential changes and existence of road works e.g. in situations where the traffic lights signals only yellow.
  • Yet an advantage of some embodiments is that a predictability is provided even for environments with traffic lights which are not connected to the infrastructure. The predictability ensures a safer traffic situation especially in environments such as intersections.
  • Yet another advantage of some embodiments is that a non-dependence of a connection to the infrastructure is provided.
  • In some embodiments, the receiving module is further configured to receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  • An advantage of some embodiments is that the vehicle speed may be adapted according to the recommended velocity and a probability value provides a realistic expectation of reaching the traffic light at green e.g. for autonomous driving.
  • In some embodiments, the display module is further configured to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
  • An advantage of some embodiments is that the vehicle speed may be adapted by a driver according to the recommended velocity and a probability value provides a realistic expectation for the driver of reaching the traffic light at green.
  • In some embodiments, any of the above aspects may additionally have features identical with or corresponding to any of the various features as explained above for any of the other aspects.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Further objects, features and advantages will appear from the following detailed description of embodiments, with reference being made to the accompanying drawings. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the example embodiments.
    • Figure 1 is a flowchart illustrating example method steps according to some embodiments;
    • Figure 2 is a schematic overview illustrating an example system according to some embodiments;
    • Figure 3a is a schematic drawing illustrating an example environment according to some embodiments;
    • Figure 3b is a schematic drawing illustrating an example environment according to some embodiments;
    • Figure 4 is a schematic block diagram illustrating an example arrangement according to some embodiments; and
    • Figure 5 is a schematic drawing illustrating an example computer readable medium according to some embodiments.
    DETAILED DESCRIPTION
  • As already mentioned above, it should be emphasized that the term "comprises/comprising" when used in this specification is taken to specify the presence of stated features, integers, steps, or components, but does not preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
  • Embodiments of the present disclosure will be described and exemplified more fully hereinafter with reference to the accompanying drawings. The solutions disclosed herein can, however, be realized in many different forms and should not be construed as being limited to the embodiments set forth herein.
  • In the following, embodiments will be described where alternative approaches to detecting patterns in traffic light behaviours for traffic lights which are not connected to the infrastructure are provided.
  • Traffic lights which are not connected to the infrastructure are hereinafter denoted as non-connected traffic lights.
  • A pattern comprises regularities in data and classification of data into different categories to discern the way in which something happens or is done.
  • Figure 1 is a flowchart illustrating example method steps according to some embodiments. The pattern detection method 100 is for detecting patterns in traffic light behaviours. Thus, the pattern detection method 100 may, for example, be performed by the pattern detection system 200 of Figure 2 for detecting patterns in traffic light behaviours.
  • The pattern detection method 100 comprises following steps.
  • In step 110, an intersection is scanned, i.e., monitored, by a cloud connected vehicle using on-board sensors.
  • A cloud connected vehicle is capable of Vehicle to Cloud (V2C) communication. The V2C technology enables an exchange of information of the vehicle or information obtained by the vehicle with a cloud system or a cloud service. This allows the vehicle to use information from other cloud connected vehicles, though the common cloud system or cloud service.
  • The on-board sensors may comprise detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
  • In addition, the cloud connected vehicle may comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization.
  • In step 130, the scanning information is analysed in the cloud.
  • The analysis may be performed in a scalable cloud system or cloud service configured for big data analytics. Big data analytics is often a complex process of examining large and varied data sets, i.e., big data, to uncover information including hidden patterns, unknown correlations, trends and preferences for making informed decisions or predictions.
  • In step 140, a traffic light state is predicted in the cloud based on the analysis of the scanning information.
  • In step 160, the predicted traffic light state is displayed in the cloud connected vehicle e.g. on the dashboard, in a head-up display or in a Human Machine Interface in the vehicle.
  • In some embodiments, the pattern detection method 100 further comprises the following step.
  • In step 120, a continuous stream of scanning information is sent from the cloud connected vehicle to the cloud in response to the scanning of the intersection. The continuous stream of scanning information may form part of big data to be analysed by a cloud service.
  • In some embodiments, the pattern detection method 100 further comprises the following step.
  • In step 150, the predicted traffic light state from the cloud is received at the cloud connected vehicle. The receiving may be performed by receiving circuitry configured for V2C comprised in the vehicle.
  • In some embodiments, the scanning of the intersection may comprise scanning traffic light states and traffic flows.
  • In some embodiments, the scanning information of the traffic flows may comprise time, position of vehicles, number of vehicles and direction of vehicles.
  • In some embodiments, the scanning of the intersection may comprise any one of scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
  • In some embodiments, the analysing of the scanning information in the cloud may comprise analysis patterns, i.e., software analysis patterns in software engineering being conceptual models, which capture an abstraction of a situation often encountered in modelling. An analysis pattern can be represented as a group of related, generic objects (e.g. meta-classes) with stereotypical attributes (e.g. data definitions), behaviours (e.g. method signatures), and expected interactions defined in a domain-neutral manner.
  • Examples of analysis patterns may be a time to change traffic light state, a sequence of traffic light states (depending on e.g. time, date, holidays etc.), discrepancies of patterns, cause of discrepancies of patterns (e.g. priority to busses, road construction, emergency vehicles, pedestrian crossing road etc.)
  • In some embodiments, the predicted traffic light state may comprise a recommended velocity so that that cloud connected vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green. An example of the recommended velocity may be "Maintain speed at 30km/h" and an example of a probability value may be "95%", i.e., a probability of 95% that the traffic light state will be green at arrival at the intersection.
  • Figure 2 is a schematic overview illustrating an example system according to some embodiments. The pattern detection system 200 is for detecting patterns in traffic light behaviours. Thus, the pattern detection system 200 may, for example, be utilized for an environment 300a of Figure 3a and/or for an environment 300b of Fig 3b.
  • A cloud connected vehicle 201 comprises an apparatus for detecting patterns in traffic light behaviours. The apparatus comprises a memory comprising executable instructions, wherein one or more processors are configured to communicate with the memory.
  • The one or more processors are configured to cause the apparatus to scan an intersection using on-board sensors and send a continuous stream of scanning information to a cloud 202 in response to the scan.
  • The one or more processors are further configured to cause the apparatus to receive a predicted traffic light state from the cloud 202 and display the predicted traffic light state in the vehicle 201.
  • The cloud connected vehicle 201 scans, i.e., monitors, the environment in proximity of the vehicle 201, e.g. lane markings, other vehicles in other lanes or in the same lane, pedestrians, cyclists, road signs, the intersection, the non-connected traffic lights 205 and their current states using the on-board sensors which may comprise e.g. detectors, cameras, 360-degree radar, LIDAR, ultrasonic sensors or any other vehicle compatible sensor for obtaining information about the environment in proximity of the vehicle.
  • The cloud connected vehicle 201 may, in addition, comprise an Internet connection, Advanced Driver Assistance Systems and high definition maps for more accurate object detection and localization.
  • The cloud connected vehicle 201 may send a continuous stream of scanning information 206 obtained by the on-board sensors, as described above, to the cloud 202 for analysis and prediction.
  • The cloud 202 comprises at least one cloud database 204 and/or at least one server database 203 which are databases that typically run on a cloud computing platform and access to it is provided as a service. The database services may provide scalability and high availability of the at least one database. The cloud 202 may be comprised in a one separate cloud service or in a plurality of associated cloud services.
  • Any cloud connected vehicle 201 may be connected to the cloud 202 for data measuring and information consumption. The cloud connected vehicle 201 may obtain data e.g. via the on-board sensors, and send the data to the cloud 202 for data measuring. The cloud connected vehicle 201 may consume data/information from the cloud 202 even if the cloud connected vehicle 201 has not sent data to the cloud 202, e.g. because of lack on-board sensors, but is still capable of consuming data/information from the cloud 202 as long as it is connected to the cloud 202 and able to position itself. An example of a data/information consuming connected vehicle 201 may be a bus or a truck etc.
  • In the cloud 202, algorithms, e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, create a model capable of predicting the state of the traffic lights including a probability estimate for an environment, e.g. an intersection, based on input parameters, i.e., scanning information, such as where other vehicles are detected in relation to the cloud connected vehicle 201 and how many other vehicles there are, which vehicles are currently driving through e.g. an intersection indicating which traffic light 205 is green, time of day, pedestrians at crosswalks (waiting or walking) and how many pedestrians there are.
  • The cloud 202 can then provide other cloud connected vehicles approaching the same non-connected traffic light 205 a prediction of the state of the non-connected traffic light 205 so that the cloud connected vehicle 201 is able to adapt by e.g. adapting its speed (manually or automatically) to an optimal speed from e.g. an energy or an environment perspective.
  • The cloud 202 receives a continuous stream of scanning information 206 of an environment, e.g. an intersection, obtained from the on-board sensors from the cloud connected vehicle 201.
  • The cloud 202 analyses the scanning information in response to reception of the stream of scanning information. The cloud 202 predicts a traffic light state based on the analysis of the scanning information. The cloud 202 may predict the traffic light state based on the scanning information obtained from the cloud connected vehicle 201 and also from scanning information obtained by other cloud connected vehicles of which scanning information may be comprised in the databases 203,204.
  • More specifically, the analysis of the scanning information is performed by algorithms, e.g. machine learning algorithms or statistical algorithms with crowd sourcing approaches, which create a model of the intersection's traffic lights statuses which is continuously improved, i.e. trained, as long as new scanning information becomes available.
  • Until the model is fully trained, a more rudimentary model one will be used. An example of this may be a cloud connected vehicle 201 that is capable of detecting necessary parameters of e.g. an intersection reports that it is standing still at a red non-connected traffic light but no other vehicles are detected, a rudimentary model in this case is to just assume (or based on previous experience from other intersections) that non-connected traffic light will turn green shortly. This information can be used to roughly estimate a recommended vehicle speed for other cloud connected vehicles that are approaching the intersection in the same direction.
  • The cloud 202 provides the predicted traffic light state 207 to the cloud connected vehicle 201.
  • In some embodiments, the cloud connected vehicle 201 may further receive a recommended velocity to keep such that cloud connected vehicle 201 reaches the non-connected traffic light 205 at green and/or a probability value of reaching the traffic light at green.
  • In some embodiments, the cloud connected vehicle 201 may further display the recommended velocity to keep such that cloud connected vehicle 201 reaches the non-connected traffic light 205 at green and/or the probability value of reaching the traffic light at green.
  • Figure 3a is a schematic drawing illustrating an example environment according to some embodiments. The pattern detection system 200 illustrated in Figure 2 may, for example, be utilized for an environment 300a of Figure 3a.
  • Figure 3a illustrates an environment comprising a cloud connected vehicle 301, connected to cloud 302, driving on a road towards a non-connected traffic light 305. The cloud connected vehicle 301 receives from the cloud 302 a predicted traffic light state e.g. a recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or a probability value of reaching the non-connected traffic light 305 at green. The cloud connected vehicle 301 is further configured to display the received recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light 305 at green. The predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic 305 light at green.
  • Figure 3b is a schematic drawing illustrating an example environment according to some embodiments. The pattern detection system 200 illustrated in Figure 2 may, for example, be utilized for an environment 300b of Figure 3b.
  • Figure 3b illustrates an environment comprising a plurality of cloud connected vehicles 301, connected to cloud 302, driving towards/through/leaving an intersection in different directions.
  • When a cloud connected vehicle 301 approaches the intersection, the cloud connected vehicle 301 scans, i.e., monitors, the state of the non-connected traffic lights 305 for each direction, senses or approximates the number of other vehicles in its proximity with respect to the non-connected traffic lights 305 and senses any pedestrians next to the road or crossing the road, including their position.
  • Further, the cloud connected vehicle 301 may sense arrows on the road or on road signs, indicating e.g. a lane direction, or any other relevant signs for modelling a traffic light behaviour of an intersection e.g. yield signs such as OK to turn at red etc.
  • The cloud connected vehicle 301 may continuously send the scanning information to the cloud 302. The cloud connected vehicle 301 may alternatively send the scanning information to the cloud 302 at specifically determined points in time or at regular time intervals e.g. each 5 seconds.
  • When the cloud connected vehicle 301 reaches the non-connected traffic lights 305 and when driving through the intersection, the cloud connected vehicle 301 senses or approximates the number of other vehicles and their locations in the intersection as well as other vehicles driving through the intersection including their position, direction and vehicle speed. Also all visible non-connected traffic lights 305 are sensed around the cloud connected vehicle 301.
  • Further, the cloud connected vehicle 301 senses pedestrians next to the road or crossing the road, including their position.
  • When the cloud connected vehicle 301 leaves the intersection, the cloud connected vehicle 301 senses the number of oncoming vehicles i.e. vehicles that are about to enter the intersection, senses the state of the non-connected traffic lights 305 behind the vehicle (e.g. using rearward facing vision sensors).
  • The cloud connected vehicle 301 may continuously send the scanning information to the cloud 302 until e.g. 200 meters after the intersection or until end of sight.
  • The cloud connected vehicles 301 receive from the cloud 302 predicted traffic light states e.g. a recommended velocity for each cloud connected vehicle 301 to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or a probability value of reaching the non-connected traffic light 305 at green. The cloud connected vehicles 301 are further configured to display the received recommended velocity to keep such that cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light 305 at green. The predicted traffic light state may also comprise a recommended velocity to accelerate to or decelerate to such that the cloud connected vehicle 301 reaches the non-connected traffic light 305 at green and/or the probability value of reaching the non-connected traffic light at green.
  • Figure 4 is a schematic block diagram illustrating an example arrangement according to some embodiments. The example arrangement is a pattern detection arrangement 410 for detecting patterns in traffic light behaviours.
  • The pattern detection arrangement 410 comprises controlling circuitry CNTR 400, which may in turn comprise a scanning arrangement SCAN 401, e.g. scanning circuitry, configured to scan or monitor an intersection, an analysing arrangement ANLS 402, e.g. analysing circuitry, configured to analyse the scanning information, an prediction arrangement PRED 403, e.g. prediction circuitry, configured to predict a traffic light state, a receiving arrangement REC 404, e.g. receiving circuitry, configured to receive the predicted traffic light state, and a display arrangement DSPL 405, e.g. display circuitry, configured to display the received traffic light state.
  • The pattern detection arrangement 410 may be comprised in the pattern detection system 200 described in connection with Figure 2 and/or the pattern detection arrangement 410 may be configured to perform method steps of any of the methods described in connection with Figure 1.
  • Figure 5 is a schematic drawing illustrating an example computer readable medium according to some embodiments. The computer program product comprises a non-transitory computer readable medium 500 having thereon a computer program 510 comprising program instructions, wherein the computer program being loadable into a data processing unit and configured to cause execution of the method steps of any of the methods described in connection with Figure 1.
  • Generally, when an arrangement is referred to herein, it is to be understood as a physical product; e.g., an apparatus. The physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
  • The described embodiments and their equivalents may be realized in software or hardware or a combination thereof. The embodiments may be performed by general purpose circuitry. Examples of general purpose circuitry include digital signal processors (DSP), central processing units (CPU), co-processor units, field programmable gate arrays (FPGA) and other programmable hardware. Alternatively or additionally, the embodiments may be performed by specialized circuitry, such as application specific integrated circuits (ASIC). The general purpose circuitry and/or the specialized circuitry may, for example, be associated with or comprised in an apparatus such as a vehicle.
  • Embodiments may appear within an electronic apparatus (associated with or comprised in a vehicle) comprising arrangements, circuitry, and/or logic according to any of the embodiments described herein. Alternatively or additionally, an electronic apparatus (associated with or comprised in a vehicle) may be configured to perform methods according to any of the embodiments described herein.
  • According to some embodiments, a computer program product comprises a computer readable medium such as, for example a universal serial bus (USB) memory, a plug-in card, an embedded drive or a read only memory (ROM). Figure 5 illustrates an example computer readable medium in the form of a compact disc (CD) ROM 500. The computer readable medium has stored thereon a computer program comprising program instructions. The computer program is loadable into a data processor (PROC) 520, which may, for example, be comprised in an apparatus or vehicle 510. When loaded into the data processing unit, the computer program may be stored in a memory (MEM) 530 associated with or comprised in the data-processing unit. According to some embodiments, the computer program may, when loaded into and run by the data processing unit, cause execution of method steps according to, for example, any of the methods illustrated in Figure 1 or otherwise described herein.
  • Generally, all terms used herein are to be interpreted according to their ordinary meaning in the relevant technical field, unless a different meaning is clearly given and/or is implied from the context in which it is used.
  • Reference has been made herein to various embodiments. However, a person skilled in the art would recognize numerous variations to the described embodiments that would still fall within the scope of the claims.
  • For example, the method embodiments described herein discloses example methods through steps being performed in a certain order. However, it is recognized that these sequences of events may take place in another order without departing from the scope of the claims. Furthermore, some method steps may be performed in parallel even though they have been described as being performed in sequence. Thus, the steps of any methods disclosed herein do not have to be performed in the exact order disclosed, unless a step is explicitly described as following or preceding another step and/or where it is implicit that a step must follow or precede another step.
  • In the same manner, it should be noted that in the description of embodiments, the partition of functional blocks into particular units is by no means intended as limiting. Contrarily, these partitions are merely examples. Functional blocks described herein as one unit may be split into two or more units. Furthermore, functional blocks described herein as being implemented as two or more units may be merged into fewer (e.g. a single) unit.
  • Any feature of any of the embodiments disclosed herein may be applied to any other embodiment, wherever suitable. Likewise, any advantage of any of the embodiments may apply to any other embodiments, and vice versa.
  • Hence, it should be understood that the details of the described embodiments are merely examples brought forward for illustrative purposes, and that all variations that fall within the scope of the claims are intended to be embraced therein.

Claims (18)

  1. A method for detecting patterns in traffic light behaviours, comprising the steps of:
    scanning (110) an intersection by a cloud connected vehicle using on-board sensors,
    analysing (130) the scanning information in the cloud,
    predicting (140) a traffic light state in the cloud based on the analysis of the scanning information, and
    displaying (160) the predicted traffic light state in the vehicle.
  2. The method according to claim 1, wherein the scanning of the intersection comprises scanning traffic light states and traffic flows.
  3. The method according to claim 2, wherein the scanning information of the traffic flows comprises time, position of vehicles, number of vehicles and direction of vehicles.
  4. The method according to any of claims 1-3, wherein the scanning of the intersection comprises any one of: scanning as the vehicle approaches the intersection, as the vehicle passes through the intersection, and as the vehicle leaves the intersection.
  5. The method according to any of claims 1-4, further comprising the step of:
    sending (120) a continuous stream of scanning information from the vehicle to the cloud in response to the scanning of the intersection.
  6. The method according to any of claims 1-5, wherein the analysing of the scanning information in the cloud comprises analysis patterns.
  7. The method according to any of claims 1-6, further comprising the step of:
    receiving (150) at the vehicle the predicted traffic light state from the cloud.
  8. The method according to any of claims 1-7, wherein the predicted traffic light state comprises a recommended velocity so that that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  9. A computer program product comprising a non-transitory computer readable medium (500), having thereon a computer program (510) comprising program instructions, the computer program being loadable into a data processing unit and configured to cause execution of the method according to any of claims 1 through 8 when the computer program is run by the data processing unit.
  10. An apparatus for detecting patterns in traffic light behaviours, comprising:
    a memory comprising executable instructions,
    one or more processors configured to communicate with the memory wherein the one or more processors are configured to cause the apparatus to:
    scan an intersection using on-board sensors,
    send a continuous stream of scanning information to a cloud in response to the scan,
    receive a predicted traffic light state from the cloud, and
    display the predicted traffic light state.
  11. The apparatus according to claim 10, wherein the one or more processors are further configured to cause the apparatus to further receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  12. The apparatus according to any of claims 10-11, wherein the one or more processors are further configured to cause the apparatus to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
  13. A vehicle (201) comprising the apparatus according to any of claims 10-12.
  14. A cloud service (202) for detecting patterns in traffic light behaviours, wherein the cloud service comprises controlling circuitry configured to:
    receive (206) a continuous stream of scanning information of an intersection obtained from on-board sensors from a cloud connected vehicle,
    analyse (203,204) the scanning information in response to reception of the stream of scanning information,
    predict (203, 204) a traffic light state based on the analysis of the scanning information, and
    provide (207) the predicted traffic light state to the cloud connected vehicle.
  15. The cloud service 202 according to claim 14, wherein the controlling circuitry of the cloud service is further configured to:
    provide a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  16. A system for detecting patterns in traffic light behaviours, comprising:
    a scanning module (401) configured to scan an intersection,
    a transmitting module (430) configured to send a continuous stream of scanning information,
    an analysis module (402) configured to analyse the scanning information,
    a prediction module (403) configured to predict a traffic light state based on the analysis of the scanning information,
    a receiving module (404) configured to receive the predicted traffic light state, and
    a display module (405) configured to display the predicted traffic light state.
  17. The system according to claim 16, wherein the receiving module (404) is further configured to receive a recommended velocity to keep such that vehicle reaches the traffic light at green and/or a probability value of reaching the traffic light at green.
  18. The system according to any of claims 16-17, wherein the display module (405) is further configured to display the recommended velocity to keep such that vehicle reaches the traffic light at green and/or the probability value of reaching the traffic light at green.
EP18213035.1A 2018-12-17 2018-12-17 Traffic light prediction Withdrawn EP3671687A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP18213035.1A EP3671687A1 (en) 2018-12-17 2018-12-17 Traffic light prediction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP18213035.1A EP3671687A1 (en) 2018-12-17 2018-12-17 Traffic light prediction

Publications (1)

Publication Number Publication Date
EP3671687A1 true EP3671687A1 (en) 2020-06-24

Family

ID=64744424

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18213035.1A Withdrawn EP3671687A1 (en) 2018-12-17 2018-12-17 Traffic light prediction

Country Status (1)

Country Link
EP (1) EP3671687A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113053141A (en) * 2021-03-23 2021-06-29 长安大学 Adaptive traffic signal control method and device based on CV data
WO2022245436A1 (en) * 2021-05-17 2022-11-24 Micron Technology, Inc. Autonomous vehicle object detection

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150379869A1 (en) * 2012-09-19 2015-12-31 Google Inc. Use of Relationship between Activities of Different Traffic Signals in a Network to Improve Traffic Signal State Estimation
US9779621B1 (en) * 2013-03-15 2017-10-03 Waymo Llc Intersection phase map
DE102017003346A1 (en) * 2017-04-06 2017-10-26 Daimler Ag Method for providing traffic signal phase switching data
US20180075739A1 (en) * 2009-08-11 2018-03-15 Connected Signals, Inc. Traffic Routing Display System with Multiple Signal Lookahead

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180075739A1 (en) * 2009-08-11 2018-03-15 Connected Signals, Inc. Traffic Routing Display System with Multiple Signal Lookahead
US20150379869A1 (en) * 2012-09-19 2015-12-31 Google Inc. Use of Relationship between Activities of Different Traffic Signals in a Network to Improve Traffic Signal State Estimation
US9779621B1 (en) * 2013-03-15 2017-10-03 Waymo Llc Intersection phase map
DE102017003346A1 (en) * 2017-04-06 2017-10-26 Daimler Ag Method for providing traffic signal phase switching data

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113053141A (en) * 2021-03-23 2021-06-29 长安大学 Adaptive traffic signal control method and device based on CV data
WO2022245436A1 (en) * 2021-05-17 2022-11-24 Micron Technology, Inc. Autonomous vehicle object detection
US11783595B2 (en) 2021-05-17 2023-10-10 Micron Technology, Inc. Autonomous vehicle object detection

Similar Documents

Publication Publication Date Title
EP3547215A1 (en) Systems and methods for automatically training neural networks
US10629080B2 (en) Autonomous vehicles featuring vehicle intention system
EP4086578A1 (en) Vehicle behavior prediction method and apparatus, electronic device, and storage medium
US11618467B2 (en) Dynamic route information interface
CN107450529A (en) improved object detection for automatic driving vehicle
US11648936B2 (en) Method and apparatus for controlling vehicle
JP7278484B2 (en) Attention-based control of vehicle traffic
CN113228040A (en) Multi-level object heading estimation
CN111094095B (en) Method and device for automatically sensing driving signal and vehicle
US20200074851A1 (en) Control device and control method
EP3671687A1 (en) Traffic light prediction
WO2023011331A1 (en) Method and apparatus for controlling formation driving, medium, and electronic device
CN111386563A (en) Teacher data collection device
WO2023064693A1 (en) Verifying reproducibility for a vehicle controller
CN110654380A (en) Method and device for controlling a vehicle
CN116917827A (en) Proxy conversion in driving simulation
US20220266859A1 (en) Simulated agents based on driving log data
Ke et al. Lightweight edge intelligence empowered near-crash detection towards real-time vehicle event logging
US20220028257A1 (en) Understanding road signs
Wirthmüller et al. A fleet learning architecture for enhanced behavior predictions during challenging external conditions
CN113327219B (en) Image processing method and system based on multi-source data fusion
CN115675479A (en) Method and processor device for operating an automatic driving function in a motor vehicle using an object classifier, and motor vehicle
CN111710175B (en) Control method and device of traffic signal lamp
US20230334876A1 (en) End-to-end learned lane boundary detection based on a transformer
US11697435B1 (en) Hierarchical vehicle action prediction

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20181217

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20210112