US20190066510A1 - Vehicular image projection - Google Patents
Vehicular image projection Download PDFInfo
- Publication number
- US20190066510A1 US20190066510A1 US15/683,045 US201715683045A US2019066510A1 US 20190066510 A1 US20190066510 A1 US 20190066510A1 US 201715683045 A US201715683045 A US 201715683045A US 2019066510 A1 US2019066510 A1 US 2019066510A1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- computer
- symbol
- target object
- traffic signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 claims description 101
- 230000008569 process Effects 0.000 description 76
- 230000008859 change Effects 0.000 description 21
- 238000010586 diagram Methods 0.000 description 18
- 238000004891 communication Methods 0.000 description 13
- 238000013480 data collection Methods 0.000 description 9
- 230000015654 memory Effects 0.000 description 9
- 230000001788 irregular Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000004397 blinking Effects 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 239000000446 fuel Substances 0.000 description 2
- 241000282994 Cervidae Species 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000002485 combustion reaction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 229910052736 halogen Inorganic materials 0.000 description 1
- 150000002367 halogens Chemical class 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000005043 peripheral vision Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000007514 turning Methods 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/543—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating other states or conditions of the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/545—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating other traffic conditions, e.g. fog, heavy traffic
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/547—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for issuing requests to other traffic participants; for confirming to other traffic participants they can proceed, e.g. they can overtake
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3647—Guidance involving output of stored or live camera images or video streams
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G01S17/936—
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
- G05D1/0251—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/582—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of traffic signs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/005—Traffic control systems for road vehicles including pedestrian guidance indicator
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/163—Decentralised systems, e.g. inter-vehicle communication involving continuous checking
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/30—Indexing codes relating to the vehicle environment
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/30—Indexing codes relating to the vehicle environment
- B60Q2300/33—Driving situation
- B60Q2300/336—Crossings
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2400/00—Special features or arrangements of exterior signal lamps for vehicles
- B60Q2400/50—Projected symbol or information, e.g. onto the road or car body
Definitions
- Autonomous and semi-autonomous vehicles may share a road with pedestrians, cyclists and other vehicles, both autonomous and non-autonomous.
- the pedestrians, cyclists and other vehicles (which may be referred to as “target objects”) may not be aware that they are in traffic with the autonomous vehicle.
- the target objects i.e., a human operator thereof, may be distracted by the use of mobile phones, conversations with other occupants, food, etc.
- the target object operator may not make adequate observation of an environment around the target object, which may include traffic conditions such as other vehicles, traffic lights, traffic signs, etc.
- traffic conditions such as other vehicles, traffic lights, traffic signs, etc.
- FIG. 1 is a block diagram of an example vehicular image projection system.
- FIG. 2A is a perspective view of a vehicle including an image projector.
- FIG. 2B is a perspective view of a housing for a puddle lamp including the image projector.
- FIG. 3 is a diagram of an example vehicle illustrating a vehicle travel path.
- FIG. 4 is a diagram of an example vehicle projecting a traffic signal symbol.
- FIG. 5 is a diagram of an exemplary process for projecting a symbol based on a traffic signal state.
- FIG. 6 is a diagram of an example vehicle projecting a symbol for indicating a vehicle change of trajectory.
- FIG. 7A is a diagram of a first portion of an exemplary process for projecting the symbol for indicating the vehicle change of trajectory.
- FIG. 7B is a diagram of the second portion of the exemplary process of FIG. 7A .
- FIG. 8 is a diagram of an example vehicle projecting the symbol moving within a target area.
- FIG. 9A is a diagram of a first portion of an exemplary process for projecting the symbol moving within the target area.
- FIG. 9B is a diagram of the second portion of the exemplary process of FIG. 9A .
- a computer is programmed to determine a target area to project, along a planned travel path of a vehicle, a symbol based on detecting a target object and actuate a light source to project the symbol moving within the target area.
- the computer can be further programmed to move the image in alternately in a first direction and a second opposite direction within the target area.
- the computer can be further programmed to determine the target area based on a type of the target object.
- the computer can be further programmed to determine the target area based on a line-of-sight of the target object.
- the computer can be further programmed to determine the target area based on a shortest straight line path from the target object to the planned travel path.
- the computer can be further programmed to determine the target area based on a direction of a road through which the planned travel path passes.
- the computer can be further programmed to actuate the light source based on a determination that the target object is within a maximum distance of the planned travel path.
- the computer can be further programmed to actuate the light source based on a determination that the target object is within a maximum distance of the vehicle.
- the computer can be further programmed to actuate the light source based on a determination that the vehicle is within a first maximum distance of a traffic signal and the target object is within a second maximum distance of the traffic signal.
- the computer can be further programmed to actuate the light source based on a determination that the vehicle is stopped at the traffic signal.
- a method includes determining a target area to project, along a planned travel path for a vehicle, a symbol based on detecting a target object and actuating a light source to project the symbol moving within the target area.
- the method can further include moving the image alternately in a first direction and a second opposite direction within the target area.
- the method can further include determining the target area based on a type of the target object.
- the method can further include determining the target area based on a line-of-sight of the target object.
- the method can further include determining the target area based on a shortest straight line path from the target object to the planned travel path.
- the method can further include determining the target area based on a direction of a road through which the planned travel path passes.
- the method can further include actuating the light source based on a determination that the target object is within a maximum distance of the planned travel path.
- the method can further include actuating the light source based on a determination that the target object is within a maximum distance of the vehicle.
- the method can further include actuating the light source based on a determination that the vehicle is within a first maximum distance of a traffic signal and the target object is within a second maximum distance of the traffic signal.
- the method can further include actuating the light source based on a determination that the vehicle is stopped at the traffic signal.
- a computer programmed to execute any one of the above method steps.
- a vehicle including the computer.
- a computer program product including a computer readable medium storing instructions executable by a computer processor, to execute any of the above method steps.
- FIG. 1 is a diagram of an exemplary system 10 for projecting a symbol by a first vehicle 20 based on a detected traffic condition.
- Target objects 90 refers to pedestrians, second vehicles, bicycles, motorcycles, scooters, skateboards, and other types of vehicles controlled by people.
- Target objects 90 may further include animals.
- a deer on a side of a road could be the target object 90 .
- the system 10 includes a first vehicle 20 , and a network 30 .
- the system 10 may further include one or more traffic signals 40 , and a server 60 .
- the first vehicle 20 is generally a land-based vehicle having three or more wheels, e.g., a passenger car, light truck, etc.
- the first vehicle 20 includes a computer 120 , sensors 122 , a human-machine interface (HMI) 124 , an image projector 126 and controllers 128 .
- HMI human-machine interface
- the first vehicle 20 can be an autonomous or semi-autonomous vehicle.
- the computer 120 controls the first vehicle 20 by sending instructions to controllers 128 including controllers for steering, propulsion (e.g., a powertrain with electric and/or internal combustion elements), and braking; in a semi-autonomous first vehicle 20 the computer 120 controls one or two of steering, propulsion, and braking.
- controllers 128 including controllers for steering, propulsion (e.g., a powertrain with electric and/or internal combustion elements), and braking; in a semi-autonomous first vehicle 20 the computer 120 controls one or two of steering, propulsion, and braking.
- the computer 120 includes a processor and a memory.
- the memory includes one or more types of computer-readable media, and storing instructions executable by the processor for performing various operations, including as disclosed herein.
- the computer 120 may include and/or be communicatively coupled to one or more other computers, including vehicle components such as the sensors 122 , the HMI 124 , the image projector 126 , and the controllers 128 , which likewise may include respective processors and memories.
- Communications i.e., communicative coupling, may be achieved via a controller area network (CAN) bus or local interconnect network (LIN) bus, a wired and/or wireless in-vehicle local area network (LAN), e.g., using wired or wireless technologies such as Wi-Fi®, Bluetooth®, etc., as is known.
- CAN controller area network
- LIN local interconnect network
- LAN wired and/or wireless in-vehicle local area network
- the computer 120 is programmed to receive and/or determine a planned travel path for the first vehicle 20 .
- the planned travel path is the path the first vehicle 20 will steer along on a roadway.
- the computer 120 may receive a route indicating a starting point, a destination, and the roads for the first vehicle 20 to follow to arrive at the destination. Based on the received route, and using autonomous vehicle control techniques as are known, the computer 120 may determine the planned travel path, i.e., specific points that the vehicle 20 will cover on roads, etc., along the route. That is, a route may specify a road or roads included on the route, and a travel path includes specific points covered on the road or roads as the vehicle 20 travels the route.
- the computer 120 is further programmed to detect traffic conditions such as a state of a traffic signal within a vehicle-signal distance threshold to the first vehicle 20 , an intended change of trajectory of the first vehicle 20 , the target object 90 within an object-path distance threshold to the planned travel path of the first vehicle 20 , etc.
- traffic conditions such as a state of a traffic signal within a vehicle-signal distance threshold to the first vehicle 20 , an intended change of trajectory of the first vehicle 20 , the target object 90 within an object-path distance threshold to the planned travel path of the first vehicle 20 , etc.
- the vehicle-signal distance threshold is a maximum distance that the first vehicle 20 can be from the traffic signal 40 in order to trigger the projection of the symbol 164 .
- the vehicle-signal distance threshold can be a predetermined distance such as ten meters. In one case, the predetermined distance can be the same for each traffic signal 40 . In another case, the predetermined distance can be a predetermined distance for each traffic signal 40 . In this case, the vehicle-signal distance threshold for each traffic signal 40 may be maintained in a vehicle-signal distance threshold table.
- the object-path distance threshold is a maximum distance of the target object 90 to the planned travel path 208 in order to trigger the projection of the symbol.
- the object-path distance threshold can be a predetermined distance, such as ten meters. In other cases, the object-path distance threshold may depend on, for example, a location of the planned travel path 208 (on a street, a highway, in a city, in a rural area, etc.), a type of target object 90 (pedestrian, cyclist, second vehicle, etc.). In this case, the object-path distance threshold can be determined based on an object-path distance threshold table that provides object-path distance thresholds based on a geo-location of the planned travel path 208 and other factors.
- the computer 120 instructs the image projector 126 to project the symbol, or change the currently projected symbol, whereby the symbol is viewable from the target object 90 .
- the sensors 122 are communicatively coupled with the computer 120 and may be programmed to collect data related to the first vehicle 20 and the environment in which the first vehicle 20 is operating.
- sensors 122 may include cameras, LiDAR, radar, ultrasonic sensors, infrared sensors, pressure sensors, accelerometers, gyroscopes, temperature sensors, pressure sensors, hall sensors, optical sensors, voltage sensors, current sensors, mechanical sensors such as switches, a global positioning system (GPS), etc.
- GPS global positioning system
- the HMI 124 is communicatively coupled to the computer 120 in a known manner and includes one or more output devices such as a display, lamps, speakers, etc., for communicating data to a user.
- the HMI 124 further includes one or more input devices such as a touch screen display, buttons, a mouse, a keyboard, a microphone, a gesture recognition device, switches, etc., for receiving input from the user.
- the HMI 124 can receive input from the user of the first vehicle 20 .
- Input from the user may include a destination for the first vehicle 20 , a schedule for the first vehicle 20 , a route for the first vehicle, planned stops along the route for the first vehicle 20 , etc.
- the image projector 126 can project symbols on surfaces or in a direction that are external to the first vehicle 20 .
- the image projector 126 may project a symbol indicating that the first vehicle 20 is an autonomous vehicle on a road on which the first vehicle 20 is travelling.
- the image projector 126 includes one or more light sources, and a computer communicatively coupled with the computer 120 , and may further include one or more actuators such as motors or solenoids.
- the light sources may include light emitting diodes (LEDs), light emitting laser diodes, fluorescent lamps, high-intensity discharge lamps, xenon lamps, halogen lamps, etc.
- the image projector 126 can, based on instructions from the computer 120 , generate and project the symbol in a direction external to, i.e., outwardly from a body surface of, the vehicle 20 . As described in additional detail below, the image projector 126 may further be programmed to cause the symbol to move along or within a target area (e.g., move back and forth within a rectangular area, move along an arc shaped line), blink, change colors, etc.
- the target area is an area, determined by the computer 120 , in which the symbol is projected, to increase the likelihood that the symbol will be detected by the target object 90 .
- the computer 120 may determine the target area based on a location of the target object 90 , the type of the target object 90 , a line-of-sight of the target object 90 , a shortest straight line between the target object 90 and the planned travel path, or other factors that may impact the likelihood that the symbol will be detected by the target object 90 .
- the controllers 128 may be Electronic Control Units (ECUs) or the like such as are known and in any event include computers communicatively coupled with the computer 120 , and may further be communicatively coupled to actuators such as motors, solenoids, relays, switches, etc.
- the controllers 128 are programmed to receive instructions from the computer 120 , and based on the instructions, take actions such as controlling a direction of the first vehicle 20 , providing propulsion to the first vehicle 20 , braking the first vehicle 20 , etc.
- the network 30 is one or more mechanisms by which the first vehicle 20 , the traffic signal 40 and the server 60 communicate with each other, and may be one or more of various wired or wireless communication mechanisms, including any desired combination of wired (e.g., cable and fiber) and/or wireless (e.g., cellular, wireless, satellite, microwave and radio frequency) communication mechanisms and any desired network topology (or topologies when multiple communication mechanisms are utilized).
- Exemplary communication networks include wireless communication networks (e.g., using one or more of cellular, Bluetooth®, IEEE 802.11, etc.), local area networks (LAN) and/or wide area networks (WAN), including the Internet, providing data communication services.
- the types of wireless communications may include one or more of cellular, Bluetooth®, IEEE 802.11 (typically, Wi-Fi®), dedicated short range communications (DSRC), two-way satellite (e.g., emergency services), one-way satellite (e.g., receiving digital audio radio broadcasts), AM/FM radio, etc.
- IEEE 802.11 typically, Wi-Fi®
- DSRC dedicated short range communications
- two-way satellite e.g., emergency services
- one-way satellite e.g., receiving digital audio radio broadcasts
- AM/FM radio etc.
- the traffic signal 40 can generate signals such as a blinking light, colored lights (e.g., standard green, yellow, red traffic lights), a display such as the display of a traffic sign (e.g., a stop sign or arrow on an LED display), a speed of a vehicle (e.g., radar activated signs that indicate a vehicle's speed as it is approaching), etc., in order to control traffic.
- the traffic signal 40 may include a computer, a light source, a display, and one or more actuators.
- the traffic signal 40 may include green, yellow and red lamps, which may be activated to control traffic at an intersection, as is known.
- the traffic signal 40 may be communicatively coupled with the first vehicle 20 .
- the traffic signal 40 may be programmed to transmit a current state or a planned future state of the traffic signal 40 to the first vehicle 20 .
- the traffic signal 40 may transmit to the first vehicle 20 , via the network 30 , a message that the current state of the traffic signal 40 is “green” for a particular direction of the traffic signal 40 (e.g., facing the first vehicle 20 ).
- the traffic signal 40 may communicate a planned future state.
- the traffic signal 40 may communicate that it will change from the state “green” to a state “red” in a time period. The time period may be chosen to provide the target object 90 time to prepare for the change, for example two seconds.
- the server 60 is a computer including a processor and a memory, the memory storing instructions which may be executed by the processor.
- the server 60 is communicatively coupled, via the network 30 with the first vehicle 20 computer 120 and the one or more traffic signals 40 .
- the server 60 may be programmed to perform one or more of the functions described in reference to the computer 120 in the first vehicle 20 .
- the server 60 may be programmed to receive or determine the planned travel path for the first vehicle 20 .
- the server 60 may further be programmed to receive data from the first vehicle 20 regarding a first vehicle 20 status, and based on the data, to detect traffic conditions such as a state of a traffic signal 40 within the vehicle-signal distance threshold to the first vehicle 20 , an intended change of trajectory of the first vehicle 20 , the target object 90 within the object-path distance threshold of the planned travel path of the first vehicle 20 , etc.
- the first vehicle 20 status is a set of data describing the operating condition (location, speed, direction of travel, current planned travel path, etc.) of the first vehicle 20 .
- the first vehicle 20 status data can further include internal operating conditions such as engine speed, engine temperature, amount of fuel, tire pressure, etc.).
- the server 60 may generate and transmit instructions to the computer 120 in the first vehicle 20 to project one or more symbols and/or to modify one or more currently projected symbols.
- the server 60 may be programmed to provide data to the first vehicle 20 related to the first vehicle 20 and its environment.
- the server 60 may supply location data related to the first vehicle 20 , map data related to the location of the first vehicle 20 , the location of the one or more traffic signals 40 along the travel path of the first vehicle 20 , traffic data indicating a location and trajectory of target objects 90 along the travel path of the first vehicle 20 , light conditions along the travel path of the first vehicle 20 , etc.
- FIG. 2 is a perspective view of the first vehicle 20 .
- the first vehicle 20 includes one or more sensors 122 and the image projector 126 .
- FIG. 2 illustrates one sensor 122 on a top 21 (e.g., a roof) of the first vehicle 20 .
- the first vehicle 20 includes a plurality of sensors 122 located throughout the first vehicle 20 , not shown in FIG. 2 for ease of illustration.
- the image projector 126 may be included in a common housing 130 and/or on a common bracket 131 with a puddle lamp 132 . Including the image projector 126 in the common housing 130 with the puddle lamp 132 may conserve wiring and connecting costs related to connecting the image projector 126 to the computer 120 . Additionally, or alternatively, the image projector 126 may be located at other locations on the first vehicle 20 , for example, in a headlamp cavity, on a bumper, together with an external mirror, etc.
- the image projector 126 can generate the symbol 164 and project the symbol 164 via a light beam 162 . As shown in FIG. 2 , the image projector 126 may project the symbol 164 on a surface supporting the vehicle such as a road 200 . Additionally, or alternatively, the image projector 126 may project the symbol 164 onto any other surface within a range of the image projector 126 , for example on a sidewalk, a ground surface, etc.
- the range of the image projector 126 may be a distance that the image projector 126 can project the symbol 164 as determined by a strength of the light beam 162 , a level of light in the environment of the first vehicle 20 , obstacles in the environment to projecting the symbol 164 , etc.
- the symbol 164 may communicate to the target object 90 that the first vehicle 20 is an autonomous vehicle. Additionally, or alternatively, as described in additional detail below, the symbol 164 may indicate the travel path of the first vehicle 20 , a change in trajectory (starting, stopping, accelerating, decelerating, turning, etc.), of the first vehicle 20 , a traffic condition such as the state of a traffic signal 40 , etc. The symbol 164 may further be generated to move along the target area, blink, change color, change in shape, and/or include other dynamic features.
- FIG. 3 is a diagram of an example first vehicle 20 on a first vehicle travel path 208 .
- the first vehicle 20 is at an intersection 201 of first and second roads 200 a , 200 b .
- the traffic signal 40 is located within a first range 202 of the intersection 201 .
- the intersection 201 is defined to mean the area where the first and second roads 200 a , 200 b cross.
- a first range 202 of the intersection 201 may be used to determine or identify whether the traffic signal 40 , or other objects (including target objects 90 ) are associated with, or current proximate to the intersection 201 .
- the first range 202 may be defined as a range extending beyond the intersection 201 a first fixed distance, e.g., three meters, in every direction from the intersection 201 .
- the first range 202 may be predetermined and can define an irregular shape.
- the first range 202 can be included in map data indicating that the traffic signal 40 is associated with the intersection 201 and the first range 202 surrounding the intersection 201 .
- the first range 202 may be an irregular shape surrounding the intersection 201 , designed by a developer of the map data, to include traffic signals 40 , traffic signs, etc. associated with the intersection 201 .
- the first vehicle 20 has the planned travel path 208 .
- the planned travel path 208 for the first vehicle 20 is to turn left through the intersection 201 and continue out of the intersection 201 on the first road 200 a.
- the traffic condition may include one or more target objects 90 such as a pedestrian 90 a , a second vehicle 90 b , and/or a cyclist 90 c within the object-path distance threshold of the planned travel path 208 .
- the object-path distance threshold is a maximum distance between the target object 90 and the travel path 208 for which the computer 120 is programmed to instruct the image projector 126 to project the symbol 164 .
- the object-path distance threshold may be a fixed distance such as 10 meters, as measured to a point on the travel path 208 that is closest to the target object 90 . Additionally, or alternatively, the computer 120 may calculate the object-path distance threshold based on a type or characteristic of the target object 90 and/or factors in the environment. For example, the computer 120 may determine the object-path distance threshold to be 10 meters for the pedestrian 90 a, 20 meters for the second vehicle 90 b and 15 meters for the cyclist 90 c . As another example, the computer 120 may determine the object-path distance threshold based on other conditions that might influence a likelihood that an interaction or collision could occur between the first vehicle 20 and the target object 90 .
- the computer 120 may consider the type of road (street without sidewalk, street with sidewalk, intersection, highway, etc.) where the target object 90 is located, a current trajectory (speed and direction) of the target object, a current trajectory (speed and direction) of the first vehicle 20 , etc. for determining the object-path distance threshold.
- the computer 120 may include a table of object-path distance thresholds that indicates the object-path distance threshold based on relevant factors such as the type of target object, the type of road, etc. The computer 120 may then determine relevant factors and retrieve the object-path distance threshold from the table of object-path distance thresholds.
- FIG. 4 is a diagram of an example traffic condition that includes the first vehicle 20 . Further in the example illustration, the image projector 126 of the first vehicle 20 is projecting the symbol 164 indicating a state of the traffic signal 40 .
- the traffic signal 40 is in the first range 202 of the intersection 201 .
- a face 41 of the traffic signal 40 is emitting a red light toward the first vehicle 20 . Accordingly, the traffic signal 40 is in a “red state” for travel through the intersection 201 in the direction of travel of the first vehicle 20 .
- the first vehicle 20 is stopped at the first intersection 201 and is a vehicle-signal distance 402 away from the traffic signal 40 .
- the vehicle-signal distance 402 is the distance between the first vehicle 20 and the traffic signal 40 .
- the pedestrian 90 a is standing at a corner of the intersection 201 and looking down at a pedestrian's mobile telephone.
- a line-of-sight 406 of the pedestrian 90 a extends from a face of the pedestrian toward the pedestrian's mobile telephone and further to the first road 200 a .
- the pedestrian 90 a is a representative example of the target object 90 that may be included in the example traffic condition.
- the computer 120 in the first vehicle 20 receives traffic signal data indicating the state of the traffic signal 40 and further receives data regarding an object location of the target object 90 . Based on the traffic signal data and the object location of the target object 90 , the image projector 126 projects the traffic signal symbol 164 to indicate the state of the traffic signal 40 .
- the computer 120 may instruct the image projector 126 to project the traffic signal symbol 164 of the traffic signal 40 to a symbol location within an object-symbol range of the target object 90 .
- the object-symbol range indicates a maximum distance from the target object 90 for projecting the traffic signal symbol 164 .
- the object-symbol range may be determined to increase a likelihood that the target object 90 will see the traffic signal symbol 164 .
- the object-symbol range may be a fixed distance such as one meter from the target object 90 , in order to increase the likelihood that the traffic signal symbol 164 will appear in a peripheral vision of, or otherwise be detected by the target object 90 .
- the object-symbol range may be determined based on the type of target object 90 .
- the object-symbol range may be determined to be one meter.
- the object-symbol range may be determined to be three meters, and further determined to be on a particular side to account for a line-of-sight of a driver looking through a windshield of the second vehicle 90 b.
- the computer 120 may determine the symbol location for projecting the traffic signal symbol 164 based on the location of the target object 90 relative to the planned travel path 208 of the first vehicle 20 . For example, the computer 120 may instruct the image projector 126 to project the traffic signal symbol 164 between the target object 90 and the planned travel path 208 . In one example, the computer 120 may identify a shortest straight line path 404 between the target object 90 and the planned travel path 208 for the first vehicle 20 , and instruct the image projector 126 to project the traffic signal symbol 164 at the symbol location along the shortest straight line path 404 .
- the computer 120 may determine the symbol location for projecting the traffic signal symbol 164 based on the line-of-sight of the target object 90 .
- the computer 120 may use object or facial recognition systems such as are known to determine the line-of-sight 406 of the pedestrian 90 a , and instruct the image projector 126 to project the traffic signal symbol 164 along the line-of-sight 406 .
- the computer 120 may determine which direction the second vehicle 90 b is facing, and instruct the image projector 126 to project the traffic signal symbol 164 in front of the second vehicle 90 b .
- Directional indicators such as “front”, “in front of,” “behind,” “front end,” “rear end,” “left,” “right,” as used herein for the second vehicle 90 b , are referenced to a driver sitting in a driver's seat facing toward the steering wheel.
- FIG. 5 is a diagram of an exemplary process 500 for projecting the traffic signal symbol 164 indicating a state of the traffic signal 40 .
- the process 500 begins in a block 505 .
- the computer 120 in the first vehicle 20 receives an input indicating that the first vehicle 20 is being started.
- the first vehicle 20 may receive an input from the user of the first vehicle 20 , via the HMI 124 that the user would like to start a trip.
- the computer 120 may identify a trigger event (e.g., a scheduled pick-up), indicating that the first vehicle 20 is requested to travel to a location.
- a trigger event e.g., a scheduled pick-up
- the computer 120 determines or receives the planned travel path 208 for the first vehicle 20 .
- the computer 120 may receive route data such as a destination from the user of the first vehicle 20 . Based on the destination, and additional data such as map data, the computer 120 and/or another computer communicatively coupled with the computer 120 may determine the first vehicle route, using known route planning techniques.
- the computer 120 may determine, at points along the route, the planned travel path 208 for the first vehicle 20 , using known autonomous vehicle control techniques.
- the planned travel path 208 is the path the first vehicle 20 will steer along on the first and second roads 200 a , 200 b , i.e., as explained above, points on a road or other ground surface that the vehicle 20 will cover as it moves.
- the computer 120 may receive the planned travel path 208 from another computer in the first vehicle 20 , or from the server 60 .
- the process 500 continues in a block 515 .
- First vehicle data in this context includes data indicating operating conditions of the first vehicle such as trajectory (speed and direction), location, tire pressure, engine speed, fuel level, number of occupants, etc.
- Environment data is data that indicates conditions of the environment in which the first vehicle 20 is operating such as weather conditions, light conditions, road conditions, topological conditions, objects in the environment, etc.
- the computer 120 may collect, for example, global positioning system (GPS) data indicating a location, i.e., geo-coordinates, of the first vehicle 20 .
- GPS global positioning system
- the computer 120 may further receive data indicating target objects 90 , weather conditions, light conditions, etc. at the first vehicle location.
- the computer 120 may collect data indicating target objects 90 , weather conditions, light conditions, etc., along the planned travel path 208 of the first vehicle 20 .
- the process 500 continues in the block 520 .
- the computer 120 may determine whether weather conditions permit projecting symbols 164 by the first vehicle 20 .
- the computer 120 may consider a brightness of the environment at the first vehicle location. In the case that it is a bright, sunny day, with a light intensity from the sun above a predetermined light intensity level, the computer 120 may determine that weather conditions do not permit projecting symbols 164 for the first vehicle 20 . In this case, the process 500 continues in a block 525 .
- the computer 120 may be programmed to determine that weather conditions permit projecting symbols 164 by the first vehicle 20 . In this case, the process 500 continues in a block 530 .
- the computer 120 determines whether the first vehicle 20 is still running. For example, the computer 120 may collect data indicating that an ignition of the first vehicle 20 is still turned on, that an engine of the first vehicle 20 is still running, and/or an electric motor in a powertrain is engaged, etc. In the case that the first vehicle 20 is still running, the process 500 continues in the block 515 . In the case that the first vehicle 20 is no longer running, the process 500 ends.
- the computer 120 collects data related to target objects 90 within a data collection range of the first vehicle 20 .
- the computer 120 may collect visual data, LIDAR data, radar data, etc. that indicates locations of respective target objects 90 and further indicates features of the target objects 90 such as the type (pedestrian, vehicle, bicycle, etc.) of the respective target objects 90 , a trajectory of the respective target objects 90 , a direction that the respective target object 90 is facing, the line-of-sight of the respective target object 90 , etc.
- the data collection range of the first vehicle 20 may be, for example a range within which the sensors 122 detect target objects 90 and features of the target objects 90 .
- each sensor 122 may have a different range within which the respective sensor 122 detects target objects 90 and features of the target objects 90 .
- the data collection range of the first vehicle 20 may be a superposition of the detection range of each of the individual sensors 122 .
- the data collection range may be, for example, a fixed distance from the first vehicle 20 , such as 500 meters.
- the computer 120 determines whether at least one of the target objects 90 is within a target range.
- the target range is a range within which the target object 90 triggers traffic symbol projection toward the target object 90 .
- the target range may be defined as the planned travel path 208 of the first vehicle 20 plus an area surrounding the planned travel path 208 .
- the target range may be defined as the planned travel path 208 plus an area extending the object-path distance threshold from the planned travel path 208 on either side.
- the target range may be defined to include the planned travel path 208 , the area extending the object path distance threshold from the planned travel path 208 on either side, and in addition include the first range 202 surrounding the intersection 201 , as discussed in reference to FIG. 3 .
- the target range may be defined as the object-signal distance threshold of the traffic signal 40 .
- the object-signal distance threshold may be, for example, a fixed distance such as 10 meters.
- the computer 120 may determine that the target object 90 is within the target range in the case that the target object 90 is within the object-signal distance threshold of the traffic signal 40 .
- the process continues in a block 540 . Otherwise, the process 500 continues in the block 525 .
- the computer 120 determines whether a trigger event for projecting the symbol 164 is present.
- the trigger event is a traffic condition that, when detected by the first computer 120 , causes the first computer 120 to instruct the image projector 126 to project the symbol 164 .
- Example trigger events may include that the first vehicle 20 is stopped at the traffic signal 40 , that the first vehicle 20 is entering the intersection 201 , or that the first vehicle 20 is stopped in the intersection 201 waiting for an opportunity to turn left.
- the trigger event may be that the first vehicle 20 is within a vehicle-object distance threshold of the target object 90 , etc.
- the vehicle-object distance threshold may be a maximum distance between the first vehicle 20 and the target object 90 that triggers projecting the symbol 164 .
- the vehicle-object distance threshold may be, for example, a predetermined distance such as 50 meters. Alternatively, the vehicle-object distance threshold may be determined based on one or more factors such as the type of object (second vehicle, cyclist, pedestrian, person on rollerblades, etc.), a location (rural area, suburb, city street, busy intersection), vehicle trajectory (speed, direction, direction relative to the object), etc.
- the computer 120 may maintain or access a table of vehicle-object distance thresholds, and based on the factors, look up an applicable vehicle-object distance threshold based on the factors.
- the computer 120 may determine that the first vehicle 20 is within the vehicle-signal distance threshold of the traffic signal 40 . For example, the computer 120 may determine that the vehicle-traffic signal distance 402 is less than the vehicle-signal distance threshold. In the case that the computer 120 determines that the trigger for projecting the symbol 164 is present, the process 500 continues in a block 545 . In the case that the computer 120 does not determine the presence of the trigger event, the process 500 continues in the block 525 .
- the computer 120 collects data indicating the state of the traffic signal 40 .
- the state of the traffic signal 40 is a color of light emitted by the traffic signal 40 on the face 41 of the traffic signal 40 facing toward the first vehicle 20 .
- the traffic signal 40 may be communicatively coupled with the computer 120 via the network 30 .
- the computer 120 may receive the data indicating the state of the traffic signal 40 via radio frequency communications.
- the computer 120 may collect data indicating the state of the traffic signal 40 via sensors 122 .
- the sensor 122 may capture a visual image of the face 41 of the traffic signal 40 facing the first vehicle 20 .
- the computer 120 determines the state of the traffic signal 40 .
- the state of the traffic signal 40 may be directly obtained from the communications.
- the computer 120 may use object recognition as is known to determine the state of the traffic signal 40 .
- the process 500 continues in a block 555 .
- the computer 120 projects, via the image projector 126 in the first vehicle 20 , the traffic signal symbol 164 indicating the state of the traffic signal 40 .
- the computer 120 may instruct the image projector 126 to project the traffic signal symbol 164 in a direction determined based on the location of the target object 90 .
- the computer 120 may instruct the image projector 126 to project the traffic signal symbol 164 toward the target object 90 .
- the computer 120 may instruct the image projector 126 to project the traffic signal symbol 164 within the object-symbol range as described above. Additionally, or alternatively, the computer 120 may instruct the image projector 126 to project the traffic signal symbol 164 along the line-of-sight 406 of the target object 90 .
- the computer 120 may instruct the image projector 126 to project the traffic signal symbol 164 along the shortest straight line path 404 between the target object 90 and the planned travel path 208 of the first vehicle 20 . Also in this case, the computer 120 may additionally consider the object-symbol range in determining the location for projecting the symbol 164 .
- the traffic signal symbol 164 may indicate the state of the traffic signal 40 .
- the traffic signal symbol 164 may be a symbol of the traffic signal 40 (or a generic traffic signal) indicating the “red” state.
- the process 500 continues in a block 560 .
- the computer 120 determines whether the first vehicle 20 is past the traffic signal 40 .
- the computer 120 may determine, for example, the that the vehicle-signal distance 402 , indicating the distance of the first vehicle 20 to the traffic signal 40 , is no longer less than the vehicle-signal distance threshold.
- the computer 120 may determine that the traffic signal 40 is behind the first vehicle 20 , and that the trajectory of the first vehicle 20 is away from the traffic signal 40 .
- the process 500 continues in a block 565 .
- the computer 120 instructs the image projector 126 to stop projecting the traffic signal symbol 164 .
- the process 500 continues in the block 525 .
- FIG. 6 is a diagram of the image projector 126 in the first vehicle 20 projecting a symbol 164 indicating the first vehicle 20 trajectory.
- the first vehicle 20 is stopped at a first stop sign 640 before entering an intersection 601 .
- the intersection 601 is an area where the first and second roads 600 a , 600 b cross.
- a second vehicle 90 b is stopped at a second stop sign 641 .
- the second vehicle 90 b is entering the intersection 601 in an opposing direction to the first vehicle 20 , and is stopped at a second stop sign 641 .
- the first vehicle 20 has the planned travel path 208 .
- the planned travel path 208 is to enter the intersection 601 and turn left.
- a first range 602 of the intersection 601 may be used to determine or identify whether the first and second stop signs 640 , 641 , or other objects (including target objects 90 ) are associated with, or proximate to the intersection 601 .
- the first range 602 may be defined as a range extending beyond the intersection 601 a first fixed distance, e.g., three meters, in every direction from the intersection 601 .
- the first range 602 may be predetermined, and included in map data indicating that the first and second stop signs 640 , 641 are associated with the intersection 601 and the first range 602 surrounding the intersection 601 .
- the first range 602 may be an irregular shape surrounding the intersection, designed by the developer of the map data, to include the first and second stop signs 640 , 641 , traffic signals, etc. associated with the intersection 601 .
- the computer 120 projects, via the image projector 126 , the trajectory symbol 164 indicating the planned travel path 208 .
- FIGS. 7A and 7B are a diagram of an exemplary process 700 for projecting the trajectory symbol 164 indicating a vehicle change of trajectory.
- the process 700 begins in a block 705 .
- the computer 120 in the first vehicle 20 receives an input indicating that the first vehicle 20 is being started as described above in reference to the block 505 .
- the process 700 continues in a block 710 .
- the computer 120 determines or receives the planned travel path 208 for the first vehicle 20 as described above in reference to the block 510 .
- the process 700 continues in a block 715 .
- the computer 120 collects vehicle and environment data related to the first vehicle 20 as described in reference to the 515 .
- the process 700 continues in the block 720 .
- the computer 120 may determine whether weather conditions permit projecting symbols by the first vehicle 20 as described in reference to block 520 . In the case that the weather conditions do not permit projecting symbols by the first vehicle 20 , the process 700 continues in a block 725 . In the case that weather conditions do permit projecting symbols by the first vehicle 20 , the process 700 continues in a block 730 .
- the computer 120 determines whether the first vehicle 20 is still running. For example, the computer 120 may collect data indicating that an ignition of the first vehicle 20 is still turned on, that an engine of the first vehicle 20 is still running, and/or an electric motor in a powertrain is engaged, etc. In the case that the first vehicle 20 is still running, the process 700 continues in the block 715 . In the case that the first vehicle 20 is no longer running, the process 700 ends.
- the computer 120 collects data related to target objects 90 within the data collection range of the first vehicle 20 , as described with reference to the block 530 . Upon collecting data related to the target objects 90 within the data collection range, the process continues in a block 735 .
- the computer 120 determines whether at least one target object 90 is within the target range.
- the target range may be defined as the planned travel path 208 plus an area extending the object-path distance threshold from the plan travel path 208 on either side.
- the target range may be defined to include the planned travel path 208 , the area extending the object path distance threshold from the planned travel path 208 on either side, and in addition to include the first range 602 surrounding the intersection 601 , as discussed in reference to FIG. 6 .
- the target range may be defined as within an object-signal distance threshold of the traffic sign 640 .
- the object-signal distance threshold in the context of a detected traffic sign is a maximum distance between the target object 90 and the traffic sign 640 for which the computer 120 is programmed to instruct the image projector 126 to project the symbol 164 .
- the object-signal distance threshold may be a predetermined distance such as 10 meters. In another case, the object signal distance threshold may depend on one or more factors such as the type of object (pedestrian, cyclist, second vehicle, etc.), the type of sign (stop, yield, etc.), location of the sign (geo-coordinates indicating at which intersection the sign is located), etc.
- the computer 120 or server 60 may maintain a table of object-signal distance thresholds. The computer 120 may determine that the target object 90 is within the target range in the case that the target object 90 is within the object-signal distance threshold of the traffic sign 640 .
- the process continues in a block 740 . Otherwise, the process 700 continues in the block 725 .
- the computer 120 determines whether a trigger event for projecting the symbol 164 is present.
- Example trigger events may include that the first vehicle 20 is stopped at the traffic signal 40 , that the first vehicle 20 is entering the intersection 601 , is stopped in the intersection 601 waiting for an opportunity to turn left, is within a vehicle-object distance threshold, etc.
- the vehicle-object distance threshold may be, for example, a distance such as 50 meters.
- the process 700 continues in a block 750 . In the case that the computer 120 does not determine the presence of the trigger event, the process 700 continues in the block 725 .
- the computer 120 instructs the image projector 126 to project a first version of the trajectory symbol 164 .
- the computer 120 may instruct the image projector 126 to project the first version of the trajectory symbol 164 indicating the planned travel path 208 of the first vehicle 20 .
- the computer 120 may instruct the image projector 126 to project the first version of the trajectory symbol 164 in a first color, for example, red.
- the first version of the trajectory symbol 164 may be an outlined arrow as shown in FIG. 6 , two or more lines indicating the planned travel path 208 , a set of dots or dashed lines along the planned travel path 208 , etc.
- the process 700 continues in a block 755 .
- the computer 120 determines whether there is an upcoming change in trajectory for the first vehicle 20 .
- a change in trajectory may be accelerating, decelerating, or changing direction.
- the first vehicle 20 may be stopped at the stop sign 640 and planning to continue along the planned travel path 208 .
- the first vehicle 20 may be stopped in the intersection 601 , waiting for an opportunity to turn left.
- the first vehicle 20 may be going straight into the intersection 601 but planning to turn left once in the intersection.
- the process 700 continues in a block 765 .
- the process 700 continues in a block 760 .
- the computer 120 determines if the first vehicle has passed the target object 90 .
- the computer 120 may determine, for example, the that the vehicle-object distance, indicating the distance of the first vehicle 20 to the target object 90 , is no longer less than a vehicle-object distance threshold.
- the computer 120 may determine that the target object 90 is behind the first vehicle 20 , and that the trajectory of the first vehicle 20 is away from the target object 90 .
- the process 700 continues in a block 725 . Otherwise, the process 700 continues in the block 750 .
- the computer 120 determines whether the time until the change in trajectory is less than a time threshold.
- the time threshold may be a specified time, such as two seconds.
- the time threshold represents the period of time that an indication of the change of trajectory is provided to the target object 90 before the change of trajectory occurs.
- the process 700 continues in a block 770 . Otherwise, the process 700 continues in the block 750 .
- the computer 120 instructs the image projector 126 to project a second version of the trajectory symbol 164 to indicate the planned change in trajectory.
- the computer 120 may instruct the image projector 126 to project the second version trajectory symbol 164 to be a second color.
- the second color may be, for example, yellow or green.
- the computer 120 may cause the second version of the trajectory symbol 164 to blink. The blinking may be at, for example, a two Hertz rate.
- the computer 120 determines whether the first vehicle 20 is past the target object 90 as described above in reference to the block 760 . In the case that the first vehicle 20 is past the target object 90 , the process 700 continues in the block 780 . Otherwise, the process 700 continues in the block 770 .
- the computer 120 turns off the trajectory symbol 164 .
- the process continues in the block 725 .
- FIG. 8 is a diagram illustrating an example traffic condition in which the image projector 126 in the first vehicle 20 is projecting the symbol 164 moving through a target area 820 .
- the first vehicle 20 is entering an intersection 801 and is travelling along the planned travel path 208 .
- the traffic signal 40 is associated with the intersection 801 .
- the first vehicle 20 is a vehicle-signal distance 808 from the traffic signal 40 .
- the planned travel path 208 is to continue through the intersection 801 and turn left.
- the intersection 801 is an area where first and second roads 800 a , 800 b cross.
- a pedestrian 90 a is standing at a corner of the intersection 801 , and looking at the pedestrian's mobile telephone.
- a line-of-sight 806 of the pedestrian 90 a extends from the face of the pedestrian 90 a toward the pedestrian's mobile telephone and further to the first road 800 a .
- the pedestrian 90 a is a representative example of the target object 90 that may be included in the example traffic condition.
- the planned travel path 208 passes by the target object 90 within a distance less than the object-path distance threshold.
- a shortest straight line path 804 extends between the target object 90 and the planned travel path 208 .
- the shortest straight line path 804 indicates the shortest path between the target object 90 and the travel path 208 .
- a first range 802 of the intersection 801 may be used to determine or identify whether the traffic signal 40 or other objects (including target objects 90 ) are associated with, or proximate to the intersection 801 .
- the first range 802 may be defined as a range extending beyond the intersection 801 a first fixed distance, e.g., three meters, in every direction from the intersection 801 .
- the first range 802 may be predetermined, and included in map data indicating that the traffic signal 40 is associated with the intersection 801 and the first range 802 surrounding the intersection 801 .
- the first range 802 may be an irregular shape surrounding the intersection 801 , designed by a developer of the map data, to include traffic signals 40 , traffic signs, etc. associated with the intersection 801 .
- the computer 120 projects, via the image projector 126 , the symbol 164 moving back and forth along the target area 820 .
- the term “back and forth” as used herein means alternately between a first direction and a second opposite direction.
- the computer 120 determines the target area 820 to increase the likelihood that the target object 90 will see the symbol 164 .
- FIGS. 9A and 9B are a diagram of an exemplary process 900 for projecting the symbol 164 moving along the target area 820 .
- the process 900 begins in a block 905 .
- the computer 120 in the first vehicle 20 receives an input indicating that the first vehicle 20 is being started as described above in reference to the block 505 .
- the process 900 continues in a block 910 .
- the computer 120 determines or receives the planned travel path 208 for the first vehicle 20 as described above in reference to the block 510 .
- the process 900 continues in a block 915 .
- the computer 120 collects location data and environment data related to the first vehicle 20 as described in reference to the 515 .
- the process 900 continues in the block 920 .
- the computer 120 may determine whether weather conditions permit projecting symbols by the first vehicle 20 as described in reference to block 520 . In the case that the weather conditions do not permit projecting symbols by the first vehicle 20 , the process 900 continues in a block 925 . In the case that weather conditions do permit projecting symbols by the first vehicle 20 , the process 900 continues in a block 930 .
- the computer 120 determines whether the first vehicle 20 is still running. For example, the computer 120 may collect data indicating that an ignition of the first vehicle 20 is still turned on, that an engine of the first vehicle 20 is still running, and/or an electric motor in a powertrain is engaged, etc. In the case that the first vehicle 20 is still running, the process 900 continues in the block 915 . In the case that the first vehicle 20 is no longer running, the process 900 ends.
- the computer 120 collects data related to target objects 90 within the data collection range of the first vehicle 20 , as described with reference to the block 535 . Upon collecting data related to the target objects 90 with the data collection range, the process continues in a block 935 .
- the computer 120 determines whether at least one target object 90 is within the target range.
- the target range may be defined as the planned travel path 208 of the first vehicle 20 plus an area surrounding the plan travel path 208 .
- the target range may be defined as the planned travel path 208 plus an area extending the object-path distance threshold from the plan travel path 208 on either side.
- the target range may be defined to include the planned travel path 208 , the area extending the object path distance threshold from the planned travel path 208 on either side, and in addition include the first range 802 surrounding the intersection 801 , as discussed in reference to FIG. 8 .
- the target range may be defined as within an object-signal distance threshold of the traffic signal 40 .
- the object-signal distance threshold may be, for example, a distance such as 10 meters.
- the computer 120 may determine that the target object 90 is within the target range in the case that the target object 90 is within the object-signal distance threshold of the traffic signal 40 .
- the process continues in a block 940 . Otherwise, the process 900 continues in the block 925 .
- the computer 120 determines whether a trigger event for projecting the symbol 164 is present.
- Example trigger events may include that the first vehicle 20 is stopped at the traffic signal 40 , that the first vehicle 20 is entering the intersection 801 , is stopped in the intersection 801 waiting for an opportunity to turn left, is within the vehicle-object distance threshold, etc.
- the vehicle-object distance threshold may be, for example, a fixed distance such as 50 meters.
- the process 900 continues in a block 945 .
- the process 900 continues in the block 925 .
- the computer 120 determines the target area 820 for projecting the symbol 164 based on the location of the target object 90 .
- the target area 820 is the range along which the computer 120 will instruct the image projector 126 to project the symbol 164 and is determined to increase the likelihood that the target object 90 will see the symbol 164 .
- the computer 120 will instruct the image projector 126 to move the symbol 164 through the target area 820 .
- the computer 120 may determine the target area 820 to be a rectangular area, and may move the symbol 164 back and forth within the rectangular area, as indicated in FIG. 8 .
- the computer 120 may determine the target area 820 based on one or more parameters such as the location of the target object 90 , the object-symbol range, the line-of-sight 806 of the target object 90 , the shortest straight line path 804 between the target object 90 and the travel path 208 , a direction of the first road 800 a where it crosses the shortest straight line path 804 , etc.
- the computer 120 may locate the target area 820 be within the object-symbol range of the target object 90 .
- the computer 120 may locate the target area 820 such that the shortest straight line path 804 passes through a middle of the target area 820 .
- the computer 120 may further determine the target area 820 to extend an extension range beyond the shortest straight line path 804 on either side.
- the extension range may be a predetermined distance such as 0.5 meters.
- the extension range may be determined based on factors such as the type of target object 90 .
- the extension range could be 0.5 meters when the target object 90 is a pedestrian or a cyclist, and one meter when the target object is a second vehicle.
- the computer 120 may further determine the target area 820 to run perpendicular to the shortest straight line path 804 .
- the computer 120 may determine the target area such that the line-of-sight 806 of the target object 90 passes through the target area 820 .
- the computer 120 may determine the target area 820 to extend the extension range on either side of the line-of-sight of the target object 90 .
- the line-of-sight 806 is shown to be the line-of-sight 806 of the pedestrian 90 a .
- the line-of-sight for determining the target area 820 may depend on the type of target object 90 . For example, for a second vehicle 90 b (see, for example, FIG. 6 ), the line-of-sight may be a line through a front windshield of the second vehicle 90 b , towards a road in front of the second vehicle 90 b.
- the computer 120 may determine the target area 820 to run parallel to the travel path 208 , or parallel to the first road 800 a associated with the travel path 208 .
- the computer 120 may determine the target area 820 to be an arc that passes around the target object 90 , between the target object 90 and the first road 800 a .
- the target area 820 may be determined to be circular, i.e., the symbol 164 may be projected along a circular path, or to be projected in an X pattern, around an oval, etc.
- the target area 820 may be determined to cross a crosswalk at a particular location.
- the process 900 Upon determining the target area 820 , the process 900 continues in a block 950 .
- the computer 120 instructs the image projector 126 to project the symbol 164 to move within or along the target area 820 .
- the computer 120 may instruct the image projector 126 to project the symbol 164 to move back and forth within the target area 820 .
- the computer 120 may instruct the image projector 126 to project the symbol 164 to move in a circular or oval pattern within or along the target area 820 .
- the computer 120 may instruct the image projector 126 to project the symbol 164 to move at a predetermined speed that is determined to get the attention of the target object 90 .
- the predetermined speed may be in a range from 0.1 to two meters per second.
- the computer 120 may be programmed to cause the symbol 164 to blink.
- the blinking frequency may be determined to get the attention of the target object 90 , and may be in a range of five to eight Hertz.
- the process 900 Upon projecting the symbol 164 to move within the target area 820 , the process 900 continues in a block 955 .
- the computer 120 determines whether the first vehicle 20 is past the target object 90 as described above in reference to the block 760 . In the case that the first vehicle 20 is past the target object 90 , the process 900 continues in the block 960 . Otherwise, the process 900 continues in the block 950 .
- the computer 120 instructs the image projector 126 to stop projecting the symbol 164 .
- the process continues in the block 925 .
- Computing devices such as those discussed herein generally each include instructions executable by one or more computing devices such as those identified above, and for carrying out blocks or steps of processes described above.
- process blocks discussed above may be embodied as computer-executable instructions.
- Computer-executable instructions may be compiled or interpreted from computer programs created using a variety of programming languages and/or technologies, including, without limitation, and either alone or in combination, JavaTM, C, C++, Visual Basic, Java Script, Perl, HTML, etc.
- a processor e.g., a microprocessor
- receives instructions e.g., from a memory, a computer-readable medium, etc., and executes these instructions, thereby performing one or more processes, including one or more of the processes described herein.
- Such instructions and other data may be stored in files and transmitted using a variety of computer-readable media.
- a file in a computing device is generally a collection of data stored on a computer readable medium, such as a storage medium, a random-access memory, etc.
- a computer-readable medium includes any medium that participates in providing data (e.g., instructions), which may be read by a computer. Such a medium may take many forms, including, but not limited to, non-volatile media, volatile media, etc.
- Non-volatile media include, for example, optical or magnetic disks and other persistent memory.
- Volatile media include dynamic random access memory (DRAM), which typically constitutes a main memory.
- DRAM dynamic random access memory
- Computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EEPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
- exemplary is used herein in the sense of signifying an example, e.g., a reference to an “exemplary widget” should be read as simply referring to an example of a widget.
- adverb “approximately” modifying a value or result means that a shape, structure, measurement, value, determination, calculation, etc. may deviate from an exact described geometry, distance, measurement, value, determination, calculation, etc., because of imperfections in materials, machining, manufacturing, sensor measurements, computations, processing time, communications time, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Electromagnetism (AREA)
- Aviation & Aerospace Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Traffic Control Systems (AREA)
- Lighting Device Outwards From Vehicle And Optical Signal (AREA)
Abstract
Description
- Autonomous and semi-autonomous vehicles may share a road with pedestrians, cyclists and other vehicles, both autonomous and non-autonomous. The pedestrians, cyclists and other vehicles (which may be referred to as “target objects”) may not be aware that they are in traffic with the autonomous vehicle. Further, the target objects, i.e., a human operator thereof, may be distracted by the use of mobile phones, conversations with other occupants, food, etc. When distracted, the target object operator may not make adequate observation of an environment around the target object, which may include traffic conditions such as other vehicles, traffic lights, traffic signs, etc. A problem exists in that technology has not been developed to identify and take action based on certain traffic conditions.
-
FIG. 1 is a block diagram of an example vehicular image projection system. -
FIG. 2A is a perspective view of a vehicle including an image projector. -
FIG. 2B is a perspective view of a housing for a puddle lamp including the image projector. -
FIG. 3 is a diagram of an example vehicle illustrating a vehicle travel path. -
FIG. 4 is a diagram of an example vehicle projecting a traffic signal symbol. -
FIG. 5 is a diagram of an exemplary process for projecting a symbol based on a traffic signal state. -
FIG. 6 is a diagram of an example vehicle projecting a symbol for indicating a vehicle change of trajectory. -
FIG. 7A is a diagram of a first portion of an exemplary process for projecting the symbol for indicating the vehicle change of trajectory. -
FIG. 7B is a diagram of the second portion of the exemplary process ofFIG. 7A . -
FIG. 8 is a diagram of an example vehicle projecting the symbol moving within a target area. -
FIG. 9A is a diagram of a first portion of an exemplary process for projecting the symbol moving within the target area. -
FIG. 9B is a diagram of the second portion of the exemplary process ofFIG. 9A . - A computer is programmed to determine a target area to project, along a planned travel path of a vehicle, a symbol based on detecting a target object and actuate a light source to project the symbol moving within the target area. The computer can be further programmed to move the image in alternately in a first direction and a second opposite direction within the target area. The computer can be further programmed to determine the target area based on a type of the target object.
- The computer can be further programmed to determine the target area based on a line-of-sight of the target object. The computer can be further programmed to determine the target area based on a shortest straight line path from the target object to the planned travel path. The computer can be further programmed to determine the target area based on a direction of a road through which the planned travel path passes.
- The computer can be further programmed to actuate the light source based on a determination that the target object is within a maximum distance of the planned travel path. The computer can be further programmed to actuate the light source based on a determination that the target object is within a maximum distance of the vehicle. The computer can be further programmed to actuate the light source based on a determination that the vehicle is within a first maximum distance of a traffic signal and the target object is within a second maximum distance of the traffic signal. The computer can be further programmed to actuate the light source based on a determination that the vehicle is stopped at the traffic signal.
- A method includes determining a target area to project, along a planned travel path for a vehicle, a symbol based on detecting a target object and actuating a light source to project the symbol moving within the target area. The method can further include moving the image alternately in a first direction and a second opposite direction within the target area. The method can further include determining the target area based on a type of the target object. The method can further include determining the target area based on a line-of-sight of the target object.
- The method can further include determining the target area based on a shortest straight line path from the target object to the planned travel path. The method can further include determining the target area based on a direction of a road through which the planned travel path passes. The method can further include actuating the light source based on a determination that the target object is within a maximum distance of the planned travel path.
- The method can further include actuating the light source based on a determination that the target object is within a maximum distance of the vehicle. The method can further include actuating the light source based on a determination that the vehicle is within a first maximum distance of a traffic signal and the target object is within a second maximum distance of the traffic signal. The method can further include actuating the light source based on a determination that the vehicle is stopped at the traffic signal.
- Further disclosed is a computer programmed to execute any one of the above method steps. Yet further disclosed is a vehicle including the computer. Yet further disclosed is a computer program product, including a computer readable medium storing instructions executable by a computer processor, to execute any of the above method steps.
-
FIG. 1 is a diagram of anexemplary system 10 for projecting a symbol by afirst vehicle 20 based on a detected traffic condition. Targetobjects 90, as used herein, refers to pedestrians, second vehicles, bicycles, motorcycles, scooters, skateboards, and other types of vehicles controlled by people.Target objects 90 may further include animals. For example, a deer on a side of a road could be thetarget object 90. - The
system 10 includes afirst vehicle 20, and anetwork 30. Thesystem 10 may further include one ormore traffic signals 40, and aserver 60. - The
first vehicle 20 is generally a land-based vehicle having three or more wheels, e.g., a passenger car, light truck, etc. Thefirst vehicle 20 includes acomputer 120,sensors 122, a human-machine interface (HMI) 124, animage projector 126 andcontrollers 128. - The
first vehicle 20 can be an autonomous or semi-autonomous vehicle. In an autonomousfirst vehicle 20 thecomputer 120 controls thefirst vehicle 20 by sending instructions tocontrollers 128 including controllers for steering, propulsion (e.g., a powertrain with electric and/or internal combustion elements), and braking; in a semi-autonomousfirst vehicle 20 thecomputer 120 controls one or two of steering, propulsion, and braking. - The
computer 120 includes a processor and a memory. The memory includes one or more types of computer-readable media, and storing instructions executable by the processor for performing various operations, including as disclosed herein. Further, thecomputer 120 may include and/or be communicatively coupled to one or more other computers, including vehicle components such as thesensors 122, the HMI 124, theimage projector 126, and thecontrollers 128, which likewise may include respective processors and memories. Communications, i.e., communicative coupling, may be achieved via a controller area network (CAN) bus or local interconnect network (LIN) bus, a wired and/or wireless in-vehicle local area network (LAN), e.g., using wired or wireless technologies such as Wi-Fi®, Bluetooth®, etc., as is known. - As described in additional detail below, the
computer 120 is programmed to receive and/or determine a planned travel path for thefirst vehicle 20. The planned travel path is the path thefirst vehicle 20 will steer along on a roadway. For example, thecomputer 120 may receive a route indicating a starting point, a destination, and the roads for thefirst vehicle 20 to follow to arrive at the destination. Based on the received route, and using autonomous vehicle control techniques as are known, thecomputer 120 may determine the planned travel path, i.e., specific points that thevehicle 20 will cover on roads, etc., along the route. That is, a route may specify a road or roads included on the route, and a travel path includes specific points covered on the road or roads as thevehicle 20 travels the route. Thecomputer 120 is further programmed to detect traffic conditions such as a state of a traffic signal within a vehicle-signal distance threshold to thefirst vehicle 20, an intended change of trajectory of thefirst vehicle 20, thetarget object 90 within an object-path distance threshold to the planned travel path of thefirst vehicle 20, etc. - The vehicle-signal distance threshold is a maximum distance that the
first vehicle 20 can be from thetraffic signal 40 in order to trigger the projection of thesymbol 164. The vehicle-signal distance threshold can be a predetermined distance such as ten meters. In one case, the predetermined distance can be the same for eachtraffic signal 40. In another case, the predetermined distance can be a predetermined distance for eachtraffic signal 40. In this case, the vehicle-signal distance threshold for eachtraffic signal 40 may be maintained in a vehicle-signal distance threshold table. - The object-path distance threshold is a maximum distance of the
target object 90 to the plannedtravel path 208 in order to trigger the projection of the symbol. The object-path distance threshold can be a predetermined distance, such as ten meters. In other cases, the object-path distance threshold may depend on, for example, a location of the planned travel path 208 (on a street, a highway, in a city, in a rural area, etc.), a type of target object 90 (pedestrian, cyclist, second vehicle, etc.). In this case, the object-path distance threshold can be determined based on an object-path distance threshold table that provides object-path distance thresholds based on a geo-location of the plannedtravel path 208 and other factors. - Based on the detected traffic condition, the
computer 120 instructs theimage projector 126 to project the symbol, or change the currently projected symbol, whereby the symbol is viewable from thetarget object 90. - The
sensors 122 are communicatively coupled with thecomputer 120 and may be programmed to collect data related to thefirst vehicle 20 and the environment in which thefirst vehicle 20 is operating. By way of example, and not limitation,sensors 122 may include cameras, LiDAR, radar, ultrasonic sensors, infrared sensors, pressure sensors, accelerometers, gyroscopes, temperature sensors, pressure sensors, hall sensors, optical sensors, voltage sensors, current sensors, mechanical sensors such as switches, a global positioning system (GPS), etc. - The
HMI 124 is communicatively coupled to thecomputer 120 in a known manner and includes one or more output devices such as a display, lamps, speakers, etc., for communicating data to a user. TheHMI 124 further includes one or more input devices such as a touch screen display, buttons, a mouse, a keyboard, a microphone, a gesture recognition device, switches, etc., for receiving input from the user. - The
HMI 124 can receive input from the user of thefirst vehicle 20. Input from the user may include a destination for thefirst vehicle 20, a schedule for thefirst vehicle 20, a route for the first vehicle, planned stops along the route for thefirst vehicle 20, etc. - The
image projector 126 can project symbols on surfaces or in a direction that are external to thefirst vehicle 20. For example, theimage projector 126 may project a symbol indicating that thefirst vehicle 20 is an autonomous vehicle on a road on which thefirst vehicle 20 is travelling. Theimage projector 126 includes one or more light sources, and a computer communicatively coupled with thecomputer 120, and may further include one or more actuators such as motors or solenoids. The light sources may include light emitting diodes (LEDs), light emitting laser diodes, fluorescent lamps, high-intensity discharge lamps, xenon lamps, halogen lamps, etc. - The
image projector 126 can, based on instructions from thecomputer 120, generate and project the symbol in a direction external to, i.e., outwardly from a body surface of, thevehicle 20. As described in additional detail below, theimage projector 126 may further be programmed to cause the symbol to move along or within a target area (e.g., move back and forth within a rectangular area, move along an arc shaped line), blink, change colors, etc. The target area is an area, determined by thecomputer 120, in which the symbol is projected, to increase the likelihood that the symbol will be detected by thetarget object 90. As discussed in additional detail below, thecomputer 120 may determine the target area based on a location of thetarget object 90, the type of thetarget object 90, a line-of-sight of thetarget object 90, a shortest straight line between thetarget object 90 and the planned travel path, or other factors that may impact the likelihood that the symbol will be detected by thetarget object 90. - The
controllers 128 may be Electronic Control Units (ECUs) or the like such as are known and in any event include computers communicatively coupled with thecomputer 120, and may further be communicatively coupled to actuators such as motors, solenoids, relays, switches, etc. Thecontrollers 128 are programmed to receive instructions from thecomputer 120, and based on the instructions, take actions such as controlling a direction of thefirst vehicle 20, providing propulsion to thefirst vehicle 20, braking thefirst vehicle 20, etc. - The
network 30 is one or more mechanisms by which thefirst vehicle 20, thetraffic signal 40 and theserver 60 communicate with each other, and may be one or more of various wired or wireless communication mechanisms, including any desired combination of wired (e.g., cable and fiber) and/or wireless (e.g., cellular, wireless, satellite, microwave and radio frequency) communication mechanisms and any desired network topology (or topologies when multiple communication mechanisms are utilized). Exemplary communication networks include wireless communication networks (e.g., using one or more of cellular, Bluetooth®, IEEE 802.11, etc.), local area networks (LAN) and/or wide area networks (WAN), including the Internet, providing data communication services. - The types of wireless communications may include one or more of cellular, Bluetooth®, IEEE 802.11 (typically, Wi-Fi®), dedicated short range communications (DSRC), two-way satellite (e.g., emergency services), one-way satellite (e.g., receiving digital audio radio broadcasts), AM/FM radio, etc.
- The
traffic signal 40 can generate signals such as a blinking light, colored lights (e.g., standard green, yellow, red traffic lights), a display such as the display of a traffic sign (e.g., a stop sign or arrow on an LED display), a speed of a vehicle (e.g., radar activated signs that indicate a vehicle's speed as it is approaching), etc., in order to control traffic. Thetraffic signal 40 may include a computer, a light source, a display, and one or more actuators. For example, thetraffic signal 40 may include green, yellow and red lamps, which may be activated to control traffic at an intersection, as is known. - In addition, the
traffic signal 40 may be communicatively coupled with thefirst vehicle 20. Thetraffic signal 40 may be programmed to transmit a current state or a planned future state of thetraffic signal 40 to thefirst vehicle 20. For example, thetraffic signal 40 may transmit to thefirst vehicle 20, via thenetwork 30, a message that the current state of thetraffic signal 40 is “green” for a particular direction of the traffic signal 40 (e.g., facing the first vehicle 20). Further, thetraffic signal 40 may communicate a planned future state. For example, thetraffic signal 40 may communicate that it will change from the state “green” to a state “red” in a time period. The time period may be chosen to provide thetarget object 90 time to prepare for the change, for example two seconds. - The
server 60 is a computer including a processor and a memory, the memory storing instructions which may be executed by the processor. Theserver 60 is communicatively coupled, via thenetwork 30 with thefirst vehicle 20computer 120 and the one ormore traffic signals 40. - The
server 60 may be programmed to perform one or more of the functions described in reference to thecomputer 120 in thefirst vehicle 20. For example, theserver 60 may be programmed to receive or determine the planned travel path for thefirst vehicle 20. As described in additional detail below, theserver 60 may further be programmed to receive data from thefirst vehicle 20 regarding afirst vehicle 20 status, and based on the data, to detect traffic conditions such as a state of atraffic signal 40 within the vehicle-signal distance threshold to thefirst vehicle 20, an intended change of trajectory of thefirst vehicle 20, thetarget object 90 within the object-path distance threshold of the planned travel path of thefirst vehicle 20, etc. Thefirst vehicle 20 status is a set of data describing the operating condition (location, speed, direction of travel, current planned travel path, etc.) of thefirst vehicle 20. Thefirst vehicle 20 status data can further include internal operating conditions such as engine speed, engine temperature, amount of fuel, tire pressure, etc.). Based on the detected traffic condition, theserver 60 may generate and transmit instructions to thecomputer 120 in thefirst vehicle 20 to project one or more symbols and/or to modify one or more currently projected symbols. - Additionally, the
server 60 may be programmed to provide data to thefirst vehicle 20 related to thefirst vehicle 20 and its environment. For example, theserver 60 may supply location data related to thefirst vehicle 20, map data related to the location of thefirst vehicle 20, the location of the one ormore traffic signals 40 along the travel path of thefirst vehicle 20, traffic data indicating a location and trajectory of target objects 90 along the travel path of thefirst vehicle 20, light conditions along the travel path of thefirst vehicle 20, etc. -
FIG. 2 is a perspective view of thefirst vehicle 20. As described above, thefirst vehicle 20 includes one ormore sensors 122 and theimage projector 126.FIG. 2 illustrates onesensor 122 on a top 21 (e.g., a roof) of thefirst vehicle 20. Typically, thefirst vehicle 20 includes a plurality ofsensors 122 located throughout thefirst vehicle 20, not shown inFIG. 2 for ease of illustration. - As illustrated in
FIG. 2 , theimage projector 126 may be included in acommon housing 130 and/or on acommon bracket 131 with apuddle lamp 132. Including theimage projector 126 in thecommon housing 130 with thepuddle lamp 132 may conserve wiring and connecting costs related to connecting theimage projector 126 to thecomputer 120. Additionally, or alternatively, theimage projector 126 may be located at other locations on thefirst vehicle 20, for example, in a headlamp cavity, on a bumper, together with an external mirror, etc. - The
image projector 126 can generate thesymbol 164 and project thesymbol 164 via alight beam 162. As shown inFIG. 2 , theimage projector 126 may project thesymbol 164 on a surface supporting the vehicle such as aroad 200. Additionally, or alternatively, theimage projector 126 may project thesymbol 164 onto any other surface within a range of theimage projector 126, for example on a sidewalk, a ground surface, etc. The range of theimage projector 126 may be a distance that theimage projector 126 can project thesymbol 164 as determined by a strength of thelight beam 162, a level of light in the environment of thefirst vehicle 20, obstacles in the environment to projecting thesymbol 164, etc. - The
symbol 164 may communicate to thetarget object 90 that thefirst vehicle 20 is an autonomous vehicle. Additionally, or alternatively, as described in additional detail below, thesymbol 164 may indicate the travel path of thefirst vehicle 20, a change in trajectory (starting, stopping, accelerating, decelerating, turning, etc.), of thefirst vehicle 20, a traffic condition such as the state of atraffic signal 40, etc. Thesymbol 164 may further be generated to move along the target area, blink, change color, change in shape, and/or include other dynamic features. -
FIG. 3 is a diagram of an examplefirst vehicle 20 on a firstvehicle travel path 208. Thefirst vehicle 20 is at anintersection 201 of first andsecond roads traffic signal 40 is located within afirst range 202 of theintersection 201. Theintersection 201 is defined to mean the area where the first andsecond roads first range 202 of theintersection 201 may be used to determine or identify whether thetraffic signal 40, or other objects (including target objects 90) are associated with, or current proximate to theintersection 201. Thefirst range 202 may be defined as a range extending beyond the intersection 201 a first fixed distance, e.g., three meters, in every direction from theintersection 201. Additionally, or alternatively, thefirst range 202 may be predetermined and can define an irregular shape. Thefirst range 202 can be included in map data indicating that thetraffic signal 40 is associated with theintersection 201 and thefirst range 202 surrounding theintersection 201. For example, thefirst range 202 may be an irregular shape surrounding theintersection 201, designed by a developer of the map data, to includetraffic signals 40, traffic signs, etc. associated with theintersection 201. - The
first vehicle 20 has the plannedtravel path 208. In the example ofFIG. 3 , the plannedtravel path 208 for thefirst vehicle 20 is to turn left through theintersection 201 and continue out of theintersection 201 on thefirst road 200 a. - As further shown in
FIG. 3 , the traffic condition may include one or more target objects 90 such as apedestrian 90 a, asecond vehicle 90 b, and/or acyclist 90 c within the object-path distance threshold of the plannedtravel path 208. The object-path distance threshold is a maximum distance between thetarget object 90 and thetravel path 208 for which thecomputer 120 is programmed to instruct theimage projector 126 to project thesymbol 164. - The object-path distance threshold may be a fixed distance such as 10 meters, as measured to a point on the
travel path 208 that is closest to thetarget object 90. Additionally, or alternatively, thecomputer 120 may calculate the object-path distance threshold based on a type or characteristic of thetarget object 90 and/or factors in the environment. For example, thecomputer 120 may determine the object-path distance threshold to be 10 meters for thepedestrian second vehicle 90 b and 15 meters for thecyclist 90 c. As another example, thecomputer 120 may determine the object-path distance threshold based on other conditions that might influence a likelihood that an interaction or collision could occur between thefirst vehicle 20 and thetarget object 90. For example, thecomputer 120 may consider the type of road (street without sidewalk, street with sidewalk, intersection, highway, etc.) where thetarget object 90 is located, a current trajectory (speed and direction) of the target object, a current trajectory (speed and direction) of thefirst vehicle 20, etc. for determining the object-path distance threshold. Thecomputer 120 may include a table of object-path distance thresholds that indicates the object-path distance threshold based on relevant factors such as the type of target object, the type of road, etc. Thecomputer 120 may then determine relevant factors and retrieve the object-path distance threshold from the table of object-path distance thresholds. -
FIG. 4 is a diagram of an example traffic condition that includes thefirst vehicle 20. Further in the example illustration, theimage projector 126 of thefirst vehicle 20 is projecting thesymbol 164 indicating a state of thetraffic signal 40. Thetraffic signal 40 is in thefirst range 202 of theintersection 201. Aface 41 of thetraffic signal 40 is emitting a red light toward thefirst vehicle 20. Accordingly, thetraffic signal 40 is in a “red state” for travel through theintersection 201 in the direction of travel of thefirst vehicle 20. - The
first vehicle 20 is stopped at thefirst intersection 201 and is a vehicle-signal distance 402 away from thetraffic signal 40. The vehicle-signal distance 402 is the distance between thefirst vehicle 20 and thetraffic signal 40. Thepedestrian 90 a is standing at a corner of theintersection 201 and looking down at a pedestrian's mobile telephone. A line-of-sight 406 of thepedestrian 90 a extends from a face of the pedestrian toward the pedestrian's mobile telephone and further to thefirst road 200 a. Thepedestrian 90 a is a representative example of thetarget object 90 that may be included in the example traffic condition. - As described below, the
computer 120 in thefirst vehicle 20 receives traffic signal data indicating the state of thetraffic signal 40 and further receives data regarding an object location of thetarget object 90. Based on the traffic signal data and the object location of thetarget object 90, theimage projector 126 projects thetraffic signal symbol 164 to indicate the state of thetraffic signal 40. - The
computer 120 may instruct theimage projector 126 to project thetraffic signal symbol 164 of thetraffic signal 40 to a symbol location within an object-symbol range of thetarget object 90. The object-symbol range indicates a maximum distance from thetarget object 90 for projecting thetraffic signal symbol 164. The object-symbol range may be determined to increase a likelihood that thetarget object 90 will see thetraffic signal symbol 164. For example, the object-symbol range may be a fixed distance such as one meter from thetarget object 90, in order to increase the likelihood that thetraffic signal symbol 164 will appear in a peripheral vision of, or otherwise be detected by thetarget object 90. Alternatively, the object-symbol range may be determined based on the type oftarget object 90. For example, for apedestrian 90 a or acyclist 90 c, the object-symbol range may be determined to be one meter. For thesecond vehicle 90 b, the object-symbol range may be determined to be three meters, and further determined to be on a particular side to account for a line-of-sight of a driver looking through a windshield of thesecond vehicle 90 b. - Additionally, or alternatively, the
computer 120 may determine the symbol location for projecting thetraffic signal symbol 164 based on the location of thetarget object 90 relative to the plannedtravel path 208 of thefirst vehicle 20. For example, thecomputer 120 may instruct theimage projector 126 to project thetraffic signal symbol 164 between thetarget object 90 and the plannedtravel path 208. In one example, thecomputer 120 may identify a shorteststraight line path 404 between thetarget object 90 and the plannedtravel path 208 for thefirst vehicle 20, and instruct theimage projector 126 to project thetraffic signal symbol 164 at the symbol location along the shorteststraight line path 404. - Still further, the
computer 120 may determine the symbol location for projecting thetraffic signal symbol 164 based on the line-of-sight of thetarget object 90. In the case of thepedestrian 90 a, thecomputer 120 may use object or facial recognition systems such as are known to determine the line-of-sight 406 of thepedestrian 90 a, and instruct theimage projector 126 to project thetraffic signal symbol 164 along the line-of-sight 406. - In the case of the
second vehicle 90 b, thecomputer 120 may determine which direction thesecond vehicle 90 b is facing, and instruct theimage projector 126 to project thetraffic signal symbol 164 in front of thesecond vehicle 90 b. Directional indicators such as “front”, “in front of,” “behind,” “front end,” “rear end,” “left,” “right,” as used herein for thesecond vehicle 90 b, are referenced to a driver sitting in a driver's seat facing toward the steering wheel. -
FIG. 5 is a diagram of an exemplary process 500 for projecting thetraffic signal symbol 164 indicating a state of thetraffic signal 40. The process 500 begins in ablock 505. - In the
block 505, thecomputer 120 in thefirst vehicle 20 receives an input indicating that thefirst vehicle 20 is being started. For example, thefirst vehicle 20 may receive an input from the user of thefirst vehicle 20, via theHMI 124 that the user would like to start a trip. As another example, thecomputer 120 may identify a trigger event (e.g., a scheduled pick-up), indicating that thefirst vehicle 20 is requested to travel to a location. Upon receiving the input indicating that thefirst vehicle 20 is being started, the process 500 continues in ablock 510. - In the
block 510, thecomputer 120 determines or receives the plannedtravel path 208 for thefirst vehicle 20. As a first example, thecomputer 120 may receive route data such as a destination from the user of thefirst vehicle 20. Based on the destination, and additional data such as map data, thecomputer 120 and/or another computer communicatively coupled with thecomputer 120 may determine the first vehicle route, using known route planning techniques. - Based on the first vehicle route, the
computer 120 may determine, at points along the route, the plannedtravel path 208 for thefirst vehicle 20, using known autonomous vehicle control techniques. The plannedtravel path 208 is the path thefirst vehicle 20 will steer along on the first andsecond roads vehicle 20 will cover as it moves. Alternatively, thecomputer 120 may receive the plannedtravel path 208 from another computer in thefirst vehicle 20, or from theserver 60. Upon determining or receiving the plannedtravel path 208, the process 500 continues in ablock 515. - In the
block 515, thecomputer 120 collects first vehicle data and environment data. First vehicle data in this context includes data indicating operating conditions of the first vehicle such as trajectory (speed and direction), location, tire pressure, engine speed, fuel level, number of occupants, etc. Environment data is data that indicates conditions of the environment in which thefirst vehicle 20 is operating such as weather conditions, light conditions, road conditions, topological conditions, objects in the environment, etc. Thecomputer 120 may collect, for example, global positioning system (GPS) data indicating a location, i.e., geo-coordinates, of thefirst vehicle 20. Thecomputer 120 may further receive data indicating target objects 90, weather conditions, light conditions, etc. at the first vehicle location. Additionally, thecomputer 120 may collect data indicating target objects 90, weather conditions, light conditions, etc., along the plannedtravel path 208 of thefirst vehicle 20. Upon collecting the first vehicle data and data related to the environment of thefirst vehicle 20, the process 500 continues in theblock 520. - In the
block 520, thecomputer 120 may determine whether weather conditions permit projectingsymbols 164 by thefirst vehicle 20. For example, thecomputer 120 may consider a brightness of the environment at the first vehicle location. In the case that it is a bright, sunny day, with a light intensity from the sun above a predetermined light intensity level, thecomputer 120 may determine that weather conditions do not permit projectingsymbols 164 for thefirst vehicle 20. In this case, the process 500 continues in ablock 525. On the other hand, in the case that the light intensity from the sun is below the predetermined light intensity level, thecomputer 120 may be programmed to determine that weather conditions permit projectingsymbols 164 by thefirst vehicle 20. In this case, the process 500 continues in ablock 530. - In the
block 525, thecomputer 120 determines whether thefirst vehicle 20 is still running. For example, thecomputer 120 may collect data indicating that an ignition of thefirst vehicle 20 is still turned on, that an engine of thefirst vehicle 20 is still running, and/or an electric motor in a powertrain is engaged, etc. In the case that thefirst vehicle 20 is still running, the process 500 continues in theblock 515. In the case that thefirst vehicle 20 is no longer running, the process 500 ends. - In the
block 530, thecomputer 120 collects data related to target objects 90 within a data collection range of thefirst vehicle 20. Thecomputer 120 may collect visual data, LIDAR data, radar data, etc. that indicates locations of respective target objects 90 and further indicates features of the target objects 90 such as the type (pedestrian, vehicle, bicycle, etc.) of the respective target objects 90, a trajectory of the respective target objects 90, a direction that therespective target object 90 is facing, the line-of-sight of therespective target object 90, etc. - The data collection range of the
first vehicle 20 may be, for example a range within which thesensors 122 detecttarget objects 90 and features of the target objects 90. In one case, eachsensor 122 may have a different range within which therespective sensor 122 detects target objects 90 and features of the target objects 90. In this case, the data collection range of thefirst vehicle 20 may be a superposition of the detection range of each of theindividual sensors 122. Alternatively, the data collection range may be, for example, a fixed distance from thefirst vehicle 20, such as 500 meters. Upon collecting data related to the target objects 90 with the data collection range, the process continues in ablock 535. - In the
block 535, thecomputer 120 determines whether at least one of the target objects 90 is within a target range. The target range is a range within which thetarget object 90 triggers traffic symbol projection toward thetarget object 90. - The target range may be defined as the planned
travel path 208 of thefirst vehicle 20 plus an area surrounding the plannedtravel path 208. As one example, the target range may be defined as the plannedtravel path 208 plus an area extending the object-path distance threshold from the plannedtravel path 208 on either side. - In another example, the target range may be defined to include the planned
travel path 208, the area extending the object path distance threshold from the plannedtravel path 208 on either side, and in addition include thefirst range 202 surrounding theintersection 201, as discussed in reference toFIG. 3 . - In another example, the target range may be defined as the object-signal distance threshold of the
traffic signal 40. The object-signal distance threshold may be, for example, a fixed distance such as 10 meters. Thecomputer 120 may determine that thetarget object 90 is within the target range in the case that thetarget object 90 is within the object-signal distance threshold of thetraffic signal 40. - In the case that the
computer 120 determines that thetarget object 90 is within the target range, the process continues in ablock 540. Otherwise, the process 500 continues in theblock 525. - In the
block 540, thecomputer 120 determines whether a trigger event for projecting thesymbol 164 is present. The trigger event is a traffic condition that, when detected by thefirst computer 120, causes thefirst computer 120 to instruct theimage projector 126 to project thesymbol 164. Example trigger events may include that thefirst vehicle 20 is stopped at thetraffic signal 40, that thefirst vehicle 20 is entering theintersection 201, or that thefirst vehicle 20 is stopped in theintersection 201 waiting for an opportunity to turn left. As another example, the trigger event may be that thefirst vehicle 20 is within a vehicle-object distance threshold of thetarget object 90, etc. The vehicle-object distance threshold may be a maximum distance between thefirst vehicle 20 and thetarget object 90 that triggers projecting thesymbol 164. The vehicle-object distance threshold may be, for example, a predetermined distance such as 50 meters. Alternatively, the vehicle-object distance threshold may be determined based on one or more factors such as the type of object (second vehicle, cyclist, pedestrian, person on rollerblades, etc.), a location (rural area, suburb, city street, busy intersection), vehicle trajectory (speed, direction, direction relative to the object), etc. Thecomputer 120 may maintain or access a table of vehicle-object distance thresholds, and based on the factors, look up an applicable vehicle-object distance threshold based on the factors. - As another example, the
computer 120 may determine that thefirst vehicle 20 is within the vehicle-signal distance threshold of thetraffic signal 40. For example, thecomputer 120 may determine that the vehicle-traffic signal distance 402 is less than the vehicle-signal distance threshold. In the case that thecomputer 120 determines that the trigger for projecting thesymbol 164 is present, the process 500 continues in ablock 545. In the case that thecomputer 120 does not determine the presence of the trigger event, the process 500 continues in theblock 525. - In the
block 545, thecomputer 120 collects data indicating the state of thetraffic signal 40. The state of thetraffic signal 40 is a color of light emitted by thetraffic signal 40 on theface 41 of thetraffic signal 40 facing toward thefirst vehicle 20. - In one case, the
traffic signal 40 may be communicatively coupled with thecomputer 120 via thenetwork 30. In this case, thecomputer 120 may receive the data indicating the state of thetraffic signal 40 via radio frequency communications. In another case, thecomputer 120 may collect data indicating the state of thetraffic signal 40 viasensors 122. As seen inFIG. 4 , thesensor 122 may capture a visual image of theface 41 of thetraffic signal 40 facing thefirst vehicle 20. Upon collecting the data indicating the state of thetraffic signal 40, the process 500 continues in ablock 550. - In the
block 550, thecomputer 120 determines the state of thetraffic signal 40. In the case of receiving the city thetraffic signal 40 via radio frequency communications, the state of thetraffic signal 40 may be directly obtained from the communications. In the case of capturing the visual image data representing the state of the traffic signal, thecomputer 120 may use object recognition as is known to determine the state of thetraffic signal 40. Upon determining the state of thetraffic signal 40, the process 500 continues in ablock 555. - In the
block 555, thecomputer 120 projects, via theimage projector 126 in thefirst vehicle 20, thetraffic signal symbol 164 indicating the state of thetraffic signal 40. Thecomputer 120 may instruct theimage projector 126 to project thetraffic signal symbol 164 in a direction determined based on the location of thetarget object 90. - The
computer 120 may instruct theimage projector 126 to project thetraffic signal symbol 164 toward thetarget object 90. For example, thecomputer 120 may instruct theimage projector 126 to project thetraffic signal symbol 164 within the object-symbol range as described above. Additionally, or alternatively, thecomputer 120 may instruct theimage projector 126 to project thetraffic signal symbol 164 along the line-of-sight 406 of thetarget object 90. - As another example, the
computer 120 may instruct theimage projector 126 to project thetraffic signal symbol 164 along the shorteststraight line path 404 between thetarget object 90 and the plannedtravel path 208 of thefirst vehicle 20. Also in this case, thecomputer 120 may additionally consider the object-symbol range in determining the location for projecting thesymbol 164. - The
traffic signal symbol 164 may indicate the state of thetraffic signal 40. For example, in the case that thetraffic signal 40 is in the “red” state in the direction facing thefirst vehicle 20, thetraffic signal symbol 164 may be a symbol of the traffic signal 40 (or a generic traffic signal) indicating the “red” state. Upon projecting thetraffic signal symbol 164, the process 500 continues in ablock 560. - In the
block 560, thecomputer 120 determines whether thefirst vehicle 20 is past thetraffic signal 40. Thecomputer 120 may determine, for example, the that the vehicle-signal distance 402, indicating the distance of thefirst vehicle 20 to thetraffic signal 40, is no longer less than the vehicle-signal distance threshold. As another example, thecomputer 120 may determine that thetraffic signal 40 is behind thefirst vehicle 20, and that the trajectory of thefirst vehicle 20 is away from thetraffic signal 40. Upon determining that thefirst vehicle 20 is past thetraffic signal 40, the process 500 continues in ablock 565. - In the
block 565, thecomputer 120 instructs theimage projector 126 to stop projecting thetraffic signal symbol 164. Upon stopping to project thetraffic signal symbol 164, the process 500 continues in theblock 525. -
FIG. 6 is a diagram of theimage projector 126 in thefirst vehicle 20 projecting asymbol 164 indicating thefirst vehicle 20 trajectory. Thefirst vehicle 20 is stopped at afirst stop sign 640 before entering anintersection 601. Theintersection 601 is an area where the first andsecond roads 600 a, 600 b cross. Asecond vehicle 90 b is stopped at asecond stop sign 641. Thesecond vehicle 90 b is entering theintersection 601 in an opposing direction to thefirst vehicle 20, and is stopped at asecond stop sign 641. Thefirst vehicle 20 has the plannedtravel path 208. The plannedtravel path 208 is to enter theintersection 601 and turn left. - A
first range 602 of theintersection 601 may be used to determine or identify whether the first andsecond stop signs intersection 601. Thefirst range 602 may be defined as a range extending beyond the intersection 601 a first fixed distance, e.g., three meters, in every direction from theintersection 601. Additionally, or alternatively, thefirst range 602 may be predetermined, and included in map data indicating that the first andsecond stop signs intersection 601 and thefirst range 602 surrounding theintersection 601. For example, thefirst range 602 may be an irregular shape surrounding the intersection, designed by the developer of the map data, to include the first andsecond stop signs intersection 601. - The
computer 120 projects, via theimage projector 126, thetrajectory symbol 164 indicating the plannedtravel path 208. -
FIGS. 7A and 7B are a diagram of anexemplary process 700 for projecting thetrajectory symbol 164 indicating a vehicle change of trajectory. Theprocess 700 begins in ablock 705. - In the
block 705, thecomputer 120 in thefirst vehicle 20 receives an input indicating that thefirst vehicle 20 is being started as described above in reference to theblock 505. Upon receiving the input indicating that thefirst vehicle 20 is being started, theprocess 700 continues in ablock 710. - In the
block 710, thecomputer 120 determines or receives the plannedtravel path 208 for thefirst vehicle 20 as described above in reference to theblock 510. Upon determining or receiving the plannedtravel path 208, theprocess 700 continues in ablock 715. - In the
block 715, thecomputer 120 collects vehicle and environment data related to thefirst vehicle 20 as described in reference to the 515. Upon collecting the vehicle and environment data, theprocess 700 continues in theblock 720. - In the
block 720, thecomputer 120 may determine whether weather conditions permit projecting symbols by thefirst vehicle 20 as described in reference to block 520. In the case that the weather conditions do not permit projecting symbols by thefirst vehicle 20, theprocess 700 continues in ablock 725. In the case that weather conditions do permit projecting symbols by thefirst vehicle 20, theprocess 700 continues in ablock 730. - In the
block 725, thecomputer 120 determines whether thefirst vehicle 20 is still running. For example, thecomputer 120 may collect data indicating that an ignition of thefirst vehicle 20 is still turned on, that an engine of thefirst vehicle 20 is still running, and/or an electric motor in a powertrain is engaged, etc. In the case that thefirst vehicle 20 is still running, theprocess 700 continues in theblock 715. In the case that thefirst vehicle 20 is no longer running, theprocess 700 ends. - In the
block 730, which follows theblock 720, thecomputer 120 collects data related to target objects 90 within the data collection range of thefirst vehicle 20, as described with reference to theblock 530. Upon collecting data related to the target objects 90 within the data collection range, the process continues in ablock 735. - In the
block 735, thecomputer 120 determines whether at least onetarget object 90 is within the target range. - As one example, the target range may be defined as the planned
travel path 208 plus an area extending the object-path distance threshold from theplan travel path 208 on either side. - In another example, the target range may be defined to include the planned
travel path 208, the area extending the object path distance threshold from the plannedtravel path 208 on either side, and in addition to include thefirst range 602 surrounding theintersection 601, as discussed in reference toFIG. 6 . - In another example, the target range may be defined as within an object-signal distance threshold of the
traffic sign 640. The object-signal distance threshold, in the context of a detected traffic sign is a maximum distance between thetarget object 90 and thetraffic sign 640 for which thecomputer 120 is programmed to instruct theimage projector 126 to project thesymbol 164. - In one case, the object-signal distance threshold may be a predetermined distance such as 10 meters. In another case, the object signal distance threshold may depend on one or more factors such as the type of object (pedestrian, cyclist, second vehicle, etc.), the type of sign (stop, yield, etc.), location of the sign (geo-coordinates indicating at which intersection the sign is located), etc. The
computer 120 orserver 60 may maintain a table of object-signal distance thresholds. Thecomputer 120 may determine that thetarget object 90 is within the target range in the case that thetarget object 90 is within the object-signal distance threshold of thetraffic sign 640. - In the case that the
computer 120 determines that thetarget object 90 is within the target range, the process continues in ablock 740. Otherwise, theprocess 700 continues in theblock 725. - In the
block 740, thecomputer 120 determines whether a trigger event for projecting thesymbol 164 is present. Example trigger events may include that thefirst vehicle 20 is stopped at thetraffic signal 40, that thefirst vehicle 20 is entering theintersection 601, is stopped in theintersection 601 waiting for an opportunity to turn left, is within a vehicle-object distance threshold, etc. The vehicle-object distance threshold may be, for example, a distance such as 50 meters. In the case that thecomputer 120 determines that the trigger for projecting thesymbol 164 is present, theprocess 700 continues in ablock 750. In the case that thecomputer 120 does not determine the presence of the trigger event, theprocess 700 continues in theblock 725. - In the
block 750 thecomputer 120 instructs theimage projector 126 to project a first version of thetrajectory symbol 164. For example, thecomputer 120 may instruct theimage projector 126 to project the first version of thetrajectory symbol 164 indicating the plannedtravel path 208 of thefirst vehicle 20. For example, in the case that thefirst vehicle 20 is stopped, thecomputer 120 may instruct theimage projector 126 to project the first version of thetrajectory symbol 164 in a first color, for example, red. The first version of thetrajectory symbol 164 may be an outlined arrow as shown inFIG. 6 , two or more lines indicating the plannedtravel path 208, a set of dots or dashed lines along the plannedtravel path 208, etc. Upon projecting thetrajectory symbol 164, theprocess 700 continues in ablock 755. - In the
block 755, thecomputer 120 determines whether there is an upcoming change in trajectory for thefirst vehicle 20. A change in trajectory may be accelerating, decelerating, or changing direction. For example, thefirst vehicle 20 may be stopped at thestop sign 640 and planning to continue along the plannedtravel path 208. As another example, thefirst vehicle 20 may be stopped in theintersection 601, waiting for an opportunity to turn left. As another example, thefirst vehicle 20 may be going straight into theintersection 601 but planning to turn left once in the intersection. In the case that thecomputer 120 determines that there is a planned change in trajectory, theprocess 700 continues in ablock 765. In the case that there is no planned change in trajectory, theprocess 700 continues in ablock 760. - In the
block 760, thecomputer 120 determines if the first vehicle has passed thetarget object 90. Thecomputer 120 may determine, for example, the that the vehicle-object distance, indicating the distance of thefirst vehicle 20 to thetarget object 90, is no longer less than a vehicle-object distance threshold. As another example, thecomputer 120 may determine that thetarget object 90 is behind thefirst vehicle 20, and that the trajectory of thefirst vehicle 20 is away from thetarget object 90. In the case that thecomputer 120 determines that thefirst vehicle 20 is past thetarget object 90, theprocess 700 continues in ablock 725. Otherwise, theprocess 700 continues in theblock 750. - In the
block 765, which follows theblock 755, thecomputer 120 determines whether the time until the change in trajectory is less than a time threshold. The time threshold may be a specified time, such as two seconds. The time threshold represents the period of time that an indication of the change of trajectory is provided to thetarget object 90 before the change of trajectory occurs. - In the case that the time until the change in trajectory is less than the time threshold, the
process 700 continues in ablock 770. Otherwise, theprocess 700 continues in theblock 750. - In the
block 770, thecomputer 120 instructs theimage projector 126 to project a second version of thetrajectory symbol 164 to indicate the planned change in trajectory. For example, in the case that the first version of thetrajectory symbol 164 was the first color, thecomputer 120 may instruct theimage projector 126 to project the secondversion trajectory symbol 164 to be a second color. The second color may be, for example, yellow or green. As another example, thecomputer 120 may cause the second version of thetrajectory symbol 164 to blink. The blinking may be at, for example, a two Hertz rate. Upon projecting the second version of thetrajectory symbol 164, the process continues in theblock 775. - In the
block 775, thecomputer 120 determines whether thefirst vehicle 20 is past thetarget object 90 as described above in reference to theblock 760. In the case that thefirst vehicle 20 is past thetarget object 90, theprocess 700 continues in theblock 780. Otherwise, theprocess 700 continues in theblock 770. - In the
block 780, thecomputer 120 turns off thetrajectory symbol 164. The process continues in theblock 725. -
FIG. 8 is a diagram illustrating an example traffic condition in which theimage projector 126 in thefirst vehicle 20 is projecting thesymbol 164 moving through atarget area 820. Thefirst vehicle 20 is entering anintersection 801 and is travelling along the plannedtravel path 208. Thetraffic signal 40 is associated with theintersection 801. Thefirst vehicle 20 is a vehicle-signal distance 808 from thetraffic signal 40. - The planned
travel path 208 is to continue through theintersection 801 and turn left. Theintersection 801 is an area where first andsecond roads pedestrian 90 a is standing at a corner of theintersection 801, and looking at the pedestrian's mobile telephone. A line-of-sight 806 of thepedestrian 90 a extends from the face of thepedestrian 90 a toward the pedestrian's mobile telephone and further to thefirst road 800 a. Thepedestrian 90 a is a representative example of thetarget object 90 that may be included in the example traffic condition. - The planned
travel path 208 passes by thetarget object 90 within a distance less than the object-path distance threshold. A shorteststraight line path 804 extends between thetarget object 90 and the plannedtravel path 208. The shorteststraight line path 804 indicates the shortest path between thetarget object 90 and thetravel path 208. - A
first range 802 of theintersection 801 may be used to determine or identify whether thetraffic signal 40 or other objects (including target objects 90) are associated with, or proximate to theintersection 801. Thefirst range 802 may be defined as a range extending beyond the intersection 801 a first fixed distance, e.g., three meters, in every direction from theintersection 801. Additionally, or alternatively, thefirst range 802 may be predetermined, and included in map data indicating that thetraffic signal 40 is associated with theintersection 801 and thefirst range 802 surrounding theintersection 801. For example, thefirst range 802 may be an irregular shape surrounding theintersection 801, designed by a developer of the map data, to includetraffic signals 40, traffic signs, etc. associated with theintersection 801. - The
computer 120 projects, via theimage projector 126, thesymbol 164 moving back and forth along thetarget area 820. The term “back and forth” as used herein means alternately between a first direction and a second opposite direction. As described in additional detail below, thecomputer 120 determines thetarget area 820 to increase the likelihood that thetarget object 90 will see thesymbol 164. -
FIGS. 9A and 9B are a diagram of anexemplary process 900 for projecting thesymbol 164 moving along thetarget area 820. Theprocess 900 begins in ablock 905. - In the
block 905, thecomputer 120 in thefirst vehicle 20 receives an input indicating that thefirst vehicle 20 is being started as described above in reference to theblock 505. Upon receiving the input indicating that thefirst vehicle 20 is being started, theprocess 900 continues in ablock 910. - In the
block 910, thecomputer 120 determines or receives the plannedtravel path 208 for thefirst vehicle 20 as described above in reference to theblock 510. Upon determining or receiving the plannedtravel path 208, theprocess 900 continues in ablock 915. - In the
block 915, thecomputer 120 collects location data and environment data related to thefirst vehicle 20 as described in reference to the 515. Upon collecting the location environment data related to thefirst vehicle 20, theprocess 900 continues in theblock 920. - In the
block 920, thecomputer 120 may determine whether weather conditions permit projecting symbols by thefirst vehicle 20 as described in reference to block 520. In the case that the weather conditions do not permit projecting symbols by thefirst vehicle 20, theprocess 900 continues in ablock 925. In the case that weather conditions do permit projecting symbols by thefirst vehicle 20, theprocess 900 continues in ablock 930. - In the
block 925, thecomputer 120 determines whether thefirst vehicle 20 is still running. For example, thecomputer 120 may collect data indicating that an ignition of thefirst vehicle 20 is still turned on, that an engine of thefirst vehicle 20 is still running, and/or an electric motor in a powertrain is engaged, etc. In the case that thefirst vehicle 20 is still running, theprocess 900 continues in theblock 915. In the case that thefirst vehicle 20 is no longer running, theprocess 900 ends. - In the
block 930, which follows theblock 920, thecomputer 120 collects data related to target objects 90 within the data collection range of thefirst vehicle 20, as described with reference to theblock 535. Upon collecting data related to the target objects 90 with the data collection range, the process continues in ablock 935. - In the
block 935, thecomputer 120 determines whether at least onetarget object 90 is within the target range. - The target range may be defined as the planned
travel path 208 of thefirst vehicle 20 plus an area surrounding theplan travel path 208. As one example, the target range may be defined as the plannedtravel path 208 plus an area extending the object-path distance threshold from theplan travel path 208 on either side. - In another example, the target range may be defined to include the planned
travel path 208, the area extending the object path distance threshold from the plannedtravel path 208 on either side, and in addition include thefirst range 802 surrounding theintersection 801, as discussed in reference toFIG. 8 . - In another example, the target range may be defined as within an object-signal distance threshold of the
traffic signal 40. The object-signal distance threshold may be, for example, a distance such as 10 meters. Thecomputer 120 may determine that thetarget object 90 is within the target range in the case that thetarget object 90 is within the object-signal distance threshold of thetraffic signal 40. - In the case that the
computer 120 determines that thetarget object 90 is within the target range, the process continues in ablock 940. Otherwise, theprocess 900 continues in theblock 925. - In the
block 940, thecomputer 120 determines whether a trigger event for projecting thesymbol 164 is present. Example trigger events may include that thefirst vehicle 20 is stopped at thetraffic signal 40, that thefirst vehicle 20 is entering theintersection 801, is stopped in theintersection 801 waiting for an opportunity to turn left, is within the vehicle-object distance threshold, etc. The vehicle-object distance threshold may be, for example, a fixed distance such as 50 meters. In the case that thecomputer 120 determines that the trigger for projecting thesymbol 164 is present, theprocess 900 continues in ablock 945. In the case that thecomputer 120 does not determine the presence of the trigger event, theprocess 900 continues in theblock 925. - In the
block 945, thecomputer 120 determines thetarget area 820 for projecting thesymbol 164 based on the location of thetarget object 90. Thetarget area 820 is the range along which thecomputer 120 will instruct theimage projector 126 to project thesymbol 164 and is determined to increase the likelihood that thetarget object 90 will see thesymbol 164. As described below, thecomputer 120 will instruct theimage projector 126 to move thesymbol 164 through thetarget area 820. As one example, thecomputer 120 may determine thetarget area 820 to be a rectangular area, and may move thesymbol 164 back and forth within the rectangular area, as indicated inFIG. 8 . - The
computer 120 may determine thetarget area 820 based on one or more parameters such as the location of thetarget object 90, the object-symbol range, the line-of-sight 806 of thetarget object 90, the shorteststraight line path 804 between thetarget object 90 and thetravel path 208, a direction of thefirst road 800 a where it crosses the shorteststraight line path 804, etc. - For example, initially, the
computer 120 may locate thetarget area 820 be within the object-symbol range of thetarget object 90. Thecomputer 120 may locate thetarget area 820 such that the shorteststraight line path 804 passes through a middle of thetarget area 820. Thecomputer 120 may further determine thetarget area 820 to extend an extension range beyond the shorteststraight line path 804 on either side. The extension range may be a predetermined distance such as 0.5 meters. Alternatively, the extension range may be determined based on factors such as the type oftarget object 90. For example, the extension range could be 0.5 meters when thetarget object 90 is a pedestrian or a cyclist, and one meter when the target object is a second vehicle. Thecomputer 120 may further determine thetarget area 820 to run perpendicular to the shorteststraight line path 804. - Alternatively, the
computer 120 may determine the target area such that the line-of-sight 806 of thetarget object 90 passes through thetarget area 820. Thecomputer 120 may determine thetarget area 820 to extend the extension range on either side of the line-of-sight of thetarget object 90. InFIG. 8 , the line-of-sight 806 is shown to be the line-of-sight 806 of thepedestrian 90 a. The line-of-sight for determining thetarget area 820 may depend on the type oftarget object 90. For example, for asecond vehicle 90 b (see, for example,FIG. 6 ), the line-of-sight may be a line through a front windshield of thesecond vehicle 90 b, towards a road in front of thesecond vehicle 90 b. - As another example, alternatively to determining the
target area 820 to run perpendicular to the shorteststraight line path 804, thecomputer 120 may determine thetarget area 820 to run parallel to thetravel path 208, or parallel to thefirst road 800 a associated with thetravel path 208. - The above examples are non-limiting. Many other possibilities for determining the
target area 820 are possible. For example, thecomputer 120 may determine thetarget area 820 to be an arc that passes around thetarget object 90, between thetarget object 90 and thefirst road 800 a. As another example, thetarget area 820 may be determined to be circular, i.e., thesymbol 164 may be projected along a circular path, or to be projected in an X pattern, around an oval, etc. Still further, thetarget area 820 may be determined to cross a crosswalk at a particular location. - Upon determining the
target area 820, theprocess 900 continues in ablock 950. - In the
block 950 thecomputer 120 instructs theimage projector 126 to project thesymbol 164 to move within or along thetarget area 820. For example, thecomputer 120 may instruct theimage projector 126 to project thesymbol 164 to move back and forth within thetarget area 820. As another example, thecomputer 120 may instruct theimage projector 126 to project thesymbol 164 to move in a circular or oval pattern within or along thetarget area 820. Thecomputer 120 may instruct theimage projector 126 to project thesymbol 164 to move at a predetermined speed that is determined to get the attention of thetarget object 90. For example, the predetermined speed may be in a range from 0.1 to two meters per second. - Additionally, the
computer 120 may be programmed to cause thesymbol 164 to blink. The blinking frequency may be determined to get the attention of thetarget object 90, and may be in a range of five to eight Hertz. - Upon projecting the
symbol 164 to move within thetarget area 820, theprocess 900 continues in ablock 955. - In the
block 955, thecomputer 120 determines whether thefirst vehicle 20 is past thetarget object 90 as described above in reference to theblock 760. In the case that thefirst vehicle 20 is past thetarget object 90, theprocess 900 continues in theblock 960. Otherwise, theprocess 900 continues in theblock 950. - In the
block 960, thecomputer 120 instructs theimage projector 126 to stop projecting thesymbol 164. The process continues in theblock 925. - Computing devices such as those discussed herein generally each include instructions executable by one or more computing devices such as those identified above, and for carrying out blocks or steps of processes described above. For example, process blocks discussed above may be embodied as computer-executable instructions.
- Computer-executable instructions may be compiled or interpreted from computer programs created using a variety of programming languages and/or technologies, including, without limitation, and either alone or in combination, Java™, C, C++, Visual Basic, Java Script, Perl, HTML, etc. In general, a processor (e.g., a microprocessor) receives instructions, e.g., from a memory, a computer-readable medium, etc., and executes these instructions, thereby performing one or more processes, including one or more of the processes described herein. Such instructions and other data may be stored in files and transmitted using a variety of computer-readable media. A file in a computing device is generally a collection of data stored on a computer readable medium, such as a storage medium, a random-access memory, etc.
- A computer-readable medium includes any medium that participates in providing data (e.g., instructions), which may be read by a computer. Such a medium may take many forms, including, but not limited to, non-volatile media, volatile media, etc. Non-volatile media include, for example, optical or magnetic disks and other persistent memory. Volatile media include dynamic random access memory (DRAM), which typically constitutes a main memory. Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EEPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
- All terms used in the claims are intended to be given their plain and ordinary meanings as understood by those skilled in the art unless an explicit indication to the contrary in made herein. In particular, use of the singular articles such as “a,” “the,” “said,” etc. should be read to recite one or more of the indicated elements unless a claim recites an explicit limitation to the contrary.
- The term “exemplary” is used herein in the sense of signifying an example, e.g., a reference to an “exemplary widget” should be read as simply referring to an example of a widget.
- The adverb “approximately” modifying a value or result means that a shape, structure, measurement, value, determination, calculation, etc. may deviate from an exact described geometry, distance, measurement, value, determination, calculation, etc., because of imperfections in materials, machining, manufacturing, sensor measurements, computations, processing time, communications time, etc.
- In the drawings, the same reference numbers indicate the same elements. Further, some or all of these elements could be changed. With regard to the media, processes, systems, methods, etc. described herein, it should be understood that, although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes could be practiced with the described steps performed in an order other than the order described herein. It further should be understood that certain steps could be performed simultaneously, that other steps could be added, or that certain steps described herein could be omitted. In other words, the descriptions of processes herein are provided for the purpose of illustrating certain embodiments, and should in no way be construed so as to limit the claimed invention.
Claims (20)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/683,045 US20190066510A1 (en) | 2017-08-22 | 2017-08-22 | Vehicular image projection |
CN201810927628.4A CN109421583A (en) | 2017-08-22 | 2018-08-15 | Vehicle image projection |
DE102018120346.2A DE102018120346A1 (en) | 2017-08-22 | 2018-08-21 | BILD PROJECTION FOR VEHICLES |
US16/796,118 US11100805B2 (en) | 2017-08-22 | 2020-02-20 | Vehicular image projection |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/683,045 US20190066510A1 (en) | 2017-08-22 | 2017-08-22 | Vehicular image projection |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/796,118 Division US11100805B2 (en) | 2017-08-22 | 2020-02-20 | Vehicular image projection |
Publications (1)
Publication Number | Publication Date |
---|---|
US20190066510A1 true US20190066510A1 (en) | 2019-02-28 |
Family
ID=65321827
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/683,045 Abandoned US20190066510A1 (en) | 2017-08-22 | 2017-08-22 | Vehicular image projection |
US16/796,118 Active US11100805B2 (en) | 2017-08-22 | 2020-02-20 | Vehicular image projection |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/796,118 Active US11100805B2 (en) | 2017-08-22 | 2020-02-20 | Vehicular image projection |
Country Status (3)
Country | Link |
---|---|
US (2) | US20190066510A1 (en) |
CN (1) | CN109421583A (en) |
DE (1) | DE102018120346A1 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10981497B2 (en) * | 2018-11-16 | 2021-04-20 | Hyundai Mobis Co., Ltd. | Control system of autonomous vehicle and control method thereof |
US20210117695A1 (en) * | 2019-10-22 | 2021-04-22 | Ford Global Technologies, Llc | Vehicle exterior imaging systems |
US11269391B2 (en) * | 2020-01-29 | 2022-03-08 | Dell Products L.P. | System and method for setting a power state of an information handling system |
US11325572B2 (en) * | 2019-04-24 | 2022-05-10 | Mazda Motor Corporation | Vehicle control device, method and computer program product |
US11383700B2 (en) * | 2018-12-03 | 2022-07-12 | Nissan Motor Co., Ltd. | Vehicle travel control device and vehicle travel control method for parking |
US20220379806A1 (en) * | 2021-05-26 | 2022-12-01 | Ryk E. Spoor | System and Method for Roadway User Safety |
DE102021120530A1 (en) | 2021-08-06 | 2023-02-09 | Audi Aktiengesellschaft | Method for operating a motor vehicle and motor vehicle |
US20230184561A1 (en) * | 2021-12-10 | 2023-06-15 | Ford Global Technologies, Llc | Systems and methods for providing a monitoring service for a pedestrian |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130335212A1 (en) * | 2010-04-13 | 2013-12-19 | Kory Patrick Purks | Vehicle turn signalling apparatuses with laser devices, light projection circuits, and related electromechanical actuators |
US20150203023A1 (en) * | 2014-01-21 | 2015-07-23 | Harman International Industries, Inc. | Roadway projection system |
US9771021B1 (en) * | 2016-05-03 | 2017-09-26 | Toyota Motor Engineering & Manufacturing North America, Inc. | Pedestrian marking systems |
US20180004020A1 (en) * | 2015-01-13 | 2018-01-04 | Hitachi Maxell, Ltd. | Image projection apparatus |
US10134280B1 (en) * | 2016-02-23 | 2018-11-20 | Taehyun You | Vehicular notifications |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6084507A (en) | 1998-11-30 | 2000-07-04 | Butler; Isaac | Truck turning safety gate |
MXPA02009331A (en) | 2002-09-24 | 2004-03-26 | San Juan Torres Carlos | Indicating lights system of the movement status of automotive vehicles. |
JP4507815B2 (en) | 2004-07-09 | 2010-07-21 | アイシン・エィ・ダブリュ株式会社 | Signal information creating method, signal guide information providing method, and navigation apparatus |
US9384660B2 (en) | 2005-05-27 | 2016-07-05 | David A. Fossier | Mirror alert with projected message |
EP2232458B1 (en) | 2007-12-13 | 2018-06-27 | Continental Teves AG & Co. oHG | Method and device for assisting a vehicle operator |
DE102010034853A1 (en) | 2010-08-18 | 2012-02-23 | Gm Global Technology Operations Llc (N.D.Ges.D. Staates Delaware) | Motor vehicle with digital projectors |
US8831849B2 (en) | 2012-02-13 | 2014-09-09 | Toyota Motor Engineering & Manufacturing North America, Inc. | System and method for traffic signal recognition |
US20140247160A1 (en) | 2013-03-01 | 2014-09-04 | Sandra J. Glascock | Systems and methods for traffic signal warning |
US9321395B2 (en) | 2013-04-26 | 2016-04-26 | Ford Global Technologies, Llc | Vehicle puddle lamp assembly generating animated image and method |
ES2520341B1 (en) | 2013-05-07 | 2015-08-18 | José María Millet Sancho | Anti-vehicle warning system for vehicles |
CN203472784U (en) | 2013-08-19 | 2014-03-12 | 北京汽车股份有限公司 | Pedestrian safety warning device and motor vehicle |
US20150058127A1 (en) | 2013-08-26 | 2015-02-26 | International Business Machines Corporation | Directional vehicular advertisements |
US9318021B2 (en) | 2014-06-26 | 2016-04-19 | Jassem M. Al-Jasem Al-Qaneei | Vehicle mounted traffic light and system |
DE102014011811B4 (en) | 2014-08-09 | 2018-08-09 | Audi Ag | Informing a road user about an autopilot-controlled journey |
US20170011628A1 (en) | 2015-07-10 | 2017-01-12 | Continental Automotive Systems, Inc. | Traffic light replicator in a bus or truck |
KR101826408B1 (en) | 2016-03-03 | 2018-03-22 | 엘지전자 주식회사 | Display Apparatus and Vehicle Having The Same |
US10657819B2 (en) | 2016-09-21 | 2020-05-19 | Apple Inc. | External communication for vehicles |
KR20170001677A (en) | 2016-12-15 | 2017-01-04 | 김원호 | lamp for traffic signal at the front of car |
KR101908309B1 (en) * | 2017-04-12 | 2018-10-16 | 엘지전자 주식회사 | Lamp for Vehicle |
US10220769B1 (en) * | 2017-08-22 | 2019-03-05 | Ford Global Technologies, Llc | Vehicular image projection |
-
2017
- 2017-08-22 US US15/683,045 patent/US20190066510A1/en not_active Abandoned
-
2018
- 2018-08-15 CN CN201810927628.4A patent/CN109421583A/en active Pending
- 2018-08-21 DE DE102018120346.2A patent/DE102018120346A1/en active Pending
-
2020
- 2020-02-20 US US16/796,118 patent/US11100805B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130335212A1 (en) * | 2010-04-13 | 2013-12-19 | Kory Patrick Purks | Vehicle turn signalling apparatuses with laser devices, light projection circuits, and related electromechanical actuators |
US20150203023A1 (en) * | 2014-01-21 | 2015-07-23 | Harman International Industries, Inc. | Roadway projection system |
US20180004020A1 (en) * | 2015-01-13 | 2018-01-04 | Hitachi Maxell, Ltd. | Image projection apparatus |
US10134280B1 (en) * | 2016-02-23 | 2018-11-20 | Taehyun You | Vehicular notifications |
US9771021B1 (en) * | 2016-05-03 | 2017-09-26 | Toyota Motor Engineering & Manufacturing North America, Inc. | Pedestrian marking systems |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10981497B2 (en) * | 2018-11-16 | 2021-04-20 | Hyundai Mobis Co., Ltd. | Control system of autonomous vehicle and control method thereof |
US11383700B2 (en) * | 2018-12-03 | 2022-07-12 | Nissan Motor Co., Ltd. | Vehicle travel control device and vehicle travel control method for parking |
US11325572B2 (en) * | 2019-04-24 | 2022-05-10 | Mazda Motor Corporation | Vehicle control device, method and computer program product |
US20210117695A1 (en) * | 2019-10-22 | 2021-04-22 | Ford Global Technologies, Llc | Vehicle exterior imaging systems |
US11682216B2 (en) * | 2019-10-22 | 2023-06-20 | Ford Global Technologies, Llc | Vehicle exterior imaging systems |
US11269391B2 (en) * | 2020-01-29 | 2022-03-08 | Dell Products L.P. | System and method for setting a power state of an information handling system |
US20220379806A1 (en) * | 2021-05-26 | 2022-12-01 | Ryk E. Spoor | System and Method for Roadway User Safety |
US11794641B2 (en) * | 2021-05-26 | 2023-10-24 | International Electronic Machines Corp. | System and method for roadway user safety |
DE102021120530A1 (en) | 2021-08-06 | 2023-02-09 | Audi Aktiengesellschaft | Method for operating a motor vehicle and motor vehicle |
WO2023012028A1 (en) | 2021-08-06 | 2023-02-09 | Audi Ag | Method for operating a motor vehicle, and motor vehicle |
US20230184561A1 (en) * | 2021-12-10 | 2023-06-15 | Ford Global Technologies, Llc | Systems and methods for providing a monitoring service for a pedestrian |
Also Published As
Publication number | Publication date |
---|---|
US20200249043A1 (en) | 2020-08-06 |
DE102018120346A1 (en) | 2019-02-28 |
CN109421583A (en) | 2019-03-05 |
US11100805B2 (en) | 2021-08-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11100805B2 (en) | Vehicular image projection | |
US10796580B2 (en) | Vehicular image projection | |
US10220769B1 (en) | Vehicular image projection | |
CN110356402B (en) | Vehicle control device, vehicle control method, and storage medium | |
JP6296162B2 (en) | Vehicle travel control apparatus and method | |
JP6414221B2 (en) | Vehicle travel control apparatus and method | |
JP6680136B2 (en) | Exterior display processing device and exterior display system | |
JP6304384B2 (en) | Vehicle travel control apparatus and method | |
CN109472975A (en) | Driving assist system, drive supporting device and driving support method | |
JP6288286B2 (en) | Travel control device and travel control method | |
KR20180000672A (en) | Vehicle control device mounted on vehicle and method for controlling the vehicle | |
CN109515434A (en) | Controller of vehicle, control method for vehicle and storage medium | |
KR101943809B1 (en) | Vehicle notification device | |
JP2016038837A (en) | Vehicle drive control device and method | |
US20210039671A1 (en) | Path providing device and path providing method thereof | |
JP2014041556A (en) | Driving support device | |
CN109421799A (en) | Controller of vehicle, control method for vehicle and storage medium | |
US11693418B2 (en) | Path providing device and control method thereof | |
JP2016037267A (en) | Travel control device and travel control method | |
US20210039674A1 (en) | Path providing device and path providing method thereof | |
JP6296161B2 (en) | Vehicle travel control apparatus and method | |
US20210197863A1 (en) | Vehicle control device, method, and program | |
US20200271459A1 (en) | Path providing device and communication system comprising the same | |
CN113391628A (en) | Obstacle prediction system for autonomous vehicle | |
US20210171065A1 (en) | Autonomous driving vehicle information presentation apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FORD GLOBAL TECHNOLOGIES, LLC, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SALTER, STUART C.;KRISHNAN, VENKATESH;DELLOCK, PAUL KENNETH;REEL/FRAME:043356/0237 Effective date: 20170821 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |