US11305688B2 - Method for visualizing a crossing over a road - Google Patents
Method for visualizing a crossing over a road Download PDFInfo
- Publication number
- US11305688B2 US11305688B2 US17/285,236 US201917285236A US11305688B2 US 11305688 B2 US11305688 B2 US 11305688B2 US 201917285236 A US201917285236 A US 201917285236A US 11305688 B2 US11305688 B2 US 11305688B2
- Authority
- US
- United States
- Prior art keywords
- vehicle
- road
- image pattern
- lane
- communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/525—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking automatically indicating risk of collision between vehicles in traffic or with pedestrians, e.g. after risk assessment using the vehicle sensor data
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/507—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking specific to autonomous vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/547—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for issuing requests to other traffic participants; for confirming to other traffic participants they can proceed, e.g. they can overtake
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/005—Traffic control systems for road vehicles including pedestrian guidance indicator
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/162—Decentralised systems, e.g. inter-vehicle communication event-triggered
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/46—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for vehicle-to-vehicle communication [V2V]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2400/00—Special features or arrangements of exterior signal lamps for vehicles
- B60Q2400/50—Projected symbol or information, e.g. onto the road or car body
Definitions
- Exemplary embodiments of the invention relate to a method for visualizing a crossing over a road.
- a generic method was presented in a research vehicle of the applicant.
- the autonomous vehicle is able to recognize a road user, such as in particular a pedestrian, together with his/her intention that he/she wants to cross a road.
- a road user such as in particular a pedestrian
- his/her intention that he/she wants to cross a road.
- an image pattern in the form of a zebra crossing is projected onto the road in front of the vehicle, such that the road user can safely cross the road on the projected zebra crossing.
- DE 10 2017 205 626 A1 describes a method for operating a lighting device for a motor vehicle, in which a headlight of the motor vehicle projects a symbol onto a surface. It can thereby project the symbol for a pedestrian and communicate with other vehicles via it.
- DE 10 2014 226 254 A1 shows a method for operating a signaling device of a motor vehicle, in particular an autonomously or semi-autonomously driving/driveable motor vehicle, which has at least one signaling means that can be perceived from outside the motor vehicle by other road users. It is provided that, depending on a detected road user, the signaling device is actuated in order to display to the detected road user information about a further behavior of the motor vehicle.
- Exemplary embodiments of the present invention are directed to an optimized method for visualizing a crossing over a road, which enables improved safety for a comfortable crossing of the road.
- the method according to the invention visualizes, comparable to the prior art created by the applicant which is explained in the introduction, a safe crossing for a road user wanting to cross a road.
- This can be a pedestrian, but also a cyclist or similar.
- he/she is not in a closed vehicle and is not obliged to use a road.
- a vehicle for example an autonomous vehicle, lets the road user, for example the pedestrian, cross the road. It informs him/her of this by projecting a corresponding image pattern, for example the zebra crossing as in the prior art mentioned in the introduction, onto the road. Laser lights or pixel lights based on individual light points or light points emitted into the environment via micromirrors can be used for this purpose, for example.
- the first vehicle projecting the image pattern establishes communication with any other vehicles which may be in the vicinity, in particular those in other lanes, and informs them that a road user, such as a pedestrian, wants to cross the road. It also informs the other vehicles about the projected or yet-to-be-projected image pattern.
- the first vehicle projecting the image pattern requests the at least one other vehicle or the other vehicles to stop in turn and project an image pattern in addition to the image pattern of the first vehicle, or if they are unable to do so, to report back to the first vehicle that it will take over the projection in the lane of the vehicle which is itself unable to project the image pattern.
- Such cooperation between the vehicles, starting from the first vehicle thus creates a situation in which all the vehicles involved participate in allowing the road user who wants to cross the road to do so.
- the vehicles all participate, if possible, via the projection of an image pattern, in indicating this to the road user accordingly and thus enabling him/her to cross all lanes of the road safely.
- the method further provides that the image pattern comprises at least two graphically different and/or differently colored states, one of which signifies that the entire road can be safely crossed, and another of which signifies that only the lane on which the image pattern is projected can be safely crossed.
- the image pattern for example a zebra crossing
- a yellow zebra crossing can signify that only the lane on which the zebra crossing is projected can be safely crossed, and that another lane is currently not yet safe. If other vehicles have been involved and have stopped, for example, a green zebra crossing can be projected continuously across several lanes to indicate to the road user that he/she can safely cross all lanes of the entire road.
- the first vehicle monitors the implementation of its request to the at least one other vehicle via feedback communication and/or its environment sensor system. It adjusts the state of the image pattern after the request has been complied with or if it can be predicted that the request will be complied with.
- the communication is carried out via optical signals of the first vehicle.
- the first vehicle can initiate the communication purely via optical signals such as, for example, a flashing or a specific image pattern, in particular in the region of the lane of the vehicle with which it wishes to communicate.
- the corresponding optical signals such as the pattern, the actuation of a hazard warning light or similar, are recognized accordingly by the further vehicle or its environment sensor system and thus enable the further vehicle to react accordingly in the manner desired by the first vehicle.
- Such communication via optical signals does not require a direct connection between the vehicles and is therefore particularly simple and also very secure with regard to potential unauthorized access to the vehicle.
- this type of communication requires appropriate evaluation of the data in order to correctly assess the situation by means of the environment sensor system and/or to give the correct instructions to the person driving the vehicle within the scope of an assistance system.
- the communication is a vehicle-to-vehicle communication, or takes place as indirect communication via a communication center or similar, i.e., as vehicle-to-X and X-to-vehicle communication, and is thus designed as indirect communication between the vehicles.
- vehicle-to-vehicle communication or takes place as indirect communication via a communication center or similar, i.e., as vehicle-to-X and X-to-vehicle communication, and is thus designed as indirect communication between the vehicles.
- Such communication offers the advantage that very detailed information can be transmitted in a very targeted manner if the vehicles have the same communication protocol.
- the communication can be implemented in a manner known in itself, for example via a radio link or similar.
- the communication link is terminated again starting from the first vehicle, which initiated the communication and plays a central role in the whole process, in order to quickly enable the communication channels again for other communications.
- the first vehicle that has detected the pedestrian or the other road user and his/her desire to cross the road plays a special role in this process. It initiates the communication with the other vehicles, regardless of the communication channels, and can also help monitor them to a certain extent. Ultimately, therefore, communication is set up in the manner of a master-slave system, in which the first vehicle acts as the master and the other vehicle or vehicles involved act as slaves, depending on this.
- the image pattern comprises a graphical representation of a blocked area that is not to be entered.
- a representation can be, for example, an X, which indicates by its coloring, for example red, and/or graphic representation, for example a flashing, that this area is blocked.
- this can indicate to the road user that he/she should not step into the adjacent lane, for example, and on the other hand, it can serve to communicate with a vehicle travelling in this adjacent lane.
- the driver of the vehicle or its environment sensor system perceives the X located in its lane next to the stationary or already greatly slowed vehicle and thus recognizes the situation, namely that a road user wants to cross the road here.
- the vehicle can stop accordingly and communicate this back to the first vehicle, or the first vehicle can also recognize or detect this automatically via its environment sensor system.
- the vehicles can then jointly project an image pattern in the form of a zebra crossing, for example, in order to enable the safe crossing of the road in the case of two lanes or at least as far as a traffic island located in the middle of the road.
- the red X as an example of a graphic sign of a blocked zone can then be hidden again if, for example, the second vehicle has projected the zebra crossing or at least stopped in order to request the first vehicle to also project the zebra crossing in its lane.
- the crossing would then be safe across the entire road, such that the zebra crossing can be coded accordingly and displayed across the entire width of the road, for example, in green. In the case of more lanes and more vehicles involved, this substantially works analogously.
- FIG. 1 a scenario from a bird's eye view to illustrate the method according to the invention
- FIG. 2 further scenario from a bird's eye view to illustrate the method according to the invention
- FIG. 3 the scenario according to FIG. 2 with an involved vehicle
- FIG. 4 the scenario according to FIG. 2 with two involved vehicles
- FIG. 5 a schematic depiction of the technical equipment required at least in the first vehicle to implement the method according to the invention
- FIGS. 6 a )- 6 d various scenarios in chronological sequence to one another and a development of the method according to the invention with an additional projection of a blocked area which is not to be entered;
- FIG. 7 a further scenario illustrating an additional further use of the additional projection of the blocked area which is not to be entered.
- a road 1 has a single lane 1 . 1 and is delimited on both sides in each case by a pavement designated with 2 , wherein a pavement is understood to mean any area on which, for example, a pedestrian 3 , depicted here as a road user wishing to cross the road 1 , is safe, i.e., also, for example, a traffic island between the lanes or similar.
- a vehicle 4 .
- the vehicle 4 . 1 which has an environment sensor 5 (not explicitly depicted here), approaches on the road 1 and detects, using the environment sensor 5 , a situation according to which the pedestrian 3 as a road user wants to cross the road 1 with the one lane 1 . 1 .
- the vehicle 4 . 1 now recognizes, using its environment sensor system 5 and/or a map module 6 , for example in a navigation device of the vehicle 4 . 1 , that the road 1 only has the one lane 1 . 1 .
- the vehicle 1 can therefore enable the pedestrian 3 alone to cross the road 1 with its one lane 1 . 1 safely. To do this, it reduces its speed and stops. It projects an image pattern 8 in the form of a zebra crossing onto the road 1 or the lane 1 .
- the image pattern 8 in this case, for example the zebra crossing, has a certain coding. This can be, for example, as coding for “crossing a lane safely” the color yellow, which is symbolized in the figures by a dashed representation of the image pattern 8 .
- the vehicle 4 . 1 or its environment sensor 5 and/or the map module 6 enable here the further information that the lane 1 . 1 corresponds to the entire road 1 , because the road 1 here just has this lane 1 . 1 .
- the coding of the image pattern 8 can also be done in such a way that it is indicated that the pedestrian 3 can safely cross the entire road 1 .
- the zebra crossing of the image pattern 8 could, for example, be projected onto the road in green color symbolized by a solid representation in order to, in accordance with the mode “the entire road can be crossed safely”, indicate this to the pedestrian 3 .
- the scenario described is relatively simple, since the vehicle 4 . 1 , which is also referred to below as the first vehicle, can detect the situation on its own and decide about the safety of the crossing on its own. However, if the road 1 now has several lanes, as is indicated in the depiction of FIG. 2 , the situation becomes correspondingly more difficult.
- the vehicle 4 . 1 is the first vehicle on the lane 1 . 1 .
- Another lane runs adjacently to it in the same direction of travel. It is marked 1 . 2 and is to be used by a vehicle marked 4 . 2 .
- Another lane 1 . 3 runs in the opposite direction.
- a third vehicle marked 4 . 3 is also travelling in this lane.
- the pedestrian 1 now recognizes the will of the pedestrian 3 to cross the road, comparable to the depiction according to FIG. 1 . It stops accordingly and projects a zebra crossing as an image pattern 8 .
- the first vehicle 4 . 1 can only ensure safe crossing for the lane 1 . 1 of the road 1 that it is travelling in.
- the image pattern 8 in this case the zebra crossing, is shown in a color code, for example in yellow, which indicates this to the pedestrian 3 accordingly.
- the pedestrian can therefore only safely cross the lane 1 . 1 at the current time. There is a threat of danger in extending the image pattern 8 on the other lanes 1 . 2 and 1 . 3 .
- the first vehicle 4 . 1 now establishes communication with the further vehicles 4 . 2 and 4 . 3 and informs them about the situation, which is of particular interest in the case of the vehicle 4 . 2 , in that there is a risk that both the projected image pattern 8 and the pedestrian 3 are so obscured by the vehicle 4 . 1 that a person driving the vehicle 4 . 2 or its environment sensor system 5 cannot perceive this accordingly.
- a radio communication can be implemented, which is also referred to as vehicle-to-vehicle or Car2Car communication. Via such a Car2Car communication, the vehicle 4 . 1 can request the vehicle 4 .
- the first vehicle 4 . 1 will now also make contact with the vehicle 4 . 3 in the lane 1 . 3 of the road.
- the first vehicle 4 . 1 informs the vehicle 4 . 3 accordingly.
- the first vehicle 4 . 1 requests the third vehicle 4 . 3 to also stop and in turn project a zebra crossing as image pattern 8 .
- the depiction in FIG. 4 shows the complete process in which all three vehicles 4 . 1 , 4 . 2 , 4 . 3 have stopped or are decelerating sharply in order to stop. In this situation, all three project the corresponding image pattern 8 of the zebra crossing. Since the entire road 1 having all three lanes 1 . 1 , 1 . 2 and 1 . 3 is now safe to cross, this projection occurs with the coding “road safe to cross”, for example in green color. The pedestrian 3 now knows that he/she can safely cross the entire road 1 and will do so.
- the first vehicle 4 . 1 which here acts as the master. It then breaks off communication with the other vehicles 4 . 2 and 4 . 3 acting as slaves, such that after the “situation” has been resolved, no further communication takes place between the vehicles 4 . 1 , 4 . 2 , 4 . 3 , and the corresponding communication channels are enabled again for other communications.
- FIG. 5 shows once again, as already mentioned, the structure of an exemplary vehicle, for example the first vehicle 4 . 1 .
- the vehicle 4 . 1 has a map module 6 , a communication module 11 , which is designed as a Car2X or Car2Car module.
- an environment detection is provided, for example with cameras, radar, lidar, or similar.
- the environment detection is indicated in the depiction of FIG. 5 via a camera and is provided with the reference numeral 5 .
- an environment detection and fusion module 50 which, in the case of several sensors for environment detection, fuses these accordingly and evaluates the results obtained.
- the vehicle 4 . 1 itself also has a projection unit, which is implemented, for example, by the pixel headlights or the laser projection 7 . It is controlled accordingly by a cooperative control module 12 of the control unit 9 .
- the cooperative control module 12 for the crossing of the road 1 by a pedestrian is in operative connection with the other modules accordingly and further has access to a situation analysis and planning module 13 , via which the corresponding situation that the pedestrian 3 wants to cross the road 1 is detected and the corresponding reaction of the vehicle 1 to this is planned.
- the cooperative control module 12 can optionally, in the case of non-autonomous vehicles, have a display module 14 , via which a driver of a non-autonomous vehicle is prompted to act cooperatively accordingly, for example based on a Car2Car communication or a communication via detected optical signals of another vehicle, in order to ensure the safe functionality of the crossing of the road 1 for the pedestrian 3 even in such a situation with at least one non-autonomous vehicle.
- the first vehicle 4 . 1 detects the will of the pedestrian 3 and initiates the pedestrian crossing. In doing so, it operates in a master mode, while the other vehicles 4 . 2 , 4 . 3 are requested by the first vehicle 4 . 1 to cooperate and accordingly operate in a slave mode.
- the vehicle 4 . 1 has detected a situation in which the pedestrian 3 wants to cross the road 1 .
- the first vehicle 4 . 1 supports this based on its situation analysis by stopping, as already mentioned above, and displaying the image pattern 8 as a zebra crossing, in the case of road 1 with several lanes 1 . 1 , 1 . 2 , 1 . 3 with the coding “one lane safe” directly in front of the pedestrian 3 on the road, as indicated in FIGS. 1, 2 and 5 .
- a communication for example a direct or indirect Car2Car communication
- the other vehicles 4 . 2 and 4 . 3 in the vicinity are now made aware of the situation and requested to act cooperatively.
- the vehicles 4 . 2 and 4 . 3 are in slave mode during this process.
- the vehicle 4 . 2 has detected, either via its ambient detection and corresponding optical signals from vehicle 4 . 1 or a Car2Car communication, that along the planned route of travel in the example of the previous figures in lane 1 . 2 , a pedestrian crossing initiated by the first vehicle 4 . 1 is planned.
- the inherent speed of the second vehicle 4 . 2 is reduced and, after the location of the projection has been detected, the corresponding connection projection on the lane 1 . 2 is triggered, as is depicted accordingly in FIG. 3 .
- the first vehicle 4 . 1 is the master and the second vehicle 4 .
- the request from the first vehicle 4 . 1 to the vehicles 4 . 2 and 4 . 3 to switch the state of the image pattern 8 from “one lane safe” to “road safe”, i.e., to change the color from yellow to green, as described in the exemplary embodiment depicted here, can again be made via the Car2Car communication, or also by an environment sensor system of the other vehicles 4 . 2 and 4 . 3 or the fact that a person driving these vehicles has detected that the first vehicle 4 . 1 has switched its part of the zebra crossing as an image pattern to green. As mentioned, this can be detected by the person or the environment sensor system and serve as a request to also switch the state of the zebra crossing from yellow to green.
- FIGS. 6 a )- 6 d a further embodiment of the method according to the invention is now shown on the basis of four individual images a) to d) to be understood in chronological sequence.
- the situation shows a part of the road 1 with the lanes 1 . 1 and 1 . 2 , the pavement 2 , as well as the pedestrian 3 .
- the first vehicle 4 . 1 has already stopped comparably as in the embodiments described above and projects the image pattern 8 in the form of the zebra crossing, for example in the coding variant “one lane safe”, i.e., for example in yellow and accordingly represented dashed, onto the lane 1 . 1 .
- a second vehicle 4 . 2 approaches the first vehicle 4 .
- the first vehicle 4 . 1 has therefore projected an additional projection of the image pattern 8 , in this case an X designated 80 , which on the one hand indicates to the pedestrian 3 that the area of the second lane 1 . 2 of the roadway 1 is not safe to enter, and which at the same time visually symbolizes the situation to a driver or the environment sensor system 5 of the second vehicle 4 . 2 .
- the vehicle 4 . 2 can now also be requested by corresponding coding to cooperate, since the vehicle 4 .
- the deceleration of the second vehicle 4 . 2 is indicated by a speed arrow with two arrow heads pointing in opposite directions after it has recognized the red X 80 of the image pattern 8 in normal driving, as shown in FIG. 6 a ).
- a subsequent step is now depicted in which the second vehicle 4 . 2 has already calculated at which point it will come to a stop and accordingly projects the image pattern 8 from it onto its lane 1 . 2 .
- the first vehicle 4 . 1 still projects the red X 80 accordingly.
- the first vehicle 4 . 1 now detects the projected zebra crossing as image pattern 8 ′ on the lane 1 . 2 and recognizes that the second vehicle 4 . 2 is cooperating accordingly. It switches off the X as a warning and danger sign for the pedestrian 3 and as communication symbol for the further vehicle 4 . 2 accordingly. If there is no vehicle in the vicinity on the further lane 1 .
- the corresponding image patterns 8 of the crosswalks can now be switched—as depicted—to “cross the whole road safely”; otherwise the scenario shown in FIG. 6 d ) is largely similar to that in FIG. 3 , wherein the communication here takes place exclusively or in addition to a Car2Car communication via the optical signals.
- the first vehicle 4 . 1 is active as an initiator and monitors the will of the other vehicle 4 . 2 to cooperate, such that here too, communication follows the master-slave concept.
- FIG. 7 shows a further scenario which substantially corresponds to that in FIG. 6 a ).
- the second vehicle 4 . 2 is detected by a rear-facing part of the environment sensor system of the first vehicle 4 . 1 . It approaches the first vehicle 4 . 1 , which has already initiated the crossing for the pedestrian 3 , at such a high speed that, despite communication, it cannot be assumed that the vehicle 4 . 2 will come to a stop next to the vehicle 4 . 1 .
- the red X 80 as a warning sign can be changed accordingly in its graphic representation or coding. By way of example, it changes its size or it flashes in order to reliably warn the pedestrian 3 .
- writings or pictograms can also be projected here, for example a stop sign or words such as, for example, stop, hazard, danger or similar.
- the vehicle 4 . 2 or a driver in this vehicle 4 . 2 can also be made aware of the potential danger point via a flashing signal from the first vehicle 4 . 1 , for example an activation of the hazard warning lights or similar.
- the described method in its embodiment variants functions in particular amongst autonomously driving vehicles.
- non-autonomously driving vehicles or vehicles that are only partially autonomous by means of corresponding driver assistance systems.
- an autonomous vehicle can be operated as the first vehicle 4 . 1 in master mode, and the non-autonomous vehicle in slave mode.
- the non-autonomous vehicle needs either an attentive driver, as in today's traffic, who then cooperates accordingly, and thus effectively stops in slave mode. This can then be detected by the first vehicle 4 . 1 and its environment sensors. If the non-autonomous vehicle, for example the vehicle 4 .
- a corresponding display can also be presented to the driver for assistance in order to prompt him/her to act cooperatively. This is done by the display module 14 optionally indicated in FIG. 5 .
- such a non-autonomous vehicle for example the vehicle 4 . 2
- vehicle 4 . 2 if it has a pixel light or a laser light, can use it to project the corresponding image pattern 8 .
- This projection must then be manually triggered by the person driving the vehicle 4 . 2 . If he/she is unable to do so, this can be indicated via a feedback communication in the case of Car2Car communication, for example. It can also be detected via the first vehicle 4 . 1 in the master mode that the further vehicle 4 . 2 has stopped accordingly, but is not projecting a zebra crossing as image pattern 8 . If the projection area of its pixel headlights 7 or its laser light or its laser projection is sufficient, it can then also take over the projection for this non-autonomous vehicle if it has reliably detected via the communication or its environment sensors that this vehicle is stationary.
- an autonomous vehicle for example the vehicle 4 . 2 and/or 4 . 3
- the communication for example via the environmental sensors 5 or a Car2Car communication, and can react to this in the manner already described above, since it is irrelevant for the vehicle in the slave mode whether the vehicle is operated autonomously or non-autonomously in the master mode.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Traffic Control Systems (AREA)
- Lighting Device Outwards From Vehicle And Optical Signal (AREA)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102018008213.0A DE102018008213B4 (de) | 2018-10-17 | 2018-10-17 | Verfahren zum Visualisieren eines Übergangs über eine Straße |
DE102018008213.0 | 2018-10-17 | ||
PCT/EP2019/077411 WO2020078810A1 (fr) | 2018-10-17 | 2019-10-09 | Procédé de visualisation d'un lieu de passage sur une route |
Publications (2)
Publication Number | Publication Date |
---|---|
US20210370823A1 US20210370823A1 (en) | 2021-12-02 |
US11305688B2 true US11305688B2 (en) | 2022-04-19 |
Family
ID=68240729
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/285,236 Active US11305688B2 (en) | 2018-10-17 | 2019-10-09 | Method for visualizing a crossing over a road |
Country Status (4)
Country | Link |
---|---|
US (1) | US11305688B2 (fr) |
CN (1) | CN112889097B (fr) |
DE (1) | DE102018008213B4 (fr) |
WO (1) | WO2020078810A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11904757B2 (en) * | 2022-02-08 | 2024-02-20 | Honda Motor Co., Ltd. | Vehicle headlight device |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11735051B2 (en) * | 2020-03-27 | 2023-08-22 | Toyota Research Institute, Inc. | Detection of bicyclists near ego vehicles |
CN115803226A (zh) * | 2020-05-22 | 2023-03-14 | 马格纳电子系统公司 | 显示系统和方法 |
CN112211129B (zh) * | 2020-10-12 | 2021-10-15 | 毕克刚 | 基于无人机、物联网和光电技术的汽车警示系统 |
DE102020216080A1 (de) | 2020-12-16 | 2022-06-23 | Psa Automobiles Sa | Farbiges Beleuchten eines Fußgängerüberwegs durch ein autonomes Fahrzeug |
JP2022149728A (ja) * | 2021-03-25 | 2022-10-07 | 本田技研工業株式会社 | 車両制御装置、車両、車両制御装置の動作方法及びプログラム |
US11794641B2 (en) * | 2021-05-26 | 2023-10-24 | International Electronic Machines Corp. | System and method for roadway user safety |
US20210312193A1 (en) * | 2021-06-15 | 2021-10-07 | Nauto, Inc. | Devices and methods for predicting intersection violations and/or collisions |
CN114228609A (zh) * | 2021-12-17 | 2022-03-25 | 一汽奔腾轿车有限公司 | 一种基于微透镜阵列的汽车倒车提示系统 |
NL2033046B1 (en) * | 2022-05-10 | 2023-11-17 | Schreder Sa | Warning light system and light-shaping module |
WO2023217913A2 (fr) * | 2022-05-10 | 2023-11-16 | Schreder S.A. | Système de lumière d'avertissement et module de façonnage de lumière |
DE102022126939A1 (de) | 2022-10-14 | 2024-04-25 | Audi Aktiengesellschaft | Verfahren zur Beleuchtung einer Umgebung eines Kraftfahrzeugs und eines Zusatzfahrzeugs, Kraftfahrzeug |
Citations (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070102214A1 (en) * | 2005-09-06 | 2007-05-10 | Marten Wittorf | Method and system for improving traffic safety |
JP2008009941A (ja) * | 2006-06-30 | 2008-01-17 | Aisin Seiki Co Ltd | 車両用報知装置及び車両用報知方法 |
DE102013217057A1 (de) | 2012-08-31 | 2014-03-06 | Denso Corporation | Fussgängerunterrichtungsvorrichtung |
DE102012223410A1 (de) | 2012-12-17 | 2014-06-18 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zur Kommunikation eines Fahrzeugs an seine Umgebung |
DE102012024494A1 (de) | 2012-12-14 | 2014-06-18 | Audi Ag | Flurförderzeug mit einer optischen Warneinrichtung, Kraftfahrzeug mit einer optischen Warneinrichtung und Projektor zur Verwendung als optische Warneinrichtung |
US20140267398A1 (en) * | 2013-03-14 | 2014-09-18 | Honda Motor Co., Ltd | Augmented reality heads up display (hud) for yield to pedestrian safety cues |
US20140324286A1 (en) * | 2013-04-26 | 2014-10-30 | Denso Corporation | Vehicle-use collision mitigation apparatus |
US20150228195A1 (en) * | 2014-02-07 | 2015-08-13 | Here Global B.V. | Method and apparatus for providing vehicle synchronization to facilitate a crossing |
US20150336502A1 (en) * | 2014-05-22 | 2015-11-26 | Applied Minds, Llc | Communication between autonomous vehicle and external observers |
DE102014226254A1 (de) | 2014-12-17 | 2016-06-23 | Robert Bosch Gmbh | Verfahren zum Betreiben eines insbesondere autonom oder teilautonom fahrenden/fahrbaren Kraftfahrzeugs, Signalisierungsvorrichtung, Kraftfahrzeug |
DE102016000555A1 (de) | 2016-01-20 | 2016-07-21 | Daimler Ag | Verfahren zur Kommunikation zwischen zumindest zwei Fahrzeugen |
DE202017103902U1 (de) | 2016-07-07 | 2017-07-20 | Zkw Group Gmbh | Beleuchtungssystem zur Kommunikation zwischen autonomen Fahrzeugen und anderen Verkehrsteilnehmern |
EP3217377A1 (fr) | 2016-03-07 | 2017-09-13 | Toyota Jidosha Kabushiki Kaisha | Système d'éclairage de véhicule |
DE102016007014A1 (de) | 2016-06-09 | 2017-12-14 | Audi Ag | Verfahren zum Betrieb einer Kommunikationseinrichtung eines Kraftfahrzeugs und Kraftfahrzeug |
DE102016122686A1 (de) | 2016-11-24 | 2018-05-24 | Henrik Stiewe | Verfahren zum Informieren eines Verkehrsteilnehmers über eine Verkehrssituation |
DE102017103862A1 (de) * | 2017-02-24 | 2018-08-30 | Osram Gmbh | System für eine Verkehrsfläche und Verfahren mit einem System für eine Verkehrsfläche |
US10065555B2 (en) * | 2016-09-08 | 2018-09-04 | Ford Global Technologies, Llc | Directional approach lighting |
US20180261081A1 (en) * | 2017-03-10 | 2018-09-13 | Subaru Corporation | Image display device |
DE102017205626A1 (de) | 2017-04-03 | 2018-10-04 | Audi Ag | Verfahren zum Betreiben einer Beleuchtungseinrichtung für eines oder mehrere Kraftfahrzeuge und Kraftfahrzeug |
US10134280B1 (en) * | 2016-02-23 | 2018-11-20 | Taehyun You | Vehicular notifications |
US10160378B2 (en) * | 2016-02-22 | 2018-12-25 | Uber Technologies, Inc. | Light output system for a self-driving vehicle |
US10217361B2 (en) * | 2016-12-15 | 2019-02-26 | Hyundai Motor Company | Apparatus and method for sensing and notifying pedestrian |
US20200114813A1 (en) * | 2018-10-16 | 2020-04-16 | GM Global Technology Operations LLC | Autonomous vehicle intent signaling |
US20200198534A1 (en) * | 2018-12-19 | 2020-06-25 | Panasonic Intellectual Property Management Co., Ltd. | Notification control apparatus, non-transitory storage medium storing therein computer program, and in-vehicle system |
US10885772B2 (en) * | 2017-12-21 | 2021-01-05 | Lumileds Llc | Road lighting |
US20210065538A1 (en) * | 2019-08-26 | 2021-03-04 | Panasonic Intellectual Property Management Co., Ltd. | Information processing apparatus, information processing method and recording medium |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013114290A (ja) * | 2011-11-25 | 2013-06-10 | Seiko Epson Corp | 安全支援装置、及び、安全支援方法 |
JP6023466B2 (ja) * | 2012-05-17 | 2016-11-09 | 東芝アルパイン・オートモティブテクノロジー株式会社 | 車載用表示装置 |
US9481287B2 (en) * | 2014-01-21 | 2016-11-01 | Harman International Industries, Inc. | Roadway projection system |
CN110450705B (zh) * | 2015-01-13 | 2023-02-17 | 麦克赛尔株式会社 | 车辆 |
WO2017019725A1 (fr) * | 2015-07-28 | 2017-02-02 | Wenasont Dynamics Llc | Système et procédé destinés à une projection de lumière et d'image |
DE102015225411A1 (de) * | 2015-12-16 | 2017-06-22 | Bayerische Motoren Werke Aktiengesellschaft | Kommunikation zwischen Verkehrsteilnehmern |
DE102016002230B4 (de) * | 2016-02-25 | 2023-05-04 | Audi Ag | Verfahren zum Betrieb eines Kraftfahrzeugs und Kraftfahrzeug |
FR3056490B1 (fr) * | 2016-09-29 | 2018-10-12 | Valeo Vision | Procede de projection d'une image par un systeme de projection d'un vehicule automobile, et systeme de projection associe |
CN107886729B (zh) * | 2016-09-30 | 2021-02-23 | 比亚迪股份有限公司 | 车辆识别方法、装置及车辆 |
CN107886770B (zh) * | 2016-09-30 | 2020-05-22 | 比亚迪股份有限公司 | 车辆识别方法、装置及车辆 |
WO2018128946A1 (fr) * | 2017-01-06 | 2018-07-12 | Pcms Holdings, Inc. | Procédé d'émission d'avertissements aux usagers vulnérables de la route dans un angle mort d'un véhicule stationné |
CN108316190B (zh) * | 2018-05-15 | 2020-07-10 | 嘉兴晟源工业设计有限公司 | 一种基于水雾投影的斑马线护栏 |
-
2018
- 2018-10-17 DE DE102018008213.0A patent/DE102018008213B4/de active Active
-
2019
- 2019-10-09 CN CN201980068463.2A patent/CN112889097B/zh active Active
- 2019-10-09 WO PCT/EP2019/077411 patent/WO2020078810A1/fr active Application Filing
- 2019-10-09 US US17/285,236 patent/US11305688B2/en active Active
Patent Citations (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070102214A1 (en) * | 2005-09-06 | 2007-05-10 | Marten Wittorf | Method and system for improving traffic safety |
JP2008009941A (ja) * | 2006-06-30 | 2008-01-17 | Aisin Seiki Co Ltd | 車両用報知装置及び車両用報知方法 |
DE102013217057A1 (de) | 2012-08-31 | 2014-03-06 | Denso Corporation | Fussgängerunterrichtungsvorrichtung |
DE102012024494A1 (de) | 2012-12-14 | 2014-06-18 | Audi Ag | Flurförderzeug mit einer optischen Warneinrichtung, Kraftfahrzeug mit einer optischen Warneinrichtung und Projektor zur Verwendung als optische Warneinrichtung |
DE102012223410A1 (de) | 2012-12-17 | 2014-06-18 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zur Kommunikation eines Fahrzeugs an seine Umgebung |
US20140267398A1 (en) * | 2013-03-14 | 2014-09-18 | Honda Motor Co., Ltd | Augmented reality heads up display (hud) for yield to pedestrian safety cues |
US20140324286A1 (en) * | 2013-04-26 | 2014-10-30 | Denso Corporation | Vehicle-use collision mitigation apparatus |
US20150228195A1 (en) * | 2014-02-07 | 2015-08-13 | Here Global B.V. | Method and apparatus for providing vehicle synchronization to facilitate a crossing |
US20150336502A1 (en) * | 2014-05-22 | 2015-11-26 | Applied Minds, Llc | Communication between autonomous vehicle and external observers |
DE102014226254A1 (de) | 2014-12-17 | 2016-06-23 | Robert Bosch Gmbh | Verfahren zum Betreiben eines insbesondere autonom oder teilautonom fahrenden/fahrbaren Kraftfahrzeugs, Signalisierungsvorrichtung, Kraftfahrzeug |
DE102016000555A1 (de) | 2016-01-20 | 2016-07-21 | Daimler Ag | Verfahren zur Kommunikation zwischen zumindest zwei Fahrzeugen |
US10160378B2 (en) * | 2016-02-22 | 2018-12-25 | Uber Technologies, Inc. | Light output system for a self-driving vehicle |
US10134280B1 (en) * | 2016-02-23 | 2018-11-20 | Taehyun You | Vehicular notifications |
EP3217377A1 (fr) | 2016-03-07 | 2017-09-13 | Toyota Jidosha Kabushiki Kaisha | Système d'éclairage de véhicule |
DE102016007014A1 (de) | 2016-06-09 | 2017-12-14 | Audi Ag | Verfahren zum Betrieb einer Kommunikationseinrichtung eines Kraftfahrzeugs und Kraftfahrzeug |
DE202017103902U1 (de) | 2016-07-07 | 2017-07-20 | Zkw Group Gmbh | Beleuchtungssystem zur Kommunikation zwischen autonomen Fahrzeugen und anderen Verkehrsteilnehmern |
US10065555B2 (en) * | 2016-09-08 | 2018-09-04 | Ford Global Technologies, Llc | Directional approach lighting |
DE102016122686A1 (de) | 2016-11-24 | 2018-05-24 | Henrik Stiewe | Verfahren zum Informieren eines Verkehrsteilnehmers über eine Verkehrssituation |
US10217361B2 (en) * | 2016-12-15 | 2019-02-26 | Hyundai Motor Company | Apparatus and method for sensing and notifying pedestrian |
DE102017103862A1 (de) * | 2017-02-24 | 2018-08-30 | Osram Gmbh | System für eine Verkehrsfläche und Verfahren mit einem System für eine Verkehrsfläche |
US20180261081A1 (en) * | 2017-03-10 | 2018-09-13 | Subaru Corporation | Image display device |
DE102017205626A1 (de) | 2017-04-03 | 2018-10-04 | Audi Ag | Verfahren zum Betreiben einer Beleuchtungseinrichtung für eines oder mehrere Kraftfahrzeuge und Kraftfahrzeug |
US10885772B2 (en) * | 2017-12-21 | 2021-01-05 | Lumileds Llc | Road lighting |
US20200114813A1 (en) * | 2018-10-16 | 2020-04-16 | GM Global Technology Operations LLC | Autonomous vehicle intent signaling |
US20200198534A1 (en) * | 2018-12-19 | 2020-06-25 | Panasonic Intellectual Property Management Co., Ltd. | Notification control apparatus, non-transitory storage medium storing therein computer program, and in-vehicle system |
US20210065538A1 (en) * | 2019-08-26 | 2021-03-04 | Panasonic Intellectual Property Management Co., Ltd. | Information processing apparatus, information processing method and recording medium |
Non-Patent Citations (3)
Title |
---|
International Search Report dated Jan. 20, 2020 in related/corresponding International Application No. PCT/EP2019/077411. |
Office Action created on Jan. 25, 2019 in related/corresponding DE Application No. 10 2018 008 213.0. |
Written Opinion dated Jan. 20, 2020 in related/corresponding International Application No. PCT/EP2019/077411. |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11904757B2 (en) * | 2022-02-08 | 2024-02-20 | Honda Motor Co., Ltd. | Vehicle headlight device |
Also Published As
Publication number | Publication date |
---|---|
DE102018008213B4 (de) | 2024-02-29 |
DE102018008213A1 (de) | 2020-04-23 |
WO2020078810A1 (fr) | 2020-04-23 |
CN112889097B (zh) | 2023-02-21 |
CN112889097A (zh) | 2021-06-01 |
US20210370823A1 (en) | 2021-12-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11305688B2 (en) | Method for visualizing a crossing over a road | |
JP6991420B2 (ja) | 自動運転制御装置及び車両 | |
US11066009B2 (en) | Vehicular illumination device, vehicle system, and vehicle | |
CN108290519B (zh) | 用于划分运动区域的控制单元和方法 | |
CN109311480B (zh) | 用于运行驾驶员辅助系统的方法和驾驶员辅助系统 | |
JP2024059901A (ja) | 車両 | |
JP5806733B2 (ja) | 車線変更支援情報可視化システム | |
US9493109B2 (en) | Method and control device for highlighting an expected movement path of a vehicle | |
WO2016039288A1 (fr) | Système de tracé d'image de surface routière pour véhicule | |
CN108367707B (zh) | 车辆用照明装置、车辆及照明控制系统 | |
US20220144296A1 (en) | Method for Operating a Driver Information System in an Ego-Vehicle and Driver Information System | |
US20220135061A1 (en) | Method for Operating a Driver Information System in an Ego-Vehicle and Driver Information System | |
US20220144297A1 (en) | Method for Operating a Driver Information System in an Ego-Vehicle and Driver Information System | |
US11807260B2 (en) | Method for operating a driver information system in an ego-vehicle and driver information system | |
CN112601689A (zh) | 车辆的行驶控制方法及行驶控制装置 | |
CN111469845B (zh) | 车辆的控制系统、车辆的控制方法以及介质 | |
JP2010146459A (ja) | 運転支援装置 | |
JP6814161B2 (ja) | 車両用照明装置、車両及び照明制御システム | |
US20210197863A1 (en) | Vehicle control device, method, and program | |
JPWO2019220229A1 (ja) | Ecu及び車線逸脱警告システム | |
KR20200089829A (ko) | 가변구간 설치용 차선 변환시스템 | |
CN109416887B (zh) | 识别控制对象车辆报知装置 | |
WO2020100655A1 (fr) | Système d'éclairage de véhicule | |
JP6980553B2 (ja) | 車両用照明システム及び車両 | |
JP7462541B2 (ja) | 車両制御方法及び車両制御システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: DAIMLER AG, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:STEIN, FRIDTJOF;REEL/FRAME:055917/0787 Effective date: 20210401 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |