FR3155195A1 - Augmented reality display system for parking spaces for people with reduced mobility - Google Patents

Abstract

A method for assisting a motor vehicle with driving, comprising the following steps: - detecting an available disabled parking space (20) in the environment of the motor vehicle, - superimposing a virtual gantry (10) on the environment of the motor vehicle, under which the motor vehicle should pass, upstream of the detected available disabled parking space (20). Figure for abstract: Fig. 1

Description

Augmented reality display system for parking spaces for people with reduced mobility Technical field of the invention

The present invention relates generally to driver assistance methods and systems, particularly for motor vehicles such as cars, trucks, or motorcycles. More specifically, it relates to driver assistance systems, also known as ADAS (Advanced Driver-Assistance System), found in certain motor vehicles. It relates more particularly to a motor vehicle incorporating an ADAS system coupled with an augmented reality display system.

State of the art

It is known in prior art to display points of interest such as parking spaces on the screen of a navigation or driver assistance system. However, it is desirable to facilitate driving and navigation for people with reduced mobility, particularly to allow for easy parking, while also improving safety, comfort, and navigation.

One aim of the present invention is to address the disadvantages of the prior art mentioned above and in particular, firstly, to provide a method of driving assistance, a driving assistance system and a vehicle equipped with such a driving assistance system in order to facilitate driving and parking for persons with reduced mobility, while improving safety and comfort.

To this end, a first aspect of the invention relates to a driving assistance method for a motor vehicle, comprising the following steps:
- to detect an available accessible parking space within the environment of a motor vehicle,
- superimpose on the environment of the motor vehicle a virtual gantry under which the motor vehicle should pass, upstream of the available disabled parking space detected.

This allows for a smoother, more user-friendly driving assistance system that detects available accessible parking spaces and indicates them to the driver immediately, clearly, and precisely, thus improving safety and comfort. Specifically, it eliminates the need for the driver to receive a message or request confirmation, particularly before performing a maneuver requiring their full attention. Furthermore, it saves the driver from having to manually search through large and complex databases for accessible parking spaces, thus saving them significant and tedious effort and enhancing both safety and ease of use. The invention also benefits from facilitating the search for accessible parking spaces by providing drivers with an augmented reality experience that optimally manages the information displayed in their field of vision, limiting the amount needed to minimize mental workload and visual impact.

The term "upstream" refers to a location positioned before the accessible parking space in the vehicle's direction of travel. The virtual gantry can therefore be displayed, for example, 5 meters before the accessible parking space, or at other distances such as 10 meters, 20 meters, 30 meters, 40 meters, 50 meters, 75 meters, 100 meters, 150 meters, or more than 150 meters. The user can preferably select this distance in the driver assistance system's user interface, for example, within their user profile. It is also possible to adapt this distance according to the speed of the vehicle (for example a greater value if the vehicle is traveling faster, for example 30 meters if the vehicle is traveling at 30 km/h +/- 10 km/h, for example 50 meters if the vehicle is traveling at 50 km/h +/- 10 km/h, and for example 150 meters if the vehicle is traveling at 80 km/h +/- 10 km/h), or according to traffic in town or in the countryside, or according to the density of car traffic.

ADAS systems are generally associated with visual information display systems on a display medium located within the driver's field of vision, particularly on the vehicle's windshield. This information is intended to help the driver navigate the vehicle within its road environment.

Augmented reality occurs when information displayed by on-screen systems is superimposed on the driver's actual view of the vehicle and its surroundings. It's a visualization of the scene around the vehicle, filmed directly, for example, by the vehicle's front camera, and enhanced by the driver assistance system.

This information complements the basic information presented, in particular, on the dashboard or on a screen in the vehicle's cockpit, in order to improve safety, comfort, or navigation.

In particular, augmented reality can display on the windshield, which serves as a support or screen for information, safety information such as a reminder of the road signs being followed, better visualization of the road at night, and a marking on the ground of the routes to follow, in particular to guide the vehicle towards parking spaces.

Most current and prior art display systems, known as HV, an acronym for "Head Up Vision" or HUD in Anglo-Saxon terminology for "Head Up Display", do not allow augmented reality display but simply allow driving information to be given to the driver without the latter diverting his attention from the road.

The new generations of VTH, known as "long distance", according to the present invention, allow images to be projected further onto the road scene extending in front of the vehicle (5 meters, up to 10 meters or even more as needed) in order to "superimpose" "virtual" graphic elements onto the "real" road scene and to offer an augmented reality service.

The advantage of augmented reality is its ability to overlay virtual "floating" arrows, road markings, compass bearings, or any other guidance information indicating the route to follow and/or pointing in the direction of travel onto the road in front of the vehicle. Furthermore, it is particularly possible to overlay a virtual gantry, as explained above and as will be described in more detail below, notably with reference to the attached figures.

To be able to guide the vehicle in its road environment, an augmented reality display system generally cooperates with an on-board ADAS system which uses maps, including high-definition maps associated with a navigation system, and data delivered by sensors on-board in the vehicle, including a multifunction camera which can be positioned against the windshield of the vehicle, preferably at the level of the interior rearview mirror.

In the vehicle, the main source of data (database) on mapped parking lots comes from the navigation system. They can be displayed at the user's request via the vehicle's navigation HMI (Human-Machine Interface), which offers a menu of display options to vehicle passengers, or permanently on the displayed navigation map, on a dashboard screen or other screen in the vehicle's cockpit.

This database lists a number of parking spaces, but updates are sporadic. Furthermore, the database does not include parking spaces that are not in parking lots or designated as such. Therefore, on-street parking spaces are not included.

On the one hand, it is desirable to move away from databases listing accessible parking spaces in order to be more efficient in finding them, for example by ensuring their real-time availability, which is particularly difficult with a database. On the other hand, it is desirable to optimally adapt the graphic representation of the information displayed (for example, on the windshield), particularly according to the actual distance of the accessible parking space from the vehicle.

The present invention thus proposes a solution embedded in the vehicle, allowing to display in augmented reality information of parking spaces for reduced mobility which is scalable/adaptive and intuitive for the driver of the vehicle, and which has been effectively detected in the environment of the vehicle.

Advantageously, the process includes the following step:
- detect an available accessible parking space in the immediate vicinity of the motor vehicle.

Advantageously, the process includes the following step:
- to indicate a preference (for example general or prior) of a user for a parking space for reduced mobility.

This allows us to better assist the user and in particular to manage their preferences through, for example, a user profile or possibly on a case-by-case basis.

Advantageously, the process also includes the following step:
- no longer display the virtual gantry after the motor vehicle has passed through or overtaken the virtual gantry.

This allows drivers to continue driving without being distracted by the virtual gantry display, while still receiving information about whether the gantry has been crossed or passed. In particular, this improves understanding of the road situation. Furthermore, it eliminates the need for the user to receive a message or take any action to confirm, resulting in a smoother user experience.

Advantageously, the process also includes the following step:
- modify the appearance of the virtual gantry when the motor vehicle passes through or overtakes the virtual gantry.

This allows the user to be easily informed that the virtual barrier has been crossed or passed. In particular, this improves understanding of the road situation and indicates to the user that they can now maneuver to park in the accessible parking space.

Advantageously, the overlay step is performed in real time, dynamically or immediately after the detection step.

This allows the system to quickly inform the user that a disabled parking space is available, while clearly indicating that they need to continue driving a short distance to reach it. This provides dynamic information that is particularly useful to the user.

Advantageously, the overlay step is performed in augmented reality.

This allows for the seamless integration of the detection of the availability of the accessible parking space into the environment of the motor vehicle, and improves user safety and comfort.

Advantageously, the driver assistance process also includes the following step:
- overlay or display a guidance for maneuvering to be carried out in order to park the motor vehicle in the available disabled parking space detected.

This makes it easier for the user to maneuver while having detected the parking space for people with reduced mobility.

Advantageously, the driver assistance process also includes the following step:
- modify a dimension of the virtual gantry as a function of a virtual distance between the motor vehicle and the virtual gantry, such as increasing the dimension of the virtual gantry as the motor vehicle moves towards the virtual gantry.

This allows the user to optimize their understanding of the road situation by having reliable, precise and intuitive information, without having to physically interact with the driver assistance system, such as by acknowledging a message, touching the screen with a finger or giving verbal confirmation.

Advantageously, the driver assistance process also includes the following step:
- adapt a color of the virtual gantry if the motor vehicle is travelling in a lane suitable for parking in the available disabled parking space detected, for example if the vehicle is travelling in a lane on the same side as the available disabled parking space detected.

Advantageously, the driver assistance process also includes the following step:
- adapt a color of the virtual gantry if the motor vehicle is travelling in a lane that is not suitable for parking in the available disabled parking space detected, for example if the vehicle is travelling in a lane on the opposite side of the available disabled parking space detected, or a lane far from the available disabled parking space detected.

This allows the user to optimize their understanding of the road situation by having reliable, precise and intuitive information, without having to physically interact with the driver assistance system, such as by acknowledging a message, touching the screen with a finger or giving verbal confirmation.

Advantageously, the step of superimposing the virtual gantry onto the environment of the motor vehicle is carried out on a screen of the motor vehicle or on a head-up display, and preferably the virtual gantry is superimposed on the environment of the motor vehicle reproduced on the screen of the motor vehicle or on the head-up display.

This allows detection to be integrated into the vehicle environment (or the real scene).

Advantageously, the process includes the following step:
- display a real-time image of the vehicle's surroundings and, simultaneously, a virtual gantry upstream of the detected available accessible parking space, as well as guidance on how to maneuver the vehicle into the detected available accessible parking space.

Advantageously, the driver assistance system includes at least one camera arranged to deliver real-time information about the vehicle's surroundings and/or the location (or detection) of a disabled parking space.

Advantageously, a vehicle navigation system is arranged to deliver map information on the disabled parking space; said information being correlated and synchronized with each other to be displayed by the augmented reality display system.

In a second aspect, the invention relates to a driver assistance system for a motor vehicle arranged to implement the method according to the first aspect.

This allows for a smoother, more user-friendly driver assistance system that can detect available accessible parking spaces and indicate them to the driver immediately, clearly, and precisely, thus improving safety and comfort. In particular, this eliminates the need for the driver to receive a message or request confirmation.

In a second aspect, the invention relates to a motor vehicle comprising a driver assistance system according to the previous aspect.

This allows for a vehicle with a smoother, more user-friendly driver assistance system that can detect available accessible parking spaces and indicate them to the driver immediately, clearly, and precisely, thus improving safety and comfort. In particular, this eliminates the need for the driver to receive a message or request confirmation.

Description of the figures

Other features and advantages of the present invention will become more apparent upon reading the following detailed description of an embodiment of the invention given by way of non-limiting example and illustrated by the accompanying drawings, in which:

FIG. 1 represents an augmented reality view of an environment of a motor vehicle according to the present invention, having a driver assistance system or using the driver assistance method according to the present invention.

FIG. 2 represents another augmented reality view of a different environment of the vehicle.

Detailed description of implementation method(s)

There FIG. 1 represents an augmented reality view of an environment of a motor vehicle according to the present invention, having a driver assistance system or using the driver assistance method according to the present invention.

Thus, when the user or driver is in the vehicle, they can enter their desired destination or simply drive without navigation assistance. In either case, they can benefit from the driving assistance provided by the present invention.

He may have previously indicated his preference for a parking space for people with reduced mobility, either through a case-by-case action or through a preference in a user profile, for example.

The vehicle includes a driver assistance system. The vehicle also preferably includes a navigation system and communication means. Communication means include, for example, an antenna connected to a GPS and/or a geolocation system (Global Positioning System, or satellite-guided global navigation system). The driver assistance system (or the vehicle) also preferably includes a display system (such as one or more screens, or a head-up display) and a human-machine interface such as a keyboard or touchscreen. The vehicle also preferably includes an on-board computer. Furthermore, the vehicle includes an on-board camera for capturing images of the environment outside the vehicle.

The view of the FIG. 1 This is the view from the vehicle being driven.

The driver assistance system detected on the left of the FIG. 1 A parking space for people with reduced mobility is available, as indicated by the camera or other optical or radar system. The space is considered available because there is no vehicle already parked in it and/or there are no obstacles obstructing or blocking access.

The driver assistance system allows a virtual gantry 10, under which the vehicle must pass, to be superimposed onto the vehicle's surroundings. The virtual gantry is positioned upstream of the available accessible parking space 20 so that the user can immediately understand the procedure to follow to reach it. The virtual gantry 10 is displayed on a screen, on the vehicle's windshield acting as a screen, or on any other device, superimposed on the surrounding environment. The user thus easily understands that they must pass under the virtual gantry 10 to reach the available accessible parking space 20.

It is therefore possible to display in an augmented reality window, in the field of vision of the vehicle driver, a graphic representation of the virtual gantry 10.

The virtual gantry 10 can also be equipped with a virtual sign 11 indicating the presence of a parking space for people with reduced mobility and an arrow 12 (possibly flashing) indicating the side of the road on which the parking space for people with reduced mobility 20 is located.

It is also possible to provide a virtual display on the ground (such as a square, a rectangle, a flat area, a space outline or any other shape) on the very location of the disabled parking space 20, and/or guidance arrows 30 to guide and reach the disabled parking space 20.

The virtual gantry 10 can also have its size modified (for example increased or decreased) as one approaches the disabled parking space 20.

Furthermore, it is possible to program a modification or adaptation of the virtual gantry 10 at the moment of crossing, such as a flashing light or a green color. Similarly, it is possible to program a flashing light or an orange or red color if the virtual gantry 10 is passed without being crossed (i.e., without the vehicle passing under the virtual gantry 10, but for example alongside it).

It is possible to detect the disabled parking space 20 by the marking on the ground physically present on the disabled parking space 20, or indicated by a physical sign 40 in the environment of the vehicle (here in the street).

There FIG. 2 represents another augmented reality view of a different environment of the vehicle.

The vehicle is moving, at the FIG. 2 , in a different location than that of the FIG. 1 .

The driver assistance system has detected a disabled parking space 20. In this case, the space is considered available because there is a physical sign 40 in the street indicating the presence of the disabled parking space 20, and the vehicle placed in the disabled parking space 20 is leaving, for example because it is maneuvering to leave or because it has put on its indicator to indicate that it wants to leave.

The virtual gantry 10 is a different color than the one in the FIG. 1 because on the FIG. 1 , the vehicle is located on a lane or in a lane adapted for parking (almost directly) in the disabled parking space 20, whereas at the FIG. 2 The vehicle is not in the correct lane and must move to another, more suitable lane in order to then park safely in the disabled parking space 20.

The virtual gantry 10 is equipped with a virtual sign 11 indicating the presence of the disabled parking space 20 as well as an arrow to the side of the road where the disabled parking space 20 is located.

Parking space 21 is considered unavailable because the vehicle parked on it shows no intention of leaving the space, for example the door is open and a passenger is getting out of the vehicle.

Furthermore, it should be noted that in navigation mode, it is possible to filter Points of Interest (POIs) to display only accessible parking spaces closest to the user's programmed route and/or near the destination or programmed stops. For example, this could be an accessible parking space on a road perpendicular to the one the vehicle is traveling on, and not on the vehicle's main route: in this case, it is possible to choose whether or not to display the virtual gantry 10, so as not to overwhelm the user with unwanted information. The user can also access all accessible parking spaces by navigating the navigation system's map.

In addition, it is possible to offer the user several 20 accessible parking spaces if they are detected, preferably in a short list, and if possible with selection criteria such as the distance between the accessible parking spaces and the desired destination, the presence of stairs, elevators, etc., and preferably with an environmental map of the area between the accessible parking space and the final destination.

It is also possible to create a "person with reduced mobility" mode when calculating a route directly via the on-board navigation system, but also via a technical device allowing subscription to a dedicated connected service providing access to a database of photos displaying the environment related to the parking space, dedicated for people with reduced mobility.

A driver assistance method, a driver assistance system and a motor vehicle equipped with the driver assistance system according to the present invention, and their manufacture and use, are capable of industrial application.

It will be understood that various modifications and/or improvements obvious to a person skilled in the art can be made to the different embodiments of the invention described in this description without departing from the scope of the invention.

Claims (10)

A method for assisting the driving of a motor vehicle, comprising the following steps:
- detect an available accessible parking space (20) in a motor vehicle environment,
- superimpose on the environment of the motor vehicle a virtual gantry (10) under which the motor vehicle should pass, upstream of the available disabled parking space (20) detected. A driving assistance method according to the preceding claim, further comprising the following step:
- no longer display the virtual gantry (10) after the motor vehicle has passed through or overtaken the virtual gantry (10). A driving assistance method according to any one of the preceding claims, wherein the overlay step is performed in real time or immediately after the detection step. A driving assistance method according to any one of the preceding claims, wherein the overlay step is performed in augmented reality. A driving assistance method according to any one of the preceding claims, further comprising the following step:
- overlay or display a maneuver guidance (30) to be carried out in order to park the motor vehicle in the available disabled parking space (20) detected. A driving assistance method according to any one of the preceding claims, further comprising the following step:
- modify a dimension of the virtual gantry (10) as a function of a virtual distance between the motor vehicle and the virtual gantry (10), such as increasing the dimension of the virtual gantry (10) as the motor vehicle moves towards the virtual gantry (10). A driving assistance method according to any one of the preceding claims, further comprising the following step:
- adapt a color of the virtual gantry (10) if the motor vehicle is travelling in a lane adapted to park in the available disabled parking space (20) detected, for example if the vehicle is travelling in a lane on the same side as the available disabled parking space (20) detected. A driving assistance method according to any one of the preceding claims, wherein the step of superimposing the virtual gantry (10) onto the environment of the motor vehicle is carried out on a screen of the motor vehicle or on a head-up display, and preferably the virtual gantry (10) is superimposed on the environment of the motor vehicle reproduced on the screen of the motor vehicle or on the head-up display. Driver assistance system for a motor vehicle arranged to implement the process according to any of the preceding steps. Motor vehicle comprising a driver assistance system according to the preceding claim.