DE102015217489B4 - Input method and device in a motor vehicle for selecting a destination for an automated trip - Google Patents

Abstract

Input method in a motor vehicle (50) for selecting a destination for an automated trip, comprising the following steps:
Offering at least one stored trajectory (6.1, 6.2, 6.3, 6.4) on a display device (3),
Selecting one of the at least one stored trajectory (6.1, 6.2, 6.3, 6.4), activating the selected trajectory (6.1) for the automated drive, with one for at least one, preferably each, of the stored trajectories (6.1, 6.2, 6.3, 6.4) graphic representation (7.1, 7.2, 7.3, 7.4) of a target (18) linked to the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) is shown on the display device (3), the graphic representation (7.1, 7.2, 7.3, 7.4) of the linked target (18) at least one of the stored trajectories (6.1, 6.2, 6.3, 6.4) is an image (40),
whereby selecting the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) results in a series of images (41) or a video (42) in the area of the graphic representation (7.1, 7.2, 7.3, 7.4) of the selected trajectory ( 19) is played on the display device (3).

Description

The invention relates to an input method and a device in a motor vehicle for selecting a destination for an automated trip.

Modern motor vehicles have a large number of assistance systems that support the driver in driving the vehicle. Semi-autonomous and autonomous systems that allow semi or fully automatic control of the motor vehicle are increasingly being used.

It is known to have motor vehicles drive automatically on trajectories with the aid of an assistance system. For example, parking spaces in garages or parking lots can be controlled automatically or semi-automatically by the motor vehicle in this way. For this purpose, the surroundings of the motor vehicle are generally recorded by a sensor system and the motor vehicle is localized in a stored environment map with the aid of the environment data generated by the sensor system. If the motor vehicle recognizes an environment in which a trajectory is stored, it offers the trajectory to the driver of the motor vehicle. A stored trajectory can then be called up and the motor vehicle is automatically or semi-automatically controlled by the assistance system on the trajectory into the parking lot.

It is not uncommon, however, to select between several stored trajectories, since there are a large number of possible destinations from the current position of the motor vehicle. This is the case, for example, when a garage or a parking lot, for example in front of large supermarkets, provides several parking spaces. Then the driver has to select the destination he wants to go to.

From the DE 10 2006 026 092 A1 a method for controlling an at least partially automatic parking process is known, by means of which a motor vehicle can be moved from an actual position to a target position, an image of the surroundings of the motor vehicle being displayed by a display unit inside the motor vehicle. A virtual target object is represented in the image of the surroundings, the image position of which in the image of the surroundings corresponds to a target position for the motor vehicle in the surroundings of the motor vehicle. The image position of the target object in the environment image is changed as a function of operating actions by an operator of the motor vehicle, the changed image position of the target object being selected by a selection action by the operator and a changed target position corresponding to the changed image position of the target object being adopted for the motor vehicle as the target position of the parking process.

From the DE 10 2012 015 002 A1 a method for assisted parking of a motor vehicle in a parking space is known, the motor vehicle having a parking device for assisted or automatic parking with surroundings recognition. Based on the information from the parking facility, an avatar is generated in the form of a virtual parking guide, which is projected into the driver's field of vision when parking and guides the driver into the parking space using a virtual gesture that is adapted to the current driving situation.

The invention is based on the technical problem of creating an input method and a device in a motor vehicle for selecting a destination of an automated journey, in which a stored trajectory can be selected in a more user-friendly manner.

The technical object is achieved according to the invention by a method with the features of claim 1 and a device with the features of claim 4. Advantageous refinements of the invention emerge from the subclaims.

For this purpose, an input method is provided in a motor vehicle for selecting a destination of an automated journey, comprising the following steps: offering at least one stored trajectory on a display device, selecting one of the at least one stored trajectory, activating the selected trajectory for the automated journey, whereby for at least one, preferably each, of the stored trajectories, a graphic representation of a destination linked to the at least one stored trajectory is displayed on the display device.

Furthermore, a device is created in a motor vehicle for selecting a destination of an automated journey, comprising at least one display device, at least one operating device, a controller and a memory, the controller being designed in such a way that at least one trajectory stored in the memory is displayed on the at least one display device so that an operator can select and activate one of the at least one stored trajectory via the at least one operating device, and for at least one, preferably each, of the stored trajectories a graphic representation stored in the memory of a destination linked to the at least one stored trajectory to be shown on the display device.

The basic idea of the invention is to provide a graphical representation of one with the stored trajectory for each stored trajectory linked target or target area. The advantage is that an operator or driver is able to identify the linked destination more easily. Stimuli presented via the visual sense can generally be grasped more quickly and more directly for humans than stimuli presented via other senses. For this reason, a graphic representation of a location or a scene in particular can be recorded directly and much faster by an operator than, for example, a description in text form, which first has to be cognitively recorded and understood. This makes it much easier for a driver to recognize a destination, and the identification of the possible options is accelerated. The input method or the selection of a stored trajectory or a linked destination of the automated journey is thus designed to be more comfortable, more ergonomic and therefore more user-friendly.

The graphical representations shown of the at least one stored trajectory can be shown on the display device, for example, in list form or tile form.

It is provided that the graphic representation of the linked target is an image of at least one of the stored trajectories. Such an image can be, for example, a photographic image of the linked destination, for example a parking lot or the surroundings of the parking lot. An operator can then identify the individual stored trajectories with their respective linked targets in a simple manner via the respective photographic image.

The photographic image can be recorded during a learning drive in which a trajectory is generated and stored, for example by a camera present in the motor vehicle. For example, a front camera, a rear view camera or area view cameras in a motor vehicle can be used to provide images for the graphic representation. Here, image data can be recorded when approaching a linked destination and stored in the memory. Image data can be rectified via image processing and shown focused on the linked destination, for example a parking space. There is also the possibility of taking different perspectives on a linked goal through digital image processing.

However, the images can also have been created completely independently of the learning drive. For example, it is also possible to obtain an image or images from private or public sources, for example from the Internet or via specialized services that provide image material. For example, satellite images, aerial photos, StreetView etc. from Internet sources can be used to describe a linked destination, for example a parking lot. In addition, cameras of the motor vehicle can be used to compare the position of the linked target in the image material with the real situation and to mark it precisely.

In principle, however, the image can also be designed as a schematic representation of the linked target, for example in the form of schematic plans, pictograms, symbols or similar schematic representations.

It is further provided that selecting one of the at least one stored trajectory leads to a series of images or a video being played on the display device in the area of the graphic representation of the selected trajectory. This enables a combination of a static picture with a moving picture series or a video. The image of a stored trajectory is displayed until this stored trajectory is selected by an operator. If the stored trajectory is selected, the series of images or the video is played until the selected trajectory is activated or another of the at least one stored trajectory is selected. If another of the stored trajectories is selected, the image for the previously selected trajectory is shown again as a graphic representation. This has the advantage that an operator is always clear which of the at least one stored trajectory he has selected, because the associated series of images or the associated video is only played in the area of the graphic representation of the currently selected trajectory. The graphic representations of the other stored trajectories, on the other hand, show an image that is static.

The series of images can consist, for example, of a series of photographic recordings that were taken when approaching the destination during a learning trip. It is possible to show the path of the entire trajectory or only the last section, for example the last 5, 20 or 50 m, as a series of images. Depending on the length of the trajectory represented by the series of images, it is useful to adapt the time intervals between the individual images of the series of images. This can ensure that the time required to play the series of images remains the same for all series of images, for example two seconds. After the series of images has run through, it can be restarted so that the series of images is repeated cyclically. Likewise, however, it can also only be played back once, with the first or the last or another image in the series of images being displayed after the series of images has been played back once.

The series of images for a stored trajectory can in turn have been recorded by a camera of the motor vehicle during a learning drive, or else come from other sources.

It is also possible to reduce the distances between the individual images in the series of images so that the impression of a fluid sequence of images is created. Therefore, in an alternative embodiment, provision is made for a video to be played after the selection. The term video is intended to mean that an impression of a fluid movement of the sequence of images is created without any jerking perceived by a viewer. As with the series of images, the video can show an entire trajectory or only a part of it, for example only the last few meters or seconds before the linked destination. Analogous to the series of images, the speed at which the video is played must be adapted to the length of the trajectory shown in the video so that the duration of the video can be kept expedient. For example, the video can be limited to a few seconds.

The video for a stored trajectory can in turn have been recorded by a camera of the motor vehicle during a learning drive, or else come from other sources.

The image and the series of images or the video can in turn be generated or provided in accordance with the options outlined above.

In one embodiment it is provided that after selecting one of the at least one stored trajectory, at least one further function is provided, the at least one further function causing a change in the graphic representation of the linked target of the selected trajectory by an image processing device. The at least one further function can include both a change in the graphic representation in the sense of a change in its graphic properties and in the sense of a change in the displayed section of the graphic representation. It is thus possible to enlarge or reduce sections of a displayed image, but in principle rotations or shifts of a scene displayed in the graphic representation are also possible. For example, a displayed parking lot can be viewed from different viewing directions and / or different distances. Likewise, a displayed section of a two-dimensional or three-dimensional representation of the linked target can be shifted, reduced or enlarged or changed with regard to a viewing direction. The advantage is that an operator can change the graphical representation of the target linked to the at least one stored trajectory in an interactive and user-friendly manner, so that any misunderstandings that may exist can be cleared up.

In a further embodiment it is provided that, in addition to the graphic representation of the linked target of the at least one stored trajectory, at least one piece of information about the at least one stored trajectory is displayed in text form on the display device. The advantage is that additional background information can be provided. For example, a distance from the current position of the motor vehicle to the respective linked destination or a parking history can be displayed, which are provided to the driver as an additional selection criterion, but are not absolutely necessary for the selection of one of the at least one stored trajectory.

In one embodiment, the display device and the operating device are designed as freely programmable touch-sensitive display devices, for example as a touchscreen.

• 1 eine schematische Darstellung einer Ausführungsform der Vorrichtung in einem Kraftfahrzeug zum Auswählen eines Zieles einer automatisierten Fahrt;
• 2 eine schematische Darstellung erfindungsgemäßer graphischer Repräsentationen mehrerer hinterlegter Trajektorien zur Erläuterung des Verfahrens;
• 3a eine schematische Darstellung zur Erläuterung einer graphischen Darstellung einer hinterlegten Trajektorie in Form eines Bildes;
• 3b eine schematische Darstellung zur Erläuterung einer graphischen Darstellung einer hinterlegten Trajektorie in Form einer Bilderserie;
• 3c eine schematische Darstellung zur Erläuterung einer graphischen Darstellung einer hinterlegten Trajektorie in Form eines Videos;
• 4 ein schematisches Ablaufdiagramm des Verfahrens zum Auswählen eines Zieles einer automatisierten Fahrt.

The invention is explained in more detail below on the basis of preferred exemplary embodiments with reference to the figures. Here show:

• 1 a schematic representation of an embodiment of the device in a motor vehicle for selecting a destination of an automated trip;
• 2 a schematic representation of graphic representations according to the invention of several stored trajectories to explain the method;
• 3a a schematic representation to explain a graphic representation of a stored trajectory in the form of an image;
• 3b a schematic representation to explain a graphic representation of a stored trajectory in the form of a series of images;
• 3c a schematic representation to explain a graphic representation of a stored trajectory in the form of a video;
• 4th a schematic flow diagram of the method for selecting a destination of an automated trip.

In 1 is schematically a device 1 in a motor vehicle 50 for carrying out the method according to the invention for selecting a The destination of an automated trip is shown. The device 1 includes an operating device for this purpose 2 , a display device 3 and a controller 4th . The operating device 2 and the display device 3 are here about a touch screen 9 summarized. The control 4th controls the operating device 2 and the display device 3 of the touchscreen 9 and can be on a memory 5 access. In the memory 5 are stored trajectories 6.1 , 6.2 , 6.3 , 6.4 saved.

The control 4th now continuously checks whether for a current position of the motor vehicle 50 a stored trajectory in the environment 6.1 , 6.2 , 6.3 , 6.4 is available. The current position of the motor vehicle 50 can be done by a localization device 51 in the motor vehicle 50 are determined and then the controller 4th via an interface 20th are provided, wherein the localization device 51 not part of the device here 1 is. It is now assumed for the current position of the motor vehicle 50 there are three stored trajectories 6.1 , 6.2 , 6.3 , 6.4 available, for example one for each of three neighboring parking spaces. In addition to the trajectories 6.1 , 6.2 , 6.3 , 6.4 themselves are each graphic representations 7.1 , 7.2 , 7.3 , 7.4 the one with the stored trajectories 6.1 , 6.2 , 6.3 , 6.4 linked destinations in memory 5 saved. With the graphic representations 7.1 , 7.2 , 7.3 , 7.4 This is a series of images, which are a sequence of photographic images of the last 10m of the respective stored trajectory 6.1 , 6.2 , 6.3 , 6.4 demonstrate.

There stored trajectories 6.1 , 6.2 , 6.3 , 6.4 from the controller 4th have been recognized, the control offers 4th now the stored trajectories 6.1 , 6.2 , 6.3 , 6.4 on the display device 3 at. This is done, for example, by a as in 2 List display shown, with the graphic representations 7.1 , 7.2 , 7.3 , 7.4 listed below each other. For each graphic representation 7.1 , 7.2 , 7.3 , 7.4 for example, only the last image of the series is shown, for example a photographic image of the respective parking lot.

An operator, for example a driver of the motor vehicle 50 , now has the option of touching the control panel 2 on the touchscreen 9 one of the stored trajectories shown 6.1 , 6.2 , 6.3 , 6.4 to select. Does he now have a trajectory 11 of the stored trajectories 6.1 , 6.2 , 6.3 , 6.4 is selected, the control initiates it 4th that the associated series of images is played. If the operator decides on the selected trajectory 11 , so he activates them, for example by touching one on the touchscreen 9 shown virtual control element, which is linked to the "Activate" function. The control 4th now transfers the parameters of the activated trajectory 12th through the interface 20th to an assistance system 52 , which is the automated drive along the activated trajectory 12th performs. The assistance system 52 is not part of the device 1 and is shown for illustrative purposes only.

Optional includes the control 4th an image processing device 8th , which is an editing of the graphic representations 7.1 , 7.2 , 7.3 , 7.4 by providing additional functions 21 enables. The other functions 21 For example, areas of the graphical representations shown can be enlarged and reduced 7.1 , 7.2 , 7.3 , 7.4 enable or provide a change in viewing direction via digital processing. The one from the image processing facility 8th provided additional functions 21 can, for example, via an additional menu on the touchscreen 9 be selected and operated.

Parts of the device 1 can also be designed as software and implemented, for example, on a microprocessor or microcontroller.

2 shows a schematic representation of a selection menu 13th how it is possible, for example, to select and activate a trajectory from several stored trajectories. The selection menu 13th is embedded in a user interface 14th as they are common in mid-range and luxury vehicles. As for 1 the user interface is described 14th or the selection menu 13th in this case, for example, shown on a display device of a touchscreen, so that operation can take place interactively.

In the selection menu 13th become graphic representations 7.1 , 7.2 , 7.3 , 7.4 represented by stored trajectories, which can be approached from a current position of a motor vehicle in an automated or semi-automated journey. In this example, four different parking spaces can be approached from the current position using stored trajectories. The graphic representations 7.1 , 7.2 , 7.3 , 7.4 show, for example, images of the destinations linked to the stored trajectories, here images of the four parking spaces. The images can be photographic images of the parking spaces or schematic representations. In addition, there is additional information here 17.1 , 17.2 , 17.3 , 17.4 shown in text form, which include, for example, a distance to the corresponding parking space and a parking history.

An operator, for example a driver of the motor vehicle, now selects, for example, a stored trajectory for “parking lot 1” Touching the touchscreen in the area of the graphic representation 7.1 . Of course, however, an entire virtual operating element assigned to the stored trajectory can be used 16.1 can be used to select the stored trajectory. The trajectory is now selected and can now be activated by touching a virtual control element “Activate” 15. Alternatively or in combination, selection and / or activation can also take place via voice input. If the operator wishes a different selection, he can use another stored trajectory before activating it by touching an associated virtual operating element 16.2 , 16.3 , 16.4 select.

An alternative to displaying images is to display a series of images that depict the entire stored trajectory or parts of it, for example only the last 10 m. For example, stored trajectories that have not been selected are used as a graphic representation 7.2 , 7.3 , 7.4 only one picture shown. If, on the other hand, a stored trajectory is selected, the graphic representation 7.1 the selected trajectory 19th the series of images is played and then repeated cyclically, for example. It is possible here for the playback to be stopped after a subsequent activation so that the driver of the motor vehicle is not distracted when driving the motor vehicle, for example during a semi-automated journey.

the 3a , 3b and 3c show schematically the possible graphic representations 7.1 to a stored trajectory 6.1 . In 3a is a picture 40 with the stored trajectory 6.1 linked goal 18th shown. This can be, for example, a photographic image or a two-dimensional or three-dimensional schematic model of the linked target 18th , for example the area around a parking lot. In 3b is the graphic representation 7.1 the stored trajectory 6.1 a series of pictures 41 whose images here, for example, at regular intervals during the second half of a learning run to the stored trajectory 6.1 were recorded. The series of pictures 41 is then after selecting the stored trajectory 6.1 played cyclically and repeated. Is the stored trajectory 6.1 not selected, for example, only the last image can 43 of the picture series 41 which is the linked goal 18th maps, are represented. In 3c is the graphic representation 7.1 a video 42 , which, for example, during the second half of a learning run to the stored trajectory 6.1 has been recorded. The video 42 becomes after selecting the stored trajectory 6.1 played cyclically. Is the stored trajectory 6.1 not selected, for example, only the last image can 43 of the video 42 which is the linked goal 18th maps, are represented.

In 4th a schematic sequence of the process is shown. Thereby the procedure 200 carried out as soon as a stored trajectory is available for a current position of the motor vehicle 101 . You can choose between the process steps 101 and 200 There are still further method steps, for example a message to a driver of the motor vehicle that at least one stored trajectory is available for the current position.

In the process 200 the at least one stored trajectory is itself offered in the first method step 201 . For this purpose, a graphic representation of a linked target is shown on a display device for each of the at least one stored trajectory 202 . Optionally, additional information can be displayed in text form for each stored trajectory, corresponding to the respective graphic representation 203 , for example a distance to the respective linked destination or a parking history in the form of an elapsed time since the last time you parked in a parking lot. Changing is also optional 204 the graphic representation via an image processing device. For example, a graphic representation can be enlarged or reduced in this way or a viewing direction can be changed. In the case of two- or three-dimensional representations, for example, an overall view can also be rotated. The operator can then select one of the at least one stored trajectory 205 . If he has selected one of the stored trajectories, he can activate it in the last process step 206 . The activated stored trajectory is then followed in an automated drive 102 , for example, by transferring the parameters of the activated trajectory to an assistance system that carries out the automated journey.

List of reference symbols

1

contraption

2

Control device

3

Display device

4th

steering

5

Storage

6.1

stored trajectory

6.2

stored trajectory

6.3

stored trajectory

6.4

stored trajectory

7.1

graphic representation

7.2

graphic representation

7.3

graphic representation

7.4

graphic representation

8th

Image processing device

9

Touch screen

11

selected trajectory

12th

activated trajectory

13th

Selection menu

14th

user interface

15th

Virtual control element "Activate"

16.1

virtual control element

16.2

virtual control element

16.3

virtual control element

16.4

virtual control element

17.1

additional information in text form

17.2

additional information in text form

17.3

additional information in text form

17.4

additional information in text form

18th

linked goal

19th

selected trajectory

20th

interface

21

More functions

40

image

41

Series of images

42

Video

43

last picture

20th

interface

50

Motor vehicle

51

Location device

52

Assistance system

101-102

Steps before and after the procedure

200-206

Procedural steps

Claims (5)

Input method in a motor vehicle (50) for selecting a destination for an automated trip, comprising the following steps: Offering at least one stored trajectory (6.1, 6.2, 6.3, 6.4) on a display device (3), Selecting one of the at least one stored trajectory (6.1, 6.2, 6.3, 6.4), activating the selected trajectory (6.1) for the automated drive, with one for at least one, preferably each, of the stored trajectories (6.1, 6.2, 6.3, 6.4) graphic representation (7.1, 7.2, 7.3, 7.4) of a target (18) linked to the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) is shown on the display device (3), the graphic representation (7.1, 7.2, 7.3, 7.4) of the linked target (18) at least one of the stored trajectories (6.1, 6.2, 6.3, 6.4) is an image (40), whereby a selection of the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) leads to a series of images (41) or a video (42) in the area of the graphic representation (7.1, 7.2, 7.3, 7.4) of the selected trajectory ( 19) is played on the display device (3). Input procedure according to Claim 1 , characterized in that after selecting one of the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) at least one further function (21) is provided, the at least one further function (21) changing the graphic representation (7.1, 7.2, 7.3, 7.4) of the linked target (18) of the selected trajectory (19) by means of an image processing device (8). Input method according to one of the preceding claims, characterized in that in addition to the graphic representation (7.1, 7.2, 7.3, 7.4) of the linked target (18) of the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) at least one piece of information (17.1, 17.2, 17.3, 17.4) for which at least one stored trajectory (6.1, 6.2, 6.3, 6.4) is shown in text form on the display device (3). Device (1) in a motor vehicle (50) for selecting a destination of an automated journey, comprising: at least one display device (3), at least one operating device (2), a controller (4) and a memory (5), the controller ( 4) is designed to offer at least one trajectory (6.1, 6.2, 6.3, 6.4) stored in the memory (5) on the at least one display device (3) so that an operator can use the at least one operating device (2) to select one of the at least can select and activate a stored trajectory (6.1, 6.2, 6.3, 6.4), and for at least one, preferably each, of the stored trajectories (6.1, 6.2, 6.3, 6.4) a graphic representation (7.1 , 7.2, 7.3, 7.4) to display a target (18) linked to the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) on the display device (3), the device (1) further being designed in such a way that the graphi cal representation (7.1, 7.2, 7.3, 7.4) of the linked target (18) of at least one of the stored trajectories (6.1, 6.2, 6.3, 6.4) is an image (40), whereby a selection of the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) results in a series of images ( 41) or a video (42) in the area of the graphic representation (7.1, 7.2, 7.3, 7.4) of the selected trajectory (19) is played on the display device (3). Device (1) according to Claim 4 , characterized in that the controller (4) comprises an image processing device, the controller (4) being designed in such a way that, after the at least one stored trajectory (6.1, 6.2, 6.3, 6.4) has been selected by an operator, at least one further function (21 ) to offer the image processing device (8) on the display device (3) and, when the operator activates the at least one further function (21), to cause the image processing device (8) to change the graphic representation (7.1, 7.2, 7.3, 7.4) of the target (18) linked to the selected trajectory (19).

Images