EP3746835B1 - Method for operating at least one pair of electronic augmented reality glasses in a motor vehicle, and display device for a motor vehice - Google Patents
Method for operating at least one pair of electronic augmented reality glasses in a motor vehicle, and display device for a motor vehice Download PDFInfo
- Publication number
- EP3746835B1 EP3746835B1 EP18769128.2A EP18769128A EP3746835B1 EP 3746835 B1 EP3746835 B1 EP 3746835B1 EP 18769128 A EP18769128 A EP 18769128A EP 3746835 B1 EP3746835 B1 EP 3746835B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- entertainment
- electronic data
- route
- motor vehicle
- offers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 13
- 239000011521 glass Substances 0.000 title description 64
- 230000003190 augmentative effect Effects 0.000 title description 7
- 230000033001 locomotion Effects 0.000 claims description 12
- WYTGDNHDOZPMIW-RCBQFDQVSA-N alstonine Natural products C1=CC2=C3C=CC=CC3=NC2=C2N1C[C@H]1[C@H](C)OC=C(C(=O)OC)[C@H]1C2 WYTGDNHDOZPMIW-RCBQFDQVSA-N 0.000 claims description 9
- 238000009877 rendering Methods 0.000 claims 8
- 230000002596 correlated effect Effects 0.000 claims 1
- 230000000875 corresponding effect Effects 0.000 claims 1
- 201000003152 motion sickness Diseases 0.000 description 7
- 238000001514 detection method Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000036421 sense of balance Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/216—Input arrangements for video game devices characterised by their sensors, purposes or types using geographical information, e.g. location of the game device or player using GPS
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3697—Output of additional, non-guidance related information, e.g. low fuel level
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Definitions
- the invention relates to a method for operating at least one electronic data glasses in a motor vehicle and a display device for a motor vehicle. Furthermore, the invention also relates to a motor vehicle with such a display device.
- DE 10 2014 011 278 A1 a method for bridging a period of time during autonomous driving of a motor vehicle.
- a driver of the motor vehicle can play a computer game while driving autonomously, whereby, among other things, a steering wheel, an accelerator pedal and a brake of the motor vehicle can be used as input elements for the computer game.
- the DE 10 2014 219 223 A1 shows an autonomous motor vehicle with an entertainment system. Using the maintenance system, media content for vehicle occupants can be projected onto a projection surface.
- the DE 10 2014 220 001 A1 shows a method in which media content is played back during autonomous driving of a motor vehicle becomes. If autonomous driving is interrupted, playback of the media content is also stopped.
- a component in a vehicle can be adjusted at least in part based on the collected data. It is further disclosed that seats, mirrors, air conditioning, video displays, and possibly other elements of the vehicle are included as components that undergo adjustment to relieve motion sickness. Further, it is disclosed that a video showing, for example, flying, fast driving in a car, views of tall buildings, and so on, may be determined to potentially cause or contribute to motion sickness. If motion and/or other images and/or phenomena in the buffered video data are determined to potentially contribute to motion sickness, the computer will pause the playing video. Further, a user may be asked whether a portion of the video that is likely to contribute to motion sickness should be skipped entirely or a portion of the video that is likely to contribute to motion sickness should be omitted.
- the DE 10 2014 019 579 A1 shows a system for operating a display device for use in a motor vehicle.
- the system includes a display area of the display device in which first and second image data are displayed independently of one another.
- the system comprises a detection device which is designed to detect a movement of the motor vehicle, the detection device being coupled to the display device via a control device.
- the control device is designed to receive a signal from the detection device and to dynamically display the first image data within the display area depending on the signal.
- this can be displayed, for example, by the display device before reaching the route section, and a user of the display device can be warned in advance, for example in the form of a symbol, which can be displayed in the display area of the display device.
- the entertainment offers can, for example, be virtual experiences in which you move in a context that matches the driving movement of the motor vehicle. For example, you can fly virtually over a planet's surface. If the motor vehicle drives a curve, this movement is also reflected in the displayed virtual world, i.e. during the flight over the planet's surface, so that the real forces acting on the wearer of the electronic data glasses correspond to what is experienced virtually.
- the entertainment offerings can also include films or the like.
- the invention is based on the knowledge that these different entertainment offers or entertainment formats sometimes work better and sometimes worse with different route characteristics. For example, a virtual space battle will feel more natural or authentic on a winding mountain road than on a long, flat stretch of highway. However, if you want to watch a movie in a virtual cinema using electronic data glasses, an elongated, flat route with few curves would be more advantageous.
- the method according to the invention it is therefore provided to analyze how well a route of an upcoming route to a destination and/or how well the respective route of a road network in the area surrounding the motor vehicle fits the entertainment offerings provided.
- Entertainment offers suitable for an upcoming route, or if this is not known, for a surrounding transport network characteristic, can be filtered out and offered particularly well.
- the route refers in particular to how curvy and hilly a particular route or road network is.
- the entertainment offers are then played back with the electronic data glasses depending on the analysis offered.
- the electronic data glasses can be connected directly or the motor vehicle can be connected to a vehicle-internal or vehicle-external navigation system.
- the motor vehicle is used to achieve a specific goal If the destination is a very curvy and hilly route, those entertainment options are rated as particularly suitable for which particularly strong ups and downs and sideways movements would be advantageous. If, on the other hand, it is determined that the above route runs, for example, along a very flat surface and also has very few curves, those entertainment offers are rated as particularly suitable in which fewer up and down movements and fewer sideways movements would be advantageous.
- the user of the electronic data glasses is presented with the analysis result either directly using the electronic data glasses, more precisely by means of the corresponding display means of the electronic data glasses, or when the electronic data glasses are removed, for example via a vehicle-side display device, in which the entertainment offers are displayed accordingly depending on the analysis.
- the user of the electronic data glasses can therefore clearly see how well the various entertainment options available relate to that of him and/or himself, even before he drives his route to the destination and/or drives along a route along the road network in the vicinity of the motor vehicle route planned on the navigation system.
- the user of the electronic data glasses can select the entertainment offerings that best suit the route or the entertainment offering that best suits the route.
- An advantageous embodiment of the invention provides that the entertainment offers are offered by a respective result of the Analysis assigned to the forms of entertainment offered is displayed. For example, a rating score or the like can be displayed next to the respective entertainment offerings provided. In this way, the user of the electronic data glasses can easily recognize the analysis result and - if he wants - select, for example, the best-rated or best-analyzed entertainment offer.
- a further advantageous embodiment of the invention provides that the entertainment offerings are offered by displaying the entertainment offerings sorted according to their respective analysis results in an order, preferably in descending order starting from the best result of the analysis.
- the user of the electronic data glasses can see in a particularly simple way which of the entertainment options on offer best suits the route ahead.
- those entertainment offers are filtered out and not offered at all which, based on the analysis results, it is clear that the correspondence between the entertainment offerings in question and the respective routes is so poor that this would lead to a particularly poor user experience.
- the user of the electronic data glasses to be able to choose whether he would like to have this filter function or would instead prefer to be shown all basically possible entertainment offers.
- a duration for the target is determined and the entertainment offers are offered for playback with the electronic data glasses depending on the determined duration. For example, if it is clear from the user input that he will only drive for 15 to 20 minutes, he can, for example, give preference Correspondingly short entertainment formats or entertainment offers are displayed or offered first or at all. If, on the other hand, it is clear that the user will be driving a very long distance, for example two or more hours, entertainment offers that have an equally long duration can also preferably be displayed for the user to select. Knowing the duration of the target, for example, those entertainment offers can be pre-filtered which are particularly suitable in terms of the length of the presentation, since they have a particularly close correspondence with the duration of the target.
- a query is made as to how long a user of the electronic data glasses would like to be entertained, and the entertainment offers are offered for playback using the electronic data glasses depending on a specified entertainment duration.
- the user of the electronic data glasses does not intend to use the entire driving time to enjoy or consume entertainment offers.
- the user of the electronic data glasses knows that he would like to make business calls while driving, so that he only wants to use one of the entertainment offers for the remaining period of time. In such a case, it can be very advantageous if the entertainment options offered correspond as closely as possible to the planned period of use.
- a most suitable section of a route traveled is selected for playback of one of the entertainment offerings.
- the previously mentioned analysis can then come into play, by means of which it is determined how well, for example, the route of the upcoming route fits a destination, in order to then select the most suitable section of the route traveled for playback of one of the entertainment offerings. For example, you can select the section of route that is particularly hilly and also has a particularly curvy route if this fits particularly well with one of the entertainment offerings.
- a reverse approach is of course also possible, so that, for example, a section of the route is chosen that has a particularly few curves if this fits particularly well with one of the entertainment offerings.
- the control device can be part of the electronic data glasses or, for example, part of an infotainment system of the motor vehicle.
- the electronic data glasses it is possible for the electronic data glasses to have a suitable communication interface via which different entertainment offerings can be downloaded, for example, from a server external to the vehicle and thus made available.
- the motor vehicle prefferably has a suitable communication interface via which different entertainment offerings can be downloaded or made available for selection.
- Advantageous embodiments of this method according to the invention are to be viewed as advantageous embodiments of the display device according to the invention and vice versa, with the display device in particular having means for carrying out the method steps.
- the electronic data glasses are virtual reality glasses or augmented reality glasses.
- the user of the electronic data glasses can completely immerse themselves in virtual worlds while driving the motor vehicle, as the virtual reality glasses completely visually isolate them from their real surroundings.
- the electronic data glasses are augmented reality glasses, the user of the electronic data glasses can still see the real environment, with the augmented reality glasses overlaying this with additional virtual content. This overlay of reality with virtual content then depends on the entertainment offering chosen by the user.
- the at least one electronic data glasses are designed to function both as virtual reality glasses and as augmented reality glasses, i.e. to represent a kind of hybrid.
- the motor vehicle according to the invention comprises the display device according to the invention or an advantageous embodiment of the display device according to the invention.
- the drawing shows a highly schematic representation of a motor vehicle in which a user sits who is wearing electronic data glasses, by means of which a wide variety of entertainment offers can be played while driving the motor vehicle.
- a motor vehicle 1 is shown in a highly schematic representation in the single figure.
- a vehicle occupant 2 who has put on electronic data glasses 3, for example in the form of virtual reality glasses or in the form of augmented reality glasses.
- a control device 4 is indicated schematically, which is set up to provide a wide variety of entertainment offers and to analyze how well a route of an upcoming route 5 to a destination and / or how well respective routes of a road network in the environment 6 of the motor vehicle 1 relate to the provided entertainment offers fit, as well as to offer the entertainment offers depending on the analysis for playback with the electronic data glasses 2.
- the control device 4 can, for example, be part of the electronic data glasses 2. It is also possible that the control device 4 is part of a vehicle-side infotainment system of the motor vehicle 1.
- the vehicle occupant 2 is, for example, the driver of the motor vehicle 1, he can use the electronic data glasses 3 for entertainment purposes in particular when the motor vehicle 1 is currently driving fully autonomously.
- the vehicle occupant 2 is provided with different entertainment options by means of the control device 4, which can be played back using the electronic data glasses 3.
- the control device 4 analyzes how well the route of the upcoming route 5 to a specific destination matches the entertainment offerings provided. For example, if the vehicle occupant 2 has previously entered a specific destination, such as a route to work or the like, a navigation system of the motor vehicle 1 (not shown here) can, for example, determine the corresponding route 5 to reach the destination and send information about the route of the route 5 to the control device 4 to transfer. This can then analyze how The route of the upcoming route 5 fits well with a wide variety of entertainment options available, such as virtual computer games, cinema films and the like.
- control device 4 In the event that the specific route 5 has not yet been determined at all, it is also possible for the control device 4 to analyze how well the respective routes of a road network (not shown here) in the environment 6 of the motor vehicle 1 match the entertainment offerings provided. Either way, the entertainment offerings provided are offered for playback with the electronic data glasses 3 depending on the analysis.
- the offering of entertainment can be done, for example, by displaying a respective result of the analysis associated with the forms of entertainment offered.
- the vehicle occupant 2 can recognize particularly well which of the available entertainment offers fit particularly well with the route of the route 5, for example, if the entertainment offers are in a very specific order according to their respective result of the aforementioned analysis, preferably in descending order starting from the best result of the analysis. displayed sorted.
- This display can be done, for example, by means of the electronic data glasses 3 and/or by means of a display device in the motor vehicle 1, for example by means of a display in the area of a center console or the like.
- the vehicle occupant 2 can therefore easily recognize which of the entertainment options that are generally available best suit the route of the route 5 ahead of him, for example. After the vehicle occupant 2 has selected one of the available and offered entertainment offerings, he can, for example, sit back and relax while the motor vehicle 1 drives fully autonomously along the route 5 and the vehicle occupant 2 is shown the entertainment offering he has just selected using the electronic data glasses 3.
- the motor vehicle 1 drives fully autonomously on a very hilly and curvy route 5.
- the vehicle occupant 2 was offered the entertainment offering that best suits a particularly curvy and hilly route, for example because the entertainment offering is a virtual space battle, in which the vehicle occupant 2 can see many virtual images when the electronic data glasses 3 are on He performs downward and sideways movements, for example because he is carrying out the space battle in question with his virtual space glider.
- a duration is also possible for a duration to be determined for the goal and the entertainment offerings to be offered for playback with the electronic data glasses 3 depending on the determined duration. If, for example, it is clear that the vehicle occupant 2 will only spend a few minutes in the motor vehicle 1 before reaching the destination, those entertainment offers are preferably displayed at the top or first in a list, for example, which do not require a particularly long entertainment period per se.
- the vehicle occupant 2 it is also possible to query how long the vehicle occupant 2 actually wants to be entertained, with the entertainment offerings being offered for playback with the electronic data glasses 3 depending on the specified entertainment duration. For example, it is also possible for the vehicle occupant 2 to know from the outset - i.e. before starting the journey - that he does not want to spend the entire journey time being entertained using the electronic data glasses 3, for example because he has other people during the journey Things like making phone calls or the like. In this case, it is particularly advantageous if it is asked how long the vehicle occupant 2 actually wants to be entertained using the electronic data glasses 3. Tailored to this query, those entertainment offers can then be preferred, for example optically marked or otherwise marked, so that the vehicle occupant 2 is not embarrassed from the outset by selecting entertainment offers that are far too long.
- the specified entertainment duration desired by the vehicle occupant 2 is shorter than a predicted travel time along the route 5 to a specific destination, a most suitable section of the traveled route 5 for reproducing one of the Entertainment options are selected.
- the route 5, for example initially runs along a motorway, which has fewer curves and a very flat profile, whereas during a middle section of the route 5, for example, a mountain pass is driven over, which has a serpentine route includes. If, for example, a very specific entertainment offer fits particularly well with this serpentine route, the electronic data glasses 3 are controlled in such a way that as soon as the serpentine route begins, the appropriate entertainment offer is played.
- the electronic data glasses 2 and the control device 4 together form a display device 7 for the motor vehicle 1.
- this display device 7 it is possible, in the manner explained, to prepare the entertainment offers that are particularly suitable for certain routes and which can be played using the electronic data glasses 3 to offer the vehicle occupant 2 that he can directly recognize which of the available entertainment offers fit particularly well with the respective routes of routes 5 that are still to be traveled.
- both virtual and augmented content can be played back particularly realistically while driving the motor vehicle 1.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- General Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Automation & Control Theory (AREA)
- Environmental & Geological Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Navigation (AREA)
Description
Die Erfindung betrifft ein Verfahren zum Betreiben wenigstens einer elektronischen Datenbrille in einem Kraftfahrzeug und eine Anzeigevorrichtung für ein Kraftfahrzeug. Des Weiteren betrifft die Erfindung auch ein Kraftfahrzeug mit einer solchen Anzeigevorrichtung.The invention relates to a method for operating at least one electronic data glasses in a motor vehicle and a display device for a motor vehicle. Furthermore, the invention also relates to a motor vehicle with such a display device.
Die Unterhaltung von Fahrzeuginsassen, insbesondere mittels verschiedener medialer Inhalte, wird unter anderem aufgrund der sehr wahrscheinlich zukünftigen Verbreitung von autonom fahrenden Fahrzeugen einen immer größeren Stellenwert einnehmen. Zur Unterhaltung von Fahrzeuginsassen gibt es schon vielfältige Ansätze.The entertainment of vehicle occupants, especially through various media content, will become increasingly important, among other things due to the very likely future spread of autonomous vehicles. There are already a variety of approaches to entertaining vehicle occupants.
So zeigt die
Die
Die
In der
Die
Es ist die Aufgabe der vorliegenden Erfindung, eine Lösung bereitzustellen, mittels welcher besonders realistisch anmutende Unterhaltungsangebote mittels wenigstens einer elektronischen Datenbrille in einem Kraftfahrzeug wiedergegeben werden können.It is the object of the present invention to provide a solution by means of which particularly realistic-looking entertainment offers can be reproduced in a motor vehicle using at least one pair of electronic data glasses.
Diese Aufgabe wird durch ein Verfahren zum Betreiben wenigstens einer elektronischen Datenbrille in einem Kraftfahrzeug sowie durch eine Anzeigevorrichtung für ein Kraftfahrzeug mit den Merkmalen der unabhängigen Patentansprüche gelöst. Vorteilhafte Ausgestaltungen mit zweckmäßigen und nicht-trivialen Weiterbildungen der Erfindung sind in den abhängigen Ansprüchen angegeben.This object is achieved by a method for operating at least one electronic data glasses in a motor vehicle and by a display device for a motor vehicle with the features of the independent patent claims. Advantageous embodiments with useful and non-trivial developments of the invention are specified in the dependent claims.
Bei dem erfindungsgemäßen Verfahren zum Betreiben wenigstens einer elektronischen Datenbrille in einem Kraftfahrzeug werden mehrere unterschiedliche Unterhaltungsangebote, welche mittels der elektronischen Datenbrille wiedergebbar sind, bereitgestellt. Bei den Unterhaltungsangeboten kann es sich beispielsweise um virtuelle Experiences handeln, bei denen man sich in einem zur Fahrbewegung des Kraftfahrzeugs passenden Kontext bewegt. So kann man beispielsweise virtuell über eine Planetenoberfläche fliegen. Fährt das Kraftfahrzeug eine Kurve, so wird diese Bewegung auch in der angezeigten virtuellen Welt, also während des Flugs über die Planetenoberfläche, wiedergegeben, sodass die auf den Träger der elektronischen Datenbrille wirkenden realen Kräfte mit dem virtuell Erlebten übereinstimmen. Genauso können die Unterhaltungsangebote auch Filme oder dergleichen umfassen.In the method according to the invention for operating at least one electronic data glasses in a motor vehicle, several different entertainment offerings, which can be played back using the electronic data glasses, are provided. The entertainment offers can, for example, be virtual experiences in which you move in a context that matches the driving movement of the motor vehicle. For example, you can fly virtually over a planet's surface. If the motor vehicle drives a curve, this movement is also reflected in the displayed virtual world, i.e. during the flight over the planet's surface, so that the real forces acting on the wearer of the electronic data glasses correspond to what is experienced virtually. Likewise, the entertainment offerings can also include films or the like.
Der Erfindung liegt die Erkenntnis zugrunde, dass diese unterschiedlichen Unterhaltungsangebote beziehungsweise Unterhaltungsformate bei unterschiedlichen Streckencharakteristika mal besser und mal schlechter funktionieren. Beispielsweise wird sich eine virtuelle Raumschlacht zum Beispiel auf einer kurvigen Bergstrecke natürlicher beziehungsweise authentischer anfühlen als auf einer langgezogenen und ebenen Autobahnstrecke. Will man hingegen einen Kinofilm in einem virtuellen Kino mittels der elektronischen Datenbrille schauen, wäre eher eine langgestreckte kurvenarme und ebene Strecke gegebenenfalls vorteilhaft.The invention is based on the knowledge that these different entertainment offers or entertainment formats sometimes work better and sometimes worse with different route characteristics. For example, a virtual space battle will feel more natural or authentic on a winding mountain road than on a long, flat stretch of highway. However, if you want to watch a movie in a virtual cinema using electronic data glasses, an elongated, flat route with few curves would be more advantageous.
Bei dem erfindungsgemäßen Verfahren ist es daher vorgesehen, zu analysieren, wie gut eine Streckenführung einer bevorstehenden Strecke zu einem Ziel und/oder wie gut die jeweilige Streckenführung eines Straßennetzes im Umfeld des Kraftfahrzeugs zu den bereitgestellten Unterhaltungsangeboten passen. Für eine bevorstehende Strecke, oder falls diese nicht bekannt sein sollte, für eine umliegende Verkehrsnetzcharakteristik geeignete Unterhaltungsangebote können so besonders gut herausgefiltert und angeboten werden. Unter der Streckenführung ist insbesondere zu verstehen, wie kurvig und hügelig eine bestimmte Strecke beziehungsweise ein Straßennetz ist.In the method according to the invention, it is therefore provided to analyze how well a route of an upcoming route to a destination and/or how well the respective route of a road network in the area surrounding the motor vehicle fits the entertainment offerings provided. Entertainment offers suitable for an upcoming route, or if this is not known, for a surrounding transport network characteristic, can be filtered out and offered particularly well. The route refers in particular to how curvy and hilly a particular route or road network is.
Nachdem die Analyse erfolgt ist, wie gut eine Streckenführung der bevorstehenden Strecke zu einem Ziel und/oder wie gut jeweilige Streckenführungen des betreffenden Straßennetzes im Umfeld des Kraftfahrzeuges zu den bereitgestellten Unterhaltungsangeboten passen, werden die Unterhaltungsangebote in Abhängigkeit von der Analyse zur Wiedergabe mit der elektronischen Datenbrille angeboten.After the analysis has been carried out as to how well a route of the upcoming route to a destination and/or how well respective routes of the relevant road network in the area surrounding the motor vehicle match the entertainment offers provided, the entertainment offers are then played back with the electronic data glasses depending on the analysis offered.
Beispielsweise kann die elektronischen Datenbrille direkt oder auch das Kraftfahrzeug mit einem fahrzeuginternen oder fahrzeugexternen Navigationssystem verbunden sein. Auf diese Weise ist es möglich, die Streckenführung der bevorstehenden Strecke und/oder jeweilige Streckenführungen des Straßennetzes im Umfeld des Kraftfahrzeugs zu analysieren und mit den bereitgestellten Unterhaltungsangeboten abzugleichen. Ist aus der Analyse beispielsweise ersichtlich, dass das Kraftfahrzeug zur Erreichung eines bestimmten Ziels eine sehr kurvige und hügelige Strecke fahren wird, so werden diejenigen Unterhaltungsangebote als besonders gut passend bewertet, bei welchen ein besonders starkes Auf und Ab und Seitwärtsbewegungen vorteilhaft wären. Wird hingegen festgestellt, dass die vorstehende Strecke beispielsweise entlang einer sehr ebenen Fläche verläuft und zudem sehr wenige Kurven aufweist, so werden diejenigen Unterhaltungsangebote als besonders passend bewertet, bei welchen weniger Auf- und Abbewegungen und weniger Seitwärtsbewegungen vorteilhaft wären.For example, the electronic data glasses can be connected directly or the motor vehicle can be connected to a vehicle-internal or vehicle-external navigation system. In this way, it is possible to analyze the route of the upcoming route and/or the respective route of the road network in the area surrounding the motor vehicle and compare it with the entertainment offerings provided. For example, it is clear from the analysis that the motor vehicle is used to achieve a specific goal If the destination is a very curvy and hilly route, those entertainment options are rated as particularly suitable for which particularly strong ups and downs and sideways movements would be advantageous. If, on the other hand, it is determined that the above route runs, for example, along a very flat surface and also has very few curves, those entertainment offers are rated as particularly suitable in which fewer up and down movements and fewer sideways movements would be advantageous.
Der Benutzer der elektronischen Datenbrille bekommt entweder direkt mittels der elektronischen Datenbrille, genauer mittels entsprechender Anzeigemittel der elektronischen Datenbrille, oder bei abgesetzter elektronischer Datenbrille beispielsweise über eine fahrzeugseitige Anzeigeeinrichtung das Analyseergebnis präsentiert, indem die Unterhaltungsangebote in Abhängigkeit von der Analyse entsprechend angezeigt werden. Der Benutzer der elektronischen Datenbrille kann also noch bevor er seine Strecke zum Ziel abfährt und/oder eine Strecke entlang des Straßennetzes im Umfeld des Kraftfahrzeugs abfährt, ganz klar erkennen, wie gut die verschiedenen zur Verfügung stehenden Unterhaltungsangebote zu der von ihm und/oder von einem Navigationssystem geplanten Route passen. Infolgedessen kann der Benutzer der elektronischen Datenbrille die zur Streckenführung am besten passenden Unterhaltungsangebote beziehungsweise das am besten passende Unterhaltungsangebot auswählen. Dadurch ergibt sich eine besonders realistisch anmutende Wahrnehmung der betreffenden Unterhaltungsangebote bei aufgesetzter elektronischer Datenbrille im Kraftfahrzeug, da mit den Augen und dem Gleichgewichtssinn wahrgenommene Reize sehr gut übereinstimmen. Dadurch kann neben dem reinen Genuss der dadurch besonders realistisch anmutenden Unterhaltungsangebote auch verhindert werden, dass dem Träger der elektronischen Datenbrille übel wird. Denn die beschriebenen Vorgehensweise verhindert auch die sogenannte Simulator und Motion Sickness.The user of the electronic data glasses is presented with the analysis result either directly using the electronic data glasses, more precisely by means of the corresponding display means of the electronic data glasses, or when the electronic data glasses are removed, for example via a vehicle-side display device, in which the entertainment offers are displayed accordingly depending on the analysis. The user of the electronic data glasses can therefore clearly see how well the various entertainment options available relate to that of him and/or himself, even before he drives his route to the destination and/or drives along a route along the road network in the vicinity of the motor vehicle route planned on the navigation system. As a result, the user of the electronic data glasses can select the entertainment offerings that best suit the route or the entertainment offering that best suits the route. This results in a particularly realistic-looking perception of the entertainment offerings in question when electronic data glasses are attached in the motor vehicle, since stimuli perceived by the eyes and the sense of balance correspond very well. In addition to the pure enjoyment of the particularly realistic-looking entertainment offers, this can also prevent the wearer of the electronic data glasses from becoming sick. The procedure described also prevents so-called simulator and motion sickness.
Eine vorteilhafte Ausführungsform der Erfindung sieht vor, dass das Anbieten der Unterhaltungsangebote dadurch erfolgt, dass ein jeweiliges Ergebnis der Analyse zugeordnet zu den angebotenen Unterhaltungsformen angezeigt wird. Beispielsweise kann eine Bewertungspunktzahl oder dergleichen neben den jeweiligen zur Verfügung gestellten Unterhaltungsangeboten eingeblendet werden. So kann der Benutzer der elektronischen Datenbrille auf einfache Weise das Analyseergebnis erkennen und - sofern er denn möchte - beispielsweise das am besten bewertete beziehungsweise am besten analysierte Unterhaltungsangebot auswählen.An advantageous embodiment of the invention provides that the entertainment offers are offered by a respective result of the Analysis assigned to the forms of entertainment offered is displayed. For example, a rating score or the like can be displayed next to the respective entertainment offerings provided. In this way, the user of the electronic data glasses can easily recognize the analysis result and - if he wants - select, for example, the best-rated or best-analyzed entertainment offer.
Eine weitere vorteilhafte Ausführungsform der Erfindung sieht vor, dass das Anbieten der Unterhaltungsangebote dadurch erfolgt, dass die Unterhaltungsangebote entsprechend ihres jeweiligen Ergebnisses der Analyse in einer Reihenfolge, vorzugsweise absteigend beginnend vom besten Ergebnis der Analyse, sortiert angezeigt werden. Auf diese Weise kann der Benutzer der elektronischen Datenbrille auf besonders einfache Weise erkennen, welches der angebotenen Unterhaltungsangebote am besten zur vor ihm liegenden Strecke passt. An sich ist es auch möglich, dass nach der Analyse, wie gut die Streckenführung der bevorstehenden Strecke zum Ziel und/oder wie gut jeweilige Streckenführungen des Straßennetzes im Umfeld des Kraftfahrzeugs zu den bereitgestellten Unterhaltungsangeboten passen, diejenigen Unterhaltungsangebote herausgefiltert und gar nicht angeboten werden, bei welchen anhand des Analyseergebnisses klar ist, dass die Übereinstimmung zwischen den betreffenden Unterhaltungsangeboten und den jeweiligen Streckenführungen so schlecht ist, dass dies zu einer besonders schlechten Userexperience führen würde. In diesem Zusammenhang ist es auch möglich, dass der Benutzer der elektronischen Datenbrille auswählen kann, ob er diese Filterfunktion haben möchte oder stattdessen lieber doch alle grundsätzlich möglichen Unterhaltungsangebote angezeigt bekommen möchte.A further advantageous embodiment of the invention provides that the entertainment offerings are offered by displaying the entertainment offerings sorted according to their respective analysis results in an order, preferably in descending order starting from the best result of the analysis. In this way, the user of the electronic data glasses can see in a particularly simple way which of the entertainment options on offer best suits the route ahead. In itself, it is also possible that after analyzing how well the route of the upcoming route to the destination and/or how well the respective routes of the road network in the area surrounding the motor vehicle match the entertainment offers provided, those entertainment offers are filtered out and not offered at all which, based on the analysis results, it is clear that the correspondence between the entertainment offerings in question and the respective routes is so poor that this would lead to a particularly poor user experience. In this context, it is also possible for the user of the electronic data glasses to be able to choose whether he would like to have this filter function or would instead prefer to be shown all basically possible entertainment offers.
In weiterer vorteilhafter Ausgestaltung der Erfindung ist es vorgesehen, dass eine Dauer zum Ziel ermittelt und die Unterhaltungsangebote in Abhängigkeit von der ermittelten Dauer zur Wiedergabe mit der elektronischen Datenbrille angeboten werden. Ist beispielsweise anhand der Benutzereingabe klar, dass er nur 15 bis 20 Minuten fahren wird, so kann er beispielsweise bevorzugt entsprechend kurze Unterhaltungsformate beziehungsweise Unterhaltungsangebote zuerst oder überhaupt angezeigt beziehungsweise angeboten bekommen. Ist hingegen klar, dass der Benutzer eine sehr lange Strecke fahren wird, beispielsweise zwei oder mehr Stunden unterwegs sein wird, so können auch bevorzugt solche Unterhaltungsangebote zur Auswahl durch den Benutzer angezeigt werden, welche eine ebenso lange Dauer aufweisen. In Kenntnis der Dauer zum Ziel können also beispielsweise diejenigen Unterhaltungsangebote vorgefiltert werden, welche hinsichtlich ihrer Länge der Darbietung besonders geeignet sind, da sie mit der Dauer zum Ziel eine besonders große Übereinstimmung aufweisen.In a further advantageous embodiment of the invention, it is provided that a duration for the target is determined and the entertainment offers are offered for playback with the electronic data glasses depending on the determined duration. For example, if it is clear from the user input that he will only drive for 15 to 20 minutes, he can, for example, give preference Correspondingly short entertainment formats or entertainment offers are displayed or offered first or at all. If, on the other hand, it is clear that the user will be driving a very long distance, for example two or more hours, entertainment offers that have an equally long duration can also preferably be displayed for the user to select. Knowing the duration of the target, for example, those entertainment offers can be pre-filtered which are particularly suitable in terms of the length of the presentation, since they have a particularly close correspondence with the duration of the target.
Gemäß einer weiteren vorteilhaften Ausführungsform der Erfindung ist es vorgesehen, dass abgefragt wird, wie lange ein Benutzer der elektronischen Datenbrille unterhalten werden möchte, und die Unterhaltungsangebote in Abhängigkeit von einer angegebenen Unterhaltungsdauer zur Wiedergabe mittels der elektronischen Datenbrille angeboten werden. So kann es beispielsweise sein, dass der Benutzer der elektronischen Datenbrille gar nicht vor hat, die gesamte Fahrzeit für den Genuss beziehungsweise Konsum von Unterhaltungsangeboten zu nutzen. In dem Fall kann es besonders vorteilhaft sein, wenn der Benutzer der elektronischen Datenbrille einfach angeben kann, wie lange er überhaupt unterhalten werden möchte, wobei passend dazu die entsprechenden Unterhaltungsangebote zur Auswahl bereitgestellt werden. So kann es beispielsweise sein, dass der Benutzer der elektronischen Datenbrille weiß, dass er während der Fahrt auch noch geschäftliche Telefonate führen möchte, sodass er lediglich für die dann noch verbleibende Zeitdauer eines der Unterhaltungsangebote nutzen mag. In einem solchen Fall kann es sehr vorteilhaft sein, wenn die zur Auswahl angebotenen Unterhaltungsangebote auch mit der geplanten Nutzungsdauer möglichst gut übereinstimmen.According to a further advantageous embodiment of the invention, it is provided that a query is made as to how long a user of the electronic data glasses would like to be entertained, and the entertainment offers are offered for playback using the electronic data glasses depending on a specified entertainment duration. For example, it may be that the user of the electronic data glasses does not intend to use the entire driving time to enjoy or consume entertainment offers. In this case, it can be particularly advantageous if the user of the electronic data glasses can simply indicate how long he or she would like to be entertained, with the appropriate entertainment offerings being made available for selection. For example, it may be that the user of the electronic data glasses knows that he would like to make business calls while driving, so that he only wants to use one of the entertainment offers for the remaining period of time. In such a case, it can be very advantageous if the entertainment options offered correspond as closely as possible to the planned period of use.
In weiterer vorteilhafter Ausgestaltung der Erfindung ist es vorgesehen, dass, falls die angegebene Unterhaltungsdauer kürzer als eine Fahrdauer mit dem Kraftfahrzeug ist, ein am besten geeigneter Abschnitt einer befahrenen Strecke zur Wiedergabe von einem der Unterhaltungsangebote ausgewählt wird.In a further advantageous embodiment of the invention, it is provided that if the specified entertainment duration is shorter than a journey time with the motor vehicle, a most suitable section of a route traveled is selected for playback of one of the entertainment offerings.
An dieser Stelle kann dann wiederum die zuvor bereits erwähnte Analyse greifen, mittels welcher ermittelt wird, wie gut beispielsweise die Streckenführung der bevorstehenden Strecke zu einem Ziel passt, um dann den am besten geeigneten Abschnitt der befahrenen Strecke zur Wiedergabe von einem der Unterhaltungsangebote auszuwählen. So kann beispielsweise der Streckenabschnitt ausgewählt werden, welcher besonders hügelig ist und auch eine besonders kurvige Streckenführung aufweist, wenn dies besonders gut zu einem der Unterhaltungsangebote passen sollte. Ein umgekehrtes Vorgehen ist natürlich auch möglich, sodass beispielsweise ein Abschnitt der Strecke gewählt wird, welcher besonders wenige Kurven aufweist, wenn dies besonders gut zu einem der Unterhaltungsangebote passen sollte.At this point, the previously mentioned analysis can then come into play, by means of which it is determined how well, for example, the route of the upcoming route fits a destination, in order to then select the most suitable section of the route traveled for playback of one of the entertainment offerings. For example, you can select the section of route that is particularly hilly and also has a particularly curvy route if this fits particularly well with one of the entertainment offerings. A reverse approach is of course also possible, so that, for example, a section of the route is chosen that has a particularly few curves if this fits particularly well with one of the entertainment offerings.
Die erfindungsgemäße Anzeigevorrichtung für ein Kraftfahrzeug umfasst wenigstens eine elektronische Datenbrille zum Wiedergeben unterschiedlicher Unterhaltungsangebote sowie eine Steuereinrichtung, welche dazu eingerichtet ist, die Unterhaltungsangebote bereitzustellen und zu analysieren, wie gut eine Streckenführung einer bevorstehenden Strecke zu einem Ziel und/oder wie gut die jeweiligen Streckenführungen eines Straßennetzes im Umfeld des Kraftfahrzeugs zu den bereitgestellten Unterhaltungsangeboten passen, sowie die Unterhaltungsangebote in Abhängigkeit von der Analyse zur Wiedergabe mit der elektronischen Datenbrille anzubieten. Die Steuereinrichtung kann dabei Teil der elektronischen Datenbrille oder auch beispielsweise Teil eines Infotainmentsystems des Kraftfahrzeugs sein. So ist es beispielsweise möglich, dass die elektronische Datenbrille über eine geeignete Kommunikationsschnittstelle verfügt, über welche unterschiedliche Unterhaltungsangebote beispielsweise von einem fahrzeugexternen Server heruntergeladen und somit bereitgestellt werden können. Genauso gut ist es auch möglich, dass das Kraftfahrzeug eine geeignete Kommunikationsschnittstelle aufweist, über welche unterschiedliche Unterhaltungsangebote heruntergeladen oder zur Auswahl bereitgestellt werden können. Vorteilhafte Ausgestaltungen dieses erfindungsgemäßen Verfahrens sind als vorteilhafte Ausgestaltungen der erfindungsgemäßen Anzeigevorrichtung und umgekehrt anzusehen, wobei die Anzeigevorrichtung insbesondere Mittel zur Durchführung der Verfahrensschritte aufweist.The display device according to the invention for a motor vehicle comprises at least one electronic data glasses for reproducing different entertainment offers and a control device which is set up to provide the entertainment offers and to analyze how well a route of an upcoming route to a destination and / or how well the respective routes of a Road network in the vicinity of the motor vehicle match the entertainment offers provided, as well as offer the entertainment offers depending on the analysis for playback with the electronic data glasses. The control device can be part of the electronic data glasses or, for example, part of an infotainment system of the motor vehicle. For example, it is possible for the electronic data glasses to have a suitable communication interface via which different entertainment offerings can be downloaded, for example, from a server external to the vehicle and thus made available. It is also possible for the motor vehicle to have a suitable communication interface via which different entertainment offerings can be downloaded or made available for selection. Advantageous embodiments of this method according to the invention are to be viewed as advantageous embodiments of the display device according to the invention and vice versa, with the display device in particular having means for carrying out the method steps.
Eine vorteilhafte Ausführungsform der Anzeigevorrichtung sieht vor, dass die elektronische Datenbrille eine Virtual Reality Brille oder eine Augmented Reality Brille ist. In ersterem Fall kann der Benutzer der elektronischen Datenbrille vollständig in virtuelle Welten während der Fahrt mit dem Kraftfahrzeug abtauchen, da er durch die Virtual Reality Brille visuell vollständig von seiner realen Umgebung abgeschottet wird. Falls die elektronische Datenbrille eine Augmented Reality Brille ist, kann der Benutzer der elektronischen Datenbrille die reale Umwelt noch sehen, wobei die Augmented Reality Brille diese mit zusätzlichen virtuellen Inhalten überlagert. Diese Überlagerung der Realität mit virtuellen Inhalten hängt dann von dem durch den Benutzer gewählten Unterhaltungsangebot ab. Es ist auch denkbar, dass die wenigstens eine elektronische Datenbrille dazu ausgebildet ist, sowohl als Virtual Reality Brille als auch als Augmented Reality Brille zu fungieren, also eine Art Hybrid darstellt.An advantageous embodiment of the display device provides that the electronic data glasses are virtual reality glasses or augmented reality glasses. In the first case, the user of the electronic data glasses can completely immerse themselves in virtual worlds while driving the motor vehicle, as the virtual reality glasses completely visually isolate them from their real surroundings. If the electronic data glasses are augmented reality glasses, the user of the electronic data glasses can still see the real environment, with the augmented reality glasses overlaying this with additional virtual content. This overlay of reality with virtual content then depends on the entertainment offering chosen by the user. It is also conceivable that the at least one electronic data glasses are designed to function both as virtual reality glasses and as augmented reality glasses, i.e. to represent a kind of hybrid.
Das erfindungsgemäße Kraftfahrzeug umfasst die erfindungsgemäße Anzeigevorrichtung oder eine vorteilhafte Ausführungsform der erfindungsgemäßen Anzeigevorrichtung.The motor vehicle according to the invention comprises the display device according to the invention or an advantageous embodiment of the display device according to the invention.
Weitere Vorteile, Merkmale und Einzelheiten der Erfindung ergeben sich aus der nachfolgenden Beschreibung bevorzugter Ausführungsbeispiele sowie anhand der Zeichnung. Die vorstehend in der Beschreibung genannten Merkmale und Merkmalskombinationen sowie die nachfolgend in der Figurenbeschreibung und/oder in der Figur alleine gezeigten Merkmale und Merkmalskombinationen sind nicht nur in der jeweils angegebenen Kombination, sondern auch in anderen Kombinationen oder in Alleinstellung verwendbar, ohne den Rahmen der Erfindung zu verlassen.Further advantages, features and details of the invention result from the following description of preferred exemplary embodiments and from the drawing. The features and combinations of features mentioned above in the description as well as the features and combinations of features shown below in the description of the figures and/or in the figure alone can be used not only in the combination specified in each case, but also in other combinations or on their own, without the scope of the invention to leave.
Die Zeichnung zeigt in der einzigen Figur eine stark schematisierte Darstellung eines Kraftfahrzeugs, in welchem ein Benutzer sitzt, der eine elektronische Datenbrille trägt, mittels welcher unterschiedlichste Unterhaltungsangebote während der Fahrt mit dem Kraftfahrzeug wiedergegeben werden können.In the single figure, the drawing shows a highly schematic representation of a motor vehicle in which a user sits who is wearing electronic data glasses, by means of which a wide variety of entertainment offers can be played while driving the motor vehicle.
Ein Kraftfahrzeug 1 ist in einer stark schematisierten Darstellung in der einzigen Figur gezeigt. In dem Kraftfahrzeug 1 sitzt ein Fahrzeuginsasse 2, der eine elektronische Datenbrille 3, beispielsweise in Form einer Virtual Reality Brille oder auch in Form einer Augmented Reality Brille, aufgesetzt hat. Zudem ist noch eine Steuereinrichtung 4 schematisch angedeutet, welche dazu eingerichtet ist, unterschiedlichste Unterhaltungsangebote bereitzustellen und zu analysieren, wie gut eine Streckenführung einer bevorstehenden Strecke 5 zu einem Ziel und/oder wie gut jeweilige Streckenführungen eines Straßennetzes im Umfeld 6 des Kraftfahrzeugs 1 zu bereitgestellten Unterhaltungsangeboten passen, sowie die Unterhaltungsangebote in Abhängigkeit von der Analyse zur Wiedergabe mit der elektronischen Datenbrille 2 anzubieten.A
Die Steuereinrichtung 4 kann beispielsweise Bestandteil der elektronischen Datenbrille 2 sein. Genauso gut ist es auch möglich, dass die Steuereinrichtung 4 Teil eines fahrzeugseitigen Infotainmentsystems des Kraftfahrzeugs 1 ist.The
Falls es sich bei dem Fahrzeuginsassen 2 beispielsweise um den Fahrer des Kraftfahrzeugs 1 handelt, kann er die elektronische Datenbrille 3 insbesondere dann zu Unterhaltungszwecken nutzen, wenn das Kraftfahrzeug 1 gerade vollautonom fährt. Vor Fahrtantritt oder zumindest vor Nutzung der elektronischen Datenbrille 3 werden dem Fahrzeuginsassen 2 mittels der Steuereinrichtung 4 unterschiedliche Unterhaltungsangebote bereitgestellt, welche mittels der elektronischen Datenbrille 3 wiedergegeben werden können. Die Steuereinrichtung 4 analysiert, wie gut die Streckenführung der bevorstehenden Strecke 5 zu einem bestimmten Ziel zu den bereitgestellten Unterhaltungsangeboten passt. Hat der Fahrzeuginsasse 2 beispielsweise zuvor ein bestimmtes Ziel, wie beispielsweise einen Arbeitsweg oder dergleichen, eingegeben, so kann zum Beispiel ein hier nicht dargestelltes Navigationssystem des Kraftfahrzeugs 1 die entsprechende Strecke 5 zur Zielerreichung ermitteln und Informationen über die Streckenführung der Strecke 5 an die Steuereinrichtung 4 übermitteln. Diese kann dann wiederum analysieren, wie gut die Streckenführung der bevorstehenden Strecke 5 zu unterschiedlichsten, zur Verfügung stehenden Unterhaltungsangeboten, wie beispielsweise virtuellen Computerspielen, Kinofilmen und dergleichen passt.If the
Für den Fall, dass die konkrete Strecke 5 überhaupt noch nicht feststehen sollte, ist es auch möglich, dass die Steuereinrichtung 4 analysiert, wie gut jeweilige Streckenführungen eines hier nicht näher dargestellten Straßennetzes im Umfeld 6 des Kraftfahrzeugs 1 zu den bereitgestellten Unterhaltungsangeboten passen. So oder so werden die bereitgestellten Unterhaltungsangebote in Abhängigkeit von der Analyse zur Wiedergabe mit der elektronischen Datenbrille 3 angeboten.In the event that the
Das Anbieten der Unterhaltungsangebote kann beispielsweise dadurch erfolgen, dass ein jeweiliges Ergebnis der Analyse zugeordnet zu den angebotenen Unterhaltungsformen angezeigt wird. Besonders gut kann der Fahrzeuginsasse 2 erkennen, welche der zur Verfügung stehenden Unterhaltungsangebote besonders gut beispielsweise zur Streckenführung der Strecke 5 passen, wenn die Unterhaltungsangebote entsprechend ihres jeweiligen Ergebnisses der zuvor genannten Analyse in einer ganz bestimmten Reihenfolge, vorzugsweise absteigend beginnend vom besten Ergebnis der Analyse, sortiert angezeigt werden. Diese Anzeige kann beispielsweise mittels der elektronischen Datenbrille 3 und/oder mittels einer Anzeigeeinrichtung im Kraftfahrzeug 1, beispielsweise mittels eines Displays im Bereich einer Mittelkonsole oder dergleichen, erfolgen.The offering of entertainment can be done, for example, by displaying a respective result of the analysis associated with the forms of entertainment offered. The
Der Fahrzeuginsasse 2 kann also ganz einfach erkennen, welche der grundsätzlich zur Verfügung stehenden Unterhaltungsangebote am besten beispielsweise zum Streckenverlauf der noch vor ihm liegenden Strecke 5 passen. Nachdem der Fahrzeuginsasse 2 eines der zur Verfügung stehenden und angebotenen Unterhaltungsangebote ausgewählt hat, kann er sich beispielsweise entspannt zurücklehnen, während das Kraftfahrzeug 1 vollautonom die Strecke 5 entlang fährt und der Fahrzeuginsasse 2 mittels der elektronischen Datenbrille 3 das von ihm gerade ausgewählte Unterhaltungsangebot wiedergegeben bekommt.The
Zum Beispiel ist es denkbar, dass das Kraftfahrzeug 1 vollautonom eine sehr hügelige und kurvige Strecke 5 befährt. Passend dazu wurde dem Fahrzeuginsassen 2 dasjenige Unterhaltungsangebot angeboten, welches am besten zu einer besonders kurvigen und hügeligen Streckenführung passt, beispielsweise weil es sich bei dem Unterhaltungsangebot um eine virtuelle Raumschlacht handelt, bei welcher der Fahrzeuginsasse 2 bei aufgesetzter elektronischer Datenbrille 3 viele virtuelle Auf- und Abbewegungen sowie Seitwärtsbewegungen vollführt, weil er beispielsweise mit seinem virtuellem Raumgleiter die besagte Raumschlacht vollführt. Dadurch, dass die Streckenführung der Strecke 5 besonders gut zur virtuellen Erfahrung passt, welche mittels des ausgewählten Unterhaltungsangebots wiedergegeben wird, ergibt sich eine besonders realistische Anmutung, beispielsweise eines Computerspiels in Form der virtuellen Raumschlacht, wenn diese mittels der elektronischen Datenbrille 3 wiedergegeben wird.For example, it is conceivable that the
Zudem ist es auch möglich, dass eine Dauer zum Ziel ermittelt und die Unterhaltungsangebote in Abhängigkeit von der ermittelten Dauer zur Wiedergabe mit der elektronischen Datenbrille 3 angeboten werden. Ist so beispielsweise klar, dass der Fahrzeuginsasse 2 nur wenige Minuten bis zur Zielerreichung im Kraftfahrzeug 1 verbringen wird, so werden bevorzugt diejenigen Unterhaltungsangebote beispielsweise in einer Auflistung zuoberst beziehungsweise zuerst angezeigt, welche keine besonders lange Unterhaltungsdauer an sich benötigen.In addition, it is also possible for a duration to be determined for the goal and the entertainment offerings to be offered for playback with the
Zudem ist es auch möglich, dass abgefragt wird, wie lange der Fahrzeuginsasse 2 überhaupt unterhalten werden möchte, wobei die Unterhaltungsangebote in Abhängigkeit von der angegebenen Unterhaltungsdauer zur Wiedergabe mit der elektronischen Datenbrille 3 angeboten werden. So ist es beispielsweise auch möglich, dass der Fahrzeuginsasse 2 von vornherein - also noch vor Fahrtantritt - weiß, dass er gar nicht die gesamte Fahrzeit dafür verwenden möchte, sich mittels der elektronischen Datenbrille 3 unterhalten zu lassen, beispielsweise weil er während der Fahrt noch andere Dinge, wie beispielsweise Telefonate oder dergleichen erledigen möchte. In dem Fall ist es besonders vorteilhaft, wenn abgefragt wird, wie lange der Fahrzeuginsasse 2 überhaupt mittels der elektronischen Datenbrille 3 unterhalten werden möchte. Abgestimmt auf diese Abfrage können dann diejenigen Unterhaltungsangebote bevorzugt, beispielsweise optisch markiert oder anderweitig gekennzeichnet, angeboten werden, sodass der Fahrzeuginsasse 2 von vornherein gar nicht in die Verlegenheit gerät, viel zu lange Unterhaltungsangebote auszuwählen.In addition, it is also possible to query how long the
Zudem ist es auch möglich, dass, falls die angegebene Unterhaltungsdauer, welche von dem Fahrzeuginsassen 2 gewünscht wird, kürzer als eine vorhergesagte Fahrtdauer entlang der Strecke 5 zu einem bestimmten Ziel ist, ein am besten geeigneter Abschnitt der befahrenen Strecke 5 zur Wiedergabe von einem der Unterhaltungsangebote ausgewählt wird. So ist es beispielsweise bei einer längeren Fahrt insbesondere denkbar, dass die Strecke 5 zum Beispiel zunächst entlang einer Autobahn verläuft, welche weniger Kurven und ein sehr flaches Profil aufweist, wohingegen während eines mittleren Abschnitts der Strecke 5 beispielsweise ein Bergpass überfahren wird, welcher eine Serpentinenstrecke umfasst. Sollte beispielsweise ein ganz bestimmtes Unterhaltungsangebot besonders gut zu dieser Serpentinenstrecke passen, so wird die elektronische Datenbrille 3 so angesteuert, dass sobald die Serpentinenstrecke beginnt, das passende Unterhaltungsangebot eingespielt wird.In addition, it is also possible that if the specified entertainment duration desired by the
Die elektronische Datenbrille 2 und die Steuereinrichtung 4 bilden gemeinsam eine Anzeigevorrichtung 7 für das Kraftfahrzeug 1. Mittels dieser Anzeigevorrichtung 7 ist es in der erläuterten Weise möglich, die für bestimmte Streckenführungen besonders geeigneten Unterhaltungsangebote, welche mittels der elektronischen Datenbrille 3 wiedergegeben werden können, so aufbereitet dem Fahrzeuginsassen 2 anzubieten, dass dieser direkt erkennen kann, welche der an sich zur Verfügung stehenden Unterhaltungsangebote besonders gut zu jeweiligen Streckenführungen noch zu befahrender Strecken 5 passen. Infolgedessen können sowohl virtuelle als auch augmentierte Inhalte besonders realistisch während der Fahrt mit dem Kraftfahrzeug 1 wiedergegeben werden.The
Claims (6)
- A method for operating at least one pair of electronic data goggles (3) in a motor vehicle (1), comprising the steps:- providing multiple different entertainment offers, which can be rendered by means of the electronic data goggles (3);- analyzing how well a routing of an upcoming route (5) to a destination and/or how well respective routings of a road network in the environment (6) of the motor vehicle (1) match the provided entertainment offers;- offering the entertainment offers for rendering with the electronic data goggles (3) depending on the analysis, wherein offering the entertainment offers is effected in that a respective result of the analysis is displayed associated with the offered entertainment forms;wherein it is queried how long a user (2) of the electronic data goggles (3) wishes to be entertained, and the entertainment offers are offered depending on a specified entertainment duration for rendering with the electronic data goggles (3), wherein the entertainment offers offered for choice conform to the planned use duration as well as possible;wherein, if the specified entertainment duration is shorter than a travel duration with the motor vehicle (1), a section of a traveled route (5) best suitable with respect to the routing is selected for rendering one of the entertainment offers;wherein the entertainment offers are virtual experiences, in which the user (2) moves in a context matching a drive movement of the motor vehicle such that the real forces acting on the wearer of the electronic data goggles (3) conform to the virtual experience;wherein the routing of the upcoming route (5) and/or the respective routings of the road network in the environment (6) of the motor vehicle (1) are analyzed and correlated with the provided entertainment offers in that the electronic data goggles directly or also the motor vehicle connect to a navigation device internal to vehicle or external to vehicle;wherein, in case that the route (5) first runs along a highway, which has less curves and a very flat profile, whereas a mountain pass, which includes a serpentine route, is traveled during a middle section of the route (5), and a certain entertainment offer particularly well matches this serpentine route, the electronic data goggles (3) are controlled such that, as soon as the serpentine route begins, the matching entertainment offer is played.
- The method according to claim 1,
characterized in that
offering the entertainment offers is effected in that the entertainment offers are displayed sorted in an order corresponding to their respective result of the analysis, preferably descending beginning from the best result of the analysis. - The method according to any one of the preceding claims, characterized in that
a duration to the destination is ascertained and the entertainment offers are offered for rendering with the electronic data goggles (3) depending on the ascertained duration. - A display device (7) for a motor vehicle (1) comprising- at least one pair of electronic data goggles (3) for rendering different entertainment offers;- a control device (4), which is configured to provide the entertainment offers and to analyze how well a routing of an upcoming route (5) to a destination and/or how well respective routings of a road network in the environment of the motor vehicle (1) match the provided entertainment offers, as well as to offer the entertainment offers for rendering with the electronic data goggles (3) depending on the analysis in that it associates a respective result of the analysis and displays it to the offered entertainment forms, to query how long a user (2) of the electronic data goggles (3) wishes to be entertained, and to offer the entertainment offers for rendering with the electronic data goggles (3) depending on a specified entertainment duration, wherein the entertainment offers offered for choice conform to the planned use duration as well as possible; and if the specified entertainment duration is shorter than a travel duration with the motor vehicle (1), to select a section of a traveled route (5) best suitable with respect to the routing for rendering one of the entertainment offers;wherein the entertainment offers are virtual experiences, in which the user (2) moves in a context matching a drive movement of the motor vehicle, such that the real forces acting on the wearer of the electronic data goggles (3) conform to the virtual experience;wherein the control device (4) is further configured to analyze the routing of the upcoming route (5) and/or the respective routings of the road network in the environment (6) of the motor vehicle (1) and to correlate them with the provided entertainment offers in that the electronic data goggles directly or also the motor vehicle are connected to a navigation device internal to vehicle or external to vehicle,wherein the control device (4) is further configured, in case that the route (5) first runs along a highway, which has less curves and a very flat profile, whereas a mountain pass is traversed, which includes a serpentine route, during a middle section of the route (5), and a certain entertainment offer particularly well matches this serpentine route, to control the electronic data goggles (3) such that, as soon as the serpentine route begins, the matching entertainment offer is played.
- The display device (7) according to claim 4,
characterized in that
the electronic data goggles (3) are virtual-reality goggles or augmented-reality goggles. - A motor vehicle (1) with a display device (7) according to any one of claims 4 or 5.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102018201523.6A DE102018201523A1 (en) | 2018-02-01 | 2018-02-01 | Method for operating at least one electronic data goggles in a motor vehicle and display device for a motor vehicle |
PCT/EP2018/074168 WO2019149389A1 (en) | 2018-02-01 | 2018-09-07 | Method for operating at least one pair of electronic augmented reality glasses in a motor vehicle, and display device for a motor vehice |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3746835A1 EP3746835A1 (en) | 2020-12-09 |
EP3746835B1 true EP3746835B1 (en) | 2024-01-03 |
Family
ID=63557455
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18769128.2A Active EP3746835B1 (en) | 2018-02-01 | 2018-09-07 | Method for operating at least one pair of electronic augmented reality glasses in a motor vehicle, and display device for a motor vehice |
Country Status (5)
Country | Link |
---|---|
US (1) | US11262963B2 (en) |
EP (1) | EP3746835B1 (en) |
CN (1) | CN111670400B (en) |
DE (1) | DE102018201523A1 (en) |
WO (1) | WO2019149389A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102019135721A1 (en) | 2019-12-23 | 2021-06-24 | Holoride Gmbh | Method for controlling data glasses while driving a motor vehicle as well as display device, motor vehicle, analysis circuit and VR system |
DE102021118627A1 (en) | 2021-07-19 | 2023-01-19 | Bayerische Motoren Werke Aktiengesellschaft | Procedure for information displays in vehicles with autonomous driving function |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10156219C1 (en) * | 2001-11-15 | 2003-08-14 | Daimler Chrysler Ag | Motion sickness reduction method for persons travelling by air, sea or rail, involves modification of images provided by image reproduction devices for reducing perception of movement |
US9272708B2 (en) | 2013-09-30 | 2016-03-01 | Ford Global Technologies, Llc | Autonomous vehicle entertainment system |
US9335765B2 (en) | 2013-10-10 | 2016-05-10 | Ford Global Technologies, Llc | Autonomous vehicle media control |
US9145129B2 (en) * | 2013-10-24 | 2015-09-29 | Ford Global Technologies, Llc | Vehicle occupant comfort |
DE102014011278A1 (en) | 2014-07-29 | 2015-01-15 | Daimler Ag | A method for bridging a period during autonomous driving of a vehicle and a vehicle |
EP3227144B1 (en) | 2014-12-02 | 2019-07-24 | Safran Seats USA LLC | Headrest with integrated in-flight entertainment system |
DE102014019579B4 (en) | 2014-12-30 | 2016-12-08 | Audi Ag | System and method for operating a display device |
DE102015003948B4 (en) | 2015-03-26 | 2022-08-11 | Audi Ag | Method for operating virtual reality glasses and a virtual reality system arranged in a motor vehicle |
EP3079041B1 (en) | 2015-04-10 | 2018-06-27 | Airbus Defence and Space GmbH | Method and system for the production of a virtual reality environment for passengers of landcraft and aircraft |
GB2543560A (en) | 2015-10-22 | 2017-04-26 | Ford Global Tech Llc | A head up display |
CN107167147A (en) | 2017-05-02 | 2017-09-15 | 深圳市元征科技股份有限公司 | Air navigation aid, glasses and readable storage medium storing program for executing based on arrowband Internet of Things |
-
2018
- 2018-02-01 DE DE102018201523.6A patent/DE102018201523A1/en active Pending
- 2018-09-07 WO PCT/EP2018/074168 patent/WO2019149389A1/en unknown
- 2018-09-07 EP EP18769128.2A patent/EP3746835B1/en active Active
- 2018-09-07 US US16/966,622 patent/US11262963B2/en active Active
- 2018-09-07 CN CN201880088187.1A patent/CN111670400B/en active Active
Non-Patent Citations (1)
Title |
---|
ANONYMOUS: "Use advanced search in Video Manager - YouTube Help", 20 September 2015 (2015-09-20), INTERNET, XP055683829, Retrieved from the Internet <URL:https://web.archive.org/web/20150920014816/https://support.google.com/youtube/answer/2685977?hl=en> [retrieved on 20200407] * |
Also Published As
Publication number | Publication date |
---|---|
DE102018201523A1 (en) | 2019-08-01 |
CN111670400A (en) | 2020-09-15 |
US11262963B2 (en) | 2022-03-01 |
CN111670400B (en) | 2022-06-07 |
EP3746835A1 (en) | 2020-12-09 |
WO2019149389A1 (en) | 2019-08-08 |
US20210034314A1 (en) | 2021-02-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE102015013319B4 (en) | Method for operating a motor vehicle, motor vehicle and computer program | |
EP3695292B1 (en) | Method and system for operating at least a pair of virtual reality glasses in a motor vehicle | |
EP2340976B1 (en) | Method for operating a driver assistance system of a motor vehicle and motor vehicle | |
DE102015003882A1 (en) | Method for operating a arranged in a motor vehicle virtual reality glasses and virtual reality system | |
EP3571543B1 (en) | Entertainment system for a motor vehicle and method for operating an entertainment system | |
DE102016216601B4 (en) | A method for assisting a driver of a motor vehicle when driving on a racetrack, motor vehicle and computer program product | |
EP3746835B1 (en) | Method for operating at least one pair of electronic augmented reality glasses in a motor vehicle, and display device for a motor vehice | |
EP3787948A1 (en) | Method and control device for operating a motor vehicle | |
WO2022079166A1 (en) | Method, computer program, and device for modifying a route | |
DE102017215714A1 (en) | Method and system for improving driver adoption | |
DE102017006231A1 (en) | Non-rail driving device provided with a virtual reality device | |
DE102017007854A1 (en) | Device and method for information output and / or information input within a vehicle | |
WO2019210985A1 (en) | Method and system for passenger transport | |
EP3814162B1 (en) | Method for operating a display device in a motor vehicle and display system for a motor vehicle | |
DE102009034373A1 (en) | Method for displaying driving route information in navigation device of vehicle, involves automatically, variably adjusting or providing display parameter of animated route preview depending on route specific parameter of preview | |
DE102021003887A1 (en) | Method for providing media content tailored to the movement of a vehicle and vehicle | |
DE102020113485A1 (en) | Method and control device for operating a display device carried on the head of a user in a vehicle | |
DE102022131033A1 (en) | SYSTEM FOR ENABLED A VEHICLE TO EXECUTE A TRACK MODE | |
DE102022103883A1 (en) | Fun operating method for a vehicle | |
WO2023117550A1 (en) | Method for exchanging information between vehicles | |
DE10049124A1 (en) | Operating race simulator involves using information about at least one other vehicle, especially its position during real race on defined track, to determine and display field of view | |
DE102021122856A1 (en) | Method for evaluating the driving style of a driver of a motor vehicle | |
DE102016218608A1 (en) | Method for comparing driving performance, server device and driving simulator provided at different times | |
DE102011013941A1 (en) | Method for reproducing optical and/or acoustic information in motor vehicle, involves manually actuating input device for reproducing optical and acoustic information via foot switch and speech input terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200901 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20221020 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230529 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230905 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502018013915 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240103 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20240103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240503 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240404 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240103 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240403 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240103 |