DE102017203875A1 - Means of transport, device for displaying a virtual reality and corresponding method - Google Patents

Abstract

A means of locating, a device for displaying a virtual reality (3), an arrangement comprising the means of locomotion and the device and a method for displaying a virtual reality for a user (21) of a means of locomotion (10) are proposed. The method comprises the steps of: determining an imminent acceleration process of the means of locomotion (10) and in response thereto representing a visual indication (2) of the imminent acceleration process in the virtual reality (3).

Description

The present invention relates to a means of locomotion, a device for displaying a virtual reality and a corresponding method. In particular, the present invention relates to prevention of nausea in the use of a virtual reality in locomotion in a vehicle.

In the prior art, headsets for representing virtual reality or augmented reality are known, which enable a mobile use of virtual / augmented reality. In the case of virtual reality, the user can not recognize the surrounding reality. When moving in means of locomotion, the user can therefore not anticipate future resulting accelerations. For example, the user does not recognize a course of the road, the passers-by crossing the road, red-lighted traffic lights, etc. Also downhill, uphill, unexpectedly emerging obstacles, etc., the user can not recognize and is therefore surprised by the acceleration occurring, which is required to respond to the aforementioned circumstances.

In the course of the automation of means of transportation (driving robot, autopilot or similar) an increasing use of virtual reality in means of transportation can be assumed. Due to the fact that the guidance of the means of locomotion takes place on the basis of data which are determined by means of the environment sensor system, the same data can be sent via wireless interfaces to external / mobile user terminals.

Based on the aforementioned prior art, it is an object of the present invention to avoid nausea in the use of a virtual reality in a means of transportation.

The above object is achieved according to the invention by a method for representing a virtual reality for a user of a means of transportation. The virtual reality can be represented for example via a display unit of the means of locomotion. Alternatively or additionally, the virtual reality may be displayed via a mobile display device (e.g., VR glasses, smartphone mount, or the like). The means of transport may be a car, van, truck, motorcycle, air and / or watercraft. The user may be a leader or other occupant of the vehicle. In a first step, an imminent acceleration process of the means of locomotion is determined. In other words, the acceleration is calculated and / or estimated in terms of its direction and / or strength before an acceleration occurs. This can be done on the basis of different data. For example, environmental sensing, digital map material, car-to-car or X-to-car communication may be used to anticipate acceleration events required to respond to environmental conditions or accelerations directly induced by environmental conditions. In response to or depending on the upcoming acceleration, a pictorial indication of the upcoming acceleration process in virtual reality is presented. The pictorial note dispenses in particular with text and / or numbers. In particular, the pictorial reference is adapted to a virtual reality scheme. By this is meant that depending on the virtual reality to virtual reality suitable objects are displayed, based on which the user can anticipate the upcoming acceleration process. In other words, the virtual reality is modified to output an indication of the impending acceleration as a function of environmental sensor data and / or digital map material. In particular, the virtual reality is also a locomotion process through an environment in which not or at least not constantly an imminent path for the user is recognizable. The course of the road to be traveled or of the air / water way to be traveled in reality is therefore not necessarily depicted correspondingly in virtual reality. All the more important is the announcement of impending acceleration events, at least insofar as the strength and / or the time course of the acceleration exceeds a predefined threshold value and thus has the potential for nausea generation by the user. According to the invention, nausea is therefore avoided, in particular if the pictorial indication within the virtual reality requires an acceleration at the same time as the real acceleration process. In this way, the user is prepared for the real acceleration, without having to leave the virtual reality or to get a non-virtual reality reference to the acceleration. The enjoyment of virtual reality is thus possible without any obstruction on board a means of transportation.

The dependent claims show preferred developments of the invention.

The acceleration may be directed in the direction of travel (X direction) or transversely to the direction of travel (Y / Z direction). Their height can be from digital data, information, which was determined by a driving robot / autopilot, environment sensor system or similar. be determined. The same applies to the direction and the time course of the acceleration. In other words, you can Accelerations in the three axes of the vehicle coordinate system are anticipated and announced in accordance with the invention. The same applies to rotational accelerations, which can occur especially in water / air vehicles in controlled driving conditions.

Preferably, the hint may represent a virtual object, on the basis of which the user may e.g. to perform a virtual maneuver for collision avoidance. During the execution of the maneuver, depending on the virtual movement state of the user, accelerations occur which correspond to the imminent real acceleration. In this way, the best possible congruence between optically presented and acceleration perception is produced by the user.

For example, the hint may represent an object that conforms to the virtual reality scheme. In other words, the object fits thematically into virtual reality. In other words, an obstacle, a plant, a mountain range, a slope, a slope, a rapids and / or wind, in particular by a flow moving particles, a light effect (eg reflections, running light, brightness gradients), planets and / or asteroids in of the virtual reality on the basis of which a virtual movement state of the user is forced or required, which leads to a virtual acceleration process identical to the imminent real acceleration process. The user is therefore not "torn" out of his virtual reality by the hint. In this way, there is no need for the user to interpret whether the hint originates from the virtual world or from the real world. Rather, the information is "translated" into the virtual world. In this way, the use of virtual reality is simplified and made more intuitive, while avoiding nausea due to an incongruity between visual and other sensory impressions.

The virtual reality may correspond, for example, to a drive (for example by means of a bicycle, a motorcycle, a vehicle) through nature. Such a theme could also be described as "mountain rallye", "desert safari" or similar. be designated. If the user desires a virtual reality on water or even under water, for example, a boat race or a dive trip can be displayed in which pylons / buoys are to be avoided, in the course of which virtual acceleration processes occur, which coincide with the determined, real-world acceleration processes. Even flowing waters, on a subject ("raft trip" or similar) are useful to indicate rapids, river bends, etc. as evidence of imminent real acceleration processes. If the user has selected an "aerospace" theme for their virtual reality, a cloud front, an aerial mine, a balloon, an oncoming aircraft or similar can be used. be displayed as an indication of the upcoming acceleration process.

The upcoming acceleration process can be determined / predicted on the basis of an autonomous travel of the means of transportation. The data available to the autonomous means of locomotion can therefore be used to predict the time, the direction and the amount of the impending acceleration exactly and as soon as possible. Accordingly, the hint can be displayed in virtual reality. For example, digital maps in conjunction with ambient sensors, satellite-based positioning or similar. used to make a turn, a speed limit, a suspension of a speed limit, or the like. predict and appropriately map in virtual reality.

According to a second aspect of the present invention, a means of locomotion is proposed, which can be configured, for example, as an autonomously mobile means of locomotion. The means of transport may be a car, van, truck, motorcycle, air and / or watercraft. It has a data input, which is linked in terms of information technology with an evaluation unit. The evaluation unit is in turn linked to a data output in terms of information technology. The data input and / or the data output may include a bus subscriber. The evaluation unit is, for example, as an electronic control unit, programmable processor, microprocessor, or the like. designed. By means of the data input, the evaluation unit is set up to determine an imminent acceleration process of the means of locomotion. If an imminent acceleration process has been determined with an amount above a predefined threshold value, the evaluation unit can transmit via the data output a data record representing the impending acceleration. This can be received, for example, via a device for displaying a virtual reality for a user of the means of locomotion and implemented in accordance with the invention. The means of locomotion may comprise the means for displaying the virtual reality for the user of the means of locomotion. In particular, the device for displaying the virtual reality can be a device that is permanently integrated into the means of transportation. In particular, the energy and / or information technology integration of the device in the electrical system of the means of transport can be permanent.

According to a third aspect of the present invention, a device for displaying a virtual reality for a user of a means of transportation is proposed. The device comprises a data input and an evaluation unit. The data input may include a bus subscriber. It may be configured to receive wireless communication signals from the means of locomotion. The evaluation unit may have a microprocessor, a nanoprocessor or the like. exhibit. The data input is set up to receive a data set representing a forthcoming acceleration of the means of transportation from the means of transportation. Preferably, the device is arranged here in the means of locomotion or the passenger compartment of the means of locomotion and / or the driver's cab of the means of locomotion. The evaluation unit is set up to display a pictorial indication of the imminent acceleration process in the virtual reality. In other words, the means of locomotion according to the second aspect of the invention and the means for presenting a virtual reality according to the third aspect of the invention are arranged in conjunction with each other to carry out a method according to the first aspect of the invention and thereby realize the same features, combinations of features and advantages so as to avoid them of repetitions to the above remarks.

• 1 eine perspektivische Darstellung auf ein teilweise frei geschnittenes Fortbewegungsmittel gemäß einem Ausführungsbeispiel der vorliegenden Erfindung, welches gemeinsam mit einem Ausführungsbeispiel einer erfindungsgemäßen Einrichtung zur Darstellung einer virtuellen Realität als Ausführungsbeispiel einer erfindungsgemäßen Anordnung fungiert; und
• 2 ein Flussdiagramm veranschaulichend Schritte eines Ausführungsbeispiels eines erfindungsgemäßen Verfahrens zur Darstellung einer virtuellen Realität für einen Anwender eines Fortbewegungsmittels.

Further details, features and advantages of the invention will become apparent from the following description and the figures. Show it:

• 1 a perspective view of a partially cutaway means of transport according to an embodiment of the present invention, which functions together with an embodiment of a device according to the invention for representing a virtual reality as an embodiment of an inventive arrangement; and
• 2 a flowchart illustrating steps of an embodiment of a method according to the invention for representing a virtual reality for a user of a means of transportation.

1 shows a car 10 as an embodiment of a means of transport according to the invention, which on a road by a driver 1 is moved. The road makes a right turn, causing an acceleration in the negative Y direction imminent. A front camera 8th and an acceleration sensor 9 are as environment sensors information technology with a data input 4 an electronic control unit 6 linked as evaluation unit. The data input 4 is also with a data storage 15 linked, stored in which map material and thus the course of the leading curve is displayed in terms of information technology. A data output 5 of the electronic control unit 6 is with an antenna 7 linked as a wireless end receiving device, by means of which the sensory detected or from the data memory 15 read information to a VR glasses 11 as a device for representing a virtual reality 3 sent and via an antenna 12 as data input of VR glasses 11 can be received. The antenna 12 is with a microprocessor 13 as an evaluation unit of the VR glasses 11 and can also be from a data store 14 Information about the representation of a virtual reality 3 recall. In response to receiving the information about the upcoming acceleration process (right turn) puts the VR glasses 11 a bent tree 2 as an indication to the user 21 which seamlessly integrates thematically into the moto-cross-drive through a forest. The user 21 , which can not see the ahead curve, gets over the bent tree 2 thus the indication that his ride in virtual reality 3 will follow a right turn. The ride through the virtual reality 3 In this case, the real acceleration resulting from the real right turn coincides with the virtual acceleration resulting from the avoidance maneuver with respect to the bent tree 2 would result. In this way, there is a congruence between the sensory impressions of the user 21 protected, without the context of virtual reality 3 to leave or to affect others.

2 FIG. 12 is a flowchart illustratively showing steps of an embodiment of a virtual reality representation method of the invention for a user of a means of transportation. FIG. In step 100 an imminent acceleration process of the means of locomotion with regard to its time / Zeitverlaufes, its magnitude, its size and its direction is determined. In this case, vehicle-based sensors and / or locally and / or by radio available map material can be read out and processed. In step 200 In response to determining the impending acceleration or depending on the impending acceleration, a pictorial indication of the imminent acceleration process in virtual reality is displayed. The visual reference has at least one picture element which is thematically associated with the virtual reality, wherein in particular textual content can be dispensed with.

The present invention enables a reduction of nausea through the correct simulation of the direction of motion, acceleration and velocity in the virtual world. The result is a new driving / flying experience, especially in the age of autonomous driving / flying. Travel becomes more relaxed and user confidence in autonomous driving is built by integrating the representation of upcoming driving maneuvers and recognized road users into the virtual reality that the user enjoys.

LIST OF REFERENCE NUMBERS

1

driver

2

kinked tree

3

virtual reality

4

data input

5

data output

6

electronic control unit

7

antenna

8th

front camera

9

accelerometer

10

car

11

VR goggles

12

antenna

13

microprocessor

14

data storage

15

data storage

21

user

100,200

steps

Claims (10)

A method of presenting a virtual reality to a user (21) of a means of transportation (10) comprising the steps of: - determining (100) an impending acceleration process of the means of locomotion (10) and in response thereto - Representing (200) a visual reference (2) for the upcoming acceleration process in the virtual reality (3). Method according to Claim 1 , wherein the acceleration - in the direction of travel and / or - transverse to the direction of travel of the means of locomotion (10) is directed. Method according to Claim 1 or 2 in which - the virtual reality (3) represents a virtual movement scenario of the user (21) and - the indication (2) represents an object on the basis of which the user (21) has to perform a virtual maneuver in which a virtual maneuver corresponding to the forthcoming acceleration process Acceleration would occur. Method according to one of the preceding claims, wherein the reference (2) as - an obstacle and / or - a plant and / or - a mountain range and / or - a gradient and / or - an incline and / or - a rapids and / or Wind effect, in particular particles moved by a flow, and / or - Lighting effects and / or - Planets and / or asteroids is designed and / or neither numbers nor letters includes. Method according to one of the preceding claims, wherein the virtual reality (3) corresponds in nature to an entry from the following list: - drive to land, - drive to water, especially under water, - Aerospace and Space. Method according to one of the preceding claims, wherein the forthcoming acceleration process due to an autonomous travel of the means of transport (10) is calculated in advance. Method according to one of the preceding claims, wherein the forthcoming acceleration process on the basis of digital map material for the means of transportation (10) is pre-calculated. Means of transport comprising a data input (4), - An evaluation unit (6) and - a data output (5), wherein - the evaluation unit (6) - By means of the data input (4) is arranged to determine an imminent acceleration process of the means of locomotion (10), and - By means of the data output (5) is arranged to send a data representing the upcoming acceleration record to a device (11) for displaying a virtual reality for a user (21) of the means of transport (10). Device for displaying a virtual reality (3) for a user (21) of a means of locomotion (10), wherein the device (11) comprises: - a data input (12) and - an evaluation unit (13), wherein - the data input (12) is set up, an imminent acceleration of the To receive means (10) representative of the means of locomotion (10) and the evaluation unit (13) is arranged to - based on the record a pictorial indication (2) for the forthcoming acceleration process in the virtual reality (3) represent. Arrangement comprising a means of transport according to Claim 8 and a device (11) according to Claim 9 wherein the arrangement is arranged, a method according to any one of the preceding Claims 1 to 7 perform.

Images