GB2557912A

GB2557912A - A system for providing a virtual reality experience

Info

Publication number: GB2557912A
Application number: GB1621405.8A
Authority: GB
Inventors: Reveley Simon
Original assignee: Figment Productions Ltd
Current assignee: Figment Productions Ltd
Priority date: 2016-12-15
Filing date: 2016-12-15
Publication date: 2018-07-04
Also published as: GB201621405D0; WO2018109502A1

Abstract

A system for providing a virtual reality experience includes a vehicle controlled to follow a pre-determined path, such as on a roller coaster; a virtual reality (VR) controller 2; one or more head mounted displays (HMD) 1 each including an orientation sensor 8 and at least one screen 7 to deliver VR content relating to the position of the vehicle during the ride. A position sensor 5 is connected to the controller 6 and includes at least one accelerometer/gyroscope adapted to sense movement/position of the vehicle. The controller 6 includes a processor adapted to compare data from the position sensor 5 to data stored in the memory of the controller to calculate the location of the vehicle on the path, and the controller is adapted to synchronise the generated virtual reality images with the location of the vehicle on the path. The position sensor 5 is mounted in the vehicle and includes at least one accelerometer and/or gyroscope adapted to sense the movement and/or orientation of the vehicle. A method of implementing the virtual reality system is also disclosed.

Description

(54) Title of the Invention: A system for providing a virtual reality experience Abstract Title: A system for providing virtual reality experience (57) A system for providing a virtual reality experience includes a vehicle controlled to follow a pre-determined path, such as on a roller coaster; a virtual reality (VR) controller 2; one or more head mounted displays (HMD) 1 each including an orientation sensor 8 and at least one screen 7 to deliver VR content relating to the position of the vehicle during the ride. A position sensor 5 is connected to the controller 6 and includes at least one accelerometer/ gyroscope adapted to sense movement/position of the vehicle. The controller 6 includes a processor adapted to compare data from the position sensor 5 to data stored in the memory of the controller to calculate the location of the vehicle on the path, and the controller is adapted to synchronise the generated virtual reality images with the location of the vehicle on the path. The position sensor 5 is mounted in the vehicle and includes at least one accelerometer and/or gyroscope adapted to sense the movement and/or orientation of the vehicle. A method of implementing the virtual reality system is also disclosed.

1/-2-

2/2

FIG. 2

Start Spike 1 Spike 2 22-^_pj_L_

Time

FIG. 3

A system for providing a virtual reality experience

The present invention relates to a system for providing a virtual reality experience, in particular for users of a vehicle travelling along a known path.

It is known to provide a virtual reality experience in conjunction with movement, for example a roller coaster ride, so that the thrill of the ride is augmented by the virtual reality content. However, there is difficulty in synchronising the virtual reality content with the movement of the vehicle. It is possible to include location sensors or markers along a track or path upon which the vehicle travels in order that the virtual reality system is able to determine the position of the vehicle on the track, but this requires modification of the track or path to retrofit the system or increases the cost of the ride when building it. Examples of such a system are described in WO95/27543 (see in particular signal generators 20) and in US 6,179,619 (see in particular the objects for detection 2). In addition the system has to be able to detect the sensors or markers, which may also require modification of the vehicles.

It is also known to generate a virtual reality experience via a smartphone or similar, wherein the smartphone includes a processor which is able to generate and/or control the virtual content and a screen upon which to display the content. Examples of such virtual reality systems include the Samsung Gear VR. However, such mobile devices tend to be limited by their processing ability and/or screen resolution. For example, the processor in a smart phone must be able to fulfil all of the functions of the smart phone (e.g. making and receiving calls, texts, mobile internet browser, various mobile applications and so forth), in addition to the provision of a virtual reality experience. Therefore, the available processing power may be significantly reduced. Furthermore, smart phones tend to be relatively heavy, as they contain their own battery, together with various components that permit the smart phone to have the desired functionality. Furthermore, stand-alone virtual reality head mounted displays are also available, such as the Oculus Rift and the HTC Vive. However, these dedicated virtual reality systems are currently configured to work in conjunction with an additional computing system, such as a computer or games machine.

It is additionally noted that computer processors (both CPUs and GPUs) and batteries generate heat when in use. This can make the user uncomfortable when all of these components are located close to their body, such as their face. In addition, it becomes more difficult to control the temperature (i.e. dissipate the generated heat) of a smart phone when it is encased in a head mounted display unit.

According to a first aspect of the invention, there is provided a system for providing a virtual reality experience, the system including a vehicle controlled to follow a pre-determined path; a virtual reality controller; a position sensor; a position processor; a first memory; and one or more head mounted displays each including at least one screen and an HMD orientation sensor, wherein the position sensor and the virtual reality controller are carried by the vehicle; the first memory stores master data relating to the path, the master data relating to forces experienced by the vehicle and/or the orientation of the vehicle as it moves along the path; the position sensor includes at least one accelerometer and/or gyroscope adapted to sense movement and/or orientation of the vehicle; the position processor compares the movement/orientation data from the position sensor to the master data stored in the first memory to calculate the location of the vehicle on the path and the position processor is connected to or forms a part of the virtual reality controller; the HMD orientation sensor detects the orientation of the head mounted display and transmits orientation data to the virtual reality controller; the virtual reality controller includes a second memory which stores data relating to virtual reality images and the controller generates virtual reality images which are synchronised with the calculated location of the vehicle on the path and the orientation of the head mounted display; and the virtual reality controller transmits the synchronised virtual reality images to the respective head mounted display, where the synchronised images are displayed on the or each screen of the head mounted display.

The system therefore detects acceleration and/or the orientation (or the change in orientation) of the vehicle, for example it may detect the g-force experienced by the vehicle, as it moves along the path and is able to compare the real time data from the position sensor to the master set of data stored in the first memory to determine or calculate the position of the vehicle relative to the path. In this way, the forces experienced by a user as a result of the movement of the vehicle in which they are travelling may be synchronised with forces that the user would expect to experience as a result of the virtual reality content.

The system of the invention is not limited by a processor which is embedded in a smart phone or other mobile device. Thus, in an embodiment of the invention, the virtual reality content is controlled other than by a smart phone.

By moving the heat-generating components away from the head mounted display, it becomes easier to manage the heat generated by these components in use.

Moreover, in embodiments in which the display screen is not formed by the screen of a smart phone, the screen may be lighter than a smart phone. This is advantageous in the context of roller coaster rides where the passenger experiences forces greater than 1G. As is well known, the effective weight of an object is multiplied by the forces applied to it. Therefore, as the weight of the screen increases, it is necessary to secure it more tightly to the user in order to prevent it being torn from the head of the user in use. This can make the head mounted display uncomfortable to wear. However, the corollary is that the lighter the screen, the less tightly the head mounted display needs to the secured to the user. Thus, by replacing a smart phone, which includes its own battery and other components not required in the subject application, with a stand-alone screen, which may be powered by a remote battery and which does not include superfluous components, the weight of the head mounted display may be reduced, which in turn makes it more comfortable to wear.

As used herein, the term virtual reality includes images that replace real-life images and images which augment real-life images or modify real-life images. Thus, the term virtual reality as used herein includes augmented reality, mixed reality and modified reality.

In embodiments in which the virtual reality is entirely generated by the virtual reality controller, the screen may be opaque such that the user of the head mounted display is only able to see the images displayed on the screen. However, in embodiments in which the virtual reality content is added to true reality (e.g. augmented reality, mixed reality or modified reality), the screen may be substantially transparent, but includes a surface which is able to display virtual images. For example, the virtual reality images can be delivered to the user's eyes via a transparent, but reflective screen, such that the user is able to see the real world through the screen but is also able to see simultaneously a reflection of the virtual image as it is displayed on the screen. In such an embodiment, the black elements may appear to be invisible and brighter elements are reflected to create an additive superimposition over the real world.

Furthermore, reference to the orientation of the vehicle includes changes in the orientation of the vehicle.

The position sensor may include (i) a gyroscope, in which case the orientation of the vehicle as it moves along the path is sensed; (ii) one or more accelerometers, in which case the force(s) experienced by the vehicle (e.g. acceleration) is/are sensed; (iii) or a combination of a gyroscope and one or more accelerometers, in which case both the orientation of the vehicle and the forces experienced by it are sensed. It will be appreciated that the master data set includes data relating to the orientation of the vehicle in embodiments in which the position sensor includes a gyroscope, and data relating to the forces experienced by the vehicle in embodiments in which the position sensor includes an accelerometer. The position processor compares the data from the position sensor with the master data set stored in the first memory.

The term gyroscope as used herein is intended to refer to any sensor configured to sense or detect the orientation of the vehicle or a change in the orientation of the vehicle.

The first memory may form part of the position sensor, form part of the virtual reality controller or the first memory may be separate from the position sensor and the virtual reality controller. Similarly, the position processor may form part of the position sensor, it may form part of the virtual reality controller or it may be separate from both the position sensor and the virtual reality controller.

Thus, in an embodiment of the invention, the first memory and the position processor both form a part of the position sensor. In this embodiment, the position sensor may process the real time data and compare this to the master data stored in the first memory to determine or calculate the position of the vehicle on the path. The position data may then be transmitted to the virtual reality controller.

In an alternative embodiment, the first memory and the position processor may form part of the virtual reality controller. In this embodiment, the position sensor transmits raw data relating to the orientation of the vehicle, the change in orientation of the vehicle and/or the forces experienced by the vehicle to the virtual reality controller and the virtual reality controller compares the real time data with the master data stored in the first memory to determine or calculate the position of the vehicle relative to the path.

Accordingly, the virtual reality controller may receive from the position sensor processed position data in embodiments in which the position sensor includes the position processor and the first memory, or it may receive non-processed or semi-processed movement data from the position sensor in embodiments in which the position processor and the first memory form part of the virtual reality controller.

The first memory and the second memory may comprise different parts of a common data storage component. For example, the first memory and the second memory may both form a part of the virtual reality controller. Alternatively, they may be separate, independent memory components where the first memory may form part of the position sensor and the second memory may form part of the virtual reality controller.

The master data set may include data relating to more than one force experienced by the vehicle as it moves around the path. For example, it may include data relating forces experienced in different directions or about different axes. The force data may be acceleration data on the basis that the force is proportional to the acceleration of the vehicle based on the equation F=ma, where F is the force, m is the mass of the vehicle and a is the acceleration of the vehicle. As the mass of the vehicle is constant, the force is proportional to the acceleration.

By calculating or determining the position of the vehicle using sensed, real time data (e.g. orientation data and/or force data) relating to the orientation/movement of the vehicle and comparing this to a master set of data, no alteration or adaptation of the track or path or the vehicle itself is necessary; the position sensor can, for example, be coupled to the vehicle or even worn by a user. In other words, the system is mechanically independent of the ride.

In view of the above, the system may be retro-fitted to a pre-existing vehicle which is constrained or controlled to follow a pre-determined path in physical space or it may form a part of a new vehicle-based experience in which the vehicle follows a known path. Thus, for example, the system may be fitted to an existing roller coaster ride with no alterations required to the track or the mechanical interaction between the vehicle and the track. Furthermore, as the system is mechanically independent of the vehicle (e.g. the ride or simulator), it may be removed from a first vehicle and installed in a second vehicle, wherein the system can be re-configured to synchronise a VR content with the position of the second vehicle on a path.

The path may be a three-dimensional path, such as a roller coaster, a simulator or a threedimensional ride having a fixed base and one or more articulated arms which move users relative to the base; or it may be a two-dimensional path in which the vehicle moves around a substantially horizontal plane or moves in a substantially vertical plane, for example. However, the path taken by the vehicle should be repeatable so that the controller is able to determine the position of the vehicle relative to the path by comparing movement data with a master data set. Thus, the path may be a fixed path (as in the case of a roller coaster, for example) or the vehicle may be controlled to follow a repeated, pre-determined series of movements that result in a repeatable, pre-determined path through space.

In an embodiment of the invention, the vehicle carries a housing, the virtual reality controller is located within the housing, and the virtual reality controller is connected to the head mounted display via a wired or wireless connection. Optionally, the virtual reality controller is connected to the head mounted display via a wired connection, for example via a high speed data cable, such as an HDMI cable, which is able to transmit video and image data to the head mounted display.

As the housing is secured to the vehicle, it may include one or more vibration damping or absorbing elements to prevent or minimise vibration from the vehicle being transmitted to the controller. Additionally or alternatively, the housing may include a door and a door seal such that ingress of water into the interior of the housing is prevented. The housing may be ventilated. This helps to maintain the temperature within the housing within pre-defined limits in use.

In embodiments in which the virtual reality controller is located within a housing fixed to the vehicle, the virtual reality controller may further include the position processor, the first memory and/or the second memory.

The position sensor suitably includes a gyroscope and at least one accelerometer or G-force sensor such that both the orientation of the vehicle and a force experienced by the vehicle may be sensed. The position sensor may further include at least two accelerometers or so that acceleration/deceleration in two planes may be detected or sensed. For example, the position sensor may comprise three accelerometers, each having a respective axis about which acceleration is sensed. The three axes are suitably arranged in mutually orthogonal planes such that motion about three mutually orthogonal axes may be sensed or detected (i.e. pitch, roll and yaw movements may be sensed). Thus, the position sensor may comprise a gyroscope and an accelerometer, a gyroscope and two accelerometers, a gyroscope and three accelerometers, two accelerometers, or three accelerometers.

For certain rides, there may be periods of time during which the vehicle is subject to little or no forces or subtle changes in orientation which may not be sensed by the gyroscope. Additionally or alternatively, at particular locations along the path there may be substantial noise in the data generated by the position sensor due to secondary movement, for example the movement of components of the vehicle or experienced by the vehicle at locations on the path. In such cases, the position sensor may include a signal receiver which receives a position signal from an external transmitter. Thus, the external transmitter may be located adjacent to a portion of the path where there is relatively little movement of the vehicle, such that the position sensor is able to sense when it is at such a position on the path via signals transmitted by the external transmitter which are received by the signal receiver.

In embodiments in which the virtual reality controller is located within a housing carried by the vehicle, the position sensor may also be located within the housing. This allows for the transmission of positional data from the position sensor to the virtual reality controller over the shortest possible distance, which in turn minimises any delay in the synchronisation of the virtual reality content to the position and motion of the vehicle.

The system may comprise a position sensor and a virtual reality controller per passenger or it may comprise a position sensor and two or more separate virtual reality controllers each connected to the position sensor, wherein the number of virtual reality controllers is equal to the number of passengers that can be accommodated by the vehicle. As the virtual reality experience for each passenger may be different, the system suitably includes a virtual reality controller per seat in the vehicle. However, groups of two or more seats may use position data from a single position sensor. Thus, the vehicle may comprise an array of seats, wherein the array includes a position sensor and a plurality of virtual reality controllers, and the number of virtual reality controllers is equal to the number of seats in the array. Accordingly, the array of seats may include a housing which contains a position sensor and a plurality of virtual reality controllers, wherein each virtual reality controller is associated with a respective seat of the array.

In a further embodiment of the invention, a single virtual reality controller may provide virtual reality content to two or more seats. In such an embodiment, the virtual reality controller may include a plurality of graphic processors. The virtual reality content may be delivered via a wired connection or it may be sent to multiple head mounted displays via a wireless connection (i.e. the virtual reality content is multicast to the respective head mounted displays). Accordingly, in an embodiment of the invention, the virtual reality controller includes a plurality of graphics processors and the virtual reality controller is connected to a plurality of head mounted displays, wherein each head mounted display has associated with it a respective graphics processor.

In an embodiment of the invention, the vehicle includes a plurality of passenger compartments, wherein each compartment comprises an array of seats. For example, the compartment may comprise a 1x2 array of seats (i.e. two seats arranged in a single row), a 1x3 array of seats (three seats in a row), a 1x4 array of seats (four seats in a row), a 2x2 array of seats (two rows of two seats), a 2x3 array of seats, a 2x4 array of seats, and so on. Each array may include one or more position sensors.

The head mounted display may optionally be portable. Accordingly, it is suitably powered by one or more batteries. The batteries may be rechargeable. In certain embodiments, the virtual reality controller may also be powered by a battery system. Thus, in embodiments in which the virtual reality controller and optionally the position sensor are located within a housing carried by or fixed to the vehicle, the housing may further contain one or more rechargeable batteries which power the respective head mounted display(s), the virtual reality controller and/or the position sensor.

In an embodiment of the invention, the virtual reality controller includes a graphics processor to control or process the virtual reality images. Thus, the virtual reality controller may include the position processor to process the position data from the position sensor and to determine the location of the vehicle relative to the track or path, and a graphics processor which processes the virtual reality content based on the location data from the position processor. This allows for faster processing of the data and better quality images. As noted above, if the images are not properly synchronised with the motion of the vehicle, passengers can experience motion sickness. Thus, it is desired to have the shortest possible processing time in order to synchronise properly the virtual reality content to the motion of the vehicle.

As noted above, the position sensor is carried by the vehicle, for example in a housing secured to the vehicle.

As noted above, the head mounted display of the system includes an HMD orientation sensor which senses a direction in which the HMD (head mounted display) is facing. Thus, the HMD orientation sensor may detect movement of a user's head. The HMD orientation sensor may be able to detect movement about three mutually orthogonal axes. Thus, the HMD orientation sensor may sense side-to-side rotation of the head (i.e. rotation of the head from left to right or vice versa), up-and-down movement of the head and tilting movement of the head from side to side. The, data relating to the orientation of the head mounted display is suitably transmitted to the virtual reality controller, which controls the virtual reality content accordingly.

The master data relating to the path that is stored in the first memory of the system (i.e. the master data set) suitably includes data corresponding to the orientation of the vehicle and/or forces exerted upon (i.e. experienced by) the vehicle as it moves along the path. The data may include data points relating to selected points along the path. Thus, the master data set may be a set of discrete data points that correspond to pre-determined points on the track or path, or it may be a continuous set of data that corresponds to the track or path as a whole.

The virtual reality controller may include one or more predictive algorithms which are able to predict future movements of the vehicle based on the master data set.

According to a second aspect of the invention, there is provided a method of operating a virtual reality experience, the method comprising: providing a system as defined anywhere herein in connection with the first aspect of the invention; establishing a master data set relating to the movement of the vehicle along the path, wherein the master data set comprises data relating to the orientation of the vehicle and/or forces experienced by the vehicle as it moves along the path; saving the master data set in the first memory of the system; comparing data from the position sensor to the master data set to determine the position of the vehicle relative to the path; and synchronising the virtual reality images transmitted to the head mounted display with the location of the vehicle.

The master data set may be obtained by running the vehicle along the path in a data acquisition mode. In the data acquisition mode, the virtual reality controller may be disconnected from the head mounted display or the head mounted display may be absent. The vehicle may move along the path one or more times in the data acquisition mode. It will be appreciated that in examples in which the vehicle moves along the path a number of times in the data acquisition mode, a number of discrete data sets may be obtained that can then be averaged to form the master data set. The data sets may be manipulated to smooth and/or optimise the data which forms the master data set. The master data set suitably provides an ideal/most common sequence of position sensor readings along the path.

Once the master data set has been obtained, it is stored in the first memory of the system (for example in the virtual reality controller). The position processor is then able to compare real-time data from the position sensor with the stored master data set when the vehicle is in an operational mode to determine or calculate the position of the vehicle in relation to the path. The virtual reality controller may then select or generate virtual reality content corresponding to the calculated position of the vehicle, such that the virtual reality content displayed on the head mounted display is synchronised with the position and movement of the vehicle. In an embodiment of the invention, the known issue of drift that is commonly associated with positional data is compensated for by the virtual reality controller. This may be achieved by comparing the real time data sensed by the position sensor against the master data set and bringing the real time data into alignment with the master data. The position processor may constantly compare the data from the position sensor in use against the master data set or it may compare it periodically, for example in accordance with a pre-determined or pre-programmed comparison schedule.

The step of synchronising the virtual reality content with the location/motion of the vehicle may include displaying virtual reality images on the or each screen. The virtual reality images suitably include movement that corresponds with the movement of the vehicle.

It may be desired to synchronise the start of the virtual reality content with the start of the vehicle movement (i.e. when the vehicle first moves from its start or stationary position). In such an embodiment, the step of synchronising the virtual reality content with the location of the vehicle suitably includes generating a start signal when the vehicle moves from its start position and synchronising the start of the virtual reality content (i.e. displaying the first virtual reality images) with the start signal.

As noted above, the master data set may include data relating to the orientation, change in orientation or force(s) experienced by the vehicle and the position sensor may sense in real-time the corresponding data experienced by the vehicle when travelling in its operational mode.

The method may further comprise the step of determining the orientation of the head mounted display, transmitting data relating to the orientation of the head mounted display to the virtual reality controller and controlling the virtual reality content based on the orientation of the head mounted display in addition to the position of the vehicle.

The skilled person will appreciate that the features described and defined in connection with the aspects of the invention and the embodiments thereof may be combined in any combination, regardless of whether the specific combination is expressly mentioned herein. Thus, all such combinations are considered to be made available to the skilled person.

An embodiment of the invention will now be described, by way of example only, with reference to the accompanying drawings in which:

Figure la is a schematic view of a system according to the first aspect of the invention; Figure lb is a front elevational view of part of a roller coaster in which the system is installed for use;

Figure 2 is a schematic view of a portion of a roller coaster ride; and Figure 3 is a schematic view of sensed data compared with a master data set.

For the avoidance of doubt, the skilled person will appreciate that in this specification, the terms up, down, front, rear, upper, lower, width, etc. refer to the orientation ofthe components as found in the example when installed for normal use as shown in the Figures.

In this embodiment, the path is defined by a roller coaster track and the vehicle travels along the track from a start point to an end point and then returns to its start position. Thus, in this embodiment, the roller coaster track defines a fixed path in space along which the vehicle travels in a repeatable and predictable way.

Figure la shows a virtual reality system comprising a head mounted display device 1 (hereinafter HMD) and a housing 2 fixed to a vehicle 3 within which passengers are secured during the ride. The vehicle 3 includes a number of seats 4. Four seats 4 are shown in Figure lb in a 1x4 array and each seat 4 has associated with it a respective housing 2. The skilled person will appreciate that the roller coaster vehicle 3 may include any desired number of seats 4, provided that each seat 4 is connected to a housing 2. A number of roller coaster vehicles 3 may be coupled together to form a train. The seats 4 are conventional roller coaster seats and include restraining bars for the passengers to prevent the passenger being ejected from the seat 4 during the ride.

The housing 2 is ventilated and includes a position sensor 5, a controller 6 and a rechargeable battery (not shown). The controller 6 includes a central processor (CPU), a graphics processor (GPU), a set of master position data also stored in a first memory of the controller 6, and data relating to virtual reality images stored on a second memory of the controller 6. In the context of the present invention, the CPU processes the position data from the position sensor 5 and the CPU therefore comprises the position processor. The arrangement of a CPU and a GPU in the context of virtual reality systems are well known. Accordingly, it is not necessary to go into detail regarding the processors, their inter-relationship and the software they run in order to control the virtual reality content displayed on the HMD 1.

The housing 2 also includes the rechargeable battery (not shown) which powers the position sensor 5, the controller 6 and the HMD 1. The controller 6 may include additional components, such as an input interface, an output interface and a wireless signal receiver, for example. These are conventional components and need not be described in detail herein.

The HMD 1 includes a high resolution display screen 7 and an HMD orientation sensor 8. The HMD 1 is held in place on a user's head with a top strap 9 and a rear strap (not shown). The arrangement of straps prevents the HMD 1 from being unintentionally dislodged from the passenger's head during the ride. The HMD 1 is connected to the controller 6 located in the housing 2 via a two-way data and power cable 10 which transmits image data from the controller 6 located in the housing 2 to the HMD 1 along a first path 11, and which transmits display orientation data from the HMD orientation sensor 8 to the controller 6 along a second path 12. The cable 10 also transmits electrical power from the battery located within the housing 2 to the HMD 1 such that the screen 7 and the HMD orientation sensor receive electrical power from the battery via the cable 10. As the screen 7 is powered by a battery located remote from the HMD 1, it can be significantly lighter than a screen formed from a smart phone or other similar device.

The screen 7 of the HMD 1 may be any suitable high resolution screen, such as an LCD, LED or projection screen. On the basis that the screen 7 is located relatively close to the eyes of the passenger, the HMD 1 may further include one or more lenses to make viewing the screen more comfortable. The screen 7 may be adjustable in the sense that it may be moveable relative to the passenger such that the passenger can bring the screen 7 into focus for their eyesight.

The HMD orientation sensor 8 may be any known orientation sensor which is able to sense changes in orientation ofthe HMD 1.

The position sensor 5 includes a gyroscope and three accelerometers arranged in mutually orthogonal axes (often referred to as the X, Y and Z axes or the yaw, roll and pitch axes) such that the sensor 5 is able to detect changes in the orientation of the vehicle and movement of the vehicle (and thus the user) about each of the three axes.

The position sensor 5 is connected to the controller 6 such that data from the position sensor 5 is transmitted to a receiver which forms part of the controller 6. Accordingly, the position sensor 5 includes a data transmitter which transmits data to the receiver of the controller 6.

The CPU of the controller 6 receives the orientation (and/or change in orientation) and force/acceleration data from the position sensor 5. It compares this to a master set of data stored in the first memory of the controller 6 to determine the precise location of the vehicle 3 on the track. The graphics processor then generates the virtual reality images corresponding to that position on the track from the image data stored in the second memory of the controller 6. The CPU further receives orientation data from the HMD orientation sensor 8 ofthe HMD 1 relating to the orientation of the HMD 1. This data relates to the direction in which the passenger is looking. The graphics processor then refines the generated images based on the orientation data and transmits the refined virtual reality images to the display 7 of the HMD 1 via path 11 of the cable 10.

As the vehicle 3 moves along the track and the orientation of the HMD 1 changes, the images transmitted to the display 7 are constantly updated to reflect the position of the vehicle 3 on the track at any given time and the direction in which the user is looking. In this way, the virtual reality images seen by the user are perfectly synchronised with the forces their body is experiencing in the real world and the direction in which they are looking.

By locating the position sensor 5 and the controller 6 in the housing 2 which is fixed to the vehicle 3, the display 7 of the HMD 1 needs only to display the images transmitted to it. As noted above, this means that the HMD 1 can be lighter, as it does not include the controller and other components not required for the present purpose. The skilled person will appreciate that any weight saving of the HMD 1 is significant when the HMD is subject to forces of more than 1G. Furthermore, the heat generated by the processors and the battery in use can be better controlled when these are located within the ventilated housing 2.

In order to generate a master data set against which data recorded by the position sensor 5 may be compared by the CPU, the vehicle 3 is run around the track a number of times in a data acquisition mode. During the data acquisition runs of the vehicle 3, the controller 6 is configured in a data acquisition mode in which data from the position sensor 5 is recorded, but the GPU is not active. Thus, position data is transmitted to the controller 6, but no virtual images are generated.

In the embodiment described above, the CPU and the first memory both form part of the virtual reality controller 6. However, the skilled person will appreciate that the CPU and the first memory may instead form a part of the position sensor 5.

A computer programme then generates a master data set based on average values and identifiable data points which provide data spikes. Figure 2 shows a section of a roller coaster track having a number of identifiable data points 14,16, 18, 20. It will be appreciated that the controller 6 may run the computer programme which generates the master data set or a separate computer may process the force data received from the position sensor 5 to generate the master data set, which is then loaded into the respective memory system of the controller 6.

There may be four sets of master data (one set for the gyroscope and one set for each accelerometer) or the data may be combined to generate a single master data set.

A start signal 22 in the form of a wireless signal which is emitted when the vehicle begins to move provides a reference point for the acquired data. This enables the software to average and smooth the raw data to generate the master data set.

When the master data set has been generated, it is saved into the memory of each virtual reality controller 6 and the CPU is configured to compare data received from the position sensor 5 to the master data set to calculate or determine the precise location of the vehicle relative to the track.

The software run by the controller 6 further includes a predictive algorithm which predicts future motion of the vehicle 3 based on its current position and the master set of data. Thus, the controller is able to predict the subsequent or future motion or movement of the vehicle 3. Based on the relative positional data and the predictive algorithm stored in the controller 6, the controller 6 is able to synchronise the virtual reality content projected onto the screen 7 with the movement of the vehicle such that forces that a user would expect to feel as a result of the virtual reality content are actually felt as a result of the movement of the vehicle.

Figure 3 shows data 24 received from the position sensor 5 and the corresponding master data set 26 for that section of the track. As can be seen, the start point 28 for the master data set closely matches the start point 30 for the specific vehicle journey and this corresponds with the start signal 22. A first spike 32 in the measured data 24 corresponds with a corresponding expected spike 34 in the master data set 26. However, a second spike 36 in the measured data 24 occurs slightly earlier than predicted from the corresponding spike 38 of the master data set 26.

As a result of this, the virtual reality content is adjusted and the controller 6 adjusts the calculated position of the vehicle 3 accordingly. The adjustments in the virtual reality content are not noticeable by the user.

When the particular journey of the vehicle ends, the controller resets the virtual reality content and awaits the next start signal 22. The skilled person will appreciate that the end of the journey may include an end signal (not shown).

Claims

1. A system for providing a virtual reality experience, the system including a vehicle controlled to follow a pre-determined path; a virtual reality controller; a position sensor; a position processor; a first memory; and one or more head mounted displays each including at least one screen and an HMD orientation sensor, wherein the position sensor and the virtual reality controller are carried by the vehicle; the first memory stores master data relating to the path, the master data relating to forces experienced by the vehicle and/or the orientation of the vehicle as it moves along the path; the position sensor includes at least one accelerometer and/or gyroscope adapted to sense movement and/or orientation of the vehicle; the position processor compares the movement/orientation data from the position sensor to the master data stored in the first memory to calculate the location of the vehicle on the path and the position processor is connected to or forms a part of the virtual reality controller; the HMD orientation sensor detects the orientation of the head mounted display and transmits orientation data to the virtual reality controller; the virtual reality controller includes a second memory which stores data relating to virtual reality images and the controller generates virtual reality images which are synchronised with the calculated location of the vehicle on the path and the orientation of the head mounted display; and the virtual reality controller transmits the synchronised virtual reality images to the respective head mounted display, where the synchronised images are displayed on the or each screen of the head mounted display.

2. A system according to Claim 1, wherein the vehicle carries a housing, the virtual reality controller is located within the housing, and the virtual reality controller is connected to the head mounted display via a wired or wireless connection.

3. A system according to Claim 2, wherein the head mounted display is connected to the virtual reality controller by a wired connection.

4. A system according to Claim 2 or Claim 3, wherein the virtual reality controller and the position sensor are both located within the housing.

5. A system according to any of Claims 1 to 4, wherein the position processor and the first memory form part of the virtual reality controller and the position sensor is connected to the virtual reality controller.

6. A system according to any of Claims 1 to 4, wherein the position processor and the first memory form part of the position sensor and the position sensor is connected to the virtual reality controller.

7. A system according to any of Claims 1 to 6, wherein the virtual reality controller includes a graphics processor to generate the virtual reality images.

8. A system according to any of Claims 1 to 7, wherein the position sensor includes a gyroscope which senses the orientation or the change in orientation of the vehicle, and the master data includes data relating to the orientation of the vehicle or changes in orientation of the vehicle as it moves along the path.

9. A system according to any of Claims 1 to 8, wherein the position sensor includes at least two accelerometers, and the master data includes acceleration data relating to the vehicle as it moves along the path.

10. A system according to Claim 9, wherein the position sensor includes three mutually orthogonal accelerometers and a gyroscope.

11. A system according to any of Claims 1 to 10, wherein the system further includes one or more batteries electrically connected to the virtual reality controller, the position sensor and/or the head mounted display.

12. A system according to Claim 11, wherein the or each battery is carried by the vehicle.

13. A system according to Claim 12, wherein the battery is housed within a housing fixed to the vehicle.

14. A system according to any of Claims 1 to 13, wherein the vehicle includes one or more arrays of seats; each seat has associated with it a virtual reality controller and a position sensor, and each position sensor is connected to a respective virtual reality controller.

15. A system according to any of Claims 1 to 13, wherein the vehicle includes one or more arrays of seats; each seat has associated with it a virtual reality controller; and the position sensor is connected to two or more virtual reality controllers in the or each array.

16. A system according to any of Claims 1 to 15, wherein the virtual reality controller includes a plurality of graphics processors and the virtual reality controller is connected to a plurality of head mounted displays, wherein each head mounted display has associated with it a respective graphics processor.

17. A system according to any of Claims 1 to 16, wherein the master data relating to the path includes data corresponding to the position of the vehicle at selected points along the path.

18. A method of operating a virtual reality experience, the method comprising: providing a system according to any of Claims 1 to 17; establishing a master data set relating to the movement of the vehicle along the path, wherein the master data set comprises data relating to the orientation of the vehicle and/or forces experienced by the vehicle as it moves along the path; saving the master data set in the first memory of the system; comparing data from the position sensor to the master data set to determine the position of the vehicle relative to the path; and synchronising the virtual reality images transmitted to the head mounted display with the location of the vehicle.

19. A method according to Claim 18, wherein the synchronisation of the virtual reality images to the position of the vehicle is controlled by the virtual reality controller.

20. A method according to Claim 19, wherein the virtual reality controller includes a graphics processor and the graphics processor generates the virtual reality images.

21. A method according to any of Claims 18 to 20, wherein the virtual reality images transmitted to the head mounted display are displayed on the or each screen.

22. A method according to any of Claims 18 to 21, wherein the method includes receiving a

5 start signal when the vehicle begins to move along the path and synchronising the virtual reality controller with the start of the vehicle.

23. A method according to any of Claims 18 to 22, wherein the master data set includes data relating to the orientation or changes in the orientation of the vehicle as it moves along

10 the path.

24. A method according to any of Claims 18 to 23, wherein the master data set includes data relating to the acceleration of the vehicle as it moves along the path

25. A method according to any of Claims 18 to 24, wherein the method includes running the vehicle around the path in a data acquisition mode to generate the master set of data and subsequently running the vehicle around the path in an operation mode in which data from the position sensor is compared to the master data set to determine the location of the vehicle relative to the path.

Intellectual

Property

Office

Application No: GB1621405.8 Examiner: MrPaulMakin