WO1997000106A1

WO1997000106A1 - Cockpit for providing a display system and user interface for an interactive computer system

Info

Publication number: WO1997000106A1
Application number: PCT/US1996/010431
Authority: WO
Inventors: Jordan Kent Weisman; David Scott Mccoy; Eric Christopher Huffman; Christopher Paul Brewer; Lyndon Ross Babcock, Iii; William Gibbens Redmann
Original assignee: Virtual World Entertainment, Inc.
Priority date: 1995-06-16
Filing date: 1996-06-14
Publication date: 1997-01-03
Also published as: AU6179696A

Abstract

The present invention provides a cockpit (10) having a display system and user interface for an interactive computer system. The cockpit has improved space efficiency, sparse, but strong, frame construction, ergonomic design, personalized nameplate, easy maintenance access, high quality directional sound, and infinity optics. The cockpit seats a single user and is enclosed to permit user immersion in the interactive computer experience. The cockpits may be networked to permit more than one user to access the simulation environment at one time. The infinity optics make the player feel immersed in the simulation environment yet allow for a reduced cockpit footprint. A plurality of display monitors configured as controls provides substantial information to and from the player, thus maximizing the communication interface between the player and the computer. The design of the display monitors and associated buttons allow flexibility in system modification, but with minimum effort.

Description

COCKPIT FOR PROVIDING A DISPLAY SYSTEM AND USER INTERFACE FOR AN INTERACTIVE COMPUTER SYSTEM

FIELD OF THE INVENTION The present invention relates generally to an apparatus which provides a display system and user interface for an interactive computer system.

BACKGROUND OF THE INVENTION In recent years, with the increased processor power and speed of the computer, the use of three-dimensional computer graphics has exploded into application areas as diverse as entertainment and medicine. Using three-dimensional computer graphics, it is now possible to create computer generated simulation environments which allow for human-computer interaction in realtime — taking the user far beyond familiar limits, a computer generated "virtual" world is treated as if it were real. Interacting with the computer generated simulation environment in realtime is known as virtual reality (VR) .

Because of the high cost of supercomputers capable of generating a simulation environment in realtime, few industries could afford to integrate virtual reality systems. The first industries to adopt virtual reality systems for use were the airlines and the military, primarily for use as fight and flight simulators. However, as the cost of computing power has decreased, and military spending has decreased, there has been a surge of interest in virtual reality systems for the entertainment industry. A virtual reality system consists of many different components. These systems deliver an interactive experience to a user. Virtual reality systems provide immersive capability resulting from the computer's power, reprogrammable content, and the use of interior (simulation environment) space rather than actual physical space. The primary components are the computer, the program (and other related software), the user interface, and the visual display system.

The user interface of a virtual reality system provides a mechanism for the user to communicate with the computer. A joystick, throttle, steering wheel, trigger and other buttons are exemplary of user interfaces. Other types of user interfaces include motion sensing devices which communicate movement such as tilting seats (which read a user's body posture) and the like. Sound is also used to enhance the experience of the user and to communicate with the user.

Displays systems used for interactive computer systems are numerous and varied. LED (light emitting diode) linear arrays (which are swept optically), LC (liquid crystal) panels, CRTs (cathode ray tubes), and projectors with screens are among the types of display devices that have been used in the past to deliver a visual display. Optics or other enhancements are typically coupled with the display device to provide an undistorted view of a simulation environment. Then, the display device and optics are held and contained within a display assembly, thus completing the display system.

Display systems can be immersion or non-immersion. Immersion display systems are those that almost completely surround the user's field of view with the simulation environment. A head mounted display is an immersion display system. The display device and optics are enclosed in a display assembly positioned close to the user's head. As the user looks around, the display device encompasses substantially all of his field of view. Another type of immersion display system is the head coupled (visually coupled) display. Although the display is optically coupled to the user's head, the user's head does not support the display system. Instead the display is held by a counterbalanced support.

Cockpits, also called "pods", are non-immersion display systems. For a pod, the display device, such as a CRT, is typically mounted a distance from the user, and the user sits and views the screen as if he were in the cockpit of a vehicle looking out a window. The non-immersion display systems are often themed to the story of the computer graphics being displayed. Other display systems include small theaters as the display assembly, these small theaters housing the display device and optics.

User interfaces are often housed within the display assembly of a display system to facilitate the important coordination between these two components of a virtual reality system. Motion sensing devices, and head tracking devices be mounted to a head mounted display to track the motion and orientation of the user and provide this information quickly to the computer so that the display device may appropriately update the computer video graphics viewed by the user. Pods and small theaters typically include throttles, joysticks, steering wheels and other user interface devices mounted within their frames.

Various display systems have been used by the entertainment industry as it moves to try and commercialize virtual reality systems. There are few providers of virtual reality systems in the entertainment industry that use head mounted displays as a display system. Virtuality Centers, located nationwide, feature a 3-D chessboard combat VR game "Dactyl Nightmare". The user or player dons a head mounted display. The user interface, which tracks the movement of the user, is a combination of a motion sensor housed in the head mounted display, and position sensors in a defined area of an open pod (with no walls or ceiling -- only rails). Each player carries a gun which shoots ammunition at another player in the simulation environment. Cybergate is the product of Visions of Reality, Irvine, California. Cybergate uses a pod for user isolation and user interface, and delivers the display system using a head mounted display. Visions of Reality's pods are 7 ft. long by 8 ft. wide (approx. 56 ft².). The Cybergate display system and user interface, called a flight simulation VR system, was created in collaboration with Kaiser Electro-Optics, a military contractor that built the hands-on display for the Apache helicopter. The display device is a LCD (liquid crystal display).

The Boom2 is a head-coupled display manufactured by Fake Space Labs, of Menlo Park, CA. It uses a pair of custom displays of high resolution. While the Boom2 is easy to use, it does not lend itself readily to hands free controls. The University of Chicago has created a multisided video projection room called the Cave. While inside the Cave, a user sees steroscopic images coupled to his head position and movement.

Because head mounted displays limit movement and suffer from low resolution, time lag, and choppy frame rates, they are not currently a popular display system for commercial virtual reality system. Users complain that they cannot see the images clearly, and that they are encumbered by the weight. Avoidance of these deficiencies is possible, but cost prohibitive. For example, the head mounted display of Kaiser Electro-Optics was originally developed for use with aircraft, and the cost is still too high to make it attractive as an option for use with mass marketed VR_^ entertainment attractions. Head coupled displays, such as the Boom2, also have deficiencies in that the user's hands are usually not free for any other type of computer interface. Head coupled displays typically require movements to be made by the users hands, which does not leave the user's hand available for such interfaces as, for example, throttle control, joystick, etc.

Cockpits or pods, while non-immersive, are the preferred mode of the entertainment industry for delivery of display systems and user interfaces with VR systems. Cockpits have been used previously by many computer games. Cockpits can be: easily and quickly entered and exited by the user, and, themed to the story provided by the simulation environment's computer graphics . With cockpits, the user's hand are free to control the user interface devices.

Iwerks Entertainment of Burbank, California produces a Virtual Adventure series of which its Loch Ness Adventure is the first. The display system and user interface is combined and designated by Iwerks as a "Loch Ness submarine control room." The pod is a large, glossy room carrying six "crew members." Each crew member is responsible for one facet of the Loch Ness submarine's function. The display device is a wall-sized screen housed in the display assembly of the pod. The users view the screen as if they were looking out the underwater window of the submarine. The controls for the submarine are also held within the display assembly.

Evans & Sutherland of Salt Lake City, Utah, markets a virtual reality attraction called ElectraDOME. ElectraDOME is an 8-foot diameter mini dome (requiring approximately 55 ft.² of floor space), and includes a projection system, that uses the movement of the user's head to determine a game response within a virtual environment. User's are given the disposable headband that is tracked by a servo-optical projector during the game as a souvenir. In Mountain View, California, the Magic Edge Center, a virtual reality theme park, opened in 1994 (and recently closed) . This attraction was provided with motion based cockpits. The cockpit housed a 30 by 40 inch screen as its display device. Controls within the cockpit allowed the user to fire missiles at other players.

Fightertown, in Irvine, California sells time in jet simulators which use cockpits as the display assembly. Some of the simulators sit facing a large (approximately 8 ft. diagonal) projection television screen which is the display device for these simulators. Other simulators use fully enclosed cockpits which have CRTs as the display device. The Fightertown cockpits are provided with switches and a single glass heads down display for instrumentation. User interface is via a flight stick, rudders, and a speed brake switch on the throttle. Interactive sound is provided with a microphone and speaker enclosed in a helmet.

Hughes Training,- Inc. , Entertainment Products Department, Arlington, Texas, and LucasArts have teamed together to produce an interactive simulation attraction which is sold under the commercial name of Mirage system. The Mirage system uses a themed pod as for its display system. The Mirage pod is made of fiberglass and has automatic doors on both sides of the pod for entry and exit. Each Mirage pod has two seats with user interaction provided through joysticks and throttles. The display device and optics include a 120 degree screen, with a large collimating mirror reflecting the imagery from the screen (specially coated) illuminated by two 850 lumen projectors. Microphones and speakers are also placed within the Mirage pod.

Virtual World Entertainment, Inc. for its Virtual World sites uses cockpits to deliver the display system and user -.interface. The cockpits are themed for 1950's era science fiction space exploration and use a CRT as the out-the-window display device, with a joystick, throttle and trigger used for user interface.

For VR systems, the lifetime of the cockpit is the period during which the VR technology is sufficiently advanced over other entertainment offerings (home PC games, arcade machines, etc.) such that the users are willing to pay a premium price.

With the high cost of the high powered computers necessary to generate the VR computer graphics, to commercially viable, the display systems and user interfaces must be cost effective. Recently, Magic Edge, Inc. closed its Magic Edge Center doors after discovering that the actual business generated did not support the amortization of the system components, (including a motion based platform added to the cockpit to enhance the user experience). Similarly, the Mirage pods never were commercialized despite enthusiastic reviews by individuals who tested it, due to the high cost of the extremely wide angle infinity optics system and the three video projectors which drove it. Both of Magic Edge, Inc. and Hughes/Lucas rt (Mirage) contemplated (correctly) that spectacular non-computer components (the motion bases, display systems with special projectors, and optics) would further differentiate their VR systems from available or anticipated arcade and home experiences, such as personal computers and game consoles (e.g. the Nintendo of America, Inc.'s SNES and SEGA of America, Inc.'s Genesis). Thus, the public's perception of their value would support a premium price, and their VR systems would have a longer effective lifespan. However, cockpits which are excessively priced cannot be profitably amortized over their lifespan.

While cockpits do not have the weight and size constraints of head mounted displays and can therefore use larger, less expensive and display systems and user interfaces, cockpits are space intensive, that is, large amounts of floor space (the footprint) are need to accommodate the cockpits for an entertainment attraction. For example, the Evans & Sutherland pod has slightly larger than 8 ft. diameter (approx. 64 ft².). The Mirage pod (a two seater pod) requires a space 9'11" high, 12'6" wide and 14'3" long (approx. 178 ft². - 89 ft², per user). A VR entertainment attraction using a Mirage pod, and having 12 Mirage Pods, would consume 2136 ft.² for the pods alone. Then, in addition to the pod requirements, space for a control console, and ancillary equipment is necessary. ElectraDOME's 8-foot diameter mini dome requires approximately 55 ft.² of floor space per unit. Gyrolab, a motion based simulator created for the United States government, was enclosed and provided infinity optics, but had a large footprint (and was not concerned with reducing the footprint because the simulators were used by the government). The cockpit with the smallest footprint (that is, the square footage of floor space consumed by the cockpit) is that of virtual World Entertainment (VWE). VWE's cockpit is 8 ft. 7 in. long, and 3 ft. 2 in. wide (and 5 ft. 3 1/2 in. tall) which is approx. 27 ft.² for its footprint. (Height is not a critical dimension because most facilities have at least 8 ft. standard ceilings. ) Cockpits which consume too much floor space reduce their own profitability by directly increasing real estate costs. Making a cockpit more compact requires many of the same considerations that arise for design of a head mounted display, e.g., a larger space is required to have an improved display system, an improved sound system, and better user interfaces typically have more equipment, requiring more room.

Using a cockpit, providing display systems that have a more realistic feeling to the user and a sound system having dimensional sound typically requires sophisticated optics which enhance the display and sophisticated speaker systems using multiple speakers, and these systems require substantial additional room. Yet, increased cockpit size mandates increased costs of construction, greater floor space, and smaller user throughput for a given area. One particular prior art device, the cockpit for the Starblade game and cockpit combination, enhanced its display system, and attempted to minimize the space necessary for the optical path of the video display system. Using a CRT located just above the user's head, the image was reflected off of a mirror located just in front of the user. While this did reduce the space requirements for the display system, the optical path necessarily cut a large clear swath through the cockpit volume and this swath needed to remain clear of other objects for the display system to operate correctly. Adding auxiliary displays and sophisticated sound systems was not possible because of the lack of adequate room. There is a need, then, for a cockpit which minimized floor space used, while maximizing the realism of the user's view, sound heard, and interaction available.

OBJECTS AND SUMMARY OF THE INVENTION

The present invention relates to a cockpit providing a display system and user interface for an interactive computer system. The present invention provides a cockpit for a single user, which may be networked to other cockpits for other users. The present invention overcomes the drawbacks of the prior art in that it provides a cockpit for a VR system having a display system, and including a user interface, for a VR system having minimum size requirements while maximizing realism of the VR experience.

In the present invention the cockpit has a space efficient arrangement of all components, including, but limited to, infinity optics, dimensional sound, secondary screen, auxiliary displays, and seating. This arrangement is desirable because it provides a cockpit having a reduced footprint, that is, it reduces the square footage consumption, from prior art devices which had similar display systems .

The cockpit of the present invention has an end-to-end taper which permits arrangement of the cockpits in a manner such that the access space necessary between multiple cockpits is minimized. In addition, the coplanar sliding door does not intrude on aisle space, minimizing aisle waste while still allowing for wheelchair and handicapped ramped access.

Within the cockpit, the display device and optics provide a realistic view of the simulation environment not possible in prior art cockpits of the same size. Using the magnifying optics of the present invention, the size of the screen necessary is smaller. With the magnifying optics, the viewing area subtends a large angle, giving adequate sense of immersion (but not so large as to readily induce motion sickness), providing an apparently large viewing area while minimizing the cost of the display device necessary. Moreover, the small, high resolution monitor (exemplary is a CRT, but another type of high resolution display panel may also be used) and magnifying optics is lower in cost than a large high resolution monitor that subtends the same angle and uses more space.

The optics of the present invention are folded with a beam splitter (partially silvered mirror) and a mirror to reduce the total throw of, and volume consumed by, the optical path. This provides infinity optics while keeping the length of the footprint for the cockpit short. Because of the angle orientation of the mirror, and beam splitter, the optical path does not have the open space requirements of the prior art devices. This permits the lower space to be used for additional ancillary displays and controls typical of a themed cockpit (e.g., weapons status, engine status, messages, score, etc.) while still providing adequate leg room for the user. The monitor and optics system is sealed to keeps out dirt and minimize the frequency of cleaning. The controls within the cockpit are placed along the vertical arch of the frame. This orientation narrows the console spread, thereby reducing the width required, and thus the footprint requirements of the cockpit. The instrumentation used is multiplane floating instruments, rather than the flat console of the prior art devices, which increases the aesthetic appearance of the controls. The controls only marginally intrude on the out-the-window, window frame of the optics system which enhances the perceived effect of viewing the simulation environment through the windshield of a vehicle without obstructing the view.

The displays of the controls within the cockpit use CRT monitors, with lighted momentary push buttons located above and below, rather than the conventional LED or LCD matrix message displays. Using a plurality of CRT monitors or other graphic display (rather than conventional LED or LCD character displays) provides the flexibility of a graphic module switch, which permits changing the function of the switch without changing the switch itself, at a substantially lower cost. For example, the graphic LCD module switch manufactured by Itochu Technology, Inc., Irvine, California has a bit map on the top of the switch which graphically indicates the switch function. While these switches permit changes, they are costly. In addition, the use of the CRT monitors in conjunction with the lighted momentary push buttons uses simpler electronics and is easily internationalizable. CRT monitors are preferred over other graphic matrix technology (such as the Graphic LCD Dot Matrix Modules, for example the AND711A or AND1181ST, and LED Dot Matrix components such as the AND2570, all three manufactured by the AND Division of the William J. Purdy Company of Burlingame, CA) Thus the display of the present invention overcomes the drawbacks of the prior art in that it is less costly, easily modifiable, typically consumes less power, than the displays of the prior art.

A centrally mounted speaker system provides three- dimensional (3D) sound, i.e., localization of sound sources. The sound system is comprised of speakers which are contained in appropriate resonant volumes, including locations behind the user, for quality sound. Quadraphonic sound balances three-dimensional (3D) localization to the user at his seat. The speaker enclosure is contained entirely within the cockpit housing and does not penetrate the housing to increase the cockpit footprint.

The cockpit has a light weight, open frame skinned with a robust material. Two piece construction facilitates handling and transport with a third piece provided for leveling and precise alignment.

In the equipment bay, the computers are mounted for easy access, yet permit minimum footprint. Diagnostic and adjustment controls are accessed from within the cockpit. Forced air ventilation improves user comfort and reduces the opportunity for motion sickness typically caused by simulators. Adjustable seats put the controls within reach of both children and adults. An external name display provides for easy identification of the particular user's cockpit.

It is an object of the present invention to provide a low cost cockpit which achieves a sustainable level of commercial attraction.

It is an object of the present invention to minimize the floor space consumed by each cockpit.

Another object of the present invention is to provide a display system, for a cockpit, having maximum realism in the smallest footprint possible for the cockpit.

Yet another object of the invention is to provide a display system for console controls with maximum flexibility and changeability, with minimum space and minimum cost.

It is a further object of the present invention to provide a cockpit for an interactive computer system that can be easily adapted as a themed VR attraction.

It is yet another object of the present invention to provide a cockpit for an interactive computer system which can accommodate many different themed computer graphics sequences. Another object of the present invention is to provide a cockpit for an interactive computer system which can accommodate modification to the themed computer graphics.

It is a further object of the present invention to provide a modular virtual environment simulation cockpit that uses a minimum quantity of materials to minimize weight and cost without compromising strength, durability, and transportability.

It is a further object of the present invention to provide a high quality audio presentation optimized for dimensional sound.

It is yet another object of the present invention to be self testing and to report failures or pending failures to a central location.

These and other features and advantages of the invention will be more readily apparent upon reading the following description of a preferred exemplified embodiment of the invention and upon reference to the accompanying drawings wherein:

BRIEF DESCRIPTION OF THE DRAWINGS

The aspects of the present invention will be apparent upon consideration of the following detailed description taken in conjunction with the accompanying drawings, in which like reference characters refer to like parts throughout, .and in which:

FIGURE 1 depicts a side view of a cockpit, with door removed for clarity, for use with an interactive computer system, said cockpit being a preferred embodiment of the present invention;

FIGURE 2 depicts the side view of the cockpit of FIGURE 1, having the skin, wall of console section, optic box enclosure, and computer bay door cover, removed to show the interrelationship of optics, displays, speakers, seating, controls, and computer equipment within the cockpit which is a preferred embodiment of the present invention;

FIGURE 3 depicts a perspective view from the rear door side of the cockpit, which is a preferred embodiment of the present invention, showing the structure and detail of the central arch, with the door-side skin, door support wall, rear speakers removed for clarity;

FIGURE 4 depicts a perspective view of the frame of the cockpit of the present invention;

FIGURE 5 depicts the interior console of the cockpit of FIGURE 1 which is a preferred embodiment of the present invention;

FIGURE 6 depicts the preferred embodiment of the front panel of a typical instrument control display located in the interior console of the cockpit shown in FIGURE 5; While the invention will be described and disclosed in connection with certain preferred embodiments and procedures, it is not intended to limit the invention to those specific embodiments. Rather it is intended to cover all such alternative embodiments and modifications as fall within the spirit and scope of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT The present invention relates to a cockpit for an interactive computer system. Referring to FIGS. 1, 2 and 3, there is shown a side view, and a perspective view of the cockpit 10 which is a preferred embodiment of the present invention. In FIG. 1 the cockpit 10 is shown with the door removed (not shown) for a view of the inside of the cockpit 10. The cockpit 10 is designed for a single user, also referred to as a player or passenger. Typically, the interactive computer system of the present invention is a simulation environment designed for multiple users, each user positioned in his own cockpit 10. The interactive computer system includes, but is not limited to, the computer, interactive program and related software, any network necessary to tie multiple users (if present) together. Multiples of the cockpit 10 are typically then located at a particular site, but may also be located at remote sites. At the particular site, usually within a building, there is housed the cockpits 10, computers, programs, and network and support systems for the interactive computer system.

The cockpit 10 is a covered frame and housing for holding and securing the components within. The cockpit 10 is comprised of two sections, the equipment section 12 and the passenger section 14. Each of these sections has a frame 18 and 19, respectively, which is joined together at their intersection 16.

Referring now to FIG. 4, the passenger section 14 has a spare frame 19 which provides its central support. The skin support strut 33, central arch 36, and the front bulkhead 31 of the passenger section 14 attach together and to each other to form the frame 19 which houses the passenger seating area and controls. The central arch 36 has two members 38 which begin from the top of the cockpit 10 at the front bulkhead 31 and arch from the top of the cockpit 10 down and outward substantially traversing the partial circumference of a large circle and ending at the passenger seat base 35 of the passenger's section to which it is anchored. The members 38 are intermittently connected by the interior bulkheads 39. The bulkheads 39 are perpendicular to the central arch interior cover plates 29 which attaches to the inside edge of the members 38 and the inside edge of the bulkheads 39, and to the central arch exterior cover plates 29' which attaches to the outside edge of the members 38 and the outside edge of the bulkheads 39.

The skin support strut 33 is formed of two parts, the first a curved member which is attached near the highest point of the central arch 36, curves outward, and then back in again and attaches to the passenger seat base 35. At its midpoint, which is its most outward point, the second part of the skin support strut 33 is attached and begins a curved path outward and perpendicular to the midpoint and meets and attaches to the central arch 36. A like skin support strut (not shown) supports the non-door side skin 34.

An arch of overhead support 8 may be added to provide space for overhead ancillary displays. Preferably, the overhead support 8 is integral with each central arch member 38. The gap between arch members 38 may be used to hold or hang additional equipment, acting as a rack mount.

In FIGS. 2, 3 and 4 there is shown frame 18 for the equipment section 12. The frame 18 consists of the optics enclosure box 43 which is rectangular in shape and has the rectangularly shaped console section boxes 42 and 42' attached above and below, respectively. The optics enclosure box 43 and the console section boxes 42 and 42' are vertically anchored to the rear bulkhead 41, and the bottom console section box 42' is attached to the equipment section base 45. The rear bulkhead 41 meets and attaches to the front bulkhead 31 at their parallel intersection 16. When assembled for use, the frames 18 and 19 are each attached to and integral with the cockpit base 20 thus completing the support structure for the cockpit 10. The cockpit base 20 supports the structure of the cockpit 10 and lifts it off of the floor. The cockpit base 20 substantially determines the footprint of the cockpit. A stabilizer leg 22, and a leg gusset 24 are located on each side of the base 20. The stabilizer legs 22 keep the cockpit 10 from being tipped over. The footprint of the cockpit 10 is reduced, that is, it is of the dimensions 7 ft. long and 3 ft. 4 in. wide (and 7 ft. 1 in. high — below that of standard ceilings) for a total floor space of approximately 23 ft.² or less.

Referring back to FIG. 2, there is shown an optional computer storage area 6 which is part of the equipment section 12 when the computer located proximate to the cockpit 10. In the present invention, if it is desired to have the computers proximate to the cockpit 10, the computers (not shown) are housed within the computer storage area 6 so as to be easily accessed while mounted in the minimum footprint orientation. If the optional computer storage area 6 is not used, the footprint of the cockpit 10 is further reduced below 23 ft.².

When it is determined that the computer be proximate to the cockpit 10, the computer storage area 6 is attached to and becomes a part of the equipment section 12. The computer storage area 6 has shelves 74 which are each located below an empty rectangular volume 79 for storage of a computer. This computer location configuration facilitates the swap out of technology parts where necessary, for example, if the lifetime of cockpit exceeds competitive lifetime of the computer (image generation equipment) . To cool the computers (not shown), circulating air is supplied to volume 79 through the air inlet port 77. Exhaust fan 76 helps to maintain the volume 79 at a comfortable temperature for the computers (not shown) by circulating the air and exhausting it through the exhaust port 78. A display of lights 72 which turn on and off in sequence under computer control, or other special effects such as strobing lights or the like, may be added to further theme the cockpit 10. With the display of lights 72, exhaust fan 76' may be used to cool the display of lights, exhausting the circulating air through exhaust port 78'. To protect the computers (not shown), the computer storage area 6 is then covered with the computer bay door 70 as shown in FIG. 1. in FIGS. 1 and 2 there is shown the skin covering 30 which covers the door side of frame 19 of the passenger section 14. A similar skin covering 34 covers the opposite side of passenger section 14 and is visible in FIGS. 1,2,3 and 4. As shown in FIG. 1, the skin covering 30 is continuous and covers this entire area with the exception of the door (not shown). Just forward of the door location, there is located an equipment section themed covering 40 on each side of the cockpit 10 for that part of the equipment section 12 containing the optics enclosure box 43 and the console section boxes 42 and 42'. Enclosing of the cockpit 10, by the frame and housing, with the door closed, keeps the outside environment from impinging on the user's experience, permits the implementation of the dimensional sound, and allows for light control. Further, by making the interior of the coverings 30 and 34, and the door covering (not shown) black in color, and painting the interior of the frame 19 to match, the user has no visual distractions when inside the cockpit 10, other than those intended by the computer graphics of the simulation environment and the displays presented; with the door closed, the interior of the cockpit 10 is dark. The material of the coverings 30 and 40, and the door (not shown), is typically robust such as a vacuformed ABS plastic. Preferably, that material will be a laminate of a black layer for the interior of the cockpit, and a second, themed color for the exterior. Over the central arch 36 may be added an additional themed covering 32.

It can be seen from FIG. 1 that the door is removed. Two door support rails 46 are attached to both frames 18 and 19 through coverings 30 and 40, beginning near the end of each of the console section boxes 42 and 42' (under cover skin 40) and extending along the side of the cockpit 10 almost to the position of the skin support strut 33. In the passenger section 14, the upper door support rail 46 is further supported by the door support wall 52 which is attached to the frame 19. The door support rails 46 provide for the door (not shown) to move from the open to close position and back again by sliding along the pair of rails 46. Within the passenger section 14, there is provided the passenger seat 64, and equipment related to user interface. The passenger seat 64 is mounted on top of the seat base 68. The seat mounting plate 66 holds the seat 64 to the seat base 68. The seat mounting plate 66 provides for the seat to have at least two positions, forward and back, for the comfort of the user. In FIG. 1, seat 64 is shown in the forward position, and in FIG. 3 seat 64 is shown in the back position. This adjustment allows for the seat controls to be within reach of most users, including children. The comfort of the user is also consider in positioning the armrest 65 along the closed side interior of the cockpit 10 passenger section 14 opposite the door (not shown). The armrest 65 is located approximately 5.5 inches above the top surface of the passenger seat 64. The location of the armrest provides that the user may optionally rest his right arm upon the armrest 65 while operating the joystick controller 60 which is attached to the armrest 65 at a substantially perpendicular orientation. Slightly forward of the joystick controller 60 in the armrest 65 there is located a detent 51 to retain a passenger beverage. At the left side of a seated user, supported on the passenger seat base 35 there is located the throttle controller 62. The throttle controller 62 is a standard single axis linear controller, such as the T-Bar Throttle manufactured by Happ Controls, Inc. of Elk Grove Village, IL, which provides for acceleration of the user through the simulation environment. The throttle controller 62 is positioned low to allow clear ingress/egress for the user when using the cockpit 10. Referring to FIG. 2, to aid in maintaining a comfortable temperature within the cockpit 10, forced air ventilation is provided in the cockpit 10. For the ventilation, a ventilation fan 37 is located the fan opening 93 of the central arch 36. The fan opening 93 penetrates both the interior cover plates 29 the exterior cover plates 29' between two of the bulkheads 39. The ventilation fan 37 provides for the circulation of air from the inside of the cockpit 10 to its exterior. This ventilation improves user comfort and reduces the opportunity for simulator sickness. The ventilation fan is further selected and operated for quiet operation so as to not adversely affect the audio presentation.

A sound system is provided to the user of the cockpit 10. Three-dimensional (3D) localization of sound sources is a preferred embodiment of the present invention. The quadraphonic sound system implemented is exemplary, but not restrictive, of the three-dimensional sound system of the invention. All of the speakers of the sound system are contained entirely within the cockpit 10 and do not extend outside the cockpit 10, which would increase the cockpit's reduced footprint. To minimize the footprint, speakers (not shown) are typically mounted inboard with outward facing or placement adjacent to and parallel with walls. Sound is reflected from the source speakers (not shown), off of the interior surfaces of skin coverings 30 and 34, and the door (not shown) to the seated user. These acoustic reflections increase apparent separation of stereo image both in front of and behind the passenger. This wider apparent separation in the front stereo image and especially the rear stereo image make the apparent spacing among the four speaker sets more equal, resulting in a superior quadraphonic 3D presentation.

The dimensional sound system is implemented with a group of balanced quadraphonic speakers. Off-the-shelf speakers are strategically located within internal space of the cockpit 10 so as to deliver the most realistic sound possible. As shown in FIGS. 2 and 4, the woofers 92 are located in woofer speaker openings 91. Two of the woofers 92 are located in the central arch 36 behind the passenger seat 64 in holes 91 provided in the interior cover plates 29 and extending into the space behind the interior cover plates 29. Acoustic ports 96 are cut into the bulkheads 39 located above and below the woofer speaker openings 91 in the central arch 36. This central placement of the rear woofers 92 is sufficient because the bass is largely non-directional. If desired, resonant volumes 90 of appropriate size, can be ducted. Referring to FIG. 5, the remaining two woofers 92 are housed in woofer speaker openings 91 located in the speaker mounting panels 95 which are beneath each of the auxiliary displays 80 of the lower display portion 75. The woofers 92 extend back from the display panel 7 into a resonant volume 90 located in the equipment section 12, shown in FIG. 2. All resonant volumes 90 are constructed with attention to sealing the volumes against undesired air leaks. The midrange speaker openings 91' provide a location for the midrange speakers (not shown). The two rear midrange speakers openings 91' are positioned on either side of the head area of the passenger seat 64 in the speaker enclosure 98 as shown in FIG. 3. The remaining two midrange speakers (not shown) are located in speaker openings 91' in the speaker mounting panels 95 on either side below the auxiliary displays 80 of the lower display portion 75.

The tweeter speaker openings 91" provide a location for the tweeters 94 shown in FIG. 2. Two of the tweeter speaker openings 91" are positioned on either side of the head area of the passenger seat 64, just above the location of the midrange speaker openings 91' as shown in FIG. 3. The remaining two tweeters (not shown) are located at the top and at either side of the viewport 99 of the display panel 7. In addition to the sound system previously described, the cockpit 10 is provided with a communication system (not shown) for communication between the operator and the user, or between users in separate cockpits. This communication system is comprised of an attendant call light, such as the display of lights 72, a large button 138, shown in FIG. 1, within the cockpit which, when activated, sends a signal to the operator which indicates that the cockpit user needs assistance, that is, a "help" button, a microphone 136, shown in FIG. 5, for the user seating in the cockpit, and a microphone and headset intercom from the operator to interior of the cockpit 10 for communication with the user.

Alternatively, the user may wear a microphone or a headset which plugs into a jack (not shown) which replaces the function of microphone 136.

Referring now to FIG. 5, there is shown the display panel 7, the upper portion of which is mounted into the overhead support 8 (also shown in FIG. 2). The display panel 7 contains the display device and other instrumentation and related equipment. Beginning from the top of the display panel 1 , centered at the top there is shown the central instrumentation bay 50. The central instrumentation bay 50 is oriented so as to hold its contents at an angle of approximately 50° which provides that its contents can be easily be viewed by a cockpit user sitting in the passenger seat 64.

Within the central instrument bay 50, located near the top, is the diagnostic readout 120. The diagnostic readout 120 is a set of LED characters which indicate, under computer control, the status of the input/output subsystem, that is, each cluster of buttons located on the display panel 7. This also permits the verification of proper operation of the cockpit controls, viz. , joystick 60, pedals 61, throttle 62, buttons 104, and keypads 85 and 134. Located below the diagnostic readout 120 on the central instrumentation bay 50 are the monitor adjustment knobs 122 and the keyboard jack 124. The keyboard jack 124 provides for the connection of a keyboard (not shown) within the cockpit 10 to program various peripheral systems, and perform diagnostic work on peripheral systems. For example, should it be necessary to cause the cockpit computer to load a new computer program, this operation would be accomplished by connecting a keyboard (not shown) within the cockpit 10. The monitor adjustment knobs 122 provide the tuning of the primary display monitor 82, shown in FIG. 2, and the secondary display monitor 110, shown in FIG. 5. Vertical height, vertical position, horizontal width, horizontal position, brightness, contrast, are exemplary of the adjustments. As discussed, the diagnostic displays for self testing, and adjustment controls for primary and secondary monitors and controls, located in the central instrument bay 50, are accessed from within cockpit 10. During normal operation of the cockpit 10, the diagnostic readout 120, the monitor adjustment knobs 122, and the keyboard jack 124 are covered by the maintenance controls cover 83, as shown in FIG. 3, to prevent tampering by a cockpit user during normal operation.

Located below the monitor adjustment knobs 122 in the central instrumentation bay 50 is one of the five auxiliary displays 80. Each of the four remaining auxiliary displays 80 are housed in the four auxiliary display housings 100. Two of the auxiliary display housings 100 are located adjacent to, and on either side of, the central instrument bay 50. These two auxiliary display housings 100 are set into the side of the bulkhead in such a manner as to orient their contents downward along the line of sight of a user sitting in the passenger seat 64.

The remaining two auxiliary display housings 100 are located on either side of the secondary display 81 just above each of the two the speaker mounting panels 95. Within the auxiliary display housing 100, the auxiliary display front panel 103 secures an auxiliary display monitor 101, a series of lighted momentary push buttons 104 above and below the auxiliary display monitor 101, and the auxiliary display module handles 102 located on either side of the auxiliary display monitor 101. The auxiliary display monitors 101 are used to display instrumentation (altimeters, speedometers, and the like), help screens, and other simulation and communication related data. A display exemplary of that shown on auxiliary display monitor 101 is shown in FIGURE 6. The lighted momentary push buttons 104 coordinate with the displays to deliver control information. Thus the displays are interactive. The displays may show bitmaps which coordinate the control information to the lighted momentary push buttons. The displays are fully configurable, that is, because the displays show bitmaps coordinated to the lighted momentary push buttons, and having additional information, if desired, the bitmaps may be easily changed to any "picture" including showing coordinated control information in foreign languages. The auxiliary display handles 102 facilitate the installation and removal of the auxiliary displays 80. Alternatively, buttons 104 can be regions of a touchscreen overlaying the surface of the auxiliary display monitor 101. For adjustment and maintenance, the entire auxiliary display 80, with the exception of the auxiliary display housing 100, can be removed from the cockpit. Retaining screws (not shown) are removed from display panel 103. A technician can draw the auxiliary display module (comprising the auxiliary display 80 without auxiliary display housing 100) out of the auxiliary display housing 100 using handles 102. A wire harness (not shown) supplying power, video signal, and interface to the buttons is then disconnected. The auxiliary display module can then be adjusted at a workbench and replaced, or a replacement module can be installed. Preferably, all auxiliary display modules throughout the display console 7 are alike and interchangeable. Each of the remaining two auxiliary display housings 100 are capped by the auxiliary display cowling 106. The secondary display 81 is capped by the secondary display cowling 108. The auxiliary display cowling 106 and the secondary display cowling 108 shield and isolate the auxiliary display monitors 101, and the secondary display monitor 110 from light from primary monitor 82 to provide a clearer display.

Below the auxiliary display 80 in the central instrumentation bay 50 there is positioned the keypad 85. The keypad 85 allows the user to input numeric data or commands during a simulation, and also provides control of maintenance functions by entry of a secret numeric code.

Referring again to FIG. 5, in the center of the display panel 7 is the viewport 99. The viewport 99 is an opening in the front bulkhead 31 which permits the user, when seated in the passenger seat 64, to view the image from the primary display monitor 82 after it has been reflected by the mirror 84 and beam splitter 86. The primary display monitor 82 is a standard 19" high resolution SVGA compatible monitor, such as those manufactured by Wells-Gardner of Chicago, IL, and is located behind the front bulkhead 31 in the equipment section 12 within the console section box 42. The magnifying mirror 84 and beam splitter 86 are located within the optics enclosure box 43. The cover to the optics enclosure box 43, just under the cover skin 40 on the door side of cockpit 10, is removable for aligning, servicing, and cleaning the optics.

A typical seated user's line of site 88 through the viewport 99 and to the mirror 84 is shown in FIG 2. The user's line of site after reflection 89 (by both the beam splitter 86 and magnifying mirror 84) is also shown in FIG. 2. The magnifying mirror 84 is a spherical section such as the model C20-S manufactured by Glass Mountain Optics, Inc. of Austin, Texas, which increases the size and apparent distance to the image from the primary display 82. Thus, the size of the CRT necessary to provide the desired picture size, that is, 19" diagonal, is much smaller than that which would be necessary without the use of the magnifying mirror 84. The wide angle maximum field of view 87 to 87' obtainable is approximately 30° degrees vertically and 40° degrees horizontally. This orientation of: the display device which includes the primary display monitor 82, and, the related optics — the mirror 84 and beam splitter 86, makes the seated user feel that he is looking out the windshield of a vehicle into the computer generated simulation environment. Further, the increase in the apparent distance to the image makes the image appear to be a life-sized environment. Directly below the viewport 99, there is located the lower display portion 75 of the display panel 7. Oriented at the top of the lower display portion 75 is the secondary display 81 having a housing (not shown) which, in conjunction with the secondary display front panel 113, holds and supports the secondary display monitor 110, the optional head mounted display jack 114, and another series of buttons 104. A head mounted display (HMD) (not shown) may be worn by the user while in the cockpit 10. A head mounted display would be plugged into head mounted display jack 114, which would be detected by the computer system providing imagery for the primary display (i.e., monitor 82). When the presence of an HMD is detected at jack 114, the primary monitor 82 is blanked, and the out-the-window view seen in viewport 99 is replaced by imagery directed to the HMD through jack 114. Typically, HMDs provide head tracking data which indicates to the image generating computer in which direction the user's head is directed, and where the user's head is located. In some HMD systems (such as those provided by Polhemus Navigation Sciences, Inc., and Ascension

Technologies, Inc.) a head tracking reference source is need. Such a source (not shown) would be preferably mounted in the cockpit along central arch 36.

The HMD (not shown) would preferably be of the beamsplitter type, such that luminous images generated by the display appear to the user to be superimposed over luminous objects within the otherwise darkened cockpit. By turning his head about, the user would thus be able to look about within the computer generated simulation environment — the image computer would receive head position information from the HMD through jack 114, compute the appropriate imagery for the user's position in the simulation environment and the direction of his gaze, and return that imagery through jack 114 to be displayed to the user in the HMD (not shown). Further, when the beamsplitter type HMD is used, if the virtual environment contains a representation of the cockpit interior (e.g., black polygons representing the lower display portion 75 and the central instrumentation bay 50, including the adjacent auxiliary displays 80), then the superimposition of the imagery representative of the computer generated simulation environment, including the cockpit interior representation, will be overlaid with the luminous portions of the actual cockpit interior. The combination will appear to the user as if he sat in a glass bubble, able to look in all directions, yet still have access to and sight of his controls and instrumentation.

Referring now to FIG. 6, there is shown a display monitor having a display 141 which is exemplary of the displays for the auxiliary display monitors 101 and secondary display monitor 110. The auxiliary display monitors 101, secondary display monitor 110, and their associated lighted momentary push buttons 104 function in a coordinated manner to provide information to the user, and controls for the cockpit 10. The monitors 101 and 110 are CRT monitors. The preferred auxiliary display monitor 101 is a 5" diagonal monochrome CRT, such as those manufactured by Wells-Gardner, of Chicago, IL. Alternatively, a graphic matrix LCD or LED display may be used. Above and below each monitor 101 (or to the right and left of monitor 110) there is located a set of lighted momentary push buttons 104. On the monitors 101 and 110 there is viewed the display 141, typically a bitmap, which contains information related to the buttons 104. For example, in the bottom right corner of the display 141 of FIG. 6, there is the display symbol 140 for a 140 shown.

This display symbol 140 is located directly above a button 104 and tells the function of the button 104. For each of the other active buttons 104, that is, a button 104 which has a active function, located along the bottom of the display 141 of FIG. 6, there is a display symbol 140 shown on the display 141 which is located directly above the button 104, coordinates to the button 104, and denotes the function of that button 104. For the top row of buttons 104, located above the display 141, there is shown a display symbol 140 on the display 141 which is directly below each button 104 and also denotes the function of the button 104 directly above it. In the middle of the display 141 there is shown additional controls information. When a user is in the cockpit 10, with the door to the cockpit closed, the inside of the cockpit 10 is dark; the only items visible in the interior of the cockpit 10 are those that are illuminated, or luminous. Those buttons 104 for which there is a corresponding display symbol 140 on the display 141 will be illuminated and considered active, having had an operational function assigned to the illuminated button 104. Those buttons 104 that are inactive will not be illuminated, and thus not visible to a user, will and will not have a display symbol 140 on the display 141 which coordinates to the inactive button 104. Should it be determined that another function is necessary at a particular display 141, an inactive button 104 may be assigned the new function, the display 141 bitmap easily modified to show a new display symbol 140 coordinated to the button 104, and the button 104 illuminated, becoming an active button 104 which can be seen from the inside of the cockpit 10.

In an alternative embodiment where buttons 104 are regions of a touchscreen overlaying auxiliary monitor 101, the display symbol 140 would be coincident with the region serving as the associated button.

As previously described, on either side of the secondary display 81, there is located an auxiliary display 80 with a speaker mounting panel 95 adjacent to and directly below the v. auxiliary display 80. This entire assembly -.— secondary display 81, the auxiliary displays 80 and speaker mounting panels 95 — extends from the equipment section rear bulkhead 41 into the equipment section 12 downward at an angle of approximately 27° to facilitate the user's viewing, and it is attached to the lower display wall 53 by the mounting bracket 109, and other mounting structure 109' located below speaker mounting panel 95.

The lower display portion 75 includes a leg area 69 in which is located the foot pedals 61 and leg room for the cockpit user. The leg area 69 extends from the passenger section forward bulkhead 31 through the equipment section rear bulkhead 41 to the foot pedal bulkhead 47 within the lower portion of the of the console section box 42' just above the equipment section base 45. When the user is ready to start his virtual reality experience, he locates the cockpit 10 designated for him by the external labeling display 44 on the outside of the cockpit 10 as shown in FIG 1. Other cockpits 10 may be networked to permit more than one user to access the simulation environment, and thus a VR game or program sequence, at one time. Each user then climbs into his designated cockpit 10 to begin. The user closes the door of the cockpit 10, which depresses a door-closed switch (not shown), that triggers a sound effect and starts the program sequence. If there are any problems, the operator can override the starting sequence and stop or suspend the program.

Once the door has closed, and the program has started, the peephole 130, located on the outside of the skin covering 30, allows an operator to view the inside of the cockpit 10 without breaking into the interior space of the cockpit 10, as would happen if the door were opened. In the event that the operator determines it is necessary to communicate with a user inside the cockpit 10, without opening the door, the operator may use the intercom jack 132 to plug in a headset (not shown) and talk with the user using the communication system provided, and previously described, for the cockpit 10. If necessary, the operator may use the external keypad 134 located on the outside of the skin covering 30 to override the program, or to activate various preprogrammed help functions, for example, functions that provide for operator override so as to assist user by take over some controls or altering cockpit modes. The cockpit 10 is constructed in three pieces to facilitate handling and transport. Movement of the cockpit 10 in multiple pieces facilitates navigating standard doors and elevators. A third piece, comprising the base 20, acts as a leveling bed for precise alignment of the two main sections at bulkheads 31 and 41.

Although the structure and operation of the apparatus has been described in connection simulation environments and the like, it is not intended that the invention be so limited. Various additional modifications of the described embodiments of the invention specifically illustrated and described herein will be apparent to those skilled in the art, particularly in light of the teachings of this invention. It is intended that the invention cover all modifications and embodiments which fall within the spirit and scope of the invention. Thus, while preferred embodiments of the present invention have been disclosed, it will be appreciated that it is not limited thereto but may be otherwise embodied within the scope of the following claims.

Claims

We claim as our invention:

1. An apparatus for providing a display system and user interface for an interactive computer system comprising: an enclosed cockpit having a reduced footprint, a display system having a view of a computer generated simulation environment, and an interface for providing communication from the user to the interactive computer system.

2. The apparatus claimed in claim 1 further comprising a dimensional sound system.

3. The apparatus claimed in claim 1 wherein the reduced footprint is no greater than 23 ft.²

4. The apparatus claimed in claim 1 wherein the reduced footprint is 7 ft. long and 3 ft. 4 in. wide.

5. A cockpit for an interactive computer system comprising: a covered frame and housing, and located within said covered frame and housing, a dimensional sound system, an infinity optics display system, and an interface for providing communication from the user to the interactive computer system.

6. The cockpit claimed in claim 5 wherein the covered frame and housing is totally enclosed.

7. The cockpit claimed in claim 5 wherein the dimensional sound system is a quadraphonic sound balanced three-dimensional (3D) localization system.

8. An apparatus for providing a display system and user interface for an interactive computer system comprising: a cockpit having a reduced footprint, a display system having a view of a computer generated simulation environment, a dimensional sound system, and an interface for providing communication from the user to the interactive computer system.

9. An apparatus as claimed in claim 8 wherein the cockpit is enclosed.

10. An apparatus as claimed in claim 8 wherein the dimensional sound system is a quadraphonic sound balanced three-dimensional (3D) localization system.

11. An apparatus as claimed in claim 8 wherein the display system is an infinity optics display system.

12. The apparatus claimed in claim 8 wherein the reduced footprint is no greater than 23 ft.²

13. The apparatus claimed in claim 8 wherein the reduced footprint is 7 ft. long and 3 ft. 4 in. wide.

14. A cockpit for an interactive computer system comprising: a covered frame and housing, and located within said covered frame and housing, a sound system, an infinity optics display system, a plurality of fully configurable interactive displays^', and an interface for providing communication from the user to the interactive computer system.

15. An apparatus as claimed in claim 14 wherein the sound system is a dimensional sound system.

16. An apparatus for providing a display system and user interface for an interactive computer system comprising: a cockpit, a display system having a view of a computer generated simulation environment, a plurality of fully configurable interactive displays, and a sound system, and an interface for providing communication from the user to the interactive computer system.

17. An apparatus as claimed in claim 15 wherein the sound system is a dimensional sound system.

18. An apparatus as claimed in claim 16 wherein the cockpit is totally enclosed.

19. An apparatus as claimed in claim 16 wherein the display system is an infinity optics display system.

20. An apparatus as claimed in claim 16 wherein the plurality of fully configurable interactive displays is configured with bitmaps.