GB2259213A - Variable resolution view-tracking display - Google Patents

Variable resolution view-tracking display Download PDF

Info

Publication number
GB2259213A
GB2259213A GB9118513A GB9118513A GB2259213A GB 2259213 A GB2259213 A GB 2259213A GB 9118513 A GB9118513 A GB 9118513A GB 9118513 A GB9118513 A GB 9118513A GB 2259213 A GB2259213 A GB 2259213A
Authority
GB
United Kingdom
Prior art keywords
operator
display apparatus
field
panoramic display
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB9118513A
Other versions
GB9118513D0 (en
Inventor
Barry Mcguiness
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BAE Systems PLC
Original Assignee
British Aerospace PLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by British Aerospace PLC filed Critical British Aerospace PLC
Priority to GB9118513A priority Critical patent/GB2259213A/en
Publication of GB9118513D0 publication Critical patent/GB9118513D0/en
Publication of GB2259213A publication Critical patent/GB2259213A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/363Image reproducers using image projection screens
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/08Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
    • G09B9/30Simulation of view from aircraft
    • G09B9/32Simulation of view from aircraft by projected image
    • G09B9/326Simulation of view from aircraft by projected image the image being transformed by optical means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • H04N13/383Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0149Head-up displays characterised by mechanical features
    • G02B2027/0154Head-up displays characterised by mechanical features with movable elements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B2027/0192Supplementary details
    • G02B2027/0198System for aligning or maintaining alignment of an image in a predetermined direction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074Stereoscopic image analysis
    • H04N2013/0088Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image

Abstract

A panoramic display apparatus 10 mounted, at least in part on a helmet 14 to be worn by an operator, in which apparatus there is a projection means 16 for projecting a high resolution stereo display within a small first field of view containing the foveal line of sight of an operator's eyes and a low resolution display outside said first field of view. The high resolution first field is used to present a detailed image of the object the operator is looking directly at whilst the low resolution field presents a low resolution peripheral image in the areas where the operator's eyes are incapable of perceiving high resolution images. One or other or both displays may be projected onto an eyeshield 24 or displayed via one or more active matrix liquid crystal displays which may be mounted on or form part of the eyeshield 24. The apparatus may be used with flight or other simulators, remote control apparatus e.g. robots, surface or space vehicles. Alternatively the apparatus may be combined with cameras to give an aircraft pilot an "all-round" view (fig 6). <IMAGE>

Description

AN EYE-SLAVED PANORAMIC DISPLAY APPARATUS The present invention relates to an eye-slaved panoramic display system and relates particularly, but not exclusively, to such an apparatus for use in applications that require remote or synthetic visual contact with the environment such as vehicle control, remote piloting, telerobotics and simulation.
Presently known systems for outside-world representation generally employ one of three methods for image display, namely: direct view monitor, video projection or, headlhelmet mounted display (HMD). Direct view monitors, such as cathode ray tubes (CRT's), offer reasonably high image resolution and are a popular display technique, both for sensor-derived and computer-generated images but they offer only a comparatively narrow field of view. The field of view can be increased by increasing the screen size but this cannot be done above a certain diameter without reducing image resolution or refresh rate. This can also be prohibitively expensive and can incur unacceptable size and weight penalties.
Video projection systems that employ multi-screen or dome-wall video projections can provide a large instantaneous field of view which in many cases is truly panoramic with over 1200 of view. Such systems provide the viewer with valuable peripheral information as well as a more realistic viewing area and, consequently, have become very popular in the field of flight simulation. These systems suffer from the problem of reduced image quality because the gain in field of view is obtained by simply expanding the original image across a larger surface at the expense of image quality (resolution and contrast).
The ESPRIT projector-based systems proposed by Singer-Link provides a so-called area-of-interest (AOI) visual simulator. In this system a wide-angle low resolution image is projected onto a simulator dome and is overlaid with a higher resolution, but smaller, eye-slaved image, provided by a separate servo-driven projector. Such a system does not lend itself to stereoscopic image presentation, nor to use by multiple viewers.
Head or helmet mounted display systems are being developed which present a condensed CRT-type image onto a head or helmet mounted eye piece. These can offer high resolution and with appropriate viewing conditions, good luminance contrast. The images are normally head-slaved (and could also, in theory, be eye-slaved) so that the wearer is able to guide his/her direction of gaze through a total potential field of view of up to 3600. In addition HMD systems can also provide binocular stereopsis, something which can only be approximated with direct-view and projection displays.
Unfortunately the field of view provided by HMD systems is relatively small (eg 600 binocular FOV, including 400 per eyepiece) and increasing the field of view without loss to image quality is prohibitively expensive in terms of image generation/ conversion.
None of the above mentioned systems is capable of providing a suitably sharp stereoscopic image with a large general viewing area without impairment of image quality or without overstretching the image generationl conversion systems.
It is therefore an object of the present invention to provide a panoramic display apparatus which mitigates the problems associated with the above mentioned systems.
Accordingly the present invention provides a panoramic display apparatus comprising a head position tracking device and an eye position tracking device which in combination enable an operator's foveal line of sight to be determined, means for dividing an operator's field of view into a first field containing an operator's foveal line of sight and a second field outside said first field, and projection means for projecting a high resolution display within said first field and a low resolution display in said second field.
It will be appreciated that the above mentioned apparatus exploits the limitations of the human eye, which is incapable of perceiving high resolution images outside a narrow (approximately 50) cone around the foveal line of sight, and provides a panoramic display apparatus that gives high image resolution only where the operator's eye is capable of perceiving it and a low resolution display outside this field. Such an apparatus is capable of providing a suitably sharp image with a large viewing area without impairing image quality and without over-stretching the image generation/conversion system.
Preferably, the apparatus includes an eyeshield of an operator's helmet onto which the high resolution display is projectable and a remote surface onto which the low resolution display is projectable.
Alternatively, the apparatus includes an eyeshield of an operator's helmet onto which the high andlor low resolution displays are projectable.
Conveniently, the above mentioned remote surface may be the interior surface of an aircraft canopy (or some other workspace interior).
The projection means may comprise a first projection system for projecting the high resolution display and a second projection system for projecting the low resolution display. In a particularly advantageous arrangement the high resolution display may be projected onto the eyeshield of an operator's helmet and the low resolution display is projected onto a remote surface such as the interior surface of an aircraft canopy.
In a simple arrangement the first projection system may comprise a first projector which presents an image alternately to both left and right eyes of an operator thereby to give a stereo image.
If just one projector is used in this way, the projection system may include an LCD shutter located at or near a source of said image and passive polarisers before an operator's eyes in order to present the image alternately to both left and right eyes.
Alternatively, the first projection system comprises first and second projectors locatable and operable in combination to present an image to both eyes of an operator in a manner which gives a stereo image.
One or more active matrix LCD arrays may also be used to project the high and/or low resolution displays. The array is/are transparent and locatable to form part or all of an eyeshield of an operator's helmet or is /arse mountable on said eyeshield.
Conveniently the first field of view may extend up to or slightly beyond an operator's foveal boundary. Gradation means may be provided for modifying the resolution of the first field at its periphery in a manner which matches or approximates the reduction in image resolution due to the human eye's acuity! eccentricity curve.
Computation means may be provided for computing the visual field location or locations of the high resolution first field or fields.
Conveniently, the first projection system may be mounted on a helmet to be worm by an operator and the second projection apparatus may be mounted remote from said helmet, thereby to enable the low resolution second field projection to be projected onto a remote screen.
In a particularly advantageous arrangement the second field of view extends to form a full field of view of up to 360 about an operator's X and Y axis, thereby to allow the operator to see in all directions including downwards and rearwards.
The above mentioned panoramic display apparatus may be used remotely to pilot a vehicle and/or in a robot/robotic system, thus avoiding exposing the operator to dangerous or inhospitable environments.
Advantageously two or more panoramic display apparatus may be linked to each other to form a network of visual displays for use with multiple operators and different information may be presented to each operator's high resolution first field of view thereby to provide the operators with only that information they require in order to perform their given task.
In a particularly convenient arrangement a helmet may be provided with a panoramic display apparatus as described above.
The present invention will now be more particularly described by way of example only with reference to the accompanying drawings in which: Figure 1 is a cross sectioned side elevation of an operator's helmet incorporating a panoramic display apparatus according to the present invention and an aircraft canopy, Figures 2 to 4 illustrate various alternative projector positions.
Figure 5 is a front elevation of two operators helmets incorporating panoramic display apparatus according to the present invention together with associated computation means, and Fig 6 is a perspective view of an aircraft incorporating a number of features the subject of the present invention.
Referring to Figure 1, a panoramic display apparatus 10 according to the present invention comprises a head position tracking device, such as an accelerometer 12, mounted on an operator's helmet 14, an eye position tracking device in the form of, for example, an infra-red LED oculometer 15 and a projection means shown at 16. In a preferred embodiment the projection means comprises a first projection system 18 for projecting a high resolution stereo display within a first field of view containing the foveal line of sight of an operator's eye 20 and a second projection system 22 for projecting a low resolution display outside said first field. It will however be appreciated that only one projection system 18 may be used if suitably modified to be able to project both the high and low resolution displays.
The first projection system 18 is preferably mounted on the operator's helmet 14 and arranged to project the high resolution display onto an eyeshield 24 of the helmet 14. The second projection system 22 may be arranged in any one of a number of ways as illustrated in figures 2 to 4 inclusive. In figure 2, the second projection system 22 comprises a number of static projectors 22a, b projecting onto, for example, the inner surface of a flight simulator dome. Alternatively, just one or two wide-angle, multi-axis, servo-drives, projectors may be provided and mounted, for example, above the operators head as shown in figure 3.Figure 4 illustrates yet another arrangement in which static video or laser projector(s) slaved to head-position by means of a flexible fibre optic link to head-position by means of a flexible fibre optic link 13 to the helmet; the images would then pass through a wide-angle projection device 22c mounted on the front of the helmet 14 before being projected on the remote surface 15. In a particularly advanced and compact arrangement, the second projection means may be arranged to project the low resolution display onto the eyeshield 24 of the helmet 14 alongside the high resolution display (see for example figure 1).
The first projection system 18 may include one or two projectors 18a,b. When just one projector 18b is used the system is further provided with a Liquid Crystal Shutter 26 at the image source and passive polarisers 28 located before the operator's eyes 20. In operation the shutter acts to deflect the source image alternatively to operator's left and right eyes in a manner which, in combination with the passive polarisers 28, acts to present an operator with a stereo high resolution image.
When the two projectors 18 are used each may be arranged to project the high resolution image to one or other of an operator's eyes thereby to provide a stereo image.
In a still further alternative arrangement the first projection system 18 is formed by one or more active matrix liquid crystal displays 30, 32 well known in the art and therefore not described herein. With suitable image processing just one display may be used to present both the high and the low resolution fields and the said one display is preferably mounted on or forms part of the eyeshield 24. When two displays 30, 32 are provided it will be appreciated that only that display presenting the high resolution display need be provided on the eyeshield. The display presenting the low resolution display can be provided on or form part of the eyeshield 24 or can be positioned remote from said eyeshield 24 if desired.
When the one or more displays 30, 32 are mounted on, or form part of the eyeshield 24 it or they may be of a transparent type thus allowing the operator to see real images which are present beyond the eyeshield 24, such as, for example, aircraft cockpit instruments and the like or a remotely projected low resolution display.
The oculometer 15, which monitors the eye position, and the head position sensor 12 are each linked to a computation device 34 via cables 36, 38 respectively. The computation device is configured to monitor the outputs from the oculometer and position sensor and determine the direction of the operator's foveal line of sight such that the high and low definition images may be projected relative thereto. Such an arrangement is well known and hence forms no part of the present invention other than to the extent that it enables the present invention to be operated.
In order to exploit fully the limitations of the human eye, which is incapable of perceiving high resolution images outside a narrow (approximately 50) cone around the foveal line of sight, the computation device 34 is also configured to determine the boundary of an operator's high resolution image perception and define the boundary of the display apparatus high resolution first field relative thereto. Preferably, the boundary of the first field extends up to or slightly beyond an operator's foveal boundary thereby to minimise the size of the high resolution display and mammise the size of the low resolution display and hence reduce to a minimum the computation power required to present the overall image to the operator.It will be appreciated that the operator's head and eyes will be constantly moving as he observes the display presented before him, consequently the computation means will be constantly updating the position of the first and second fields in order to provide the best possible display to the operator. Reduction in the computation power required to provide the overall display frees computation power to be used to speed up the image update rate thereby providing a more realistic overall image.
In operation, the high resolution first field may be used to present vital information to the operator, such as weapon or aircraft performance information, together with an enhanced view of that portion of the overall display the operator is looking directly at. Portions of the low resolution display may be enhanced in order tQ attract the operator's eyes to potential targets if desired.
Figure 6 illustrates an aircraft 40 which is provided with a number of remote cameras 42, 44, 46, 48 and 50 respectively set for forward, downward, upward and left and right viewing respectively. These cameras may be linked into the panoramic display apparatus 10 to provide the pilot operator with outside world visual information in all directions, including directions he would normally be unable to see. It will be appreciated that a pilot operator of an aircraft equipped with such cameras and display apparatus will be able to look down by rotating his head about axis Y-Y towards the cockpit floor for example and see a representation of the real world image on the other side thereof thus enabling him to make visual contact with landmarks or aircraft normally outside his field of view.If the pilot operator rotates his head about axis X-X he will be able to make visual contact with landmarks etc to his left and his right as well as behind the aircraft if a suitable remote camera if provided to point in this direction. The computation means may be configured to be selective with the outside world information it presents to the pilot operator, thus preventing him from being distracted by irrelevant detail.
An aircraft when provided with the above mentioned cameras and suitably modified to enable remote operation of the aircraft controls to be achieved lends itself to being remotely piloted by a pilot operator using a panoramic display apparatus 10 as described above. The operator would be provided with all the visual information he requires in order to fly the aircraft 40 without being exposed to the often hostile environment the aircraft is flown in.
It will be appreciated that whilst the panoramic display apparatus 10 has been described with reference to use on aircraft it also lends itself to use with mannedlunmanned surface vehicles and submersibles, robotic systems in nuclear power plants and teleoperation in space.

Claims (20)

1. A panoramic display apparatus comprising a head position tracking device and an eye position tracking device which in combination enable an operator's foveal line of sight to be determined, means for dividing an operator's field of view into a first field containing an operator's foveal line of sight and a second field outside said first field, and projection means for projecting a high resolution display within said first field and a low-resolution display in said second field.
2. A panoramic display apparatus as claimed in claim 1 including an eyeshield of an operator's helmet onto which the high resolution display is projectable and a remote surface onto which the low resolution display is projectable.
3. A panoramic display apparatus as claimed in claim 1 including an eyeshield of an operator's helmet onto which the high and/or low resolution displays are projectable.
4. A panoramic display apparatus as claimed in claim 3 in which the remote surface is an interior surface of an aircraft canopy.
5. A panoramic display apparatus as claimed in claim 1 or claim 2 in which the projection means comprises a first projection system for projecting said high resolution display and a second projection system for projecting said low resolution display.
6. A panoramic display apparatus as claimed in claim 5 in which the first projection system comprises a first projector which presents an image alternately to the left and the right eye of an operator thereby to give a stereo image.
7. A panoramic display apparatus as claimed in claim 6 in which the projection system includes a LCD shutter located at or near a source of said image and passive polarisers before an operator's eyes.
8. A panoramic display apparatus as claimed in claim 5 in which the first projection system comprises a first and second projectors locatable and operable in combination to present an image to both eyes of an operator thereby to give a stereo image.
9. A panoramic display apparatus as claimed in claim 1 including one or more active matrix LCD arrays for projecting the high and/or low resolution displays.
10. A panoramic display apparatus as claimed in claim 9 in which the one or more active matrix LCD arrays is/are of a transparent type and locatable to form part or all of an eyeshield of an operator's helmet or islare mountable on said eyeshield.
11. A panoramic display apparatus as claimed in any one of the preceding claims in which the first field of view extends up to or slightly beyond an operator's foveal boundary.
12. A panoramic display apparatus as claimed in any one of the preceding claims including graduation means for modifying the resolution of said first field at its periphery in a manner which matches the reduction in image resolution due to the human eye's acuity/eccentricity curve.
13. A panoramic display apparatus as claimed in any one of the preceding claims including a computation means for computing the visual field location or locations of the high resolution first field or fields
14. A panoramic display apparatus as claimed in any one of claims 3 to 11 in which the first projection system is mounted on a helmet to be worn by an operator and the second projection apparatus is mounted remote from said helmet.
15. A panoramic display apparatus as claimed in any one of the preceding claims in which the second field of view extends to form a full field of view of up to 3600 about an operator's vertical and/or horizontal axis.
16.A panoramic display apparatus as claimed in any one of the above claims when used remotely to pilot a vehicle and/or in a robotlrobotic system.
17. Two or more panoramic display apparatus as claimed in any one of the previous claims when linked to each other to form a network of visual displays for use with multiple operators.
18. Two or more panoramic display apparatus as claimed in claim 17 operable such that different information is presented in each operators high resolution first field of view.
19. A panoramic display apparatus substantially as herebefore described with reference to and as illustrated in Figures 1 to 3 of the accompanying drawings.
20. A helmet when provided with a panoramic display apparatus as claimed in any one of claims 1 to 18.
GB9118513A 1991-08-29 1991-08-29 Variable resolution view-tracking display Withdrawn GB2259213A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB9118513A GB2259213A (en) 1991-08-29 1991-08-29 Variable resolution view-tracking display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB9118513A GB2259213A (en) 1991-08-29 1991-08-29 Variable resolution view-tracking display

Publications (2)

Publication Number Publication Date
GB9118513D0 GB9118513D0 (en) 1991-10-16
GB2259213A true GB2259213A (en) 1993-03-03

Family

ID=10700628

Family Applications (1)

Application Number Title Priority Date Filing Date
GB9118513A Withdrawn GB2259213A (en) 1991-08-29 1991-08-29 Variable resolution view-tracking display

Country Status (1)

Country Link
GB (1) GB2259213A (en)

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0618471A2 (en) * 1993-03-29 1994-10-05 Canon Kabushiki Kaisha Image display apparatus and image photographing apparatus therefor
FR2706661A1 (en) * 1993-06-11 1994-12-23 Thomson Csf Simulator with a spherical screen of small dimensions and with devices for realistic visual display of external scenes
FR2711808A1 (en) * 1993-10-22 1995-05-05 Thomson Csf Device for projecting, onto a common medium (support), images which are intended for different observers
FR2718855A1 (en) * 1994-04-18 1995-10-20 Boisse Serge Optical information device e.g. for virtual reality spectacles, earphones, helmet
EP0714043A1 (en) * 1993-08-12 1996-05-29 Seiko Epson Corporation Head mount type image display device and information processor equipped with the device
WO1996018925A1 (en) * 1994-12-13 1996-06-20 Xenotech Research Pty. Ltd. Tracking system for stereoscopic display systems
WO1997035223A1 (en) * 1996-03-15 1997-09-25 Retinal Display Cayman Limited Method of and apparatus for viewing an image
EP0821338A2 (en) * 1996-06-27 1998-01-28 Sharp Kabushiki Kaisha Address generator for display and light modulator including a reconfigurable shift register
US5739893A (en) * 1993-08-20 1998-04-14 Seiko Epson Corporation Head-mounted image display apparatus
WO1999028894A1 (en) * 1997-12-02 1999-06-10 Raytheon Company Large screen display with projected overlay and method of using same
US6211976B1 (en) 1998-09-14 2001-04-03 Digilens, Inc. Holographic projection system
US6219435B1 (en) * 1996-12-06 2001-04-17 Nippon Telegraph And Telephone Corporation Method and system for producing computer generated holograms realizing real time holographic video production and display
GB2356757A (en) * 1999-11-29 2001-05-30 Seos Displays Ltd Image display apparatus
US6339486B1 (en) 1998-10-16 2002-01-15 Digilens, Inc. Holographic technique for illumination of image displays using ambient illumination
US6421109B1 (en) 1998-10-16 2002-07-16 Digilens, Inc. Method and system for display resolution multiplication
US6424437B1 (en) 2000-10-10 2002-07-23 Digilens, Inc. Projection display employing switchable holographic optical elements
US6473115B1 (en) 1996-06-04 2002-10-29 Dynamic Digital Depth Research Pty Ltd Multiple viewer system for displaying a plurality of images
US6504629B1 (en) 1999-03-23 2003-01-07 Digilens, Inc. Method and apparatus for illuminating a display
US6507419B1 (en) 1999-03-23 2003-01-14 Digilens, Inc. Illumination system using optical feedback
US6538624B1 (en) 1993-08-20 2003-03-25 Seiko Epson Corporation Head-mounted image display apparatus
US6678078B1 (en) 1999-01-07 2004-01-13 Digilens, Inc. Optical filter employing holographic optical elements and image generating system incorporating the optical filter
ES2200638A1 (en) * 2001-05-16 2004-03-01 Bsh And Fedders Internat Air C Air conditioning device with remote controller
EP1403680A1 (en) * 2002-09-27 2004-03-31 The Boeing Company Gaze tracking system, eye-tracking system and an associated method of calibration
US6781606B2 (en) * 1999-05-20 2004-08-24 Hewlett-Packard Development Company, L.P. System and method for displaying images using foveal video
WO2004113991A2 (en) * 2003-06-12 2004-12-29 Siemens Corporate Research, Inc. Calibrating real and virtual views
WO2006129307A1 (en) * 2005-05-30 2006-12-07 Elbit Systems Ltd. Combined head up display
CN100416336C (en) * 2003-06-12 2008-09-03 美国西门子医疗解决公司 Calibrating real and virtual views
EP2133729A1 (en) * 2008-06-11 2009-12-16 Honeywell International Inc. Method and system for operating a near-to-eye display
WO2011082159A1 (en) * 2009-12-29 2011-07-07 Elbit Systems Of America, Llc System and method for adjusting a projected image
CN103050028A (en) * 2012-12-28 2013-04-17 武汉理工大学 Driving simulator with stereoscopic vision follow-up function
CN103050027A (en) * 2012-12-28 2013-04-17 武汉理工大学 Driving simulator with stereoscopic vision
EP2600331A1 (en) * 2011-11-30 2013-06-05 Microsoft Corporation Head-mounted display based education and instruction
GB2526515A (en) * 2014-03-25 2015-12-02 Jaguar Land Rover Ltd Image capture system
US10185212B1 (en) 2017-07-24 2019-01-22 Samsung Electronics Co., Ltd. Projection display apparatus including eye tracker
US10257416B2 (en) 2015-04-10 2019-04-09 Samsung Electronics Co., Ltd. Apparatus and method for setting camera

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10318003B2 (en) * 2016-04-11 2019-06-11 Honeywell International Inc. System and method for providing aircraft autoflight capability feedback to a pilot
US11119567B2 (en) * 2017-03-23 2021-09-14 Interdigital Ce Patent Holdings Method and apparatus for providing immersive reality content
US20190302881A1 (en) * 2018-03-29 2019-10-03 Omnivision Technologies, Inc. Display device and methods of operation
CN112433599A (en) * 2019-08-26 2021-03-02 株式会社理光 Display method, display device and computer-readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4348186A (en) * 1979-12-17 1982-09-07 The United States Of America As Represented By The Secretary Of The Navy Pilot helmet mounted CIG display with eye coupled area of interest
US4421486A (en) * 1982-03-29 1983-12-20 The United States Of America As Represented By The Secretary Of The Navy Field of view test apparatus
US4479784A (en) * 1981-03-03 1984-10-30 The Singer Company Eye line-of-sight responsive wide angle visual system
US4634384A (en) * 1984-02-02 1987-01-06 General Electric Company Head and/or eye tracked optically blended display system
GB2201069A (en) * 1987-01-21 1988-08-17 Jonathan David Waldern Method and apparatus for the perception of computer-generated imagery
EP0284389A2 (en) * 1987-03-27 1988-09-28 KAISER AEROSPACE &amp; ELECTRONICS CORPORATION Helmet mounted display systems

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4348186A (en) * 1979-12-17 1982-09-07 The United States Of America As Represented By The Secretary Of The Navy Pilot helmet mounted CIG display with eye coupled area of interest
US4479784A (en) * 1981-03-03 1984-10-30 The Singer Company Eye line-of-sight responsive wide angle visual system
US4421486A (en) * 1982-03-29 1983-12-20 The United States Of America As Represented By The Secretary Of The Navy Field of view test apparatus
US4634384A (en) * 1984-02-02 1987-01-06 General Electric Company Head and/or eye tracked optically blended display system
GB2201069A (en) * 1987-01-21 1988-08-17 Jonathan David Waldern Method and apparatus for the perception of computer-generated imagery
EP0284389A2 (en) * 1987-03-27 1988-09-28 KAISER AEROSPACE &amp; ELECTRONICS CORPORATION Helmet mounted display systems

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
New Scientist, 29 September 1990, page 32. *
Scientific American, July 1986, pages 90 - 97. *

Cited By (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0618471A2 (en) * 1993-03-29 1994-10-05 Canon Kabushiki Kaisha Image display apparatus and image photographing apparatus therefor
US6445365B1 (en) 1993-03-29 2002-09-03 Canon Kabushiki Kaisha Image display apparatus and image photographing apparatus therefor
EP0618471A3 (en) * 1993-03-29 1995-11-08 Canon Kk Image display apparatus and image photographing apparatus therefor.
FR2706661A1 (en) * 1993-06-11 1994-12-23 Thomson Csf Simulator with a spherical screen of small dimensions and with devices for realistic visual display of external scenes
US6320559B1 (en) 1993-08-12 2001-11-20 Seiko Epson Corporation Head-mounted image display device and data processing apparatus including the same
EP0714043A1 (en) * 1993-08-12 1996-05-29 Seiko Epson Corporation Head mount type image display device and information processor equipped with the device
US7113151B2 (en) 1993-08-12 2006-09-26 Seiko Epson Corporation Head-mounted image display device and data processing apparatus including the same
EP0714043A4 (en) * 1993-08-12 1997-01-29 Seiko Epson Corp Head mount type image display device and information processor equipped with the device
US5977935A (en) * 1993-08-12 1999-11-02 Seiko Epson Corporation Head-mounted image display device and data processing apparatus including the same
US5739893A (en) * 1993-08-20 1998-04-14 Seiko Epson Corporation Head-mounted image display apparatus
US6538624B1 (en) 1993-08-20 2003-03-25 Seiko Epson Corporation Head-mounted image display apparatus
FR2711808A1 (en) * 1993-10-22 1995-05-05 Thomson Csf Device for projecting, onto a common medium (support), images which are intended for different observers
FR2718855A1 (en) * 1994-04-18 1995-10-20 Boisse Serge Optical information device e.g. for virtual reality spectacles, earphones, helmet
US6163336A (en) * 1994-12-13 2000-12-19 Richards; Angus Duncan Tracking system for stereoscopic display systems
WO1996018925A1 (en) * 1994-12-13 1996-06-20 Xenotech Research Pty. Ltd. Tracking system for stereoscopic display systems
US6407724B2 (en) 1996-03-15 2002-06-18 Digilens, Inc. Method of and apparatus for viewing an image
WO1997035223A1 (en) * 1996-03-15 1997-09-25 Retinal Display Cayman Limited Method of and apparatus for viewing an image
US6473115B1 (en) 1996-06-04 2002-10-29 Dynamic Digital Depth Research Pty Ltd Multiple viewer system for displaying a plurality of images
EP0821338A3 (en) * 1996-06-27 1998-11-11 Sharp Kabushiki Kaisha Address generator for display and light modulator including a reconfigurable shift register
EP0821338A2 (en) * 1996-06-27 1998-01-28 Sharp Kabushiki Kaisha Address generator for display and light modulator including a reconfigurable shift register
US6175352B1 (en) 1996-06-27 2001-01-16 Sharp Kabushiki Kaisha Address generator display and spatial light modulator
US6219435B1 (en) * 1996-12-06 2001-04-17 Nippon Telegraph And Telephone Corporation Method and system for producing computer generated holograms realizing real time holographic video production and display
US6151081A (en) * 1997-12-02 2000-11-21 Raytheon Company Large screen display with projected overlay and method of using same
WO1999028894A1 (en) * 1997-12-02 1999-06-10 Raytheon Company Large screen display with projected overlay and method of using same
US6211976B1 (en) 1998-09-14 2001-04-03 Digilens, Inc. Holographic projection system
US6421109B1 (en) 1998-10-16 2002-07-16 Digilens, Inc. Method and system for display resolution multiplication
US6339486B1 (en) 1998-10-16 2002-01-15 Digilens, Inc. Holographic technique for illumination of image displays using ambient illumination
US6678078B1 (en) 1999-01-07 2004-01-13 Digilens, Inc. Optical filter employing holographic optical elements and image generating system incorporating the optical filter
US6504629B1 (en) 1999-03-23 2003-01-07 Digilens, Inc. Method and apparatus for illuminating a display
US6507419B1 (en) 1999-03-23 2003-01-14 Digilens, Inc. Illumination system using optical feedback
US6781606B2 (en) * 1999-05-20 2004-08-24 Hewlett-Packard Development Company, L.P. System and method for displaying images using foveal video
GB2356757A (en) * 1999-11-29 2001-05-30 Seos Displays Ltd Image display apparatus
GB2356757B (en) * 1999-11-29 2004-02-04 Seos Displays Ltd Image display apparatus
US7218328B2 (en) 1999-11-29 2007-05-15 Seos Limited Image display apparatus
US6424437B1 (en) 2000-10-10 2002-07-23 Digilens, Inc. Projection display employing switchable holographic optical elements
ES2200638A1 (en) * 2001-05-16 2004-03-01 Bsh And Fedders Internat Air C Air conditioning device with remote controller
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7130447B2 (en) 2002-09-27 2006-10-31 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
EP1403680A1 (en) * 2002-09-27 2004-03-31 The Boeing Company Gaze tracking system, eye-tracking system and an associated method of calibration
WO2004113991A3 (en) * 2003-06-12 2005-02-24 Siemens Corp Res Inc Calibrating real and virtual views
WO2004113991A2 (en) * 2003-06-12 2004-12-29 Siemens Corporate Research, Inc. Calibrating real and virtual views
CN100416336C (en) * 2003-06-12 2008-09-03 美国西门子医疗解决公司 Calibrating real and virtual views
WO2006129307A1 (en) * 2005-05-30 2006-12-07 Elbit Systems Ltd. Combined head up display
EP2133729A1 (en) * 2008-06-11 2009-12-16 Honeywell International Inc. Method and system for operating a near-to-eye display
US8416152B2 (en) 2008-06-11 2013-04-09 Honeywell International Inc. Method and system for operating a near-to-eye display
US9594248B2 (en) 2008-06-11 2017-03-14 Honeywell International Inc. Method and system for operating a near-to-eye display
US8982480B2 (en) 2009-12-29 2015-03-17 Elbit Systems Of America, Llc System and method for adjusting a projected image
WO2011082159A1 (en) * 2009-12-29 2011-07-07 Elbit Systems Of America, Llc System and method for adjusting a projected image
EP2600331A1 (en) * 2011-11-30 2013-06-05 Microsoft Corporation Head-mounted display based education and instruction
CN103050027A (en) * 2012-12-28 2013-04-17 武汉理工大学 Driving simulator with stereoscopic vision
CN103050028B (en) * 2012-12-28 2015-04-08 武汉理工大学 Driving simulator with stereoscopic vision follow-up function
CN103050027B (en) * 2012-12-28 2015-04-08 武汉理工大学 Driving simulator with stereoscopic vision
CN103050028A (en) * 2012-12-28 2013-04-17 武汉理工大学 Driving simulator with stereoscopic vision follow-up function
GB2526515A (en) * 2014-03-25 2015-12-02 Jaguar Land Rover Ltd Image capture system
US10257416B2 (en) 2015-04-10 2019-04-09 Samsung Electronics Co., Ltd. Apparatus and method for setting camera
EP3481049A1 (en) * 2015-04-10 2019-05-08 Samsung Electronics Co., Ltd. Apparatus and method for setting camera
US10185212B1 (en) 2017-07-24 2019-01-22 Samsung Electronics Co., Ltd. Projection display apparatus including eye tracker
EP3435661A1 (en) * 2017-07-24 2019-01-30 Samsung Electronics Co., Ltd. Projection display apparatus including eye tracker
CN109302594A (en) * 2017-07-24 2019-02-01 三星电子株式会社 Projection display equipment including eye tracker

Also Published As

Publication number Publication date
GB9118513D0 (en) 1991-10-16

Similar Documents

Publication Publication Date Title
GB2259213A (en) Variable resolution view-tracking display
US6078427A (en) Smooth transition device for area of interest head-mounted display
US4348185A (en) Wide angle infinity display system
US5348477A (en) High definition television head mounted display unit
US6222675B1 (en) Area of interest head-mounted display using low resolution, wide angle; high resolution, narrow angle; and see-through views
US4994794A (en) Methods and apparatus for displaying data
Furness III The super cockpit and its human factors challenges
US7542210B2 (en) Eye tracking head mounted display
US4028725A (en) High-resolution vision system
US6814578B2 (en) Visual display system and method for displaying images utilizing a holographic collimator
US5581271A (en) Head mounted visual display
US4697879A (en) Airborne system for display of collimated images
EP0395570A2 (en) Helmet mounted display configured for simulator use
JPH08286275A (en) Image projection display
WO1992018971A1 (en) Head-mounted projection display system featuring beam splitter
Kiyokawa An introduction to head mounted displays for augmented reality
US6151081A (en) Large screen display with projected overlay and method of using same
Schwartz Head tracking stereoscopic display
Wells et al. The human factors of helmet-mounted displays and sights
Melzer et al. Partial binocular-overlap in helmet-mounted displays
McLean et al. Developing a wide field of view HMD for simulators
Winterbottom et al. Helmet-Mounted Displays for use in Air Force Training and Simulation
EP0065837B1 (en) Display of information
Fukai et al. Color and high-resolution head-mounted display
de Vries et al. Steering a simulated unmanned aerial vehicle using a head-slaved camera and HMD

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)