CA2306713A1 - Multi-image compositing - Google Patents

Abstract

Image compositing apparatus and methodology for the creation, in a defined volume of three-dimensional space, of a composite organization of plural images/visual phenomena, including at least one projected real image (104), displayed in formats including (a) front-to-rear, (b) side-by-side and (c) overlapping and intersecting, adjacency. The apparatus incorporates different unique arrangements of visual sources (110, 112), and optical elements including concave reflectors (114), beam splitters (116) and image-forming/image-transmissive scrim/screen structures (334). In one important modification of the system, which does not necessarily require compositing, a projected real image is derived from an image-producing data stream containing three-dimensional image cues selected from the group consisting of shading, occlusion, perspective, motion parallax, size vs. depth, light (chroma value) vs. depth and definition vs. depth. In a further important modification of the invention, a system (620) is proposed which allows a viewer/user to interact directly with a projected real image, in a manner allowing the manipulation of one or more characteristics or aspects of the image.

Description

MULTI-IMAGE COMPOSITING
Reference to Related Application This application is related to U.S. Patent No. 5,311,357, filed December 3, 1992, by Susan Kasen Summer and Burkhard Katz for DEVICE
FOR THE CREATION OF THREE-DIMENSIONAL IMAGES. Also of interest are U.S. Patents Nos. 4,802,750 to Welck, entitled REAL IMAGE
PROJECTION SYSTEM WITH TWO CURVED REFLECTORS OF
PARABOLOID OF REVOLUTION SHAPE HAVING EACH VERTEX
COINCIDENT WITH THE FOCAL POINT OF THE OTHER, and 5,257,130 to Monroe, entitled APPARATUS AND METHOD FOR
CREATING A REAL IMAGE ILLUSION, and of Swiss Patent No. CH
679342 A5, entitled APPARATUS FOR PROJECTION OF OBJECTS.
Background and Summary of the Invention The present invention relates to apparatus and methodology for the compositing of multiple, viewable phenomena/sight-stimulators, such as multiple images and real objects, and in particular, to such apparatus and methodology which includes the incorporation into such compositing formation of at least one projected real image.

WO 9s/19s8a PCT/US9Sl00512 The power of visual ima~en~ has fascinated and captured people for decades, and as new visual-imagery technology has emerged in recent years, the possibilities for presenting startling, dramatic visual phenomena have leapt onto the communicating landscape with powerful, attention-getting boldness. Long recognized, for example, have been the striking, attention-capturing power of motion pictures, of television, of three-dimensional graphics and displays, of magical floating-in-space images, and of others, and this attention-getting capability is widely recognized as a powerful tool in the creative communication "playing" fields of amusement, advertising, basic information conveyance, clarification of hard-to-otherwise-visualize phenomena and relationships, medical diagnostics, and many, many others.
In this setting, the present invention steps onto the "communication stage" with a highly innovative and advanced systemic apparatus and methodology that allows for the selective compositing, in a defined viewable volume of space, of wonderfully innovative multiple-layer, adjustably positionable composite images, including at least one three-dimensional real image, which advance opens important doors in all of the fields mentioned above (as well as many others) neither openable, nor even approachable with prior art technology.
Described hereinbelow, and illustrated in the plates of drawings which form pan of this invention disclosure, are numerous key embodiments of the system and methodology of the invention, with all embodiments offering the core capability of compositing, in three-dimensional space, multiple images, including at least one real image, where any two images (or visual phenomena) are organized, at any given point in time, with at least one of formats (a) front-to-rear, (b) side-by-side and (c) overlapping and intersecting, adjacency. If desired, these formats may be combined in different ways. Each of these formats is, of f course, taken with reference to the specific point of view of an observer.
So, for example, the front-to-rear format may exist with respect to a viewer looking at the created composite ima~erv generall along a horizontal axis, as well as such a person view ng the composite imagew alon<_ a more upright axis. The ima«crv, or am~ component thereof may he moveable in the composite settin~_. eiti~er by \ ii iU~ of i.7~ l:W , ,:~::lt ill: i C ~::.~ ~ JW .ii t: iius,i.'vLJ IiiO1 L117Li7t, ()f lO\ \.. _ , ii :ut ()1 tilt WO 95/19S8a PCTIUS95100512 _ ;_ provision of moveable optical structure which plays a role in the creation of the composite whole.
A special feature of the present invention includes the cooperative relationship, for example, between: (a) a source of three-dimensional imagery ' S (other than a real object source), which source includes a visual-image database itself containing "entrained" psychological optical cues that dramatically promote the perception of real three dimensionality; (b) a two-dimensional screen device, such as a video monitor, which forms from a data stream provided by this database a related image (rnoving or still) which contains the relevant three-dimensional cues; and (c) a real-image optical projection system that acquires such a screen-device-borne image and projects the same into space in a setting which is free of (unencumbered by) physiological impediments, such as a frame or a border, that might detract from the apparent, real, three-dimensionality of the projected real image.
Still another important feature of the invention described and claimed herein is the presence of an organization, in certain embodiments, of a system which allows a viewer/user to interact directly with a projected real image, in effect to manipulate one or more characteristics or aspects of the image.
For example, and to illustrate this notion, one can imagine the projection into space of a real image of a piece of fruit, such as a pear, in a setting which permits the viewer/user to "grasp" the pear, and to rotate or otherwise move it, for example.
One of the extraordinary capabilities of the system of the present invention, as will be described and illustrated more fully hereinbelow, is that it is possible to composite, in essentially or approximately a single plane, slightly staggered/offset pixelated or rastered, images (and the like), as, for example, might be derived from a video source, in a manner resulting in a composite projected real image having greatly enhanced image resolution. In such an application, of course, the several sources which result in the end-result composite image would be dra~-n from nreciselv the same foundation image source material.
t 30 In other words, were, for example, three video images composited in this fashion and to this end, the ssme i~m«~ III:.VCr1! would he uccurrin~~ at tile same inument r ;_.. o r .i_ , .t_. ~
l~. im:~ ~)o ..=~. Ui W m:..v t):: ..~:i vidl'W lii.ir~C~.

As will be apparent from a reading of the description which follows, along with a viewing of the respective, different drawing plates, each of the systems described herein has, as a part of what is referred to as viewing-enabling structure, one or more optical elements which are common to other disclosed systems though each system specifically shown herein has, generally speaking, an optical arrangement or organization which is specifically different from the arrangements of the other systems. Also, and with respect to the illustrated and described systems, various sources (image-effecting, sight-stimulator-effecting) of ultimately viewable imagery, occupying suitable location stations, are common from one system to another, but somewhat differently arranged in order to cooperate appropriately with related optical elements (system optical structure).
The different optical elements (arrangements) which are combined in the systems described are individually known and understood in the world of optics, and accordingly, great detail about the positioning, sizing and relative locating of these elements, which is well understood by those skilled in the art, is omitted from this text. The prior patents referred to above, taken together with the drawings and description herein, afford an abundant base of information for one of ordinary skill in the art fully to appreciate the respective operations of the several systems shown and discussed, as well as to understand the powerful potential for the core contribution of this invention in enabling the spatial compositing of multiple images as contemplated by the invention.
Further explaining something in general terms about the apparatus descriptions which are to follow, it will be immediately evident that the various optical elements and imagery sources in each disclosed system must be, and are, integrated interactively and operatively with one another so that their respective positions relative to one another result in the placement and compositing of images in a spatial station (visual staging station) which is easily viewable by an observer.
In some instances, it will be immediately apparent from the drawing figures that the nature of this system integration structure takes the form of a cart or a housing or some other evident kind of framework, but in certain other illustrations of _ CA 02306713 2000-OS-02 systems, the details of specific system integration structure are omitted in favor of a bracket in the figure which is presented there specifically to symbolize the presence of such structure.
This invention provides visual display apparatus including:
a visual staging station defining a space for viewing images from a vantage point along a viewing axis, and viewing enabling structure associated operatively with said station and with said space for enabling placement therein of a composite organization of at least two viewable phenomena, one of which takes the form of an optically-projected real image that appears to float in space in front of the staging station without aid of a stereoscopic device, each of said at least two phenomena being located along the viewing axis and viewable by both eyes of a viewer positioned at the vantage point.
This invention also provides visual display apparatus including:
a visual staging station defining a space for viewing images from a vantage point along a viewing axis, and viewing enabling structure associated operatively with said station and with said space for enabling placement therein of a composite organization of at least two images, one

2 0 of which takes the form of an optically-projected real image that appears to float in space in front of the staging station without aid of a stereoscopic device, each of said at least two images being located along the viewing axis and viewable by both eyes of a viewer positioned at the vantage point.
This invention also provides a real image interaction system incorporating a visual 2 5 display apparatus as described above, said system including:
a source for displaying a visual image, a real image generating optics device associated with the source so that a real image version of the visual image can be generated in a defined spatial location, a sensor capable of generating a data stream relatable to a person's physical or

3 o verbal expression and a processor capable of interpreting the data stream then generating and transmitting corresponding image modification signals to the source so that the system can enable the person to indirectly manipulate the real image through verbal or physical expression.

-Sa-This invention also provides a visual display system incorporating a visual display apparatus, said system including:
a source station occupiable by a source for a projected real image, said visual staging station occupying a location spaced from said source station, a beam splitter optically interposed between said source station and said staging station, and optical co-acting structure co-actable with said stations and said beam sputter to 1 o create in said staging station a real image of any source material present in said source station.
This invention also provides a visual display method including:
selecting multiple sources for display of viewable phenomena;
by means of a viewing-enabling structure, placing in a visual staging station which defines a space for viewing images from a vantage point along a viewing axis, a composite organization of at least two viewable phenomena derived from selected sources, one of such phenomena taking the form of an optically projected real image that appears to float in space in front of the staging station without aid of a stereoscopic device, and organizing such phenomena in such station in a manner whereby each of said at least 2 o two phenomena is located along the viewing axis and viewable by both eyes of a viewer positioned at the vantage point.
This invention provides a visual display apparatus comprising a visual staging station defining a space for viewing images from a vantage point along a viewing axis, 2 5 a beam sputter located along the viewing axis in said space, the beam sputter having a front side partially facing the vantage point, and a back side opposite from the front side, wherein the beam sputter is oriented obliquely relative to the viewing axis, a first image source equipped and positioned to display a first image directed toward the front side of the beam sputter so that, to a person viewing the staging station 3 o from the vantage point, the first image appears to be a background image located behind the beam sputter substantially along the viewing axis, _. _ _ ~ _ __.__._ _ CA 02306713 2000-OS-02 -Sb-a second image source equipped and positioned to display a second image directed along the path leading toward and through the backside of the beam splitter along the viewing axis toward the vantage point, and an optical structure located along the path between the second image source and the beam splitter, wherein the optical structure causes divergent rays from the second image to converge substantially along the viewing axis in front of the beam splitter, so that, to a person viewing the staging station from the vantage point, the second image appears as 1 o a floating real image in front of both the beam sputter and the background image.
In the aforementioned visual display apparatus, the optical structure may include at least one curved mirror, plural mirrors, or at least one parabolic mirror. The beam sputter may form about a 45-degree angle relative to the viewing axis. The first image source may face in a direction substantially perpendicular to the viewing axis. The optical structure may include an element which is at least partially light transmissive. The .display apparatus may further comprise a housing for substantially encasing the image sources and optical structure .
In the aforementioned display apparatus, the second image source may be provided with a data stream containing three-dimensional image cues selected from the group 2 o consisting of shading, occlusion, perspective, motion parallax, size versus depth, light versus depth and definition versus depth, and combinations thereof, so that the floating real image in front of the beam sputter appears to be three-dimensional from the vantage point along the viewing axis.
The aforementioned display apparatus may further comprise a control mechanism 2 5 which allows a viewer to interact with the floating real image in front of the beam splitter.
The various objects and important advantages sought for and offered by the apparatus and methodology of the present invention, alluded to above, will become apparent as the description which follows is read in conjunction with the accompanying drawings.

-Sc-Description of the Drawings The several drawings which form part of this disclosure are schematic in nature, and are not presented herein with any precise scale, or exact dimensional relative inter-relationship of components.
Fig. 1 is a schematic illustration of one embodiment of an image compositing system constructed in accordance with the present invention, with this embodiment including a dual-sector real image projector and a piano beam sputter, with two video 1 o sources, to create a composite image including a projected foreground real image and a background virtual image.
Fig. 2 is a schematic illustration of another embodiment of the invention employing a dual-sector real image projector and a piano beam splitter, along with a video source and a projected-onto-screen source, to create a composite image including a foreground projected real image and a background virtual image.
Fig. 3 illustrates schematically another embodiment of the invention which employs a dual-sector real image projector, along with a video source and a three-dimensional object display, to create compositing between the real object display and an overlying projected real image.
2 o Fig. 4 illustrates another embodiment of the invention employing a dual-sector real image projector and a piano beam splitter, along with two video sources, to create a composite image including a projected real image foreground and a virtual image background.
Fig. 5 shows a somewhat modified form of the invention appearing in 2 5 Fig. 4 - here illustrating the cooperative use of a single-sector optic portion ~of a real image projector along with a piano beam sputter, and two video sources.

WO 9511958 pC'T/iJS95/00512 -ri-to create a composite image including a foreground projected real image and a background virtual image.
Fig. 6 illustrates another embodiment of the invention employing a dual-sector real image projector and two video sources to create a composite image including a projected real image and an underlying screen-borne image which appears on the screen of one of the two video sources.
Fig. 7 depicts another invention embodiment which is somewhat similar to that illustrated in Fig. 6, except that here there is employed a single-sector optic portion of a real image projector along with a piano beam splitter to create the same kind of composite image discussed above in relation to the embodiment of Fig. 6.
Fig. 8 illustrates another modified embodiment of the invention which is related to the embodiment shown in Fig. 2, except that it differs from that embodiment in the same structural way that the embodiment of Fig. 7 differs from the embodiment of Fig. 6. This system, as does the system of Fig. 2, creates a composite image including a foreground projected real image and a background virtual image.
Fig. 9 displays another embodiment of the invention which employs a dual-sector real image projector, a spherical mirror, and a pair of piano beam splitters to create a composite image which includes a foreground projected real image and a background expanded/collimated virtual image.
Fig. 10 shows an embodiment of the invention which is somewhat similar to that drawn in Fig. 9 -- here including a dual-sector real image projector, a spherical mirror, and a pair of piano beam sputters, along with three video sources, to create a composite image including a foreground projected real image, and two, front-to-rear-separated, background virtual images, including an expanded/collimated virtual image.
FiQ. 11 illustrates another embodiment of the invention which can be thousTht of as a modification of the embodiment shown in Fi~. 9, differing in respect of the fact that it empiovs but one sin«ie-sector optic portion of a real lIlid'~C p1()~c'.Ct01- slrllClU)-e CO;:)i)IIIc.Ii uyii7 s i~i:nl~i I)C3117 a,,)i111c'f, ;iillj W'ltll Llic' i V1'O 95/1958-t PC?NS95/00512 _'7 _ overall system creating a composite image including a foreground projected real image and a background expanded/collimated virtual image.
v . Fig. 12 illustrates yet another embodiment of the system of the invention, which can be thought of as a modification of the embodiment shown in Fig. 10, with this modification differing from the structure in Fig. 10 in the same manner that the structure illustrated in Fig. 11 differs from the structure shown in Fig. 9, and with the further difference that the system organization of Fig. 12 creates a composite image including two front-to-rear-relatively-displaced, projected real images against a background virtual image.
Fig. 13 shows a modified embodiment of the system which creates a composite image organization like that created by the system illustrated in Fig.
12, with the system of Fig. 13 including a pair of single-sector optic portions of a real image projector, each combined with a respective piano beam splitter, along with three video sources.
Figs. 14 and 15 are directly related schematic drawings of one form of a theater-environment system constructed in accordance with the invention, with Fig. 14 illustrating a plan view, and Fig. 15 illustrating a section/side elevation. The system of Figs. 14 and 15 includes three projection sources along with three additional video sources, in combination with a cascaded interleaving organization including two piano beam splitters, three screen/scrim structures (image-forming surface structures), and a dual-sector real image projector, to create a composite image which, in addition to a projected real image, can include up to five other distributed images.
Figs. 16 and 17 are related to one another, and show another form of a theater-environment system constructed in accordance with the invention, which system also uses herein three projection sources along W th three additional _ video sources, and a somewhat different arrangement of cascaded interleaved beam splitters and screen/scrim structures, along with a spherical mirror, to create another kind of mufti-layered composite image somewhat line th;7t creatahle by the s\~stem illustrated in Figs. 14 and 1 ~.
Fi~~. l<s illustrates still anther emhodimen; of th: waem of the pr~J~Ii; 111\C171iUi7. \sillOi7 C177I1~;1177c_171 11W iUOe~, it)lll-\-lllC() s~rUllt~. ;:~tlli_ \slill I\lv), WO 9~/1958.i pCT/US95/00512 -dual-sector, real image projectors, and a plano beam splitter, to create a composite image including a pair of projected real images, a screen-borne image beneath the two real images, and a virtual image beneath all of the other images.
Fig. 19 illustrates yet a further embodiment of the invention, here taking the form of a distributed array of dual-sector, real image projectors and plano beam splitters, organized with an object source for each projector, and with one, additional video source, with this embodiment enabling the creation of a composite stack of real images, one for each of the sources, overlying and thus composited with a screen-borne viewable image generated by the video source.
Fig. 20 illustrates still another embodiment of the invention which includes a dual-sector, real image projector disposed on one side of a screen/scrim structure, and a pair of sources including a video source and a projector, all cooperating to create a composite image including a foreground projected real image (projected through the screen/scrim structure) displayed against a background image projected onto the "viewing", image-forming side of the screen/scrim structure.
Fig. 21 shows another embodiment of the invention which includes a dual-element, spherical-component, real image projector, and behind one of the elements in the projector, which element is at least partially transmissive to light, a video source which presents a screen-borne image. All of this cooperating structure creates a composite image including a foreground projected real image displayed against a background screen-borne image, which screen-borne image is thus viewable through one of the optical elements in the real image projector which is effective to create the projected real image.
Fig. 22 illustrates still another modification of the invention which is somewhat similar in its organization to that illustrated in Fig. 20, with the structure of Fig. 22 including a dual-sector real image projector, a scrim/screen structure through which a real image is projected, and a projector for projecting and creating a screen-borne image on the "view no" side of the screen/scrim 3U structure. This embodiment results in the production of a composite imaee includin~_ a foreground ~r<yecteci real ~ma~e ciisplaved a~ain~t :.~
haci;«ronnd pr~ieceu-onto-,..rcu for >mco-io>ro~~~ im,i~~c_ ~ ~,. , _ v ,. WO 95/19581 pCT/US95HH1512 _Q_ Fig. ?3 illustrates another form of the invention which includes a real-image projector in the form of a single-element spherical mirror, and a cooperating piano beam splitter, both of which work together to create a composite image including a foreground-projected real image and a background virtual image.
Fig. 24 illustrates a fragmentary plan view of an amusement system characterized by an amusement ride having, distributed along its ride path, several (three in the drawing) image-co;npositing systems constructed, for example, in accordance with any one of the embodiments specifically illustrated in other drawing figures herein.
Fig. 25 is a view which relaxes to Fig. 24, and shows, in side schematic form, viewers in an amusement sidecar approaching one of the image-oompositing systems depicted in Fig. 24, with the particular kind of oompositing system which is shown in Fig. 25 including a dual-sector, real image projector IS which projects, as de 'rived from a rear-projection screen, a foreground real image through a screen/scrim structure, onto which structure is projected a screen-borne image derived from a projector disposed on the "viewing" side of the screen/scrim structure.
Fig. 26 is a view of a system very much like that which is illustrated in Fig. 19, but differing in the fact that here what is shown is a system for greatly enhancing the resolution of a video image provided simultaneously ~on each of three spaced video monitors, with there resulting from this arrangement a composite, approximately single-layer projected real image which is formed by effective staggering of the images drawn specifically from each of the three video sources to enhance greatly the resulting image resolution. For the purpose of clarity in this figure, the three components of the resulting projected real image are actually show in a significant)v out-of-single-plane manner in order to clarify understanding of what is occurring in the operation of this system.
Fio. 27 is a schematic/block view' of a modified form of the system 3U wherein an aeriallv suspended three-dimensional-appearing image is projected a ii rc'.ai ima~~C U:(.~c:U U~)Uii VisUaii ~VU~ic: il:ii:: Vs171CI) ll7CIUdC:S
U17~' UnC or iliUi-C Ui ;a ~~;::i:i~ ('Ji E)W'Cru)iU~:;:,''.ii:v ;iiv:::'~';::. s :;;:~:-i~iil~:rlSiO:~~.i li~;;''~,' ~:1:~..

' wo 9:vi9sa.~ r~r~s~osiz Fig. ?$ is a perspective schematic view illustrating a system allowing viewer/user interaction with an image in a setting whereby the user employs a trackable, worn glove in a region adjacent the location of the image. .
Fig. 29 is a schematic view of a system, somewhat like that illustrated in Fig. 28, wherein a user, wearing a trachable glove interacts with a P~j~ed real image, such as the imago of a pear.
Fig. 30 is a schematic view of a system, somewhat like that depicted in Fig. 29, wherein a user, without the employzaeat of a trackablc glove, can interact directly, as far example by grasping, a projected real image to manipulate the orientation, position, etc. of the same.
F3g. 31 is a schematic illustration of the projocted real image o~ for example, a board game, with rrspect to which a user is permitted to interact in s fashio~a moviag, as indicated by vertical and h~ixontal arrows is the f gore, a player, piece, etc., which forms part of the $ame. , Turning atteation now to the drawit~, atui referring 5rst of all to Fig. 1, indicated generally at 100 is one form of visual display apparatus constructed in accordance with the invention. Apparatus 100 operates, as will be explained, to create, in a visual staging station shown gener$lIy at 102 which occupies a defined volume of viewable space, a composite organization of awltiple viewablc phenomena, and specifically here, a pair of images.
including a real image 104' in the foreground and a virtual image 106 iu the badcgs'ound.
The point of view of an observer is laterally to the left of the apparatus iilustratod in this figure.
This same terminology ("visual staging station", "defined volume of viewable space" and "composite organization of multiple viewable phanomena").
and general organization, charactcriu all of the other spec system embodiments which are shown in the other drawing figures. Accordingly, all of this terrninolog_v m'll not necessarily be repeated in the respective descriptions of the other drau~ng fi~urc~. Apparatus 100, as is true for the other system apparatus disclosed herein, is also referred to ac a system for establishing viewability of sight stimulators, and further as a system for producing a composite organization of multiple images. Where the terms viewable phenomena and sight stimulators are used, it is intended that these phrases be understood to include real, three-dimensional objects as well as images. Where the term image is used, this is intended to include real images, screen-borne images (i.e., projection-based images as from a film projectors, a slide projector, a video unit) and virtual Images.
The key operative components which make up apparatus 100 are suitable fixed and contained within the frame 108 of a cart, which is also referred to herein as system integration structure.
Two sources of imagery are included in apparatus 100, and these are a large-screen, rear projection video unit 110 which faces nearly straight downwardly in Fig. 1, and another, smaller-screen video source 112 which faces upwardly in Fig. 1. Located intermediate these two sources are a dual-sector, parabolic, concave real image projector 114, and a plano, reflective beam splitter 116, positioned and oriented relative to one another, and to the two imagery sources, as illustrated in Fig. 1.
Projector 114 is constructed precisely in accordance with the teachings of the aforementioned Welck patent, and works exactly as is described in that patent. This projector includes two concave, optically confronting, cooperative, reflective surfaces which extend in space in a manner discontinuous from one another (i.e., their extensions intersect). While in many instances, it is preferable to use, as a real image projector, a structure based upon parabolic optics, such as the one shown in the structure of Fig. 1, other concave reflecting surface structures, such as spherical structures, elliptical structures, and others, may be used.
Beam sputter 116 is a reflectively coated sheet of glass (or the like) which allows light transmission through it.
With operation of the system shown in Fig. l, projector 114 creates, from the screen of source 112, real image 104, and beam splitter 116 creates, from the image appearing on the screen of source 110, virtual image 106. From ' CA 02306713 2000-OS-02 WO 95/1958) _l the point of view (mentioned above) of an observer, real image 104 resides in the foreground, and virtual image 106 in the background.
Fig. 2 shows at 118 another form of visual display apparatus constructed in accordance with the invention, with this system creating, in a viewing station 120 which is somewhat like previously mentioned viewing station 102, a composite of multiple images including a foreground real image 122 and a background virtual image 124.
Forming part of apparatus 118 are two imagery sources including a video source 126 and a projected image source including a projector 128 and an overhead screen 130. Also included in apparatus 118 are a dual-sector real image projector 132, which is like previously mentioned projector 114, and a piano beam splitter 134 which is like previously described beam splitter 116.
Hereinafter, where reference is made to a dual-sector real image projector, and to a piano beam splitter, it should be understood that these respective structures have the same characteristics, respectively, as projectors 114, 132 and beam splitters 116, 134.
Light from projector 128 passes through beam splitter 134 to form an image on screen 130, and the image on this screen is reflected to the viewer via beam sputter 134 to create virtual image 124. The viewer's point of view in Fig. 2 is laterally to the right of the structure shown in this figure.
From the image which appears at the site of video source 126, projector 132 creates foreground real image 122.
Turning attention now to Fig. 3, here there is shown at 136 another visual display system embodying the present invention, and including a housing 138 in which are mounted a dual-sector real image projector 140, a video source 142, a real object display 144 u-hich takes the form of an imaginary playing field, and a piano beam splitter 146 w-hich directly overlies this object-organized playn~
field.
~'Vith operation of system 136, projector 140, deriun~ information from video source 14?, pr~iectc a foreground real image 148 which is thus visually comnosite~ won the hack~~r~>;mc, v;u;jl in~;i«ew nr nhenomer~a re~ultin« from the _. _.. _ _ ..-__ _ _~_ __ _.

,.. i , I ~~ ~ ,...

r WO 95/t958a PGTIUS95/(10512 objects in field 144. The point of view of an observer relative to the apparatus of Fig. 3 is downwardly toward image 148 and field 144.
. In Fig. 4 there is shown at 150 visual display apparatus including two video sources 152, 154, a dual-sector real image projector 156 and a piano ' S beam splitter 158.
This system, when operated, creates, in a visual staging station lfi0, a foreground real image 162 and a background virntal image 164. Real image 162 is derived from the display of source 154 and is projected toward the location shown by projector 156. Virtual image 164 is created by reflection from beam splitter 158 of what appears at video source 152. The point of view of an observer is laterally to the right of the apparatus shown in Fig. 4.
The system illustrated in Fig. 5 creates, from the point of view of a viewer (which is laterally to the left of the apparatus in Fig. 5) a mufti-image composite in a visual staging station 166. This image composite organization is similar to that which is produced by the apparatus of Fig. 4, but is accomplished by a very different optical and imagery-source structural organization.
Included in the apparatus of Fig. 5 are a downwardly pointing video source 168 and an upwardly pointing video source 170.
Directly interposed these two sources, as the same arc shown in Fig.
S, is a piano beam splitter 172. Also included in the system optical structure of Fig. 5 is a single-sector optical (or optic) portion 174 of a real image projector, which portion basically takes the form of one-half the structure of the previously described real image projectors. With optic portion 174 combined as shown with beam sputter 172, the two cooperate to create a virtual, confronting, reflective surface, shown at 174, which cooperates with optic portion 174 to create an effective, whole real image projector. This very same kind of structure is fully . described and explained in the referenced Welck patent.
With operation of sources 168, 170, the cooperative interaction of beam splitter 172 and optic portion 1 74 create a real imaee 176 derived from source 170. Beam sputter 172 creates a background virtual image 17F from what :~pp~~;~ at the loc;.~:ion of uicco source :(;~. T':~e pc3int of view o' ~,:n obacwer it T r'', .' l: :: r:.»: !11 !1,' 1 ~~'! iy ~~,' y:~i'._~::::'.' .
!:i?1°.T :t WO 95/1958-1 pLT1US95/00512 _la_ The system of Fig. 6 is one in which a composite image is formed with a projected real image and a background screen-borne image. This apparatus, designated generally 180, includes two video sources 182, 184, a piano beam splitter 186 which substantially directly overlies the face of source 184, and S a dual-sector real image projector 188.
With respect to the apparatus of Fig. 6, the point of view of an observer is indicated at 190. Through beam splitter 186, the observer is provided with a direct view of the screen-borne image created by source 184, with this view residing as a background to a real image 192 which is projected by projector as derived from source 182.
The display apparatus shown in Fig. 7 is very similar in many respects to that shown in Fig. 6. This apparatus, which is designated generally 194, includes a pair of video sources 196, 198, a pair of piano beam splitters 200, 202, and a single-sector optic portion 204 of a real image projector. Sector optic 204 coacts with beam splitter 200 in the same fashion that previously mentioned optic portion 174 coacts with beam splitter 172 in the apparatus of Fig. 5.
Beam splitter 202 directly overlies the face of video source 198, which source is directly viewable through this beam splitter by an observer, whose point of view is substantially the same as that illustrated in Fig. 6. Composited with this screen-borne image is a foreground real image 206 which is projected by coaction between beam splitter 200 and sector optic 204 as the same derive information from video source 196.
Turning attention now to Fig. 8, indicated generally at 208 is a visual display apparatus including, as one imagery source, a video source 210, and 2~ as another imagery source, a projector 212 and an overhead screen 214.
Further included in apparatus 208 are a piano beam splitter 216, and coacting therewith, as has previously been described, a single-sector optic portion 218 of a real image projector.
With operation of display apparatus 205. the image which i projected by projector ?1? onto screen ~'l~ results in a background virtual image ~~0 (re~3?i\'~ tW Ihc ~7C11t71 (!f wj,'W f1f ,.;, rs!,c~ ~-\ ; - y'111C11 1~
~,ileral~',' 1r11nledl;??e)\' 1c?
L
f ~ ;., 4 :

Ya t\
WO 9511958a PCTNS9S/(10512 _l;_ the right of the apparatus in Fig. 8). Cooperation of beam splitter 21b with sector optic 218 results in the projection of a foreground real image 222.
In Fig. 9 there is shown at 224 yet another apparatus embodiment of the invention. Apparatus 224 includes two video sources 226, 228, a dual-' S sector real image projector 230, two substantially right-angularly disposed piano . beam sputters 232, 234, and a spherical mirror 236. The point of view of an observer in Fig. 9 is immediately to the left of the apparatus shown in this figure.
From that point of view, projector 230 creates a projected foreground real image 238 derived from video source 228, and coaction between beam sputters 232, 234 and mirror 236 creates a background, composited, expanded/collimated virtual image 240 derived from video source 226.
Display apparatus 242 shown in Fig. 10 is similar in many ways to the apparatus shown in Fig. 9, except that it includes three sources of imagery, and produces for an observer, whose point-of view position is laterally to the left of the apparatus of Fig. 10, a mufti-planar composite image including a foreground real image 244, and two, depth-offset, background, virtual images 24b, 248. Image 248 is expanded/collimated.
Thus, included in apparatus 242 are video sources 250, 252, 254, a dual-sector real image projector 256, a pair of piano beam splitters 258, 260 and a spherical mirror 262.
With operation of apparatus 242, the composite of images 244, 246, 248 comes about as follows. Mirror 262 coasts with beam sputters 258, 260 to create the furthest background virtual image 248, derived from video source 250.
T'he two beam splitters coast with imagery at the location of source 254 to create the intermediate background virtual image 246. Projector 256 derives information from video source 252 to create foreground real image 244.
Fig. l l shows at 264 an embodiment of display apparatus which includes two video sources 200, 268, two piano beam splitters 270, 272, a single-sector optic portion of a real image projector 274 which coasts with beam splitter 272, and a spherical mirror 2 7d.
~'~IIII ()~l~railoli t>i Ilie iil)Jar~iIUs t)f 1'1;~. i i, ;(Ilu irUl7i tli::
~)Ulil: t~:
\'IC:\\- l)I .li) l)i)ll:i~\v \iilv)\v vi,.W it~;ili1).u tlliiii: 1 il:ii~iss::.:.ui.\~ tl) li:'v'. ivr. (~

i~ ~ ., <, ~ , ~ WO 9:S/i9:~8.t pCT/US9.'SH10512 apparatus in Fig. 11, there is created, in the same kind of visual staging station previously mentioned, a composited multiple-image display including a background expanded/collimated virtual image 278, and a projected foreground real image 280. Coaction between beam sputter 272 and sector optic 274 projects, from information derived from video source 268, real image 280. The two beam splitters, in cooperation with spherical mirror 276, create virtual image 278 from source material derived from video source 266.
At 282 in Fig. 12 there is shown yet another embodiment of the present invention, with this embodiment having some strong structural similarity to the embodiment shown in Fig. 11. Structurally, the Fig. 12 embodiment differs from the Fig. 11 embodiment by the presence of a third video source.
Functionally, and from the point of view of a viewer, which is to the left of the apparatus shown in Fig. 12, a three-level composite image results, which composite includes an outer foreground real image 284, an intermediate foreground real image 286, and an background virtual image 288.
The three video sources contained the apparatus of Fig. 12 are shown at 290, 292, 294. Cooperating with these three video sources are two piano beam splitters 296, 298, a single-sector optic portion 300 of a real image projector, which portion coasts with beam splitter 298, and a spherical mirror 302.
u1 Beam sputter 298 and sector optic 300, deriving imagery from video source 292, create outer foreground projected real image 284. Cooperative action between the two beam spliiters and spherical mirror, deriving information from video source 290, create background virtual image 288. Cooperative interaction between the two beam splitters and video source 294 results in intermediate foreground projected real image 286.
Addressing attention now to Fig. 13, here there is shown generally at 30~ still another embodiment of visual display apparatus constructed in accordance with the present invention. The point of view of an observer relative to the apparatus of Fig. 13 is immediately to the left of this apparatus. The composite image v~~hich results from operation of apparatus s44 is very much like -, j lii:ii l:t:::W ()y l)~)W:lillll7 l)i 117e :lppiir:.'i:::i U. 1'1''. l_.
~117U~ hill ~U~ii%v)s:iv 1117;i'~e i;.;:~:_. :.,,..: .... ;o);,:, c.' .w of ;:.. u~~:~~.~r ,:: ;~~:
r~:1:::;;::.~.. ..:7. to,:::r f ~. p ~ ~ WO 93/19_'S8.i pCTlUS9:5100512 foreground real image 3(;t6, an intermediate foreground real image 3Ub, and a bac:;ground virtual image 310.
. Included in apparatus 304 are three video sources 312, 314, 31b, two piano beam sputters disposed as shown at 318, 320, and two single-sector optic portions 322, 324 of a real image projector, which portions cooperate, respectively, directly with beam splatters 318, 320.
With video source 314 providing the relevant source information, beam splatter 320 coasts with sector optic 324 to create outermost foreground projected real image 306. Deriving information from video source 311, sector optic 322 cooperating with the two beam splatters, create intermediate foreground projected real image 308. Interactive cooperation between the two beam splatters, which derive information from video source 316, creates background virtual image 310.
Looking now at Figs. 14 and 15 together, here there is shown generally at 326 a theater-like system which is constructed in accordance with yet another important embodiment of our invention. Fig. 14 represents an overhead plan schematic view of this system, and Fig. 15 shows, schematically, a cross section/side elevation of the system. Focusing for just a moment on Fig. 15, indicated generally at 328 is what is referred to herein as an audience envelope -- a space where members of an audience can be seated or otherwise placed for viewing (toward the left in Figs. 14 and 15) composite imagery created by the structure in system 326. Still with momentary reference to Fig. 15 alone, shown at 330, in front of the audience envelope, is a stage which can support, if desired, three-dimensional objects, including live action.
Progressing from left-to-right generally through Figs. 14 and 15, and focusing attention on the constituents of system 326, these include a dual-sector real image projector 332, a pair of screen/scrim structures 3 34, 336, a piano beam splatter 338, another screen/scrim structure 340, another piano beam splatter 342, and somewhat above and slightly behind, or at least toward the rear of, the audience envelope, three projectors 34.x. 34b, 34b (see particularly Fi~~.
14). These pT()Ic:CI()rs are ll)T prcyCCt111!_ i111i1!'_c'>, as IVr Z~:illl~lc ULrI\'c:~l jiuiii ~imi:'.>, ~1i113. c:W
.~1111) iIiCiiilJ~:lj iii ilie Vi~~:.tili~:,:viOJ) Oi vls:C:i::,s) :I:t ::.:Cs'Jl:::s? ~u:::WS ~~

' CA 02306713 2000-OS-02 . ~ WO 95/1958-~ PGT/US9.5100512 354 (see particularly Fig. 15) with video source 350 pointing downwardly just rearwardly (relative to the audience envelope) of screen/scrim structure 340, with source 352 pointing upwardly immediately beneath beam splitter 342, and with .
source 354 pointing upwardly beneath projector 332. The screen/scrim structures in system 326, as do the piano beam splitters, permit visual transmission through them. In addition, they act as image-forming surface structures which respect to projections, as will be described, from projectors 344, 346, 348. .
~peradon of system 326 permits . very complex compositing of multiple images, including a real image, in up to six layers, so-to-speak, of visual information. More specifically, projection from projector 344 forms an audience-viewable image on the viewing side of screen/scrim structure 334. Similarly, projection from projector 34b forms a viewable image on screen/scrim structure 340. Projection from projector 348 forms a surface-viewable image on the viewing side of srreen/scrim structure 336.
Imagery derived from video source 354 is projected by projector 332 to form a foreground projected real image 356. Imagery derived from video source 352, through the optical action of beam splitter 342, creates a virtual image 358. Beam splitter 338 creates, as derived from video source 350, a virtual image 360.
Thus, the system shown and described in and with respect to Figs.
14 and 15 offers the possibility of compositing a quite deep and complex composite of multiple images, all of which can be combined (composited) with the appearance of solid objects, including live action, on stage 330. In the region of system 326 which lies between projector 332 and projectors 344, 346, 348, the structural components of the system can be viewed as a cascaded, interleaved organization, including at least one beam sputter interposed a pair of image-forming surface structures (screen/scrim structures), and 'at least one image-forming surface structure interposed a pair of beam splitters.
Figs. 16 and l7 illustrate at 362 another theater-like organization constructed in accordance with the features of the present invention. Fig. lh provides a ~Ch~tl7allC tt)i~ ut:~n view of the system. and Fib.:. i- a crc~~,-sectionaiwide-eiev;~tiun~~ v ~; ~: of the ,sme. Pimured in 1=i~~. i ; ;::; ~,.
;::~de:~::

.~
WO 9511958a PCT/US9:V(ltlSll -] 0_ envelope 364 which is like previously mentioned audience envelope 328, and a stage 366 which is like previously mentioned stage 330.
- Progressing generally from left-to-right in Figs. 16 and 17, through the various components which form system 362, included are a spherical mirror ' S 3b8, a piano beam splitter 370, a pair of screen/scrim structures 372, 374, another piano beam sputter 376, and yet one more screen/scrim structure 378. Disposed slightly above and toward the rear of the audience envelope are three projectors 380, 382, 384 (see particularly Fig. 16) which are like previously mentioned projectors 344, 346, 348, respectively. Also included in system 362 are three video sources 386, 388, 390 (see particularly Fig.17). Source 386 points upwaidly at the underside of beam splitter 370, and sourx 388 points downwardly at the upper surface of this very same beam splitter. Video source 390 points downwardly at the upper surface of beam spGtter 376.
System 362, like previously described system 326, permits the deep-volume compositing of a mix of up to six images, including a projected real image.
Projections from projectors 380, 382, 384 result in audience-viewable surfaoe-formed images on the viewing sides .of screen/scrim structures 372, 378, 374, respectively. Coaction of spherical mirror 368 and adjacent beam splitter 370 derives imagery from video source 388 to create a foreground projected real image 392. The undersurface of beam splitter 370 coasts with source 38b to create a background virtual image 394. The upper surface of beam splitter 376 cooperates with video source 390 to create an intermediate virtual image 396.
As is true in the case of previously described system 326, imagery produced in system 362 can be composited with three-dimensional real objects and live action on stage 366.
Indicated at 398 in Fig. 18 is yet another embodiment of the present - invention. This embodiment includes four video sources 400, 402, 404, 406, two dual-sector real image projectors 408, 410, and two piano beam splitters 412, which directly overly the image forming surfaces of sources 402, 40~, respectively.
~~'ith operation of the apparatus of Fig. 18. and from the point of view of an ~h~en~er »~hic)~ i~ ch~w~n at 41n. the nv~ real image nrniect~r~
and t~~e two beam splitter~ coast wnn ima4~en~ derived trom source 4tn~ tn create a near >~ .~ ~, ,"."".. ." , "m~ w.~.w~ ~ , ,". ., ,. , ., , ~ ~ .~,~.. ~ _ ,. ~ ."

WO 9i/1958a PCT/US95It10512 _'7()_ foreground projected real image 418. The two beam splitters and real image projector 410 coact to create an intermediate foreground projected real image 420. Immediately beneath image 420, beam splitter 414 allows direct viewing of the surface-screen-formed image appearing from video source 404. Cooperation between beam splitter 414 and video source 406 results in a background virtual image 422.
Fig. 19 illustrates what might be thought of as a distributed array form of the present invention, and is shown here, generally at 424, include an array of six dual-sector real image projectors 426, 428, 430, 432, 434, 436, six inanimate visual sources, such as solid objects, 438, 440, 442, 444, 446, 448, and five piano beam spiitters 452, 454, 456, 458, 460 which overlie, respectively, objects 440, 442, 444, 446, 448. Also included, toward the right side of the organization shown in Fig. 19, are a video source 462 and a piano beats sputter 464 directly~overlying the screen in this source.
The chosen point of view for an observer in the system of Fig. 19, is downwardly adjacent the right end of the array in the figure. Here, what is seen is a vertical composite of seven images which appear in a stack.
Progressing downwardly through this stack, at 466, 468, 470, 472, 474 and 476 are real projected images derived from sources 438, 440, 442, 444, 446, 448, respectively.
Composited beneath this "stack" is the directly viewable, screen-formed image appearing on the surface (screen) of video source 462.
Fig. 20 illustrates at 478 apparatus constructed in accordance with the invention which includes a screen/scrim structure 480, on the rear side of which (from the point of view of an observer shown at 482) is a dual-sector real image projector 484. On the viewing side of structure 480 is a projector 486 which acts as a source for the projection of a static, or a moving, image onto this viewing side. Real image projector 484 coacts with a video source, for example that shown at 4ss, to create a foreground projected real image 490 which is thus composited ~~th the background, surface-formed image appearing on the viewin<a surface of structure 480 (as derived from projection by projector 48G).
1:: 1'~1~. ~~, tll~.': :~ ~~7C)t~,M ,~,~,'~'1,~ ::I 'n~ v~:; ::T7()Ih:.' :::7~t)~:.".'::~:
o~ Ih~ p.'.~:T7I i:wention. ~hf;~s emh~c_-~:n! includes ~~ duul-sec::<):~.
~f~h~::C:.al-i i WO 9i11958~ PC?'lUS9~51I1(1i12 ' ?1_ component, real image projector 494 which includes optically confronting reflective components 494, 494. The point of view of an observer is to the left of the apparatus pictured in Fig. 21. Relative to this point of view, disposed behind component 494, which component is partially transmissive to light, there ' S is a video source 496. At 498 in apparatus 492 is a visual source which takes the form of a real object.
With operation of the system/apparatus of Fig. 21, real image projector 494 projects a foreground real image 500. This real image is composited against a background, screen-borne image which appears at the surface (screen) 496 of source 496, as transmitted through projector component 494.
Fig. 22 illustrates another important form of the invention, here shown generally ai 502, with apparatus S02 including and articulated (adjustable), dual-sector real image projector 504, a scrim/screen structure 506, and a projector 1S S08 usable to project static or moving images onto the image-forming surface of structure 506. This image-forming surface faces to the right in Fig. 22. With operation of this system, projector S04 creates, from a suitable visual image source, a foreground projected real image S10 which is composited against a background, surface-formed image resulting from projection from projector 508.
In Fig. 23, at S12 there is shown still another organization which embodies the key features of the present invention. Within a housing 514 there are disposed a spherical mirror S 16, a piano beam splitter S 18, and two visual imagery sources, including a three-dimensional object 520, and an array S22 of two-dimensional images.
With operation of the system of Fig. 23, mirror S16 coasts with I piano beam splitter S 18 to create at 524. and through a viewport S 14a in housing j . ~ 14, a foreground projected real image. The piano beam splitter forms at 526 a background, composited virtual image derived from array 52'' Focusing attention now on Figs. 24 and 2~ together, and beginning W th Fig. 24, here there i~ shown an amusement-ride system application and :nT:u)(?~iuiC.,;~t ~}~;: J -~~.~.... ..., ...:','.".. ~ ~'.::~~. ~~~C)\~,'!';
j,n, i-'j'_ '?.'. jC ; rl(~:C::-. O~'i~:
vehicl:. ''_'', whic': t',wc'~ ~_: n:.-~'..'.v ir. :!~c direc:ion of zrrc~w ~
=() alon~_ a ricic ,...__. ~_.~..~ -_~.. .,. , ,.. ~ . ~.
_ CA 02306713 2000-OS-02 WO 9i/t958a pGTIUS9.~/(10512 __ path 532, to transport riding viewers past the three visual staging stations presented, according to the present invention, by each of three visual display units 534, 536, 538. These display units may be constructed in accordance with any one of the specific system embodiments which have been described hereinbefore.
Fig. 25 illustrates one of these display units, such as display unit 534, as including a dual-sector real image projector 540, a rear projection screen and a rear projector 544 as a source of visual imagery, a screen/scrim structure 546, and a viewing-side-of structure-546 projector 548.
With operation of the system depicted in Fig. 25, riders transported by ride vehicle 528 past the image viewing station presented by this system see a mufti-image composite which includes a foreground projected real image 550, derived from rear-projection screen 542, displayed against a background, screen-borne image resulting from projection by projector 548 onto the viewing side of structure 546. If desired, the system could be operated in such a fashion that projector 548 is not at all times turned on, whereupon viewers transported past the system now being described would see a composite image which includes t projected real image 550 against the background image of the screen/scrim i structure per se.
Turning attention now to Fig. 26, here there is shown generally at 552 another distributed-array form of the present invention including three dual-sector real image projectors 554, 556, 558, three video sources 560, 562, 564 and three piano beam sputters 566, 568, 570. Beam splitters 566, 568 directly overlie the screens of video sources 562, 564, respectively, and beam splitter 570 is disposed in approximately the same relationship to projector 558 in Fig. 26 as is previously mentioned beam splitter 464 located relative to projector 436 in the structure of Fig. 19.
1'fith operation of system 552, each of the three video sources is supplied with exactly the same video information. These three sources, and the projecting optics associated thereW th, are so positioned that a resulting projected composite real image lies immediately above beam splitter 570 approximately in a single plane. hut with the three comno~itin~~ constituent ima~e~ sii~htiv ata~~~~erru in ti~ut li;~ne reismc tm onr ~mui~:: in suci~ s manner that the p~x~i~.

WO 931198.1 PCTJUS9;5I(M512 raster lines, or the like in these images "fill in" spaces to achieve significantly higher image resolution than that which characterizes any single one of the images that appears on the faces of the three video sources. This composite real image includes three image components 572, 574, 576 which derive, respectively, ' S from video sources 560, 562, 564, respectively.
In order to make the "story" of the operation of system 552 clear, the resultant projected composite real image is shown with each of the three image components just mentioned displaced vertically relative to one another (i.e.
significantly out-of-plane), and laterally staggered in an exaggerated manner.
The staggering which is utilized occurs, from the point of view of a viewer of Fig. 26, in a plane which extends generally from the left to the right in the figure, and normal to the plane of Fig. 26.
Such a system as system 552 can, of course, be utilized to enhance resolution using any appropriate number of projected images, two or more.
Shifting focus now to Fig. 27 in the drawings, here there is depicted schematically at 580 a very exciting system modification of the invention which can be employed, with or without multi-image compositing, and which is based on the concept of supplying image data for the projection of an serially suspended real image, where that data includes one or more psychologically motivating three-dimensional image cues. In other words, the source data, which might take the form of a film, a videotape, a video laser disc, a magnetic image-containing disc, an optical data stream, an electronic data stream, or other, has built into it one or more of these cues which results in the creation ~f imagery that strongly suggests to a viewer that he or she is actually looking at a real three-dimensional, i.e., real volume-occupying, image. According to this system, these data cues are selected from a group of well-known cues, such as that group consisting of shading. occlusion, perspective, motion parallax, size vs. depth. light (or chroma value) vs. depth, and definition vs. depth. Such source data is illustrated in block form at ~fi2 in FisTure 27.
Software which is available, for example, to create such image cue, In is U1;'ilal-l1'1)C: ljal;il7W i;i~iilU(:~ ~I l)llUei~ 1~.'hli'il ;:r a ~UiU
ii:~:1- the li;iillC'.~

Flame, Flint, Soft Image, Electric Image, Swivel 3-D, Spectra Vision, Elastic Reality, and Cluster After Effects (Trademarks).
Image-generating information from source data 582 is furnished, as indicated by arrow 584, in any suitable fashion to a two-dimensional (2-D) screen device (visual image source), such as a video monitor 586, which produces, from the supplied image-promoting data stream, a two-dimensional image characterized by the presence of psychologically-perceived motivating cues that strongly suggest to a viewer that he or she is looking at a real, volume-occupying, three-dimensional image.
Progressing further through the system illustrated at 580, monitor 586 acts as a visual source, as indicated by arrow 588, for a real-image projection system 590 (or real-image projecting optics) which can take the form of any known type of real-image projection system, including any one of the imaging systems described hereinabove. As illustrated schematically by arrow 592, system 590 projects into a visual staging station 594 a projected real image derived, via rays emanating from screen device 586, from source data 582. In block form at 596 there is shown a viewer's eye which, in station 594, perceives a startling, realistic, three-dimensional-appearing, unencumbered, projected real image which, because of the presence of one or more of the source-data three-dimensional image cues, is perceived absolutely to be a real, volume-occupying, three-dimensional image.
It is the important combined presence of source-data three-dimensional cues, and the ultimate aerial suspension of an unencumbered image, characterized by the selected cues, that presents a stunning, unencumbered, believable three-dimensional image, which actually is an image that lies more nearly in a somewhat dimensionless (from a thickness point of view) plane in space.
Further describing what is illustrated in Figure 27, an example here is pictured where the viewer's eye (s) perceives in station 594 a pair of turning and moving boots which change orientations and which appear to walk toward and to approach the viewer. Four stages in the progress of forward (toward the viewer) motion of these boots is illustrated at 598a, 598b, 598c and 598d. Arrow 599 schematically illustrates a progression in time as the boots appear to approach the viewer. The apparent three-dimensional imagery of these boots is infused with the kind of perceptually motivating three-dimensional cues mentioned earlier embedded in the generating source-data stream, and causing the viewer, in the specific illustration given, to see moving imagery characterized by shading, occlusion, perspective, motion parallax, size vs. depth, chroma value (light) vs.
depth and definition vs. depth cues. From the vantage point of the viewer, system 580 presents an unencumbered, projected real image which unquestionably appears to occupy three-dimensional space, even though that imagery is actually derived from data based upon two dimensions.
Suspended Image Interaction An important extension of the real-image producing systems of the present invention relates to the capability of allowing a viewer to interact with a suspended or apparently floating real image. A large body of published information enables one skilled in the art to produce a system in which a user can manipulate (for example, through a data glove which includes a sensor) or experience travel within an image displayed on a two-dimensional computer display screen. For example, see the following U.S. 'Patents: No. 4,988,981, No.

4,937,444, No. 5,097,252 and No. 4,542,291 (collectively referred to as the "Zimmerman patents"). The Zimmerman patents as well as many other publications and products currently on the market generally relate to a t~hnology known as "virtual reality" . Figure 28 shows a basic virtual reality system which is disclosed in Zimmerman's '981 patent. The system 600 utilizes a computer 602 to generate an image on a two-dimensional or semi-flat display screen 606. A cable 608 connects a data glove 610 to interface electronics 611 which is connected to computer 602. A signal generator, for example, an ultrasonic transducer 612 is attached to glove 610. Ultrasonic receivers 614a, 614b and 614c are positioned around display screen 606 and are connected to interface electronics 611. Signal data is collected relating to the position of ultrasonic transducer 17 and the degree of bending andlor direction of pointing, of one or more of the user" fingers in glove 610. Computer WO 9511958a pCT/US9:51Q(1512 602 then affects changes in displayed image 604 corresponding to the movement of data glove 610, i.e., the user's hand.
The present invention enables a very important and powerful extension of virtual reality technology by providing techniques for suspending a real image with which a viewer may interact. Figure 29 schematically illustrates such a system. Interactive suspended image system 620 includes a computer b22 1 which is capadle of generating an image on two-dimensional display screen 624.
Computer 622 and display screen 624 are collectively referred to as an image source. Real image producing optics (real image derivation/presentation structure) 626, for example, such as the optics shown in U.S. Patent No.
4,802,750, is positioned to receive an image from display screen 624, and to form and project a corresponding real image b28 in a staging area b30 in front a viewer's eye 631.
A cord 632 connects computer b22 to data glove 633 which is worn on a user's hand at the end of arm 634. Data glove 633 may also have a signal generator such as ultrasonic transducer 63b which sends signals to an ultrasonic reviver b38.
In the system illustrated in Figure 29, interaction data is produced through sensors and signal generators such as the ones disclosed in the Zimmerman patents. There are, however, other ways to facilitate interaction between a user and a suspended image without a data glove. For example, in Figure 30, a real image of a pear 650 is projected in staging area b52. The user ' achieves interaction with the pear by moving a portion of hand 652 in the staging r area. A light emission and detection device 654, such as one of the ones disclosed in U.S. Patent No. 5,248,856 (scanning laser system) generates signals indicative of finger location. The signals are transmitted to a signal processor which then affects the desired movement or alteration of pear 650.
As shown in Figure 31, the present invention may also take the form of a ~ame played on a suspended screen. i.e., a real imabe of a screen.
I~'Iaze 660 is suspended :n staging area 662. A plover cursor 664 is movable through maze 66f1. The user attempts to advance cursor fi6.~ from start 666 to end 668. The user i~ able to direct advancement of cursor fif,4 by touching, or penetratin«
msn~nuecl real ima~'e arn)w: t~7tl. 'f n: t)u<l:ic)n <)f ti)r users fin~_er rnav ht CIetCCIeCI. 1()i eXalllj)lt'.. i~l W :Illllll)~' I::ver~. C:~ e::i:)1()\'c:u lli tile 1\'1iC'I)i ~C11W t)lCli lli nHw ., ...~,.nm. ~r :..e~rv~, . ~wn,r=m rm,.a a , _ ~. , , , ~ ~ . , ,.. ...
....

WO 9Si1958a PC"f1t7S95I11Q:~12 U.S. Patent No. 5,24$,856. In some cases it may also be useful for the user to attach rings, reflectors, light or sound emitters, etc. to the fingers in order to . facilitate the interactive process. Additionally, it is also possible to employ a sou~d.detecting mechanism to allow the user to interact with a suspended image by~local~ commands. A system such as the one used to produce the game illuuu~ed in Figure 31 could also project a real image of a screen and a keyboard analogous to a conventional computer screen and keyboard.
From the foregoing, it should be quite apparent and evident how the system and methodology of the present invention open the °important doors"
referred to above for the creation of exciting, visually striking and commanding, volume-occupying composited and other images, including at least one projected real image. The potential applications and fields of use are nearly as wide as the creative imagination. The numerous embodiments disclosed and discussed herein show and suggest the various many ways in which optical elements and visual r 15 sources can be combined, according to the invention, to achieve the kind of compositing on which this invention centers. We know, therefore, that other specific arrangements of such components, well within the scope of this invention, will come to the minds of those skilled in the relevant art.
g _

Claims (20)

WHAT IS CLAIMED IS:

1. Visual display apparatus including:
a visual staging station defining a space for viewing images from a vantage point along a viewing axis, and viewing enabling structure associated operatively with said station and with said space for enabling placement therein of a composite organization of at least two viewable phenomena, one of which takes the form of an optically-projected real image that appears to float in space in front of the staging station without aid of a stereoscopic device, each of said at least two phenomena being located along the viewing axis and viewable by both eyes of a viewer positioned at the vantage point.

2. A display apparatus according to claim 1, wherein the viewing-enabling structure which enables placement of said one real-image viewable phenomenon takes the form of a pair of optically confrontive cooperative reflecting surface structures characterized by concavity.

3. A display apparatus according to claim 2, wherein said surface structures extend in space in a manner discontinuous from one another.

4. A display apparatus according to claim 2 or 3, wherein one of said surface structures takes the form of a virtual image of at least a portion of the other surface structure.

5. A display apparatus according to any one of claims 1-4, wherein said real image is derived from an image-producing data stream containing three-dimensional image cues selected from the group consisting of shading, occlusion, perspective, motion parallax, size vs. depth, light (chroma value) vs. depth and definition vs. depth.

6. Visual display apparatus including:
a visual staging station defining a space for viewing images from a vantage point along a viewing axis, and viewing enabling structure associated operatively with said station and with said space for enabling placement therein of a composite organization of at least two images, one of which takes the form of an optically-projected real image that appears to float in space in front of the staging station without aid of a stereoscopic device, each of said at least two images being located along the viewing axis and viewable by both eyes of a viewer positioned at the vantage point.

7. A display apparatus according to claim 6, wherein at least one other of said at least two images takes the form of a virtual image.

8. A display apparatus according to claim 6, wherein at least one other of said at least two images takes the form of an image projected onto a screen.

9. A display apparatus according to claim 6, 7 or 8 wherein said real image is projected through a light-transmissive structure which plays a role in enabling viewability of at least one other of said at least two images.

10. A display apparatus according to claim 9, wherein said light-transmissive structure takes the form of a beam sputter.

11. A display apparatus according to claim 9, wherein said light-transmissive structure takes the form of a screen/scrim structure.

12. A display apparatus according to claim 11, wherein said at least one other of said at least two images takes the form of a projection onto the opposite side of said screen/scrim structure relative to the side from which said real image is projected.

13. A display apparatus according to claim 6, 7 or 8, wherein said real image and at least one other of said at least two images exist in said space on opposite sides of an optical element which forms part of said viewing-enabling structure, which element plays a role in enabling the viewability in said space of at least one of said real and said one other images.

14. A display apparatus according to any one of claims 6-13, wherein said real image is derived from an image-producing data stream containing three-dimensional image cues selected from the group consisting of shading, occlusion, perspective, motion parallax, size vs, depth, light (chroma value) vs. depth and definition vs. depth.

15. A visual display method including:
selecting multiple sources for display of viewable phenomena;
by means of a viewing-enabling structure, placing in a visual staging station which defines a space for viewing images from a vantage point along a viewing axis, a composite organization of at least two viewable phenomena derived from selected sources, one of such phenomena taking the form of an optically projected real image that appears to float in space in front of the staging station without aid of a stereoscopic device, and organizing such phenomena in such station in a manner whereby each of said at least two phenomena is located along the viewing axis and viewable by both eyes of a viewer positioned at the vantage point.

16. A method according to claim 15, wherein said placing of phenomena comprises effecting of multiple viewable images.

17. A method according to claim 16, wherein said effecting of viewable images includes, in addition to projecting of such at least one real image, creating in such station of at least one other image selected from a group consisting of a real image, a virtual image, and a screen-borne image.

18. A method according to claim 15, 16 or 17 which is implemented in a setting of an amusement ride, and which further comprises transporting a viewer in a ride vehicle along a path extending past the visual staging station.

19. A real image interaction system incorporating a visual display apparatus according to any one of claims 1 to 14, said system including:
a source for displaying a visual image, a real image generating optics device associated with the source so that a real image version of the visual image can be generated in a defined spatial location, a sensor capable of generating a data stream relatable to a person's physical or verbal expression and a processor capable of interpreting the data stream then generating and transmitting corresponding image modification signals to the source so that the system can enable the person to indirectly manipulate the real image through verbal or physical expression.

20. A visual display system incorporating a visual display apparatus according to any one of claims 1 to 14, said system including:
a source station occupiable by a source for a projected real image, said visual staging station occupying a location spaced from said source station, a beam sputter optically interposed between said source station and said staging station, and optical co-acting structure co-actable with said stations and said beam sputter to create in said staging station a real image of any source material present in said source station.