US20020030679A1 - Method and system for high performance computer-generated virtual environments - Google Patents

Method and system for high performance computer-generated virtual environments Download PDF

Info

Publication number
US20020030679A1
US20020030679A1 US09/945,405 US94540501A US2002030679A1 US 20020030679 A1 US20020030679 A1 US 20020030679A1 US 94540501 A US94540501 A US 94540501A US 2002030679 A1 US2002030679 A1 US 2002030679A1
Authority
US
United States
Prior art keywords
images
image
texture
operating
pair
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/945,405
Other versions
US6441815B1 (en
Inventor
Ian McDowall
Mark Bolas
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fakespace Labs Inc
Original Assignee
Fakespace Labs Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US08/498,221 priority Critical patent/US5905499A/en
Priority to US09/313,508 priority patent/US6285370B1/en
Application filed by Fakespace Labs Inc filed Critical Fakespace Labs Inc
Priority to US09/945,405 priority patent/US6441815B1/en
Publication of US20020030679A1 publication Critical patent/US20020030679A1/en
Assigned to FAKESPACE LABS, INC. reassignment FAKESPACE LABS, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: BOLAS, MARK T., MCDOWALL, IAN E.
Application granted granted Critical
Publication of US6441815B1 publication Critical patent/US6441815B1/en
Assigned to BANK OF AMERICA, N.A. reassignment BANK OF AMERICA, N.A. SECURITY AGREEMENT Assignors: ADVANCED MEDICAL OPTICS, INC., AMO HOLDINGS, LLC
Assigned to ADVANCED MEDICAL OPTICS, INC., AMO HOLDINGS, INC. (FORMERLY KNOWN AS AMO HOLDINGS, LLC) reassignment ADVANCED MEDICAL OPTICS, INC. RELEASE OF SECURITY INTEREST AT REEL/FRAME NO. 13203/0039 Assignors: BANK OF AMERICA, N.A.
Anticipated expiration legal-status Critical
Application status is Expired - Lifetime legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/286Image signal generators having separate monoscopic and stereoscopic modes
    • H04N13/289Switching between monoscopic and stereoscopic modes

Abstract

A computer system and computer-implemented method for rendering images in real-time with a three-dimensional appearance. Using a database including at least one pair of texture maps uses as a stereo pair behind a portal to simulate a scene. An input database can be processed to generate a processed database by performing texture mapping to replace at least one portion of the input data representing a view (or object) by data indicative of a pair of texture maps and an associated polygon or polygons. One of the texture maps represents the view (object) from a left-eye viewpoint; the other represents the view (object) from a right-eye viewpoint. In some embodiments, to generate the texture map pairs, the input database analyzed to produce the images. In other embodiments the images are from photographs or other sources.

Description

  • This application is a continuation of U.S. application Ser. No. 09/313,508 filed May 17, 1999, now U.S. Pat. No. 6,285,370, which in turn is a continuation of U.S. application Ser. No. 08/498,221 filed Jul. 5, 1995, now U.S. Pat. No. 5,905,499.[0001]
  • FIELD OF THE INVENTIONS
  • The invention pertains to the field of computer graphics, particularly to methods for rendering complex scenes quickly and efficiently. In preferred embodiments, the invention pertains to methods and systems for real-time rendering of images, especially for creating computer-generated virtual environments or displayed virtual objects in virtual environments. [0002]
  • BACKGROUND OF THE INVENTIONS
  • The terms “virtual environment”, “virtual world”, and “virtual reality” are used interchangeably to describe a computer-simulated environment (intended to be immersive) which includes a graphic display (from a user's first person perspective, in a form intended to be immersive to the user), and optionally also sounds that simulate environmental sounds. The abbreviation “VR” will sometimes be used herein to denote “virtual reality”, “virtual environment”, or “virtual world”. A computer system programmed with software, and including peripheral devices, for producing a virtual environment will sometimes be referred to herein as a VR system or VR processor. [0003]
  • In the computer graphics art (including the art of designing and operating computer systems for producing virtual environments), complex scene rendering is typically accomplished by methods which restrict what is rendered to that in the viewing frustum. A current focus of computer graphics research into the efficient rendering of 3D scenes pertains to development of methods for efficient culling of a relatively small subset of data, defining a 3D scene to be drawn, from a relatively large database. [0004]
  • There have been attempts to reduce the actual complexity of a displayed scene by creating in a database several versions of an item (to be displayed), with the different versions (“models”) of each item having different levels of detail. During rendering of a scene to include a representation of the item, a determination is made as to which of the models should be used. The determination is made on the basis of some metric. Usually the metric is the distance between the viewer's eye and the item (object) in world space. Thus models for large values of the metric (far away distances) are more coarse (e.g., have lower accuracy and fewer vertices) than models for small values of the metric (near distances). This “level of detail” approach to scene rendering has been employed in flight simulation systems. In flight simulation the level of detail (LOD) method works well. The objects on the ground such as buildings and so on appear on the horizon and the airplane speeds towards them the models are switched out for higher resolution models. However, in other applications such as computer aided design (CAD) in which the database represents a large number of detailed objects, the “level of detail” approach does not produce significant benefits because the objects are too close to one another and the switching of the models may be noticed by the human eye. In these other applications, it would be much more useful to reduce polygonal complexity overall than to reduce complexity of a selected few displayed objects. [0005]
  • Efficient culling algorithms also speed up traditional computer graphics. They work by reducing the number of polygons which have to be drawn. A good example of this type of work is described in the literature see for example Teller, T. J. and Sé quin, C. H., [0006] Visibility Processing For Interactive Walkthroughs, Proceedings of SIGGRAPH '91 (Las Vegas, Nevada, Jul. 28-Aug. 2, 1991) ACM SIGGRAPH, New York, 1991, pp. 61-70. This paper describes algorithms for the determination of the visibility cells from other cells in a building or other database with portals from one cell to another. The algorithm identifies these areas so that the rendering of the scene can ignore parts of the database which cannot be seen from the viewer's current viewpoint. This approach is most applicable to the interactive exploration of databases such as buildings, ships and other structures with explicit “openings” through which other parts of the database are visible.
  • Another technique for generating a database of image data for display is known as “texture mapping”. This technique has been employed for various applications, and is described in the literature (see for example, J. D. Foley, [0007] Computer Graphics: Principles and Practice—2nd Ed., Addison-Wesley Publishing Company, pp. 741-744 (1990)). Computer systems have been developed for controlling the display of images resulting from texture mapping (for example, the “Reality Engine” developed by Silicon Graphics as described in R. S. Kalawsky, The Science of Virtual Reality and Virtual Environments, Addison-Wesley Publishing Company, pp. 168-178 (1993)). Texture mapping can be performed in real time by an appropriately designed hardware/software data processing system. Hardware texture mapping is available as a new feature on the latest generation of high performance graphics workstations and is becoming standard on graphics workstations.
  • Traditional implementations of texture mapping result in the apparent “shrink wrapping” (or “pasting”) of a texture (image) onto a displayed representation of an object (virtual object), to increase the realism of the virtual object. The displayed texture modifies the surface color of the virtual object locally. The texture is traditionally created by photographing a real object and then scanning and digitizing the resulting photograph. [0008]
  • A texture map is defined by an array of data (texture elements or “texels”) in texture coordinate space, which corresponds to an array of pixels on a geometric surface (in the coordinate space of the surface). The latter array of pixels can in turn correspond to a rectangular two-dimensional array of pixels for display on the flat screen of a display device. The texture coordinate space can be two-dimensional or three-dimensional. The geometric surface can be a polygon (“n-gon”) or set of polygons. [0009]
  • For example, if texture mapping is employed to display a stop sign, the following image data can be stored for use in later generating the display: data determining a hexagon, and data determining the word “STOP” on a red background. Thus, texture mapping enables display of a stop sign with a relatively simple, inexpensive display control hardware/software system (having relatively small memory capacity), in contrast with a more complex and expensive system (with greater memory capacity) that would be needed to draw each letter of the sign as a collection of different colored polygons. [0010]
  • An example of texture mapping is described in Hirose, et al., “A Study on Synthetic Visual Sensation through Artificial Reality,” 7th Symposium on Human Interface, Kyoto, Japan, pp. 675-682 (Oct. 23-25, 1991). Hirose, et al. send images of the real world from a camera to a computer system, which then texture maps the image data onto the inside of a virtual dome. Then, when a user wears a head-mounted display and looks around, he or she has the illusion of looking at the real world scene imaged by the camera. The Hirose system thus achieves a type of telepresence. The virtual dome is implemented as a set of polygons. Images from the camera are texture-mapped to the polygons. In this way a telepresence system is realized. From the user's point of view there is video from the camera all around. Thus, the polygonal dome is used to hold the images from the camera around the user. The dome is not attempting to model the space in any way. [0011]
  • In a virtual environment in which a different image is fed to each eye of the viewer, the application software generating the environment is said to be running in stereo. Viewers of such a virtual environment use the stereoscopic information in the images presented to their eyes to determine the relative placement of the displayed virtual objects. Hirose, et al. suggest.(at p. 681) that their virtual dome should provide a “stereoscopic view” but do not discuss how to implement such a stereoscopic view. This system illustrates the potential power of texture mapping. [0012]
  • The Silicon Graphics Reality Engine (shown in FIG. 4.[0013] 46 of the above-cited work by Kalawsky) has an architecture for displaying left and right images (for left and right eyes of a viewer, respectively) resulting from texture mapping. It is important to note however that the diagram illustrates only the hardware paths. From a software point of view there is an implicit assumption that the textures and other attributes of objects for the left and right eyes are the same. This assumption sneaks in because it is assumed that the scene graph is the same for both eyes. In general this is a valid assumption. In contrast with the general teachings of the prior art, the present invention pertains to specific, inventive applications of the concept of displaying stereoscopic images that are generated as a result of texture mapping in which one exploits the possibility of having different scene graphs or attributes depending on which eye is being drawn.
  • The method and apparatus of the present invention are particularly useful for creating virtual environments. For example, the invention is useful for implementing a VR system for creating virtual environments, of the type including an input device and user interface software which enable a user to interact with a scene being displayed, such as to simulate motion in the virtual environment or manipulation of displayed representations of objects in the virtual environment. The illusion of immersion in such a VR system is often strengthened by the use of head-tracking means or some other such system which directs the computer to generate images along the area of viewing interest of the user. A VR system which embodies the invention can rapidly and inexpensively create a wide variety of entertaining 3D virtual environments and 3D virtual objects. [0014]
  • SUMMARY
  • In a class of preferred embodiments, the invention is a computer system and computer-implemented method for rendering of images in real time with a three-dimensional (3D) appearance. The invention processes an input database or databases which contain portals and associated images which are stereo pairs. During the display of the resulting virtual environment, the images seen through the portals of the virtual environment will appear to contain depth. [0015]
  • Stencil planes may be used to mask the textures from interfering with one another when the portals are in close proximity but “look” into different scenes. [0016]
  • In another class of embodiments, the invention employs a database including data determining a texture map pair and polygon for displaying a stereoscopic view (or views) on a displayed billboard as part of a larger image. A billboard is a virtual object which rotates in response to the viewer's direction of view so as always to remain oriented facing the user. Billboards are often used to simulate trees in virtual environments. One texture map represents the view from a left-eye viewpoint, and the other represents the view from a right-eye viewpoint. The database is then processed to display (simultaneously or substantially simultaneously) a left image (with “left” texture appearing on the billboard) for the viewer's left eye and a right image (with “right” texture appearing on the billboard) for the viewer's right eye. [0017]
  • In any embodiment of the invention, each texture map pair can be static or dynamic. A static texture map does not change with time. A dynamic texture map consists of a movie-like sequence of texture maps, which are sequentially displayed. This provides an additional element of realism to the displayed scene (or virtual environment) at the expense of texture memory. [0018]
  • In any embodiment of the invention, one texture map rendering may blend (e.g., cross fade) to another in response to movement of the viewer's viewpoint or some other parameter. For example, a view through a window may fade from summer to fall to winter over time or depending on where the viewer looks from. [0019]
  • Brief Description of The Drawings FIG. 1 is a diagram of a preferred embodiment of the inventive system, in which a VR processor receives, processes, and stores image data, and generates a stereoscopic virtual environment for display on a display device. [0020]
  • FIG. 2 is a diagram of a scene to be used as an illustrative example of the method disclosed. [0021]
  • FIG. 3 is a view out over the garden of FIG. 2 from left and right eye viewpoints. [0022]
  • FIG. 4 is an illustration of the inventive method as implemented on the scene shown in FIG. 1. [0023]
  • FIG. 5 is an illustration similar to that of FIG. 4 for a different embodiment in which the mounting surface for the images is not a single flat polygon. [0024]
  • FIG. 6 is a top view of the scene from FIG. 1 as it would be without using the inventive method. [0025]
  • FIG. 7 illustrates a sequence of images which the inventive method can use to show motion in the textured scenes.[0026]
  • REFERENCE NUMERALS IN DRAWINGS
  • [0027] 1 permanent database storage medium
  • [0028] 3 on-line data storage for temporary storage of data
  • [0029] 7 computer used to run the VR application
  • [0030] 8 stereo display worn or used by the viewer or user
  • [0031] 9 input device used to control the environment
  • [0032] 10 head phones for stereo sound from the environment
  • [0033] 11 head tracking device
  • [0034] 201 walls of room
  • [0035] 202 window open to the outside
  • [0036] 203 open doorway to the outside
  • [0037] 204 scene visible through window
  • [0038] 205 scene visible through door
  • [0039] 301 left eye texture
  • [0040] 302 right eye texture
  • [0041] 313 left view of near tree
  • [0042] 314 left view of far tree
  • [0043] 315 left view of mountains
  • [0044] 323 right view of near tree
  • [0045] 324 right view of far tree
  • [0046] 325 right view of mountains
  • [0047] 401 doorway
  • [0048] 402 window frame
  • [0049] 403 textured polygon for window
  • [0050] 404 textured polygon for door
  • [0051] 405 viewer
  • [0052] 501 wall
  • [0053] 502 portal
  • [0054] 503 backdrop for stereo texture
  • [0055] 601 doorway
  • [0056] 602 window
  • [0057] 603 near tree
  • [0058] 604 far tree
  • [0059] 606 walls
  • [0060] 607 viewer
  • [0061] 701 first position
  • [0062] 702 second position
  • [0063] 703 third position
  • DETAILED DESCRIPTION OF THE INVENTIONS
  • FIG. 1 is a diagram of a preferred embodiment of the inventive system. Data source [0064] 1 supplies an input database to VR processor 7. VR processor 7 is a computer programmed with software for implementing a virtual environment. Specifically, VR processor 7 controls the display (in stereo fashion) of data representing a virtual environment on stereoscopic display device 8 and controls the playback of left and right channels of audio signals (simulating sounds in the virtual environment) to a user wearing headphones 10 (which include left and right speakers). VR processor 7 is a computer which generally includes internal data storage 3, and a graphics sub system 2. The graphics sub system produces the images seen by the user through display 8 in real time.
  • Display device [0065] 8 can be any of a variety of devices, such as a device which mounts on the head of a human user (including left and right monitors for providing a stereoscopic display to the user), or a single flat screen display which outputs a field-sequential stereoscopic display.
  • Head-tracking means [0066] 11 is optionally provided for providing input (to processor 7) indicative of the position of the head of a human user wearing a head-mounted embodiment of display device 8. In each embodiment with head-tracking means 11, processor 7 is programmed to process position data received from head-tracking means 11, for use (for example) in controlling the view point of the displayed virtual environment.
  • Processor [0067] 7 is also programmed with software enabling a human user to interact with the virtual environment by manipulating input device 9, whose output is supplied to processor 7. In one embodiment, input device 9 includes a glove and sensors mounted to the glove for detecting movements of a user's hand within the glove. In another embodiment, input device 9 includes a frame and sensors for producing output signals indicative of forces or torques exerted on the frame by a user. The frame can be mounted to display device 8 (or to a base supporting the display device) symmetrically with respect to an axis of symmetry the display device, with limited freedom to move relative thereto, and the sensors are preferably mounted at the ends of the limited range of motion of the frame.
  • In preferred embodiments to be described with reference to FIG. 2, the virtual environment consists of the interior of a room with views to the outside. At the far end wall [0068] 201 has a door 203 and window 202. These look out to scene 204 through the window and 205 through the door. In this and many other instances, a virtual environment simulates a “real” environment. The space being modeled in the virtual environment is the interior of a space—a room in which particular furnishings are to be evaluated for instance. The objects in the room are generally modeled using polygonal meshes and applied texture maps. The doors and windows (generally referred to here as portals) of the room may look out onto gardens or into other parts of the structure such as into another room.
  • Rather than creating a geometric model of the gardens or other objects outside the room one could simply take a photograph of a real garden and use it as a texture map in the place where the window should be. Thus where one would have had an opening looking out onto the garden one replaces this with a “picture on the wall” of the garden. This will not produce a very compelling illusion however. As we move in the room there will be no parallax between our viewpoint and the garden outside. The window will also look flat. All in all, the window will look more like what it really is, a picture of a garden rather than the illusion we are interested in creating of looking out of a window into another scene. This distinction is not possible to discern from a 2 dimensional image as in FIG. 2 which would look the same whether the garden is a flat photograph, or if the garden had been modeled in 3 dimensions to the finest detail. [0069]
  • In a virtual environment there are several additional visual cues not present when viewing flat artwork. The first such cue is stereo vision in which a viewer perceives an object to be closer than another object because the view of the scene from the two eyes of the viewer are used by the brain to estimate the distance to an object. The second cue which provides distance and relative depth information is motion parallax. As we move around, objects closer to us appear to move more than those in the background. If you move your head from side to side when looking out of a window a tree branch close to you will appear to move more than a building which is far away. Because of these additional motion and depth cues, using a flat picture of a garden in a virtual environment to simulate a window does not work as well as one might expect. [0070]
  • This inventive method creates the illusion we seek—the illusion of there being a garden beyond the window's frame without having to model every leaf and blade of grass. In FIG. 2 the desired illusion of there being a garden can be achieved if we take pictures of the garden which form stereo pairs of images. These images are then used in the virtual environment in a special way. We use the stereo pair of images as texture maps and apply them to a polygon (actually there are at least 2 polygons—one for the left eye and one for the right). The image drawn for the right eye of the viewer uses the right image from the stereo pair applied to a large polygon beyond the portal frame. The left eye sees the identical environment from its perspective and the left image from the stereo pair is applied to the polygon beyond the portal. Thus for each eye there is a texture mapped polygon larger than the opening located behind the portal. The textured polygons for the left and right eyes are shown in FIG. 3. [0071] 301 is the left eye view and 302 is the right eye view. In each scene, there are a number of objects. The trees 313 and 323 are physically the same tree but as seen from the two different positions. Tree 314 and 324 is further away than 313 and 323 and so it appears to move less relative to the mountains 315 and 325 which are essentially identical from the two perspectives. Note that the stereo effect is exaggerated somewhat so these features are obvious. FIG. 6 illustrates the “actual” scene as it would look if everything were actually drawn. The room is composed of walls 606, window 602 and door 601. Viewer 607 looks out onto tree 603 and tree 604. Mountains 605 have been shrunk to fit them on the paper. Note that in an accurate physical model the mountains would be as they are in real life—far away and very large, indeed the trees 603 and 604 would be just a spec if drawn in the correct scale relative to the mountains 605.
  • The textures from FIG. 3 are used in FIG. 4. The images seen through door [0072] 203 of FIG. 2 and window 202 are created by texture mapping the left and right images onto the polygons behind the window and door. In FIG. 4 the door 401 in wall 406 looks out and sees polygon 404 which is texture mapped with images of the scene outside. Window 402 is open to the polygon 403 and associated left and right texture maps. A stereo pair of images is used as textures on the polygons which hang behind the window and the door. In this particular example there could be just one polygon and two texture maps, the door 401 and window 402 look out to the same scenery and thus one could use the same stereo pair. One achieves better stereo however by using a separate image for each. This is also more general. In particular, it is then possible to have the door and window look out on different scenes. This may not be desirable in an interior decoration application but could be a device used in an entertainment or gaming application where the scenes are not the same. Also note that while this example is phrased as looking out of a room into an expanse, this technique is also applicable to environments where the definition of the portals is less obvious and different. For instance if virtually traveling down a gangway in a ship, the chambers off the gangway could be replaced with textures. Portals may also be formed by obstructing pieces of geometry—an alleyway between two buildings might create a “portal” although the space is not explicitly defined in the database, a portal has been created. As shown in FIG. 4, the polygon with the image is located behind the frame of the portal from the viewer's point of view 405. This will produce motion parallax for the viewer. As the viewer moves to the right, the left hand edge of the window frame will expose more of the image hanging behind it. The stereo nature of the image also improves the feeling of looking out because the depth cues provided by stereopsis are generally present only in real scenes.
  • In some situations we may wish to have portals and images which could not actually exist. For instance we might have an open door and a window in a wall, the door might open out into what appears to be a garden and the window may look out onto a cityscape. By using stencil planes we can make sure that the texture for each portal (the window and the door) appears only through the intended opening. This does not occur naturally. Since we want the image behind the portal to be larger than the opening so the viewer sees parallax between the frame and the image, two adjacent openings looking at different scenes will not work correctly as the polygons behind the wall may overlap so one would see part of the wrong image. One method for rendering such a scene as intended can be accomplished by the following method: [0073]
  • 1. Turn off updates to the Z buffer and color planes [0074]
  • 2. Draw the door with the stencil plane value set to A [0075]
  • 3. Draw the window with the stencil plan value set to B [0076]
  • 4. Turn on updates to the Z buffer and color planes [0077]
  • 5. Draw the texture mapped polygons to be seen through the door only where the stencil planes are equal to A [0078]
  • 6. Draw the texture mapped polygons to be seen through the window only where the stencil planes are equal to B [0079]
  • 7. Draw the rest of the scene [0080]
  • Traditionally billboards have been used in visual simulation environments to simulate objects which look pretty much the same from all directions. Trees are a good example. To simulate a tree a single polygon and a texture map can be used. The polygon's normal will always face the viewer. By using a texture map on the polygon a pretty convincing tree can be simulated. In addition to the angle of the textured image to the viewer it is also possible to adjust the distance between the textured polygon and the portal. [0081]
  • By using a billboard as the way of displaying the stereo texture behind an opening one alleviates to some extent the problems related to being able to get close to the portal opening and peering around the edge of the texture. If using a billboard, the normal of the texture mapped image will be maintained parallel to the viewer. Thus as one peers around the corner, the texture image is rotated in unison and the textured polygon will intersect the wall in which the opening is located. If one does not use billboards to mount the textured images on then it is possible for a viewer to get close enough to the frame that the image can be seen completely and by going a little closer the edges will be seen. [0082]
  • Another approach to the peering problem is to make the mount for the image non flat. Instead of mounting the image on a single flat polygon behind an opening as shown in FIG. 3 it is possible to use a shaped surface like that of FIG. 5. This type of mount will make sure that a viewer gets the advantages of flat texture map but also helps mitigate some of the peering problems. One could also use a set of images on a section of a sphere or cylinder. [0083]
  • By replacing a texture with a series of textures, a dynamic environment can be simulated. The images of a garden through a window may be enhanced by including a sequence of stereo pairs which show a buffeting wind for instance. The motion in the scene of each object relative to its neighbors will make the scene appear more realistic and the virtual environment more compelling. This is illustrated in FIG. 7 which shows one of the viewpoints. In this sequence of 3 images the trees are blown by the wind. Repeated cycling of the texture mapped onto the polygon from [0084] 701 to 702 to 703 and then back 702 to 701 etc. would give the illusion of motion. The rate of transition from one image to the next can be varied over time so as to create a more realistic effect. The use of blending or fading between the textures as the transition from one texture to the next occurs will produce smoother motion.
  • Fading from one stereo texture pair to another can be used to perform a smooth transition. For instance if there are several sets of stereo pairs for a particular view through a window then as the viewer moves in the room then the view which best matches the viewer's current location can be used. As the viewer moves to a position where another pair would give a better illusion then as the viewer moves to it the images from both positions would be blended in the appropriate proportions. The proportion of the images is related to how close the viewer is to the ideal viewing location for that stereo pair. The fade is preferable to a sharp transition because sharp transitions are very noticeable to the viewer's eye. In fact, this would be a defect which a user could well be expected to notice and then bob one's head back and forth to see the changing images. By doing a smooth blend from one image pair to another, the eye does not catch any abrupt changes and thus will not notice the transitions as much thus maintaining a better illusion of the space behind the opening. Blended fades are simple to implement using a common technique called alpha blending. In addition to a simple cross fade using alpha blending, it is also possible to use a metamorphosis technique. Metamorphosis involves creating a transition or morph from one form or image to another in such a way as to have intermediate features at the intermediate steps. This will give a smoother segue from one image to the next but at the moment these techniques require intervention to define features in the various images to be tweened. [0085]
  • The images used as stereo pairs can come from a number of sources. They may be photographs, computer graphics images, live video, or some other source. [0086]
  • Photographs provide a method for getting the stereo pairs into the computer. A stereo pair of images are taken of a particular scene and then scanned into the computer and are used as the stereo pair. Images from old stereoscopes would work for instance. In addition to a single pair of images one may also use a set of positions so as to give higher quality results when looking from a number of positions in the virtual world by blending in the most appropriate image(s). A single image of a scene may be used to create a false stereo pair by editing the images carefully. At present this is done by hand but one could expect this to be computer done in the future. This retouching introduces the possibility of applying the stereo texture technique to the wide range of existing stock images. The advantage of using a stereo pair, as pointed out before, is that the images appear to be much more vivid and look more realistic in a virtual environment than simple flat two dimensional images. [0087]
  • One can also use computer databases to create the image pairs. In this case one may select part of a database either by applying a computer based heuristic or by hand. The images from the selected area of the database can be rendered using any rendering technique and stereo pairs generated. For instance if one were looking out over the garden of FIG. 2, the tree's and so on could have been computer generated and rendered (which is a slow process for a high quality photo realistic rendering). From the viewer's point of point of view, standing in the room the garden will appear to have been rendered at a very high quality (which it was) and at a quick frame rate (the image of the garden does not have to be recalculated every time the viewer moves). In fact, the textures may be updated every so often as the viewer is moving around in the room. Thus the garden can be rendered to appear at high quality but updated infrequently. In this way we maintain a fast and interactive environment while also preserving a high degree of fidelity in portions of the scene which are very costly to render such as plants which consume a large number of polygons in the complex curves and surfaces of which they are composed. This ability to mix the rendering of some parts of the scene in real time and other parts of the scene more periodically (as an “off line” process) lets the designer of a system trade some visual realism for faster overall frame rates. [0088]
  • In order to automatically decide which parts of a database to replace with a texture mapped stereo pair one may examine the database in a linear hierarchical fashion looking for areas of the database which contain a large number of vertices or other indications of expected rendering time. The linear hierarchical traversal will visit each node at each level in the database of the scene. Areas (or nodes) which are relatively dense are considered candidates for replacement with a stereo texture and associated polygons. That part of the database can then be rendered in order to grab the texture. Note that the drawing of the image to be used as a texture would, ideally, be rendered to a part of the frame buffer not visible to the user. [0089]
  • Once a database had had parts of it modeled using the stereo textures these may also be stored in the database along with or as a replacement for the geometry which the image pair were created to mimic. By maintaining both in one database it would be possible to switch from the real geometry to the textured model and vice versa. Thus if one walked out of the house in FIG. 4 into the garden, it could be transitioned from the texture based representation to the actual model. [0090]
  • Image pairs derived from computer based models (such as CAD models) can also be rendered in such a way as to retain information which lets one find out the source data for any part or texel in the textured images. There are many ways to do this. One way is to associate a tag field with each pixel as the images are drawn. They are stored as attribute bits for each object drawn. Once the rendering is finished, the color and tag information are stored as rectangular arrays of values. The generated images are then used as textures and the tag array is also kept as a lookup table. During the use of the texture pair it is then possible for the user to find out information as to the identity of any part of the texture mapped model by pointing to it and then looking up the associated tag back into the database. For instance, while drawing the images for a garden, a tag can be associated with each pixel in the image to identify the plant type in the original geometric model. When in use the user could point at the texture and the application could use the tag to identify the plant being pointed at. In addition to the user being able to identify items in the images by pointing the same identification facility is obviously available to the application also. [0091]
  • Various other modifications and alterations in the method and apparatus of the invention will be apparent to those skilled in the art without departing from the scope and spirit of this invention. Although the invention has been described in connection with specific preferred embodiments, it should be understood that the invention as claimed should not be unduly limited to such specific embodiments. [0092]

Claims (3)

We claim:
1. A method for rendering a plurality of images on a display, said images comprising a plurality of pixels, with said images forming a three-dimensional appearance by using a processed database, and subsequently identifying said images with a color tag upon user request, said method including the steps of:
(a) supplying to a computer system, from the processed database, a selected pair of texture maps and associated polygons;
(b) operating the computer system to display a stereoscopic view in a region of a larger image, wherein the pair of texture maps and associated polygons determines the stereoscopic view and the region;
(c) operating the computer system to associate a tag field with each pixel as each of said images is drawn;
(d) storing the color tag and the tag field information as an array of values in a lookup database for later use as a lookup table;
(e) operating the computer system such that when a user points in a virtual space at one of said pair of texture maps and associated polygons with a data input device the computer system will retrieve, from the lookup database, the array of values associated with the pixels comprising the pair of texture maps and associated polygons; and
(f) displaying information regarding an identity of a specified part of the pair of texture maps and associated polygons based on the array of values in the lookup database.
2. The method according to claim 1 where step (f) includes the further step of operating the computer system such that the color tag displays information identifying the pair of texture maps and associated polygons as a particular object.
3. A method for rendering a plurality of distinct images, each distinct image having a three-dimensional appearance and each distinct image rendered within one of a plurality of regions within a larger image, by using a processed database, said method including the steps of:
(a) supplying to a computer system, from the processed database, a selected pair of texture maps and associated polygons;
(b) operating the computer system to display a stereoscopic view in each of the plurality of regions of the larger image, wherein the pair of texture maps and associated polygons determines the stereoscopic view and the plurality of regions;
(c) operating the computer system to turn off updates to a Z buffer and to a plurality of color planes;
(d) operating the computer to draw a first image within the larger image with a stencil plane value set to a first parameter, drawing a second image within the larger image with a stencil plane value set to a second parameter, and continuing to draw images within the larger image with stencil plane values set to a particular parameter associated with a particular stencil plane value, until every image is drawn within the larger image;
(e) operating the computer to turn on the updates to the Z buffer and the color planes;
(f) operating the computer to draw a first set of texture mapped images and associated polygons to be seen through the first image only when the stencil planes are equal to the first parameter, to draw a second set of texture mapped images and associated polygons to be seen through the second image only when the stencil planes are equal to the second parameter, and continuing to draw only a particular set of texture mapped images and associated polygons within the larger image only when a stencil plane value is equal to the parameter associated with that stencil plane value;
(g) operating the computer to draw the larger image; and,
(f) operating the computer to display the larger image and each of the very different images within the larger image as an entire scene.
US09/945,405 1995-07-05 2001-08-31 Method and system for high performance computer-generated virtual environments Expired - Lifetime US6441815B1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US08/498,221 US5905499A (en) 1995-07-05 1995-07-05 Method and system for high performance computer-generated virtual environments
US09/313,508 US6285370B1 (en) 1995-07-05 1999-05-17 Method and system for high performance computer-generated virtual environments
US09/945,405 US6441815B1 (en) 1995-07-05 2001-08-31 Method and system for high performance computer-generated virtual environments

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/945,405 US6441815B1 (en) 1995-07-05 2001-08-31 Method and system for high performance computer-generated virtual environments

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/313,508 Continuation US6285370B1 (en) 1995-07-05 1999-05-17 Method and system for high performance computer-generated virtual environments

Publications (2)

Publication Number Publication Date
US20020030679A1 true US20020030679A1 (en) 2002-03-14
US6441815B1 US6441815B1 (en) 2002-08-27

Family

ID=23980104

Family Applications (3)

Application Number Title Priority Date Filing Date
US08/498,221 Expired - Lifetime US5905499A (en) 1995-07-05 1995-07-05 Method and system for high performance computer-generated virtual environments
US09/313,508 Expired - Lifetime US6285370B1 (en) 1995-07-05 1999-05-17 Method and system for high performance computer-generated virtual environments
US09/945,405 Expired - Lifetime US6441815B1 (en) 1995-07-05 2001-08-31 Method and system for high performance computer-generated virtual environments

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US08/498,221 Expired - Lifetime US5905499A (en) 1995-07-05 1995-07-05 Method and system for high performance computer-generated virtual environments
US09/313,508 Expired - Lifetime US6285370B1 (en) 1995-07-05 1999-05-17 Method and system for high performance computer-generated virtual environments

Country Status (1)

Country Link
US (3) US5905499A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030025694A1 (en) * 2001-06-06 2003-02-06 Punch! Software, Llc Method of rendering bitmap images into three dimensions
US20040130578A1 (en) * 2003-01-08 2004-07-08 Douglas Charney Method and system for selection of menu items in a telephone menu screen interface
US20060232665A1 (en) * 2002-03-15 2006-10-19 7Tm Pharma A/S Materials and methods for simulating focal shifts in viewers using large depth of focus displays
US20080117289A1 (en) * 2004-08-06 2008-05-22 Schowengerdt Brian T Variable Fixation Viewing Distance Scanned Light Displays
US20080158248A1 (en) * 2004-01-20 2008-07-03 Matsushita Electric Industrial Co., Ltd. Rendering device and rendering method
US20080270945A1 (en) * 2007-04-24 2008-10-30 Fatdoor, Inc. Interior spaces in a geo-spatial environment
US20120116953A1 (en) * 2007-11-21 2012-05-10 International Business Machines Corporation Generation of a Three-Dimensional Virtual Reality Environment From a Business Process Model
US8375397B1 (en) 2007-11-06 2013-02-12 Google Inc. Snapshot view of multi-dimensional virtual environment
US8595299B1 (en) * 2007-11-07 2013-11-26 Google Inc. Portals between multi-dimensional virtual environments
US20140125649A1 (en) * 2000-08-22 2014-05-08 Bruce Carlin Network repository of digitalized 3D object models, and networked generation of photorealistic images based upon these models
US8732591B1 (en) 2007-11-08 2014-05-20 Google Inc. Annotations of objects in multi-dimensional virtual environments
US20150312561A1 (en) * 2011-12-06 2015-10-29 Microsoft Technology Licensing, Llc Virtual 3d monitor
CN107810634A (en) * 2015-06-12 2018-03-16 微软技术许可有限责任公司 Display for stereoscopic augmented reality
US10262231B2 (en) * 2012-03-19 2019-04-16 Google Llc Apparatus and method for spatially referencing images

Families Citing this family (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5905499A (en) * 1995-07-05 1999-05-18 Fakespace, Inc. Method and system for high performance computer-generated virtual environments
US6317127B1 (en) * 1996-10-16 2001-11-13 Hughes Electronics Corporation Multi-user real-time augmented reality system and method
JP3469410B2 (en) * 1996-11-25 2003-11-25 三菱電機株式会社 Wellness System
AU731906B2 (en) * 1997-07-18 2001-04-05 Sony Corporation Image signal multiplexing apparatus and methods, image signal demultiplexing apparatus and methods, and transmission media
US6208997B1 (en) * 1997-10-17 2001-03-27 The Regents Of The University Of California Rapid production of optimal-quality reduced-resolution representations of very large databases
US5999944A (en) * 1998-02-27 1999-12-07 Oracle Corporation Method and apparatus for implementing dynamic VRML
US6552697B1 (en) * 1999-04-21 2003-04-22 Ati International S.R.L. Method and apparatus for generating stereoscopic three-dimensional images
AU5011700A (en) * 1999-05-14 2000-12-05 Graphic Gems Method and apparatus for displaying distant objects in a displayed scene
US6972734B1 (en) * 1999-06-11 2005-12-06 Canon Kabushiki Kaisha Mixed reality apparatus and mixed reality presentation method
US7015954B1 (en) * 1999-08-09 2006-03-21 Fuji Xerox Co., Ltd. Automatic video system using multiple cameras
GB0012275D0 (en) * 2000-05-22 2000-07-12 Secr Defence Brit Three dimensional human computer interface
JP3450833B2 (en) * 2001-02-23 2003-09-29 キヤノン株式会社 Image processing apparatus and method and program code storage medium
US6677956B2 (en) * 2001-08-15 2004-01-13 Mitsubishi Electric Research Laboratories, Inc. Method for cross-fading intensities of multiple images of a scene for seamless reconstruction
US7225115B2 (en) * 2001-10-04 2007-05-29 Novint Technologies, Inc. Coordinating haptics with visual images in a human-computer interface
US7120293B2 (en) * 2001-11-30 2006-10-10 Microsoft Corporation Interactive images
US20040032489A1 (en) * 2002-08-13 2004-02-19 Tyra Donald Wayne Method for displaying a visual element of a scene
US7680322B2 (en) * 2002-11-12 2010-03-16 Namco Bandai Games Inc. Method of fabricating printed material for stereoscopic viewing, and printed material for stereoscopic viewing
US7321682B2 (en) * 2002-11-12 2008-01-22 Namco Bandai Games, Inc. Image generation system, image generation method, program, and information storage medium
JP3855053B2 (en) * 2003-01-30 2006-12-06 国立大学法人 東京大学 Image processing apparatus, image processing method, and image processing program
US7497807B2 (en) * 2003-07-15 2009-03-03 Cube X Incorporated Interactive computer simulation enhanced exercise machine
US7497812B2 (en) * 2003-07-15 2009-03-03 Cube X, Incorporated Interactive computer simulation enhanced exercise machine
US20050054492A1 (en) * 2003-07-15 2005-03-10 Neff John D. Exercise device for under a desk
US7546343B2 (en) * 2003-09-23 2009-06-09 Alcatel-Lucent Usa Inc. System and method for supporting virtual conferences
GB0322840D0 (en) * 2003-09-30 2003-10-29 Lange Eric B Stereoscopic imaging
US7643025B2 (en) * 2003-09-30 2010-01-05 Eric Belk Lange Method and apparatus for applying stereoscopic imagery to three-dimensionally defined substrates
CA2550512C (en) * 2003-12-19 2012-12-18 Tdvision Corporation S.A. De C.V. 3d videogame system
JP4227561B2 (en) * 2004-06-03 2009-02-18 キヤノン株式会社 Image processing method, image processing apparatus
US9002754B2 (en) 2006-03-17 2015-04-07 Fatdoor, Inc. Campaign in a geo-spatial environment
US8732091B1 (en) 2006-03-17 2014-05-20 Raj Abhyanker Security in a geo-spatial environment
US9373149B2 (en) 2006-03-17 2016-06-21 Fatdoor, Inc. Autonomous neighborhood vehicle commerce network and community
US8874489B2 (en) 2006-03-17 2014-10-28 Fatdoor, Inc. Short-term residential spaces in a geo-spatial environment
US9064288B2 (en) 2006-03-17 2015-06-23 Fatdoor, Inc. Government structures and neighborhood leads in a geo-spatial environment
US20070218900A1 (en) 2006-03-17 2007-09-20 Raj Vasant Abhyanker Map based neighborhood search and community contribution
US8965409B2 (en) 2006-03-17 2015-02-24 Fatdoor, Inc. User-generated community publication in an online neighborhood social network
US8863245B1 (en) 2006-10-19 2014-10-14 Fatdoor, Inc. Nextdoor neighborhood social network method, apparatus, and system
US9071367B2 (en) 2006-03-17 2015-06-30 Fatdoor, Inc. Emergency including crime broadcast in a neighborhood social network
US9459622B2 (en) 2007-01-12 2016-10-04 Legalforce, Inc. Driverless vehicle commerce network and community
US8738545B2 (en) 2006-11-22 2014-05-27 Raj Abhyanker Map based neighborhood search and community contribution
US9037516B2 (en) 2006-03-17 2015-05-19 Fatdoor, Inc. Direct mailing in a geo-spatial environment
US9070101B2 (en) 2007-01-12 2015-06-30 Fatdoor, Inc. Peer-to-peer neighborhood delivery multi-copter and method
US20100245571A1 (en) * 2006-04-24 2010-09-30 Northrop Grumman Corporation Global hawk image mosaic
US9958934B1 (en) * 2006-05-01 2018-05-01 Jeffrey D. Mullen Home and portable augmented reality and virtual reality video game consoles
US20080147488A1 (en) * 2006-10-20 2008-06-19 Tunick James A System and method for monitoring viewer attention with respect to a display and determining associated charges
US9098545B2 (en) 2007-07-10 2015-08-04 Raj Abhyanker Hot news neighborhood banter in a geo-spatial social network
CA2643570C (en) * 2007-11-08 2013-01-22 Carole Moquin Virtual environment simulating travel by various modes of transportation
JP4956574B2 (en) * 2009-03-24 2012-06-20 株式会社東芝 Stereoscopic image drawing apparatus and drawing method
US20120157204A1 (en) * 2010-12-20 2012-06-21 Lai Games Australia Pty Ltd. User-controlled projector-based games
EP2490452A1 (en) * 2011-02-21 2012-08-22 Advanced Digital Broadcast S.A. A method and system for rendering a stereoscopic view
US9439367B2 (en) 2014-02-07 2016-09-13 Arthi Abhyanker Network enabled gardening with a remotely controllable positioning extension
US9457901B2 (en) 2014-04-22 2016-10-04 Fatdoor, Inc. Quadcopter with a printable payload extension system and method
US9004396B1 (en) 2014-04-24 2015-04-14 Fatdoor, Inc. Skyteboard quadcopter and method
US9022324B1 (en) 2014-05-05 2015-05-05 Fatdoor, Inc. Coordination of aerial vehicles through a central server
US9441981B2 (en) 2014-06-20 2016-09-13 Fatdoor, Inc. Variable bus stops across a bus route in a regional transportation network
US9971985B2 (en) 2014-06-20 2018-05-15 Raj Abhyanker Train based community
US9451020B2 (en) 2014-07-18 2016-09-20 Legalforce, Inc. Distributed communication of independent autonomous vehicles to provide redundancy and performance
US9911232B2 (en) 2015-02-27 2018-03-06 Microsoft Technology Licensing, Llc Molding and anchoring physically constrained virtual environments to real-world environments
DE102015004749A1 (en) * 2015-04-11 2016-10-13 Audi Ag A method of operating a virtual reality goggles and system with a virtual-reality goggles
US9898864B2 (en) 2015-05-28 2018-02-20 Microsoft Technology Licensing, Llc Shared tactile interaction and user safety in shared space multi-person immersive virtual reality
US9836117B2 (en) 2015-05-28 2017-12-05 Microsoft Technology Licensing, Llc Autonomous drones for tactile feedback in immersive virtual reality
US20180330325A1 (en) 2017-05-12 2018-11-15 Zippy Inc. Method for indicating delivery location and software for same

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3423066C2 (en) 1983-06-24 1989-08-24 Sharp K.K., Osaka, Jp
US5130794A (en) * 1990-03-29 1992-07-14 Ritchey Kurtis J Panoramic display system
US5504845A (en) * 1990-09-10 1996-04-02 Modacad, Inc. Method for remodeling and rendering three-dimensional surfaces
JP3179474B2 (en) * 1990-11-28 2001-06-25 株式会社日立製作所 Computer graphics display method and an information processing apparatus
JPH07325934A (en) * 1992-07-10 1995-12-12 Walt Disney Co:The Method and device for supplying improved graphics to virtual word
US5495576A (en) * 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5513129A (en) * 1993-07-14 1996-04-30 Fakespace, Inc. Method and system for controlling computer-generated virtual environment in response to audio signals
US5905499A (en) * 1995-07-05 1999-05-18 Fakespace, Inc. Method and system for high performance computer-generated virtual environments

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140125649A1 (en) * 2000-08-22 2014-05-08 Bruce Carlin Network repository of digitalized 3D object models, and networked generation of photorealistic images based upon these models
US8930844B2 (en) * 2000-08-22 2015-01-06 Bruce Carlin Network repository of digitalized 3D object models, and networked generation of photorealistic images based upon these models
US20030025694A1 (en) * 2001-06-06 2003-02-06 Punch! Software, Llc Method of rendering bitmap images into three dimensions
US20060232665A1 (en) * 2002-03-15 2006-10-19 7Tm Pharma A/S Materials and methods for simulating focal shifts in viewers using large depth of focus displays
US7428001B2 (en) 2002-03-15 2008-09-23 University Of Washington Materials and methods for simulating focal shifts in viewers using large depth of focus displays
US20040130578A1 (en) * 2003-01-08 2004-07-08 Douglas Charney Method and system for selection of menu items in a telephone menu screen interface
US20080158248A1 (en) * 2004-01-20 2008-07-03 Matsushita Electric Industrial Co., Ltd. Rendering device and rendering method
US20080117289A1 (en) * 2004-08-06 2008-05-22 Schowengerdt Brian T Variable Fixation Viewing Distance Scanned Light Displays
US8248458B2 (en) 2004-08-06 2012-08-21 University Of Washington Through Its Center For Commercialization Variable fixation viewing distance scanned light displays
US20080270945A1 (en) * 2007-04-24 2008-10-30 Fatdoor, Inc. Interior spaces in a geo-spatial environment
US9003424B1 (en) 2007-11-05 2015-04-07 Google Inc. Snapshot view of multi-dimensional virtual environment
US8375397B1 (en) 2007-11-06 2013-02-12 Google Inc. Snapshot view of multi-dimensional virtual environment
US8631417B1 (en) 2007-11-06 2014-01-14 Google Inc. Snapshot view of multi-dimensional virtual environment
US8595299B1 (en) * 2007-11-07 2013-11-26 Google Inc. Portals between multi-dimensional virtual environments
US8732591B1 (en) 2007-11-08 2014-05-20 Google Inc. Annotations of objects in multi-dimensional virtual environments
US10341424B1 (en) 2007-11-08 2019-07-02 Google Llc Annotations of objects in multi-dimensional virtual environments
US9398078B1 (en) 2007-11-08 2016-07-19 Google Inc. Annotations of objects in multi-dimensional virtual environments
US9886682B2 (en) * 2007-11-21 2018-02-06 International Business Machines Corporation Generation of a three-dimensional virtual reality environment from a business process model
US20120116953A1 (en) * 2007-11-21 2012-05-10 International Business Machines Corporation Generation of a Three-Dimensional Virtual Reality Environment From a Business Process Model
US20150312561A1 (en) * 2011-12-06 2015-10-29 Microsoft Technology Licensing, Llc Virtual 3d monitor
US10262231B2 (en) * 2012-03-19 2019-04-16 Google Llc Apparatus and method for spatially referencing images
CN107810634A (en) * 2015-06-12 2018-03-16 微软技术许可有限责任公司 Display for stereoscopic augmented reality

Also Published As

Publication number Publication date
US5905499A (en) 1999-05-18
US6441815B1 (en) 2002-08-27
US6285370B1 (en) 2001-09-04

Similar Documents

Publication Publication Date Title
Bandyopadhyay et al. Dynamic shader lamps: Painting on movable objects
Lake et al. Stylized rendering techniques for scalable real-time 3d animation
Zhang et al. Visibility culling using hierarchical occlusion maps
US5751927A (en) Method and apparatus for producing three dimensional displays on a two dimensional surface
US7068274B2 (en) System and method for animating real objects with projected images
Vince Introduction to virtual reality
US8860712B2 (en) System and method for processing video images
Regan et al. Priority rendering with a virtual reality address recalculation pipeline
CA2282637C (en) Method for rendering shadows on a graphical display
US7439975B2 (en) Method and system for producing dynamically determined drop shadows in a three-dimensional graphical user interface
US5696892A (en) Method and apparatus for providing animation in a three-dimensional computer generated virtual world using a succession of textures derived from temporally related source images
US6057847A (en) System and method of image generation and encoding using primitive reprojection
JP3184327B2 (en) 3D graphics processing method and apparatus
Airey et al. Towards image realism with interactive update rates in complex virtual building environments
US5630043A (en) Animated texture map apparatus and method for 3-D image displays
Mark et al. Post-rendering 3d warping.
JP3981302B2 (en) Three-dimensional static or moving object hierarchy image-based representations as well as methods and apparatus for using the representation to render the object
Darsa et al. Navigating static environments using image-space simplification and morphing
US6268862B1 (en) Three dimensional virtual space generation by fusing images
Snyder Hierarchical image caching for accelerated walkthroughs of complex environments
US8515157B2 (en) Method for digitally rendering skin or like materials
Bergeron A general version of Crow's shadow volumes
Ayd et al. Scene representation technologies for 3DTV—a survey
Zockler et al. Interactive visualization of 3D-vector fields using illuminated stream lines
CA2232757C (en) Real-time image rendering with layered depth images

Legal Events

Date Code Title Description
AS Assignment

Owner name: FAKESPACE LABS, INC., CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNORS:MCDOWALL, IAN E.;BOLAS, MARK T.;REEL/FRAME:012833/0374

Effective date: 19990831

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: BANK OF AMERICA, N.A., NEW YORK

Free format text: SECURITY AGREEMENT;ASSIGNORS:ADVANCED MEDICAL OPTICS, INC.;AMO HOLDINGS, LLC;REEL/FRAME:013203/0039

Effective date: 20020621

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: ADVANCED MEDICAL OPTICS, INC., CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST AT REEL/FRAME NO. 13203/0039;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:019111/0348

Effective date: 20070402

Owner name: AMO HOLDINGS, INC. (FORMERLY KNOWN AS AMO HOLDINGS

Free format text: RELEASE OF SECURITY INTEREST AT REEL/FRAME NO. 13203/0039;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:019111/0348

Effective date: 20070402

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12