WO2008066954A1 - Time-sliced multiplexed image display - Google Patents

Time-sliced multiplexed image display Download PDF

Info

Publication number
WO2008066954A1
WO2008066954A1 PCT/US2007/069458 US2007069458W WO2008066954A1 WO 2008066954 A1 WO2008066954 A1 WO 2008066954A1 US 2007069458 W US2007069458 W US 2007069458W WO 2008066954 A1 WO2008066954 A1 WO 2008066954A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
interleaved
stream
image stream
frames
Prior art date
Application number
PCT/US2007/069458
Other languages
French (fr)
Inventor
Scott R. Trowbridge
Steven C. Blum
Justin Michael Schwartz
Brian Mcquillian
Original Assignee
Universal City Studios Lllp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universal City Studios Lllp filed Critical Universal City Studios Lllp
Priority to JP2009539374A priority Critical patent/JP5048781B2/en
Priority to ES07762287.6T priority patent/ES2553615T3/en
Priority to CN2007800438550A priority patent/CN101543085B/en
Priority to EP07762287.6A priority patent/EP2090118B1/en
Priority to KR1020097011011A priority patent/KR101389195B1/en
Publication of WO2008066954A1 publication Critical patent/WO2008066954A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/354—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying sequentially
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41415—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/015—High-definition television systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/337—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using polarisation multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/398—Synchronisation thereof; Control thereof

Definitions

  • the field of the invention relates to motion picture display and viewing, and in particular, to a new and useful apparatus and method for displaying multiple image streams for individual viewers to perceive only a selected subset of the total set of projected image streams.
  • the invention is well suited for use in amusement parks or theme parks, as well as in movie theaters and other places where display screens are used.
  • a conventional television show or theatrical film or other "moving picture" display is comprised of multiple still images shown in rapid succession on a screen or other display surface.
  • the still images forming a moving picture are displayed at a rate of about 24-30 frames per second and are often synchronized with sound.
  • the images impart the effect of motion because the human eye cannot perceive distinct changes in frames at rates greater than about 20 frames per second and blur the changes into the illusion of motion.
  • the human eye does not perceive flickering at rates above approximately 50 frames per second due to visual persistence.
  • the above phenomenon has been used since the beginning of the 20th century to produce moving pictures, or movies. Thomas Edison, the inventor of the motion picture camera, needed to balance the needs of human perception with the need to minimize the amount of film that needed to be taken.
  • Three-dimensional, or 3D, displays which have two different images forming a stereoscopic image in a single frame are also popular.
  • the images can be separated by light polarization for projected images, or color, or via time-sequenced shuttering equipment.
  • images separated by polarization one method would be for images for each eye to be polarized orthogonally to one another. The viewer is given polarized lenses to look through, which are coordinated with the projected image polarization for that eye, such that only the intended image reaches each eye.
  • each component of the stereoscopic image is presented in a different color within a single frame.
  • a shuttering system For images that are time sequenced, a shuttering system presents the left and right images sequentially, and the observer wears glasses with shuttering mechanisms synchronized with the projection such that light is allowed to pass only when the appropriate image is illuminated.
  • a person wearing glasses with lenses designed to filter images for each eye views the component images of the frame, one per eye, and human vision recombines the images into a single image having a three-dimensional appearance.
  • a 3D image may look discolored and distorted when viewed without the appropriate aforementioned filtering mechanisms. Similar to conventional 2D images on a movie theater or television screen or other projection surface, observers viewing a conventional 3D display all see the same image.
  • VR glasses typically present each user with a single image directly in front of their eyes, with all other surroundings blocked out by the VR glasses.
  • VR glasses can be used to present different images to each individual in a small group since the input for the VR glasses can be made unique.
  • VR glasses are impractical for use with large crowds of people due to the cost and volume of equipment required. The equipment must be unusually mechanically robust to resist abuse by guests and other wear and tear damage, and sanitizing between uses is logistically difficult and reduces equipment life. Further, it is difficult for individuals wearing the headsets to share the experience, as the glasses block out all surroundings.
  • a device for displaying multiple image streams comprising multiple image frames that entertains multiple viewers comprises at least three image generators for generating at least three separate image streams each comprising multiple image frames and wherein at least one image generator is configured for at least one viewer input.
  • An image multiplexer is provided for interleaving the image frames of each image stream to produce an interleaved image stream and a display is provided for showing the interleaved image stream.
  • a filtering mechanism is also provided that comprises at least one shutter that is synchronized to the display of the desired frames in the interleaved image stream.
  • the filtering mechanism is interposed between the viewer and display medium.
  • the interleaved image stream is superimposed on a background image stream that is visible to all viewers.
  • the images from other projectors may be subtracted out prior to projection so as not to cause distortion in the combined image.
  • the combination of a background image stream and a selected subset of filtered image streams is passed by the viewer's filtering mechanism, such as a shuttering filter.
  • a method of displaying multiple image streams comprising multiple image frames for entertaining multiple viewers comprises generating at least three separate image streams each comprising multiple image frames and providing for input from at least one viewer to one of the separate image streams; interleaving image frames of each image stream to produce an interleaved image stream; and displaying the interleaved image stream.
  • Fig. 1 is a schematic of a display system in accordance with one embodiment of the invention.
  • Fig. 2 is a schematic of a display system in accordance with a further embodiment of the invention.
  • Fig. 3 is a timing chart in accordance with another embodiment of the invention.
  • Fig. 4 is a timing chart showing an alternative embodiment of the invention.
  • Fig. 5 is a timing chart illustrating a still further alternative embodiment of the invention.
  • FIG. 1 illustrates a display system in which images 34, 36, 38 are depicted in image streams 14, 16, 18, respectively, for combining into a single interleaved image stream 20.
  • Each of the image streams 14, 16, 18 comprise multiple frames Al through A4, labeled 14a-d, Bl through B4, labeled 16a-d, Cl through C4, labeled 18a-d, respectively.
  • the interleaved image stream 20 comprises multiple image frames labeled as 22a-c, repetitively, which correspond to particular image frames from each image stream 14, 16 and 18, respectively.
  • each stream 14, 16, 18 may change between frames 14a-d, 16a-d, 18a-d, or it may remain constant for a period of time; in order to impart the illusion of motion, the images 34, 36, 38 change with time.
  • Each stream 14, 16, 18 may have any number of frames. It is preferable that each stream 14, 16, 18 have the same number of frames so that the interleaved image stream 20 displays an image for each stream until the interleaved image stream 20 ends. Further, while three separate image streams 14, 16, 18 are illustrated, the number should not be seen as limiting; as few as two independent image streams 14, 16 may be employed, or multiple streams may be combined to form the interleaved image stream 20.
  • the image streams 14, 16, 18 may be combined in any order in the interleaved image stream 20; that is, it is not essential that the order is 1, 2, 3, 1, 2, 3.
  • the order of the combined images 14a-d, 16a-d, 18a-d is only limited by the fact that a certain number of images from one of the image streams 14, 16, 18 must be presented to a viewer each second with high enough frequency to avoid visible frame changes or flickering, and any filtering mechanism 50, 52, 54 is synchronized to the image frame 14a-d, 16a-d, 18a-d display order.
  • images 34, 36, 38 represent three different objects - a cylinder, a cube and a triangle.
  • the images 34, 36, 38 presented can all be two-dimensional, in 3D form, or a combination of image types.
  • the cylinder 34 and cube 36 images may be presented in 2D or 3D, while the triangle 38 is a 2D image.
  • the viewers 40, 42, 44 are each provided with means for viewing a 2D or a 3D image and the system is operated accordingly.
  • the frames 14a-d, 16a-d, 18a-d forming the image of each object are combined in a predetermined manner to produce the interleaved image stream 20.
  • Display media 25 may be a video screen, a projection screen, a television or computer monitor or another device capable of displaying the interleaved image stream 20.
  • the display media 25 may be a lenticular lens, so that multiple images can be projected at once in the image stream 20, and the lens separates the images for viewers at different physical positions relative to the lens.
  • Three viewers 40, 42, 44 are shown in Fig. 1 who each view the interleaved image stream 20.
  • a filter mechanism 50, 52, 54 is interposed between each viewer 40, 42, 44 and the display media 25.
  • the filter mechanisms 50, 52, 54 are operated so that each viewer 40, 42, 44 sees only one of the images in the interleaved image stream 20.
  • the filter mechanisms 50, 52, 54 are shuttering devices that can be implemented as any of optical, electro-optical, mechanical or electro-mechanical, chemical and electro-chemical.
  • the mechanisms 50, 52, 54 can be composed solely of or include polarization or other filtering.
  • Each of the filter mechanisms 50, 52, 54 includes a synchronization device for synchronizing the shuttering of the filter mechanism with the display of one of the image streams 14, 16, 18 in the interleaved image stream 20, so that only the selected image stream 14, 16, 18 is visible on the display media 25 as viewed through the particular filter mechanism 50, 52, 54.
  • the display time for each frame 22a-c in the interleaved image stream is selected to ensure viewers 40, 42, 44 can still interpret the image 34, 36, 38 displayed on the display media 25. For example, in the case of the three images 34, 36, 38 combined into the interleaved image stream 20, each frame 22a-c can be displayed for about 1/90 second.
  • the filtering mechanism 50, 52, 54 for each viewer 40, 42, 44 is synchronized to pass the appropriate image frame 22a-c at the correct time for each viewer and to prevent image frames 22a-c from other ones of the image streams 14, 16, 18 from being seen.
  • Polarizing filters combined with shutters can be used to double the effective frame rate.
  • the number of viewers 40, 42, 44 illustrated in Fig. 1 should not be seen as limiting. Any number of viewers 40, 42, 44 may view each one of the image streams 14, 16, 18 contained in the interleaved image stream 20. Viewers 40, 42, 44 may all view the same filtered image 34, 36, 38, or they may each view a different one, and other, different image streams can be provided for additional viewers to view. Viewers 40, 42, 44 may view a common filtered image 34, 36, 38 through a shared filter mechanism 50, 52, or 54, or though individual filter mechanisms.
  • Filter mechanisms 50, 52, 54 include, among other things, self-supported panels or windows containing active shutters, and headwear, including goggles or glasses with active shutter lenses.
  • filter mechanisms 50, 52, 54 can be electro-optical systems or polarizing filters. It should be noted that the system does not require a given image 34, 36, 38 in the interleaved image stream 20 to be viewed by any viewer.
  • FIG. 2 illustrates an optional embodiment of the invention shown in Fig. 1 in which two image display drivers or projectors 85, 95 are provided and the outputs are combined on display media 25.
  • the term projector is intended to include other image display devices used to produce an image upon a surface, including LCD and plasma monitors, among others.
  • Projectors 85, 95 may be capable of displaying images at frame rates of 30 frames/sec and higher, including about 150 frames/ second or more.
  • the common image projector 95 receives a single image signal from source 90 for display on display media 25.
  • the image signal from source 90 is not interleaved. All viewers in the system see the same image produced by projector 95.
  • a multiple image projector 85 receives a signal containing multiple images from image multiplexer 80 for display on the display media 25 in combination or overlay with the image from common image projector 95.
  • Image multiplexer 80 combines signals from three sources 64, 66, 70.
  • Source 70 produces an image stream that is responsive to user inputs 60, 62.
  • Sources 64, 66 are real time image generators which use inputs from interactive inputs 60, 62 to generate image displays to combine with the image stream from source 70 and produce an interleaved image stream 20. It will be understood that source 70 may be responsive to the sources 64, 66 in that various changes to a story line may occur based on one or more viewer's input. This optional feature is reflected in the connection illustrated in broken line between sources 64, 66 and source 70.
  • the non- interleaved frame rate from common image projector 95 can be adjusted so that each frame is displayed for the same amount of time as one cycle of interleaved frames from the multiple image projector 85. That is, the image from common image projector 95 is displayed for the same amount of time as it takes to display one frame for each of the interleaved image streams combined by the image multiplexer 80.
  • a viewer watches the combined images from the common image projector 95 and the multiple image projector through a filter mechanism 50, the viewer sees a selected image stream from the multiple image projector.
  • the images from sources 64, 66, and 70 may be subtracted from the image source 90 sent to projector 95. That is, projector 95 presents the common background image with holes or blank space where the images from sources 64, 66, 70 are projected to produce the combined image. The image subtraction is necessary so that viewers do not see color-distorted images on display media 25.
  • the invention as illustrated by Fig. 2 can be used to provide an interactive experience in which a guest at an entertainment attraction provides the user input 60 or 62 to the system.
  • the user input 60, 62 drives real-time image generator 64, 66 to produce an image stream that can be multiplexed and displayed.
  • the user inputs can be gaming guns for simulating targeting and shooting target objects in an image stream displayed on the display media 25.
  • the image multiplexer 80 combines images of targets generated by the responsive source 70 with images corresponding to "shots" fired by the gaming guns (user inputs 60, 62).
  • the multiplexed image stream combines the user input generated images 64, 66 with the responsive source image 70 into a single stream. As shown in Fig.
  • images corresponding to their shots can be interleaved in the multiplexed image stream, and the users can be outfitted with filter mechanisms 50, 52, 54 so that they each see only their own shots, even though they are playing on the same display media 25.
  • the multiplexed image stream is projected or displayed by projector 85 concurrently with, for example, a background image generated from source 90 and projected or displayed by projector 95.
  • the image streams 14, 16, 18 are composed of frames 14a-d, 16a-d, 18a-d that produce three-dimensional images.
  • the frames are divided into left eye and right eye images as is known when creating three-dimensional images; that is, one set of frames is intended to be seen by a viewer's left eye only, while the other set of frames are to be seen only by the viewer's right eye.
  • the frames of each image stream 14, 16, 18 are arranged so that when they are interleaved, the corresponding left and right eye images for each viewer are displayed consecutively.
  • Filter mechanisms 50, 52, 54 are provided to each viewer 40, 42, 44 which selectively expose only one of the viewer's eyes at a time in synchronization with the desired image stream so that each viewer sees a three- dimensional image.
  • the filter mechanisms 50, 52, 54 may use polarization or electrical or mechanical shuttering or some combination thereof to block or pass a desired image.
  • Fig. 3 is a timing chart showing the status of a shutter Ll, Rl; L2, R2; L3, R3 for each lens of a viewer's filtering mechanism 50, 52, 54.
  • a "0" indicates the shutter is closed, while a " 1 " indicates the shutter is open.
  • only one shutter Ll, Rl; L2, R2; L3, R3 of the six in the example is opened at any one time.
  • the shutters Ll, Rl; L2, R2; L3, R3 are opened sequentially in the same order that the corresponding image stream frames are displayed.
  • the opening of a selected shutter Ll, Rl; L2, R2; L3, R3 is synchronized to the corresponding image frame.
  • the first stream, left eye image is displayed at time 1 while shutter Ll is open, followed by the first stream, right eye image at time 2 while shutter Rl is open, then the second stream, left eye image is displayed at time 3 as shutter L2 is open, and so on.
  • the left and right eye image frames for the image streams can be interleaved so that all left eye image frames are displayed, followed by all right eye image frames. Other image interleaving patterns are possible as well.
  • each shutter can be opened for about 1/180 second, during which time the corresponding image frame of the interleaved three- dimensional image stream is displayed on display media 25.
  • each viewer sees a filtered image in each eye for 1/180 second and each viewer's eye is exposed to a new image every 1/30 second, for a frame rate of 30 frames per second for each viewer.
  • the three dimensional image streams could be used in the interactive system of Fig. 2.
  • the filters 50, 52, 54 are adapted to incorporate separate lenses with independent shutters Ll, Rl; L2, R2; L3, R3 for each eye of a viewer, and the shutters are operated as shown in Fig. 3.
  • Ll, Rl; L2, R2; L3, R3 for each eye of a viewer
  • the shutters are operated as shown in Fig. 3.
  • a three- dimensional image is seen by each viewer overlaid on a common or background image from source 90.
  • a three-dimensional individual interactive experience is thereby provided using a single display media.
  • Figs. 4 and 5 illustrate further timing charts using different sequences for opening and closing the shutters Ll, Rl; L2, R2; L3, R3.
  • the shuttering order starts with the right shutter, Rl instead of the left shutter Ll , and is then followed in sequence by R2 and R3.
  • the left lenses Ll, L2, L3 are then opened in order after the right lenses Rl, R2, R3.
  • the shutter opening starts with R3, followed by L3, then R2, L2 and Rl, Ll in order.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Circuits (AREA)

Abstract

A device for displaying multiple image streams each comprising multiple image frames that entertains multiple viewers includes at least three image generators for generating at least three separate image streams that each include multiple image frames. An image multiplexer is provided for interleaving image frames of each image stream to produce an interleaved image stream and a display is provided for showing the interleaved image stream. Shutter glasses (and/or polarizers) filter the interleaved image stream, thereby separating one image stream for viewing by one viewer. A method of displaying multiple image streams is also presented 2D or 3D images can be displayed.

Description

TIME-SLICED MULTIPLEXED IMAGE DISPLAY
Cross Reference to Related Applications
This application claims benefit of U.S. Patent Application Serial No. 11/565,185, filed November 30, 2006, entitled "Time-Sliced Multiplexed Image Display" the entire contents of which is incorporated herein by reference to the extent necessary to make and use the present invention.
Background of the Invention
The field of the invention relates to motion picture display and viewing, and in particular, to a new and useful apparatus and method for displaying multiple image streams for individual viewers to perceive only a selected subset of the total set of projected image streams. The invention is well suited for use in amusement parks or theme parks, as well as in movie theaters and other places where display screens are used.
A conventional television show or theatrical film or other "moving picture" display is comprised of multiple still images shown in rapid succession on a screen or other display surface. Typically, the still images forming a moving picture are displayed at a rate of about 24-30 frames per second and are often synchronized with sound. The images impart the effect of motion because the human eye cannot perceive distinct changes in frames at rates greater than about 20 frames per second and blur the changes into the illusion of motion. Similarly, the human eye does not perceive flickering at rates above approximately 50 frames per second due to visual persistence. The above phenomenon has been used since the beginning of the 20th century to produce moving pictures, or movies. Thomas Edison, the inventor of the motion picture camera, needed to balance the needs of human perception with the need to minimize the amount of film that needed to be taken. He determined experimentally that 10 frames per second sufficed to provide the illusion of continuous motion. He also determined that viewers were quite annoyed by 10 flashes per second caused by the shutter opening and closing to accommodate motion of the film between looks. This phenomenon was simply addressed by having the shutter open and close three times for each single motion of the film, producing a 30 flash per second presentation that was well received by viewers.
Now, when a group of viewers watch a conventional television or movie theater screen, they each see the same image stream and have the same viewing experience. The display produces only a single image that is shared by the entire group viewing the screen.
Three-dimensional, or 3D, displays which have two different images forming a stereoscopic image in a single frame are also popular. The images can be separated by light polarization for projected images, or color, or via time-sequenced shuttering equipment. For images separated by polarization, one method would be for images for each eye to be polarized orthogonally to one another. The viewer is given polarized lenses to look through, which are coordinated with the projected image polarization for that eye, such that only the intended image reaches each eye. For images separated by color, each component of the stereoscopic image is presented in a different color within a single frame. For images that are time sequenced, a shuttering system presents the left and right images sequentially, and the observer wears glasses with shuttering mechanisms synchronized with the projection such that light is allowed to pass only when the appropriate image is illuminated. A person wearing glasses with lenses designed to filter images for each eye views the component images of the frame, one per eye, and human vision recombines the images into a single image having a three-dimensional appearance. A 3D image may look discolored and distorted when viewed without the appropriate aforementioned filtering mechanisms. Similar to conventional 2D images on a movie theater or television screen or other projection surface, observers viewing a conventional 3D display all see the same image.
It is important in the field of theme parks and amusements to create individual or personal experiences for guests. Large projection screens with image streams are used to immerse a large number of guests in a themed environment at one time. Each guest views the same images projected onto the screen as is seen by all the other guests in the venue. Each guest has a limited interactive experience in such a setting because of the number of people simultaneously having identical experiences. Additionally, were interactive components for each guest in a large audience to be displayed simultaneously, causing many individual interactive elements to share the same screen space simultaneously, confusion and a greatly diminished guest experience would result. Furthermore, sequencing interactive elements on a large audience display is not usually possible, as the total experience time may be as short as two to three minutes in a typical theme park venue.
One method for presenting multiple users in a group with individual viewing experiences is to use virtual reality (VR) glasses. VR glasses typically present each user with a single image directly in front of their eyes, with all other surroundings blocked out by the VR glasses. VR glasses can be used to present different images to each individual in a small group since the input for the VR glasses can be made unique. However, VR glasses are impractical for use with large crowds of people due to the cost and volume of equipment required. The equipment must be unusually mechanically robust to resist abuse by guests and other wear and tear damage, and sanitizing between uses is logistically difficult and reduces equipment life. Further, it is difficult for individuals wearing the headsets to share the experience, as the glasses block out all surroundings.
Presently, no desirable methods exist for effectively creating different shows or experiences for individuals or smaller groups in larger crowds. Accordingly, a need exists for being able to create different shows or environments for individual guests or small selected groups of guests within a larger group on the same display screen to create satisfying personal experiences for each guest, and to thereby enhance the overall theme park or amusement experience. Brief Description of the Invention
A device for displaying multiple image streams comprising multiple image frames that entertains multiple viewers comprises at least three image generators for generating at least three separate image streams each comprising multiple image frames and wherein at least one image generator is configured for at least one viewer input. An image multiplexer is provided for interleaving the image frames of each image stream to produce an interleaved image stream and a display is provided for showing the interleaved image stream.
According to one particular aspect of the invention, a filtering mechanism is also provided that comprises at least one shutter that is synchronized to the display of the desired frames in the interleaved image stream. The filtering mechanism is interposed between the viewer and display medium.
In another particular aspect of the invention, the interleaved image stream is superimposed on a background image stream that is visible to all viewers. When multiple image projectors are used to combine the images for viewers, the images from other projectors may be subtracted out prior to projection so as not to cause distortion in the combined image. The combination of a background image stream and a selected subset of filtered image streams is passed by the viewer's filtering mechanism, such as a shuttering filter.
In another embodiment of the invention, a method of displaying multiple image streams comprising multiple image frames for entertaining multiple viewers, comprises generating at least three separate image streams each comprising multiple image frames and providing for input from at least one viewer to one of the separate image streams; interleaving image frames of each image stream to produce an interleaved image stream; and displaying the interleaved image stream.
The various features of novelty which characterize the invention are pointed out with particularity in the claims annexed to and forming a part of this disclosure. For a better understanding of the invention, its operating advantages and benefits obtained by its uses, reference is made to the accompanying drawings and descriptive matter. The accompanying drawings are intended to show examples of the many forms of the invention. The drawings are not intended to show the complete range of ways the invention can be made and used. Changes to and substitutions of the various components of the invention can of course be made. The invention resides as well in sub-combinations and sub-systems of the elements described, and in methods of using them.
Brief Description of the Drawings
Fig. 1 is a schematic of a display system in accordance with one embodiment of the invention;
Fig. 2 is a schematic of a display system in accordance with a further embodiment of the invention;
Fig. 3 is a timing chart in accordance with another embodiment of the invention;
Fig. 4 is a timing chart showing an alternative embodiment of the invention; and
Fig. 5 is a timing chart illustrating a still further alternative embodiment of the invention.
Detailed Description of the Invention
Referring now to the drawings in which like reference numerals are used to indicate the same or related elements, Fig. 1 illustrates a display system in which images 34, 36, 38 are depicted in image streams 14, 16, 18, respectively, for combining into a single interleaved image stream 20. Each of the image streams 14, 16, 18 comprise multiple frames Al through A4, labeled 14a-d, Bl through B4, labeled 16a-d, Cl through C4, labeled 18a-d, respectively. The interleaved image stream 20 comprises multiple image frames labeled as 22a-c, repetitively, which correspond to particular image frames from each image stream 14, 16 and 18, respectively. It should be noted that the image 34, 36, 38 in each stream 14, 16, 18 may change between frames 14a-d, 16a-d, 18a-d, or it may remain constant for a period of time; in order to impart the illusion of motion, the images 34, 36, 38 change with time. Each stream 14, 16, 18 may have any number of frames. It is preferable that each stream 14, 16, 18 have the same number of frames so that the interleaved image stream 20 displays an image for each stream until the interleaved image stream 20 ends. Further, while three separate image streams 14, 16, 18 are illustrated, the number should not be seen as limiting; as few as two independent image streams 14, 16 may be employed, or multiple streams may be combined to form the interleaved image stream 20. The image streams 14, 16, 18 may be combined in any order in the interleaved image stream 20; that is, it is not essential that the order is 1, 2, 3, 1, 2, 3. The order of the combined images 14a-d, 16a-d, 18a-d is only limited by the fact that a certain number of images from one of the image streams 14, 16, 18 must be presented to a viewer each second with high enough frequency to avoid visible frame changes or flickering, and any filtering mechanism 50, 52, 54 is synchronized to the image frame 14a-d, 16a-d, 18a-d display order.
As illustrated in Fig. 1, images 34, 36, 38 represent three different objects - a cylinder, a cube and a triangle. As will be explained further herein, the images 34, 36, 38 presented can all be two-dimensional, in 3D form, or a combination of image types. Thus, for example, the cylinder 34 and cube 36 images may be presented in 2D or 3D, while the triangle 38 is a 2D image. As explained below, the viewers 40, 42, 44 are each provided with means for viewing a 2D or a 3D image and the system is operated accordingly.
The frames 14a-d, 16a-d, 18a-d forming the image of each object are combined in a predetermined manner to produce the interleaved image stream 20. If the interleaved image stream 20 is viewed without filtering, a composite, incoherent, image 23 appears on display media 25. Display media 25 may be a video screen, a projection screen, a television or computer monitor or another device capable of displaying the interleaved image stream 20. In one alternative, the display media 25 may be a lenticular lens, so that multiple images can be projected at once in the image stream 20, and the lens separates the images for viewers at different physical positions relative to the lens. Three viewers 40, 42, 44 are shown in Fig. 1 who each view the interleaved image stream 20. A filter mechanism 50, 52, 54 is interposed between each viewer 40, 42, 44 and the display media 25. The filter mechanisms 50, 52, 54 are operated so that each viewer 40, 42, 44 sees only one of the images in the interleaved image stream 20. The filter mechanisms 50, 52, 54 are shuttering devices that can be implemented as any of optical, electro-optical, mechanical or electro-mechanical, chemical and electro-chemical. The mechanisms 50, 52, 54 can be composed solely of or include polarization or other filtering. When the filter mechanisms 50, 52, 54 are shuttered, no image passes, while when the shutter is opened, an image is visible by the eyes of the respective viewer 40, 42, 44. Each of the filter mechanisms 50, 52, 54 includes a synchronization device for synchronizing the shuttering of the filter mechanism with the display of one of the image streams 14, 16, 18 in the interleaved image stream 20, so that only the selected image stream 14, 16, 18 is visible on the display media 25 as viewed through the particular filter mechanism 50, 52, 54. The display time for each frame 22a-c in the interleaved image stream is selected to ensure viewers 40, 42, 44 can still interpret the image 34, 36, 38 displayed on the display media 25. For example, in the case of the three images 34, 36, 38 combined into the interleaved image stream 20, each frame 22a-c can be displayed for about 1/90 second. The filtering mechanism 50, 52, 54 for each viewer 40, 42, 44 is synchronized to pass the appropriate image frame 22a-c at the correct time for each viewer and to prevent image frames 22a-c from other ones of the image streams 14, 16, 18 from being seen. Polarizing filters combined with shutters can be used to double the effective frame rate.
Again, as with the number of image streams 14, 16, 18 interleaved, the number of viewers 40, 42, 44 illustrated in Fig. 1 should not be seen as limiting. Any number of viewers 40, 42, 44 may view each one of the image streams 14, 16, 18 contained in the interleaved image stream 20. Viewers 40, 42, 44 may all view the same filtered image 34, 36, 38, or they may each view a different one, and other, different image streams can be provided for additional viewers to view. Viewers 40, 42, 44 may view a common filtered image 34, 36, 38 through a shared filter mechanism 50, 52, or 54, or though individual filter mechanisms. Filter mechanisms 50, 52, 54 include, among other things, self-supported panels or windows containing active shutters, and headwear, including goggles or glasses with active shutter lenses. Optionally, filter mechanisms 50, 52, 54 can be electro-optical systems or polarizing filters. It should be noted that the system does not require a given image 34, 36, 38 in the interleaved image stream 20 to be viewed by any viewer.
Referring now also to Fig. 2 illustrates an optional embodiment of the invention shown in Fig. 1 in which two image display drivers or projectors 85, 95 are provided and the outputs are combined on display media 25. The term projector is intended to include other image display devices used to produce an image upon a surface, including LCD and plasma monitors, among others. Projectors 85, 95 may be capable of displaying images at frame rates of 30 frames/sec and higher, including about 150 frames/ second or more.
In Fig. 2, the common image projector 95 receives a single image signal from source 90 for display on display media 25. The image signal from source 90 is not interleaved. All viewers in the system see the same image produced by projector 95. A multiple image projector 85 receives a signal containing multiple images from image multiplexer 80 for display on the display media 25 in combination or overlay with the image from common image projector 95. Image multiplexer 80 combines signals from three sources 64, 66, 70. Source 70 produces an image stream that is responsive to user inputs 60, 62. Sources 64, 66 are real time image generators which use inputs from interactive inputs 60, 62 to generate image displays to combine with the image stream from source 70 and produce an interleaved image stream 20. It will be understood that source 70 may be responsive to the sources 64, 66 in that various changes to a story line may occur based on one or more viewer's input. This optional feature is reflected in the connection illustrated in broken line between sources 64, 66 and source 70.
In order to display the images from projectors 85, 95 properly to viewers, the non- interleaved frame rate from common image projector 95 can be adjusted so that each frame is displayed for the same amount of time as one cycle of interleaved frames from the multiple image projector 85. That is, the image from common image projector 95 is displayed for the same amount of time as it takes to display one frame for each of the interleaved image streams combined by the image multiplexer 80. When a viewer watches the combined images from the common image projector 95 and the multiple image projector through a filter mechanism 50, the viewer sees a selected image stream from the multiple image projector. It should be noted that in order for each viewer to see the correct combined image, the images from sources 64, 66, and 70 may be subtracted from the image source 90 sent to projector 95. That is, projector 95 presents the common background image with holes or blank space where the images from sources 64, 66, 70 are projected to produce the combined image. The image subtraction is necessary so that viewers do not see color-distorted images on display media 25.
As an example, the invention as illustrated by Fig. 2 can be used to provide an interactive experience in which a guest at an entertainment attraction provides the user input 60 or 62 to the system. The user input 60, 62 drives real-time image generator 64, 66 to produce an image stream that can be multiplexed and displayed. In one embodiment, the user inputs can be gaming guns for simulating targeting and shooting target objects in an image stream displayed on the display media 25. The image multiplexer 80 combines images of targets generated by the responsive source 70 with images corresponding to "shots" fired by the gaming guns (user inputs 60, 62). The multiplexed image stream combines the user input generated images 64, 66 with the responsive source image 70 into a single stream. As shown in Fig. 2, if there are two users each with one of the user inputs 60, 62, images corresponding to their shots can be interleaved in the multiplexed image stream, and the users can be outfitted with filter mechanisms 50, 52, 54 so that they each see only their own shots, even though they are playing on the same display media 25. The multiplexed image stream is projected or displayed by projector 85 concurrently with, for example, a background image generated from source 90 and projected or displayed by projector 95.
Referring again to Fig. 1, in a still further embodiment, the image streams 14, 16, 18 are composed of frames 14a-d, 16a-d, 18a-d that produce three-dimensional images. The frames are divided into left eye and right eye images as is known when creating three-dimensional images; that is, one set of frames is intended to be seen by a viewer's left eye only, while the other set of frames are to be seen only by the viewer's right eye. The frames of each image stream 14, 16, 18 are arranged so that when they are interleaved, the corresponding left and right eye images for each viewer are displayed consecutively. Filter mechanisms 50, 52, 54 are provided to each viewer 40, 42, 44 which selectively expose only one of the viewer's eyes at a time in synchronization with the desired image stream so that each viewer sees a three- dimensional image. The filter mechanisms 50, 52, 54 may use polarization or electrical or mechanical shuttering or some combination thereof to block or pass a desired image.
Fig. 3 is a timing chart showing the status of a shutter Ll, Rl; L2, R2; L3, R3 for each lens of a viewer's filtering mechanism 50, 52, 54. In the timing chart, a "0" indicates the shutter is closed, while a " 1 " indicates the shutter is open. As can be seen, only one shutter Ll, Rl; L2, R2; L3, R3 of the six in the example is opened at any one time. The shutters Ll, Rl; L2, R2; L3, R3 are opened sequentially in the same order that the corresponding image stream frames are displayed. The opening of a selected shutter Ll, Rl; L2, R2; L3, R3 is synchronized to the corresponding image frame. For example, the first stream, left eye image is displayed at time 1 while shutter Ll is open, followed by the first stream, right eye image at time 2 while shutter Rl is open, then the second stream, left eye image is displayed at time 3 as shutter L2 is open, and so on. Alternatively, the left and right eye image frames for the image streams can be interleaved so that all left eye image frames are displayed, followed by all right eye image frames. Other image interleaving patterns are possible as well.
As indicated in Fig. 3, for three viewers, each shutter can be opened for about 1/180 second, during which time the corresponding image frame of the interleaved three- dimensional image stream is displayed on display media 25. In a three viewer system, such as diagrammed in Figs. 1 and 3, each viewer sees a filtered image in each eye for 1/180 second and each viewer's eye is exposed to a new image every 1/30 second, for a frame rate of 30 frames per second for each viewer. In a further alternative, the three dimensional image streams could be used in the interactive system of Fig. 2. In such case the filters 50, 52, 54 are adapted to incorporate separate lenses with independent shutters Ll, Rl; L2, R2; L3, R3 for each eye of a viewer, and the shutters are operated as shown in Fig. 3. As a result, a three- dimensional image is seen by each viewer overlaid on a common or background image from source 90. A three-dimensional individual interactive experience is thereby provided using a single display media.
Figs. 4 and 5 illustrate further timing charts using different sequences for opening and closing the shutters Ll, Rl; L2, R2; L3, R3. As can be seen in Fig. 4, the shuttering order starts with the right shutter, Rl instead of the left shutter Ll , and is then followed in sequence by R2 and R3. The left lenses Ll, L2, L3 are then opened in order after the right lenses Rl, R2, R3. In Fig. 5, the shutter opening starts with R3, followed by L3, then R2, L2 and Rl, Ll in order. Thus, it should be clear that the only restriction on the order of operation of the shutters is simply that one side of a filter mechanism 50, 52, 54 should not shutter twice before the other side shutters once, so that each viewer's eye is exposed to coordinated images for a given frame.
While the present invention has been described with references to preferred embodiments, various changes or substitutions may be made on these embodiments by those ordinarily skilled in the art pertinent to the present invention with out departing from the technical scope of the present invention. Therefore, the technical scope of the present invention encompasses not only those embodiments described above, but all that fall within the scope of the appended claims.

Claims

What is Claimed is:
1. A method of displaying multiple image streams each comprising multiple image frames for entertaining multiple viewers, comprising:
generating at least three separate image streams comprising multiple image frames and providing for input from at least one viewer to at least one of the separate image streams;
interleaving image frames of each image stream to produce an interleaved image stream; and
displaying the interleaved image stream.
2. The method of claim 1, wherein the interleaving of each image frame is sequential.
3. The method of claim 1, further comprising filtering the displayed interleaved image stream to separate one of the image streams for viewing by one of the viewers.
4. The method of claim 3, wherein the interleaved image stream comprises an interleaved image stream configured for displaying two-dimensional images.
5. The method of claim 3, wherein the interleaved image stream comprises an interleaved image stream configured for displaying three-dimensional images.
6. The method of claim 3, wherein filtering the displayed interleaved image stream comprises providing polarized lenses.
7. The method of claim 1, further comprising generating a background image and displaying the background image along with the interleaved image stream.
8. The method of claim 7, wherein the interleaved image stream is subtracted from the background image prior to displaying the background image and the interleaved image stream.
9. The method of claim 1, wherein providing for input from at least one viewer comprises providing a responsive image source for varying at least one story line based on input at least one of the viewers.
10. The method of claim 3, wherein filtering the displayed interleaved image stream comprises providing a plurality of shutters that open and close for a predetermined period of time that is synchronized with a frame rate of the interleaved image stream.
11. The method of claim 10, wherein each shutter is open for about 1/180 second and the frame rate is approximately thirty frames per second.
12. The method of claim 1, wherein displaying the interleaved image stream comprises providing a plurality of image projectors one of which projects a background image stream.
13. A device for displaying multiple image streams each comprising multiple image frames that entertains multiple viewers, comprising:
at least three image generators for generating at least three separate image streams each comprising multiple image frames and wherein at least one image generator is configured for at least one viewer input;
an image multiplexer for interleaving image frames of each image stream to produce an interleaved image stream; and
a display for showing the interleaved image stream.
14. The device of claim 13, further comprising at least one filter for filtering the displayed interleaved image stream to separate one of the image streams for viewing by one of the viewers.
15. The device of claim 14, wherein the at least one filter comprises polarized lenses.
16. The device of claim 13, further comprising a background image source that generates a background image for display with the interleaved image stream.
17. The device of claim 16, wherein the interleaved image stream is subtracted from the background image prior to the background image being displayed with the interleaved image stream.
18. The device of claim 13, wherein the display comprises a plurality of image projectors one of which projects a background image stream.
19. The device of claim 13, wherein the at least one image generator configured for at least one viewer input comprises a responsive image source connected to a plurality of image generators each being configured for varying at least one story line based on input from each viewer.
20. The device of claim 14, wherein the at least one filter comprises providing a plurality of shutters that open and close for predetermined period of time that is synchronized with a frame rate of the interleaved image stream.
PCT/US2007/069458 2006-11-30 2007-05-22 Time-sliced multiplexed image display WO2008066954A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2009539374A JP5048781B2 (en) 2006-11-30 2007-05-22 Time division multiple image display
ES07762287.6T ES2553615T3 (en) 2006-11-30 2007-05-22 Display of multiplexed images by fraction of time
CN2007800438550A CN101543085B (en) 2006-11-30 2007-05-22 Time-sliced multiplexed image display
EP07762287.6A EP2090118B1 (en) 2006-11-30 2007-05-22 Time-sliced multiplexed image display
KR1020097011011A KR101389195B1 (en) 2006-11-30 2007-05-22 Time-sliced multiplexed image display

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/565,185 US8305488B2 (en) 2006-05-10 2006-11-30 Time-sliced multiplexed image display
US11/565,185 2006-11-30

Publications (1)

Publication Number Publication Date
WO2008066954A1 true WO2008066954A1 (en) 2008-06-05

Family

ID=38626695

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/069458 WO2008066954A1 (en) 2006-11-30 2007-05-22 Time-sliced multiplexed image display

Country Status (8)

Country Link
US (1) US8305488B2 (en)
EP (1) EP2090118B1 (en)
JP (1) JP5048781B2 (en)
KR (1) KR101389195B1 (en)
CN (1) CN101543085B (en)
ES (1) ES2553615T3 (en)
SG (1) SG176495A1 (en)
WO (1) WO2008066954A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010020290A (en) * 2008-06-09 2010-01-28 Sony Corp Video-signal processing apparatus, video-signal processing method, and video-signal processing system, program, and recording medium
JP2010088111A (en) * 2008-09-29 2010-04-15 Disney Enterprises Inc Method of providing stream, interactive theater system with audience participation, and apparatus for viewing and listening stream
JP2010213267A (en) * 2008-09-30 2010-09-24 Panasonic Corp Eyeglasses related to 3d images and display device
GB2472438A (en) * 2009-08-06 2011-02-09 Sony Corp Multi-person 3D display system with several viewers watching different images on a single screen
CN102187385A (en) * 2008-10-20 2011-09-14 日本电气株式会社 Image display system, image control device, method for controlling image and light shutter
CN102187382B (en) * 2008-10-20 2013-12-18 日本电气株式会社 Image display system, image display device, and optical shutter
WO2021035373A1 (en) * 2019-08-30 2021-03-04 刘简 3d glasses for decomposing 4d space of 2d video
US11321909B2 (en) 2019-08-26 2022-05-03 International Business Machines Corporation Tracking and rendering physical volumetric substances in virtual reality

Families Citing this family (83)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090309826A1 (en) 2008-06-17 2009-12-17 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Systems and devices
US8733952B2 (en) 2008-06-17 2014-05-27 The Invention Science Fund I, Llc Methods and systems for coordinated use of two or more user responsive projectors
US8308304B2 (en) 2008-06-17 2012-11-13 The Invention Science Fund I, Llc Systems associated with receiving and transmitting information related to projection
US8936367B2 (en) 2008-06-17 2015-01-20 The Invention Science Fund I, Llc Systems and methods associated with projecting in response to conformation
US8376558B2 (en) 2008-06-17 2013-02-19 The Invention Science Fund I, Llc Systems and methods for projecting in response to position change of a projection surface
US8944608B2 (en) 2008-06-17 2015-02-03 The Invention Science Fund I, Llc Systems and methods associated with projecting in response to conformation
US8641203B2 (en) 2008-06-17 2014-02-04 The Invention Science Fund I, Llc Methods and systems for receiving and transmitting signals between server and projector apparatuses
US8602564B2 (en) 2008-06-17 2013-12-10 The Invention Science Fund I, Llc Methods and systems for projecting in response to position
US8608321B2 (en) 2008-06-17 2013-12-17 The Invention Science Fund I, Llc Systems and methods for projecting in response to conformation
US8820939B2 (en) 2008-06-17 2014-09-02 The Invention Science Fund I, Llc Projection associated methods and systems
US8267526B2 (en) 2008-06-17 2012-09-18 The Invention Science Fund I, Llc Methods associated with receiving and transmitting information related to projection
US8262236B2 (en) 2008-06-17 2012-09-11 The Invention Science Fund I, Llc Systems and methods for transmitting information associated with change of a projection surface
US8384005B2 (en) 2008-06-17 2013-02-26 The Invention Science Fund I, Llc Systems and methods for selectively projecting information in response to at least one specified motion associated with pressure applied to at least one projection surface
US20090310103A1 (en) * 2008-06-17 2009-12-17 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Methods and systems for receiving information associated with the coordinated use of two or more user responsive projectors
US8723787B2 (en) 2008-06-17 2014-05-13 The Invention Science Fund I, Llc Methods and systems related to an image capture projection surface
US8274611B2 (en) * 2008-06-27 2012-09-25 Mitsubishi Electric Visual Solutions America, Inc. System and methods for television with integrated sound projection system
US8279357B2 (en) * 2008-09-02 2012-10-02 Mitsubishi Electric Visual Solutions America, Inc. System and methods for television with integrated sound projection system
EP2204965B1 (en) * 2008-12-31 2016-07-27 Google Technology Holdings LLC Device and method for receiving scalable content from multiple sources having different content quality
US8488042B2 (en) * 2009-01-28 2013-07-16 Hewlett-Packard Development Company, L.P. Systems for capturing images through a display
US8179427B2 (en) 2009-03-06 2012-05-15 Disney Enterprises, Inc. Optical filter devices and methods for passing one of two orthogonally polarized images
KR101293552B1 (en) * 2009-03-20 2013-08-06 엘지디스플레이 주식회사 Multi full size displayable system including liquid crystal display device
EP2430838A4 (en) 2009-06-16 2017-03-15 LG Electronics Inc. 3d display device and selective image display method thereof
WO2011052125A1 (en) * 2009-10-27 2011-05-05 パナソニック株式会社 Three-dimensional display device, three-dimensional display system, and three-dimensional display method
KR20120084775A (en) 2009-10-30 2012-07-30 휴렛-팩커드 디벨롭먼트 컴퍼니, 엘.피. Stereo display systems
TWI404405B (en) 2009-12-25 2013-08-01 Mstar Semiconductor Inc Image processing apparatus having on-screen display function and method thereof
CN102118625B (en) * 2009-12-30 2013-07-24 晨星软件研发(深圳)有限公司 Image processing device with screen display function and image processing method
CN102196300A (en) * 2010-03-18 2011-09-21 国际商业机器公司 Providing method and device as well as processing method and device for images of virtual world scene
US10448083B2 (en) * 2010-04-06 2019-10-15 Comcast Cable Communications, Llc Streaming and rendering of 3-dimensional video
WO2011132422A1 (en) * 2010-04-21 2011-10-27 パナソニック株式会社 Three-dimensional video display device and three-dimensional video display method
US20110267439A1 (en) * 2010-04-30 2011-11-03 Chien-Chou Chen Display system for displaying multiple full-screen images and related method
JP2011244318A (en) * 2010-05-20 2011-12-01 Sharp Corp Use-spectacle identification device, video appreciation system, video appreciation spectacle, use-spectacle identification program, recording medium readable by computer, and display apparatus
KR20110128099A (en) * 2010-05-20 2011-11-28 삼성전자주식회사 Three dimensional image display device and method of driving the same
US9030536B2 (en) 2010-06-04 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for presenting media content
US8402502B2 (en) 2010-06-16 2013-03-19 At&T Intellectual Property I, L.P. Method and apparatus for presenting media content
IL213797A0 (en) * 2010-06-29 2011-11-30 X6D Ltd Universal 3d glasses
US9787974B2 (en) * 2010-06-30 2017-10-10 At&T Intellectual Property I, L.P. Method and apparatus for delivering media content
US8593574B2 (en) 2010-06-30 2013-11-26 At&T Intellectual Property I, L.P. Apparatus and method for providing dimensional media content based on detected display capability
US8640182B2 (en) 2010-06-30 2014-01-28 At&T Intellectual Property I, L.P. Method for detecting a viewing apparatus
US8918831B2 (en) 2010-07-06 2014-12-23 At&T Intellectual Property I, Lp Method and apparatus for managing a presentation of media content
US9049426B2 (en) 2010-07-07 2015-06-02 At&T Intellectual Property I, Lp Apparatus and method for distributing three dimensional media content
US9232274B2 (en) 2010-07-20 2016-01-05 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US9032470B2 (en) 2010-07-20 2015-05-12 At&T Intellectual Property I, Lp Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
US9560406B2 (en) 2010-07-20 2017-01-31 At&T Intellectual Property I, L.P. Method and apparatus for adapting a presentation of media content
US8994716B2 (en) 2010-08-02 2015-03-31 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US20120038827A1 (en) * 2010-08-11 2012-02-16 Charles Davis System and methods for dual view viewing with targeted sound projection
US8438502B2 (en) 2010-08-25 2013-05-07 At&T Intellectual Property I, L.P. Apparatus for controlling three-dimensional images
CN101964182A (en) * 2010-09-15 2011-02-02 冠捷显示科技（厦门）有限公司 Double-picture same-screen display method based on asynchronous display
US8947511B2 (en) 2010-10-01 2015-02-03 At&T Intellectual Property I, L.P. Apparatus and method for presenting three-dimensional media content
CN102014292A (en) * 2010-11-17 2011-04-13 深圳创维－Rgb电子有限公司 3D image display system and method
US8698880B2 (en) * 2010-12-01 2014-04-15 Industrial Technology Research Institute System and method for time multiplexed stereo display and display apparatus
KR101295884B1 (en) * 2010-12-17 2013-08-16 엘지디스플레이 주식회사 Multi view and stereoscopic image display
US20130286170A1 (en) * 2010-12-29 2013-10-31 Thomson Licensing Method and apparatus for providing mono-vision in multi-view system
WO2012110910A1 (en) * 2011-02-17 2012-08-23 Tp Vision Holding B.V. Ambient lighting for dual view applications
TWI450208B (en) * 2011-02-24 2014-08-21 Acer Inc 3d charging method, 3d glass and 3d display apparatus with charging function
KR20120105199A (en) 2011-03-15 2012-09-25 엘지디스플레이 주식회사 Multi view-able stereoscopic image display device and driving method thereof
JP5810585B2 (en) * 2011-03-30 2015-11-11 カシオ計算機株式会社 Video presentation system and video presentation method
US8566694B2 (en) * 2011-04-04 2013-10-22 Xerox Corporation Multi-dimensional documents for parallel content display on a single screen for multiple viewers
US9602766B2 (en) 2011-06-24 2017-03-21 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
US9445046B2 (en) 2011-06-24 2016-09-13 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content with telepresence
US9030522B2 (en) 2011-06-24 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US8947497B2 (en) 2011-06-24 2015-02-03 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US8587635B2 (en) 2011-07-15 2013-11-19 At&T Intellectual Property I, L.P. Apparatus and method for providing media services with telepresence
CN102438162A (en) * 2011-08-19 2012-05-02 深圳Tcl新技术有限公司 Dual-channel signal processing and displaying method and device
CN102387326B (en) * 2011-09-28 2015-12-16 歌尔声学股份有限公司 Realize watching the method for different pictures, system and equipment at same screen simultaneously
CN102426829B (en) * 2011-09-30 2014-06-25 冠捷显示科技（厦门）有限公司 Double-picture display device and implementation method
EP2611152A3 (en) * 2011-12-28 2014-10-15 Samsung Electronics Co., Ltd. Display apparatus, image processing system, display method and imaging processing thereof
EP2611198A3 (en) * 2011-12-30 2013-08-21 Samsung Electronics Co., Ltd. Display apparatus, input apparatus and method for controlling the display apparatus to provide a single-view or multi-view mode
WO2013106390A1 (en) 2012-01-09 2013-07-18 Activevideo Networks, Inc. Rendering of an interactive lean-backward user interface on a television
US9800945B2 (en) 2012-04-03 2017-10-24 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US20130300730A1 (en) * 2012-05-14 2013-11-14 Shenzhen China Star Optoelectronics Technology Co., Ltd. Lcd system and method for displaying image therein
US10275128B2 (en) 2013-03-15 2019-04-30 Activevideo Networks, Inc. Multiple-mode system and method for providing user selectable video content
CN104349093A (en) * 2013-08-01 2015-02-11 深圳市亿思达科技集团有限公司 Single-machine dual-projection system and control method
KR102091519B1 (en) * 2013-11-05 2020-03-20 엘지전자 주식회사 Mobile terminal and control method thereof
US10490099B2 (en) * 2013-11-26 2019-11-26 At&T Intellectual Property I, L.P. Manipulation of media content to overcome user impairments
CN103974054A (en) * 2014-04-04 2014-08-06 广东睿立宝莱科技股份有限公司 Method for outputting double-channel video and audio by aid of single equipment
US9788029B2 (en) 2014-04-25 2017-10-10 Activevideo Networks, Inc. Intelligent multiplexing using class-based, multi-dimensioned decision logic for managed networks
KR101597546B1 (en) * 2014-07-08 2016-02-25 대우조선해양 주식회사 System for transmit receive of multiple video information and method thereof
US10264293B2 (en) 2014-12-24 2019-04-16 Activevideo Networks, Inc. Systems and methods for interleaving video streams on a client device
US10523985B2 (en) 2014-12-24 2019-12-31 Activevideo Networks, Inc. Managing deep and shallow buffers in a thin-client device of a digital media distribution network
CN104537976B (en) 2015-01-16 2018-09-04 北京智谷睿拓技术服务有限公司 Time-division display control method and device, display equipment
RU178954U1 (en) * 2016-10-10 2018-04-24 Артем Викторович Будаев MULTI-THREAD VISUALIZATION OF MULTIMEDIA DATA DEVICE
GB201720062D0 (en) * 2017-12-01 2018-01-17 Holovis International Ltd Immersive three-dimensional environment
WO2021106379A1 (en) * 2019-11-29 2021-06-03 ソニーグループ株式会社 Image processing device, image processing method, and image display system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4562463A (en) * 1981-05-15 1985-12-31 Stereographics Corp. Stereoscopic television system with field storage for sequential display of right and left images
US6188442B1 (en) 1997-08-01 2001-02-13 International Business Machines Corporation Multiviewer display system for television monitors
US20020105483A1 (en) * 1995-10-05 2002-08-08 Shunpei Yamazaki Three dimensional display unit and display method
US6529209B1 (en) * 2000-01-12 2003-03-04 International Business Machines Corporation Method for providing privately viewable data in a publically viewable display
US20040056948A1 (en) 2002-09-23 2004-03-25 Gibson Robert John Multi-play theatre

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2832821A (en) * 1954-01-11 1958-04-29 Du Mont Allen B Lab Inc Dual image viewing apparatus
US4214267A (en) * 1977-11-23 1980-07-22 Roese John A Stereofluoroscopy system
US4847690A (en) * 1987-02-19 1989-07-11 Isix, Inc. Interleaved video system, method and apparatus
US5117302A (en) * 1990-04-13 1992-05-26 Stereographics Corporation High dynamic range electro-optical shutter for steroscopic and other applications
US5821989A (en) * 1990-06-11 1998-10-13 Vrex, Inc. Stereoscopic 3-D viewing system and glasses having electrooptical shutters controlled by control signals produced using horizontal pulse detection within the vertical synchronization pulse period of computer generated video signals
US5537144A (en) * 1990-06-11 1996-07-16 Revfo, Inc. Electro-optical display system for visually displaying polarized spatially multiplexed images of 3-D objects for use in stereoscopically viewing the same with high image quality and resolution
US5619219A (en) * 1994-11-21 1997-04-08 International Business Machines Corporation Secure viewing of display units using a wavelength filter
US5537476A (en) * 1994-11-21 1996-07-16 International Business Machines Corporation Secure viewing of display units by image superposition and wavelength separation
US5969767A (en) * 1995-09-08 1999-10-19 Matsushita Electric Industrial Co., Ltd. Multipicture video signal display apparatus with modified picture indication
US6608652B1 (en) * 1995-10-14 2003-08-19 Semiconductor Energy Laboratory Co., Ltd. Image display system and method
AUPO024696A0 (en) * 1996-06-04 1996-06-27 Xenotech Research Pty Ltd Video display system
US5847771A (en) * 1996-08-14 1998-12-08 Bell Atlantic Network Services, Inc. Digital entertainment terminal providing multiple digital pictures
JPH10240212A (en) * 1997-03-03 1998-09-11 Sony Corp Video display device
JPH1147437A (en) * 1997-07-29 1999-02-23 Enix:Kk Video game device and control method for video game device
US5963371A (en) * 1998-02-04 1999-10-05 Intel Corporation Method of displaying private data to collocated users
US6975345B1 (en) * 1998-03-27 2005-12-13 Stereographics Corporation Polarizing modulator for an electronic stereoscopic display
US6674463B1 (en) * 1999-08-06 2004-01-06 Deiter Just Technique for autostereoscopic image, film and television acquisition and display by multi-aperture multiplexing
US6931660B1 (en) * 2000-01-28 2005-08-16 Opentv, Inc. Interactive television system and method for simultaneous transmission and rendering of multiple MPEG-encoded video streams
US6678091B2 (en) * 2000-02-16 2004-01-13 Matthew Bruce Tropper System and method to synchronize one or more shutters with a sequence of images
US6687399B1 (en) * 2000-08-03 2004-02-03 Silicon Integrated Systems Corp. Stereo synchronizing signal generator for liquid crystal shutter glasses
US6980177B2 (en) * 2001-08-03 2005-12-27 Waterstrike Incorporated Sequential inverse encoding apparatus and method for providing confidential viewing of a fundamental display image
US7319755B2 (en) * 2001-08-03 2008-01-15 Waterstrike Incorporated Image altering apparatus and method for providing confidential viewing of a fundamental display image
JP2003078843A (en) 2001-09-06 2003-03-14 Tsumura Sogo Kenkyusho:Kk Video showing system and video multiplexer for the same
US20040252187A1 (en) * 2001-09-10 2004-12-16 Alden Ray M. Processes and apparatuses for efficient multiple program and 3D display
US20040246383A1 (en) 2003-06-05 2004-12-09 Alden Ray M. Time sequenced user space segmentation for multiple program and 3D display
US20030202015A1 (en) * 2002-04-30 2003-10-30 Battles Amy E. Imaging device user interface method and apparatus
US20040109093A1 (en) * 2002-12-05 2004-06-10 Small-Stryker Aaron Tug Method and apparatus for simultaneous television video presentation and separate viewing of different broadcasts
US6947014B2 (en) * 2002-12-23 2005-09-20 Wooten Gary L Personalized, private eyewear-based display system
US7411611B2 (en) * 2003-08-25 2008-08-12 Barco N. V. Device and method for performing multiple view imaging by means of a plurality of video processing devices
JP2005136661A (en) 2003-10-30 2005-05-26 Nippon Telegr & Teleph Corp <Ntt> Multi-story distribution method and multi-story distributing program
JP2006071681A (en) 2004-08-31 2006-03-16 Seiko Epson Corp Image display system, optical projection display device, program and method for controlling optical projection display device display data processing apparatus and method for controlling program and display data processing apparatus
JP3964429B2 (en) 2004-12-03 2007-08-22 株式会社半導体エネルギー研究所 apparatus
JP2006186768A (en) * 2004-12-28 2006-07-13 Seiko Epson Corp Unit and method for image display
US20070247477A1 (en) * 2006-04-21 2007-10-25 Lowry Gregory N Method and apparatus for processing, displaying and viewing stereoscopic 3D images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4562463A (en) * 1981-05-15 1985-12-31 Stereographics Corp. Stereoscopic television system with field storage for sequential display of right and left images
US20020105483A1 (en) * 1995-10-05 2002-08-08 Shunpei Yamazaki Three dimensional display unit and display method
US6188442B1 (en) 1997-08-01 2001-02-13 International Business Machines Corporation Multiviewer display system for television monitors
US6529209B1 (en) * 2000-01-12 2003-03-04 International Business Machines Corporation Method for providing privately viewable data in a publically viewable display
US20040056948A1 (en) 2002-09-23 2004-03-25 Gibson Robert John Multi-play theatre

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010020290A (en) * 2008-06-09 2010-01-28 Sony Corp Video-signal processing apparatus, video-signal processing method, and video-signal processing system, program, and recording medium
US8284834B2 (en) 2008-06-09 2012-10-09 Sony Corporation Video-signal processing apparatus, video-signal processing method, and video-signal processing system
JP2010088111A (en) * 2008-09-29 2010-04-15 Disney Enterprises Inc Method of providing stream, interactive theater system with audience participation, and apparatus for viewing and listening stream
JP2010213267A (en) * 2008-09-30 2010-09-24 Panasonic Corp Eyeglasses related to 3d images and display device
CN102187385A (en) * 2008-10-20 2011-09-14 日本电气株式会社 Image display system, image control device, method for controlling image and light shutter
CN102187382B (en) * 2008-10-20 2013-12-18 日本电气株式会社 Image display system, image display device, and optical shutter
US8696132B2 (en) 2008-10-20 2014-04-15 Nec Corporation Image display system, image control apparatus, image control method, and optical shutter in which plural kinds of information are multiplexed and displayed on a display surface
GB2472438A (en) * 2009-08-06 2011-02-09 Sony Corp Multi-person 3D display system with several viewers watching different images on a single screen
JP2013501443A (en) * 2009-08-06 2013-01-10 ソニー ヨーロッパ リミテッド 3D image display method, 3D image display device, shutter glasses, program, and computer-readable recording medium
US11321909B2 (en) 2019-08-26 2022-05-03 International Business Machines Corporation Tracking and rendering physical volumetric substances in virtual reality
WO2021035373A1 (en) * 2019-08-30 2021-03-04 刘简 3d glasses for decomposing 4d space of 2d video

Also Published As

Publication number Publication date
SG176495A1 (en) 2011-12-29
CN101543085A (en) 2009-09-23
EP2090118A1 (en) 2009-08-19
EP2090118B1 (en) 2015-09-30
CN101543085B (en) 2011-07-06
US8305488B2 (en) 2012-11-06
KR101389195B1 (en) 2014-04-24
US20070266412A1 (en) 2007-11-15
JP5048781B2 (en) 2012-10-17
KR20090085648A (en) 2009-08-07
JP2010512058A (en) 2010-04-15
ES2553615T3 (en) 2015-12-10

Similar Documents

Publication Publication Date Title
EP2090118B1 (en) Time-sliced multiplexed image display
US5448287A (en) Spatial video display system
US7808449B2 (en) Method and system for multi-channel viewing applications
EP2169967B1 (en) Interactive theater with audience participation
JP5573683B2 (en) 3D image viewing system, display system, optical shutter, and 3D image viewing method
US20120057006A1 (en) Autostereoscopic display system and method
Fröhlich et al. Implementing multi-viewer stereo displays
JP2010507332A (en) Dual ZScreen (R) projection
WO2006127677A2 (en) Immersive environments with multiple points of view
WO2010084803A1 (en) Three-dimensional picture viewing system, display system, optical shutter, and three-dimensional picture viewing method
US20120194656A1 (en) System and method for displaying multiple exclusive video streams on one monitor
KR20110025977A (en) Display of two-dimensional content during three-dimensional presentation
WO2008021857A2 (en) Method and system for multi-channel viewing applications
KR20140035520A (en) 3d display apparatus, method and structures
Naimark Two unusual projection spaces
US20030169404A1 (en) Method for exhibiting high-quality three-dimensional motion from a single strip of motion picture film
Rogers Scaling Down: Cinerama on Blu-ray.’
CN101477299A (en) Stereo movie shooting apparatus
Starks 3DTV and 3D movie technology
WO1998011737A1 (en) Method and apparatus for presenting a visual display to an audience
WO2002071384A1 (en) Three-dimensional display system and method
McCormick et al. Implementation of Stereoscopic and Dualview Images on a Micro-Display High Definition Television
CN101072367A (en) Two-dimensional picture stimulated three-dimensional image display method
RU2391689C2 (en) Device for demonstrating raster stereoscopic image with high resolution
TW405044B (en) Autostereo projection system

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200780043855.0

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07762287

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2007762287

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2009539374

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 1020097011011

Country of ref document: KR

NENP Non-entry into the national phase

Ref country code: DE