US20050078108A1 - Electronic stereoscopic media delivery system - Google Patents
Electronic stereoscopic media delivery system Download PDFInfo
- Publication number
- US20050078108A1 US20050078108A1 US10/888,946 US88894604A US2005078108A1 US 20050078108 A1 US20050078108 A1 US 20050078108A1 US 88894604 A US88894604 A US 88894604A US 2005078108 A1 US2005078108 A1 US 2005078108A1
- Authority
- US
- United States
- Prior art keywords
- stereoscopic
- media
- viewing
- stereo
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000009467 reduction Effects 0.000 claims abstract description 6
- 238000000034 method Methods 0.000 claims description 85
- 230000006835 compression Effects 0.000 claims description 18
- 238000007906 compression Methods 0.000 claims description 18
- 238000013515 script Methods 0.000 claims description 14
- 230000007246 mechanism Effects 0.000 claims description 11
- 238000000926 separation method Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 6
- 238000009826 distribution Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 238000004321 preservation Methods 0.000 claims description 3
- 238000012937 correction Methods 0.000 claims description 2
- 230000010354 integration Effects 0.000 claims description 2
- 230000003993 interaction Effects 0.000 claims description 2
- 238000004091 panning Methods 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 claims description 2
- 230000003287 optical effect Effects 0.000 claims 1
- 238000005457 optimization Methods 0.000 abstract description 2
- 208000001692 Esotropia Diseases 0.000 description 10
- 239000011521 glass Substances 0.000 description 10
- 238000003860 storage Methods 0.000 description 9
- 208000003464 asthenopia Diseases 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000004040 coloring Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009429 electrical wiring Methods 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000009416 shuttering Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/139—Format conversion, e.g. of frame-rate or size
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/189—Recording image signals; Reproducing recorded image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/334—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spectral multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/339—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spatial multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
- H04N13/359—Switching between monoscopic and stereoscopic modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
- H04N7/17309—Transmission or handling of upstream communications
- H04N7/17318—Direct or substantially direct transmission and handling of requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/15—Processing image signals for colour aspects of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/221—Image signal generators using stereoscopic image cameras using a single 2D image sensor using the relative movement between cameras and objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/324—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/346—Image reproducers using prisms or semi-transparent mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0077—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0088—Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image
Definitions
- the invention is directed to providing a means of delivering stereoscopic media on and off the Internet.
- the invention provides a means of encoding stereoscopic media, transmitting and storing stereoscopic media, displaying stereoscopic media, and providing helpful tools for viewing the media.
- Stereoscopic images have been in use for hundreds of years. Recently stereoscopic images, and other forms of stereoscopic media like animations and video, have been Converted to electronic form for display on personal computers, the Internet, and on other electronic media like CD-ROMs. Stereoscopic media has been successfully used in numerous applications ranging from medical imaging, to entertainment, to training, to electronic commerce.
- Stereoscopic media and viewing systems can take on numerous formats. For example, there are several ways to encode a still stereoscopic 3D image including red/blue anaglyphic format, side-by-side, interleaved or line-alternate formats, etc. There are also numerous viewing systems available to viewing stereoscopic media: red/blue glasses, active shutter glasses, high-speed page-flipping graphics cards with shutter glasses, line-blanking viewing systems, cross-eye lens systems, etc. Many of these media and viewing formats are not compatible with each other. The fact that the stereoscopic media for these various systems is not compatible makes it difficult for a content developer, such as a CD-ROM developer, or Website developer, to support all of the stereoscopic viewing devices on the market.
- a content developer such as a CD-ROM developer, or Website developer
- This invention presents new stereoscopic media delivery system that includes means for encoding stereoscopic media, transmitting and storing stereoscopic media, displaying stereoscopic media, and providing helpful tools for viewing the media.
- the preferred embodiment addresses the problem of delivering stereoscopic media in electronic form (images, videos, animations, object models, etc.). Firstly, it provides a single format with independent right and left channels (with an option for mixed or combined right and left channels) to represent the stereoscopic media. Secondly, it provides a means of displaying stereoscopic media inside a movable windowed area while eliminating pseudostereo conditions during movement. Thirdly, it provides automatic and manual optimization adjustments such as parallax shift adjustment, brightness control, color adjustment, and cross-talk reduction to the stereoscopic media based on viewing hardware, monitor size, and media content for optimal viewing quality. Fourthly, it provides seamless support for monoscopic (2D) viewing modes allowing delivery of said stereoscopic media in a normal 2D viewing mode.
- 2D monoscopic
- FIG. 1 illustrates the various display formats embodied in the invention
- FIG. 2 illustrates the contents of a window displayed in stereo
- FIG. 3 illustrates the contents of a window displayed in reverse stereo
- FIG. 4 illustrates the contents of a scrolling window displayed in stereo
- FIG. 5 illustrates a general software flowchart
- FIG. 6 illustrates the scaling of stereoscopic 3D media while preserving the left and right media
- FIG. 7 illustrates the scaling of stereoscopic 3D media without preserving the left and right media
- FIG. 8 illustrates the automatic brightness adjustment of a stereoscopic 3D media file
- FIG. 9 illustrates the setting of script commands to a preselected display mode
- FIG. 10 illustrates the contents of a VRR file
- FIG. 11 illustrates a parallel viewing mode
- FIG. 12 illustrates a cross-eye viewing mode
- FIG. 13 illustrates the ability to download larger sized 3D stereoscopic content files as a background task or during idle use times of the workstation
- FIG. 14 illustrates the side by side format
- FIG. 15 illustrates one method of displaying helper alignment images for a cross eye viewing mode
- FIG. 16 illustrates one way to store a series of N images into a single resource file
- FIG. 17 illustrates the relationship between the images and the object in question
- FIG. 18 illustrates an embodiment that allows a larger 3D stereoscopic image or panorama to be scrolled within a smaller viewing window
- FIG. 19 illustrates an original right and left camera view of an object.
- the embodiments of the invention include display methods, encoding methods and tools.
- display methods this includes a single media file format that is converted to various display formats on the user side; stereoscopic media in a window such as a browser or application; stereoscopic preservation in a window during scrolling and window movement; support of auto-detection 3D stereo hardware systems; script buttons (VRR scripts) to change global stereo formats; stereo media file formats that contain sub media such as VRR and blocks; parallax shift adjustments based on physical size of display window; automatic brightness adjustments; color calibration/adjustments for physical 3D viewing mechanisms; including variations in display devices; crosstalk reduction techniques on user side; smart stereo scaling; integration of stereo media types into one viewer with script interaction; monoscopic and stereoscopic viewing that allows greater distribution since both types can be viewed within one system; save and conversion of one format into another from the Internet using a local drive from the original source; automatic free view image size adjustment to minimize viewing fatigue; pseudostereo correction based on image processing of a few lines or the entire image
- the scaling can be done while preserving stereo. Additionally, looking at the storage method used, it is necessary to take the appropriate actions to scale the media while preserving the stereo and to perform scaling done to increase or decrease the display size of the stereoscopic media.
- FIG. 1 provides a mechanism to increase or decrease the size at which the media is displayed while preserving the stereo.
- the left and right media are extracted from the Stereoscopic 3D Media file 12 , scaled, recombined into the selected display method, then the resulting scaled Stereoscopic Media is displayed.
- the displayed formats include Monoscopic 14 , Line-Interleaved, Cross-eye 18 , Parallel 20 , Various Anaglyph 22 Page-flipping 24 and Others 26 .
- Another embodiment of the present invention is to provide a system to access 3D stereoscopic content through the internet or an intranet or similar network environment where the 3D stereoscopic content is stored in a location that is not physically connected to the users workstation and to also provide a means to view content that resides locally on the users workstation.
- the encoding processes used include independent compression of the Left and Right images. Independent compression of Left and Right provides better quality display output.
- a good example of this is anaglyph method.
- the methods include a video setup format for compression (sbs format and asf). Image alignment reference points/indicators are used to aid in visual image alignment.
- Object viewers in stereo use multiple sub images for a one dimensional or two-dimensional object viewer.
- the use of stereoscopic panning preserves the stereo image alignment.
- the co-existence of Java software and a plug-in solution minimizes downloading.
- Image interpolation is used to generate in between stereo views to minimize or maximize the stereo separation.Image interpolation is used for converting a 2D object movie to a 3D stereoscopic object movie.
- the methods provide a background download capability.
- Stereoscopic preservation in a window during scrolling and window movement is very important.
- the first line of the image When interleaved stereo images are displayed in a window, the first line of the image must be on an even scan line, or else the image will be perceived in reverse stereo.
- the system looks at the current vertical location of the window, and then places the first line of the stereo image on an even scan line. Whenever a user scrolls within that window, or moves the window itself, the application checks the odd/even status, and adjusts accordingly. In the case of vertically scrolling within a window or if the window itself is moved, the first line of the stereo image is placed on an even scan line.
- the left and right fields or views must be preserved and presented consistently.
- the first horizontal line of a stereo image that is presented within a window may represent the right field or view and the second horizontal line the left field or view.
- the first horizontal line of the display device is even, or represented by a zero, the right field/view is to be presented on even scan lines, and the left field/view is to be presented on odd scan lines to maintain stereo.
- the result would be pseudostereo.
- the selection of associating the right field/view with even scan lines is arbitrary—the reverse can also be true provided consistency is maintained.
- the left field/view may be on the odd scan lines, the right field/view on the even.
- the exemplary embodiment preserves left field/view and right field/view in a several ways.
- a first method is to snap the window to an even scan line, which ensures that the window starts on an even horizontal scan line.
- Another method is to look at the even/oddness of the first horizontal line where the stereo media starts. If the right field/view is on the even scan line, and the left field/view is on the odd, then no action is required, otherwise the left/right fields/views can be swapped-placing the left content on the even lines, and the right content on odd, for every horizontal line in the media, thereby resulting in a stereo image.
- the third method is to shift the entire viewing region within the window by one horizontal line to match right field/view with an even scan line and left field/view with an odd scan line. This may require dynamic resizing of the window to accommodate the vertical shift.
- An algorithm looks at the current vertical location of the window, and then places the first line of the stereo image on an even scan line. Whenever a user scrolls within that window, or moves the window itself, the application checks the odd/even status, and adjusts accordingly. In the case of vertically scrolling within a window or if the window itself is moved, the first line of the stereo image is placed on an even scan line. When the image is scrolled vertically, movement is done in even increments so as to maintain stereo. Stereo can be maintained by controlling the window position, forcing it to snap to even scan lines.
- the solutions include moving the window, moving the image, and swapping fields.
- FIG. 2 illustrates the contents of a window displayed in stereo 100 .
- a computer 102 and its monitor 104 are used to display a line interlaced stereo image 106 and 108 .
- the stereo image is presented in a magnified form 110 .
- This window could be a standalone application, plug-in, or interpreted program.
- the magnification shows the details of a line interleaved stereo image.
- the even line of the stereo image is aligned with an even scan line of the monitor, which results in the display of a stereoscopic image. If the window moves, a check is done to determine even/odd scan-line, then the stereo image is started on an even scan line. If the window is moved, it will snap to start on an even scan line.
- FIG. 3 illustrates the contents of window displayed in reverse stereo 200 .
- a computer 202 and its monitor 204 are used to display pseudoscopic or reverse stereo image 206 and 208 .
- the pseudoscopic, or reverse stereo image is presented on the computer screen in a window.
- This window could be a standalone application, plug-in, or interpreted program.
- the magnification 210 shows the details of a line interleaved stereo image.
- the even line of the stereo image is not aligned with an even scan line of the monitor, which results in the display of a pseudoscopic, or reverse image.
- FIG. 4 illustrates the contents of a scrolling window displayed in stereo 300 .
- a stereo image is presented on a computer screen in a window 302 .
- This particular window scrolls vertically.
- the first line of the image is aligned on an even scan line 304 with the monitor, which allows for stereoscopic presentation. Whenever vertical scrolling occurs, even increments are made so that the image is always presented in stereo.
- FIG. 5 illustrates a General Software Flowchart 400 .
- the application checks to see where the image starts, on an even or odd scan line 404 . If on an even scan line 406 , a stereo image is then displayed 408 . If the image starts on an odd scan line 410 , then the image is shifted to an even scan line or the left and right field/views are swapped and then displayed 412 . Vertical scrolling begins 418 and is done by an even increment 420 .
- the left and right source must be preserved. Since the format of the original left and right is known, as designated by the tag within the Stereoscopic 3D Media file, scaling can be done while preserving stereo. An embodiment ooks at the storage method used, then takes the appropriate actions to scale the media while preserving the stereo. Scaling may done to increase or decrease the display size of the stereoscopic media.
- FIG. 6 illustrates an analysis of the left and right media 500 that are extracted from the Stereoscopic 3D Media file 502 , individually scaled 504 , 506 , recombined into the selected display 508 , and then the resulting scaled Stereoscopic Media is displayed 510 .
- the left and right source must be preserved. Since the format of the original left and right is known, as designated by the tag within the Stereoscopic 3D Media file, the scaling can be done while preserving stereo. The system will look at the storage method used, and then take the appropriate actions to scale the media while preserving the stereo. Scaling may done to increase or decrease the display size of the stereoscopic media.
- stereo media can only be viewed at the original size.
- An embodiment provides a mechanism to increase or decrease the size at which the media is displayed while preserving the stereo.
- FIG. 7 illustrates that without any analysis 600 , if the Stereoscopic 3D Media File is scaled without regard for the format used for the left and right, the scaled result will not be in stereo. Without any analysis, the Stereoscopic 3D Media Files 602 and 604 are scaled without regard for the format used for the left and right, the scaled result will not be in stereo 606 .
- Monoscopic and Stereoscopic Viewing allows greater distribution since both types can be viewed within one system.
- Prior Electronic Stereoscopic viewing systems only display stereoscopic media.
- the embodiments of the invention accommodate monoscopic and stereoscopic viewing.
- the embodiments of the invention allow users to access stereoscopic media without a 3D stereoscopic enabled physical viewing device.
- This invention can have greater distribution and market penetration since it is not dependent upon a physical viewing device.
- This viewing system can be toggled to display monoscopic, as well as various stereoscopic modes (color anaglyph, gray anaglyph, line interleaved, page-flipping, cross-eye, parallel viewing, etc.).
- monoscopic mode the image appears in 2D like other 2D web based images which allows all web users to view the images in 2D even if they do not have a stereoscopic viewing device.
- the user can select whether to view the left or right monoscopic view.
- Users without a physical stereo viewing device can see the media in monoscopic form by selecting to use either the right or left monoscopic views.
- An embodiment of the invention contains automatic adjustment of Brightness/Contrast/Image properties adjustment based on viewing mechanism.
- No prior Electronic viewing system adjusts media brightness/contrast based upon the display method.
- This embodiment adjusts the final display of the stereo media to accommodate LC shutter-glasses, and LC shutter-glasses with line-blanker type products.
- stereo media is viewed through an LC shutter-glass viewing system it appears darker due to the shuttering system.
- stereo media is viewed through an LC Shutter-glass coupled with a line blanker, the media appears even darker.
- This embodiment will adjust the brightness, contrast and other media properties to compensate for the color distortion/darkness incurred by the viewing mechanism.
- FIG. 8 illustrates the automatic adjustment of Brightness/Contrast/Image properties adjustment based on viewing mechanism 700 .
- the Stereoscopic Media file 702 is queried and is displayed using shutter glasses 704 .
- the Brightness adjustment system 706 adjusts the brightness of the media file to accommodate the physical viewing mechanism 708 .
- This same embodiment can compensate for uneven image luminance between the left and right eyes when using anaglyphic colored viewing glasses.
- Crosstalk often appears in stereo media and can be referred to as ghosting. Bright in one eye, dark in the other, occupying the same point in the scene can create crosstalk. Areas of high contrast in stereo media are subject to crosstalk. This ghosting occurs because each eye is seeing some of the media intended only for the other eye, and in this case there may be very bright content in one eye, and darker content in the other eye.
- the right eye could see the media intended for the right eye, but also some of the media intended for the left eye. Seeing both at once through one eye shows up as a form of ghosting.
- This invention locates points where crosstalk may occur, and adjusts the displayed stereo image to reduce or eliminate crosstalk.
- the system can query the hardware or the user to determine the optimum crosstalk reduction amount for a particular viewing system.
- Script buttons are used to change global stereo formats.
- An embodiment of the invention provides a novel method to switch the current display method for all stereo media currently displayed on-screen. For example, ten stereoscopic media files can be displayed on one web page. The display mode for each of those files can be changed with one command. Once a stereo display method is selected, then each of the stereo windows is notified to switch to the newly selected format. Typically, the user would be required to change the stereo display method for each stereoscopic image or media file.
- FIG. 9 illustrates a script command to set the display mode to Color Anaglyph 900 .
- the Web Page as received has media files as illustrated by Stereo Image Grey Anaglyph 904 ; Stereo Image Color Anaglyph 906 ; Stereo Image Cross-eye 908 and Stereo Image Parallel 910 ; Stereo Image Interleaved 912 ; and Stereo Image Interleaved 914 .
- the Script Commands sets the Display Mode Color Anaglyph 918 .
- the system converts all the media files to Color Anaglyph as illustrated by files 920 through 930 . This embodiment is critical in providing an easy to use 3D stereoscopic viewing system.
- the viewing system takes a Stereoscopic Media File, displays it on the user side according to the user's display preferences, and saves a local copy in whatever display format the user selects.
- the system can convert the Stereoscopic Media into the display method selected by the user, and save the result on the user's local drive.
- the original form of the Stereoscopic 3D Media file may be saved on the user's local drive.
- a color calibration/adjustment for physical 3D viewing mechanisms compensates for variations in the display devices.
- An embodiment includes the functionality to adjust stereo media properties, thereby preserving the original color, hues, saturation, etc. when viewed through a physical viewing mechanism. For example, when looking through liquid crystal shutter-glass systems, the LC may introduce additional yellow coloring to the subject matter. Based on the user's view settings that tell the originator what kind of viewing device the user may be using. Another embodiment of the invention corrects for distortions introduced by the viewing mechanism. Another example could be for anaglyph viewing. For this example, the viewing system goes through a color calibration to attempt to more closely match the coloring of the anaglyph lenses with the coloring of the monitor or display device.
- a stereo media file format may contain certain sub media such as VRR and blocks.
- An embodiment supports a stereoscopic media file that contains sub-media. Specifically, a file structure is created to store and preserve various types of stereo media in various formats. Additionally, this file format can also store monoscopic media, as well as audio or other data. This one file format can store multiple or single stereo/non-stereo media elements.
- FIG. 10 illustrates a VRR file 1000 that may contain a script 1002 , a Stereo Still Image 1004 , a Stereoscopic Animation/movie 1006 , Stereoscopic Object Model 1008 , a Thumbnail 1010 , and Audio 1012 . This embodiment also allows multiple resolution images to be stored in one media file or to be referenced (linked to) from one media file.
- the system may also include an automatic free view image size adjustment to minimize viewing fatigue. For example, when parallel-viewing (also known as relaxed viewing, or free-viewing) stereo images, the separation of the left and right should not greatly exceed the average interocular distance of an adult.
- parallel-viewing also known as relaxed viewing, or free-viewing
- the separation of the left and right should not greatly exceed the average interocular distance of an adult.
- FIG. 11 illustrates a parallel viewing mode.
- the right 1104 and left 1102 images be scaled and spaced so as to not exceed the viewer's eye spacing. If the viewer has a prismatic viewing aid, the image separation can be increased. The users can be queried to determine what viewing system is installed. Since most computer operating systems now store information on the width 1108 of the monitor image on the display monitor, it is possible to automatically adjust the spacing and size of the right and left images to avoid eyestrain.
- FIG. 12 illustratess a cross-eye viewing mode.
- For cross-eye viewing it is possible to use larger images than with the parallel viewing method. There is still a limit where many users will begin to experience eyestrain. The user can be queried to determine the limits of cross-eye viewing.
- Another embodiment allows for automatic detection of 3D display hardware.
- Many 3D stereoscopic hardware vendors install software that can be detected so that an appropriate display method can be automatically selected. If no stereoscopic hardware is detected, then the system must prompt the user to configure the display mode.
- Another embodiment automatically (or manually if desired) adjusts with overall left and right image shift to compensate for image magnification.
- a 3D stereoscopic image is enlarged and displayed on a viewing system that has a larger image size then the target system, there is a potential of creating large separations between objects in the 3D stereoscopic image that can lead to eyestrain for the viewer.
- the present invention stores important parameters about the 3D stereoscopic image like width, height, target screen size, etc.
- the 3D stereoscopic image is to be displayed on a display that is larger or smaller than the target screen size, then the 3D stereoscopic image is adjusted accordingly to minimize eye fatigue for the user.
- One embodiment utilizes image processing to detect pseudo-stereo 3D stereoscopic content. It is common for content authors to sometimes reverse the right and left eyes when creating 3D stereoscopic content. When this happens, the display system will present the wrong image to the viewer's eyes. This embodiment attempts to correct this problem by comparing portions of the right and left image content to determine if a pseudo condition exists and then swaps the right and left images to correct for the problem.
- Another embodiment encodes the full-color left and right images in separate channels and compresses the left and right channels independently.
- This technique provides less compression artifacts and reduces crosstalk when compared to anaglyphic storage techniques.
- analgyph storage techniques which are widely used on the Internet, combine the right and left images in separate color channels of a single image and then compressed the resulting image.
- This technique results in the introduction of crosstalk because most compression techniques, like JPEG that is commonly used, reduce the color space of an image drastically, which in turn compromises the quality of the Anaglyphic storage technique.
- FIG. 14 illustrates the side-by-side format.
- the right image 1400 is placed to the left of the left image 1402 to form the composite image 1404 .
- the composite image is twice as wide as either the left or right source images.
- a vertical colored separator band 1406 can be added between the right and left image.
- FIG. 15 illustrates one method of displaying helper alignment images for a cross-eye viewing mode.
- the helper images are placed below the image 1504 and above the image 1506 and are aligned with the center of the right and left images.
- the helper images could also be shifted towards the edges of the right and left images.
- the images are of high contrast and attract the viewer to fuse the images first before the primary 3D stereoscopic image is viewed.
- the simple high contrast nature of the alignment images allows them to be more easily viewed. This system makes it possible for viewers with poor stereo viewing capabilities to see more stereoscopic content with the cross-eyed, parallel, and other viewing modes.
- FIG. 16 illustrates one way to store a series of N images into a single resource file.
- the first image 1600 is at the top of the file and the rest of the images follow sequentially until the last file 1602 .
- the collection of these images forms an object movie data file 1604 .
- FIG. 17 shows the relationship between the images and the object in question 1700 .
- the point of view of the camera is swung around the object to generate all of the intermediate images.
- these images are displayed in a sequential fashion, it appears that the object is rotating on the screen in 3D depth.
- the images are displayed in reverse order, the object appears to turn in the opposite direction.
- FIG. 18 Another embodiment allows a larger 3D stereoscopic image or panorama to be scrolled within a smaller viewing window as shown in FIG. 18 .
- the viewing window 1802 is a fixed size and does not move with respect to the viewing screen.
- the 3D stereoscopic image 1800 is larger than the viewing window and therefore must be scrolled horizontally and vertically within the viewing window in order for the viewer to see the entire image. This is always the case with panoramic images that contain a very wide or tall view of a scene.
- the invention ensures that the left and right views are presented to the correct eyes.
- the image will flip into pseudostereo mode.
- the present invention will either shift the image an additional line to make it viewable in non-pseudostereo or it will flip the left and right images to correct the problem.
- This embodiment is an extension of the previously described scrolling embodiment since it applies the scrolling embodiments to an image that is scrolled within a viewing window as opposed to a viewing window which is scrolled on the display screen (as previously detailed).
- Another embodiment allows the previously discussed display embodiments to be extended to a wider viewing audience on the Internet and for local viewing on a workstation by implementing the invention on multiple parallel systems. For example, for viewing 3D stereoscopic content on the Internet through a browser, it is desirable to have uniform support for all browser systems.
- the present invention provides uniform support by implementing several parallel solutions.
- the present invention can be implemented as a Netscape plug-in to support the Netscape browser (see www.netscape.com) or the present invention can be implemented as an Active-X control to support the Microsoft Internet Explorer Browser (see www.Microsoft.com) or the present invention can be implemented as a Java Applet (see www.sun.com) to support some other forms of browsers.
- the embodiment described here implements the present invention on all of these systems in parallel and utilizes browser client side scripting and/or server side scripting (well known by someone skilled in web based systems) to select the correct system for a particular user.
- browser client side scripting and/or server side scripting well known by someone skilled in web based systems
- FIG. 19 illustrates an original right 1902 and left 1904 camera views of an object 1900 .
- the new synthesized right 1906 and left 1908 views will be easier to view for some users.
- Another embodiment of the invention provides an automatic alignment and/or re-alignment of the left and right images.
- Many 3D stereoscopic images are created incorrectly and may have vertical, horizontal, or rotational misalignment that will cause eyestrain for the viewer.
- image correlation techniques horizontal and vertical misalignment of the right and left views is corrected. Further correlation is applied to correct for rotational alignment issues.
- Another embodiment provides a tool that compares the left and right images to determine if stereoscopic information is lost during compression. Compression is used to reduce the size of a stereoscopic image so that it can be easily transmitted over a low bandwidth connection. If too much compression is applied, the image will loose its stereoscopic impact. This embodiment provides a measure of the quality of the stereoscopic image that can be used to readjust the compression system.
- Another embodiment allows both local content, residing on the users workstation, and remote content, residing on a server or web site to be viewed using the display methods.
- This embodiment is needed to allow for remote streaming playback as well as to allow for local playback of files that are delivered via cd-rom or other storage means or for content that is downloaded from a remote location to a local storage location before being displayed.
- Another embodiment of the present invention provides the ability to download larger sized 3D stereoscopic content files as a background task or during idle use times of the workstation as shown in FIG. 13 .
- These large sized files 1300 cannot be easily streamed over the Internet in real-time or near real-time.
- This background downloading capability allows the present invention to be more widely used on low-bandwidth systems.
- This embodiment utilizes a database of known locations where information about 3D content is stored 1302 .
- a subscription system or search engine can be used to access the 3D content or specific content can be added to the download database.
- the system of the present invention keeps track of what content has been downloaded in a second database 1304 and records details about the download that can be used to recover a faulty download.
- the 3D stereoscopic content is moved from a remote location 1310 to a higher bandwidth local location 1308 where the content can be played back in real-time or near real-time.
- the download database and the 3D stereoscopic content location database are also used to help append 3D stereoscopic content into a larger local file. This method allows a very large or long content file to be broken into much smaller files that are downloaded one after the other. As each file is downloaded, it is appended to the current local copy of the download. If new remote content files are made available on a periodic basis, this system will allow them to be appended together as they become available.
- a conventional object movie utilizes a sequence of still images of an object captured a various view angles as illustrated in FIG. 17 .
- a 2D object movie can be converted to 3D stereoscopic format by pairing up the original images. For example, in FIG. 17 , View 1 and View 2 can be combined to form a left right pair (respectively). The next 3D stereoscopic view is formed by combining view 2 with view 3 (left and right respectively). Each image in the original object movie is used twice. If the original 2D object movie contains enough images (60 images produces good results) then the converted 3D object movie will be usable.
- the present invention can also be embodied in the form of computer program code, for example, whether stored in a storage medium, loaded into and/or executed by a computer, or transmitted over some transmission medium, such as over electrical wiring or cabling, through fiber optics, via electromagnetic radiation or via the Internet, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus for practicing the invention.
- the computer program code segments configure the microprocessor to create specific logic circuits.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Processing Or Creating Images (AREA)
Abstract
The preferred embodiment addresses the problem of delivering stereoscopic media in electronic form (images, videos, animations, object models, etc.). First, it provides a single format with independent right and left channels to represent the stereoscopic media. Second, it provides a means of displaying stereoscopic media inside a movable windowed area while eliminating pseudostereo conditions during movement. Third, it provides automatic and manual optimization adjustments (parallax shift adjustment, brightness control, color adjustment, and cross-talk reduction) to the stereoscopic media based on viewing hardware, monitor size, and media content for optimal viewing quality. Fourth, it provides seamless support for monoscopic (2D) viewing modes allowing delivery of said stereoscopic media in a normal 2D viewing mode.
Description
- The invention is directed to providing a means of delivering stereoscopic media on and off the Internet. In particular the invention provides a means of encoding stereoscopic media, transmitting and storing stereoscopic media, displaying stereoscopic media, and providing helpful tools for viewing the media.
- Stereoscopic images have been in use for hundreds of years. Recently stereoscopic images, and other forms of stereoscopic media like animations and video, have been Converted to electronic form for display on personal computers, the Internet, and on other electronic media like CD-ROMs. Stereoscopic media has been successfully used in numerous applications ranging from medical imaging, to entertainment, to training, to electronic commerce.
- Stereoscopic media and viewing systems can take on numerous formats. For example, there are several ways to encode a still stereoscopic 3D image including red/blue anaglyphic format, side-by-side, interleaved or line-alternate formats, etc. There are also numerous viewing systems available to viewing stereoscopic media: red/blue glasses, active shutter glasses, high-speed page-flipping graphics cards with shutter glasses, line-blanking viewing systems, cross-eye lens systems, etc. Many of these media and viewing formats are not compatible with each other. The fact that the stereoscopic media for these various systems is not compatible makes it difficult for a content developer, such as a CD-ROM developer, or Website developer, to support all of the stereoscopic viewing devices on the market.
- Several patents contain background information for this disclosure. They include: U.S. Pat. No. 6,028,649 dated Feb. 22, 2000 and entitled “Image Display Systems having Direct and Projection Viewing Modes”; U.S. Pat. No. 6,016,159 dated Jan. 18, 2000 and entitled “Method and Apparatus for Producing and Displaying Spectrally-multiplexed Images of Three-dimensional Imagery for Use in Stereoscopic Viewing Thereof”; U.S. Pat. No. 6,002,518 dated Dec. 14, 1999 and entitled “Phase-retardation Based System for Stereoscopic Viewing Micropolarized Spatially-multiplexed Images Substantially Free of Visual-channel Cross-talk and Asymmetric Image Distortion”; U.S. Pat. 5,844,717 dated Dec. 1, 1998 and entitled “Method and System for Producing Micropolarization panels for Use in Micropolarizing Spatially Multiplexed Images of 3-D Objects During Stereoscopic Display Processes”; U.S. Pat. No. 5,828,427 dated Oct. 27, 1998 and entitled “Computer-based Image Display Systems Having Direct and Projection Modes of Viewing”; U.S. Pat. No. 5,760,827 dated Jun. 2, 1998 and entitled “Pixel-data Processing System and Method for Producing Spectrally-multiplexed Images of Three-dimensional Imagery for Use in Stereoscopic Viewing Thereof”; U.S. Pat. No. 5,745,164 dated Apr. 28, 1998 entitled System and Method for Electro-optically Producing and Displaying Spectrally-multiplexed Images of Three-dimensional Imagery for Use in Stereoscopic Viewing Thereof”; U.S. Pat. No. 5,7423,33 dated Apr. 21, 1998 and entitled “Electro-optical Device for Selectively Transmitting Polarized Spectral Components”; U.S. Pat. No. 5,680,233 dated Oct. 21, 1997 and entitled Image Display Systems Having Direct and Projection Viewing Modes”; U.S. Pat. No. 5,553,203 dated Sep. 3, 1996 and entitled “Pixel Data Processing System and Method for Producing and Graphically Presenting Spatially Multiplexed Images of 3-D Objects for Stereoscopic Viewing Thereof”; U.S. Pat. No. 6,031,564 dated Feb. 29, 2000 and entitled “Method and Apparatus for Monoscopic to Stereoscopic Image Conversion”; U.S. Pat. No. 6,011,581 dated Jan. 4, 2000 and entitled “Intelligent Method and System for Producing and Displaying Stereoscopically-multiplexed Images of Three-dimensional Objects for Use in Realistic Stereoscopic Viewing Thereof In Interactive Virtual Reality Display Environments”; and U.S. Pat. No. 5,537,144 dated Jul. 16, 1996 and entitled “Electro-optical Display System for Visually Displaying Polarized Spatially Multiplexed Images of 3-D Objects for Use in Stereoscopically Viewing The Same With High Image Quality and Resolution.
- In order to facilitate the growth of stereoscopic 3D media in electronic form, an easy to use, multi-format delivery system is needed. This invention presents new stereoscopic media delivery system that includes means for encoding stereoscopic media, transmitting and storing stereoscopic media, displaying stereoscopic media, and providing helpful tools for viewing the media.
- The preferred embodiment addresses the problem of delivering stereoscopic media in electronic form (images, videos, animations, object models, etc.). Firstly, it provides a single format with independent right and left channels (with an option for mixed or combined right and left channels) to represent the stereoscopic media. Secondly, it provides a means of displaying stereoscopic media inside a movable windowed area while eliminating pseudostereo conditions during movement. Thirdly, it provides automatic and manual optimization adjustments such as parallax shift adjustment, brightness control, color adjustment, and cross-talk reduction to the stereoscopic media based on viewing hardware, monitor size, and media content for optimal viewing quality. Fourthly, it provides seamless support for monoscopic (2D) viewing modes allowing delivery of said stereoscopic media in a normal 2D viewing mode.
- These and other features of the present invention will be apparent from the following description of the drawings, detailed description, and appended claims and drawings.
-
FIG. 1 illustrates the various display formats embodied in the invention; -
FIG. 2 illustrates the contents of a window displayed in stereo; -
FIG. 3 illustrates the contents of a window displayed in reverse stereo; -
FIG. 4 illustrates the contents of a scrolling window displayed in stereo; -
FIG. 5 illustrates a general software flowchart; -
FIG. 6 illustrates the scaling of stereoscopic 3D media while preserving the left and right media; -
FIG. 7 illustrates the scaling of stereoscopic 3D media without preserving the left and right media; -
FIG. 8 illustrates the automatic brightness adjustment of a stereoscopic 3D media file; -
FIG. 9 illustrates the setting of script commands to a preselected display mode; -
FIG. 10 illustrates the contents of a VRR file; -
FIG. 11 illustrates a parallel viewing mode; -
FIG. 12 illustrates a cross-eye viewing mode; -
FIG. 13 illustrates the ability to download larger sized 3D stereoscopic content files as a background task or during idle use times of the workstation; -
FIG. 14 illustrates the side by side format; -
FIG. 15 illustrates one method of displaying helper alignment images for a cross eye viewing mode; -
FIG. 16 illustrates one way to store a series of N images into a single resource file; -
FIG. 17 illustrates the relationship between the images and the object in question; -
FIG. 18 illustrates an embodiment that allows a larger 3D stereoscopic image or panorama to be scrolled within a smaller viewing window; -
FIG. 19 illustrates an original right and left camera view of an object. - The embodiments of the invention include display methods, encoding methods and tools. With regard to display methods this includes a single media file format that is converted to various display formats on the user side; stereoscopic media in a window such as a browser or application; stereoscopic preservation in a window during scrolling and window movement; support of auto-
detection 3D stereo hardware systems; script buttons (VRR scripts) to change global stereo formats; stereo media file formats that contain sub media such as VRR and blocks; parallax shift adjustments based on physical size of display window; automatic brightness adjustments; color calibration/adjustments for physical 3D viewing mechanisms; including variations in display devices; crosstalk reduction techniques on user side; smart stereo scaling; integration of stereo media types into one viewer with script interaction; monoscopic and stereoscopic viewing that allows greater distribution since both types can be viewed within one system; save and conversion of one format into another from the Internet using a local drive from the original source; automatic free view image size adjustment to minimize viewing fatigue; pseudostereo correction based on image processing of a few lines or the entire image; scaling stereo media, so that the left and right sources are preserved; and improvements to Anaglyph display methods. Since the format of the original left and right is known, as designated by the tag within the Stereoscopic 3D Media file, the scaling can be done while preserving stereo. Additionally, looking at the storage method used, it is necessary to take the appropriate actions to scale the media while preserving the stereo and to perform scaling done to increase or decrease the display size of the stereoscopic media. - In existing systems, stereo media can only be viewed at the original size. The embodiment of
FIG. 1 provides a mechanism to increase or decrease the size at which the media is displayed while preserving the stereo. As shown inFIG. 1 with analysis 10, the left and right media are extracted from the Stereoscopic3D Media file 12, scaled, recombined into the selected display method, then the resulting scaled Stereoscopic Media is displayed. The displayed formats include Monoscopic 14, Line-Interleaved, Cross-eye 18, Parallel 20, Various Anaglyph 22 Page-flipping 24 andOthers 26. - Another embodiment of the present invention is to provide a system to access 3D stereoscopic content through the internet or an intranet or similar network environment where the 3D stereoscopic content is stored in a location that is not physically connected to the users workstation and to also provide a means to view content that resides locally on the users workstation.
- The encoding processes used include independent compression of the Left and Right images. Independent compression of Left and Right provides better quality display output. A good example of this is anaglyph method. The methods include a video setup format for compression (sbs format and asf). Image alignment reference points/indicators are used to aid in visual image alignment. Object viewers in stereo use multiple sub images for a one dimensional or two-dimensional object viewer. The use of stereoscopic panning preserves the stereo image alignment. The co-existence of Java software and a plug-in solution minimizes downloading.Image interpolation is used to generate in between stereo views to minimize or maximize the stereo separation.Image interpolation is used for converting a 2D object movie to a 3D stereoscopic object movie. Also, the methods provide a background download capability.
- Several tools are used in the process. These include automatic stereoscopic alignment and/or re-alignment (rotational and shift and scale) and a stereo compression analysis tool to detect if the stereo information is preserved after compression.
- Stereoscopic preservation in a window during scrolling and window movement is very important. When interleaved stereo images are displayed in a window, the first line of the image must be on an even scan line, or else the image will be perceived in reverse stereo. The system looks at the current vertical location of the window, and then places the first line of the stereo image on an even scan line. Whenever a user scrolls within that window, or moves the window itself, the application checks the odd/even status, and adjusts accordingly. In the case of vertically scrolling within a window or if the window itself is moved, the first line of the stereo image is placed on an even scan line. When the image is scrolled vertically, movement is done in even increments so as to maintain stereo or the right and left images are swapped for each pixel move to maintain stereo. For the case of horizontal scrolling, the same methods as vertical scrolling apply. To display interleaved stereo images in a window or on a full-screen, the left and right fields or views must be preserved and presented consistently. For example the first horizontal line of a stereo image that is presented within a window may represent the right field or view and the second horizontal line the left field or view. In this example, the first horizontal line of the display device is even, or represented by a zero, the right field/view is to be presented on even scan lines, and the left field/view is to be presented on odd scan lines to maintain stereo. If the left field/view were presented on the even scan lines and the right field/view on the odd lines, then the result would be pseudostereo. The selection of associating the right field/view with even scan lines is arbitrary—the reverse can also be true provided consistency is maintained. The left field/view may be on the odd scan lines, the right field/view on the even.
- The exemplary embodiment preserves left field/view and right field/view in a several ways. A first method is to snap the window to an even scan line, which ensures that the window starts on an even horizontal scan line. Another method is to look at the even/oddness of the first horizontal line where the stereo media starts. If the right field/view is on the even scan line, and the left field/view is on the odd, then no action is required, otherwise the left/right fields/views can be swapped-placing the left content on the even lines, and the right content on odd, for every horizontal line in the media, thereby resulting in a stereo image. The third method is to shift the entire viewing region within the window by one horizontal line to match right field/view with an even scan line and left field/view with an odd scan line. This may require dynamic resizing of the window to accommodate the vertical shift.
- An algorithm looks at the current vertical location of the window, and then places the first line of the stereo image on an even scan line. Whenever a user scrolls within that window, or moves the window itself, the application checks the odd/even status, and adjusts accordingly. In the case of vertically scrolling within a window or if the window itself is moved, the first line of the stereo image is placed on an even scan line. When the image is scrolled vertically, movement is done in even increments so as to maintain stereo. Stereo can be maintained by controlling the window position, forcing it to snap to even scan lines. The solutions include moving the window, moving the image, and swapping fields.
-
FIG. 2 illustrates the contents of a window displayed instereo 100. Acomputer 102 and itsmonitor 104 are used to display a line interlacedstereo image form 110. This window could be a standalone application, plug-in, or interpreted program. The magnification shows the details of a line interleaved stereo image. The even line of the stereo image is aligned with an even scan line of the monitor, which results in the display of a stereoscopic image. If the window moves, a check is done to determine even/odd scan-line, then the stereo image is started on an even scan line. If the window is moved, it will snap to start on an even scan line. -
FIG. 3 illustrates the contents of window displayed inreverse stereo 200. Acomputer 202 and itsmonitor 204 are used to display pseudoscopic or reversestereo image magnification 210 shows the details of a line interleaved stereo image. The even line of the stereo image is not aligned with an even scan line of the monitor, which results in the display of a pseudoscopic, or reverse image. -
FIG. 4 illustrates the contents of a scrolling window displayed instereo 300. A stereo image is presented on a computer screen in awindow 302. This particular window scrolls vertically. The first line of the image is aligned on aneven scan line 304 with the monitor, which allows for stereoscopic presentation. Whenever vertical scrolling occurs, even increments are made so that the image is always presented in stereo. -
FIG. 5 illustrates aGeneral Software Flowchart 400. Uponstart 402, the application checks to see where the image starts, on an even orodd scan line 404. If on aneven scan line 406, a stereo image is then displayed 408. If the image starts on anodd scan line 410, then the image is shifted to an even scan line or the left and right field/views are swapped and then displayed 412. Vertical scrolling begins 418 and is done by an even increment 420. - To scale stereo media, the left and right source must be preserved. Since the format of the original left and right is known, as designated by the tag within the
Stereoscopic 3D Media file, scaling can be done while preserving stereo. An embodiment ooks at the storage method used, then takes the appropriate actions to scale the media while preserving the stereo. Scaling may done to increase or decrease the display size of the stereoscopic media. -
FIG. 6 illustrates an analysis of the left andright media 500 that are extracted from theStereoscopic 3D Media file 502, individually scaled504, 506, recombined into the selected display 508, and then the resulting scaled Stereoscopic Media is displayed 510. - To scale stereo media, the left and right source must be preserved. Since the format of the original left and right is known, as designated by the tag within the
Stereoscopic 3D Media file, the scaling can be done while preserving stereo. The system will look at the storage method used, and then take the appropriate actions to scale the media while preserving the stereo. Scaling may done to increase or decrease the display size of the stereoscopic media. - In existing systems, stereo media can only be viewed at the original size. An embodiment provides a mechanism to increase or decrease the size at which the media is displayed while preserving the stereo.
-
FIG. 7 illustrates that without anyanalysis 600, if theStereoscopic 3D Media File is scaled without regard for the format used for the left and right, the scaled result will not be in stereo. Without any analysis, theStereoscopic 3D Media Files 602 and 604 are scaled without regard for the format used for the left and right, the scaled result will not be instereo 606. - Monoscopic and Stereoscopic Viewing allows greater distribution since both types can be viewed within one system. Prior Electronic Stereoscopic viewing systems only display stereoscopic media. The embodiments of the invention accommodate monoscopic and stereoscopic viewing. The embodiments of the invention allow users to access stereoscopic media without a 3D stereoscopic enabled physical viewing device. This invention can have greater distribution and market penetration since it is not dependent upon a physical viewing device. This viewing system can be toggled to display monoscopic, as well as various stereoscopic modes (color anaglyph, gray anaglyph, line interleaved, page-flipping, cross-eye, parallel viewing, etc.). In monoscopic mode, the image appears in 2D like other 2D web based images which allows all web users to view the images in 2D even if they do not have a stereoscopic viewing device.
- This is accomplished by showing either the left or right mono image. The user can select whether to view the left or right monoscopic view. Users without a physical stereo viewing device can see the media in monoscopic form by selecting to use either the right or left monoscopic views.
- An embodiment of the invention contains automatic adjustment of Brightness/Contrast/Image properties adjustment based on viewing mechanism. No prior Electronic viewing system adjusts media brightness/contrast based upon the display method. This embodiment adjusts the final display of the stereo media to accommodate LC shutter-glasses, and LC shutter-glasses with line-blanker type products. When stereo media is viewed through an LC shutter-glass viewing system it appears darker due to the shuttering system. Additionally when stereo media is viewed through an LC Shutter-glass coupled with a line blanker, the media appears even darker. This embodiment will adjust the brightness, contrast and other media properties to compensate for the color distortion/darkness incurred by the viewing mechanism.
FIG. 8 illustrates the automatic adjustment of Brightness/Contrast/Image properties adjustment based onviewing mechanism 700. TheStereoscopic Media file 702 is queried and is displayed usingshutter glasses 704. The Brightness adjustment system 706 adjusts the brightness of the media file to accommodate thephysical viewing mechanism 708. This same embodiment can compensate for uneven image luminance between the left and right eyes when using anaglyphic colored viewing glasses. - Algorithms are used to reduce crosstalk between the left and right views. Other stereoscopic viewing systems do not incorporate a system to reduce crosstalk. Crosstalk often appears in stereo media and can be referred to as ghosting. Bright in one eye, dark in the other, occupying the same point in the scene can create crosstalk. Areas of high contrast in stereo media are subject to crosstalk. This ghosting occurs because each eye is seeing some of the media intended only for the other eye, and in this case there may be very bright content in one eye, and darker content in the other eye.
- For example, the right eye could see the media intended for the right eye, but also some of the media intended for the left eye. Seeing both at once through one eye shows up as a form of ghosting. This invention locates points where crosstalk may occur, and adjusts the displayed stereo image to reduce or eliminate crosstalk. The system can query the hardware or the user to determine the optimum crosstalk reduction amount for a particular viewing system.
- Script buttons (vrr scripts) are used to change global stereo formats. An embodiment of the invention provides a novel method to switch the current display method for all stereo media currently displayed on-screen. For example, ten stereoscopic media files can be displayed on one web page. The display mode for each of those files can be changed with one command. Once a stereo display method is selected, then each of the stereo windows is notified to switch to the newly selected format. Typically, the user would be required to change the stereo display method for each stereoscopic image or media file.
- Using a script system, the viewing system is instructed to change display modes on the fly. The user can issue a command using a script to specify any viewing mode. All stereoscopic media files that are displayed on that web page are then dynamically switched to the new viewing method.
FIG. 9 illustrates a script command to set the display mode toColor Anaglyph 900. The Web Page as received has media files as illustrated by StereoImage Grey Anaglyph 904; StereoImage Color Anaglyph 906;Stereo Image Cross-eye 908 andStereo Image Parallel 910;Stereo Image Interleaved 912; andStereo Image Interleaved 914. With the Button: Set to Display mode toColor Anaglyph 916, the Script Commands sets the Display Mode Color Anaglyph 918. The system converts all the media files to Color Anaglyph as illustrated byfiles 920 through 930. This embodiment is critical in providing an easy to use 3D stereoscopic viewing system. - There is an embodiment that saves and converts one format into another from the Internet using a local drive from original source. The viewing system takes a Stereoscopic Media File, displays it on the user side according to the user's display preferences, and saves a local copy in whatever display format the user selects. The system can convert the Stereoscopic Media into the display method selected by the user, and save the result on the user's local drive. Alternately, the original form of the
Stereoscopic 3D Media file may be saved on the user's local drive. This embodiment makes it possible to support special 3D formats that are not easy to generate in real time. - A color calibration/adjustment for physical 3D viewing mechanisms, compensates for variations in the display devices. An embodiment includes the functionality to adjust stereo media properties, thereby preserving the original color, hues, saturation, etc. when viewed through a physical viewing mechanism. For example, when looking through liquid crystal shutter-glass systems, the LC may introduce additional yellow coloring to the subject matter. Based on the user's view settings that tell the originator what kind of viewing device the user may be using. Another embodiment of the invention corrects for distortions introduced by the viewing mechanism. Another example could be for anaglyph viewing. For this example, the viewing system goes through a color calibration to attempt to more closely match the coloring of the anaglyph lenses with the coloring of the monitor or display device.
- A stereo media file format may contain certain sub media such as VRR and blocks. An embodiment supports a stereoscopic media file that contains sub-media. Specifically, a file structure is created to store and preserve various types of stereo media in various formats. Additionally, this file format can also store monoscopic media, as well as audio or other data. This one file format can store multiple or single stereo/non-stereo media elements.
FIG. 10 illustrates aVRR file 1000 that may contain ascript 1002, aStereo Still Image 1004, a Stereoscopic Animation/movie 1006,Stereoscopic Object Model 1008, aThumbnail 1010, andAudio 1012. This embodiment also allows multiple resolution images to be stored in one media file or to be referenced (linked to) from one media file. - The system may also include an automatic free view image size adjustment to minimize viewing fatigue. For example, when parallel-viewing (also known as relaxed viewing, or free-viewing) stereo images, the separation of the left and right should not greatly exceed the average interocular distance of an adult.
-
FIG. 11 illustrates a parallel viewing mode. For parallel viewing, it is important that the right 1104 and left 1102 images be scaled and spaced so as to not exceed the viewer's eye spacing. If the viewer has a prismatic viewing aid, the image separation can be increased. The users can be queried to determine what viewing system is installed. Since most computer operating systems now store information on thewidth 1108 of the monitor image on the display monitor, it is possible to automatically adjust the spacing and size of the right and left images to avoid eyestrain. -
FIG. 12 illustratess a cross-eye viewing mode. For cross-eye viewing, it is possible to use larger images than with the parallel viewing method. There is still a limit where many users will begin to experience eyestrain. The user can be queried to determine the limits of cross-eye viewing. - Another embodiment allows for automatic detection of 3D display hardware. Many 3D stereoscopic hardware vendors install software that can be detected so that an appropriate display method can be automatically selected. If no stereoscopic hardware is detected, then the system must prompt the user to configure the display mode.
- Another embodiment automatically (or manually if desired) adjusts with overall left and right image shift to compensate for image magnification. When a 3D stereoscopic image is enlarged and displayed on a viewing system that has a larger image size then the target system, there is a potential of creating large separations between objects in the 3D stereoscopic image that can lead to eyestrain for the viewer. The present invention stores important parameters about the 3D stereoscopic image like width, height, target screen size, etc. When the 3D stereoscopic image is to be displayed on a display that is larger or smaller than the target screen size, then the 3D stereoscopic image is adjusted accordingly to minimize eye fatigue for the user.
- One embodiment utilizes image processing to detect pseudo-stereo 3D stereoscopic content. It is common for content authors to sometimes reverse the right and left eyes when creating 3D stereoscopic content. When this happens, the display system will present the wrong image to the viewer's eyes. This embodiment attempts to correct this problem by comparing portions of the right and left image content to determine if a pseudo condition exists and then swaps the right and left images to correct for the problem.
- Another embodiment encodes the full-color left and right images in separate channels and compresses the left and right channels independently. This technique provides less compression artifacts and reduces crosstalk when compared to anaglyphic storage techniques. In comparison, analgyph storage techniques, which are widely used on the Internet, combine the right and left images in separate color channels of a single image and then compressed the resulting image. This technique results in the introduction of crosstalk because most compression techniques, like JPEG that is commonly used, reduce the color space of an image drastically, which in turn compromises the quality of the Anaglyphic storage technique.
- < Another embodiment allows video to be stored in a side-by-side format in a single video-streaming file. This encoding method allows the right and left channels to be independently compressed which provides the best quality and ensures that the correct right and left image pair are matched up and that the images will not get out of synchronization during a long streaming session. In contrast, if two separate streaming channels were used, extra processing power would be required to manage two channels and ensure that they remained synchronized.
FIG. 14 illustrates the side-by-side format. Theright image 1400 is placed to the left of theleft image 1402 to form thecomposite image 1404. The composite image is twice as wide as either the left or right source images. For improved compression quality when using some compression systems, a verticalcolored separator band 1406 can be added between the right and left image. Some compression systems work better with this separator band. - Another embodiment of the display system is to create alignment dots or reference images to help the viewer view cross-eyed or parallel view image formats.
FIG. 15 illustrates one method of displaying helper alignment images for a cross-eye viewing mode. In this example, the helper images are placed below theimage 1504 and above theimage 1506 and are aligned with the center of the right and left images. The helper images could also be shifted towards the edges of the right and left images. The images are of high contrast and attract the viewer to fuse the images first before the primary 3D stereoscopic image is viewed. The simple high contrast nature of the alignment images allows them to be more easily viewed. This system makes it possible for viewers with poor stereo viewing capabilities to see more stereoscopic content with the cross-eyed, parallel, and other viewing modes. - One embodiment stores a series of 3D stereoscopic images of an object into one file.
FIG. 16 illustrates one way to store a series of N images into a single resource file. Thefirst image 1600 is at the top of the file and the rest of the images follow sequentially until thelast file 1602. The collection of these images forms an object movie data file 1604.FIG. 17 shows the relationship between the images and the object inquestion 1700. As the figure illustrates, the point of view of the camera is swung around the object to generate all of the intermediate images. When these images are displayed in a sequential fashion, it appears that the object is rotating on the screen in 3D depth. When the images are displayed in reverse order, the object appears to turn in the opposite direction. If the playback of the images is linked to the right/left movement of a mouse point on the screen, it will appear that the user is actually rotating the object on the screen. This example illustrates a one dimensional object movie. It is possible to store additional sets of rotational images sets to simulate other views of the object (example: doors open or closed on a car model). - Another embodiment allows a larger 3D stereoscopic image or panorama to be scrolled within a smaller viewing window as shown in
FIG. 18 . Theviewing window 1802 is a fixed size and does not move with respect to the viewing screen. The 3Dstereoscopic image 1800 is larger than the viewing window and therefore must be scrolled horizontally and vertically within the viewing window in order for the viewer to see the entire image. This is always the case with panoramic images that contain a very wide or tall view of a scene. When the image is panned within the viewing window, the invention ensures that the left and right views are presented to the correct eyes. For example, in the row interleaved viewing method, if the larger 3D stereoscopic image is moved vertically by a single pixel, the image will flip into pseudostereo mode. The present invention will either shift the image an additional line to make it viewable in non-pseudostereo or it will flip the left and right images to correct the problem. This embodiment is an extension of the previously described scrolling embodiment since it applies the scrolling embodiments to an image that is scrolled within a viewing window as opposed to a viewing window which is scrolled on the display screen (as previously detailed). - Another embodiment allows the previously discussed display embodiments to be extended to a wider viewing audience on the Internet and for local viewing on a workstation by implementing the invention on multiple parallel systems. For example, for viewing 3D stereoscopic content on the Internet through a browser, it is desirable to have uniform support for all browser systems. The present invention provides uniform support by implementing several parallel solutions. In particular, the present invention can be implemented as a Netscape plug-in to support the Netscape browser (see www.netscape.com) or the present invention can be implemented as an Active-X control to support the Microsoft Internet Explorer Browser (see www.Microsoft.com) or the present invention can be implemented as a Java Applet (see www.sun.com) to support some other forms of browsers. The embodiment described here implements the present invention on all of these systems in parallel and utilizes browser client side scripting and/or server side scripting (well known by someone skilled in web based systems) to select the correct system for a particular user. When a user points their browser to a particular website page which contains 3D stereoscopic content, the system of the present invention will determine which parallel system to use.
- Another embodiment allows new right and left image views to be generated to simulate a new stereoscopic camera separation. Some viewers may find it hard to view some images if the original cameras were separated by a large amount. The current embodiment utilizes image interpolation and morphing techniques to synthesize a new right and left image that are closer together. The same technique can be used to simulate a wider stereoscopic camera separation to increase the depth effect. The amount of adjustment can be selected by the user to suit their viewing condition and capabilities.
FIG. 19 illustrates an original right 1902 and left 1904 camera views of anobject 1900. The new synthesized right 1906 and left 1908 views will be easier to view for some users. - Another embodiment of the invention provides an automatic alignment and/or re-alignment of the left and right images. Many 3D stereoscopic images are created incorrectly and may have vertical, horizontal, or rotational misalignment that will cause eyestrain for the viewer. Using image correlation techniques, horizontal and vertical misalignment of the right and left views is corrected. Further correlation is applied to correct for rotational alignment issues.
- Another embodiment provides a tool that compares the left and right images to determine if stereoscopic information is lost during compression. Compression is used to reduce the size of a stereoscopic image so that it can be easily transmitted over a low bandwidth connection. If too much compression is applied, the image will loose its stereoscopic impact. This embodiment provides a measure of the quality of the stereoscopic image that can be used to readjust the compression system.
- Another embodiment allows both local content, residing on the users workstation, and remote content, residing on a server or web site to be viewed using the display methods. This embodiment is needed to allow for remote streaming playback as well as to allow for local playback of files that are delivered via cd-rom or other storage means or for content that is downloaded from a remote location to a local storage location before being displayed.
- Another embodiment of the present invention provides the ability to download larger sized 3D stereoscopic content files as a background task or during idle use times of the workstation as shown in
FIG. 13 . These largesized files 1300 cannot be easily streamed over the Internet in real-time or near real-time. This background downloading capability allows the present invention to be more widely used on low-bandwidth systems. This embodiment utilizes a database of known locations where information about 3D content is stored 1302. A subscription system or search engine can be used to access the 3D content or specific content can be added to the download database. The system of the present invention keeps track of what content has been downloaded in asecond database 1304 and records details about the download that can be used to recover a faulty download. The 3D stereoscopic content is moved from aremote location 1310 to a higher bandwidthlocal location 1308 where the content can be played back in real-time or near real-time. The download database and the 3D stereoscopic content location database are also used to help append 3D stereoscopic content into a larger local file. This method allows a very large or long content file to be broken into much smaller files that are downloaded one after the other. As each file is downloaded, it is appended to the current local copy of the download. If new remote content files are made available on a periodic basis, this system will allow them to be appended together as they become available. - Another embodiment allows conventional 2D object movies to be converted into 3D stereoscopic object movies. A conventional object movie utilizes a sequence of still images of an object captured a various view angles as illustrated in
FIG. 17 . A 2D object movie can be converted to 3D stereoscopic format by pairing up the original images. For example, inFIG. 17 ,View 1 andView 2 can be combined to form a left right pair (respectively). The next 3D stereoscopic view is formed by combiningview 2 with view 3 (left and right respectively). Each image in the original object movie is used twice. If the original 2D object movie contains enough images (60 images produces good results) then the converted 3D object movie will be usable. If there are not enough images, less than 40, then better results are achieved if the previously mentioned embodiment of generating intermediate views using image interpolation can be applied to the object movie conversion. Using image interpolation allows intermediate stereoscopic views to be generated, which have much less camera separation and are easier to view. - The present invention can also be embodied in the form of computer program code, for example, whether stored in a storage medium, loaded into and/or executed by a computer, or transmitted over some transmission medium, such as over electrical wiring or cabling, through fiber optics, via electromagnetic radiation or via the Internet, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus for practicing the invention. When implemented on a general-purpose microprocessor, the computer program code segments configure the microprocessor to create specific logic circuits.
- The modifications to the various aspects of the present invention described above are merely exemplary. It is understood that other modifications to the illustrative embodiments will readily occur to persons with ordinary skill in the art. All such modifications and variations are deemed to be within the scope and spirit of the present invention as defined by the accompanying Claims.
Claims (33)
1. A method for delivering stereoscopic media in electronic form comprising:
providing a single format with independent right and left channels to represent the stereoscopic media;
displaying said stereoscopic media inside a movable windowed area while eliminating pseudo stereo conditions during movement;
optimizing adjustments of parallax shift adjustment, brightness control, color adjustment, and cross-talk reduction of said stereoscopic media based on viewing hardware, monitor size, and media content for optimal viewing quality and
seamlessly supporting for monoscopic (2D) viewing modes allowing delivery of said stereoscopic media in a normal 2D viewing mode.
2. The method of claim 1 , wherein said media includes images, videos, animations, and object models.
3. The method of claim 2 wherein delivering comprises locations including the Internet and electronic media.
4. The method of claim 3 wherein electronic media comprises optical media and magnetic media.
5. The method of claim 1 wherein a single media file format that is converted to various display formats on a user side.
6. The method of claim 1 further comprising a stereoscopic media in a window such as a browser or application.
7. The method of claim 1 further comprising stereoscopic preservation in a window during scrolling and window movement.
8. The method of claim 1 comprising supporting of auto-detection 3D stereo hardware systems.
9. The method of claim 1 comprising script buttons (VRR scripts) for changing global stereo formats.
10. The method of claim 9 further comprising stereoscopic media file formats that contain sub media such as VRR and blocks.
11. The method of claim 1 comprising parallax shift adjustments based on a physical size of display window.
12. The method of claim 1 further comprising automatic brightness adjustments.
13. The method of claim 1 further comprising color calibration/adjustments for physical 3D viewing mechanisms, including variations in display devices.
14. The method of claim 1 further comprising crosstalk reduction techniques on a user side.
15. The method of claim 1 further comprising smart stereo scaling.
16. The method of claim 1 further comprising integration of stereo media types into one viewer with script interaction.
17. The method of claim 1 further comprising monoscopic and stereoscopic viewing that allows greater distribution since both types can be viewed within one system.
18. The method of claim 1 comprising saving and converting one format into another from the Internet using a local drive from an original source.
19. The method of claim 1 further comprising automatic free view image size adjustment to minimize viewing fatigue.
20. The method of claim 1 further comprising pseudostereo correction based on image processing of a few lines or the entire image.
21. The method of claim 1 further comprising scaling said stereoscopic media, so that left and right sources are preserved.
22. The method of claim 1 further comprising improvements to Anaglyph display methods.
23. A method for delivering stereoscopic content in electronic form through the internet or an intranet or similar network environment comprising:
storing said stereoscopic content in a location that is not physically connected to a users workstation; and
providing a means to view content that resides locally on the users workstation.
24. The method of claim 23 wherein the encoding processes used includes independent compression of Left and Right images.
25. The method of claim 23 wherein Independent compression of Left and Right provides better quality display output.
26. The method of claim 25 wherein said compression uses an anaglyph method.
27. The method of claim 26 further includes:
a video setup format for compression (sbs format and asf).
28. The method of claim 26 includes using image alignment reference points/indicators to aid in visual image alignment.
29. The method of claim 28 including using multiple sub images by object viewers in stereo for a one-dimensional or two dimensional object viewer.
30. The method of claim 29 including using stereoscopic panning that preserve the stereo image alignment.
31. The method of claim 30 uses a co-existence of Java software and a plug-in solution to minimize downloading.
32. The method of claim 31 using image interpolation to generate in between stereo views to minimize or maximize the stereo separation
33. The method of claim 32 using image interpolation for converting a 2D object movie to a 3D stereoscopic object display and provide a background download capability.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/888,946 US20050078108A1 (en) | 2000-06-12 | 2004-07-09 | Electronic stereoscopic media delivery system |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US21109200P | 2000-06-12 | 2000-06-12 | |
US09/879,420 US6765568B2 (en) | 2000-06-12 | 2001-06-12 | Electronic stereoscopic media delivery system |
US10/888,946 US20050078108A1 (en) | 2000-06-12 | 2004-07-09 | Electronic stereoscopic media delivery system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/879,420 Continuation US6765568B2 (en) | 2000-06-12 | 2001-06-12 | Electronic stereoscopic media delivery system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20050078108A1 true US20050078108A1 (en) | 2005-04-14 |
Family
ID=22785567
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/879,420 Expired - Fee Related US6765568B2 (en) | 2000-06-12 | 2001-06-12 | Electronic stereoscopic media delivery system |
US10/888,946 Abandoned US20050078108A1 (en) | 2000-06-12 | 2004-07-09 | Electronic stereoscopic media delivery system |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/879,420 Expired - Fee Related US6765568B2 (en) | 2000-06-12 | 2001-06-12 | Electronic stereoscopic media delivery system |
Country Status (4)
Country | Link |
---|---|
US (2) | US6765568B2 (en) |
AU (1) | AU2001266862A1 (en) |
TW (1) | TW529297B (en) |
WO (1) | WO2001097531A2 (en) |
Cited By (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020021832A1 (en) * | 2000-06-30 | 2002-02-21 | Dawson Mark Thomas | Method and apparatus for producing anaglyphic 3-D images |
US20060062490A1 (en) * | 2004-07-15 | 2006-03-23 | Samsung Electronics Co., Ltd. | Apparatus and method of transforming multidimensional video format |
US20080266387A1 (en) * | 2005-12-20 | 2008-10-30 | Koninklijke Philips Electronics, N.V. | Autostereoscopic Display Device |
US20090315977A1 (en) * | 2008-06-24 | 2009-12-24 | Samsung Electronics Co., Ltd. | Method and apparatus for processing three dimensional video data |
US20100097443A1 (en) * | 2008-10-16 | 2010-04-22 | Peter Lablans | Controller in a Camera for Creating a Panoramic Image |
US20100142924A1 (en) * | 2008-11-18 | 2010-06-10 | Panasonic Corporation | Playback apparatus, playback method, and program for performing stereoscopic playback |
US20100156897A1 (en) * | 2008-12-18 | 2010-06-24 | 3D Fusion Inc. | System and Method For Adaptive Scalable Dynamic Conversion, Quality and Processing Optimization, Enhancement, Correction, Mastering, And Other Advantageous Processing of Three Dimensional Media Content |
US20100208044A1 (en) * | 2009-02-19 | 2010-08-19 | Real D | Stereoscopic systems for anaglyph images |
US20100214286A1 (en) * | 2009-02-25 | 2010-08-26 | 3D Fusion, Inc. | System and method for collaborative distributed generation, conversion, quality and processing optimization, enhancement, correction, mastering, and other advantageous processing of three dimensional media content |
US20100259690A1 (en) * | 2009-04-14 | 2010-10-14 | Futurewei Technologies, Inc. | System and Method for Processing Video Files |
US20110026608A1 (en) * | 2009-08-03 | 2011-02-03 | General Instrument Corporation | Method of encoding video content |
US20110102559A1 (en) * | 2009-10-30 | 2011-05-05 | Kazuhiko Nakane | Video display control method and apparatus |
US20110161843A1 (en) * | 2009-12-31 | 2011-06-30 | Broadcom Corporation | Internet browser and associated content definition supporting mixed two and three dimensional displays |
US20110221866A1 (en) * | 2010-01-14 | 2011-09-15 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US20120011151A1 (en) * | 2006-06-30 | 2012-01-12 | Aperio Technologies, Inc. | System and Method for Managing Images Over a Network |
US20120120063A1 (en) * | 2010-11-11 | 2012-05-17 | Sony Corporation | Image processing device, image processing method, and program |
CN102484025A (en) * | 2009-08-10 | 2012-05-30 | 株式会社日立高新技术 | Charged particle beam device and image display method |
US20120169719A1 (en) * | 2010-12-31 | 2012-07-05 | Samsung Electronics Co., Ltd. | Method for compensating data, compensating apparatus for performing the method and display apparatus having the compensating apparatus |
US20120182387A1 (en) * | 2011-01-17 | 2012-07-19 | Sony Corporation | 3d motion picture processing device |
US20120293494A1 (en) * | 2011-05-18 | 2012-11-22 | Nintendo Co., Ltd. | Computer-readable storage medium having display control program stored therein, display control apparatus, display control system, and display control method |
US20140022244A1 (en) * | 2011-03-24 | 2014-01-23 | Fujifilm Corporation | Stereoscopic image processing device and stereoscopic image processing method |
WO2014052270A1 (en) * | 2012-09-27 | 2014-04-03 | 3M Innovative Properties Company | Method to store and retrieve crosstalk profiles of 3d stereoscopic displays |
US8894486B2 (en) | 2010-01-14 | 2014-11-25 | Nintendo Co., Ltd. | Handheld information processing apparatus and handheld game apparatus |
US9117385B2 (en) | 2011-02-09 | 2015-08-25 | Dolby Laboratories Licensing Corporation | Resolution management for multi-view display technologies |
US9584794B2 (en) | 2012-04-05 | 2017-02-28 | Koninklijke Philips N.V. | Depth helper data |
US20170188792A1 (en) * | 2014-03-17 | 2017-07-06 | Intuitive Surgical Operations, Inc | Systems and methods for control of imaging instruement orientation |
EP2365699B1 (en) * | 2010-03-11 | 2018-10-17 | Samsung Electronics Co., Ltd. | Method for adjusting 3D image quality, 3D display apparatus, 3D glasses, and system for providing 3D image |
US10275932B2 (en) | 2010-12-06 | 2019-04-30 | Dolby Laboratories Licensing Corporation | Methods and apparatus for image adjustment for displays having 2D and 3D display modes |
US10506218B2 (en) | 2010-03-12 | 2019-12-10 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
Families Citing this family (168)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7907793B1 (en) | 2001-05-04 | 2011-03-15 | Legend Films Inc. | Image sequence depth enhancement system and method |
US8396328B2 (en) | 2001-05-04 | 2013-03-12 | Legend3D, Inc. | Minimal artifact image sequence depth enhancement system and method |
US20050231505A1 (en) * | 1998-05-27 | 2005-10-20 | Kaye Michael C | Method for creating artifact free three-dimensional images converted from two-dimensional images |
US7116323B2 (en) * | 1998-05-27 | 2006-10-03 | In-Three, Inc. | Method of hidden surface reconstruction for creating accurate three-dimensional images converted from two-dimensional images |
US20050146521A1 (en) * | 1998-05-27 | 2005-07-07 | Kaye Michael C. | Method for creating and presenting an accurate reproduction of three-dimensional images converted from two-dimensional images |
DE10016074B4 (en) * | 2000-04-01 | 2004-09-30 | Tdv Technologies Corp. | Method and device for generating 3D images |
US7254265B2 (en) * | 2000-04-01 | 2007-08-07 | Newsight Corporation | Methods and systems for 2D/3D image conversion and optimization |
US6765568B2 (en) * | 2000-06-12 | 2004-07-20 | Vrex, Inc. | Electronic stereoscopic media delivery system |
US8401336B2 (en) * | 2001-05-04 | 2013-03-19 | Legend3D, Inc. | System and method for rapid image sequence depth enhancement with augmented computer-generated elements |
US8897596B1 (en) | 2001-05-04 | 2014-11-25 | Legend3D, Inc. | System and method for rapid image sequence depth enhancement with translucent elements |
US9286941B2 (en) | 2001-05-04 | 2016-03-15 | Legend3D, Inc. | Image sequence enhancement and motion picture project management system |
DE10128530A1 (en) * | 2001-06-13 | 2002-12-19 | Basf Ag | Water-dilutable concentrate giving long-life low electrical conductivity cooling systems for fuel cell systems in e.g. vehicles is based on alkylene glycols and also contains azole derivatives |
US7277121B2 (en) * | 2001-08-29 | 2007-10-02 | Sanyo Electric Co., Ltd. | Stereoscopic image processing and display system |
JP5020458B2 (en) * | 2001-11-24 | 2012-09-05 | フェニックス スリーディー インコーポレイテッド | Generation of stereoscopic image sequence from 2D image sequence |
DE60316738T2 (en) * | 2002-03-08 | 2008-07-24 | Topcon Corp. | Apparatus and method for stereoscopic image reproduction |
US8369607B2 (en) * | 2002-03-27 | 2013-02-05 | Sanyo Electric Co., Ltd. | Method and apparatus for processing three-dimensional images |
CA2380105A1 (en) * | 2002-04-09 | 2003-10-09 | Nicholas Routhier | Process and system for encoding and playback of stereoscopic video sequences |
AU2003231510A1 (en) * | 2002-04-25 | 2003-11-10 | Sharp Kabushiki Kaisha | Image data creation device, image data reproduction device, and image data recording medium |
WO2003092305A1 (en) * | 2002-04-25 | 2003-11-06 | Sharp Kabushiki Kaisha | Image encodder, image decoder, record medium, and image recorder |
GR1004257B (en) * | 2002-06-05 | 2003-06-09 | Method and system for stereoscopic representations. | |
US7804995B2 (en) * | 2002-07-02 | 2010-09-28 | Reald Inc. | Stereoscopic format converter |
KR100934006B1 (en) * | 2002-07-16 | 2009-12-28 | 한국전자통신연구원 | Apparatus and method for adaptive conversion of 2D and 3D binocular video signals |
WO2004021285A1 (en) * | 2002-08-27 | 2004-03-11 | Sharp Kabushiki Kaisha | Content reproduction device capable of reproducing a content in optimal reproduction mode |
JP3973525B2 (en) * | 2002-09-24 | 2007-09-12 | シャープ株式会社 | Electronic device having 2D (2D) and 3D (3D) display functions |
US7034819B2 (en) * | 2002-10-04 | 2006-04-25 | Silicon Integrated Systems Corp. | Apparatus and method for generating an interleaved stereo image |
JP4259884B2 (en) * | 2003-01-20 | 2009-04-30 | シャープ株式会社 | Image data creating apparatus and image data reproducing apparatus for reproducing the data |
JP2004287857A (en) * | 2003-03-20 | 2004-10-14 | Sanyo Electric Co Ltd | Program, recording medium, server device and image filter |
JP4679804B2 (en) * | 2003-04-17 | 2011-05-11 | シャープ株式会社 | Image file creation device |
JP4684107B2 (en) * | 2003-09-11 | 2011-05-18 | シャープ株式会社 | Portable display device and method for controlling portable display device |
US7650036B2 (en) * | 2003-10-16 | 2010-01-19 | Sharp Laboratories Of America, Inc. | System and method for three-dimensional video coding |
JP4841250B2 (en) * | 2003-12-19 | 2011-12-21 | ティディヴィジョン コーポレイション エス.エー. デ シー.ヴィ. | 3D video game system |
EP2442576A3 (en) | 2004-04-26 | 2013-08-21 | Olympus Corporation | Generating, editing and updating data of a stereoscopic image file, generating a stereoscopic image file and reproducing data therefrom |
JP2005311983A (en) * | 2004-04-26 | 2005-11-04 | Olympus Corp | Image processing apparatus |
WO2006019039A1 (en) * | 2004-08-18 | 2006-02-23 | Sharp Kabushiki Kaisha | Image data display |
KR100657275B1 (en) * | 2004-08-26 | 2006-12-14 | 삼성전자주식회사 | Method for generating a stereoscopic image and method for scaling therefor |
US7542034B2 (en) | 2004-09-23 | 2009-06-02 | Conversion Works, Inc. | System and method for processing video images |
US20080259073A1 (en) * | 2004-09-23 | 2008-10-23 | Conversion Works, Inc. | System and method for processing video images |
US20080246836A1 (en) * | 2004-09-23 | 2008-10-09 | Conversion Works, Inc. | System and method for processing video images for camera recreation |
WO2006056616A1 (en) * | 2004-11-27 | 2006-06-01 | Bracco Imaging S.P.A. | Systems and methods for displaying multiple views of a single 3d rendering ('multiple views') |
US20090051759A1 (en) * | 2005-05-27 | 2009-02-26 | Adkins Sean M | Equipment and methods for the synchronization of stereoscopic projection displays |
JP4687279B2 (en) * | 2005-06-29 | 2011-05-25 | ソニー株式会社 | Image reproduction apparatus, image reproduction method, and image reproduction program |
JP4665166B2 (en) * | 2005-06-29 | 2011-04-06 | ソニー株式会社 | Stereo image processing apparatus, stereo image processing method, and stereo image processing program |
JP4665167B2 (en) * | 2005-06-29 | 2011-04-06 | ソニー株式会社 | Stereo image processing apparatus, stereo image processing method, and stereo image processing program |
US8885017B2 (en) * | 2005-07-14 | 2014-11-11 | 3Ality Digital Systems, Llc | Real-time process and technology using image processing to maintain and ensure viewer comfort during capture, live transmission, and post-production of stereoscopic 3D imagery |
KR101468746B1 (en) * | 2005-09-16 | 2014-12-04 | 스테레오그래픽스 코포레이션 | Stereoscopic Format Converter |
US8466954B2 (en) * | 2006-04-03 | 2013-06-18 | Sony Computer Entertainment Inc. | Screen sharing method and apparatus |
US20070247477A1 (en) * | 2006-04-21 | 2007-10-25 | Lowry Gregory N | Method and apparatus for processing, displaying and viewing stereoscopic 3D images |
US8655052B2 (en) * | 2007-01-26 | 2014-02-18 | Intellectual Discovery Co., Ltd. | Methodology for 3D scene reconstruction from 2D image sequences |
US8274530B2 (en) | 2007-03-12 | 2012-09-25 | Conversion Works, Inc. | Systems and methods for filling occluded information for 2-D to 3-D conversion |
US20080225059A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | System and method for using off-screen mask space to provide enhanced viewing |
US20080228449A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems and methods for 2-d to 3-d conversion using depth access segments to define an object |
US20080226128A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | System and method for using feature tracking techniques for the generation of masks in the conversion of two-dimensional images to three-dimensional images |
US20080225042A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems and methods for allowing a user to dynamically manipulate stereoscopic parameters |
US20080226160A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems and methods for filling light in frames during 2-d to 3-d image conversion |
US20080225045A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems and methods for 2-d to 3-d image conversion using mask to model, or model to mask, conversion |
US20080225040A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | System and method of treating semi-transparent features in the conversion of two-dimensional images to three-dimensional images |
US20080226194A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems and methods for treating occlusions in 2-d to 3-d image conversion |
US20080226181A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems and methods for depth peeling using stereoscopic variables during the rendering of 2-d to 3-d images |
US8339333B2 (en) * | 2008-01-02 | 2012-12-25 | 3M Innovative Properties Company | Methods of reducing perceived image crosstalk in a multiview display |
US7746098B2 (en) * | 2008-03-10 | 2010-06-29 | Qimonda North America Corp. | Termination switching based on data rate |
JP4608563B2 (en) * | 2008-03-26 | 2011-01-12 | 富士フイルム株式会社 | Stereoscopic image display apparatus and method, and program |
US8629898B2 (en) | 2008-09-03 | 2014-01-14 | Sony Corporation | Stereoscopic video delivery |
DE102008049921A1 (en) * | 2008-09-29 | 2010-04-15 | Mobotix Ag | Method of video stream generation |
EP2360935A4 (en) * | 2008-09-30 | 2012-06-20 | Panasonic Corp | Reproduction device, recording medium, and integrated circuit |
USD603445S1 (en) | 2009-03-13 | 2009-11-03 | X6D Limited | 3D glasses |
USD624952S1 (en) | 2008-10-20 | 2010-10-05 | X6D Ltd. | 3D glasses |
USRE45394E1 (en) | 2008-10-20 | 2015-03-03 | X6D Limited | 3D glasses |
USD666663S1 (en) | 2008-10-20 | 2012-09-04 | X6D Limited | 3D glasses |
CA2684513A1 (en) | 2008-11-17 | 2010-05-17 | X6D Limited | Improved performance 3d glasses |
US8542326B2 (en) | 2008-11-17 | 2013-09-24 | X6D Limited | 3D shutter glasses for use with LCD displays |
US20120105439A1 (en) * | 2008-12-18 | 2012-05-03 | 3D Fusion Inc. | System and Method For Adaptive Scalable Dynamic Conversion, Quality and Processing Optimization, Enhancement, Correction, Mastering, And Other Advantageous Processing of Three Dimensional Media Content |
KR20100093638A (en) * | 2009-02-17 | 2010-08-26 | 삼성전자주식회사 | Display system, display apparatus and control method thereof |
USD646451S1 (en) | 2009-03-30 | 2011-10-04 | X6D Limited | Cart for 3D glasses |
JP5702054B2 (en) * | 2009-03-31 | 2015-04-15 | ソニー株式会社 | Display device and display method |
USD650956S1 (en) | 2009-05-13 | 2011-12-20 | X6D Limited | Cart for 3D glasses |
USD672804S1 (en) | 2009-05-13 | 2012-12-18 | X6D Limited | 3D glasses |
JP5252223B2 (en) * | 2009-06-09 | 2013-07-31 | ソニー株式会社 | Video display device and video display system |
EP2449787A1 (en) * | 2009-07-02 | 2012-05-09 | Thomson Licensing | Method and system for differential distortion correction for three-dimensional (3d) projection |
CN102474642A (en) * | 2009-07-09 | 2012-05-23 | Lg电子株式会社 | Image output method for display device which outputs three-dimensional contents, and display device employing method |
WO2011008626A1 (en) * | 2009-07-14 | 2011-01-20 | Sony Computer Entertainment America Llc | System and method of displaying multiple video feeds |
US9036700B2 (en) | 2009-07-15 | 2015-05-19 | Google Technology Holdings LLC | Simulcast of stereoviews for 3D TV |
WO2011014692A1 (en) * | 2009-07-29 | 2011-02-03 | Thomson Licensing | Method for crosstalk correction for three-dimensional (3d) projection |
US9083958B2 (en) * | 2009-08-06 | 2015-07-14 | Qualcomm Incorporated | Transforming video data in accordance with three dimensional input formats |
KR101699956B1 (en) * | 2009-08-12 | 2017-01-25 | 톰슨 라이센싱 | Method and system for crosstalk and distortion corrections for three-dimensional (3d) projection |
USD669522S1 (en) | 2010-08-27 | 2012-10-23 | X6D Limited | 3D glasses |
USD671590S1 (en) | 2010-09-10 | 2012-11-27 | X6D Limited | 3D glasses |
USD692941S1 (en) | 2009-11-16 | 2013-11-05 | X6D Limited | 3D glasses |
IT1397591B1 (en) * | 2009-12-21 | 2013-01-16 | Sisvel Technology Srl | METHOD FOR THE GENERATION, TRANSMISSION AND RECEPTION OF STEREOSCOPIC IMAGES AND RELATIVE DEVICES. |
TWI628947B (en) * | 2009-12-31 | 2018-07-01 | 江國慶 | Method of transmitting image for communication name list through remote server |
WO2011079376A1 (en) * | 2010-01-03 | 2011-07-07 | Sensio Technologies Inc. | Method and system for detecting compressed stereoscopic frames in a digital video signal |
USD662965S1 (en) | 2010-02-04 | 2012-07-03 | X6D Limited | 3D glasses |
US8896668B2 (en) * | 2010-04-05 | 2014-11-25 | Qualcomm Incorporated | Combining data from multiple image sensors |
US9001227B2 (en) * | 2010-04-05 | 2015-04-07 | Qualcomm Incorporated | Combining data from multiple image sensors |
JP5449536B2 (en) * | 2010-04-28 | 2014-03-19 | 富士フイルム株式会社 | Stereoscopic image reproduction apparatus and method, stereoscopic imaging apparatus, and stereoscopic display apparatus |
JP5268991B2 (en) * | 2010-05-18 | 2013-08-21 | 株式会社東芝 | Information processing apparatus and video content reproduction method |
US8872893B2 (en) * | 2010-05-26 | 2014-10-28 | Broadcom Corporation | Systems and methods for managing distribution of 3D media |
EP2393298A1 (en) * | 2010-06-03 | 2011-12-07 | Zoltan Korcsok | Method and apparatus for generating multiple image views for a multiview autostereoscopic display device |
US9030536B2 (en) | 2010-06-04 | 2015-05-12 | At&T Intellectual Property I, Lp | Apparatus and method for presenting media content |
US8593574B2 (en) | 2010-06-30 | 2013-11-26 | At&T Intellectual Property I, L.P. | Apparatus and method for providing dimensional media content based on detected display capability |
US9787974B2 (en) | 2010-06-30 | 2017-10-10 | At&T Intellectual Property I, L.P. | Method and apparatus for delivering media content |
US8640182B2 (en) | 2010-06-30 | 2014-01-28 | At&T Intellectual Property I, L.P. | Method for detecting a viewing apparatus |
US8918831B2 (en) | 2010-07-06 | 2014-12-23 | At&T Intellectual Property I, Lp | Method and apparatus for managing a presentation of media content |
US9049426B2 (en) | 2010-07-07 | 2015-06-02 | At&T Intellectual Property I, Lp | Apparatus and method for distributing three dimensional media content |
US9560406B2 (en) | 2010-07-20 | 2017-01-31 | At&T Intellectual Property I, L.P. | Method and apparatus for adapting a presentation of media content |
US9032470B2 (en) | 2010-07-20 | 2015-05-12 | At&T Intellectual Property I, Lp | Apparatus for adapting a presentation of media content according to a position of a viewing apparatus |
US9232274B2 (en) * | 2010-07-20 | 2016-01-05 | At&T Intellectual Property I, L.P. | Apparatus for adapting a presentation of media content to a requesting device |
US8446461B2 (en) * | 2010-07-23 | 2013-05-21 | Superd Co. Ltd. | Three-dimensional (3D) display method and system |
US8994716B2 (en) | 2010-08-02 | 2015-03-31 | At&T Intellectual Property I, Lp | Apparatus and method for providing media content |
US9412335B2 (en) | 2010-08-19 | 2016-08-09 | Thomson Licensing | Color calibration and compensation for 3D display systems |
US8438502B2 (en) | 2010-08-25 | 2013-05-07 | At&T Intellectual Property I, L.P. | Apparatus for controlling three-dimensional images |
USD664183S1 (en) | 2010-08-27 | 2012-07-24 | X6D Limited | 3D glasses |
US8831273B2 (en) | 2010-09-10 | 2014-09-09 | Reald Inc. | Methods and systems for pre-processing two-dimensional image files to be converted to three-dimensional image files |
US9485497B2 (en) | 2010-09-10 | 2016-11-01 | Reald Inc. | Systems and methods for converting two-dimensional images into three-dimensional images |
FR2965444B1 (en) | 2010-09-24 | 2012-10-05 | St Microelectronics Grenoble 2 | 3D VIDEO TRANSMISSION ON A HISTORIC TRANSPORT INFRASTRUCTURE |
US8872888B2 (en) | 2010-10-01 | 2014-10-28 | Sony Corporation | Content transmission apparatus, content transmission method, content reproduction apparatus, content reproduction method, program and content delivery system |
US8947511B2 (en) | 2010-10-01 | 2015-02-03 | At&T Intellectual Property I, L.P. | Apparatus and method for presenting three-dimensional media content |
US8730232B2 (en) | 2011-02-01 | 2014-05-20 | Legend3D, Inc. | Director-style based 2D to 3D movie conversion system and method |
US9288476B2 (en) | 2011-02-17 | 2016-03-15 | Legend3D, Inc. | System and method for real-time depth modification of stereo images of a virtual reality environment |
US9113130B2 (en) | 2012-02-06 | 2015-08-18 | Legend3D, Inc. | Multi-stage production pipeline system |
US9407904B2 (en) | 2013-05-01 | 2016-08-02 | Legend3D, Inc. | Method for creating 3D virtual reality from 2D images |
US9282321B2 (en) | 2011-02-17 | 2016-03-08 | Legend3D, Inc. | 3D model multi-reviewer system |
US9241147B2 (en) | 2013-05-01 | 2016-01-19 | Legend3D, Inc. | External depth map transformation method for conversion of two-dimensional images to stereoscopic images |
KR20120114476A (en) * | 2011-04-07 | 2012-10-17 | 한국전자통신연구원 | Method and apparatus for 3-dimentional image output |
KR101088634B1 (en) * | 2011-04-11 | 2011-12-06 | 이종오 | Stereoscopic display panel, stereoscopic display apparatus, and stereoscopic display method |
JP5052683B1 (en) * | 2011-04-19 | 2012-10-17 | 株式会社東芝 | Electronic device and video display method |
TWI465104B (en) * | 2011-05-04 | 2014-12-11 | Oriental Inst Technology | Image color correction system and the correction method thereof |
US9407907B2 (en) | 2011-05-13 | 2016-08-02 | Écrans Polaires Inc./Polar Screens Inc. | Method and display for concurrently displaying a first image and a second image |
US8947497B2 (en) | 2011-06-24 | 2015-02-03 | At&T Intellectual Property I, Lp | Apparatus and method for managing telepresence sessions |
US9445046B2 (en) | 2011-06-24 | 2016-09-13 | At&T Intellectual Property I, L.P. | Apparatus and method for presenting media content with telepresence |
US9030522B2 (en) | 2011-06-24 | 2015-05-12 | At&T Intellectual Property I, Lp | Apparatus and method for providing media content |
US9602766B2 (en) | 2011-06-24 | 2017-03-21 | At&T Intellectual Property I, L.P. | Apparatus and method for presenting three dimensional objects with telepresence |
US20130009949A1 (en) * | 2011-07-05 | 2013-01-10 | Texas Instruments Incorporated | Method, system and computer program product for re-convergence of a stereoscopic image |
US8587635B2 (en) | 2011-07-15 | 2013-11-19 | At&T Intellectual Property I, L.P. | Apparatus and method for providing media services with telepresence |
GB2495907B (en) * | 2011-10-18 | 2013-09-18 | Sony Comp Entertainment Europe | Image transfer apparatus and method |
US9208641B2 (en) | 2012-01-13 | 2015-12-08 | Igt Canada Solutions Ulc | Remote gaming method allowing temporary inactivation without terminating playing session due to game inactivity |
US9280868B2 (en) | 2012-01-13 | 2016-03-08 | Igt Canada Solutions Ulc | Systems and methods for carrying out an uninterrupted game |
US9295908B2 (en) | 2012-01-13 | 2016-03-29 | Igt Canada Solutions Ulc | Systems and methods for remote gaming using game recommender |
US9129489B2 (en) | 2012-01-13 | 2015-09-08 | Gtech Canada Ulc | Remote gaming method where venue's system suggests different games to remote player using a mobile gaming device |
US9159189B2 (en) | 2012-01-13 | 2015-10-13 | Gtech Canada Ulc | Mobile gaming device carrying out uninterrupted game despite communications link disruption |
US9269222B2 (en) | 2012-01-13 | 2016-02-23 | Igt Canada Solutions Ulc | Remote gaming system using separate terminal to set up remote play with a gaming terminal |
US9079098B2 (en) | 2012-01-13 | 2015-07-14 | Gtech Canada Ulc | Automated discovery of gaming preferences |
US9123200B2 (en) | 2012-01-13 | 2015-09-01 | Gtech Canada Ulc | Remote gaming using game recommender system and generic mobile gaming device |
US9011240B2 (en) | 2012-01-13 | 2015-04-21 | Spielo International Canada Ulc | Remote gaming system allowing adjustment of original 3D images for a mobile gaming device |
US9536378B2 (en) | 2012-01-13 | 2017-01-03 | Igt Canada Solutions Ulc | Systems and methods for recommending games to registered players using distributed storage |
US9558625B2 (en) | 2012-01-13 | 2017-01-31 | Igt Canada Solutions Ulc | Systems and methods for recommending games to anonymous players using distributed storage |
US9143754B2 (en) | 2012-02-02 | 2015-09-22 | Cyberlink Corp. | Systems and methods for modifying stereoscopic images |
US9934614B2 (en) | 2012-05-31 | 2018-04-03 | Microsoft Technology Licensing, Llc | Fixed size augmented reality objects |
US20130326364A1 (en) * | 2012-05-31 | 2013-12-05 | Stephen G. Latta | Position relative hologram interactions |
US9129436B2 (en) | 2012-08-01 | 2015-09-08 | Dreamworks Animation Llc | Techniques for smoothing scripted stereo curves for stereoscopic computer animation |
USD711959S1 (en) | 2012-08-10 | 2014-08-26 | X6D Limited | Glasses for amblyopia treatment |
US9454879B2 (en) | 2012-09-18 | 2016-09-27 | Igt Canada Solutions Ulc | Enhancements to game components in gaming systems |
US9754442B2 (en) | 2012-09-18 | 2017-09-05 | Igt Canada Solutions Ulc | 3D enhanced gaming machine with foreground and background game surfaces |
US9007365B2 (en) | 2012-11-27 | 2015-04-14 | Legend3D, Inc. | Line depth augmentation system and method for conversion of 2D images to 3D images |
US9547937B2 (en) | 2012-11-30 | 2017-01-17 | Legend3D, Inc. | Three-dimensional annotation system and method |
US9330431B2 (en) * | 2012-12-19 | 2016-05-03 | Jeffrey Huang | System and method for synchronizing, merging, and utilizing multiple data sets for augmented reality application |
US9373216B2 (en) | 2012-12-28 | 2016-06-21 | Igt Canada Solutions Ulc | 3D enhancements to game components in gaming systems with stacks of game components |
US9007404B2 (en) | 2013-03-15 | 2015-04-14 | Legend3D, Inc. | Tilt-based look around effect image enhancement method |
US9438878B2 (en) | 2013-05-01 | 2016-09-06 | Legend3D, Inc. | Method of converting 2D video to 3D video using 3D object models |
US9824524B2 (en) | 2014-05-30 | 2017-11-21 | Igt Canada Solutions Ulc | Three dimensional enhancements to game components in gaming systems |
US10347073B2 (en) | 2014-05-30 | 2019-07-09 | Igt Canada Solutions Ulc | Systems and methods for three dimensional games in gaming systems |
EP3284039A4 (en) | 2015-04-17 | 2019-07-24 | Tulip Interfaces Inc. | Containerized communications gateway |
US20150237327A1 (en) * | 2015-04-30 | 2015-08-20 | 3-D XRay Technologies, L.L.C. | Process for creating a three dimensional x-ray image using a single x-ray emitter |
US9609307B1 (en) | 2015-09-17 | 2017-03-28 | Legend3D, Inc. | Method of converting 2D video to 3D video using machine learning |
KR102459850B1 (en) * | 2015-12-03 | 2022-10-27 | 삼성전자주식회사 | Method and apparatus for processing 3-dimension image, and graphic processing unit |
KR102401168B1 (en) * | 2017-10-27 | 2022-05-24 | 삼성전자주식회사 | Method and apparatus for calibrating parameter of 3d display apparatus |
US20200168045A1 (en) | 2018-11-28 | 2020-05-28 | Igt | Dynamic game flow modification in electronic wagering games |
US20200288098A1 (en) | 2019-03-07 | 2020-09-10 | Alibaba Group Holding Limited | Method, apparatus, medium, terminal, and device for multi-angle free-perspective interaction |
US11415728B2 (en) | 2020-05-27 | 2022-08-16 | Looking Glass Factory, Inc. | System and method for holographic displays |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6765568B2 (en) * | 2000-06-12 | 2004-07-20 | Vrex, Inc. | Electronic stereoscopic media delivery system |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7038698B1 (en) | 1996-02-08 | 2006-05-02 | Palm Charles S | 3D stereo browser for the internet |
JP3441911B2 (en) * | 1997-02-20 | 2003-09-02 | キヤノン株式会社 | Information processing apparatus and method |
AUPO894497A0 (en) * | 1997-09-02 | 1997-09-25 | Xenotech Research Pty Ltd | Image processing method and apparatus |
GB2336963A (en) | 1998-05-02 | 1999-11-03 | Sharp Kk | Controller for three dimensional display and method of reducing crosstalk |
-
2001
- 2001-06-12 US US09/879,420 patent/US6765568B2/en not_active Expired - Fee Related
- 2001-06-12 WO PCT/US2001/018873 patent/WO2001097531A2/en active Application Filing
- 2001-06-12 AU AU2001266862A patent/AU2001266862A1/en not_active Abandoned
- 2001-06-28 TW TW090115815A patent/TW529297B/en not_active IP Right Cessation
-
2004
- 2004-07-09 US US10/888,946 patent/US20050078108A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6765568B2 (en) * | 2000-06-12 | 2004-07-20 | Vrex, Inc. | Electronic stereoscopic media delivery system |
Cited By (55)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020021832A1 (en) * | 2000-06-30 | 2002-02-21 | Dawson Mark Thomas | Method and apparatus for producing anaglyphic 3-D images |
US20060062490A1 (en) * | 2004-07-15 | 2006-03-23 | Samsung Electronics Co., Ltd. | Apparatus and method of transforming multidimensional video format |
US7724271B2 (en) * | 2004-07-15 | 2010-05-25 | Samsung Electronics Co., Ltd. | Apparatus and method of transforming multidimensional video format |
US20080266387A1 (en) * | 2005-12-20 | 2008-10-30 | Koninklijke Philips Electronics, N.V. | Autostereoscopic Display Device |
US8493440B2 (en) * | 2005-12-20 | 2013-07-23 | Koninklijke Philips N.V. | Autostereoscopic display device |
US8805791B2 (en) * | 2006-06-30 | 2014-08-12 | Leica Biosystems Imaging, Inc. | System and method for managing images over a network |
US20120011151A1 (en) * | 2006-06-30 | 2012-01-12 | Aperio Technologies, Inc. | System and Method for Managing Images Over a Network |
US9152654B2 (en) | 2006-06-30 | 2015-10-06 | Leica Biosystems Imaging, Inc. | System and method for managing images over a network |
US20090315977A1 (en) * | 2008-06-24 | 2009-12-24 | Samsung Electronics Co., Ltd. | Method and apparatus for processing three dimensional video data |
US8803944B2 (en) | 2008-10-16 | 2014-08-12 | Spatial Cam Llc | Controller in a camera for creating a registered video image |
US8355042B2 (en) * | 2008-10-16 | 2013-01-15 | Spatial Cam Llc | Controller in a camera for creating a panoramic image |
US20100097443A1 (en) * | 2008-10-16 | 2010-04-22 | Peter Lablans | Controller in a Camera for Creating a Panoramic Image |
US9531965B2 (en) | 2008-10-16 | 2016-12-27 | Spatial Cam Llc | Controller in a camera for creating a registered video image |
US20100142924A1 (en) * | 2008-11-18 | 2010-06-10 | Panasonic Corporation | Playback apparatus, playback method, and program for performing stereoscopic playback |
US8335425B2 (en) * | 2008-11-18 | 2012-12-18 | Panasonic Corporation | Playback apparatus, playback method, and program for performing stereoscopic playback |
US8558830B2 (en) * | 2008-12-18 | 2013-10-15 | 3D Fusion, Inc. | System and method for adaptive scalable dynamic conversion, quality and processing optimization, enhancement, correction, mastering, and other advantageous processing of three dimensional media content |
US20100156897A1 (en) * | 2008-12-18 | 2010-06-24 | 3D Fusion Inc. | System and Method For Adaptive Scalable Dynamic Conversion, Quality and Processing Optimization, Enhancement, Correction, Mastering, And Other Advantageous Processing of Three Dimensional Media Content |
WO2010096729A1 (en) * | 2009-02-19 | 2010-08-26 | Reald Inc. | Stereoscopic systems for anaglyph images |
US20100208044A1 (en) * | 2009-02-19 | 2010-08-19 | Real D | Stereoscopic systems for anaglyph images |
US20100214286A1 (en) * | 2009-02-25 | 2010-08-26 | 3D Fusion, Inc. | System and method for collaborative distributed generation, conversion, quality and processing optimization, enhancement, correction, mastering, and other advantageous processing of three dimensional media content |
CN102224733A (en) * | 2009-04-14 | 2011-10-19 | 华为技术有限公司 | System and method for processing video files |
US20100259690A1 (en) * | 2009-04-14 | 2010-10-14 | Futurewei Technologies, Inc. | System and Method for Processing Video Files |
US8948247B2 (en) * | 2009-04-14 | 2015-02-03 | Futurewei Technologies, Inc. | System and method for processing video files |
US10051275B2 (en) | 2009-08-03 | 2018-08-14 | Google Technology Holdings LLC | Methods and apparatus for encoding video content |
US9432723B2 (en) * | 2009-08-03 | 2016-08-30 | Google Technology Holdings LLC | Method of encoding video content |
US20110026608A1 (en) * | 2009-08-03 | 2011-02-03 | General Instrument Corporation | Method of encoding video content |
US9202669B2 (en) * | 2009-08-10 | 2015-12-01 | Hitachi High-Technologies Corporation | Charged particle beam device and image display method for stereoscopic observation and stereoscopic display |
US20120132803A1 (en) * | 2009-08-10 | 2012-05-31 | Hitachi High-Technologies Corporation | Charged particle beam device and image display method |
US20140001355A1 (en) * | 2009-08-10 | 2014-01-02 | Hitachi High-Technologies Corporation | Charged particle beam device and image display method |
CN102484025A (en) * | 2009-08-10 | 2012-05-30 | 株式会社日立高新技术 | Charged particle beam device and image display method |
US20110102559A1 (en) * | 2009-10-30 | 2011-05-05 | Kazuhiko Nakane | Video display control method and apparatus |
US9066076B2 (en) * | 2009-10-30 | 2015-06-23 | Mitsubishi Electric Corporation | Video display control method and apparatus |
US9654767B2 (en) | 2009-12-31 | 2017-05-16 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Programming architecture supporting mixed two and three dimensional displays |
US20110161843A1 (en) * | 2009-12-31 | 2011-06-30 | Broadcom Corporation | Internet browser and associated content definition supporting mixed two and three dimensional displays |
US20110221866A1 (en) * | 2010-01-14 | 2011-09-15 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US9696555B2 (en) | 2010-01-14 | 2017-07-04 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US8894486B2 (en) | 2010-01-14 | 2014-11-25 | Nintendo Co., Ltd. | Handheld information processing apparatus and handheld game apparatus |
US9128293B2 (en) * | 2010-01-14 | 2015-09-08 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
EP2365699B1 (en) * | 2010-03-11 | 2018-10-17 | Samsung Electronics Co., Ltd. | Method for adjusting 3D image quality, 3D display apparatus, 3D glasses, and system for providing 3D image |
US10764565B2 (en) | 2010-03-12 | 2020-09-01 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US10506218B2 (en) | 2010-03-12 | 2019-12-10 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US20120120063A1 (en) * | 2010-11-11 | 2012-05-17 | Sony Corporation | Image processing device, image processing method, and program |
US10275932B2 (en) | 2010-12-06 | 2019-04-30 | Dolby Laboratories Licensing Corporation | Methods and apparatus for image adjustment for displays having 2D and 3D display modes |
US20120169719A1 (en) * | 2010-12-31 | 2012-07-05 | Samsung Electronics Co., Ltd. | Method for compensating data, compensating apparatus for performing the method and display apparatus having the compensating apparatus |
US9888232B2 (en) * | 2011-01-17 | 2018-02-06 | Sony Corporation | 3D motion picture processing device |
US20120182387A1 (en) * | 2011-01-17 | 2012-07-19 | Sony Corporation | 3d motion picture processing device |
US9117385B2 (en) | 2011-02-09 | 2015-08-25 | Dolby Laboratories Licensing Corporation | Resolution management for multi-view display technologies |
US20140022244A1 (en) * | 2011-03-24 | 2014-01-23 | Fujifilm Corporation | Stereoscopic image processing device and stereoscopic image processing method |
US9053567B2 (en) * | 2011-03-24 | 2015-06-09 | Fujifilm Corporation | Stereoscopic image processing device and stereoscopic image processing method |
US20120293494A1 (en) * | 2011-05-18 | 2012-11-22 | Nintendo Co., Ltd. | Computer-readable storage medium having display control program stored therein, display control apparatus, display control system, and display control method |
TWI586143B (en) * | 2012-04-05 | 2017-06-01 | 皇家飛利浦電子股份有限公司 | Three dimensional [3d] source device, method and record carrier for providing 3d video signal fortransferring to 3d destination device, and 3d destination device for receiving 3d video signal from 3d source device |
US9584794B2 (en) | 2012-04-05 | 2017-02-28 | Koninklijke Philips N.V. | Depth helper data |
WO2014052270A1 (en) * | 2012-09-27 | 2014-04-03 | 3M Innovative Properties Company | Method to store and retrieve crosstalk profiles of 3d stereoscopic displays |
US20170188792A1 (en) * | 2014-03-17 | 2017-07-06 | Intuitive Surgical Operations, Inc | Systems and methods for control of imaging instruement orientation |
US10548459B2 (en) * | 2014-03-17 | 2020-02-04 | Intuitive Surgical Operations, Inc. | Systems and methods for control of imaging instrument orientation |
Also Published As
Publication number | Publication date |
---|---|
US20020122585A1 (en) | 2002-09-05 |
WO2001097531A3 (en) | 2002-03-28 |
WO2001097531A2 (en) | 2001-12-20 |
US6765568B2 (en) | 2004-07-20 |
AU2001266862A1 (en) | 2001-12-24 |
TW529297B (en) | 2003-04-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6765568B2 (en) | Electronic stereoscopic media delivery system | |
US9355455B2 (en) | Image data processing method and stereoscopic image display using the same | |
US9021399B2 (en) | Stereoscopic image reproduction device and method for providing 3D user interface | |
US8228327B2 (en) | Non-linear depth rendering of stereoscopic animated images | |
US6108005A (en) | Method for producing a synthesized stereoscopic image | |
EP2448276B1 (en) | GUI providing method, and display apparatus and 3D image providing system using the same | |
US8514275B2 (en) | Three-dimensional (3D) display method and system | |
US20060203085A1 (en) | There dimensional image signal producing circuit and three-dimensional image display apparatus | |
US20020191841A1 (en) | Image processing method and apparatus | |
US20100238274A1 (en) | Method of displaying three-dimensional image data and an apparatus of processing three-dimensional image data | |
Hill et al. | 3-D liquid crystal displays and their applications | |
JPH11164328A (en) | Stereoscopic video image display device | |
JP2012518317A (en) | Transfer of 3D observer metadata | |
WO2012005962A1 (en) | Method and apparatus for customizing 3-dimensional effects of stereo content | |
US20120140035A1 (en) | Image output method for a display device which outputs three-dimensional contents, and a display device employing the method | |
US8723920B1 (en) | Encoding process for multidimensional display | |
US9167237B2 (en) | Method and apparatus for providing 3-dimensional image | |
EP2387245A2 (en) | Three dimensional (3D) image display apparatus, and driving method thereof | |
CN102340678B (en) | Stereoscopic display device with adjustable field depth and field depth adjusting method | |
US20130050183A1 (en) | System and Method of Rendering Stereoscopic Images | |
Tam et al. | Depth image based rendering for multiview stereoscopic displays: Role of information at object boundaries | |
KR100823561B1 (en) | Display device for displaying two-three dimensional image | |
EP2547109A1 (en) | Automatic conversion in a 2D/3D compatible mode | |
KR20110037068A (en) | An apparatus for displaying stereoscopic image and a method for controlling video quality | |
KR101433082B1 (en) | Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |