US20030095177A1 - 3D stereoscopic/multiview video processing system and its method - Google Patents

3D stereoscopic/multiview video processing system and its method Download PDF

Info

Publication number
US20030095177A1
US20030095177A1 US10/317,861 US31786102A US2003095177A1 US 20030095177 A1 US20030095177 A1 US 20030095177A1 US 31786102 A US31786102 A US 31786102A US 2003095177 A1 US2003095177 A1 US 2003095177A1
Authority
US
United States
Prior art keywords
stream
dimensional
elementary
video
stereoscopic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/317,861
Other languages
English (en)
Inventor
Kug-Jin Yun
Suk-Hee Cho
Yunjung Choi
Jinhwan Lee
Young-Kwon Hahm
Chieteuk Ahn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Assigned to ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE reassignment ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AHN, CHIETEUK, CHO, SUK-HEE, CHOI, YUNJUNG, HAHM, YOUNG-KWON, LEE, JINHWAN, YUN, KUG-JIN
Publication of US20030095177A1 publication Critical patent/US20030095177A1/en
Priority to US10/648,169 priority Critical patent/US8111758B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/167—Synchronising or controlling image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189—Recording image signals; Reproducing recorded image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing

Definitions

  • the present invention relates to a three-dimensional (3D) video processing system and its method. More specifically, the present invention relates to an apparatus and method for processing stereoscopic/multiview three-dimensional video images based on MPEG-4 (Motion Picture Experts Group-4).
  • MPEG-4 Motion Picture Experts Group-4
  • MPEG is an information transmission method through video image compression and code representation and has been developed to the next-generation compression method, MPEG-7, subsequent to the current MPEG-1/2/4.
  • MPEG-4 i.e., the video streaming standard for freely storing multimedia data including video images in digital storage media on the Internet is now in common use and is applicable to a portable webcasting MPEG-4 player (PWMP), etc.
  • PWMP portable webcasting MPEG-4 player
  • MPEG-4 is the standard for general multimedia including still pictures, computer graphics (CG), audio coding of analytical composition systems, composite audio based on the musical instrument data interface (MIDI), and text, by adding compression coding of the existing video and audio signals.
  • media objects are coded and transferred in the form of an elementary stream (ES), which is characterized by variables determining a maximum transmission rate on the network, QoS (Quality of Service) factors, and necessary decoder resources.
  • ES elementary stream
  • QoS Quality of Service
  • the individual media object is composed of one elementary stream of a particular coding method and is streamed through a hierarchy structure, which comprises a compression layer, a sync layer, and a delivery layer.
  • the MPEG-4 system packetizes the data stream output from a plurality of encoders per access unit (AU) to process objects of different attributes and freely represents the data stream using the object descriptor information and the scene description information.
  • AU encoders per access unit
  • the existing MPEG-4 system standardizes only two-dimensional (hereinafter referred to as “2D”) multimedia data and therefore scarcely concerns the technology for processing stereoscopic/multiview 3D video data.
  • a stereoscopic/multiview three-dimensional video processing system which is to process video images based on MPEG-4, the system including: a compressor for processing input stereoscopic/multiview three-dimensional video data to generate field-based elementary streams of multiple channels, and outputting the multi-channel elementary streams into a single integrated elementary stream; a packetizer for receiving the elementary streams from the compressor per access unit and packetizing the received elementary streams; and a transmitter for processing the packetized stereoscopic/multiview three-dimensional video data and transferring or storing the processed video data.
  • the compressor includes: a three-dimensional object encoder for coding the input stereoscopic/multiview three-dimensional video data to output multi-channel field-based elementary streams; and a three-dimensional elementary stream mixer for integrating the multi-channel field-based elementary streams into a single elementary stream.
  • the three-dimensional object encoder outputs elementary streams in the unit of 4-channel fields including odd and even fields of a left image and odd and even fields of a right image, when the input data are three-dimensional stereoscopic video data.
  • the three-dimensional object encoder outputs N ⁇ 2 field-based elementary streams to the three-dimensional elementary stream mixer, when the input data are N-view multiview video data.
  • the three-dimensional elementary stream mixer generates a single elementary stream by selectively using a plurality of elementary streams input through multiple channels according to a display mode for stereoscopic/multiview three-dimensional video data selected by a user.
  • the display mode is any one mode selected from a two-dimensional video display mode, a three-dimensional video field shuttering display mode for displaying three-dimensional video images by field-based shuttering, a three-dimensional stereoscopic video frame shuttering display mode for displaying three-dimensional video images by frame-based shuttering, and a multiview three-dimensional video display mode for sequentially displaying images at a required frame rate.
  • the three-dimensional elementary stream mixer multiplexes 4-channel field-based elementary streams of stereoscopic three-dimensional video data output from the three-dimensional object encoder into a single-channel access unit stream using 2-channel elementary streams in the order of the odd field elementary stream of a left image and the even field elementary stream of a right image, when the display mode is the three-dimensional video field shuttering display mode.
  • the three-dimensional elementary stream mixer multiplexes 4-channel field-based elementary streams of stereoscopic three-dimensional video output from the three-dimensional object encoder into a single-channel access unit stream using 4-channel elementary streams in the order of the odd field elementary stream of a left image, the even field elementary stream of the left image, the odd field elementary stream of a right image, and the even field elementary stream of the right image, when the display mode is the three-dimensional video frame shuttering display mode.
  • the three-dimensional elementary stream mixer multiplexes 4-channel field-based elementary streams of stereoscopic three-dimensional video output from the three-dimensional object encoder into a single-channel access unit stream using 2-channel elementary streams in the order of the odd field elementary stream of a left image and the even field elementary stream of the left image, when the display mode is the two-dimensional video display mode.
  • the three-dimensional elementary stream mixer multiplexes N ⁇ 2 field-based elementary streams of N-view video output from the three-dimensional object encoder into a single-channel access unit stream sequentially using the individual viewpoints in the order of odd field elementary streams and even field elementary streams by viewpoints, when the display mode is the three-dimensional multiview video display mode.
  • the compressor When processing the elementary streams into a single-channel access unit stream and sending them to the packetizer, the compressor sends the individual elementary stream to the packetizer by adding at least one of image discrimination information representing whether the elementary stream is two- or three-dimensional video data, display discrimination information representing the display mode of the stereoscopic/multiview three-dimensional video selected by a user, and viewpoint information representing the number of viewpoints of a corresponding video image that is a multiview video image.
  • the packetizer receives a single-channel stream from the compressor per access unit, packetizes the received single-channel stream, and then constructs a packet header based on the additional information.
  • the packet header includes an access unit start flag representing which byte of a packet payload is the start of the stream, an access unit end flag representing which byte of the packet payload is the end of the stream, an image discrimination flag representing whether the elementary stream output from the compressor is two- or three-dimensional video data, a decoding time stamp flag, a composition time stamp flag, a viewpoint information flag representing the number of viewpoints of the video image, and a display discrimination flag representing the display mode.
  • a stereoscopic/multiview three-dimensional video processing method that includes: (a) receiving three-dimensional video data, determining whether a corresponding video image is a stereoscopic or multiview video image, and processing the corresponding video data according to the determination result to generate multi-channel field-based elementary streams; (b) multiplexing the multi-channel field-based elementary streams in a display mode selected by a user to output a single-channel elementary stream; (c) packetizing the single-channel elementary stream received; and (d) processing the packetized stereoscopic/multiview three-dimensional video image and sending or storing the processed video image.
  • the step (a) of generating the elementary streams includes: outputting elementary streams in the unit of 4-channel fields including odd and even fields of a left three-dimensional stereoscopic image and odd and even fields of a right three-dimensional stereoscopic image, when the input data are three-dimensional stereoscopic video data; and outputting N ⁇ 2 field-based elementary streams, when the input data are N-view multiview video data.
  • the multiplexing step (b) further includes multiplexing 4-channel field-based elementary streams of stereoscopic three-dimensional video into a single-channel access unit stream using 2-channel elementary streams in the order of the odd field elementary streams of a left image and the even field elementary streams of a right image, when the display mode is a three-dimensional video field shuttering display mode.
  • the multiplexing step (b) further includes multiplexing 4-channel field-based elementary streams of stereoscopic three-dimensional video into a single-channel access unit stream using 4-channel elementary streams in the order of the odd field elementary stream of a left image, the even field elementary stream of the left image, the odd field elementary stream of a right image and the even field elementary stream of the right image, when the display mode is a three-dimensional video frame shuttering display mode.
  • the multiplexing step (b) further includes multiplexing 4-channel field-based elementary streams of stereoscopic three-dimensional video into a single-channel access unit stream using 2-channel elementary streams in the order of the odd field elementary stream of a left image and the even field elementary stream of the left image, when the display mode is a two-dimensional video display mode.
  • the multiplexing step (b) further includes multiplexing N ⁇ 2 field-based elementary streams of N-view video into a single-channel access unit stream sequentially using the individual viewpoints in the order of odd field elementary streams and even field elementary streams by viewpoints, when the display mode is a three-dimensional multiview video display mode.
  • the multiplexing step (b) includes: processing multiview three-dimensional video images to generate multi-channel elementary streams and using time information acquired from an elementary stream of one channel among the multi-channel elementary streams to acquire synchronization with elementary streams of the other viewpoints, thereby acquiring synchronization among the three-dimensional video images.
  • FIG. 1 is a schematic of a stereoscopic/multiview 3D video processing system according to an embodiment of the present invention
  • FIG. 2 is an illustration of information transmitted by ESI for the conventional 2D multimedia
  • FIG. 3 is an illustration of input/output data of a stereoscopic 3D video encoder according to an embodiment of the present invention
  • FIG. 4 is an illustration of input/output data of a 3D N-view video encoder according to an embodiment of the present invention
  • FIG. 5 is an illustration of input/output data of a 3D ES mixer for stereoscopic video according to an embodiment of the present invention
  • FIG. 6 is an illustration of input/output data of a multi-view 3D ES mixer according to an embodiment of the present invention
  • FIG. 7 is a schematic of a field-based ES multiplexer for stereoscopic 3D video images for field shuttering display according to an embodiment of the present invention
  • FIG. 8 is a schematic of a field-based ES multiplexer for stereoscopic 3D video images for frame shuttering display according to an embodiment of the present invention
  • FIG. 9 is a schematic of a field-based ES multiplexer for stereoscopic 3D video images for 2D display according to an embodiment of the present invention.
  • FIG. 10 is a schematic of a field-based ES multiplexer for multiview 3D video images for 3D display according to an embodiment of the present invention
  • FIG. 11 is a schematic of a field-based ES multiplexer for multiview 3D video images for 2D display according to an embodiment of the present invention
  • FIG. 12 is an illustration of additional transfer information for the conventional ESI for processing stereoscopic/multiview 3D video images according to an embodiment of the present invention
  • FIG. 13 is a schematic of a sync packet header for processing stereoscopic/multiview 3D video images according to an embodiment of the present invention
  • FIG. 14 MPEG-4 is stream types defined by a system
  • FIG. 15 is a 3D video image stream type for processing a stereoscopic/multiview 3D video image by a decoder.
  • MPEG-4 stereoscopic/multiview 3D video data are processed.
  • the encoded field-based elementary streams output through multiple channels at the same time are integrated into a single-channel elementary stream according to the user's system environments and the user's selected display mode, and then multiplexed into a single 3D access unit stream (hereinafter referred to as “3D_AU stream”).
  • the streaming is enabled to support all the four display modes: a two-dimensional video display mode, a three-dimensional video field shuttering display mode for displaying three-dimensional video images by field-based shuttering, a three-dimensional stereoscopic video frame shuttering display mode for displaying three-dimensional video images by frame-based shuttering, and a multiview three-dimensional video display mode for sequentially displaying images at a required frame rate by using a lenticula lens or the like.
  • the embodiment of the present invention To enable the multiplexing of the stereoscopic/multiview 3D video images and the above-mentioned four display defined by the user, the embodiment of the present invention generates new header information of a sync packet header and constructs the header with the overlapping information minimized. Furthermore, the embodiment of the present invention simplifies synchronization among 3D video images by using the time information acquired from one-channel elementary streams among multi-channel elementary streams for multiview video images at the same time, to acquire synchronization with the elementary streams of the other viewpoints.
  • FIG. 1 is a schematic of a stereoscopic/multiview 3D video processing system (hereinafter referred to as “video processing system”) according to an embodiment of the present invention.
  • the video processing system which is to process stereoscopic/multiview 3D video data based on the MPEG-4 system, comprises, as shown in FIG. 1, a compression layer 10 supporting multiple encoders; a sync layer 20 receiving access unit (AU) data and generating packets suitable for synchronization; and a delivery layer 30 including a FlexMux 31 optionally given for simultaneous multiplexing of multiple streams, and a delivery multimedia integrated framework (DMIF) 32 for constructing interfaces to transport environments and storage media.
  • a compression layer 10 supporting multiple encoders
  • a sync layer 20 receiving access unit (AU) data and generating packets suitable for synchronization
  • a delivery layer 30 including a FlexMux 31 optionally given for simultaneous multiplexing of multiple streams, and a delivery multimedia integrated framework (DMIF) 32 for constructing interfaces to transport environments and storage media.
  • a FlexMux 31 optionally given for simultaneous multiplexing of multiple streams
  • DMIF delivery multimedia integrated framework
  • the compression layer 10 comprises various object encoders for still pictures, computer graphics (CG), audio coding of analytical composition systems, musical instrument data interface (MIDI), and text, as well as 2D video and audio.
  • CG computer graphics
  • MIDI musical instrument data interface
  • the compression layer 10 comprises, as shown in FIG. 1, a 3D object encoder 11 , a 2D object encoder 12 , a scene description stream generator 13 , a object descriptor stream generator 14 , and 3D elementary stream mixers (hereinafter referred to as “3D_ES mixers”) 15 and 16 .
  • 3D_ES mixers 3D elementary stream mixers
  • the 2D object encoder 12 encodes various objects including still pictures, computer graphics (CG), audio coding of analytical composition systems, musical instrument data interface (MIDI), and text, as well as 2D video and audio.
  • the elementary stream output from the individual encoders in the 2D object encoder 12 is output in the form of an AU stream and is transferred to the sync layer 20 .
  • the object descriptor stream generator 14 generates an object descriptor stream for representing the attributes of multiple objects, and the scene configuration information stream generator 13 generates a scene description stream for representing the temporal and spatial correlations among the objects.
  • the 3D object encoder 11 and the 3D_ES mixers 15 and 16 are to process stereoscopic/multiview 3D video images while maintaining compatibility with the existing MPEG-4 system.
  • the 3D object encoder 11 is an object-based encoder for stereoscopic/multiview 3D video data, and comprises a plurality of 3D real image encoders for processing images actually taken by cameras or the like, and a 3D computer graphic (CG) encoder for processing computer-generated images, i.e., CG.
  • CG computer graphic
  • the 3D object encoder 11 When the input data are stereoscopic 3D video images generated in different directions, the 3D object encoder 11 outputs elementary streams in the units of even and odd fields of left and right images, respectively. Contrarily, when the input data are N-view 3D video images, the 3D object encoder 11 outputs N ⁇ 2 field-based elementary streams to the 3D_ES mixers 15 and 16 .
  • the 3D_ES mixers 15 and 16 process the individual elementary streams output from the 3D object encoder 11 into a single 3D_AU stream, and send the single 3D_AU stream to the sync layer 20 .
  • the above-stated single 3D_AU stream output from the compression layer 10 is transferred to the sync layer via an elementary stream interface (ESI).
  • ESI is an interface connecting media data streams to the sync layer that is not prescribed by the ISO/IEC 14496-1 but is provided for easy realization, and accordingly, can be modified in case of need.
  • the ESI transfers SL packet header information.
  • An example of the SL packet header information transferred through the ESI in the existing MPEG-4 system is illustrated in FIG. 2.
  • the SL packet header information is used for the sync layer 20 generating an SL packet header.
  • the sync layer 20 comprises a plurality of object packetizers 21 for receiving the individual elementary stream output from the compression layer 10 per AU, dividing it into a plurality of SL packets to generate a payload of individual SL packets and to generate a header of each individual SL packet with reference to information received for every AU via the ESI, thereby completing SL packets composed of the header and the payload.
  • the SL packet header is used to check continuity in case of data loss and includes information related to a time stamp.
  • the packet stream output from the sync layer 20 is sent to the delivery layer 30 , and is processed into a stream suitable for interfaces to transport environments and storage media via the DIMF 32 after being multiplexed by the FlexMux 31 .
  • 2D images and multi-channel 3D images taken by at least two cameras, or computer-generated 3D images, i.e., CG, are fed into the 2D object encoder 12 and the 3D object encoder 11 of the compression layer 10 , respectively.
  • the multiplexing process for 2D images is well known to those skilled in the art and will not be described in detail.
  • the stereoscopic/multiview 3D video images that are real images taken by cameras are input to a 3D real image encoder 11 of the 3D object encoder 11 , and the CG as a computer-generated 3D stereoscopic/multiview video image is input to a 3D CG encoder 112 of the 3D object encoder 11 .
  • FIGS. 3 and 4 illustrate the operations of the plural 3D real image encoders and the 3D CG encoder, respectively.
  • the 3D real image encoder 111 or the 3D CG encoder 112 encodes left and right images or left and right CG data in the unit of fields to output elementary streams in the unit of 4-channel fields.
  • the stereoscopic 3D real image or CG is encoded into a stereoscopic 3D elementary stream of left odd fields 3DES_LO, a stereoscopic 3D elementary stream of left even fields 3DES_LE, a stereoscopic 3D elementary stream of right odd fields 3DES_RO, and a stereoscopic 3D elementary stream of right even fields 3DES_RE.
  • the 3D real image encoder 11 or the 3D CG encoder 112 encodes N-view image or CG data in the unit of fields to output odd field elementary streams of first to N-th viewpoints, and even field elementary streams of first to N-th viewpoints.
  • the N-view video is encoded into N ⁇ 2 elementary streams including an odd field elementary stream of the first viewpoint 3DES — #1 OddField, an odd field elementary stream of the second viewpoint 3DES — #2 OddField, . . . , an odd field elementary stream of the N-th viewpoint 3DES_#N OddField, an even field elementary stream of the first viewpoint 3DES — #1 EvenField, an even field elementary stream of the second viewpoint 3DES — #2 EvenField, . . . , and an even field elementary stream of the N-th viewpoint 3DES_#N EvenField.
  • the multi-channel field-based elementary streams output from the stereoscopic/multiview 3D object encoder 11 are input to the 3D_ES mixers 15 and 16 for multiplexing.
  • FIGS. 5 and 6 illustrate the multiplexing process of the 3D_ES mixers.
  • the 3D_ES mixers 15 and 16 multiplex the multi-channel field-based elementary streams into a 3D_AU stream to output a single-channel integrated stream.
  • the elementary stream data to be transferred are variable depending on the display mode. Accordingly, multiplexing is performed to transfer only the necessary elementary streams for the individual display mode.
  • a 2D video display mode There are four display modes: a 2D video display mode, a 3D video field shuttering display mode, a 3D video frame shuttering display mode, and a multiview 3D video display mode.
  • FIGS. 7 to 11 illustrate multiplexing examples for multi-channel field-based elementary streams depending on the display mode concerned.
  • FIGS. 7, 8, and 9 show multiplexing methods for stereoscopic 3D video data
  • FIGS. 10 and 11 show multiplexing method for multiview 3D video data.
  • the stereoscopic 3D elementary stream of left odd fields 3DES_LO and the stereoscopic 3D elementary stream of right even fields 3DES_RE among the 4-channel elementary streams output from the 3D object encoder 11 are sequentially integrated into a single-channel 3D_AU stream, as shown in FIG. 7.
  • the stereoscopic 3D elementary stream of left odd fields 3DES_LO, the stereoscopic 3D elementary stream of left even fields 3DES_LE, the stereoscopic 3D elementary stream of right odd fields 3DES_RO, and the stereoscopic 3D elementary stream of right even fields 3DES_RE among the 4-channel elementary streams are sequentially integrated into a single-channel 3D_AU stream, as shown in FIG. 8.
  • the stereoscopic 3D elementary stream of left odd fields 3DES_LO and the stereoscopic 3D elementary stream of left even fields 3DES_LE are sequentially integrated into a single-channel 3D_AU stream, as shown in FIG. 9.
  • the elementary streams are integrated into a single-channel 3D AU stream in the order of odd and even fields for every viewpoint and then in the order of viewpoints, as shown in FIG. 10.
  • the elementary streams of a multiview video image are integrated into a single-channel 3D_AU stream in the order of the odd field elementary stream of the first viewpoint 3DES — #1 OddField, the even field elementary stream of the first viewpoint 3DES — #1 EvenField, . . . , the odd field elementary stream of the N-th viewpoint 3DES_#N OddField, and the even field elementary stream of the N-th viewpoint 3DES_#N EvenField.
  • the single-channel 3D_AU stream output from the 3D_ES mixers 15 and 16 are fed into the sync layer 20 .
  • the single channel 3D_AU stream includes optional information for stereoscopic/multiview 3D video streaming according to the embodiment of the present invention.
  • FIG. 12 shows the syntax and semantics of the information added to the single 3D_AU stream for stereoscopic/multiview 3D video images, where only the optional information other than the information transferred via the ESI is illustrated.
  • three information sets such as a display discrimination flag 2D — 3DDispFlag, and a viewpoint information flag NumViewpoint are additionally given, as shown in FIG. 12.
  • the display discrimination flag 2D — 3DDispFlag represents the display mode for stereoscopic/multiview 3D video chosen by the user.
  • the display discrimination flag is, if not specifically limited to, “00” for the 2D video display mode, “01” for the 3D video field shuttering display mode, “10” for the 3D video frame shuttering display mode, and “11” for the multiview 3D video display mode.
  • the viewpoint information flag NumViewpoint represents the number of viewpoints for motion pictures. Namely, the viewpoint information flag is designated as “2” for stereoscopic 3D video data that are video images of two viewpoints, and as “N” for 3D N-view video data that are video images of N viewpoints.
  • the sync layer 20 receives the input elementary streams per AU, divides it into a plurality of SL packets to generate a payload of the individual SL packets and constructs a sync packet header based on the information transferred via the ESI for every AU, and the above-stated additional information for stereoscopic/multiview 3D video images (i.e., display discrimination flag, and viewpoint information flag).
  • FIG. 13 illustrates the structure of a sync packet header that is header information added to one 3D_AU stream for stereoscopic 3D video data according to an embodiment of the present invention.
  • an access unit start flag AccessUnitStartFlag represents which byte of the sync packet payload is the start of the 3D_AU stream.
  • the flag bit of “1” means that the first byte of the SL packet payload is the start of one 3D_AU stream.
  • An access unit end flag AccessUnitEndFlag represents which byte of the sync packet payload is the end of the 3D_AU stream. For example, the flag bit of “1” means that the last byte of the SL packet payload is the ending byte of the current 3D_AU stream.
  • An object clock reference (OCR) flag represents how many object clock references follow. For example, the flag bit of “1” means that one object clock reference follows.
  • An idle flag IdleFlag represents the output state of the 3D_AU stream.
  • the flag bit of “1” means that 3D_AU data are not output for a predetermined time
  • the flag bit of “0” means that 3D_AU data are output.
  • a padding flag PaddingFlag represents whether or not padding is present in the SL packet. For example, the flag bit of “1” means that padding is present in the SL packet.
  • the padding bit PaddingBits represents a padding mode to be used for the SL packet and has a default value of “0”.
  • a packet sequence number PacketSequenceNumber has a modulo value continuously increasing for the individual SL packet. Discontinuity in the decoder means a loss of at least one SL packet.
  • the object clock reference includes an OCR time stamp and exists in the SL packet header only when the OCR flag is set.
  • the flag bit of the access unit start flag AccessUnitStartFlag set to “1” represents that the first byte of the SL packet payload is the start of one 3D_AU, in which case information of the optional fields is transferred.
  • a random access point flag RandomAccessPointFlag having a flag bit set to “1” represents that random access to contents is enabled.
  • a 3D_AU sequence number 3D_AUSequenceNumber has a module value continuously increasing for the individual 3D_AU. Discontinuity in the decoder means a loss of at least one 3D_AU.
  • a decoding time stamp flag DecodingTimeStampFlag represents the presence of a decoding time stamp (DTS) in the SL packet.
  • a composition time stamp flag CompositionTimeStampFlag represents the presence of a composition time stamp (CTS) in the SL packet.
  • An instant bit rate flag InstantBitRateFlag represents the presence of an instant bit rate in the SL packet.
  • a decoding time stamp is a DTS present in the related SL configuration descriptor and exists only when the decoding time differs from the composition time for the 3D_AU.
  • a composition time stamp is a CTS present in the related SI configuration descriptor.
  • a 3D_AU length represents the byte length of the 3D_AU.
  • An instant bit rate represents the bit rate for the current 3D_AU, and is effective until the next instant bit rate field appears.
  • a degradation priority represents the priority of the SL packet payload.
  • a viewpoint information flag NumViewpoint represents the number of viewpoints of motion pictures. Namely, the viewpoint information flag is set to “2” for stereoscopic 3D video data that are motion pictures of two viewpoints; or the viewpoint information flag is set to “N” for 3D N-view video data.
  • a display discrimination flag 2D — 3DDispFlag represents the display mode for 3D video data in the same manner as the case of stereoscopic 3D video data.
  • the display discrimination flag is set to “00” for the 2D video display mode, “01” for the 3D video field shuttering display mode, “10” for the 3D video frame shuttering display mode and “11” for the multiview video display mode.
  • the sync layer 20 combines the header with the payload to generate an SL packet and sends the SL packet to the delivery layer 30 .
  • the SL packet stream transferred to the delivery layer 30 is processed into a stream suitable for an interface to transport environments via the DIMF 32 and sent to a receiver.
  • the SL packet stream is processed into a stream suitable for an interface to storage media and is stored in the storage media.
  • the receiver decodes the processed packet stream from the video processing system to reproduce the original image.
  • the 3D object decoder at the receiver detects the stream format type of the multiplexed 3D_AU so as to restore the 3D video data in the stream format type of each 3D-AU multiplexed.
  • the 3D object decoder performs decoding after detecting the stream format type of the 3D_AU based on the values stored in the viewpoint information flag NumViewpoint and the display discrimination flag 2D — 3DDispFlag among the information stored in the header of the packet received.
  • stereoscopic 3D video data are to be displayed in the 2D video display mode and the 3D_AU is multiplexed in the order of the 3D elementary stream of left odd fields 3DES_LO and the 3D elementary stream of left even fields 3DES_LE, as shown in FIG. 10.
  • the receiver checks the stream format type of the 3D_AU multiplexed in the packet stream based on the values stored in the viewpoint information flag NumViewpoint and the display discrimination flag 2D — 3DDispFlag of the header of the packet stream transferred from the video processing system according to the embodiment of the present invention, and then performs decoding to reproduce 3D video images.
  • FIG. 14 shows stream types defined by the DecoderConfigDescriptor of the MPEG-4 system
  • FIG. 15 shows a new stream type for determining whether an elementary stream of the stereoscopic 3D video image output from the compression layer is 2D or 3D video image data.
  • the present invention enables stereoscopic/multiview 3D video processing in the existing MPEG-4 system.
  • the multi-channel field-based elementary streams having the same temporal and spatial information are multiplexed into a single elementary stream, thereby minimizing the overlapping header information.
  • the present invention also simplifies synchronization among 3D video data by using the time information acquired from the one-channel elementary stream among the multi-channel elementary streams for multiview video data at the same time in synchronization with elementary streams of the other viewpoints.
  • the multiplexing structure and the header construction of the present invention enable the user to selectively display stereoscopic/multiview 3D video data in the 3D video field/frame shuttering display mode, the multiview 3D video display mode, or the 2D video display mode, while maintaining compatibility with the existing 2D video processing system.
  • the present invention can perform streaming of selected data suitable for the user's demand and system environments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Library & Information Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Systems (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
US10/317,861 2001-11-21 2002-11-20 3D stereoscopic/multiview video processing system and its method Abandoned US20030095177A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/648,169 US8111758B2 (en) 2001-11-21 2003-08-26 3D stereoscopic/multiview video processing system and its method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR2001-72603 2001-11-21
KR10-2001-0072603A KR100397511B1 (ko) 2001-11-21 2001-11-21 양안식/다시점 3차원 동영상 처리 시스템 및 그 방법

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/648,169 Continuation US8111758B2 (en) 2001-11-21 2003-08-26 3D stereoscopic/multiview video processing system and its method

Publications (1)

Publication Number Publication Date
US20030095177A1 true US20030095177A1 (en) 2003-05-22

Family

ID=19716151

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/317,861 Abandoned US20030095177A1 (en) 2001-11-21 2002-11-20 3D stereoscopic/multiview video processing system and its method
US10/648,169 Expired - Fee Related US8111758B2 (en) 2001-11-21 2003-08-26 3D stereoscopic/multiview video processing system and its method

Family Applications After (1)

Application Number Title Priority Date Filing Date
US10/648,169 Expired - Fee Related US8111758B2 (en) 2001-11-21 2003-08-26 3D stereoscopic/multiview video processing system and its method

Country Status (7)

Country Link
US (2) US20030095177A1 (ja)
EP (2) EP1457034A2 (ja)
JP (2) JP4425635B2 (ja)
KR (1) KR100397511B1 (ja)
CN (2) CN101188779B (ja)
AU (1) AU2002366143A1 (ja)
WO (1) WO2003045046A2 (ja)

Cited By (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040066846A1 (en) * 2002-10-07 2004-04-08 Kugjin Yun Data processing system for stereoscopic 3-dimensional video based on MPEG-4 and method thereof
US20050062846A1 (en) * 2001-12-28 2005-03-24 Yunjung Choi Stereoscopic video encoding/decoding apparatuses supporting multi-display modes and methods thereof
US20050084006A1 (en) * 2003-10-16 2005-04-21 Shawmin Lei System and method for three-dimensional video coding
US20050185676A1 (en) * 2004-01-27 2005-08-25 Lg Electronics Inc. Multi access unit transport packetization method of MPEG4 sync layer packet and multi access unit transport packet
US20050195157A1 (en) * 2004-03-03 2005-09-08 Gary Kramer System for delivering and enabling interactivity with images
US20050195216A1 (en) * 2004-03-03 2005-09-08 Gary Kramer System for delivering and enabling interactivity with images
US20050271303A1 (en) * 2004-02-10 2005-12-08 Todd Simpson System and method for managing stereoscopic viewing
EP1633148A1 (en) * 2003-05-30 2006-03-08 Sharp Kabushiki Kaisha Image receiving apparatus and image reproducing apparatus
US20060103664A1 (en) * 2002-08-27 2006-05-18 Sharp Kabushiki Kaisha Contents reproduction device capable of reproducing a contents in optimal reproduction mode
WO2006066454A1 (fr) * 2004-12-22 2006-06-29 Zte Corporation Procede de transmission des sources video multicanaux sur un systeme de visioconference
US20060221178A1 (en) * 2003-04-17 2006-10-05 Kug-Jin Yun System and method for internet broadcasting of mpeg-4-based stereoscopic video
US20070008575A1 (en) * 2005-06-14 2007-01-11 Samsung Electronics Co., Ltd. Transport stream structure including image data and apparatus and method for transmitting and receiving image data
EP1751979A1 (en) * 2004-05-21 2007-02-14 Electronics and Telecommunications Research Institute Apparatus and method for transmitting/receiving 3d stereoscopic digital broadcast signal by using 3d stereoscopic video additional data
US20070041442A1 (en) * 2004-02-27 2007-02-22 Novelo Manuel R G Stereoscopic three dimensional video image digital coding system and method
US20070041444A1 (en) * 2004-02-27 2007-02-22 Gutierrez Novelo Manuel R Stereoscopic 3D-video image digital decoding system and method
KR100697972B1 (ko) 2004-11-16 2007-03-23 한국전자통신연구원 입체 방송 서비스를 위한 디지털 방송 송신 장치 및 그 방법
US20070115276A1 (en) * 2003-12-09 2007-05-24 Kug-Jin Yun Apparatus and method for processing 3d video based on mpeg-4 object descriptor information
EP1868307A2 (en) * 2006-05-04 2007-12-19 LG Electronics, Inc. Transmitting and outputting content triggered by an event at the receiver
WO2008030011A1 (en) * 2006-09-04 2008-03-13 Enhanced Chip Technology Inc. File format for encoded stereoscopic image/video data
WO2008150111A1 (en) * 2007-06-07 2008-12-11 Enhanced Chip Technology Inc. Format for encoded stereoscopic image data file
US20080303813A1 (en) * 2007-06-08 2008-12-11 Do-Young Joung Method for recording three-dimensional video data and medium recording the same
WO2009002115A2 (en) * 2007-06-26 2008-12-31 Lg Electronics Inc. Media file format based on, method and apparatus for reproducing the same, and apparatus for generating the same
US20090003389A1 (en) * 2004-07-22 2009-01-01 Ye-Sun Joung Saf Synchronization Layer Packet Structure and Server System Therefor
WO2008156318A3 (en) * 2007-06-19 2009-02-05 Korea Electronics Telecomm Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
WO2009048216A1 (en) * 2007-10-10 2009-04-16 Electronics And Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
US20090122134A1 (en) * 2007-10-19 2009-05-14 Do-Young Joung Method of recording three-dimensional image data
WO2009078678A2 (en) * 2007-12-18 2009-06-25 Electronics And Telecommunications Research Institute Stereoscopic content service system and method
US20090317061A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Image generating method and apparatus and image processing method and apparatus
US20090317062A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Image processing method and apparatus
US20100110163A1 (en) * 2007-09-24 2010-05-06 Koninklijke Philips Electronics N.V. Method and system for encoding a video data signal, encoded video data signal, method and sytem for decoding a video data signal
US20100182403A1 (en) * 2006-09-04 2010-07-22 Enhanced Chip Technology Inc. File format for encoded stereoscopic image/video data
EP2211556A1 (en) * 2009-01-22 2010-07-28 Electronics and Telecommunications Research Institute Method for processing non-real time stereoscopic services in terrestrial digital multimedia broadcasting and apparatus for receiving terrestrial digital multimedia broadcasting
WO2010074378A3 (en) * 2008-12-22 2010-08-12 Electronics And Telecommunications Research Institute Method for transmitting data on stereoscopic image, method for playing back stereoscopic image, and method for creating file of stereoscopic image
CN101841720A (zh) * 2010-05-25 2010-09-22 东南大学 基于改进vls的立体视频编码方法
US20100266010A1 (en) * 2009-01-19 2010-10-21 Chong Soon Lim Coding method, decoding method, coding apparatus, decoding apparatus, program, and integrated circuit
US20100290483A1 (en) * 2009-04-30 2010-11-18 Samsung Electronics Co., Ltd. Apparatus and method for transmitting stereoscopic image data
EP2290997A1 (en) * 2009-04-15 2011-03-02 Sony Corporation Data structure, recording medium, reproducing device, reproducing method, and program
US20110064322A1 (en) * 2009-04-03 2011-03-17 Sony Corporation Image signal decoding apparatus, image signal decoding method, image signal encoding apparatus, image signal encoding method, and program
US20110099285A1 (en) * 2009-10-28 2011-04-28 Sony Corporation Stream receiving device, stream receiving method, stream transmission device, stream transmission method and computer program
US20110273542A1 (en) * 2009-01-28 2011-11-10 Jong Yeul Suh Broadcast receiver and video data processing method thereof
US20110310225A1 (en) * 2009-09-28 2011-12-22 Panasonic Corporation Three-dimensional image processing apparatus and method of controlling the same
US20120128321A1 (en) * 2007-10-19 2012-05-24 Bradley Thomas Collar Method and apparatus for generating stereoscopic images from a dvd disc
CN102486873A (zh) * 2010-12-01 2012-06-06 财团法人资讯工业策进会 数字三维对象处理装置和方法
US20120229612A1 (en) * 2011-03-08 2012-09-13 Sony Corporation Video transmission device and control method thereof, and video reception device and control method thereof
US20120300031A1 (en) * 2010-02-15 2012-11-29 Thomas Edward Horlander Apparatus and Method for Processing Video Content
CN102972024A (zh) * 2011-05-11 2013-03-13 松下电器产业株式会社 动态图像发送装置以及动态图像发送方法
EP2582142A2 (en) * 2010-06-09 2013-04-17 Samsung Electronics Co., Ltd Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same
US20130278720A1 (en) * 2008-12-18 2013-10-24 Jong-Yeul Suh Digital broadcasting reception method capable of displaying stereoscopic image, and digital broadcasting reception apparatus using same
EP2658267A1 (en) * 2011-12-13 2013-10-30 Sony Corporation Transmission device, transmission method, reception device, and reception method
RU2504916C2 (ru) * 2008-12-01 2014-01-20 Шарп Кабусики Кайся Устройство воспроизведения содержимого и носитель записи
US20140078249A1 (en) * 2012-09-20 2014-03-20 Qualcomm Incorporated Indication of frame-packed stereoscopic 3d video data for video coding
US20140347455A1 (en) * 2002-04-09 2014-11-27 Sensio Technologies Inc. Process and system for encoding and playback of stereoscopic video sequences
US20150172647A1 (en) * 2013-12-16 2015-06-18 Samsung Display Co., Ltd. Stereoscopic image display device and operating method thereof
EP2471270A4 (en) * 2009-10-20 2015-09-16 Samsung Electronics Co Ltd METHOD AND DEVICE FOR GENERATING A CURRENT AND METHOD AND DEVICE FOR PROCESSING A CURRENT
US20150281670A1 (en) * 2010-10-01 2015-10-01 Hitachi Maxell, Ltd. Reproducing Apparatus And Reproducing Method
EP2424257A4 (en) * 2009-04-24 2015-12-02 Lg Electronics Inc VIDEO DISPLAY DEVICE AND OPERATING METHOD THEREFOR
US9628769B2 (en) 2011-02-15 2017-04-18 Thomson Licensing Dtv Apparatus and method for generating a disparity map in a receiving device
US9693033B2 (en) 2011-11-11 2017-06-27 Saturn Licensing Llc Transmitting apparatus, transmitting method, receiving apparatus and receiving method for transmission and reception of image data for stereoscopic display using multiview configuration and container with predetermined format
EP2645725B1 (en) * 2011-11-11 2018-05-23 Saturn Licensing LLC Image data transmission device, image data transmission method, and image data receiving device
EP2353299B1 (en) * 2008-11-04 2018-09-12 Electronics and Telecommunications Research Institute Apparatus and method for synchronizing stereoscopic image, and apparatus and method for providing stereoscopic image based on the same
US11290745B2 (en) * 2015-12-14 2022-03-29 Panasonic Intellectual Property Corporation Of America Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device

Families Citing this family (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100475060B1 (ko) * 2002-08-07 2005-03-10 한국전자통신연구원 다시점 3차원 동영상에 대한 사용자 요구가 반영된 다중화장치 및 방법
KR100679740B1 (ko) * 2004-06-25 2007-02-07 학교법인연세대학교 시점 선택이 가능한 다시점 동영상 부호화/복호화 방법
JP4361435B2 (ja) * 2004-07-14 2009-11-11 株式会社エヌ・ティ・ティ・ドコモ 動画像復号方法、動画像復号プログラム、動画像復号装置、動画像符号化方法、動画像符号化プログラム及び動画像符号化装置
KR100940603B1 (ko) * 2004-07-22 2010-02-08 한국전자통신연구원 Ｓａｆ 동기화 계층 패킷 구조와 이를 제공하는 방법
KR100658222B1 (ko) * 2004-08-09 2006-12-15 한국전자통신연구원 3차원 디지털 멀티미디어 방송 시스템
US8204133B2 (en) * 2004-10-12 2012-06-19 Electronics And Telecommunications Research Institute Method and apparatus for encoding and decoding multi-view video using image stitching
KR100785012B1 (ko) * 2005-04-11 2007-12-12 삼성전자주식회사 3ｄ 압축 데이터 생성, 복원 방법 및 그 장치
CN101156319B (zh) * 2005-04-11 2012-05-30 三星电子株式会社 产生和恢复3d压缩数据的方法和设备
JP5431726B2 (ja) * 2005-06-23 2014-03-05 コーニンクレッカ フィリップス エヌ ヴェ 画像および関連データの組み合わされた交換
KR100657322B1 (ko) * 2005-07-02 2006-12-14 삼성전자주식회사 로컬 3차원 비디오를 구현하기 위한 인코딩/디코딩 방법 및장치
CN101253774B (zh) 2005-07-18 2011-04-06 韩国电子通信研究院 使用视角时间参考图像缓冲器的预测编码/解码装置及使用其的方法
US7903737B2 (en) * 2005-11-30 2011-03-08 Mitsubishi Electric Research Laboratories, Inc. Method and system for randomly accessing multiview videos with known prediction dependency
KR100747598B1 (ko) 2005-12-09 2007-08-08 한국전자통신연구원 디지털방송 기반의 3차원 입체영상 송수신 시스템 및 그방법
WO2007081176A1 (en) * 2006-01-12 2007-07-19 Lg Electronics Inc. Processing multiview video
KR101276847B1 (ko) 2006-01-12 2013-06-18 엘지전자 주식회사 다시점 비디오의 처리
US20070220171A1 (en) * 2006-03-17 2007-09-20 Sony Corporation Systems and methods for synchronization of asynchronous networks
EP2005752A4 (en) * 2006-03-30 2010-06-09 Lg Electronics Inc METHOD AND APPARATUS FOR DECODING / ENCODING A VIDEO SIGNAL
KR100780844B1 (ko) * 2006-04-28 2007-11-29 광주과학기술원 다시점 화상 복호화기, 다시점 화상 데이터 처리 시스템,다시점 화상 데이터 처리 방법 및 이를 수행하는프로그램을 기록한 기록매체
WO2007148906A1 (en) * 2006-06-19 2007-12-27 Lg Electronics, Inc. Method and apparatus for processing a vedeo signal
US20090279612A1 (en) * 2006-07-05 2009-11-12 Purvin Bibhas Pandit Methods and apparatus for multi-view video encoding and decoding
TWI344792B (en) 2006-07-12 2011-07-01 Lg Electronics Inc A method and apparatus for processing a signal
CN100415002C (zh) * 2006-08-11 2008-08-27 宁波大学 多模式多视点视频信号编码压缩方法
TWI375469B (en) * 2006-08-25 2012-10-21 Lg Electronics Inc A method and apparatus for decoding/encoding a video signal
EP3182708B1 (en) * 2007-01-04 2019-03-06 InterDigital Madison Patent Holdings Methods and apparatus for multi-view information conveyed in high level syntax
WO2008085909A2 (en) * 2007-01-04 2008-07-17 Thomson Licensing Methods and apparatus for video error correction in multi-view coded video
CN101578873B (zh) * 2007-01-04 2012-07-25 汤姆森特许公司 一种解码多视图视频内容的装置和方法
US20080252719A1 (en) * 2007-04-13 2008-10-16 Samsung Electronics Co., Ltd. Apparatus, method, and system for generating stereo-scopic image file based on media standards
US8749615B2 (en) * 2007-06-07 2014-06-10 Reald Inc. Demultiplexing for stereoplexed film and video applications
US8373744B2 (en) * 2007-06-07 2013-02-12 Reald Inc. Stereoplexing for video and film applications
US8487982B2 (en) 2007-06-07 2013-07-16 Reald Inc. Stereoplexing for film and video applications
KR101416228B1 (ko) * 2007-07-06 2014-07-08 삼성전자주식회사 2차원/3차원 영상 호환용 디스플레이 장치의 구동 장치 및그 구동방법
KR101362647B1 (ko) * 2007-09-07 2014-02-12 삼성전자주식회사 2ｄ 영상을 포함하는 3ｄ 입체영상 파일을 생성 및재생하기 위한 시스템 및 방법
US8218855B2 (en) 2007-10-04 2012-07-10 Samsung Electronics Co., Ltd. Method and apparatus for receiving multiview camera parameters for stereoscopic image, and method and apparatus for transmitting multiview camera parameters for stereoscopic image
KR101396350B1 (ko) * 2007-10-04 2014-05-20 삼성전자주식회사 다시점 영상 데이터스트림 생성 방법 및 장치와 다시점영상 데이터스트림 복호화 방법 및 장치
US8390674B2 (en) 2007-10-10 2013-03-05 Samsung Electronics Co., Ltd. Method and apparatus for reducing fatigue resulting from viewing three-dimensional image display, and method and apparatus for generating data stream of low visual fatigue three-dimensional image
WO2009075495A1 (en) * 2007-12-10 2009-06-18 Samsung Electronics Co., Ltd. System and method for generating and reproducing image file including 2d image and 3d stereoscopic image
CN101897195B (zh) * 2007-12-14 2013-03-06 皇家飞利浦电子股份有限公司 用于视频重放的3d模式选择机制
US8384764B2 (en) * 2007-12-20 2013-02-26 Samsung Electronics Co., Ltd. Method and apparatus for generating multiview image data stream and method and apparatus for decoding the same
KR101560182B1 (ko) * 2008-01-07 2015-10-15 삼성전자주식회사 다시점 비디오 부호화 방법과 그 장치 및 다시점 비디오 복호화 방법과 그 장치
KR101524465B1 (ko) 2008-01-10 2015-06-02 삼성전자주식회사 색차 보상을 이용한 다시점 비디오 부호화 방법과 그 장치 및 다시점 비디오 복호화 방법과 그 장치
US8878836B2 (en) * 2008-02-29 2014-11-04 Samsung Electronics Co., Ltd. Method and apparatus for encoding datastream including additional information on multiview image and method and apparatus for decoding datastream by using the same
US8811499B2 (en) * 2008-04-10 2014-08-19 Imagine Communications Corp. Video multiviewer system permitting scrolling of multiple video windows and related methods
KR101591085B1 (ko) * 2008-05-19 2016-02-02 삼성전자주식회사 영상 파일 생성 및 재생 장치 및 방법
US20110044664A1 (en) * 2008-06-18 2011-02-24 Maki Yukawa Three-dimensional video conversion recording device, three-dimensional video conversion recording method, recording medium, three-dimensional video conversion device, and three-dimensional video transmission device
WO2009157707A2 (en) * 2008-06-24 2009-12-30 Samsung Electronics Co,. Ltd. Image processing method and apparatus
JP5338166B2 (ja) 2008-07-16 2013-11-13 ソニー株式会社 送信装置、立体画像データ送信方法、受信装置および立体画像データ受信方法
KR20100040640A (ko) 2008-10-10 2010-04-20 엘지전자 주식회사 수신 시스템 및 데이터 처리 방법
KR101154051B1 (ko) * 2008-11-28 2012-06-08 한국전자통신연구원 다시점 영상 송수신 장치 및 그 방법
KR101090499B1 (ko) 2008-11-28 2011-12-07 한국전자통신연구원 멀티 앵글 디지털 방송 서비스 제공 방법
EP2357842A1 (en) * 2008-12-09 2011-08-17 Sony Corporation Image processing device and method
US9179125B2 (en) 2009-01-06 2015-11-03 Lg Electronics Inc. Method for processing three dimensional (3D) video signal and digital broadcast receiver for performing the method
US10742953B2 (en) * 2009-01-20 2020-08-11 Koninklijke Philips N.V. Transferring of three-dimensional image data
EP2399394B1 (en) * 2009-02-19 2020-09-30 InterDigital Madison Patent Holdings 3d video formats
JP2010244635A (ja) 2009-04-08 2010-10-28 Sony Corp 情報処理装置、情報処理方法、再生装置、再生方法、プログラム、および記録媒体
JP4962525B2 (ja) * 2009-04-08 2012-06-27 ソニー株式会社 再生装置、再生方法、およびプログラム
JP4993224B2 (ja) 2009-04-08 2012-08-08 ソニー株式会社 再生装置および再生方法
CN102415100B (zh) * 2009-04-27 2015-02-04 Lg电子株式会社 广播接收机及其3d视频数据处理方法
US8780999B2 (en) 2009-06-12 2014-07-15 Qualcomm Incorporated Assembling multiview video coding sub-BITSTREAMS in MPEG-2 systems
US8411746B2 (en) * 2009-06-12 2013-04-02 Qualcomm Incorporated Multiview video coding over MPEG-2 systems
JP5622484B2 (ja) * 2009-08-20 2014-11-12 富士フイルム株式会社 発色感光性組成物、平版印刷版原版及び新規シアニン色素
JP4763822B2 (ja) * 2009-09-30 2011-08-31 パナソニック株式会社 映像信号処理装置及び映像信号処理方法
US20110085024A1 (en) * 2009-10-13 2011-04-14 Sony Corporation, A Japanese Corporation 3d multiview display
KR101234495B1 (ko) * 2009-10-19 2013-02-18 한국전자통신연구원 화상회의 시스템을 위한 단말, 중계 노드 및 스트림 처리 방법
US20110110641A1 (en) * 2009-11-11 2011-05-12 Electronics And Telecommunications Research Institute Method for real-sense broadcasting service using device cooperation, production apparatus and play apparatus for real-sense broadcasting content thereof
JP2011119906A (ja) * 2009-12-02 2011-06-16 Sony Corp 画像処理装置および画像処理方法
EP2355510A1 (en) * 2009-12-21 2011-08-10 Alcatel Lucent Method and arrangement for video coding
KR101289269B1 (ko) * 2010-03-23 2013-07-24 한국전자통신연구원 영상 시스템에서 영상 디스플레이 장치 및 방법
JP2011216965A (ja) * 2010-03-31 2011-10-27 Sony Corp 情報処理装置、情報処理方法、再生装置、再生方法、およびプログラム
WO2011132882A2 (ko) 2010-04-19 2011-10-27 엘지전자 주식회사 인터넷 기반 컨텐츠 송수신 방법 및 그를 이용한 송수신 장치
KR101838071B1 (ko) * 2010-04-30 2018-03-13 엘지전자 주식회사 이미지 처리 방법 및 장치
EP2569942A1 (en) * 2010-05-11 2013-03-20 Telefonaktiebolaget LM Ericsson (publ) Video signal compression coding
US20110292038A1 (en) * 2010-05-27 2011-12-01 Sony Computer Entertainment America, LLC 3d video conversion
CN107911684B (zh) 2010-06-02 2020-06-23 麦克赛尔株式会社 接收装置和接收方法
JP5050079B2 (ja) * 2010-06-02 2012-10-17 日立コンシューマエレクトロニクス株式会社 デジタルコンテンツ受信装置およびデジタルコンテンツ受信方法
JP5710895B2 (ja) * 2010-06-02 2015-04-30 日立マクセル株式会社 デジタルコンテンツ受信装置およびデジタルコンテンツ受信方法
KR101303456B1 (ko) * 2010-06-22 2013-09-10 엘지디스플레이 주식회사 3차원 데이터 변조방법과 이를 이용한 액정표시장치
KR101645465B1 (ko) * 2010-07-23 2016-08-04 삼성전자주식회사 휴대용 단말기에서 입체 영상 데이터를 생성하기 위한 장치 및 방법
CN102340681A (zh) * 2010-07-26 2012-02-01 深圳市锐取软件技术有限公司 3d立体视频单文件双视频流录制方法
KR20130098184A (ko) * 2010-08-17 2013-09-04 엘지전자 주식회사 디지털 수신기 및 디지털 수신기에서의 컨텐트 처리 방법
CN105979240B (zh) * 2010-09-03 2018-06-05 索尼公司 编码装置和编码方法以及解码装置和解码方法
JP5454444B2 (ja) * 2010-10-01 2014-03-26 ソニー株式会社 立体画像データ送信装置、立体画像データ送信方法、立体画像データ受信装置および立体画像データ受信方法
KR101750047B1 (ko) 2010-10-11 2017-06-22 삼성전자주식회사 3차원 영상 제공 및 처리 방법과 3차원 영상 제공 및 처리 장치
US20120206568A1 (en) * 2011-02-10 2012-08-16 Google Inc. Computing device having multiple image capture devices and image modes
CN102137258B (zh) * 2011-03-22 2013-04-24 宁波大学 一种立体视频码率控制方法
JP2013024915A (ja) * 2011-07-15 2013-02-04 Yamaha Corp ドングル（ｄｏｎｇｌｅ）装置および再生システム
CN103891275B (zh) * 2011-08-31 2017-02-15 Lg电子株式会社 数字广播信号处理方法及设备
US20130094518A1 (en) * 2011-10-13 2013-04-18 Electronics And Telecommunications Research Institute Method for configuring and transmitting mmt payload
KR102003925B1 (ko) * 2011-11-23 2019-10-02 한국전자통신연구원 스케일러빌리티 및 뷰 정보를 제공하는 스트리밍 서비스를 위한 방법 및 장치
JP4993233B2 (ja) * 2012-01-26 2012-08-08 ソニー株式会社 記録方法
JP4993234B2 (ja) * 2012-01-26 2012-08-08 ソニー株式会社 再生装置、再生方法、および記録方法
US8325821B1 (en) * 2012-02-08 2012-12-04 Vyumix, Inc. Video transcoder stream multiplexing systems and methods
US9860515B2 (en) * 2012-12-11 2018-01-02 Electronics And Telecommunications Research Institute Apparatus and method for 3D content broadcasting with boundary information
US10120891B2 (en) * 2013-02-11 2018-11-06 International Business Machines Corporation Data placement optimization
KR101804364B1 (ko) * 2014-12-30 2017-12-04 한국전자통신연구원 초다시점 영상 시스템 및 이의 구동방법
JP6098678B2 (ja) * 2015-07-31 2017-03-22 ソニー株式会社 送信方法および送信装置
JP2022051967A (ja) * 2019-01-08 2022-04-04 ソニーグループ株式会社 情報処理装置および情報処理方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5263888A (en) * 1992-02-20 1993-11-23 Matsushita Electric Industrial Co., Ltd. Method of manufacture of liquid crystal display panel
US6553147B2 (en) * 1998-10-05 2003-04-22 Sarnoff Corporation Apparatus and method for data partitioning to improving error resilience
US6574423B1 (en) * 1996-02-28 2003-06-03 Matsushita Electric Industrial Co., Ltd. High-resolution optical disk for recording stereoscopic video, optical disk reproducing device, and optical disk recording device

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3081675B2 (ja) 1991-07-24 2000-08-28 オリンパス光学工業株式会社 画像記録装置および画像再生装置
US5724091A (en) * 1991-11-25 1998-03-03 Actv, Inc. Compressed digital data interactive program system
US6055012A (en) * 1995-12-29 2000-04-25 Lucent Technologies Inc. Digital multi-view video compression with complexity and compatibility constraints
KR100197833B1 (ko) * 1995-12-29 1999-06-15 윤종용 더블스캔 방식의 입체 tv
JPH09247119A (ja) * 1996-03-11 1997-09-19 Oki Electric Ind Co Ltd 多重化装置
JPH1023427A (ja) * 1996-07-04 1998-01-23 Matsushita Electric Ind Co Ltd 映像信号符号化及び復号化装置と映像信号伝送装置
JPH1091998A (ja) * 1996-09-13 1998-04-10 Nec Corp 開口制限付光ヘッド装置
US6057884A (en) 1997-06-05 2000-05-02 General Instrument Corporation Temporal and spatial scaleable coding for video object planes
JP3475081B2 (ja) * 1998-06-03 2003-12-08 三洋電機株式会社 立体映像再生方法
EP0986267A3 (de) 1998-09-07 2003-11-19 Robert Bosch Gmbh Verfahren zur Einbindung von audiovisueller codierter Information in einen vorgegebenen Übertragungsstandard sowie Endgeräte hierzu
JP2002527960A (ja) 1998-10-05 2002-08-27 サーノフ コーポレイション エラーレジリエンスを改善するためのデータ区分装置と方法
JP2000209580A (ja) 1999-01-13 2000-07-28 Canon Inc 画像処理装置およびその方法
US6674440B1 (en) * 1999-04-05 2004-01-06 3Dlabs, Inc., Inc. Ltd. Graphics processor for stereoscopically displaying a graphical image
JP2001078181A (ja) 1999-09-02 2001-03-23 Matsushita Electric Ind Co Ltd パケット伝送方法、パケット受信再生装置
JP4162348B2 (ja) * 2000-02-04 2008-10-08 株式会社東芝 メモリ混載画像処理用ｌｓｉおよび画像処理装置
EP1134702A3 (en) 2000-03-14 2003-10-29 Samsung Electronics Co., Ltd. Method for processing nodes in 3D scene and apparatus thereof
US7035453B2 (en) * 2000-03-24 2006-04-25 Reality Commerce Corporation Method and apparatus for parallel multi-view point video capturing and compression
JP3841630B2 (ja) * 2000-08-29 2006-11-01 オリンパス株式会社 画像取り扱い装置
US6760918B2 (en) * 2001-06-29 2004-07-06 Scientific-Atlanta, Inc. Method and apparatus for recordable media content distribution
JP3789794B2 (ja) 2001-09-26 2006-06-28 三洋電機株式会社 立体画像処理方法、装置、およびシステム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5263888A (en) * 1992-02-20 1993-11-23 Matsushita Electric Industrial Co., Ltd. Method of manufacture of liquid crystal display panel
US6574423B1 (en) * 1996-02-28 2003-06-03 Matsushita Electric Industrial Co., Ltd. High-resolution optical disk for recording stereoscopic video, optical disk reproducing device, and optical disk recording device
US6553147B2 (en) * 1998-10-05 2003-04-22 Sarnoff Corporation Apparatus and method for data partitioning to improving error resilience

Cited By (153)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050062846A1 (en) * 2001-12-28 2005-03-24 Yunjung Choi Stereoscopic video encoding/decoding apparatuses supporting multi-display modes and methods thereof
US11012680B2 (en) 2002-04-09 2021-05-18 3Dn, Llc Process and system for encoding and playback of stereoscopic video sequences
US10341643B2 (en) 2002-04-09 2019-07-02 3Dn, Llc Process and system for encoding and playback of stereoscopic video sequences
US9479755B2 (en) * 2002-04-09 2016-10-25 3Dn, Llc Process and system for encoding and playback of stereoscopic video sequences
US20140347455A1 (en) * 2002-04-09 2014-11-27 Sensio Technologies Inc. Process and system for encoding and playback of stereoscopic video sequences
US20060103664A1 (en) * 2002-08-27 2006-05-18 Sharp Kabushiki Kaisha Contents reproduction device capable of reproducing a contents in optimal reproduction mode
US20040066846A1 (en) * 2002-10-07 2004-04-08 Kugjin Yun Data processing system for stereoscopic 3-dimensional video based on MPEG-4 and method thereof
US7177357B2 (en) * 2002-10-07 2007-02-13 Electronics And Telecommunications Research Institute Data processing system for stereoscopic 3-dimensional video based on MPEG-4 and method thereof
US7782937B2 (en) * 2003-04-17 2010-08-24 Electronics And Telecommunications Research Institute System and method for internet broadcasting of MPEG-4-based stereoscopic video
US20060221178A1 (en) * 2003-04-17 2006-10-05 Kug-Jin Yun System and method for internet broadcasting of mpeg-4-based stereoscopic video
EP2453663A3 (en) * 2003-05-30 2013-10-02 Sharp Kabushiki Kaisha Video receiving apparatus and video reproducing apparatus
EP1633148A4 (en) * 2003-05-30 2009-10-21 Sharp Kk PICTURE RECEPTOR AND IMAGE PLAYER
US20060269226A1 (en) * 2003-05-30 2006-11-30 Motohiro Ito Image receiving apparatus and image reproducing apparatus
EP1633148A1 (en) * 2003-05-30 2006-03-08 Sharp Kabushiki Kaisha Image receiving apparatus and image reproducing apparatus
JP4628062B2 (ja) * 2003-10-16 2011-02-09 シャープ株式会社 三次元ビデオ符号化に関するシステム及び方法
US20050084006A1 (en) * 2003-10-16 2005-04-21 Shawmin Lei System and method for three-dimensional video coding
JP2005124200A (ja) * 2003-10-16 2005-05-12 Sharp Corp 三次元ビデオ符号化に関するシステム及び方法
US7650036B2 (en) * 2003-10-16 2010-01-19 Sharp Laboratories Of America, Inc. System and method for three-dimensional video coding
US20070115276A1 (en) * 2003-12-09 2007-05-24 Kug-Jin Yun Apparatus and method for processing 3d video based on mpeg-4 object descriptor information
US8023560B2 (en) 2003-12-09 2011-09-20 Electronics And Telecommunications Research Institute Apparatus and method for processing 3d video based on MPEG-4 object descriptor information
US20050185676A1 (en) * 2004-01-27 2005-08-25 Lg Electronics Inc. Multi access unit transport packetization method of MPEG4 sync layer packet and multi access unit transport packet
US7660472B2 (en) * 2004-02-10 2010-02-09 Headplay (Barbados) Inc. System and method for managing stereoscopic viewing
US20050271303A1 (en) * 2004-02-10 2005-12-08 Todd Simpson System and method for managing stereoscopic viewing
US9503742B2 (en) 2004-02-27 2016-11-22 Td Vision Corporation S.A. De C.V. System and method for decoding 3D stereoscopic digital video
US20100271463A1 (en) * 2004-02-27 2010-10-28 Td Vision Corporation S.A. De C.V. System and method for encoding 3d stereoscopic digital video
US20100271462A1 (en) * 2004-02-27 2010-10-28 Td Vision Corporation S.A. De C.V. System and method for decoding 3d stereoscopic digital video
US20070041444A1 (en) * 2004-02-27 2007-02-22 Gutierrez Novelo Manuel R Stereoscopic 3D-video image digital decoding system and method
US20070041442A1 (en) * 2004-02-27 2007-02-22 Novelo Manuel R G Stereoscopic three dimensional video image digital coding system and method
US9087413B2 (en) 2004-03-03 2015-07-21 Engram Networking Llc System for delivering and enabling interactivity with images
US8411109B2 (en) 2004-03-03 2013-04-02 Engram Networking Llc System for delivering and enabling interactivity with images
US7542050B2 (en) 2004-03-03 2009-06-02 Virtual Iris Studios, Inc. System for delivering and enabling interactivity with images
US20050195157A1 (en) * 2004-03-03 2005-09-08 Gary Kramer System for delivering and enabling interactivity with images
US7755643B2 (en) 2004-03-03 2010-07-13 Virtual Iris Studios, Inc. System for delivering and enabling interactivity with images
US20050195216A1 (en) * 2004-03-03 2005-09-08 Gary Kramer System for delivering and enabling interactivity with images
US7956872B2 (en) 2004-03-03 2011-06-07 Virtual Iris Studios, Inc. System for delivering and enabling interactivity with images
US7262783B2 (en) 2004-03-03 2007-08-28 Virtual Iris Studios, Inc. System for delivering and enabling interactivity with images
EP1751979A1 (en) * 2004-05-21 2007-02-14 Electronics and Telecommunications Research Institute Apparatus and method for transmitting/receiving 3d stereoscopic digital broadcast signal by using 3d stereoscopic video additional data
EP1751979A4 (en) * 2004-05-21 2009-12-23 Korea Electronics Telecomm DEVICE AND METHOD FOR TRANSMITTING / RECEIVING 3D STEREOSCOPIC DIGITAL BROADCASTING SIGNAL THROUGH ADDITIONAL 3D STEREOSCOPIC VIDEO DATA
US8472477B2 (en) * 2004-07-22 2013-06-25 Electronics And Telecommunications Research Institute SAF synchronization layer packet structure and server system therefor
US20090003389A1 (en) * 2004-07-22 2009-01-01 Ye-Sun Joung Saf Synchronization Layer Packet Structure and Server System Therefor
KR100697972B1 (ko) 2004-11-16 2007-03-23 한국전자통신연구원 입체 방송 서비스를 위한 디지털 방송 송신 장치 및 그 방법
WO2006066454A1 (fr) * 2004-12-22 2006-06-29 Zte Corporation Procede de transmission des sources video multicanaux sur un systeme de visioconference
EP1734766A3 (en) * 2005-06-14 2013-01-23 Samsung Electronics Co., Ltd. Transport stream structure including image data and apparatus and method for transmitting and receiving image data
US20070008575A1 (en) * 2005-06-14 2007-01-11 Samsung Electronics Co., Ltd. Transport stream structure including image data and apparatus and method for transmitting and receiving image data
EP1868307A2 (en) * 2006-05-04 2007-12-19 LG Electronics, Inc. Transmitting and outputting content triggered by an event at the receiver
US20080037683A1 (en) * 2006-05-04 2008-02-14 Han Seong Cheol Apparatus for transmitting and outputting content, a method for transmitting and outputting content and a data structure for transmitting content
EP1868307B1 (en) * 2006-05-04 2014-05-07 LG Electronics Inc. Transmitting and outputting content triggered by an event at the receiver
WO2008030011A1 (en) * 2006-09-04 2008-03-13 Enhanced Chip Technology Inc. File format for encoded stereoscopic image/video data
US20100182403A1 (en) * 2006-09-04 2010-07-22 Enhanced Chip Technology Inc. File format for encoded stereoscopic image/video data
WO2008150111A1 (en) * 2007-06-07 2008-12-11 Enhanced Chip Technology Inc. Format for encoded stereoscopic image data file
KR100962696B1 (ko) 2007-06-07 2010-06-11 주식회사 이시티 부호화된 스테레오스코픽 영상 데이터 파일의 구성방법
US20100171812A1 (en) * 2007-06-07 2010-07-08 Kyu Heon Kim Format for encoded stereoscopic image data file
US20080303813A1 (en) * 2007-06-08 2008-12-11 Do-Young Joung Method for recording three-dimensional video data and medium recording the same
US8786593B2 (en) * 2007-06-08 2014-07-22 Samsung Electronics Co., Ltd. Method for recording three-dimensional video data and medium recording the same
WO2008156318A3 (en) * 2007-06-19 2009-02-05 Korea Electronics Telecomm Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
EP2168384A4 (en) * 2007-06-19 2013-11-06 Korea Electronics Telecomm METADATA STRUCTURE FOR STORING AND REPRODUCING STEREOSCOPIC DATA, AND METHOD FOR STEREOSCOPIC CONTENT FILE STORAGE USING SUCH METADATA
EP2168384A2 (en) * 2007-06-19 2010-03-31 Electronics and Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
EP2757788B1 (en) * 2007-06-19 2020-03-11 Electronics and Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
US20100161686A1 (en) * 2007-06-19 2010-06-24 Electronic And Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
US8755672B2 (en) 2007-06-26 2014-06-17 Lg Electronics Inc. Media file format based on, method and apparatus for reproducing the same, and apparatus for generating the same
WO2009002115A3 (en) * 2007-06-26 2009-02-26 Lg Electronics Inc Media file format based on, method and apparatus for reproducing the same, and apparatus for generating the same
US20110002594A1 (en) * 2007-06-26 2011-01-06 Lg Electronics Inc. Media file format based on, method and apparatus for reproducing the same, and apparatus for generating the same
WO2009002115A2 (en) * 2007-06-26 2008-12-31 Lg Electronics Inc. Media file format based on, method and apparatus for reproducing the same, and apparatus for generating the same
US10904509B2 (en) 2007-09-24 2021-01-26 Koninklijke Philips N.V. Method and system for encoding a video data signal, encoded video data signal, method and system for decoding a video data signal
US11677924B2 (en) 2007-09-24 2023-06-13 Koninklijke Philips N.V. Method and system for encoding a video data signal, encoded video data signal, method and system for decoding a video data signal
US8854427B2 (en) * 2007-09-24 2014-10-07 Koninklijke Philips N.V. Method and system for encoding a video data signal, encoded video data signal, method and system for decoding a video data signal
CN104935956A (zh) * 2007-09-24 2015-09-23 皇家飞利浦电子股份有限公司 用于编码和解码3d视频信号的方法与系统
US20100110163A1 (en) * 2007-09-24 2010-05-06 Koninklijke Philips Electronics N.V. Method and system for encoding a video data signal, encoded video data signal, method and sytem for decoding a video data signal
KR101398168B1 (ko) * 2007-10-10 2014-05-22 한국전자통신연구원 스테레오스코픽 데이터의 저장 및 재생을 위한 메타데이터구조 및 이를 이용하는 스테레오스코픽 콘텐츠 파일의 저장방법
US8396906B2 (en) 2007-10-10 2013-03-12 Electronics And Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
WO2009048216A1 (en) * 2007-10-10 2009-04-16 Electronics And Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
US20100217785A1 (en) * 2007-10-10 2010-08-26 Electronics And Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
US20120128321A1 (en) * 2007-10-19 2012-05-24 Bradley Thomas Collar Method and apparatus for generating stereoscopic images from a dvd disc
US8922621B2 (en) * 2007-10-19 2014-12-30 Samsung Electronics Co., Ltd. Method of recording three-dimensional image data
WO2009051457A3 (en) * 2007-10-19 2009-06-04 Samsung Electronics Co Ltd Method of recording three-dimensional image data
US20090122134A1 (en) * 2007-10-19 2009-05-14 Do-Young Joung Method of recording three-dimensional image data
CN101868970B (zh) * 2007-10-19 2015-01-21 三星电子株式会社 记录三维图像数据的方法
WO2009078678A2 (en) * 2007-12-18 2009-06-25 Electronics And Telecommunications Research Institute Stereoscopic content service system and method
US8773504B2 (en) * 2007-12-18 2014-07-08 Electronics And Telecommunications Research Institute Stereoscopic content service system and method
US20120098928A1 (en) * 2007-12-18 2012-04-26 Electronics And Telecommunications Research Instit Stereoscopic content service system and method
WO2009078678A3 (en) * 2007-12-18 2009-09-03 Electronics And Telecommunications Research Institute Stereoscopic content service system and method
US20090317061A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Image generating method and apparatus and image processing method and apparatus
US20090315884A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Method and apparatus for outputting and displaying image data
US20090317062A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Image processing method and apparatus
US20090315977A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Method and apparatus for processing three dimensional video data
WO2009157668A3 (en) * 2008-06-24 2010-03-25 Samsung Electronics Co., Ltd. Method and apparatus for outputting and displaying image data
EP2353299B1 (en) * 2008-11-04 2018-09-12 Electronics and Telecommunications Research Institute Apparatus and method for synchronizing stereoscopic image, and apparatus and method for providing stereoscopic image based on the same
US8933987B2 (en) 2008-12-01 2015-01-13 Sharp Kabushiki Kaisha Content reproducing apparatus and recording medium for switching graphics and video images from 2D to 3D
RU2504916C2 (ru) * 2008-12-01 2014-01-20 Шарп Кабусики Кайся Устройство воспроизведения содержимого и носитель записи
US20130278720A1 (en) * 2008-12-18 2013-10-24 Jong-Yeul Suh Digital broadcasting reception method capable of displaying stereoscopic image, and digital broadcasting reception apparatus using same
US10015467B2 (en) * 2008-12-18 2018-07-03 Lg Electronics Inc. Digital broadcasting reception method capable of displaying stereoscopic image, and digital broadcasting reception apparatus using same
US20110254838A1 (en) * 2008-12-22 2011-10-20 Electronics And Telecommunications Research Institute Method for transmitting data on stereoscopic image, method for playing back stereoscopic image, and method for creating file of stereoscopic image
KR101176065B1 (ko) 2008-12-22 2012-08-24 한국전자통신연구원 스테레오스코픽 영상에 관한 데이터를 전송하는 방법, 스테레오스코픽 영상을 재생하는 방법, 및 스테레오스코픽 영상 데이터의 파일 생성 방법
WO2010074378A3 (en) * 2008-12-22 2010-08-12 Electronics And Telecommunications Research Institute Method for transmitting data on stereoscopic image, method for playing back stereoscopic image, and method for creating file of stereoscopic image
US8451890B2 (en) 2009-01-19 2013-05-28 Panasonic Corporation Coding method, decoding method, coding apparatus, decoding apparatus, program, and integrated circuit
US8553761B2 (en) 2009-01-19 2013-10-08 Panasonic Corporation Coding method, decoding method, coding apparatus, decoding apparatus, program, and integrated circuit
US20100266010A1 (en) * 2009-01-19 2010-10-21 Chong Soon Lim Coding method, decoding method, coding apparatus, decoding apparatus, program, and integrated circuit
US8548040B2 (en) 2009-01-19 2013-10-01 Panasonic Corporation Coding method, decoding method, coding apparatus, decoding apparatus, program, and integrated circuit
EP2389000A1 (en) * 2009-01-19 2011-11-23 Panasonic Corporation Encoding method, decoding method, encoding device, decoding device, program, and integrated circuit
EP2389000A4 (en) * 2009-01-19 2014-04-02 Panasonic Corp ENCLOSURE METHOD, DECOMPOSITION METHOD, ENCRYPTION DEVICE, DECOMPOSITION DEVICE, PROGRAM AND INTEGRATED CIRCUIT
EP2211556A1 (en) * 2009-01-22 2010-07-28 Electronics and Telecommunications Research Institute Method for processing non-real time stereoscopic services in terrestrial digital multimedia broadcasting and apparatus for receiving terrestrial digital multimedia broadcasting
US10341636B2 (en) 2009-01-28 2019-07-02 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
US20110273542A1 (en) * 2009-01-28 2011-11-10 Jong Yeul Suh Broadcast receiver and video data processing method thereof
US9769452B2 (en) 2009-01-28 2017-09-19 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
US9736452B2 (en) 2009-01-28 2017-08-15 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
US9013548B2 (en) * 2009-01-28 2015-04-21 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
US8947504B2 (en) * 2009-01-28 2015-02-03 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
US20110279646A1 (en) * 2009-01-28 2011-11-17 Jong Yeul Suh Broadcast receiver and video data processing method thereof
EP2416577A1 (en) * 2009-04-03 2012-02-08 Sony Corporation Image signal decoding device, image signal decoding method, image signal encoding device, image signal encoding method, and program
US8503804B2 (en) 2009-04-03 2013-08-06 Sony Corporation Image signal decoding apparatus and image signal decoding method
US9426480B2 (en) 2009-04-03 2016-08-23 Sony Corporation Image signal decoding apparatus and image signal decoding method
US8472731B2 (en) 2009-04-03 2013-06-25 Sony Corporation Image signal decoding apparatus, image signal decoding method, image signal encoding apparatus, image signal encoding method, and program
US9036930B2 (en) 2009-04-03 2015-05-19 Sony Corporation Image signal decoding apparatus and image signal decoding method
US8538181B2 (en) 2009-04-03 2013-09-17 Sony Corporation Image signal encoding apparatus and image signal encoding method
US20110064322A1 (en) * 2009-04-03 2011-03-17 Sony Corporation Image signal decoding apparatus, image signal decoding method, image signal encoding apparatus, image signal encoding method, and program
EP2416577A4 (en) * 2009-04-03 2013-02-27 Sony Corp IMAGE SIGNAL DECODING DEVICE, IMAGE SIGNAL DECODING METHOD, IMAGE SIGNAL ENCODING DEVICE, IMAGE SIGNAL ENCODING METHOD, AND PROGRAM
EP2290997A4 (en) * 2009-04-15 2014-10-01 Sony Corp DATA STRUCTURE, RECORDING MEDIA, PLAYING DEVICE, PLAY PROCESS AND PROGRAM
EP2706751A3 (en) * 2009-04-15 2014-10-08 Sony Corporation Data structure, recording medium, playing device and playing method, and program
EP2706750A3 (en) * 2009-04-15 2014-10-08 Sony Corporation Data structure, recording medium, playing device and playing method and program
AU2010237886B2 (en) * 2009-04-15 2015-06-11 Sony Corporation Data structure, recording medium, reproducing device, reproducing method, and program
EP2290997A1 (en) * 2009-04-15 2011-03-02 Sony Corporation Data structure, recording medium, reproducing device, reproducing method, and program
EP2424257A4 (en) * 2009-04-24 2015-12-02 Lg Electronics Inc VIDEO DISPLAY DEVICE AND OPERATING METHOD THEREFOR
US20100290483A1 (en) * 2009-04-30 2010-11-18 Samsung Electronics Co., Ltd. Apparatus and method for transmitting stereoscopic image data
US8861550B2 (en) * 2009-04-30 2014-10-14 Samsung Electronics Co., Ltd. Apparatus and method for transmitting stereoscopic image data
US20110310225A1 (en) * 2009-09-28 2011-12-22 Panasonic Corporation Three-dimensional image processing apparatus and method of controlling the same
US8836758B2 (en) * 2009-09-28 2014-09-16 Panasonic Corporation Three-dimensional image processing apparatus and method of controlling the same
EP2471270A4 (en) * 2009-10-20 2015-09-16 Samsung Electronics Co Ltd METHOD AND DEVICE FOR GENERATING A CURRENT AND METHOD AND DEVICE FOR PROCESSING A CURRENT
US8704873B2 (en) * 2009-10-28 2014-04-22 Sony Corporation Receiving stream data which may be used to implement both two-dimensional display and three-dimensional display
US20110099285A1 (en) * 2009-10-28 2011-04-28 Sony Corporation Stream receiving device, stream receiving method, stream transmission device, stream transmission method and computer program
US9077966B2 (en) * 2010-02-15 2015-07-07 Thomson Licensing Apparatus and method for processing video content
US9148646B2 (en) * 2010-02-15 2015-09-29 Thomson Licensing Apparatus and method for processing video content
US20150201177A1 (en) * 2010-02-15 2015-07-16 Thomson Licensing Apparatus and method for processing video content
US20120300031A1 (en) * 2010-02-15 2012-11-29 Thomas Edward Horlander Apparatus and Method for Processing Video Content
CN101841720A (zh) * 2010-05-25 2010-09-22 东南大学 基于改进vls的立体视频编码方法
CN101841720B (zh) * 2010-05-25 2011-08-10 东南大学 基于改进vls的立体视频编码方法
US9674502B2 (en) 2010-06-09 2017-06-06 Samsung Electronics Co., Ltd. Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same
EP2582142A4 (en) * 2010-06-09 2014-04-02 Samsung Electronics Co Ltd METHOD FOR PROVIDING FRAGMENT-BASED CONTINUOUS MEDIA TRANSMISSION SERVICE AND APPARATUS THEREOF, AND METHOD FOR RECEIVING FRAGMENT-BASED CONTINUOUS MEDIA TRANSMISSION SERVICE AND DEVICE THEREOF
EP2582142A2 (en) * 2010-06-09 2013-04-17 Samsung Electronics Co., Ltd Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same
US20150281670A1 (en) * 2010-10-01 2015-10-01 Hitachi Maxell, Ltd. Reproducing Apparatus And Reproducing Method
CN102486873A (zh) * 2010-12-01 2012-06-06 财团法人资讯工业策进会 数字三维对象处理装置和方法
US9628769B2 (en) 2011-02-15 2017-04-18 Thomson Licensing Dtv Apparatus and method for generating a disparity map in a receiving device
CN102685528A (zh) * 2011-03-08 2012-09-19 索尼公司 视频发送设备及其控制方法和视频接收设备及其控制方法
US20120229612A1 (en) * 2011-03-08 2012-09-13 Sony Corporation Video transmission device and control method thereof, and video reception device and control method thereof
CN102972024A (zh) * 2011-05-11 2013-03-13 松下电器产业株式会社 动态图像发送装置以及动态图像发送方法
US20130100248A1 (en) * 2011-05-11 2013-04-25 Shinya Kadono Video transmitting apparatus and video transmitting method
US9693033B2 (en) 2011-11-11 2017-06-27 Saturn Licensing Llc Transmitting apparatus, transmitting method, receiving apparatus and receiving method for transmission and reception of image data for stereoscopic display using multiview configuration and container with predetermined format
EP2645725B1 (en) * 2011-11-11 2018-05-23 Saturn Licensing LLC Image data transmission device, image data transmission method, and image data receiving device
EP2658267A1 (en) * 2011-12-13 2013-10-30 Sony Corporation Transmission device, transmission method, reception device, and reception method
EP2658267A4 (en) * 2011-12-13 2014-12-10 Sony Corp TRANSMITTING DEVICE, TRANSMITTING METHOD, RECEIVING DEVICE, AND RECEIVING METHOD
US20140078249A1 (en) * 2012-09-20 2014-03-20 Qualcomm Incorporated Indication of frame-packed stereoscopic 3d video data for video coding
US20150172647A1 (en) * 2013-12-16 2015-06-18 Samsung Display Co., Ltd. Stereoscopic image display device and operating method thereof
US9621881B2 (en) * 2013-12-16 2017-04-11 Samsung Display Co., Ltd. Stereoscopic image display device and operating method thereof
US11290745B2 (en) * 2015-12-14 2022-03-29 Panasonic Intellectual Property Corporation Of America Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device

Also Published As

Publication number Publication date
US20040120396A1 (en) 2004-06-24
CN101188779A (zh) 2008-05-28
EP1457034A2 (en) 2004-09-15
KR20030042090A (ko) 2003-05-28
US8111758B2 (en) 2012-02-07
WO2003045046A2 (en) 2003-05-30
JP2005510187A (ja) 2005-04-14
CN1613263A (zh) 2005-05-04
EP2306747A1 (en) 2011-04-06
JP2008306750A (ja) 2008-12-18
JP4425635B2 (ja) 2010-03-03
CN101188779B (zh) 2010-12-22
AU2002366143A8 (en) 2003-06-10
JP4417421B2 (ja) 2010-02-17
KR100397511B1 (ko) 2003-09-13
CN100428804C (zh) 2008-10-22
WO2003045046A3 (en) 2003-10-09
AU2002366143A1 (en) 2003-06-10

Similar Documents

Publication Publication Date Title
US8111758B2 (en) 3D stereoscopic/multiview video processing system and its method
KR100488804B1 (ko) Ｍｐｅｇ-4 기반의 양안식 3차원 동영상 데이터 처리시스템 및 그 방법
US7782937B2 (en) System and method for internet broadcasting of MPEG-4-based stereoscopic video
US8289998B2 (en) Method and apparatus for generating three (3)-dimensional image data stream, and method and apparatus for receiving three (3)-dimensional image data stream
US7136415B2 (en) Method and apparatus for multiplexing multi-view three-dimensional moving picture
JP4190357B2 (ja) 放送データ送信装置、放送データ送信方法および放送データ受信装置
KR100703715B1 (ko) 다시점 3차원 동영상 송수신 시스템
EP2543191B1 (en) Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content
KR20100086440A (ko) 지상파 디지털멀티미디어방송에서 비실시간 스테레오스코픽 서비스 수행 방법 및 지상파 디지털멀티미디어방송 수신 장치
WO2013089024A1 (ja) 送信装置、送信方法、受信装置および受信方法
KR20080051041A (ko) 전송 효율을 높이기 위한 다시점 파노라믹 콘텐츠 송/수신시스템 및 그 방법
WO2013069608A1 (ja) 送信装置、送信方法、受信装置および受信方法
WO2013054775A1 (ja) 送信装置、送信方法、受信装置および受信方法
JP5928118B2 (ja) 送信装置、送信方法、受信装置および受信方法
KR100913397B1 (ko) Ｄｍｂ기반의 3차원 입체영상 서비스를 위한 객체 기술방법과, 그에 따른 3차원 입체영상 서비스 수신 및 영상포맷 변환 방법
KR101591703B1 (ko) 3차원 영상 데이터스트림 생성 방법 및 그 장치와 3차원 영상 데이터스트림 수신 방법 및 그 장치

Legal Events

Date Code Title Description
AS Assignment

Owner name: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTIT

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YUN, KUG-JIN;CHO, SUK-HEE;CHOI, YUNJUNG;AND OTHERS;REEL/FRAME:013585/0592

Effective date: 20021104

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION