Connect public, paid and private patent data with Google Patents Public Datasets

System and method for three-dimensional video coding

Download PDF

Info

Publication number
US7650036B2
US7650036B2 US10817309 US81730904A US7650036B2 US 7650036 B2 US7650036 B2 US 7650036B2 US 10817309 US10817309 US 10817309 US 81730904 A US81730904 A US 81730904A US 7650036 B2 US7650036 B2 US 7650036B2
Authority
US
Grant status
Grant
Patent type
Prior art keywords
frame
field
video
image
bottom
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US10817309
Other versions
US20050084006A1 (en )
Inventor
Shawmin Lei
Shijun Sun
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Laboratories of America Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162User input
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164Feedback from the receiver or from the transmission channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Systems and methods are provided for receiving and encoding 3D video. The receiving method comprises: accepting a bitstream with a current video frame encoded with two interlaced fields, in a MPEG2, MPEG4, or H.264 standard; decoding a current frame top field; decoding a current frame bottom field; and, presenting the decoded top and bottom fields as a 3D frame image. In some aspects, the method presents the decoded top and bottom fields as a stereo-view image. In other aspects, the method accepts 2D selection commands in response to a trigger such as receiving a supplemental enhancement information (SEI) message, an analysis of display capabilities, manual selection, or receiver system configuration. Then, only one of the current frame interlaced fields is decoded, and a 2D frame image is presented.

Description

RELATED APPLICATIONS

This application claims the benefit of a provisional application entitled, SYSTEMS AND METHODS FOR STEREO VIDEO CODING, invented by Lei et al., Ser. No. 60,512,155, filed Oct. 16, 2003.

This application claims the benefit of a provisional application entitled, SYSTEMS AND METHODS FOR STEREO VIDEO CODING, invented by Lei et al., Ser. No. 60,519,482, filed Nov. 13, 2003.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention generally relates to video compression and, more particularly, to a system and method of encoding/decoding compressed video for three-dimensional and stereo viewing.

2. Description of the Related Art

Conventional video compression techniques typically handle three-dimensional (3D), or stereo-view video, in units of a frame. The most straightforward method is to code two views separately, as independent video sequences. This straightforward method, however, suffers from poor coding efficiency. It also has higher complexity because it needs to encode/decoder, multiplex/demultiplex, and synchronize two bitstreams. To reduce the complexity of bitstream handling, synchronized frames from each view can also be grouped together to form a composite frame, and then coded into one single bitstream. This composite-frame method still suffers from poor coding efficiency. It also loses a view-scalable functionality, i.e., decoder can choose to decode and display only one view.

Alternately, as noted in U.S. patent application 20020009137, one view can be coded into a base layer bitstream, and the other view into an enhancement layer. This layer approach not only has a better coding efficiency, but it also preserves the view-scalable functionality. However, this method still has higher complexity due to its needs to handle multiple bitstreams (base-layer and enhanced-layer bitstreams).

It would be advantageous if compressed 3D video could be communicated with greater efficiency.

It would be advantageous if only one view of a compressed 3D or stereo-view could be decoded to permit viewing on legacy 2D displays.

SUMMARY OF THE INVENTION

The present invention treats 3D video frames as interlaced materials. Therefore, a 3D view can be coded using existing interlace-coding methods, such as those in H.264, which enable better compression. Further, the invention supports a scalable coding (two-dimensional view) feature with minimal restrictions on the encoder side. The scalable decoding option can be signaled in a simple SEI message, for example.

Accordingly, a method is provided for receiving 3D video. The method comprises: accepting a bitstream with a current video frame encoded with two interlaced fields, in a Motion Pictures Expert Group-2 (MPEG2), MPEG4, or ITU-T H.264 standard; decoding a current frame top field; decoding a current frame bottom field; and, presenting the decoded top and bottom fields as a 3D frame image. In some aspects, the method presents the decoded top and bottom fields as a stereo-view image.

In some aspects, the method accepts 2D selection commands in response to a trigger such as receiving a supplemental enhancement information (SEI) message. Other triggers include an analysis of display capabilities, manual selection, or receiver system configuration. Then, only one of the current frame interlaced fields is decoded, and a 2D frame image is presented.

In one aspect of the method, a first encoded video frame is accepted prior to accepting the current frame. Then, the method: derives a predictive first frame top field; and, derives a predictive first frame bottom field. Then, the current frame top and bottom fields are decoded in response to the predictive first frame top field and predictive first frame bottom field, respectively.

Likewise, a method is providing for encoding 3D video, comprising: accepting a current 3D video image, including a first view of the image and a second, 3D, view of the image; encoding the first view as a frame top field; encoding the second view as the frame bottom field; and, transmitting a bitstream with a current video frame, having the top field interlaced with the bottom field, into a channel.

Additional details of the above-described methods, and 3D video encoder and receiver systems are provided below.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram of the present invention 3D video receiver system.

FIG. 2 is a schematic block diagram of the present invention 3D video encoding system.

FIG. 3 illustrates the present invention 3D view field interlacing process.

FIG. 4 is a graph illustrating a comparison of coding performance.

FIG. 5 is a flowchart illustrating the present invention method for receiving 3D video.

FIG. 6 is a flowchart illustrating the present invention method for encoding 3D video.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1 is a schematic block diagram of the present invention 3D video receiver system. The system 100 comprises a decoder 102 having an input connected to a channel on line 104 to accept a bitstream with a current video frame encoded with two interlaced fields. For example, line 104 may be connected to the Internet, a satellite receiver, or a digital cable network. The decoder 102 accepts the bitstream in a standard such as MPEG2, MPEG4, or ITU-T H.264. The decoder 102 has an output on line 106 to supply a decoded current frame top field and current frame bottom field. A display 108 has an input to accept the decoded fields on line 106. The display 108 visually presents the decoded top and bottom fields as a 3D frame image. For example, the display 108 can be a high-definition TV. In other aspects of the system, the display 108 visually presents the decoded top and bottom fields as a stereo-view image.

Generally, the display 108 may visually presents a two-dimensional (2D) image in response to using only one of the decoded current frame interlaced fields. Also, as a selected alternative to the presentation of the 3D image, the display 108 may present a 2D image in response to using only one of the decoded current frame interlaced fields. For example, a user may manually select to view a 2D image, even if a 3D image is available.

In other aspects, the decoder 102 may analyze the display capabilities and decode only one of the current frame interlaced fields, if non-3D display capabilities are detected. For example, the decoder may detect that display 108 is a legacy television. In this circumstance, the display 108 visually presents a two-dimensional (2D) image.

In some aspects, the decoder 102 receives a supplemental enhancement information (SEI) 3D content message with the current video frame. There are many types of conventional SEI messages. The 3D content SEI message is a message acts as a signal that the referenced frame(s) include 3D content organized as top and bottom fields in a frame. The 3D content SEI messages may trigger the decoder 102 to analyze display capabilities. This analysis may be a result of a query directed to display 108, or a result of accessing pre-configured information in memory concerning display capabilities. If non-3D display capabilities are detected, the decoder may elect to decode only one of the current frame interlaced fields in response to the 3D option SEI message. Since only one field is supplied by the decoder 102, the display 108 visually presents a two-dimensional (2D) image. Note, the decoder 102 may still provide both fields of a 3D view to a display 108, even if the display is not enabled to present a 3D image.

In some aspects, the decoder 102 includes a 2D decision unit 110 to supply 2D selection commands on line 112. The decoder 102 decodes only one of the current frame interlaced fields in response to the 2D selection commands. In response, the display 108 visually presents a 2D image. The decoder 2D decision unit 110 supplies 2D selection commands in response to a trigger such as receiving an SEI message on line 104. The trigger may be an analysis of display capabilities. For example, capabilities may be explored in communications with the display on line 106. In other aspects, the trigger may be responsive to a manual selection made by the user and received on line 114. In another aspect, the trigger can be responsive to the receiver system configuration stored in memory 116.

The organization of top and bottom fields as complementary 3D views is compatible with predictive encoding and decoding processes. With respect to MPEG standards, intra-coded frames (I-frames) are used to carry information that can be used as a foundation in a series of subsequent frames. With respect to H.264, the predictive frame is called an independent decoder refresh (IDR) picture. In some aspects, the decoder accepts a first encoded video frame prior to accepting the current frame. The decoder 102 derives a predictive first frame top field and a predictive first frame bottom field from the first frame. Then, the decoder 102 decodes the current frame top field in response to the predictive first frame top field. Likewise, the current frame bottom field is decoded in response to the predictive first frame bottom field.

Alternately, the decoder 102 derives a predictive first frame first field from the first frame. The first field may be either a top field or a bottom field. The decoder 102 decodes the current frame top field in response to the predictive first frame first field, and decodes the current frame bottom field in response to the predictive first frame first field.

FIG. 2 is a schematic block diagram of the present invention 3D video encoding system. The system 200 comprises an encoder 202 having an input on line 204 to accept a current 3D video image, including a first view of the image and a second, 3D, view of the image. In some aspects, the encoder 202 accepts a stereo image. The encoder 202 encodes the first view as a frame top field and encodes the second view as the frame bottom field. The encoder 202 has a channel-connected output on line 104 to supply a bitstream with a current video frame, having the top field interlaced with the bottom field. The encoder 202 transmits the bitstream in a standard such as MPEG2, MPEG4, or H.264.

In one aspect of the system, the encoder 202 transmits a 2D command responsive to a trigger such as an analysis of connected receiver capabilities or the channel bandwidth. The analysis of receiver capabilities may occur as a result of accessing a memory 212 holding a record of receiver capabilities. For example, record may show that a connected receiver, or group of receivers, lacks 3D display capability. The analysis of channel bandwidth may be made as a result of accessing the memory 212, or a result of receiving a real-time measurement of bandwidth. In some circumstances the bandwidth may be small enough that the transmission of both fields is impractical. For these, and potentially other reasons, the encoder 202 may elect to encode and transmit only one of the fields from the current view frame.

In another aspect, the encoder 202 may transmit an SEI 3D optional message, to signal 3D views available, to describe how 3D views are mapped into interlaced fields, and to describe dependency of each field.

In another aspect, the encoder 202 may transmit an SEI 3D option message with the current video frame, to trigger optional single field two-dimensional (2D) decoding. For example, if 2D receiver capabilities are discovered, the encoder 202 may transmit the SEI 3D option message, along with only one of fields.

Prior to accepting the current video image, the encoder 202 may accept a first video image, and encode a first image top field, as well as a first image bottom field. For example, the first image top and bottom fields may be used to form either an I-frame (MPEG) or an IDR picture (H.264). Then, the encoder 204 encodes the current frame top field in response to the first image top field, and encodes the current frame bottom field in response to the first frame bottom field.

Alternately, a single field can be used to generate subsequent top and bottom fields. That is, the encoder 204, prior to accepting the current image, may accept a first video image and encode a first image first field. The first image first field may be either a top or bottom field. Then, the encoder 204 encodes the current frame top field in response to the first image first field, and encodes the current frame bottom field in response to the first image first field.

Functional Description

FIG. 3 illustrates the present invention 3D view field interlacing process. Option 1 shows the left and right (stereo or 3D) views. Option 2 shows the views as a composite video frame.

Instead of treating stereo-view video frames as separate frames or a composite video frame, the present invention considers the sequence as interlaced materials. For example, as illustrated in option 3, the left view picture is the top field and the right view is the bottom field. It is straightforward to code the interlaced video frames using existing interlaced coding methods in different video coding standards, for example, but not limited to, MPEG2, MPEG4, and H.264. The use of these standards enables better compression and bitstream handling.

Using the interlaced coding methods of the above-mentioned video coding standards, a scalable decoding option can be supported with minimal restrictions on the encoder side. The scalable option means that at least one view (or field) can be decoded independently, without referring to bitstream of the other view (or field). This option permits decoder and encoder devices to be used with legacy devices that do not support 3D display functionality. To enable this scalable coding option, all pictures are coded in field-picture mode. At least one field (either top or bottom) is self-contained; and for a self-contained field, the corresponding field pictures can only use previously coded field pictures with the same parity as reference for motion compensation.

Here is a very brief summary of relevant H.264 coding tools. H.264 is the latest international video coding standard. Relative to prior video coding methods, some new inter-frame prediction options have been designed to enhance the prediction flexibility and accuracy. H.264 permits multiple reference pictures to be used for inter prediction. That is, more than one prior coded picture can be used as references for inter prediction. To allow for better handling of interlaced materials, H.264 permits a video frame to be coded as either a frame picture, or two field pictures. The choice between these two options is referred to as picture-level adaptive-frame-field (PAFF) coding. This idea can be extended to the macroblock level, to enable the option of Macroblock-level adaptive frame-field (MBAFF) coding.

FIG. 4 is a graph illustrating a comparison of coding performance. Experiments were conducted to evaluate the coding performance using the H.264 verification model JM7.3 software. The encoding parameters are: 5 reference frames, +/− 32 pixel motion search range, 15-frame group of pictures (GOP) with IPPP (an Intra-frame followed by 14 P pictures), RD-optimization (a JM software encoding option), CAVLC (context adaptive variable length coding—an entropy option in the H.264 standard), and a fixed quantization parameter (QP) of 28/32/36. A 300-frame stereo sequence was coded in the following three settings:

    • 1. Full frame coding (as option 2 in FIG. 3);
    • 2. PAFF coding (as option 3 in FIG. 3, with no restriction on reference pictures); and
    • 3. Scalable field coding (as option 3 in FIG. 3, with restriction on reference pictures).

The coding performances are shown in FIG. 4. The scalable field coding (setting #3) and PAFF coding (setting #3) essentially overlap. Both setting #2 and setting #3 have much better coding performance than setting #1. The difference is roughly 0.8 dB at relatively high quality side. The higher the peak signal-to-noise ratio (PSNR) values, the better the coding performance. So, for example, setting #2 is better than setting #1 (by 0.8 dB at the high bitrate side). Compared to setting #2, setting #3 has very little overhead, less than 0.1 dB.

FIG. 5 is a flowchart illustrating the present invention method for receiving 3D video. Although the method is depicted as a sequence of numbered steps for clarity, no order should be inferred from the numbering unless explicitly stated. It should be understood that some of these steps may be skipped, performed in parallel, or performed without the requirement of maintaining a strict order of sequence. The method starts at Step 500.

Step 502 accepts a bitstream with a current video frame encoded with two interlaced fields. For example, the bitstream is a standard such as MPEG2, MPEG4, or H.264. Step 504 decodes a current frame top field. Step 506 decodes a current frame bottom field. Step 508 presents the decoded top and bottom fields as a 3D frame image. In some aspects, Step 508 presents the decoded top and bottom fields as a stereo-view image. In one aspect of the method, Step 503 accepts a 2D selection command. For example, the 2D selection command may be accepted in response to a trigger such as a supplemental enhancement information (SEI) message, an analysis of display capabilities, manual selection, or receiver system configuration. Then, only one of the current frame interlaced fields is used in response to the 2D selection commands. That is, either Step 504 or Step 506 is preformed. As shown, Step 504 is performed (Step 506 is bypassed). Step 510 presents a 2D frame image. Alternately, both fields may be decoded but a 2D frame image is presented in Step 510 in response to using only one of the decoded current frame interlaced fields. In one aspect of the method, simultaneous with the presentation of the 3D image (Step 508), Step 510 presents a 2D image in response to using one of the decoded current frame interlaced fields. The simultaneous presentation of 2D and 3D images may represent that either the 2D or 3D view may be selected.

In another aspect of the method, Step 503 is organized into substeps, not shown. Step 503 a receives a (SEI) 3D content message with the current video frame. Step 503 b analyzes display capabilities. If non-3D display capabilities are detected, only one of the current frame interlaced fields is decoded. That is, either Step 504 or Step 506 is performed. Then, Step 510 presents a 2D frame image.

In another aspect, Step 503 accepts an SEI 3D optional message, to signal 3D views available, to describe how 3D views are mapped into interlaced fields, and to describe the dependency of each field. In another aspect, Step 501 a accepts a first encoded video frame prior to accepting the current frame. Step 501 b derives a predictive first frame top field. Step 501 c derives a predictive first frame bottom field. Then, decoding the current frame top field (Step 504) includes decoding the current frame top field in response to the predictive first frame top field. Likewise, decoding a current frame bottom field (Step 506) includes decoding the current frame bottom field in response to the predictive first frame bottom field.

Alternately, but not shown, Step 501 b derives a predictive first frame first field, either a top field or a bottom field. In this aspect Step 501 c is bypassed. Then, Step 504 decodes the current frame top field in response to the predictive first frame first field. Step 506 decodes the current frame bottom field in response to the predictive first frame first field.

FIG. 6 is a flowchart illustrating the present invention method for encoding 3D video. The method starts at Step 600. Step 602 accepts a current 3D video image, including a first view of the image and a second, 3D, view of the image. In one aspect, Step 602 accepts a first and second view of a stereo image. Step 604 encodes the first view as a frame top field. Step 606 encodes the second view as the frame bottom field. Step 608 transmits a bitstream with a current video frame, having the top field interlaced with the bottom field, into a channel. For example, Step 608 transmits the bitstream in a standard such as MPEG2, MPEG4, or ITU-T H.264.

In one aspect, Step 607 accepts a 2D command responsive to a trigger such as an analysis of receiver capabilities or the channel bandwidth. Then, Step 610 transmits the 2D command to a receiver. In one aspect, Step 610 transmits a supplemental enhancement information (SEI) 3D option message with the current video frame to trigger optional single field two-dimensional (2D) decoding. In another aspect, Step 612 transmits only one of the fields from the current view frame, if the 2D command is transmitted in Step 610.

In one aspect, Step 601 a accepts a first video image prior to accepting the current video image. Step 601 b encodes a first image top field. Step 601 c encodes a first image bottom field. For example, an I-frame may be encoded for MPEG standard transmissions. Then, Step 604 encodes the current frame top field in response to the first image top field, and Step 606 encodes the current frame bottom field in response to the first frame bottom field.

Alternately, Step 601 b encodes a first image first field, either a top field or a bottom field, and Step 601 c is bypassed. Then, Step 604 encodes the current frame top field in response to the first image first field, and Step 606 encodes the current frame bottom field in response to the first image first field.

Systems and methods for 3D encoding and decoding have been provided. Examples have been given as to how the processes may be scaled for 2D applications. Examples have also been given for how the processes may be enabled with predictive coding. However, the present invention is not limited to merely these examples. Other variations and embodiments of the invention will occur to those skilled in the art.

Claims (35)

1. A method for receiving three-dimensional (3D) video in a receiver system, the method comprising:
in a receiver decoder:
accepting an electromagnetic waveform representing a bitstream with two interlaced fields, both encoded in a single first video frame, with a supplemental enhancement information (SEI) 3D content message;
analyzing display capabilities in response to being triggered by the SEI 3D content message;
if 3D display abilities are detected, decoding a first frame top field from the first video frame and decoding a first frame bottom field from the first video frame;
if non-3D display capabilities are detected, decoding only one of the first video frame interlaced fields; and,
a display presenting an electromagnetic waveform representing the decoded top and bottom fields as a 3D frame image if 3D capable, and presenting a two-dimensional (2D) frame image if non-3D capable.
2. The method of claim 1 wherein accepting a bitstream with first video frame encoded with two interlaced fields includes accepting the bitstream in a standard selected from the group including Motion Pictures Expert Group-2 (MPEG2), MPEG4, and ITU-T H.264 standards.
3. The method of claim 1 wherein presenting the decoded top and bottom fields as a 3D frame image includes presenting the decoded top and bottom fields as a stereo-view image.
4. The method of claim 1 further comprising:
prior to accepting the first video frame, accepting a first encoded video frame;
deriving a predictive first frame top field;
deriving a predictive first frame bottom field;
wherein decoding the first video frame top field includes decoding the first video frame top field in response to the predictive first frame top field; and,
wherein decoding the first video frame bottom field includes decoding the first video frame bottom field in response to the predictive first frame bottom field.
5. The method of claim 1 further comprising:
prior to accepting the first video frame, accepting a first encoded video frame;
deriving a predictive first frame first field;
wherein decoding the first video frame top field includes decoding the first video frame top field in response to the predictive first frame first field; and,
wherein decoding the first video frame bottom field includes decoding the first video frame bottom field in response to the predictive first frame first field.
6. The method of claim 5 wherein deriving a predictive first frame first field includes deriving a predictive first frame top field.
7. The method of claim 5 wherein deriving a predictive first frame first field includes deriving a predictive first frame bottom field.
8. The method of claim 1 further comprising:
simultaneous with the presentation of the 3D image, presenting a 2D image in response to using one of the decoded first frame interlaced fields.
9. A method for encoding three-dimensional (3D) video in a transmitter system, the method comprising:
in a transmitter encoder:
accepting an electromagnetic waveform representing a 3D video image, including a first view of the image and a second view of the image;
encoding the first view as a top field in a single first video frame;
encoding the second view as a bottom field in the first video frame; and,
transmitting an electromagnetic waveform into a channel representing a first video frame bitstream having the top field interlaced with the bottom field in the single first video frame, and a supplemental enhancement information (SEI) 3D option message with the first video frame to trigger decoding selected from a group consisting of single field two-dimensional (2D) decoding, and top and bottom field 3D decoding in a receiver decoder, depending on receiver capabilities.
10. The method of claim 9 wherein transmitting the first video frame bitstream having the top field interlaced with the bottom field includes transmitting the bitstream in a standard selected from the group including Motion Pictures Expert Group-2 (MPEG2), MPEG4, and ITU-T H.264 standards.
11. The method of claim 9 wherein accepting a current 3D video image, including a first view of the image and a second, 3D, view of the image includes accepting a first and second view of a stereo image.
12. The method of claim 9 further comprising:
accepting a 2D command responsive to a trigger selected from the group including an analysis of receiver capabilities and the channel bandwidth; and,
transmitting the 2D command to a receiver.
13. The method of claim 12 further comprising:
transmitting only one of the fields from the first video view frame.
14. The method of claim 9 further comprising: tuviste
prior to accepting the current video image, accepting a first video image;
encoding a first image top field;
encoding a first image bottom field;
wherein encoding the current frame top field includes encoding the current frame top field in response to the first image top field; and,
wherein encoding the current frame bottom field includes encoding the first video frame bottom field in response to the first frame bottom field.
15. The method of claim 9 further comprising:
prior to accepting the current image, accepting a first video image;
encoding a first image first field;
wherein encoding the current frame top field includes encoding the current frame top field in response to the first image first field; and,
wherein encoding the current frame bottom field includes encoding the current frame bottom field in response to the first image first field.
16. The method of claim 15 wherein encoding a first image first field includes encoding a first image top field.
17. The method of claim 15 wherein encoding a first image first field includes encoding a first image bottom field.
18. A three-dimensional (3D) video receiver system, the system comprising:
a decoder having an input connected to a channel to accept a bitstream with a single first video frame encoded with two interlaced fields and an output to supply a top field and a bottom field, both decoded from the first video frame; and,
a display having an input to accept the decoded fields, the display visually presenting the decoded top and bottom fields as a 3D frame image;
wherein the decoder receives a supplemental enhancement information (SEI) 3D content message with the first video frame, analyzes display capabilities, and, if non-3D display capabilities are detected, decodes only one of the first frame interlaced fields in response to the 3D option SEI message; and,
wherein the display visually presents a two-dimensional (2D) image.
19. The system of claim 18 wherein the decoder accepts the bitstream in a standard selected from the group including Motion Pictures Expert Group-2 (MPEG2), MPEG4, and ITU-T H.264 standards.
20. The system of claim 18 wherein the display visually presents the decoded top and bottom fields as a stereo-view image.
21. The system of claim 18 wherein the decoder, prior to accepting the current frame, accepts a first encoded video frame, derives a predictive first frame top field, derives a predictive first frame bottom field, decodes the current frame top field in response to the predictive first frame top field, and decodes the current frame bottom field in response to the predictive first frame bottom field.
22. The system of claim 18 wherein the decoder, prior to accepting the first video frame, accepts a first encoded video frame, derives a predictive first frame first field, decodes the first video frame top field in response to the predictive first frame first field, and decodes the first video frame bottom field in response to the predictive first frame first field.
23. The system of claim 22 wherein the decoder derives a predictive first frame top field.
24. The system of claim 22 wherein the decoder derives a predictive first frame bottom field.
25. The system of claim 18 wherein the display, as a selected alternative to the presentation of the 3D image, presents a 2D image in response to using only one of the decoded first video frame interlaced fields.
26. A three-dimensional (3D) video encoding system, the system comprising:
an encoder having an input to accept a current 3D video image, including a first view of the image and a second, 3D, view of the image, the encoder encoding the first view as a frame top field and the second view as the frame bottom field, interlaced in a single first video frame, and the encoder having a channel-connected output to supply a first video frame bitstream; and,
wherein the encoder transmits a supplemental enhancement information (SEI) 3D option message with the first video frame, to trigger decoding selected from a group consisting of single field two-dimensional (2D) decoding and top and bottom field 3D decoding in response to receiver capabilities.
27. The system of claim 26 wherein the encoder transmits the bitstream in a standard selected from the group including Motion Pictures Expert Group-2 (MPEG2), MPEG4, and ITU-T H.264 standards.
28. The system of claim 26 wherein the encoder accepts a first and second view of a stereo image.
29. The system of claim 26 wherein the encoder transmits a 2D command responsive to a trigger selected from the group including an analysis of connected receiver capabilities and the channel bandwidth.
30. The system of claim 29 wherein the encoder encodes and transmits only one of the fields from the first video frame.
31. The system of claim 26 wherein the encoder, prior to accepting the current video image, accepts a first video image, encodes a first image top field, encodes a first image bottom field, encodes the current frame top field in response to the first image top field, and encodes the first video frame bottom field in response to the first image bottom field.
32. The system of claim 26 wherein the encoder, prior to accepting the current image, accepts a first video image, encodes a first image first field, encodes the first video frame top field in response to the first image first field, and encodes the first video frame bottom field in response to the first image first field.
33. The system of claim 32 wherein the first image first field is a first image top field.
34. The system of claim 32 wherein the first image first field is a first image bottom field.
35. A three-dimensional (3D) video decoder, the decoder comprising:
an input connected to a channel to accept a single first video frame bitstream encoded with two interlaced fields and a supplemental enhancement information (SEI) 3D content message with the first video frame;
a two-dimensional (2D) decision unit to analyze the SEI 3D content message, and if non-3D display capabilities are detected in an associated display, decoding only one of the first frame interlaced fields in response to the 3D option SEI message;
a 3D decision unit to analyze the SEI 3D content message, and if 3D display capabilities are detected in the associated display, decoding first frame interlaced top and bottom fields in response to the 3D option SEI message; and,
an output to supply at least one of the first video frame top field and the first video frame bottom field.
US10817309 2003-10-16 2004-04-02 System and method for three-dimensional video coding Active 2026-12-07 US7650036B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US51215503 true 2003-10-16 2003-10-16
US51948203 true 2003-11-13 2003-11-13
US10817309 US7650036B2 (en) 2003-10-16 2004-04-02 System and method for three-dimensional video coding

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US10817309 US7650036B2 (en) 2003-10-16 2004-04-02 System and method for three-dimensional video coding
JP2004299120A JP4628062B2 (en) 2003-10-16 2004-10-13 System and method for three dimensional video coding
EP20040024614 EP1524859A3 (en) 2003-10-16 2004-10-15 System and method for three-dimensional video coding
EP20100010236 EP2309748A2 (en) 2003-10-16 2004-10-15 System and method for three-dimensional video coding
JP2010074349A JP5072996B2 (en) 2003-10-16 2010-03-29 System and method for three dimensional video coding

Publications (2)

Publication Number Publication Date
US20050084006A1 true US20050084006A1 (en) 2005-04-21
US7650036B2 true US7650036B2 (en) 2010-01-19

Family

ID=34382018

Family Applications (1)

Application Number Title Priority Date Filing Date
US10817309 Active 2026-12-07 US7650036B2 (en) 2003-10-16 2004-04-02 System and method for three-dimensional video coding

Country Status (3)

Country Link
US (1) US7650036B2 (en)
JP (2) JP4628062B2 (en)
EP (2) EP1524859A3 (en)

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070195894A1 (en) * 2006-02-21 2007-08-23 Digital Fountain, Inc. Multiple-field based code generator and decoder for communications systems
US20080256418A1 (en) * 2006-06-09 2008-10-16 Digital Fountain, Inc Dynamic stream interleaving and sub-stream based delivery
US20090031199A1 (en) * 2004-05-07 2009-01-29 Digital Fountain, Inc. File download and streaming system
US20090028249A1 (en) * 2006-01-09 2009-01-29 Thomson Licensing Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding
US20090067551A1 (en) * 2007-09-12 2009-03-12 Digital Fountain, Inc. Generating and communicating source identification information to enable reliable communications
US20090189792A1 (en) * 2002-10-05 2009-07-30 Shokrollahi M Amin Systematic encoding and decoding of chain reaction codes
US20100141738A1 (en) * 2008-11-04 2010-06-10 Gwang-Soon Lee Method and system for transmitting/receiving 3-dimensional broadcasting service
US20100165077A1 (en) * 2005-10-19 2010-07-01 Peng Yin Multi-View Video Coding Using Scalable Video Coding
US20100211690A1 (en) * 2009-02-13 2010-08-19 Digital Fountain, Inc. Block partitioning for a data stream
US20100223533A1 (en) * 2009-02-27 2010-09-02 Qualcomm Incorporated Mobile reception of digital video broadcasting-terrestrial services
US20100259690A1 (en) * 2009-04-14 2010-10-14 Futurewei Technologies, Inc. System and Method for Processing Video Files
US20110019769A1 (en) * 2001-12-21 2011-01-27 Qualcomm Incorporated Multi stage code generator and decoder for communication systems
US20110096828A1 (en) * 2009-09-22 2011-04-28 Qualcomm Incorporated Enhanced block-request streaming using scalable encoding
US20110103519A1 (en) * 2002-06-11 2011-05-05 Qualcomm Incorporated Systems and processes for decoding chain reaction codes through inactivation
US20110216162A1 (en) * 2010-01-05 2011-09-08 Dolby Laboratories Licensing Corporation Multi-View Video Format Control
US20110231519A1 (en) * 2006-06-09 2011-09-22 Qualcomm Incorporated Enhanced block-request streaming using url templates and construction rules
US20110238789A1 (en) * 2006-06-09 2011-09-29 Qualcomm Incorporated Enhanced block-request streaming system using signaling or block creation
US20110239078A1 (en) * 2006-06-09 2011-09-29 Qualcomm Incorporated Enhanced block-request streaming using cooperative parallel http and forward error correction
US20110254920A1 (en) * 2008-11-04 2011-10-20 Electronics And Telecommunications Research Institute Apparatus and method for synchronizing stereoscopic image, and apparatus and method for providing stereoscopic image based on the same
US20120063508A1 (en) * 2010-09-15 2012-03-15 Shinobu Hattori Transmitting apparatus, transmitting method, receiving apparatus, receiving method, program, and broadcasting system
US20120086774A1 (en) * 2009-06-16 2012-04-12 Sangwook Nam 3d display device and selective image display method thereof
US20120303738A1 (en) * 2011-05-24 2012-11-29 Comcast Cable Communications, Llc Dynamic distribution of three-dimensional content
US8363724B2 (en) 2006-07-11 2013-01-29 Thomson Licensing Methods and apparatus using virtual reference pictures
US20130141533A1 (en) * 2008-12-18 2013-06-06 Jongyeul Suh Digital broadcasting reception method capable of displaying stereoscopic image, and digital broadcasting reception apparatus using same
US20130169753A1 (en) * 2010-09-19 2013-07-04 Joonhui Lee Broadcast receiver and method for processing 3d video data
US20130222541A1 (en) * 2010-10-28 2013-08-29 Lg Electronics Inc Receiver apparatus and method for receiving a three-dimensional broadcast signal in a mobile environment
US8806050B2 (en) 2010-08-10 2014-08-12 Qualcomm Incorporated Manifest file updates for network streaming of coded multimedia data
US8887020B2 (en) 2003-10-06 2014-11-11 Digital Fountain, Inc. Error-correcting multi-stage code generator and decoder for communication systems having single transmitters or multiple transmitters
US8918533B2 (en) 2010-07-13 2014-12-23 Qualcomm Incorporated Video switching for streaming video data
US20140375780A1 (en) * 2009-11-05 2014-12-25 Sony Corporation Method and receiver for enabling switching involving a 3d video signal
US8958375B2 (en) 2011-02-11 2015-02-17 Qualcomm Incorporated Framing for an improved radio link protocol including FEC
US9136983B2 (en) 2006-02-13 2015-09-15 Digital Fountain, Inc. Streaming and buffering using variable FEC overhead and protection periods
US9171354B2 (en) 2012-12-13 2015-10-27 Samsung Electronics Co., Ltd. Image processing apparatus and method for enhancing the quality of an image
US9185439B2 (en) 2010-07-15 2015-11-10 Qualcomm Incorporated Signaling data for multiplexing video components
US9225961B2 (en) 2010-05-13 2015-12-29 Qualcomm Incorporated Frame packing for asymmetric stereo video
US9246633B2 (en) 1998-09-23 2016-01-26 Digital Fountain, Inc. Information additive code generator and decoder for communication systems
US9253233B2 (en) 2011-08-31 2016-02-02 Qualcomm Incorporated Switch signaling methods providing improved switching between representations for adaptive HTTP streaming
US9264069B2 (en) 2006-05-10 2016-02-16 Digital Fountain, Inc. Code generator and decoder for communications systems operating using hybrid codes to allow for multiple efficient uses of the communications systems
US9270299B2 (en) 2011-02-11 2016-02-23 Qualcomm Incorporated Encoding and decoding using elastic codes with flexible source block mapping
US9288010B2 (en) 2009-08-19 2016-03-15 Qualcomm Incorporated Universal file delivery methods for providing unequal error protection and bundled file delivery services
US9288473B2 (en) 2011-03-09 2016-03-15 Fujitsu Limited Creating apparatus and creating method
US9294226B2 (en) 2012-03-26 2016-03-22 Qualcomm Incorporated Universal object delivery and template-based file delivery
US9380096B2 (en) 2006-06-09 2016-06-28 Qualcomm Incorporated Enhanced block-request streaming system for handling low-latency streaming
US9386293B2 (en) 2010-04-12 2016-07-05 S.I.Sv.El Societa' Italiana Per Lo Sviluppo Dell'elettronica S.P.A. Method for generating and rebuilding a stereoscopic-compatible video stream and related coding and decoding devices
US9419749B2 (en) 2009-08-19 2016-08-16 Qualcomm Incorporated Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes
US9596447B2 (en) 2010-07-21 2017-03-14 Qualcomm Incorporated Providing frame packing type information for video coding
US9787966B2 (en) 2012-09-04 2017-10-10 Industrial Technology Research Institute Methods and devices for coding interlaced depth data for three-dimensional video content
US9838666B2 (en) 2011-08-12 2017-12-05 Renesas Electronics Corporation Video decoding device and image display device
US9843844B2 (en) 2011-10-05 2017-12-12 Qualcomm Incorporated Network streaming of media data

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050254575A1 (en) * 2004-05-12 2005-11-17 Nokia Corporation Multiple interoperability points for scalable media coding and transmission
US20060015919A1 (en) * 2004-07-13 2006-01-19 Nokia Corporation System and method for transferring video information
US7515759B2 (en) * 2004-07-14 2009-04-07 Sharp Laboratories Of America, Inc. 3D video coding using sub-sequences
WO2006020826A3 (en) * 2004-08-11 2007-08-02 Digital Fountain Inc Method and apparatus for fast encoding of data symbols according to half-weight codes
KR100716992B1 (en) * 2005-02-04 2007-05-10 삼성전자주식회사 Method for encoding and decoding of stereo video, and apparatus thereof
US7881384B2 (en) * 2005-08-05 2011-02-01 Lsi Corporation Method and apparatus for H.264 to MPEG-2 video transcoding
US8208540B2 (en) 2005-08-05 2012-06-26 Lsi Corporation Video bitstream transcoding method and apparatus
US7903739B2 (en) * 2005-08-05 2011-03-08 Lsi Corporation Method and apparatus for VC-1 to MPEG-2 video transcoding
EP1972153A4 (en) * 2006-01-09 2015-03-11 Lg Electronics Inc Inter-layer prediction method for video signal
KR101177412B1 (en) 2006-04-20 2012-08-24 엘지전자 주식회사 apparatus for transmitting and receiving broadcast signal and method thereof
WO2008046243A1 (en) * 2006-10-16 2008-04-24 Thomson Licensing Method and device for encoding a data stream, method and device for decoding a data stream, video indexing system and image retrieval system
WO2008054100A1 (en) * 2006-11-01 2008-05-08 Electronics And Telecommunications Research Institute Method and apparatus for decoding metadata used for playing stereoscopic contents
US8274551B2 (en) 2007-06-11 2012-09-25 Samsung Electronics Co., Ltd. Method and apparatus for generating header information of stereoscopic image data
EP2863640A1 (en) 2007-09-24 2015-04-22 Koninklijke Philips N.V. Signal for carrying 3D video data, encoding system for encoding a 3D video data, recording device, method for encoding 3D video data, computer program product, decoding system, display device
US8538134B2 (en) * 2007-10-04 2013-09-17 Samsung Electronics Co., Ltd. Method and apparatus for receiving and generating image data stream including parameters for displaying local three dimensional image
CN101616322A (en) * 2008-06-24 2009-12-30 深圳华为通信技术有限公司 Method, device and system for coding and decoding stereo video
US8508582B2 (en) * 2008-07-25 2013-08-13 Koninklijke Philips N.V. 3D display handling of subtitles
US20100026783A1 (en) * 2008-08-01 2010-02-04 Real D Method and apparatus to encode and decode stereoscopic video data
CN102132573B (en) * 2008-08-26 2013-10-23 皇家飞利浦电子股份有限公司 Method and system for encoding 3d video signal, encoder for encoding 3-d video signal, encoded 3d video signal, method and system for decoding 3d video signal, decoder for decoding 3d video signal
WO2010039417A1 (en) 2008-09-23 2010-04-08 Dolby Laboratories Licensing Corporation Encoding and decoding architecture of checkerboard multiplexed image data
CN102395032B (en) 2009-01-19 2014-04-09 松下电器产业株式会社 Coding method, decoding method, coding apparatus, decoding apparatus, program, and integrated circuit
US8947504B2 (en) * 2009-01-28 2015-02-03 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
JP5406942B2 (en) * 2009-01-29 2014-02-05 ドルビー ラボラトリーズ ライセンシング コーポレイション Method and apparatus for subsampling and interleaving the plurality of images is a stereoscopic image
CN102292992B (en) * 2009-04-08 2013-03-20 索尼公司 Information processing device, information processing method, playback device, playback method, and recording medium
US9124874B2 (en) 2009-06-05 2015-09-01 Qualcomm Incorporated Encoding of three-dimensional conversion information with two-dimensional video sequence
US8675730B2 (en) * 2009-07-13 2014-03-18 Nvidia Corporation Macroblock grouping in a destination video frame to improve video reconstruction performance
KR101353115B1 (en) * 2009-08-03 2014-01-21 제너럴 인스트루먼트 코포레이션 Method of encoding video content
CN102648629B (en) * 2009-10-20 2015-05-06 瑞典爱立信有限公司 Provision of supplemental processing information
KR101637490B1 (en) * 2009-12-30 2016-07-08 삼성전자주식회사 Apparatus and method for displaying 3-dimension image and controlling shutter glasses
US8908774B2 (en) 2010-02-11 2014-12-09 Mediatek Inc. Method and video receiving system for adaptively decoding embedded video bitstream
EP2364031A1 (en) * 2010-03-01 2011-09-07 Telefonaktiebolaget L M Ericsson (Publ) Compression coding and compression decoding of video signals
US9030536B2 (en) 2010-06-04 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for presenting media content
KR101774396B1 (en) 2010-06-28 2017-09-04 에스.아이.에스브이.이엘. 쏘시에타‘ 이탈리아나 퍼 로 스빌루포 델‘엘레트로니카 에스.피.에이. Method for decoding 2d-compatible stereoscopic video flows
US9485546B2 (en) 2010-06-29 2016-11-01 Qualcomm Incorporated Signaling video samples for trick mode video representations
US8593574B2 (en) 2010-06-30 2013-11-26 At&T Intellectual Property I, L.P. Apparatus and method for providing dimensional media content based on detected display capability
US9787974B2 (en) 2010-06-30 2017-10-10 At&T Intellectual Property I, L.P. Method and apparatus for delivering media content
US8640182B2 (en) 2010-06-30 2014-01-28 At&T Intellectual Property I, L.P. Method for detecting a viewing apparatus
US8918831B2 (en) 2010-07-06 2014-12-23 At&T Intellectual Property I, Lp Method and apparatus for managing a presentation of media content
US9049426B2 (en) * 2010-07-07 2015-06-02 At&T Intellectual Property I, Lp Apparatus and method for distributing three dimensional media content
JP5960133B2 (en) * 2010-07-12 2016-08-02 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Auxiliary data in 3d video broadcasting
US9560406B2 (en) 2010-07-20 2017-01-31 At&T Intellectual Property I, L.P. Method and apparatus for adapting a presentation of media content
US9232274B2 (en) 2010-07-20 2016-01-05 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US9032470B2 (en) 2010-07-20 2015-05-12 At&T Intellectual Property I, Lp Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
JP5652642B2 (en) * 2010-08-02 2015-01-14 ソニー株式会社 Data generating apparatus and a data generation method, a data processing apparatus and data processing method
US8994716B2 (en) 2010-08-02 2015-03-31 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US8438502B2 (en) 2010-08-25 2013-05-07 At&T Intellectual Property I, L.P. Apparatus for controlling three-dimensional images
US8947511B2 (en) 2010-10-01 2015-02-03 At&T Intellectual Property I, L.P. Apparatus and method for presenting three-dimensional media content
CN102972024A (en) * 2011-05-11 2013-03-13 松下电器产业株式会社 Video transmission device and video transmission method
US8947497B2 (en) 2011-06-24 2015-02-03 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US9602766B2 (en) 2011-06-24 2017-03-21 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
US9030522B2 (en) 2011-06-24 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US9445046B2 (en) 2011-06-24 2016-09-13 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content with telepresence
US8587635B2 (en) 2011-07-15 2013-11-19 At&T Intellectual Property I, L.P. Apparatus and method for providing media services with telepresence
US20130050573A1 (en) * 2011-08-25 2013-02-28 Comcast Cable Communications, Llc Transmission of video content
WO2013075329A1 (en) * 2011-11-25 2013-05-30 Thomson Licensing Method and apparatus for generating a bitstream of repetitive structure discovery based 3d model compression
WO2013154029A1 (en) * 2012-04-13 2013-10-17 ソニー株式会社 Decoding device and decoding method, and coding device and coding method
WO2014060937A1 (en) * 2012-10-15 2014-04-24 Rai Radiotelevisione Italiana S.P.A. Method for coding and decoding a digital video, and related coding and decoding devices
US9560361B2 (en) * 2012-12-05 2017-01-31 Vixs Systems Inc. Adaptive single-field/dual-field video encoding

Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5012326A (en) * 1988-08-23 1991-04-30 Kabushiki Kaisha Toshiba Television signal transmitting and receiving system
EP0639031A2 (en) * 1993-07-09 1995-02-15 RCA Thomson Licensing Corporation Method and apparatus for encoding stereo video signals
US5633682A (en) 1993-10-22 1997-05-27 Sony Corporation Stereoscopic coding system
US5767898A (en) * 1994-06-23 1998-06-16 Sanyo Electric Co., Ltd. Three-dimensional image coding by merger of left and right images
US6081270A (en) * 1997-01-27 2000-06-27 International Business Machines Corporation Method and system for providing an improved view of an object in a three-dimensional environment on a computer display
US20020009137A1 (en) 2000-02-01 2002-01-24 Nelson John E. Three-dimensional video broadcasting system
US20020047835A1 (en) * 2000-09-11 2002-04-25 Tomoaki Kawai Image display apparatus and method of displaying image data
US20020122585A1 (en) * 2000-06-12 2002-09-05 Swift David C. Electronic stereoscopic media delivery system
US6449003B1 (en) * 1996-12-18 2002-09-10 Siemens Nixdorf Informationssysteme Aktiengesellschaft Method and circuit for converting the image format of three-dimensional electronic images produced with line polarization
US6515663B1 (en) * 1999-03-19 2003-02-04 Asustek Computer Inc. Apparatus for and method of processing three-dimensional images
US20030095177A1 (en) * 2001-11-21 2003-05-22 Kug-Jin Yun 3D stereoscopic/multiview video processing system and its method
US6574423B1 (en) * 1996-02-28 2003-06-03 Matsushita Electric Industrial Co., Ltd. High-resolution optical disk for recording stereoscopic video, optical disk reproducing device, and optical disk recording device
WO2003056843A1 (en) 2001-12-28 2003-07-10 Electronics And Telecommunications Research Institute Stereoscopic video encoding/decoding apparatuses supporting multi-display modes and methods thereof
US20040022418A1 (en) * 2002-07-31 2004-02-05 Akihiro Oota Pattern-matching processing method and image processing apparatus
US20040032980A1 (en) * 1997-12-05 2004-02-19 Dynamic Digital Depth Research Pty Ltd Image conversion and encoding techniques
US20040096109A1 (en) * 2001-11-27 2004-05-20 Limin Wang Frequency coefficient scanning paths for coding digital video content
US20040126020A1 (en) * 2002-10-02 2004-07-01 Hiroyuki Sakuyama Apparatus and method for processing image data based on object movement speed within a frame
US6784891B2 (en) * 2001-02-28 2004-08-31 Hitachi, Ltd. Image display system
US20040218816A1 (en) * 2003-04-30 2004-11-04 Nokia Corporation Picture coding method
US20060013490A1 (en) * 2004-07-14 2006-01-19 Sharp Laboratories Of America, Inc. 3D video coding using sup-sequences
US20060177123A1 (en) * 2005-02-04 2006-08-10 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding stereo image
US7254265B2 (en) * 2000-04-01 2007-08-07 Newsight Corporation Methods and systems for 2D/3D image conversion and optimization

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0944269B1 (en) * 1996-12-04 2002-11-13 Matsushita Electric Industrial Co., Ltd. Optical disc for high resolution and three-dimensional image recording, optical disc reproducing device, and optical disc recording device
JP2000197074A (en) * 1998-12-25 2000-07-14 Canon Inc Stereoscopic reproduction device, output device, and its control method and storage medium
JP2002095018A (en) * 2000-09-12 2002-03-29 Canon Inc Image display controller, image display system and method for displaying image data
JP2002209232A (en) * 2001-01-09 2002-07-26 Canon Inc Compound eye camera

Patent Citations (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5012326A (en) * 1988-08-23 1991-04-30 Kabushiki Kaisha Toshiba Television signal transmitting and receiving system
EP0639031A2 (en) * 1993-07-09 1995-02-15 RCA Thomson Licensing Corporation Method and apparatus for encoding stereo video signals
US5633682A (en) 1993-10-22 1997-05-27 Sony Corporation Stereoscopic coding system
US5767898A (en) * 1994-06-23 1998-06-16 Sanyo Electric Co., Ltd. Three-dimensional image coding by merger of left and right images
US6574423B1 (en) * 1996-02-28 2003-06-03 Matsushita Electric Industrial Co., Ltd. High-resolution optical disk for recording stereoscopic video, optical disk reproducing device, and optical disk recording device
US6449003B1 (en) * 1996-12-18 2002-09-10 Siemens Nixdorf Informationssysteme Aktiengesellschaft Method and circuit for converting the image format of three-dimensional electronic images produced with line polarization
US6081270A (en) * 1997-01-27 2000-06-27 International Business Machines Corporation Method and system for providing an improved view of an object in a three-dimensional environment on a computer display
US20040032980A1 (en) * 1997-12-05 2004-02-19 Dynamic Digital Depth Research Pty Ltd Image conversion and encoding techniques
US6515663B1 (en) * 1999-03-19 2003-02-04 Asustek Computer Inc. Apparatus for and method of processing three-dimensional images
US20020009137A1 (en) 2000-02-01 2002-01-24 Nelson John E. Three-dimensional video broadcasting system
US7254265B2 (en) * 2000-04-01 2007-08-07 Newsight Corporation Methods and systems for 2D/3D image conversion and optimization
US20020122585A1 (en) * 2000-06-12 2002-09-05 Swift David C. Electronic stereoscopic media delivery system
US6765568B2 (en) * 2000-06-12 2004-07-20 Vrex, Inc. Electronic stereoscopic media delivery system
US20020047835A1 (en) * 2000-09-11 2002-04-25 Tomoaki Kawai Image display apparatus and method of displaying image data
US6784891B2 (en) * 2001-02-28 2004-08-31 Hitachi, Ltd. Image display system
US20030095177A1 (en) * 2001-11-21 2003-05-22 Kug-Jin Yun 3D stereoscopic/multiview video processing system and its method
US20040096109A1 (en) * 2001-11-27 2004-05-20 Limin Wang Frequency coefficient scanning paths for coding digital video content
WO2003056843A1 (en) 2001-12-28 2003-07-10 Electronics And Telecommunications Research Institute Stereoscopic video encoding/decoding apparatuses supporting multi-display modes and methods thereof
US20040022418A1 (en) * 2002-07-31 2004-02-05 Akihiro Oota Pattern-matching processing method and image processing apparatus
US20040126020A1 (en) * 2002-10-02 2004-07-01 Hiroyuki Sakuyama Apparatus and method for processing image data based on object movement speed within a frame
US20040218816A1 (en) * 2003-04-30 2004-11-04 Nokia Corporation Picture coding method
US20060013490A1 (en) * 2004-07-14 2006-01-19 Sharp Laboratories Of America, Inc. 3D video coding using sup-sequences
US20060177123A1 (en) * 2005-02-04 2006-08-10 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding stereo image

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
Eichenlaub, A Lightweight Compact 2-D/3-D Autostereescopic LCD Backlight for Games, Monitor, and Notebook Applications, SID International Symposium Digest of Technical Papers.
Engdahl, How to Show Video Material in Computer Screen, Nov. 5, 1999, web.archieve.orgiweb/19991105154813.
Hur et al., Experimental Service of 3DTV Broadcasting Replay in Korea, Proceedings of the SPIE, vol. 4864, 2002, pp. 1-13.
Taylor, DVD Demystified, McGraw-Hill, 2001, pp. 138-142.
Wiegand et al., "Overview of the H.264/AVC Video Coding Standard", Jul. 2003, IEEE, IEEE Transactions on Circuits an Systems for Video Technology, vol. 13, No. 7, pp. 560-576. *
Wiegand et al., Overview of the H.264/AVC Video COding Standard, IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, No. 7, Jul. 2003, pp. 560-576.

Cited By (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9246633B2 (en) 1998-09-23 2016-01-26 Digital Fountain, Inc. Information additive code generator and decoder for communication systems
US20110019769A1 (en) * 2001-12-21 2011-01-27 Qualcomm Incorporated Multi stage code generator and decoder for communication systems
US9236976B2 (en) 2001-12-21 2016-01-12 Digital Fountain, Inc. Multi stage code generator and decoder for communication systems
US20110103519A1 (en) * 2002-06-11 2011-05-05 Qualcomm Incorporated Systems and processes for decoding chain reaction codes through inactivation
US9240810B2 (en) 2002-06-11 2016-01-19 Digital Fountain, Inc. Systems and processes for decoding chain reaction codes through inactivation
US9236885B2 (en) 2002-10-05 2016-01-12 Digital Fountain, Inc. Systematic encoding and decoding of chain reaction codes
US20090189792A1 (en) * 2002-10-05 2009-07-30 Shokrollahi M Amin Systematic encoding and decoding of chain reaction codes
USRE43741E1 (en) 2002-10-05 2012-10-16 Qualcomm Incorporated Systematic encoding and decoding of chain reaction codes
US8887020B2 (en) 2003-10-06 2014-11-11 Digital Fountain, Inc. Error-correcting multi-stage code generator and decoder for communication systems having single transmitters or multiple transmitters
US20090031199A1 (en) * 2004-05-07 2009-01-29 Digital Fountain, Inc. File download and streaming system
US9136878B2 (en) 2004-05-07 2015-09-15 Digital Fountain, Inc. File download and streaming system
US9236887B2 (en) 2004-05-07 2016-01-12 Digital Fountain, Inc. File download and streaming system
US9131247B2 (en) * 2005-10-19 2015-09-08 Thomson Licensing Multi-view video coding using scalable video coding
US20100165077A1 (en) * 2005-10-19 2010-07-01 Peng Yin Multi-View Video Coding Using Scalable Video Coding
US9628823B2 (en) 2006-01-09 2017-04-18 Thomson Licensing Dtv Method and apparatus for providing reduced resolution update mode for multi-view video coding
US20090028249A1 (en) * 2006-01-09 2009-01-29 Thomson Licensing Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding
US9136983B2 (en) 2006-02-13 2015-09-15 Digital Fountain, Inc. Streaming and buffering using variable FEC overhead and protection periods
US9270414B2 (en) 2006-02-21 2016-02-23 Digital Fountain, Inc. Multiple-field based code generator and decoder for communications systems
US20070195894A1 (en) * 2006-02-21 2007-08-23 Digital Fountain, Inc. Multiple-field based code generator and decoder for communications systems
US9264069B2 (en) 2006-05-10 2016-02-16 Digital Fountain, Inc. Code generator and decoder for communications systems operating using hybrid codes to allow for multiple efficient uses of the communications systems
US20110231519A1 (en) * 2006-06-09 2011-09-22 Qualcomm Incorporated Enhanced block-request streaming using url templates and construction rules
US9432433B2 (en) 2006-06-09 2016-08-30 Qualcomm Incorporated Enhanced block-request streaming system using signaling or block creation
US9178535B2 (en) 2006-06-09 2015-11-03 Digital Fountain, Inc. Dynamic stream interleaving and sub-stream based delivery
US20110239078A1 (en) * 2006-06-09 2011-09-29 Qualcomm Incorporated Enhanced block-request streaming using cooperative parallel http and forward error correction
US9191151B2 (en) 2006-06-09 2015-11-17 Qualcomm Incorporated Enhanced block-request streaming using cooperative parallel HTTP and forward error correction
US9380096B2 (en) 2006-06-09 2016-06-28 Qualcomm Incorporated Enhanced block-request streaming system for handling low-latency streaming
US9209934B2 (en) 2006-06-09 2015-12-08 Qualcomm Incorporated Enhanced block-request streaming using cooperative parallel HTTP and forward error correction
US9628536B2 (en) 2006-06-09 2017-04-18 Qualcomm Incorporated Enhanced block-request streaming using cooperative parallel HTTP and forward error correction
US20110238789A1 (en) * 2006-06-09 2011-09-29 Qualcomm Incorporated Enhanced block-request streaming system using signaling or block creation
US20080256418A1 (en) * 2006-06-09 2008-10-16 Digital Fountain, Inc Dynamic stream interleaving and sub-stream based delivery
US9386064B2 (en) 2006-06-09 2016-07-05 Qualcomm Incorporated Enhanced block-request streaming using URL templates and construction rules
US8363724B2 (en) 2006-07-11 2013-01-29 Thomson Licensing Methods and apparatus using virtual reference pictures
US20090067551A1 (en) * 2007-09-12 2009-03-12 Digital Fountain, Inc. Generating and communicating source identification information to enable reliable communications
US9237101B2 (en) 2007-09-12 2016-01-12 Digital Fountain, Inc. Generating and communicating source identification information to enable reliable communications
US8917314B2 (en) * 2008-11-04 2014-12-23 Electronics And Telecommunications Research Institute Apparatus and method for synchronizing stereoscopic image, and apparatus and method for providing stereoscopic image based on the same
US20110254920A1 (en) * 2008-11-04 2011-10-20 Electronics And Telecommunications Research Institute Apparatus and method for synchronizing stereoscopic image, and apparatus and method for providing stereoscopic image based on the same
US20100141738A1 (en) * 2008-11-04 2010-06-10 Gwang-Soon Lee Method and system for transmitting/receiving 3-dimensional broadcasting service
US8520057B2 (en) * 2008-11-04 2013-08-27 Electronics And Telecommunications Research Institute Method and system for transmitting/receiving 3-dimensional broadcasting service
US20130141533A1 (en) * 2008-12-18 2013-06-06 Jongyeul Suh Digital broadcasting reception method capable of displaying stereoscopic image, and digital broadcasting reception apparatus using same
US9516294B2 (en) * 2008-12-18 2016-12-06 Lg Electronics Inc. Digital broadcasting reception method capable of displaying stereoscopic image, and digital broadcasting reception apparatus using same
US20100211690A1 (en) * 2009-02-13 2010-08-19 Digital Fountain, Inc. Block partitioning for a data stream
US20100223533A1 (en) * 2009-02-27 2010-09-02 Qualcomm Incorporated Mobile reception of digital video broadcasting-terrestrial services
US9281847B2 (en) 2009-02-27 2016-03-08 Qualcomm Incorporated Mobile reception of digital video broadcasting—terrestrial services
US8948247B2 (en) 2009-04-14 2015-02-03 Futurewei Technologies, Inc. System and method for processing video files
US20100259690A1 (en) * 2009-04-14 2010-10-14 Futurewei Technologies, Inc. System and Method for Processing Video Files
US9869875B2 (en) * 2009-06-16 2018-01-16 Lg Electronics Inc. 3D display device and selective image display method thereof
US20120086774A1 (en) * 2009-06-16 2012-04-12 Sangwook Nam 3d display device and selective image display method thereof
US9097903B2 (en) * 2009-06-16 2015-08-04 Lg Electronics Inc. 3D display device and selective image display method thereof
US20150326849A1 (en) * 2009-06-16 2015-11-12 Lg Electronics Inc. 3d display device and selective image display method thereof
US9288010B2 (en) 2009-08-19 2016-03-15 Qualcomm Incorporated Universal file delivery methods for providing unequal error protection and bundled file delivery services
US9419749B2 (en) 2009-08-19 2016-08-16 Qualcomm Incorporated Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes
US9876607B2 (en) 2009-08-19 2018-01-23 Qualcomm Incorporated Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes
US20110096828A1 (en) * 2009-09-22 2011-04-28 Qualcomm Incorporated Enhanced block-request streaming using scalable encoding
US20140375780A1 (en) * 2009-11-05 2014-12-25 Sony Corporation Method and receiver for enabling switching involving a 3d video signal
US8743178B2 (en) * 2010-01-05 2014-06-03 Dolby Laboratories Licensing Corporation Multi-view video format control
US20110216162A1 (en) * 2010-01-05 2011-09-08 Dolby Laboratories Licensing Corporation Multi-View Video Format Control
US9386293B2 (en) 2010-04-12 2016-07-05 S.I.Sv.El Societa' Italiana Per Lo Sviluppo Dell'elettronica S.P.A. Method for generating and rebuilding a stereoscopic-compatible video stream and related coding and decoding devices
US9225961B2 (en) 2010-05-13 2015-12-29 Qualcomm Incorporated Frame packing for asymmetric stereo video
US8918533B2 (en) 2010-07-13 2014-12-23 Qualcomm Incorporated Video switching for streaming video data
US9185439B2 (en) 2010-07-15 2015-11-10 Qualcomm Incorporated Signaling data for multiplexing video components
US9596447B2 (en) 2010-07-21 2017-03-14 Qualcomm Incorporated Providing frame packing type information for video coding
US9602802B2 (en) 2010-07-21 2017-03-21 Qualcomm Incorporated Providing frame packing type information for video coding
US9319448B2 (en) 2010-08-10 2016-04-19 Qualcomm Incorporated Trick modes for network streaming of coded multimedia data
US9456015B2 (en) 2010-08-10 2016-09-27 Qualcomm Incorporated Representation groups for network streaming of coded multimedia data
US8806050B2 (en) 2010-08-10 2014-08-12 Qualcomm Incorporated Manifest file updates for network streaming of coded multimedia data
US20120063508A1 (en) * 2010-09-15 2012-03-15 Shinobu Hattori Transmitting apparatus, transmitting method, receiving apparatus, receiving method, program, and broadcasting system
US20130169753A1 (en) * 2010-09-19 2013-07-04 Joonhui Lee Broadcast receiver and method for processing 3d video data
US20130222541A1 (en) * 2010-10-28 2013-08-29 Lg Electronics Inc Receiver apparatus and method for receiving a three-dimensional broadcast signal in a mobile environment
US9681117B2 (en) * 2010-10-28 2017-06-13 Lg Electronics Inc. Receiver apparatus and method for receiving a three-dimensional broadcast signal in a mobile environment
US9270299B2 (en) 2011-02-11 2016-02-23 Qualcomm Incorporated Encoding and decoding using elastic codes with flexible source block mapping
US8958375B2 (en) 2011-02-11 2015-02-17 Qualcomm Incorporated Framing for an improved radio link protocol including FEC
US9288473B2 (en) 2011-03-09 2016-03-15 Fujitsu Limited Creating apparatus and creating method
US9420259B2 (en) * 2011-05-24 2016-08-16 Comcast Cable Communications, Llc Dynamic distribution of three-dimensional content
US20120303738A1 (en) * 2011-05-24 2012-11-29 Comcast Cable Communications, Llc Dynamic distribution of three-dimensional content
US9838666B2 (en) 2011-08-12 2017-12-05 Renesas Electronics Corporation Video decoding device and image display device
US9253233B2 (en) 2011-08-31 2016-02-02 Qualcomm Incorporated Switch signaling methods providing improved switching between representations for adaptive HTTP streaming
US9843844B2 (en) 2011-10-05 2017-12-12 Qualcomm Incorporated Network streaming of media data
US9294226B2 (en) 2012-03-26 2016-03-22 Qualcomm Incorporated Universal object delivery and template-based file delivery
US9787966B2 (en) 2012-09-04 2017-10-10 Industrial Technology Research Institute Methods and devices for coding interlaced depth data for three-dimensional video content
US9171354B2 (en) 2012-12-13 2015-10-27 Samsung Electronics Co., Ltd. Image processing apparatus and method for enhancing the quality of an image

Also Published As

Publication number Publication date Type
JP2005124200A (en) 2005-05-12 application
JP4628062B2 (en) 2011-02-09 grant
JP2010220221A (en) 2010-09-30 application
EP1524859A3 (en) 2006-02-15 application
JP5072996B2 (en) 2012-11-14 grant
US20050084006A1 (en) 2005-04-21 application
EP1524859A2 (en) 2005-04-20 application
EP2309748A2 (en) 2011-04-13 application

Similar Documents

Publication Publication Date Title
Wiegand et al. Rate-constrained coder control and comparison of video coding standards
Marpe et al. The H. 264/MPEG4 advanced video coding standard and its applications
Merkle et al. Efficient compression of multi-view video exploiting inter-view dependencies based on H. 264/MPEG4-AVC
US6920175B2 (en) Video coding architecture and methods for using same
US5612735A (en) Digital 3D/stereoscopic video compression technique utilizing two disparity estimates
Wiegand et al. Overview of the H. 264/AVC video coding standard
Schwarz et al. Overview of the scalable video coding extension of the H. 264/AVC standard
Puri et al. Video coding using the H. 264/MPEG-4 AVC compression standard
US6614845B1 (en) Method and apparatus for differential macroblock coding for intra-frame data in video conferencing systems
US20050094726A1 (en) System for encoding video data and system for decoding video data
US20020009137A1 (en) Three-dimensional video broadcasting system
US7194032B1 (en) Circuit and method for modifying a region of an encoded image
US20050249291A1 (en) Method and system for generating a transform size syntax element for video decoding
US5568200A (en) Method and apparatus for improved video display of progressively refreshed coded video
US20050135783A1 (en) Trick mode elementary stream and receiver system
Merkle et al. Efficient prediction structures for multiview video coding
US20050117647A1 (en) Method and apparatus for scalable video encoding and decoding
US20110194613A1 (en) Video coding with large macroblocks
US20120075436A1 (en) Coding stereo video data
US20100309286A1 (en) Encoding of three-dimensional conversion information with two-dimensional video sequence
US20020122491A1 (en) Video decoder architecture and method for using same
US20070098079A1 (en) Decoding method and apparatus enabling fast channel change of compressed video
US20010019354A1 (en) Method and an apparatus for video mixing of bit streams
US20070121723A1 (en) Scalable video coding method and apparatus based on multiple layers
US20050008240A1 (en) Stitching of video for continuous presence multipoint video conferencing

Legal Events

Date Code Title Description
AS Assignment

Owner name: SHARP LABORATORIES OF AMERICA, INC., WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEI, SHAWMIN;SUN, SHIJUN;REEL/FRAME:015184/0197

Effective date: 20040330

AS Assignment

Owner name: SHARP KABUSHIKI KAISHA,JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHARP LABORATORIES OF AMERICA INC.;REEL/FRAME:023937/0526

Effective date: 20100216

CC Certificate of correction
RF Reissue application filed

Effective date: 20120119

REMI Maintenance fee reminder mailed
SULP Surcharge for late payment
FPAY Fee payment

Year of fee payment: 4

FEPP

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.)