WO2000021291A1 - Dispositif et procede de formation d'une unite de codage - Google Patents

Dispositif et procede de formation d'une unite de codage Download PDF

Info

Publication number
WO2000021291A1
WO2000021291A1 PCT/US1999/022889 US9922889W WO0021291A1 WO 2000021291 A1 WO2000021291 A1 WO 2000021291A1 US 9922889 W US9922889 W US 9922889W WO 0021291 A1 WO0021291 A1 WO 0021291A1
Authority
WO
WIPO (PCT)
Prior art keywords
coefficients
texture unit
texture
packet
subbands
Prior art date
Application number
PCT/US1999/022889
Other languages
English (en)
Other versions
WO2000021291A8 (fr
Inventor
Bing-Bing Chai
Original Assignee
Sarnoff Corporation
Sharp K.K.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sarnoff Corporation, Sharp K.K. filed Critical Sarnoff Corporation
Priority to AU17047/00A priority Critical patent/AU1704700A/en
Priority to JP2000575301A priority patent/JP2002527956A/ja
Priority to EP99960111A priority patent/EP1118218A4/fr
Publication of WO2000021291A1 publication Critical patent/WO2000021291A1/fr
Publication of WO2000021291A8 publication Critical patent/WO2000021291A8/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
    • H04N19/68—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience involving the insertion of resynchronisation markers into the bitstream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/63—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/63—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
    • H04N19/64—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by ordering of coefficients or of bits for transmission
    • H04N19/647—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by ordering of coefficients or of bits for transmission using significance based coding, e.g. Embedded Zerotrees of Wavelets [EZW] or Set Partitioning in Hierarchical Trees [SPIHT]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
    • H04N19/66—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience involving data partitioning, i.e. separation of data into packets or partitions according to importance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder

Definitions

  • the invention relates to a data structure in the field of digital multimedia communications. More particularly, the invention relates to a formation of a data structure that improves error resilience when applied to the coding of hierarchical subband decomposed coefficients, e.g. , wavelet transform coefficients. BACKGROUND OF THE DISCLOSURE
  • a packet is a group of binary digits that include data and control elements which are switched and transmitted as a composite whole.
  • the data, control elements and other information are arranged in various specific formats.
  • MPEG defines a packet as consisting of a header followed by a number of contiguous bytes (payload) from an "elementary data stream".
  • An elementary stream is simply a generic term for one of the coded video, coded audio or other coded bitstreams.
  • an MPEG-2 "transport stream" packet comprises a header, which may be four (4) or more bytes long with a payload having a maximum length of 184 bytes.
  • Transport stream packets are part of one or more programs that are assembled into a transport stream. The transport stream is then transmitted over a channel with a particular transfer rate.
  • transmission of packets over a noisy communication channel may cause corruption in the packets received by a receiver/decoder.
  • some data streams or bitstreams carry compressed data that are correlated in a manner such that partial loss of a packet may cause the receiver/decoder to discard the entire packet.
  • compression methods are useful for representing information as accurately as possible with a minimum number of bits and thus minimizing the amount of data that must be stored or transmitted.
  • some compression methods employ "significance-based" information, e.g., a significance map-value model, to indicate to a receiver /decoder the significance of the transmitted information or absence of transmitted information.
  • the "significance-based" information is often previously defined, e.g. , using symbols, such that the receiver/decoder is able to decipher additional information from the transmitted information.
  • the loss of compressed data such as "significance-based” information often results in substantial errors when a receiver/decoder attempts to decompress or decode the corrupted data.
  • a wavelet pyramid also known as critically sampled quadrature-mirror filter (QMF) subband representation, is a specific type of multiresolution hierarchical subband representation of an image.
  • QMF quadrature-mirror filter
  • every coefficient at a given scale can be related to a set of coefficients at the next finer scale of similar orientation according to a structure called a wavelet tree.
  • the coefficients at the coarsest scale will be called the parent nodes, and all coefficients corresponding to the same spatial or temporal location at the next finer scale of similar orientation will be called child nodes.
  • a typical method of coding these transform coefficients is in "tree depth scan order as shown in FIG. 1, where an image is decomposed into three levels of resolution.
  • the wavelet coefficients are coded in tree blocks fashion, where each tree block is represented by three separate “texture units” shown with different shadings.
  • Each texture unit is representative of a tree structure starting from the lowest or coarsest AC band to the highest or finest AC band coefficients.
  • each texture unit will encompass a greater number of transform coefficients such that each texture unit is coded using more than one packet. This can cause more information loss if error occurs in one of these packets.
  • an apparatus and a method for forming a data structure that improves error resilience when applied to the coding of hierarchical subband decomposed coefficients, e.g. , wavelet transform coefficients is disclosed.
  • the data structure is referred to as a "texture unit" .
  • the texture unit is defined as comprising only those AC transform coefficients that are located in one or more rows in a single subband. For example, a single slice of transform coefficients in a HLi subband is collected as a texture unit and then packetized.
  • the texture unit is defined as comprising only those AC transform coefficients that are located in all the subbands of a decomposition level. For example, a single slice of transform coefficients from each of the HL , HH 3 , LH 3 subbands are collected as a texture unit and then packetized.
  • the texture unit is defined as comprising only those AC transform coefficients that are across "n" subbands, where "n" is a smaller number than the total number of "N" levels of decomposition. Namely, the "depth" of a texture unit in terms of subband is limited to a fixed value of "n” .
  • transform coefficients from the HL2 and HLi subbands can be collected as a texture unit and then packetized.
  • the texture unit is defined as comprising a bitplane from any color components.
  • each bitplane of the DC transform coefficients is encoded as a single texture unit.
  • the packet size varies in accordance with a subband or decomposition level of the hierarchical subband decomposed image. Namely, in the context of hierarchical subband coding, a smaller packet size is employed for the lower frequency subbands and a larger packet size is employed for the higher frequency subbands.
  • the present coding method and data structures provide error resilience. Namely, if an error occurs in a packet or a portion thereof, the overall amount of information that is lost will be minimized. In fact, it is likely that the receiver/decoder may account for the loss by applying various error recovery methods.
  • FIG. 1 is a schematic illustration of the parent-child dependencies of subbands in an image decomposed to three levels within a wavelet tree having a plurality of texture units as used in the prior art;
  • FIG. 2 depicts a block diagram of a simplified packet stream system of the present invention
  • FIG. 3 is a schematic illustration of a texture unit comprising AC coefficients within a single subband and its corresponding packet structure
  • FIG. 6 is a schematic illustration of a texture unit comprising of a single bitplane from the DC band;
  • FIG. 7 illustrates a block diagram of an encoding system and a decoding system of the present invention
  • FIG. 8 is a schematic illustration of a texture unit comprising AC coefficients from all subbands of a decomposition level and its corresponding packet structure.
  • FIG. 9 is a detailed schematic illustration of a texture unit comprising only those bits from the DC transform coefficients that form a single bitplane.
  • FIG. 2 depicts a block diagram of a simplified structure of a packet stream system 200 of the present invention.
  • a data stream such as a "transport stream” as defined in accordance with the MPEG standards is used in the packet stream system illustrated in FIG. 2.
  • transport stream as defined in accordance with the MPEG standards
  • FIG. 2 depicts a block diagram of a simplified structure of a packet stream system 200 of the present invention.
  • a data stream such as a "transport stream” as defined in accordance with the MPEG standards is used in the packet stream system illustrated in FIG. 2.
  • the present invention is described below using the transport stream as an example, those skilled in the art will realize that the present invention can be applied to any packet streams, e.g. , an MPEG "program stream” or any other packet streams in accordance with other formats.
  • the present invention is described below using the term “stream”, it should be understood that the various operations described below may be performed on the entire stream or portion thereof.
  • System 200 includes an image/video encoder 220 for receiving and encoding video data 210 into an elementary video bitstream.
  • the video encoder 220 is an encoder capable of generating hierarchical subband decomposed coefficients, e.g., wavelet coefficients with or without significance-based information.
  • the image/video encoder 220 may be a single image encoder, e.g., a Joint Photographic Experts Group (JPEG) encoder, GIF, PICT, and the like, or an encoder for an image sequence (video), e.g., a block-based or wavelet-based image encoder operating in accordance with an MPEG standard.
  • JPEG Joint Photographic Experts Group
  • video e.g., a block-based or wavelet-based image encoder operating in accordance with an MPEG standard.
  • image sequence, images, and video are used interchangeably.
  • the invention operates in cooperation with any form of image or image sequence encoder that would benefit from the present packet structures to provide error resilience.
  • VLBR Very Low Bit Rate
  • the system may include an audio encoder 222 for receiving and encoding audio data 212 into an elementary audio bitstream.
  • an audio encoder 222 for receiving and encoding audio data 212 into an elementary audio bitstream.
  • a plurality of image/video encoders 220n and audio encoders 222n can be employed to produce a plurality of elementary bitstreams.
  • the plurality of video and audio encoders can be collectively represented by a server 225, which may employ various encoders and/or may simply contain a plurality (or a library) of stored elementary streams in various storage media.
  • the output of such server contains interleaved program streams.
  • these bitstreams are sent to packetizers 230 of the present invention, where the elementary bitstreams are converted into packets.
  • Information for using the packets independently of the transport stream may be added when the packets are formed.
  • non-audio/video data are allowed, but they are not shown in FIG. 2.
  • the present encoder and the packetizer are implemented in a single module, those skilled in the art will realize that the functions performed by the encoder and the packetizer can be jointly or separately implemented as required by a particular application.
  • the packets are received and multiplexed by the transport stream multiplexer 240 to produce a transport stream 245.
  • Packets constructed from elementary streams that form a program (a group of "Packet Identifiers" (PIDs) with associated video and audio data) generally share a common time base.
  • the transport stream may contain one or more programs with one or more independent time bases, where the time bases are used for synchronized presentation.
  • the time bases of different programs within a transport stream may be different.
  • the transport stream 245 is transmitted over a transmission channel 250, which may further incorporate separate channel specific encoder and decoder (not shown).
  • the transport stream 245 is demultiplexed and decoded by a transport stream demultiplexer 260, where the elementary streams serve as inputs to video decoder 270 and audio decoder 290, whose outputs are decoded video signals 275 and audio signals 295, respectively.
  • timing information is also extracted by the transport stream demultiplexer 260 and delivered to clock control 280 for synchronizing the video and audio decoders with each other and with the channel. Synchronization of the decoders with the channel is accomplished through the use of the "Program Clock Reference” (PCR) in the transport stream.
  • PCR Program Clock Reference
  • the PCR is a time stamp encoding the timing of the bitstream itself and is used to derive the decoder timing.
  • the packetizer 230 organizes the bitstream from the encoder into packets for transmission. If the transmission channel 250 is noisy, the transmitted packets can be corrupted or partially lost.
  • the present invention describes a method for manipulating a bitstream to form a particular data structure or packet structure within the encoder 220, it should be understood that this operation can also be performed within the packetizer 230. As such, the implementation of the present invention is a matter of designer choice.
  • Error resilience is particularly important for packets carrying hierarchically decomposed information, i.e., hierarchical subband decomposed coefficients.
  • Hierarchical subband decomposition provides a multi-resolution representation of an image. For example, the image is first decomposed into four subbands, LL, LH, HL, HH, each representing approximately a quarter of the entire frequency band. To obtain the next coarser scale image representation, the LL band is further divided into four subbands. The process can be repeated to form a hierarchical subband pyramid. It should be understood that hierarchical subband decomposition can apply any number of subband decompositions.
  • Hierarchical subband decomposed coefficients can be packetized into units called "texture packets" for error resilience.
  • a texture packet consists of one or more coding units, named "texture units" . Namely, if the texture unit is packetized into a single packet, then the packet is referred to as a texture packet of the hierarchical subband decomposed image. In the present invention, different embodiments for forming a texture unit are disclosed.
  • FIG. 3 is a schematic illustration of one or more texture units 320a-c comprising of a slice of AC coefficients within a single subband. It should be noted that a slice can correspond to one or more rows in a subband.
  • the texture units 320a-c are also shown disposed within a packet structure 300 separated by markers 325.
  • FIG. 3 illustrates a texture unit 320a comprising only a single row of coefficients in the HL 3 subband.
  • FIG. 3 illustrates two other texture units 320b and 320c comprising two rows and four rows of wavelet coefficients in the HL 2 and HLi subbands, respectively.
  • the texture unit comprises 2 1 row(s) of coefficients.
  • each of these texture units is also shown as being encoded onto a texture packet 300 having a header 310, a plurality of texture units 320.
  • the packet may comprise a marker 325 to demarcate the separation of two texture units 320.
  • FIG. 8 is a schematic illustration of one or more texture units 820a- c comprising of slices of AC coefficients within subbands of a particular decomposition level.
  • This texture unit is referred to as having a layer-by-layer structure.
  • a slice can correspond to one or more rows in a subband.
  • the texture units 820a-c are also shown disposed within a packet structure 800 separated by optional markers 825.
  • FIG. 8 illustrates a texture unit 820a comprising three rows of coefficients from the HL 3 , HH 3 and LH 3 subbands.
  • FIG. 8 illustrates a texture unit 820a comprising three rows of coefficients from the HL 3
  • the texture unit 820b and 820c comprising three sets of two rows of coefficients from the HL 2 , HH2 and LH2 subbands and three sets of four rows of coefficients from the HLi, HHi and LHi subbands, respectively.
  • the texture unit comprises 3x2' row(s) of coefficients.
  • FIG. 4 shows an example of "depth 2" texture units, where all texture units contain the same number of coefficients.
  • FIG. 4 illustrates a texture unit 420a comprising coefficients across two subbands, HL4 and HL3.
  • FIG. 4 illustrates a texture unit 420a comprising coefficients across two subbands, HL4 and HL3.
  • each of these texture units is shown as being encoded onto a texture packet 400 having a header 410, a texture unit 420.
  • a single texture unit 420 is shown encoded onto a single texture packet, there may be situations where it is desirable to encode more than one texture unit onto a single texture packet, e.g. , small texture units.
  • the packet may comprise a marker 425 to demarcate the separation of two texture units 420.
  • the present texture unit formation yields fixed size texture units. If an image is hierarchically subband decomposed into "N" levels, a texture unit is formed as a subtree structure of depth "n" (n ⁇ N) with a single coefficient as the root of the subtree, where n can vary from image to image.
  • the formation of texture units can start either from the highest AC band or from the lowest AC band. It is possible that (N MOD n ) ⁇ 0, thus some texture units will have only (N MOD n ) depth. If these texture units are too small, they can be combined with the next texture unit in coding order onto the same packet as shown in packet 400. With the new texture unit formation, the coding order of coefficients is such that all coefficients within a texture unit are coded before coding the next texture unit.
  • FIG. 5 shows an example of "depth 3" texture units that are formed from the highest AC bands.
  • FIG. 6 is a schematic illustration of a texture unit 620 comprising of DC coefficients that are encoded in accordance with bitplanes, e.g. , four bitplanes for each color components (Y, U, V).
  • the texture unit 620 is also shown disposed within a packet structure 600.
  • each texture unit 620 is defined as comprising only those bits from the DC transform coefficients that form a single bitplane.
  • the DC component LL 3 for each image can be represented in three color components: luminance (Y) , Cr (U), and Cb (V). It should be noted that the color components Cr, and are typically defined as being one-fourth the size of the corresponding luminance color component.
  • a bitplane bn is defined as comprising those bits from the DC transform coefficients that are of common "significance".
  • FIG. 9 illustrates 16 DC coefficients for the Y color component and four corresponding DC coefficients for each of the U and V color components. The non-zero coefficient values are expressed in binary form as an example.
  • the most significant bit (MSB) of each DC coefficient of the Y color component form one bitplane, which also is defined as a texture unit in this embodiment.
  • the next bitplane bn+i is formed from the next most significant bit (MSB) of each DC coefficient of the Y color component and so on. Therefore, FIG. 9 illustrates 12 possible bitplanes that correspond to 12 texture units 620a-lof FIG.
  • the number of bitplanes is dependent on the maximum magnitude of the DC coefficients. Since the DC band carries more important coefficients as compared to high frequency AC coefficients, the present embodiment of defining a texture unit for the DC coefficients based on each bitplane greatly increases error resiliency. Namely, the lost of one corrupted texture unit will only result in a partial loss of information for each DC coefficient. Thus, by using various error recovery or error concealment methods, error resiliency can be maximized for the important DC coefficients by defining each texture unit as comprising only those bits from the DC transform coefficients that form a single bitplane.
  • a single texture unit 620 is shown encoded onto a single texture packet, there may be situations where it is desirable to encode more than one texture unit onto a single texture packet, e.g., small texture units.
  • the packet may comprise a marker 625 to demarcate the separation of two texture units 620.
  • the size, shape and levels of resolution can be selectively defined for a texture unit in accordance with a particular application using one of the above texture unit formation embodiments.
  • the target packet size varies in accordance with subbands and decomposition levels. Specifically, a smaller packet size is employed for the more important coefficients and a larger packet size is employed for the less important coefficients. In the context of hierarchical subband coding, a smaller packet size is employed for the lower frequency subbands and a larger packet size is employed for the higher frequency subbands.
  • This embodiment provides greater error protection because the effect from the loss of an "important" texture packet is minimized due to its reduced packet size, i.e. , losing less information for each corrupted important packet. More specifically, the present embodiment employs a small packet size of N bits for the lowest frequency subband, e.g., LL 3 . Next, the packet size is increased to "a" x N, where "a" is greater than or equal to 1 for the subbands of the next decomposition level, e.g., HL 3 , HH 3 , and LH 3 and so on. It should be noted that in the present invention, the coding of coefficients means the coding of the coefficient values and/ or the significant symbols (e.g. , if zerotree encoding is employed).
  • zerotree encoding is an example of an encoding method that employs wavelet transform to generate a plurality of wavelet coefficients with "coefficient significance information" in the form of a significance map.
  • the significance map is entropy coded using a plurality of symbols: ZEROTREE ROOT (ZTR), VALUED
  • ZEROTREE ROOT VZTR
  • ISOLATED ZERO IZ
  • VALUE ZEROTREE ROOT
  • a ZEROTREE ROOT symbol denotes a coefficient that is the root of a zerotree.
  • a VALUED ZEROTREE ROOT symbol is a node where the coefficient has a non-zero value and all four children are ZEROTREE ROOTS.
  • An ISOLATED ZERO symbol identifies a coefficient with zero value, but with some descendant somewhere further along with a nonzero. Furthermore, if a leave has a zero value, it can also be assigned as an ISOLATED ZERO.
  • a VALUE symbol identifies a coefficient with a non-zero value, but also with some descendant somewhere further along the tree that has a non-zero value.
  • FIG. 7 illustrates a block diagram of an encoding system 700 and a decoding system 760 of the present invention.
  • the encoding system 700 comprises a general purpose computer 710 and various input/output devices 720.
  • the general purpose computer comprises a central processing unit (CPU) 712, a memory 714 and an encoder /packetizer 716 for encoding and packetizing an image, video and/or audio signal.
  • CPU central processing unit
  • memory 714 for encoding and packetizing an image, video and/or audio signal.
  • the encoder/packetizer 716 is simply the video encoder 220, the audio encoder 222 and/or the packetizer 230 as discussed above in FIG.
  • the encoder/packetizer 716 can be physical devices which are coupled to the CPU 712 through a communication channel.
  • the encoder/packetizer 716 can be represented by a software application (or a combination of software and hardware, e.g., using application specific integrated circuits (ASIC)), where the software is loaded from a storage medium, (e.g. , a magnetic or optical drive or diskette) and operated by the CPU in the memory 714 of the computer.
  • ASIC application specific integrated circuits
  • the encoder/packetizer 716 of the present invention can be stored on a computer readable medium.
  • the packets 300 through 600, which are generated by the encoder/packetizer 716 can also be stored on a computer readable medium, e.g., RAM memory, magnetic or optical drive or diskette and the like.
  • the computer 710 can be coupled to a plurality of input and output devices 720, such as a keyboard, a mouse, an audio recorder, a camera, a camcorder, a video monitor, any number of imaging devices or storage devices, including but not limited to, a tape drive, a floppy drive, a hard disk drive or a compact disk drive.
  • input and output devices 720 such as a keyboard, a mouse, an audio recorder, a camera, a camcorder, a video monitor, any number of imaging devices or storage devices, including but not limited to, a tape drive, a floppy drive, a hard disk drive or a compact disk drive.
  • the encoding system is coupled to the decoding system via a communication channel 750.
  • the present invention is not limited to any particular type of communication channel.
  • the decoding system 760 comprises a general purpose computer 770 and various input/output devices 780.
  • the general purpose computer comprises a central processing unit (CPU) 772, a memory 774 and an decoder/depacketizer 776 for receiving and decoding a sequence of encoded images.
  • the decoder/depacketizer 776 is simply any decoders that are complementary to the encoder/packetizer 716 as discussed above for decoding the bitstreams generated by the encoder/packetizer 716.
  • the decoder 776 can be a physical device which is coupled to the CPU 772 through a communication channel.
  • the decoder/depacketizer 776 can be represented by a software application which is loaded from a storage device, e.g. , a magnetic or optical disk, and resides in the memory 774 of the computer.
  • any of complementary decoders of the encoder/packetizer 716 of the present invention can be stored on a computer readable medium.
  • the computer 760 can be coupled to a plurality of input and output devices 780, such as a keyboard, a mouse, a video monitor, or any number of devices for storing or distributing images, including but not limited to, a tape drive, a floppy drive, a hard disk drive or a compact disk drive. These input/output devices allow the computer to store and distribute the sequence of decoded video images.
  • input and output devices 780 such as a keyboard, a mouse, a video monitor, or any number of devices for storing or distributing images, including but not limited to, a tape drive, a floppy drive, a hard disk drive or a compact disk drive.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

Cette invention a trait à un dispositif (200) ainsi qu'à un procédé de formation d'une structure de données améliorant la résistance aux erreurs une fois appliquée au codage de coefficients décomposés de sous-bande hiérarchique, par exemple des coefficients de transformée d'ondelette. L'unité de texture (320) est définie comme ne comprenant que les coefficients de transformée AC se trouvant dans une tranche, sinon dans plusieurs, d'une sous-bande unique. Cette unité de texture est également définie comme ne comprenant que les coefficients de transformée AC se trouvant dans « n » sous-bandes, « n » étant inférieur au nombre total de « N » niveaux de décomposition. Il est également possible de définir un unité de texture (320) comme ne comprenant que les bits provenant du coefficient de transformée DC formant un seul plan de mémoire d'image.
PCT/US1999/022889 1998-10-05 1999-10-01 Dispositif et procede de formation d'une unite de codage WO2000021291A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
AU17047/00A AU1704700A (en) 1998-10-05 1999-10-01 Apparatus and method for forming a coding unit
JP2000575301A JP2002527956A (ja) 1998-10-05 1999-10-01 符号化単位形成装置と方法
EP99960111A EP1118218A4 (fr) 1998-10-05 1999-10-01 Dispositif et procede de formation d'une unite de codage

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US10308198P 1998-10-05 1998-10-05
US60/103,081 1998-10-05
US12360099P 1999-03-10 1999-03-10
US60/123,600 1999-03-10

Publications (2)

Publication Number Publication Date
WO2000021291A1 true WO2000021291A1 (fr) 2000-04-13
WO2000021291A8 WO2000021291A8 (fr) 2000-07-20

Family

ID=26800071

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/022889 WO2000021291A1 (fr) 1998-10-05 1999-10-01 Dispositif et procede de formation d'une unite de codage

Country Status (4)

Country Link
EP (1) EP1118218A4 (fr)
JP (1) JP2002527956A (fr)
AU (1) AU1704700A (fr)
WO (1) WO2000021291A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8842734B2 (en) 2009-08-14 2014-09-23 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5168356A (en) * 1991-02-27 1992-12-01 General Electric Company Apparatus for segmenting encoded video signal for transmission
US5796743A (en) * 1993-11-30 1998-08-18 General Electric Company Data word indicator in a system for assembling transport data packets
US5808570A (en) * 1996-06-28 1998-09-15 Philips Electronics North America Corp. Device and method for pair-match Huffman transcoding and high-performance variable length decoder with two-word bit stream segmentation which utilizes the same

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0715609A (ja) * 1993-06-17 1995-01-17 Toshiba Corp 画像伝送方法並びに画像送信装置、画像受信装置および画像伝送装置
GB2281465B (en) * 1993-08-27 1997-06-04 Sony Uk Ltd Image data compression
GB2295936B (en) * 1994-12-05 1997-02-05 Microsoft Corp Progressive image transmission using discrete wavelet transforms
JPH09182085A (ja) * 1995-10-26 1997-07-11 Sony Corp 画像符号化装置、画像復号装置、画像符号化方法、画像復号方法、画像伝送方法及び記録媒体
JPH09261644A (ja) * 1996-03-22 1997-10-03 Matsushita Electric Ind Co Ltd ウエーブレットビデオ符号化方法
JP3637993B2 (ja) * 1996-06-05 2005-04-13 株式会社リコー 画像符号化装置及び画像復号化装置
US6339658B1 (en) * 1999-03-09 2002-01-15 Rockwell Science Center, Llc Error resilient still image packetization method and packet structure

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5168356A (en) * 1991-02-27 1992-12-01 General Electric Company Apparatus for segmenting encoded video signal for transmission
US5796743A (en) * 1993-11-30 1998-08-18 General Electric Company Data word indicator in a system for assembling transport data packets
US5808570A (en) * 1996-06-28 1998-09-15 Philips Electronics North America Corp. Device and method for pair-match Huffman transcoding and high-performance variable length decoder with two-word bit stream segmentation which utilizes the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1118218A4 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8842734B2 (en) 2009-08-14 2014-09-23 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video
US8953682B2 (en) 2009-08-14 2015-02-10 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video
TWI474722B (zh) * 2009-08-14 2015-02-21 Samsung Electronics Co Ltd 視訊編碼方法與裝置及視訊解碼方法與裝置
US9307238B2 (en) 2009-08-14 2016-04-05 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video
US9313490B2 (en) 2009-08-14 2016-04-12 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video
US9313489B2 (en) 2009-08-14 2016-04-12 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video
US9374579B2 (en) 2009-08-14 2016-06-21 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video

Also Published As

Publication number Publication date
EP1118218A1 (fr) 2001-07-25
JP2002527956A (ja) 2002-08-27
WO2000021291A8 (fr) 2000-07-20
AU1704700A (en) 2000-04-26
EP1118218A4 (fr) 2004-08-25

Similar Documents

Publication Publication Date Title
US7606434B2 (en) Apparatus and method for forming a coding unit
US6137915A (en) Apparatus and method for error concealment for hierarchical subband coding and decoding
US6487319B1 (en) Apparatus and method for identifying the location of a coding unit
US6526175B2 (en) Apparatus and method for packetizing significance-based information
US6553147B2 (en) Apparatus and method for data partitioning to improving error resilience
US7120306B2 (en) Image processing method and image coding apparatus utilizing the image processing method
US20030206557A1 (en) Error-resilient video transmission system for wireless LAN utilizing data partitioning and unequal error protection
JPH11122617A (ja) 画像圧縮
US20050244068A1 (en) Encoding method, decoding method, encoding device, and decoding device
US8331708B2 (en) Method and apparatus for a multidimensional discrete multiwavelet transform
US7580582B2 (en) Methods for decoding corrupt JPEG2000 codestreams
JP2000032464A (ja) 画像圧縮
EP1118218A1 (fr) Dispositif et procede de formation d'une unite de codage
EP1119977B1 (fr) Appareil et procede de partitionnement de donnees destines a ameliorer la tolerance aux erreurs
Baccaglini et al. Robust distributed storage of Digital Cinema contents
Yuan Wavelet video coding with application in network streaming
Cai et al. Layer based multiple description packetized coding
MILOVANOVIC et al. DEVELOPMENT OF WAVELET TECHNIQUES IN JPEG2000 IMAGE CODING STANDARD

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref country code: AU

Ref document number: 2000 17047

Kind code of ref document: A

Format of ref document f/p: F

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: C1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

CFP Corrected version of a pamphlet front page

Free format text: REVISED ABSTRACT RECEIVED BY THE INTERNATIONAL BUREAU AFTER COMPLETION OF THE TECHNICAL PREPARATIONS FOR INTERNATIONAL PUBLICATION

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 1999960111

Country of ref document: EP

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2000 575301

Kind code of ref document: A

Format of ref document f/p: F

WWP Wipo information: published in national office

Ref document number: 1999960111

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 1999960111

Country of ref document: EP